Commit Graph
1431 Commits
Author SHA1 Message Date
Ilya Lavrenov e57a455b92 Added support of external modules in static build (#8518)
* Added support of external modules in static build

* Enable template plugin static run; disabled CPU tests run in dynamic build

* Make FEM library dynamic

* Fixed static build

* clang-format

* Fixed targets

* Python tests fix

* Fixed python API tests skip

* Fixed pattern

* Fixed pattern 2

* Don't run template plugin tests in static build
2021-11-12 08:56:57 +03:00
Eugeny Volosenkov f46e8bb3f8 Ngraph/fix serializer (#8461)
* Fix serializer

* Fix code style

* add test for bodies without parameters]
2021-11-11 22:06:19 +03:00
Tomasz Dołbniak 0e7eef3c88 ONNX MaxPool (opset 8+) (#7100) 2021-11-11 14:48:32 +03:00
Ilya Churaev 0017ec71fd Added hash to type_info (#8175)
* Added hash to type_info

* Fast hash

* Fixed tests

* Added new tests

* Fixed build

* Fix centos

* Fixed segfault

* Fixed test

* Fixed build

* Revert "Fix centos"

This reverts commit c739e923aa.

* Try to fix cent os

* Fixed style

* Fixed GCC 4.8

* Try to fix build

* Fixed code style

* remove constexpr from type construction

* Fixed tests

* Revert "Fixed tests"

This reverts commit 50aec37f95.

* Revert "remove constexpr from type construction"

This reverts commit 6c22d7ecfa.
2021-11-11 12:59:37 +03:00
Ilya Churaev f1ca728ab1 Deprecated set_* methods in desctiption::Tensor (#8510)
* Deprecated set_* methods in desctiption::Tensor

* Fix code style

* Fixed tests
2021-11-11 09:52:59 +03:00
Ilya Lavrenov 461f746430 Install rules for static libraries case (#8384)
* Proper cmake install for static libraries case

* Added an ability to skip template plugin

* Added install rules for VPU / GPU

* Install more libraries

* Fixed absolute TBB include paths

* Disable GNA

* Fixed issue with linker

* Some fixes

* Fixed linkage issues in tests

* Disabled some tests

* Updated CI pipelines

* Fixed Windows linkage

* Fixed custom_opset test for static casr

* Fixed CVS-70313

* Continue on error

* Fixed clanf-format

* Try to fix Windows linker

* Fixed compilation

* Disable samples

* Fixed samples build with THREADING=SEQ

* Fixed link error on Windows

* Fixed ieFuncTests

* Added static Azure CI

* Revert "Fixed link error on Windows"

This reverts commit 78cca36fd2.

* Merge static and dynamic linux pipelines

* Fixed Azure
2021-11-10 18:25:51 +03:00
Tomasz Jankowski cfdc4c1f3d Avoid redundant graph nodes scans (#8415) 2021-11-10 14:50:58 +01:00
Ilya Churaev 54c384db11 Updated common migration pipeline (#8176)
* Updated common migration pipeline

* Fixed merge issue

* Added new model and extended example

* Fixed typo

* Added v10-v11 comparison
2021-11-10 16:27:23 +03:00
Wilson Seok 35ba404bcb Migrate ngraph backend test/prior box (#8227)
* Remove fp16 of Convert layer test from skip_tests.config.cpp as it works now

* update repo

* add op reference test of prior_box/prior_box_clustered/reorg_yolo and remove ngraph backend test

* remove related backend test file
2021-11-10 15:28:41 +03:00
Andrey Sapozhnikov 286fefb956 [GNA] ActivationLayer tests enabled (#7920)
* [GNA] ActivationLayer tests in integer precision enabled

* Enabling some FP32 and FP16 ActivationLayerTests | Limiting Sign activation input values

* Refactoring activation tests
2021-11-10 14:20:43 +03:00
Tomasz Dołbniak aa5a220ea0 Pad reference implementation fix so that it doesn't segfault the ONNX tests runner (#8483) 2021-11-10 14:02:15 +03:00
Ilya Churaev 6a89eb2844 Change frontends namespace to ov (#8434)
* Changed namespace from ngraph to ov for OV Frontends

* Fixed python

* Fixed ONNX Editor for windows

* Try to fix centos

* Fixed code style

* Revert frontend loader
2021-11-10 12:48:37 +03:00
Anton Chetverikov c8e1c8e3eb [MO|nGraph]GatherND_8 (#7743)
* Add GatherND_8 operation

* Update shape infer function and tests

* Initial commit for nGraph GatherND_8 operation

* Add GatherNDBase class implementation

* Fix base class errors

* Add missrd header

* Update base class

* Update GatherND_8 implementation

* Fix codestyle

* Fix wrong rank

* Implement tests for gatherND_8 shape inference function

* fix codestyle

* Add limitation to doc

* Siplyfy check in shape inference

* Add more test cases

* Update shape inference function

* Add more test cases to cover all case with dynamic input shapes

* Update shape inference function

* Refactor tests

* Add visitor tests for gatherND_8 operation

* Correct comment

* Add additional check is shape inference function

* Update shape inference implementation for gathernd operartion

* Fix codestyle

* Remove restriction for data is fully defined

* Update shape inference functon

* Fix missed check for nonetype

* Remove redundant checks for batch_dims

* Fix codestyle
2021-11-10 11:54:52 +03:00
Ilya Churaev e298775a89 Fixed fuzz tests (#8443) 2021-11-10 11:11:44 +03:00
Ilya Churaev 512db063a8 New extension serialization (#8252)
* Fixed custom op serialization

* Deprecate old serialize constructor
2021-11-10 07:15:30 +03:00
Ilya Churaev 97a4b944b1 Fixed coverity issues (#8448) 2021-11-10 06:17:43 +03:00
Gleb Kazantaev ce51b62b70 Fix PartialShape Iterators to reset cache (#8453) 2021-11-09 21:11:54 +03:00
Gleb Kazantaev eb2b149fca Fix RTInfo Deserialization for multiple key occurances (#8455) 2021-11-09 21:09:48 +03:00
Maxim Vafin 34886b650d Add model compression to FP16 weights (#7588)
* Add model compression to FP16 weights

* Fix build

* Fix build

* Fix build

* Add wrapper over ConvertPrecision

* Add documentation to attributes

* Fix MO IR Reader

* Fix build

* Return DisableDecompressionConvertConstantFolding call in CommonOptimizations

* Temporarily disable old_api map

* Fix TI Convert issue

* Apply review feedback

* Fix build

* Fix build

* Fix build
2021-11-09 19:37:41 +03:00
Tomasz Dołbniak 6780dfcba7 Update of ONNX submodule to v1.10.2 (#8383)
* Update of ONNX submodule to v1.10.0

* Update of ONNX to 1.10.2

* Adaptation of the ONNX FE to ONNX 1.10

* ConstantOfShape XFAIL removal

* SCEL reference model updated to the new ONNX functions expansion behavior

* UnXFAIL more ONNX tests

* UnXFAIL even more ONNX tests
2021-11-09 12:53:34 +03:00
Vladislav Golubev 62b084a524 FullyConnectedNode: deserialization fix (#8345)
* FullyConnected deserialization fix

* Added test-case with MatMul to caching tests

* postreview fixes
2021-11-09 12:14:36 +03:00
5dacaa386f [TF FE] Port operation loaders and refactor preliminary versions (#8150)
* Migrate POC for TensorFlow frontend

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Refactor InputModelTensorFlow API

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Repack POC to official API

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Remove tensorflow API from public include

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Make TF frontend work from MO and clean-up code

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Apply codestyle

* Fix win biuld

* Fix Linux build

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Implement Place class

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Determine outputs from graph

* Implement all Place classes

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Make small clean-up

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Apply code-style corrections

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Determine cut nodes

* Apply codestyle

* Rework to use places

* Fix conversion issue

* Fix build

* Fix conversion

* Small fixes

* Add test for tf frontend

* Add tests

* Implement partial conversion

* Use dynamic type in TFFrameworkNode

* Fix build on Linux

* Implement InputModelTF class

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Fix code by replacing InputModelTensorFlow to InputModelTF

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Fix to pass getPlaceByTensorName test

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Refactor and clean the code

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Finalize refactoring code

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Support freezing inputs

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Add support for pruning input ports as new model output

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Apply code-style fixes

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* move op convertors to separate files, refactoring

* openvino codestyle

* openvino codestyle

* fix crash of layer tests

* fix missprint

* Implement TensorFlow NodeContext and DecoderTFProto classes

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Switch to new NodeContext

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Remove ngraph_builder class and node_context_impl class

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Move decoder/graph_iterator to separate files and remove old files

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Document Decoder, GraphIterator, and NodeContext classes

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Apply code style

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Remove empty file graph_iterator_proto.cpp and redundant comments

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Use base class for GraphIterator in model class and correct exception class

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Use ends_with from util library

* Remain only InputModelTF constructor with GraphIterator and adopt other code

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Correct code after merge

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Apply code style

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Fix code based on feedback: delete extra namespace usage, etc.

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* refactoring of tf FrontEnd: rename namespaces, delete default opset

* codestyle

* fix e2e tests

* change namespaces of external classes

* resolve review comment

* codestyle

* Enable translators for Size,Shape,Rank,Range,Reshape ops

* Add translators for MatMul,Reciprocal,Square,XdivY ops

* enable Translators for Where,Log1p, Transpose, ZerosLike, Pack ops

* Enable Split,IsFinite,Tile ops, refactor Reduce ops

* Add Reverse,Round ops

* fix codestyle

* Enable Unpack, L2Loss ops

* Add LRN, GatherND, TopK ops, fix Reduce ops

* codestyle

* Revising of StridedSlice,SplitV,SpaceToDepth ops

* Add Concat,FusedBatchNormEx,Slice,SpaceToDepth ops

* Add Interpolate,BatchToSpaceNd,SpaceToBatchNd,NonMaxSuppression ops support

* codestyle

* Port CropAndResize,FakeQuantMinMaxVars,FusedDepthwiseConv2d

* fix translators

* codestyle

* Resolve review remarks

* fix wrong merge

* fix incorrect merge, refactoring

* add LeakyRelu op

* codestyle

* Add LogicalXor operation

* Add support for Swish op, set correct tensor names, refactoring

* fix incorrect merge

* codestyle

* fix unit tests

* fix build

* Refactoring

* codestyle

* fix win build

* fix reduce op

* Investigate failures on Windows

* add debug prints

* debug prints

* debug prints

* Delete debug prints

* clean up

* clean up

* codestyle

* delete debug changes

* Delete redandant comments

* rename utils functions

* rename translators

* rename layout convertors

* resolve review comments

* resolve review comments:

* codestyle

* rename NodeContext methods

* add todo comment

* Remove internal tf ops from op_table

* fix decode

Co-authored-by: Roman Kazantsev <roman.kazantsev@intel.com>
Co-authored-by: Maxim Vafin <maxim.vafin@intel.com>
2021-11-08 13:46:19 +03:00
Ilya Lavrenov 279d905011 Fixed interpolate to work with int32 axes, target_shapes (#8379) 2021-11-08 13:40:54 +03:00
mei, yang b2523b1c01 remove paddle mul op converter (#8190) 2021-11-08 07:16:12 +03:00
Michał Karzyński db27dcce94 Remove NGRAPH_USE_PROTOBUF_LITE option, always use Lite (#8286) 2021-11-03 18:22:20 +03:00
165ce3eeea Add support for ONNX RandomNormal and RandomNormalLike operators (#8024)
Co-authored-by: Tomasz Dołbniak <tomasz.dolbniak@intel.com>
Co-authored-by: Tomasz Jankowski <tomasz1.jankowski@intel.com>
2021-11-03 15:50:35 +03:00
Steve Yoo e3f1813e5c Migrate Movement 2 (GatherElements-6, GatherND-5) (#8282) 2021-11-03 08:02:19 +03:00
Steve Yoo bd756df2f5 Migrate ngraph backend test of constant operation (#7996)
* Add test cases for PReLU in cpu plugin

* For case when slope is vector

* Add Constant template plugin reference tests

* Update CMakeLists.txt and delete constant.in.cpp

* Add tests of tensor_2constant and constant_multi_use

* Add test of constant_equality_bool

* Remove wrong comments

* Remove some of strange if

* Merge to one CreateFunction

* Remove test names and update test for types

* Add bf16 and f64 tests

* Add missing type tests

* Clear actualOutData to allow multiple use of Validate()

* Update SetUp and CreateFunction to support CentOS CI

* Remove inputData = {}
2021-11-03 07:52:59 +03:00
Ilya Lavrenov 384eea4eda Static version: plugin registration as extension (#8365)
* Load CPU plugin as extension as well

* Fixed linkage issues

* Added static linux build

* Disabled GPU
2021-11-02 16:07:45 +03:00
Tomasz Jankowski de4ceba375 [ONNX FE] Add implementation of Frontend API methods for naming and annotation (#8026) 2021-11-02 09:35:04 +01:00
Wilson Seok 75c6af7af5 Migrate ngraph backend test/experimental detectron detection & experimental detectron generate proposals (#8264)
* Remove fp16 of Convert layer test from skip_tests.config.cpp as it works now

* update repo

* add op reference test of experimental_detectron_detection_output and experimental_detecteion_generate_proposals and remove ngraph backend test

* modify visitor api test of experimental_detectron_detection for clang-format

* modify visitor api test of experimental_detectron_detection for clang-format again

* modify visitor api test of experimental_detectron_detection for clang-format again2
2021-11-02 10:48:15 +03:00
Mang GuoandEvgenya Stepyreva 0a850ce73e [Shape infer] Implement ExperimentalDetectronTopKROIs shape infer (#7926)
* Implement ExperimentalDetectronROIs shape infer

* Fix review comments

* Update for review comments

Co-authored-by: Evgenya Stepyreva <evgenya.stepyreva@intel.com>
2021-11-02 05:32:46 +03:00
Ilya Churaev 4122ef50d6 Introduce OV Extension base api (#7562)
* Moved so loader to utils

* Fixed extension tests

* Fixed tests and style

* Fixed style and tests

* Fixed ARM build

* Fix windows

* Fix ieFuncTests

* Wrap runtime exception

* Fixed tests

* Added separate new extension

* Fixed unicode extension loading

* Try to fix windows

* Fixed windows

* Fixed macro

* Fixed doc

* Fixed build

* Fixed comments

* Try to fix build

* Fixed build

* Fixed build

* Fixed shared_from_this

* Temp commit

* Changed extension

* Fixed merge conflicts

* Removed ngraph namespace from new extensions

* Fixed code style

* Added core add_extension methods and tests

* Added new tests

* Implement tile operation

* Enabled new extensions support

* Fixed build

* Fixed code style

* Try to fix windows

* Changed base extension class

* Removed redundant Ptr

* Fixed comments

* Fixed friend decl

* Fixed Windows export

* Fixed centos

* Added template add_extension method

* Move destructor to public

* Removed BaseExtension class

* Added variadic add_extension methods

* Fixed doc and typo

* Added BaseOpDestructor

* Allow to create new extension only for new operations

* Revert tests

* Fixed comments

* Fixed comments

* Fixed comment

* Added SO Extension wrapper
2021-11-01 10:36:30 +03:00
Ilya Churaev 94206b9e2d Removed redundant evaluate methods (#8283)
* Removed redundant evaluate methods

* Added If to eval map

* Disable unsupported test cases
2021-11-01 09:08:32 +03:00
Wilson Seok 3775efd54a Migrate ngraph backend test/detection output (#8111)
* Remove fp16 of Convert layer test from skip_tests.config.cpp as it works now

* update repo

* add op reference test of detection_output

* update op reference test and remove ngraph backend test

* make up the reference test data
2021-11-01 07:21:28 +03:00
Steve Yoo ff713a5e01 Migrate Movement 1 Operations (Transpose-1) (#8135)
* Migrate Transpose-1

* Skip dynamic shape tests

* Add shapes to tensors
2021-11-01 05:52:14 +03:00
Steve Yoo 05dfee0a70 Migrate Movement 1 Operations (VariadicSplit-1) (#8091)
* Migrate VariadicSplit

* Skip dynamic shape tests

* Add shapes to tensors
2021-11-01 05:42:10 +03:00
Evgenya Stepyreva d50a40cd09 Shape inference (#8307)
* Convolution update

* Adds pragma once

* Reductions shape infer

* Shape nodes

* style
2021-11-01 05:39:57 +03:00
Wilson Seok f912a8102d Migrate ngraph backend test/psroi pooling/deformable psroi pooling/proposal (#8152)
* Remove fp16 of Convert layer test from skip_tests.config.cpp as it works now

* update repo

* add op reference test of psroi_pooling and deformable_psrio_pooling

* update op reference test

* remove ngraph backend test

* add op reference test of proposalV1 and proposalV4

* update skip_test_config.cpp to avoid failure of accuracy drop in fp16/bf16 test case of proposal
2021-11-01 04:47:42 +03:00
David Nam cc457e003e Migrate normalization to template plugin test (#8240)
* Migrate normalization to template plugin test

* Migrate result, parameter to template plugin test
2021-10-30 17:58:33 +03:00
David Nam a429044038 Migrate signals to template plugin test (#8279)
* Migrate signals to template plugin test

* Use AutobroadcastType::NONE instead of AutobroadcastSpec::NONE

* Remove unused variable

* Fix cpplint error

* Remove unused variable
2021-10-29 13:01:42 +03:00
David Nam b2b9d9f2c7 Migrate MatMul to template plugin test (#8253) 2021-10-29 13:00:30 +03:00
Steve Yoo 5c2ef7268b Migrate Movement 1 Operations (Reverse-1, Split-1) (#8079)
* Migrate Reverse-1 and Split-1

* Separate classes for each exception test case
2021-10-29 12:49:41 +03:00
Piotr Szmelczynski c729a6bfca [PYTHON] Expose Layout class (#7578)
* Create binding for Layout class

* add import of Layout to __init__

* add Layout to pyngraph.cpp

* create test for Layout

* fix typo

* fix style

* clean file

* fix style

* add Layot import to ngrapph init

* remove const char* init

* style fix

* move Layout from pyngraph/ to pyopenvino/graph

* style fix

* add doc() and args to Layout

* add Layout to openvino init

* fix style

* change import name

* fix import

* add __str__ impl

* remove duplicate

* style fix

* update test_layout

* add eq and ne operators

* create test for eq and ne operators

* fix style

* update copyright year
2021-10-28 19:46:50 +03:00
Ilya Lavrenov 8fb699a42c Static compilation for inference plugins (#8197)
* 1. Removed explicit SHARED from libraries
2. Fixed double definition for ie_layer_validators

* Fixed SEG in unit-test: order of initialization for global vars

* Added an ability to find plugins.xml from static IE

* Fixes in unit-test

* Migrated to new macro for import / export

* Minimized number of custom dllexport

* Don't use IR v7 for static libraries

* Revert for merge

* Don't enable tests with dlopen for static libraries

* Code style

* Added condition for export

* Revert format_reader

* Removed forward decalaration with external linkage

* Fixed IE linkage on Windows

* Reverted back 2 flags

* Minimal RRTI for cpuFuncTests

* Minimal RRTI for cpuFuncTests

* Still need IR v7 reader

* Fixed build

* Fixed compilation

* clang-format fix

* Removed BUILD_AS_IS and used USE_STATIC_IE

* Enable IR v7 reader as static library

* Fixed compilation for GPU plugin

* Trying to build plugins as static library

* Plugins are able provide their own name for CreatePluginEngine function

* Fixed CPU

* Fixed comments

* Fixed ENABLE_IR_V7_READER usage

* Fixed VPU

* clang-format

* Fixes

* Fix

* Load multiple plugins at once

* Fixed interpreter undefined symbols

* Trying to dynamically register static plugins

* Reverted some ngraph changes

* Fixed cpuUnitTests compilation

* Fixed compilation

* Fixed myriad

* Fixed custom_opset tests

* Reverted linker flags

* Support both static and dynamic plugins

* Fixed compilation of myriadFuncTests

* Removed duplication

* Fixes after self-review

* Fixed linkage for preprocessing

* Fixes for Windows

* Fixes

* Fixed cmake options

* Fix

* Fix

* Fix 2
2021-10-28 11:33:56 +03:00
Mikhail Nosov 5cb2174721 Layout: add _idx suffix for helper getters (#8196)
'layout::width' -> 'layout::width_idx', etc
2021-10-28 11:26:55 +03:00
David Nam d198d57fe1 Migrate pooling to template plugin test (#8136)
* Migrate pooling to template plugin test

* Fix clang format

* Fix clang style error

* Fix clang style error

* Remove unused variable

* Fix cpplint error

* Fix CI build error

* Remove max_pool.in.cpp
2021-10-28 09:45:12 +03:00
Steve Yoo 6f862822e1 Migrate Movement 1 Operations (ScatterNDUpsate-1) (#8116)
* Migrate ScatterNDUpsate-1

* Remove round.in.cpp
2021-10-28 08:42:50 +03:00
Ilya Lavrenov fe457aa59c Wmissing declarations for core OpenVINO (#8242)
* Fixed common libraries

* Enable flags only for ngraph, FEM, plugins and IE

* Fixed OpenVINOConfig.cmake

* Fixes for plugins

* Fixed link stage
2021-10-27 22:45:16 +03:00
Mikhail Nosov 846d1e0467 [OV2.0+Bugfix] Layout serialization + Fix caching issues with auto-generated friendly names (#8153)
* Fix caching issues with auto-generated friendly names

Introduce "HashPass" to calculate hash like a serialize but without auto-generated friendly names
IE Compilation context: use HashPass to calculate hash of ov::Function
IE Compilation context tests: removed "friendly names" from tests
Layout: serialization support + tests
Parameter/Result: update set/get_layout according to layout changes

* Fix clang

* Tiny correction of CmakeLists

* Renamed VariantWrapper<Layout> to LayoutAttribute
Removed test for conversion from/to fully dynamic layout (allowed now and does nothing)
'set_layout' - remove layout runtime info if empty layout is passed. This allows hashes to be the same if set_layout(param->get_layout()) is called

* Fix build

* change size_t to uint64_t for hash value
Using size_t leads to high probability of conflict for 32-bit platforms

* Removed debug print

* Fix hash calculation for 32-bit platforms

* Fix review comment
2021-10-27 21:05:06 +03:00