* Initial optimization implementation
* Add tests
* Updated function and node accessors
* Avoid using static mutex in get_ordered_ops
* Apply comments
* resolve PR comments
* Move mutex up
* Simplify shared info
* Fix info copying in node copy c-tor
* Move friend declarations to public
* Fix to support node access from multiple functions in different threads
* Enable LTO for oneDNN GPU
* Use importer target for onednn_gpu
* Fixed install of OpenCL, ittapi
* Try to enable samples build
* Fixed ie_wheel build
* Disabled samples
* Fixed incorrect install of pugixml in dynamic build
* Fixed clDNN_unit_tests64 link
* Minimized a number of hardcoded paths
* Switched off ITT
* Disable TBBBind for static Windows
* Fixed link on Windows
* Fixes
* Static build for Window
* Disable unit-tests
* Disabled TF
* Fixed add dependency for PDPD unit tests
* Disabled GNA
* Enabled ngraph test utils
* Fixes
* Fixes
* Disable clDNN for static build on Windows
* Dynamic MCVS runtime for OpenCL
* Disable ITT traces for static libs
* Ability to switch TBBBind_2_5 OFF
* Disabled GPU on Windows build
* Fixed libGNA link
* Disabled some GNA tests
* Fixed multiple definitions issue
* Hide FrontEnd::load in DLL
* Install libGNAStubs
* Trying to fix Windows
* Trying to fix frontends
* Passed compilation on Windows
* Updated install rules for ngraph backends
* Try CPU, TEMPLATE tests
* Enabled unit-tests
* Enabled ngraph tests
* Try to fix unit-test
* Fixed unit-test on Linux
* Fixed compilation with ENABLE_IR_V7_READER=OFF
* Fixed tests on Linux
* Enable cpuFuncTests only in static build
* Try to fix testMockPluginFrontEnd test
* Try to enable TF
* Fixed python tests
* Partial revert
* Removed OV_FRONTEND_PATH
- PrePostProcessor takes 'function' argument in constructor
- PrePostProcessor::build() doesn't take any function anymore
- PrePostProcessor::input() method to get reference to input
- PrePostProcessor::output() method to get reference to output
- InputInfo - add getters of tensor, preprocess, network
- OutputInfo - add getters of tensor, preprocess, network
Samples:
ClassificationSampleAsync - use new getters
Inference engine:
- Use new getters in ie_network_reader.cpp
TODO: Consider removal of builder-like API in PrePostProcessor, InputInfo, OutputInfo
* Add GatherND_8 operation
* Update shape infer function and tests
* Initial commit for nGraph GatherND_8 operation
* Add GatherNDBase class implementation
* Fix base class errors
* Add missrd header
* Update base class
* Update GatherND_8 implementation
* Fix codestyle
* Fix wrong rank
* Implement tests for gatherND_8 shape inference function
* fix codestyle
* Add limitation to doc
* Siplyfy check in shape inference
* Add more test cases
* Update shape inference function
* Add more test cases to cover all case with dynamic input shapes
* Update shape inference function
* Refactor tests
* Initial commit for gatherND_8 reference implementation
* Add visitor tests for gatherND_8 operation
* Add visitor tests for gatherND_8 operation
* Correct comment
* Add additional check is shape inference function
* Update shape inference implementation for gathernd operartion
* Fix codestyle
* Remove restriction for data is fully defined
* Update shape inference functon
* Add gatherND_8 reference to evaluate map
* Add tests for gathernd_8 reference in batch_dims > 1
* Fix codestyle
* Fix codestyle
* Fix missed check for nonetype
* Remove redundant checks for batch_dims
* Use get_shape method instead of get_input_shape in GatherND reference implementation call
* update reference implementation call
* Properly add GatherND_8 to test opset table
* Update GatherND reference implementation for support opset8 version
* Add unit tests for gatherND_8 reference implementation
* Update gatherND reference implementation call in evaluate map
* Mark failed tests for missed plugin gatherND_8 implementations
* Fix codestyle
* Fix codestyle
* Fix codestyle
* Update tests
* Move common methods to base class
* Fix codestyle
* Revert clone_with_new_input function moving
* Add more test for reference
* partially revert API changes
* revise LSTM spec
Signed-off-by: fishbell <bell.song@intel.com>
* add param check and related test case
Signed-off-by: fishbell <bell.song@intel.com>
* fix clang-format
Signed-off-by: fishbell <bell.song@intel.com>
* use static_cast to replace c style force conversion
Signed-off-by: fishbell <bell.song@intel.com>
* Proper cmake install for static libraries case
* Added an ability to skip template plugin
* Added install rules for VPU / GPU
* Install more libraries
* Fixed absolute TBB include paths
* Disable GNA
* Fixed issue with linker
* Some fixes
* Fixed linkage issues in tests
* Disabled some tests
* Updated CI pipelines
* Fixed Windows linkage
* Fixed custom_opset test for static casr
* Fixed CVS-70313
* Continue on error
* Fixed clanf-format
* Try to fix Windows linker
* Fixed compilation
* Disable samples
* Fixed samples build with THREADING=SEQ
* Fixed link error on Windows
* Fixed ieFuncTests
* Added static Azure CI
* Revert "Fixed link error on Windows"
This reverts commit 78cca36fd2.
* Merge static and dynamic linux pipelines
* Fixed Azure
* Add GatherND_8 operation
* Update shape infer function and tests
* Initial commit for nGraph GatherND_8 operation
* Add GatherNDBase class implementation
* Fix base class errors
* Add missrd header
* Update base class
* Update GatherND_8 implementation
* Fix codestyle
* Fix wrong rank
* Implement tests for gatherND_8 shape inference function
* fix codestyle
* Add limitation to doc
* Siplyfy check in shape inference
* Add more test cases
* Update shape inference function
* Add more test cases to cover all case with dynamic input shapes
* Update shape inference function
* Refactor tests
* Add visitor tests for gatherND_8 operation
* Correct comment
* Add additional check is shape inference function
* Update shape inference implementation for gathernd operartion
* Fix codestyle
* Remove restriction for data is fully defined
* Update shape inference functon
* Fix missed check for nonetype
* Remove redundant checks for batch_dims
* Fix codestyle
* Migrate POC for TensorFlow frontend
Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>
* Refactor InputModelTensorFlow API
Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>
* Repack POC to official API
Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>
* Remove tensorflow API from public include
Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>
* Make TF frontend work from MO and clean-up code
Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>
* Apply codestyle
* Fix win biuld
* Fix Linux build
Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>
* Implement Place class
Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>
* Determine outputs from graph
* Implement all Place classes
Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>
* Make small clean-up
Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>
* Apply code-style corrections
Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>
* Determine cut nodes
* Apply codestyle
* Rework to use places
* Fix conversion issue
* Fix build
* Fix conversion
* Small fixes
* Add test for tf frontend
* Add tests
* Implement partial conversion
* Use dynamic type in TFFrameworkNode
* Fix build on Linux
* Implement InputModelTF class
Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>
* Fix code by replacing InputModelTensorFlow to InputModelTF
Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>
* Fix to pass getPlaceByTensorName test
Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>
* Refactor and clean the code
Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>
* Finalize refactoring code
Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>
* Support freezing inputs
Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>
* Add support for pruning input ports as new model output
Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>
* Apply code-style fixes
Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>
* move op convertors to separate files, refactoring
* openvino codestyle
* openvino codestyle
* fix crash of layer tests
* fix missprint
* Implement TensorFlow NodeContext and DecoderTFProto classes
Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>
* Switch to new NodeContext
Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>
* Remove ngraph_builder class and node_context_impl class
Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>
* Move decoder/graph_iterator to separate files and remove old files
Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>
* Document Decoder, GraphIterator, and NodeContext classes
Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>
* Apply code style
Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>
* Remove empty file graph_iterator_proto.cpp and redundant comments
Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>
* Use base class for GraphIterator in model class and correct exception class
Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>
* Use ends_with from util library
* Remain only InputModelTF constructor with GraphIterator and adopt other code
Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>
* Correct code after merge
Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>
* Apply code style
Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>
* Fix code based on feedback: delete extra namespace usage, etc.
Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>
* refactoring of tf FrontEnd: rename namespaces, delete default opset
* codestyle
* fix e2e tests
* change namespaces of external classes
* resolve review comment
* codestyle
* Enable translators for Size,Shape,Rank,Range,Reshape ops
* Add translators for MatMul,Reciprocal,Square,XdivY ops
* enable Translators for Where,Log1p, Transpose, ZerosLike, Pack ops
* Enable Split,IsFinite,Tile ops, refactor Reduce ops
* Add Reverse,Round ops
* fix codestyle
* Enable Unpack, L2Loss ops
* Add LRN, GatherND, TopK ops, fix Reduce ops
* codestyle
* Revising of StridedSlice,SplitV,SpaceToDepth ops
* Add Concat,FusedBatchNormEx,Slice,SpaceToDepth ops
* Add Interpolate,BatchToSpaceNd,SpaceToBatchNd,NonMaxSuppression ops support
* codestyle
* Port CropAndResize,FakeQuantMinMaxVars,FusedDepthwiseConv2d
* fix translators
* codestyle
* Resolve review remarks
* fix wrong merge
* fix incorrect merge, refactoring
* add LeakyRelu op
* codestyle
* Add LogicalXor operation
* Add support for Swish op, set correct tensor names, refactoring
* fix incorrect merge
* codestyle
* fix unit tests
* fix build
* Refactoring
* codestyle
* fix win build
* fix reduce op
* Investigate failures on Windows
* add debug prints
* debug prints
* debug prints
* Delete debug prints
* clean up
* clean up
* codestyle
* delete debug changes
* Delete redandant comments
* rename utils functions
* rename translators
* rename layout convertors
* resolve review comments
* resolve review comments:
* codestyle
* rename NodeContext methods
* add todo comment
* Remove internal tf ops from op_table
* fix decode
Co-authored-by: Roman Kazantsev <roman.kazantsev@intel.com>
Co-authored-by: Maxim Vafin <maxim.vafin@intel.com>
* 1. Removed explicit SHARED from libraries
2. Fixed double definition for ie_layer_validators
* Fixed SEG in unit-test: order of initialization for global vars
* Added an ability to find plugins.xml from static IE
* Fixes in unit-test
* Migrated to new macro for import / export
* Minimized number of custom dllexport
* Don't use IR v7 for static libraries
* Revert for merge
* Don't enable tests with dlopen for static libraries
* Code style
* Added condition for export
* Revert format_reader
* Removed forward decalaration with external linkage
* Fixed IE linkage on Windows
* Reverted back 2 flags
* Minimal RRTI for cpuFuncTests
* Minimal RRTI for cpuFuncTests
* Still need IR v7 reader
* Fixed build
* Fixed compilation
* clang-format fix
* Removed BUILD_AS_IS and used USE_STATIC_IE
* Enable IR v7 reader as static library
* Fixed compilation for GPU plugin
* Trying to build plugins as static library
* Plugins are able provide their own name for CreatePluginEngine function
* Fixed CPU
* Fixed comments
* Fixed ENABLE_IR_V7_READER usage
* Fixed VPU
* clang-format
* Fixes
* Fix
* Load multiple plugins at once
* Fixed interpreter undefined symbols
* Trying to dynamically register static plugins
* Reverted some ngraph changes
* Fixed cpuUnitTests compilation
* Fixed compilation
* Fixed myriad
* Fixed custom_opset tests
* Reverted linker flags
* Support both static and dynamic plugins
* Fixed compilation of myriadFuncTests
* Removed duplication
* Fixes after self-review
* Fixed linkage for preprocessing
* Fixes for Windows
* Fixes
* Fixed cmake options
* Fix
* Fix
* Fix 2
* Fix caching issues with auto-generated friendly names
Introduce "HashPass" to calculate hash like a serialize but without auto-generated friendly names
IE Compilation context: use HashPass to calculate hash of ov::Function
IE Compilation context tests: removed "friendly names" from tests
Layout: serialization support + tests
Parameter/Result: update set/get_layout according to layout changes
* Fix clang
* Tiny correction of CmakeLists
* Renamed VariantWrapper<Layout> to LayoutAttribute
Removed test for conversion from/to fully dynamic layout (allowed now and does nothing)
'set_layout' - remove layout runtime info if empty layout is passed. This allows hashes to be the same if set_layout(param->get_layout()) is called
* Fix build
* change size_t to uint64_t for hash value
Using size_t leads to high probability of conflict for 32-bit platforms
* Removed debug print
* Fix hash calculation for 32-bit platforms
* Fix review comment
* Interpolate reference implementation:
- Support u8 and other numeric types
- For integral types - round result to nearest integer (don't cast)
Preprocessing: enable OpenCV tests and add resize conformance tests with OpenCV
* Revert changes in interpolate.cpp, making them minimal needed (added u8 resize)
* Preprocessing: convert_layout<std::vector<uint64_t>> implementation
User is able to use this version without specifying layout explicitly
Same version of convert_layout is added for post-processing
Added usage of new convert_layout to ie_network_reader
* Fix review comment
* ngraph functio sample
* Fixes
* OV2.0: NV12 hello classification with new preprocessing API
* Fix clang-format
* Rewrote several samples
* Some updates
* clang-format
* Fixed TODO
* Fixed comments and improved samples
* Preprocessing comments
* clang-format
* Fixed comment
* Fixed Windows
* Added back Blob support to ClassificationResult
Co-authored-by: Michael Nosov <mikhail.nosov@intel.com>
