* [GNA] Add gna model dumping
* [GNA] Modify debug layout, add timestamp, fix compound bias dump
* [GNA] Move data dump to another file
* [GNA] Create model data dump file only when needed
* Refactor specification
* Complete detail description section
* Rewrite mathematical formula
* Fix range of values for min and max attributes
* Add note for conversion policy between float and integral type of input tensor
* Address review comments
* Fix typo in max attribute
* Remove redundant examples
* Reshape interval propagation tests with scalar
* Set or_tensor result shape to log_or ourput
* Create result HostTensor without shape
* Add tests for scalar broadcast in binary ops
* Add tests for 1D inputs
Test:
Use benchmark_app from this PR #4814
Run ./benchmark_app -h
Verify that template plugin is listed in supported caching devices
Run ./benchmark_app -m <model.onnx> -d TEMPLATE -i <file> -cache tmpCache
Verify that tmpCache is created and network is exported to blob
Verify that if model is ONNX (e.g. ResNet50) - that loading of network is performed faster when cache is available
Run several times: ./benchmark_app -m <model.onnx> -d TEMPLATE -i <file> -cache tmpCache -single_load
Verify that if model is ONNX (e.g. ResNet50) - that loading of network is performed faster when cache is available
Verify that in this mode loading of network is faster than without "-single_load" option
* Subgraph extraction in ONNX models
* Windows compilation error fix + docs update
* Code cleanup after the first round of reviews
* CI compilation error fix
* Even more CI compilation error fixes
* Proper usage of ADL in generic code
* ONNX shape inference related code cleanup
* Disable the onnx test utils when pb-lite is used
* PB dependency removal from UT, strong types for input and output edges, more verbose errors in tests
* Fix for the protobuf descriptor database corruption
* testing visibility changes
* Revert the changes that didn't work
* Make tests green again?
* Make the current tests pass
* Remove the ONNX header from editor's tests
* Switch from stable_partition to remove_if because of compiler bugs
* Obsolete test removal and cmakelists cleanup in tests
* Macos failed, reverting some changes
* Handle the multiple output consumers UC
* Keep the tensor name when replacing an initializer
* Cutting a graph with multiple consumers of inputs and initializers
* Subgraph extraction with multiple initializer consumers
* Add CMakeList, move files
* fixed headers locations
* fixed calling tests
* apply code styles
* change namespace to onnx_editor
* removd not needed dependencies to onnx_editor
* Remove linking libonnx from unit-test
* Consider all flavors of protobuf libraries
* disable lto for onnx and onnx_proto
* revert set ONNX_INCLUDE_DIR change
* create new target onnx_common
* cmake dependencies clean-up
* Added onnx_common visibility
* pass ModelProto as reference + remove redundant dependencies
* expose onnx symbols by onnx_common
* remove -fno-lto, move InputEdge and OutputEdge to other header
* configure onnx linking for MSVC and APPLE
* remove unused comment
* fixed linking configuration for msvc and apple/clang
* clean cmakes
* added dependencies
* remove onnx and onnx_proto from NGRAPH_EXPORT_TARGETS_ENABLE
* make onnx and protobuf dynamic
* cmake dependency clean-up
* added onnx patch - make only onnx_proto shared
* use protobuf should depend on BUILD_SHARED_LIBS
* fixed patch
* fixed install targets
* add if to install protobuf
* fixed onnx flag
* move protobuf install
* cmake dependencies
* added protobuf header include dir + clean-up ng cmake
* added protobuf to ng targets
* fix apple build
* dependencies clean-up
* make onnx_editor static lib
* remove onnx editor visibility
* fixed protobuf export enablement
* fix apple build
* test build protobuf by fetch content
* fix apple protobuf build
* Docs update
* Producer name update in test onnx models
* More comments in the subgraph extraction code
* Merge remote-tracking branch 'upstream/master' into mbencer/MoveEditorToSeparateLib
* add dependency to onnx_proto for test utils
* dependency to ngraph_test_util
* ngraph_test_util dependency. part. 2
* conditional dependency of onnx to ngraph_test_util
* Apply suggestions from code review
Co-authored-by: Tomasz Socha <tomasz.socha@intel.com>
* review remarks
* remove onnx_proto default visibility
* camke remarks, not exporting onnx_common and onnx_editor to target set
* [test fix macos CI] Revert "remove onnx_proto default visibility"
* set onnx_proto visibility only for macos
* [PyPI] remove rpath for dylib
* Corrected cmd
* fix protobuf-lite linking
Co-authored-by: tomdol <tomasz.dolbniak@intel.com>
Co-authored-by: Tomasz Jankowski <tomasz1.jankowski@intel.com>
Co-authored-by: Mateusz Tabaka <mateusz.tabaka@intel.com>
Co-authored-by: Tomasz Socha <tomasz.socha@intel.com>
Co-authored-by: mryzhov <mikhail.ryzhov@intel.com>
* Recently we have merged the WA for MyriadPlugin to be not unloaded at runtime for Linux systems.
It has been found that there are some problems with the usage of this linker option on CentOS, which led to Segmentation Fault on it, on the second call of dlopen() on myriadPlugin.
I tried to update glibc version on CentOS (to 2.28) and the problem disappeared.
Both Ubuntu 18 and 20 works fine and as it was requested as the used platform for the initial problem, I've decided to limit the solution for Ubuntu OS only.
* Created opset7.md to add the specification of the operation FFT.
* Started to write the specification of the operation FFT.
* Added link to the specification of the operation FFT.
* Continued to write the specification of the FFT.
* Written about inputs and outputs of FFT.
* Started to write examples.
* Added example when there is no input 'signal_size'.
* Added more example.
* Small fixes.
* Small fix.
* Renamed FFT to DFFT.
* Small fix.
* Small fix.
* Started to write the algorithm of FFT.
* Added asserts.
* Started to write the method __call__ of the class of DFFT calculation.
* Fixed category.
* Continued to write the algorithm of the FFT calculation.
* Continued to write the algorithm of the FFT calculation.
* Continued to write the algorithm of the FFT calculation.
* Continued to write the algorithm of the calculation of DFFT.
* Written the algorithm of the calculation of DFFT.
* Small fix.
* Renamed operation.
* Added examples of 3D input tensors.
* Covered complex number representation.
* Written formulas for FFT.
* Written about start point of trimming.
* Small fixes.
* Small fixes.
* Some fixes.
* Added some note.
* Added a description of the calculation of the output shape.
* Added examples with unsorted axes and with (-1) in signal_size.
* Fixed range of axes indices.
* Small fix.
* Small change.
* Added T_SIZE type.
* Added negative axes support.
* Some fixes.
* Some fixes.
* Written the draft of the specification of the operation IFFT.
* Small fix.
* Renamed the operation IFFT into DIFFT. Deleted attribute.
* Renamed operation to IDFT.
* Deleted int8 type.
* Added examples of 3D input tensors.
* Added formulas and text.
* Fixed ie_docs.xml.
* Fixed sign in the IFFT formula.
* Some fixes.
* Added examples with unsorted axes and with (-1) in signal_size.
* Some fixes.
* Small fix.
* Small fixes.
* Added type T_SIZE.
* Deleted redundant sentence.
* Added support for negative axes.
* Some changes.
* Model caching support - Core part
Introducing model caching support
Use core.SetConfig({{CONFIG_KEY(CACHE_DIR), <dir>}}); to enable caching of models
OpenVINO will try to create caching folder if it doesn't exist, but it is recommended for client to create caching folder with necessary permissions before enabling cache in config
For caching, plugins shall support import/export functionality
Plugin requirements:
- Add METRIC_KEY(IMPORT_EXPORT_SUPPORT) in SUPPORTED_METRICS to support caching
If plugin has different device architectures with different caches, i.e.
For "GNA.0" - one cache, for "GNA.10" - another cache
In this case plugin shall support DEVICE_ARCHITECTURE metric and return different strings for different DEVICE_ID's
Added functional tests
* Fix CentOS build issues
* Few updates according to code review
* Revert unnecessary changes for Import/Export core implementation
These changes affect old behavior and may be undesired
For caching support these is no need to change anything in this area
If needed, such removal of 'Magic' usage can be done under separate task in future
* More tests:
1) Verify that Imported data from stream is the same as was exported
2) Verify that cache is not loaded when config in LoadNetwork is changed
3) Verify that if CNN Network is changed between ReadNetwork and LoadNetwork - cache is not loaded
* Update of NetworkCompilationContext
Put back functionality of calculating hash based on runtime information, weights
Implemented OstreamHashWrapper to avoid serialization to buffer
* Correction of CACHE_DIR key description
* Unit tests for compilation_context
Changes:
1) Improved handling of OstreamHashAdapter
2) Improved runtime info serialization (not just PrimitivesPriority and affinity)
3) Removed redundant weights hash calculation
* Fix GCC 4.8 build issues
* Compilation context updates
1) Use hash of sum of serialized data to get hash of network. It is more efficient comparing to weights sum calculation
2) CalculateFileInfo - convert path to absolute ("./test.blob" and "test.blob" shall give same hash)
* Hash - added more rt_info attributes + tests
- PrimitivesPriority
- FusedNames
- Dequantization
* Moved "get_absolute_path" macro to file_utils.h
* Make 'absoluteFilePath' a library API, not macro
* One more unit test for fileName hashing
* Fix compilation error after merge with latest master
* Allow tests to be executed in parallel (stress mode)
* More minor updates for stress testing
Now it allows to execute tests with '--repeat=100' option where one test is executed in multiple processes simultaneously
Example:
./gtest-parallel <openvino_dir>/bin/intel64/Debug/ieFuncTests --gtest_filter=CachingTest* --repeat=10
* Use absolute model file path for calculating blob name
* Added 'createDirectoryRecursive' API to plugin_api/file_utils
* Fix issue with GNA Import/Export.
Application may create ostream and write some app-specific header to beginning of stream.
GNA plug-in shall not 'seekg' to beginning of stream where app-specific content is located.
Instead it shall seek to the original position of stream
Functional test is also updated to cover this case
* Updated according to review comments
- Check return code right after 'istream::tellg'
- Added 'applicationHeader' as parameter to base ImportExport tests
* Error check for startPos + unit test
* Suppress deprecated warnings like in other GNA tests
* Feature/vpu doc fixes 2021 3 (#4635)
* Documentation fixes and updates for VPU
* minor correction
* minor correction
* Fixed links
* updated supported layers list for vpu
* Auto benchmarks for evaluate(...) and extra unit tests.
* Test suite for manual i/o examination.
* Template on input type. Constant folding tests the 'count_ops_of_type' issue.
* Multidim manual tests
* NgOp&Ref: Unit tests Ok. NB evaluates_map
* Stable. Negative indices as if larger than depth. Benchmarks removed.
* Added Serialization SLT
* I/O shapes consistency checks
* Consistency checks in evaluate(). Removed the ref from evaluates_map.
* removed excessive #include from evaluates_map
* Code style
* [GNA] Support Pooling 2D
Refactor Pooling
Remove unused sum pooling
Skip ReorderPoolActivation pass when 2D pooling detected
Enable fusing of Pool2D with other components into GNA Operation
* Support GNA_SW_FP32 mode for Pooling 2D with tests
* Apply review
typo
* Apply review
Restore indentation
* Only executor threads now have top task priority. Other runtime threads have lower priority. Other non-runtime tasks (which do not participate in inference) have much lower priority.
* Initial Subgraphs Dumper and IR runner test inplementation
* Implement matchers configuration
* Refactor MatcherConfig
* Add OP cloners factory
* Remove IR runner test (to be added in separate PR)
* Use different nodes comparison method
* Remove extra include of <any> which fails build with old glibc
* Add README.md
Co-authored-by: Mikhail Treskin <mikhail.treskin@intel.com>
