* Moved CC macros for transformations to public API (to reuse their in plugin transformations)
* Added CC to template plugin
* Moved itt.h from nGraph to openvino/cc
* Fixed build
* Corrected tests to match CVS-53713
* Fixed tests configs
* Skip tests on GPU
* Commented condition inside main SetBlob because of MYRIAD
* Adopted tests
* Added LoadNetwork(filename) to AUTO
* Added more files
* So pointer can be used without loading
* Changed InferencePlugin, ICore to return internal interfaces
* Added SoPointers for InferRequest, ExecutableNetwork
* Fixed Windows
* Fixed KMB
* Fixes for KMB
* Removed dereference operator
* Play with include files
* Fixed compilation with older compilers
* Fixed comments
* Fixed win build
* Try to fix Windows
* Try to fix Windows 2
* Fixed windows
* Fixed windows
* Removed SOPointer as a base class
* Reverted back SOPointer split
* Code review
Co-authored-by: apankratovantonp <anton.pankratov@intel.com>
* Fixed preprocessing for template plugin
* Added more tests instances
* Split common transformation to smaller ones which can be used by plugins
* Moved preprocessing transformation to Plugin API
* Added PreprocessConversionTest tests
* Disabled tests on GPU: CVS-51764
* Disabled some tests on VPU and TEMPLATE
* Support for input layout conversions in TEMPLATE plugin
* Improvements in Template Plugin
* Fixed compilation
* Fixes
* Disables some tests
* Fixed compilation on Windows
* Fixed docs
* Small refactoring in TEMPLATE plugin
* Fixed compilation on Windows
* Fixed code style
* Hide CALL_STATUS_FNC helpers to private API
* Moved some base classes to private place from plugin_api
* Updates for VariableState creation
* Take Jane's changes for Demension names
* Revert "Take Jane's changes for Demension names"
This reverts commit 9f6c8fa5a6.
* Removed ICNNNetwork include
* removed more icnnnetwork includes
* Added missed include with ie_input_info.hpp
* Fixed GNA plugin to provide names w/o \0
* Removed suppressions for IInferRequest deprecation
* Fixed Windows
* More fixes for Windows
* Fixed compilation on Windows
* Fixed comment in documentatipn
* Fixes for Andorid
* Fixes for old gcc 4.8
* WA for cross-compilations
* Fixed compilation
* Fixed HETERO plugin compilation for old compilers
* Flags
Co-authored-by: lab_ddpqa <lab_ddpqa@intel.com>
* Added PreprocessConversionTest tests
* Disabled tests on GPU: CVS-51764
* Disabled some tests on VPU and TEMPLATE
* Support for input layout conversions in TEMPLATE plugin
* [Plugins test] Add functional test for correct import/export support by plugins
Test suite creates number of models with various precisions.
For each model:
- If plugin doesn't support IMPORT_EXPORT_SUPPORT metric - skip the test
- Try LoadNetwork without cache enabled fails - skip the test
- Do one inference
If Load and Infer request is succeeded and plugin has import metric:
- Load network with cache enabled. Infer request and compare outputs with original infer
- Import network, perform inference. Compare outputs with previous ones
* Fix Centos build warnings
Myriad: reset executableNetwork before next load
Myriad: Reduced time consumption for Myriad tests
* Caching test suite - batch size parameter support
Test:
Use benchmark_app from this PR #4814
Run ./benchmark_app -h
Verify that template plugin is listed in supported caching devices
Run ./benchmark_app -m <model.onnx> -d TEMPLATE -i <file> -cache tmpCache
Verify that tmpCache is created and network is exported to blob
Verify that if model is ONNX (e.g. ResNet50) - that loading of network is performed faster when cache is available
Run several times: ./benchmark_app -m <model.onnx> -d TEMPLATE -i <file> -cache tmpCache -single_load
Verify that if model is ONNX (e.g. ResNet50) - that loading of network is performed faster when cache is available
Verify that in this mode loading of network is faster than without "-single_load" option
* Fixed tests compilation for Android ARM
* Small fixes
* Fixed issues CVS-44775, CVS-34206, CVS-34349
* Disabled KSO tests for Template
* Eliminated invalid subgraphs
* Enabled KSO QueryNetwork tests for Template
* Fixed other plugins as well
* Used NodeTypeInfo instead of std::string
Co-authored-by: apankratovantonp <anton.pankratov@intel.com>
desired format
changed InferRequestInternal:
- added _deviceInputs member to store plugin desired perprocessing
targets
- added default argument to preProcessingRequired to describe plugin
specific desired preprocessing target
- SetBlob and GetBlob to deal with plugin desired preprocessing targets
(_deviceInputs)
- added addInputPreProcessingFor helper method to avoid code
duplication
changed TEMPLATE plugin to use new functionality:
- removed explicit presicion conversion (to use built-in one of
InferRequestInternal)
- _networkInputBlobs to use InferRequestInternal::_deviceInputs
changed PreprocessingPrecisionConvertTest:
- to force output precision to be same as input (and not FP32 always)
changed TEMPLATE plugin to allow U8 outputs
