Commit Graph
30 Commits
Author SHA1 Message Date
Ilya Churaev cc810297f4 Align style doc with samples (#5709)
* Added clang-format config

* Fixed style

* Fixed code-style for snippets and fixed build

* Disable clang-format for snippets

* Fixed comments
2021-05-25 10:32:48 +03:00
Vladislav Volkov d2c9bddff1 Convert operation optimization for FP16 -> INT8 and FP32 -> INT8 (#5275)
Improvements for ConvertPrecision transformation pass
2021-05-14 13:48:02 +03:00
Ilya Lavrenov 8b1b900591 CVS-44774: Fixed preprocessing for template plugin (#4118)
* Fixed preprocessing for template plugin

* Added more tests instances

* Split common transformation to smaller ones which can be used by plugins

* Moved preprocessing transformation to Plugin API

* Added PreprocessConversionTest tests

* Disabled tests on GPU: CVS-51764

* Disabled some tests on VPU and TEMPLATE

* Support for input layout conversions in TEMPLATE plugin

* Improvements in Template Plugin

* Fixed compilation

* Fixes

* Disables some tests

* Fixed compilation on Windows

* Fixed docs
2021-04-30 10:47:29 +03:00
Ilya Lavrenov 6c83e0f8a5 Small refactoring in TEMPLATE plugin (#5398)
* Small refactoring in TEMPLATE plugin

* Fixed compilation on Windows

* Fixed code style
2021-04-27 18:52:45 +03:00
Anton Pankratv 46987def54 Merged internal Infer Request implementation (#5125) 2021-04-19 15:16:47 +03:00
Anton Pankratv b20d9b725c Used internal exec network impl (#4922) 2021-04-08 12:29:41 +03:00
Ilya Lavrenov 8e261de0a8 Added PreprocessConversionTest tests (#4946)
* Added PreprocessConversionTest tests

* Disabled tests on GPU: CVS-51764

* Disabled some tests on VPU and TEMPLATE

* Support for input layout conversions in TEMPLATE plugin
2021-03-25 16:31:33 +03:00
Alexey Suhov a748c26fee Align copyright notice in cpp and cmake source files (CVS-51320) (#4950) 2021-03-25 02:40:09 +03:00
Anton Pankratv 3b3d9a0989 Used IE_THROW macro (#4869)
* Added ie throw macro

* Used IE_THROW macro
2021-03-23 18:57:12 +03:00
Anton Pankratv a2b8b974b8 Simplified IE Exceptions Implementation (#4258) 2021-03-18 16:30:16 +03:00
Mikhail Nosov 4c5d9c2a1b [Template]: Metrics IMPORT_EXPORT_SUPPORT and DEVICE_ARCHITECTURE (#4818)
Test:
Use benchmark_app from this PR #4814

Run ./benchmark_app -h
Verify that template plugin is listed in supported caching devices

Run ./benchmark_app -m <model.onnx> -d TEMPLATE -i <file> -cache tmpCache
Verify that tmpCache is created and network is exported to blob
Verify that if model is ONNX (e.g. ResNet50) - that loading of network is performed faster when cache is available

Run several times: ./benchmark_app -m <model.onnx> -d TEMPLATE -i <file> -cache tmpCache -single_load
Verify that if model is ONNX (e.g. ResNet50) - that loading of network is performed faster when cache is available
Verify that in this mode loading of network is faster than without "-single_load" option
2021-03-17 12:15:53 +03:00
Ilya Lavrenov 5f982ca6ac Removed obsolete ie_profiling.hpp (#4043) 2021-01-28 20:04:52 +03:00
Ilya Lavrenov 1044ed4352 Added export / import for Template and Hetero plugins (#3940)
* Added export / import for Template and Hetero plugins

* Added WA for Apple RTTI
2021-01-22 14:17:44 +03:00
Ilya Lavrenovandapankratovantonp 8685c20baf Fixed HETERO + Template cases (#3580)
* Fixed tests compilation for Android ARM

* Small fixes

* Fixed issues CVS-44775, CVS-34206, CVS-34349

* Disabled KSO tests for Template

* Eliminated invalid subgraphs

* Enabled KSO QueryNetwork tests for Template

* Fixed other plugins as well

* Used NodeTypeInfo instead of std::string

Co-authored-by: apankratovantonp <anton.pankratov@intel.com>
2020-12-16 12:17:29 +03:00
Anton Potapov 8aabcde925 [PP] Altered preprocessing tests to use existin posprocessing as well (#3554)
changed PreprocessingPrecisionConvertTest:
 - to force output precision to be same as input (and not FP32 always)

changed TEMPLATE plugin to allow U8 outputs
2020-12-11 12:49:38 +03:00
Ilya Lavrenov 2d75d8aff2 Removed global using namespace from Plugin API (#3451) 2020-12-03 17:52:55 +03:00
Ilya Lavrenov 6aa7c51de9 Removed ICNNNetwork from Plugin API (#3384)
* ICNNnetwork

* Removed ICNNNetwork from Plugin API
2020-11-27 16:30:02 +03:00
Ilya Lavrenov 1e66624799 Plugin interface refactoring (#2591)
* Simplified plugin interface

* Allow not implemented

* Fixes

* Fixed CPU plugin tests

* Fixed tests dependencies

* Fixes

* Fixed GPU plugin compilation

* Renamed plugin

* Fixes

* Removed tests for plugin base

* Fix2

* Fix 2

* Define a macro to define plugin creation function

* Clean-up

* Fixed OSX build

* Fixed CentOS

* Removed statuscode from IExecutableNetworkInternal interface

* Interface

* Removed not used macro

* QueryNetwork returns result using return value

* LoadNetwork interface

* Fixed compilation with private plugins

* Fixed compilation when NGRAPH_INTERP is not enabled

* Return ExecutableNetwork from ImportNetwork with fileName

* Updated GetContext method

* Return exec graph information as return value

* Message about deprecation of Export with file name

* Message about deprecation of QueryState

* Updated ExecutableNetwork::GetConfig signature

* Updated ExecutableNetwork::GetMetric signature

* Updated docs

* WIP createIR

* Simplified IR creation

* CreateInferRequest returns value

* Removed GetExecutor from ExecutableNetworkThreadSafeDefault

* execDataPreprocessing is protected

* Fixed mock test
2020-10-13 17:22:51 +03:00
Evgeny Talanin 83238b23db Revert "Eliminated invalid subgraphs (#2196)" (#2250)
This reverts commit 89a6f926a4.
2020-09-15 19:24:57 +03:00
Anton Pankratv 89a6f926a4 Eliminated invalid subgraphs (#2196) 2020-09-15 14:03:24 +03:00
Anton Pankratv 7c1b87c7aa Query network should return all supported layers (#1845)
* Query network should return all supported layers

* Added other plugins. Fixed hetero and multi

* IRv7 test use legacy impl
2020-08-26 15:33:37 +03:00
Ilya Lavrenov 5d328b94a6 Reuse make_executable_network in ImportNetwork (#1869)
* Reuse make_executable_network for ImportNetwork

* make_executable_network returns ExecutableNetwork cpp wrapper
2020-08-20 18:34:19 +03:00
Ilya Lavrenov a4dcfed1a9 Simplified plugin interfaces (#1745)
* Simplified plugin interface

* Allow not implemented

* Fixes

* Fixed CPU plugin tests

* Fixed tests dependencies

* Fixes

* Fixed GPU plugin compilation

* Renamed plugin

* Fixes

* Removed tests for plugin base

* Fix2

* Fix 2

* Define a macro to define plugin creation function

* Clean-up

* Fixed OSX build

* Fixed CentOS

* Fixed exception catch / throw

* Fixed clang issue

* Fixed python tests on macOsx
2020-08-14 12:11:54 +03:00
Ilya Lavrenov 2b81b947dc Define a macro to define plugin creation function (#1727) 2020-08-12 12:00:30 +03:00
Ilya Churaev d791d295aa Use clone_function instead of specialize_function (#1523)
* Try to use clone_function instead of specialize_function

* Try to fix stress tests

* Remove redundant specialize_function

* Fixed TI clone

* Removed redundant code

* Uncomment threading tests

* Fixed docs

* copy function friendly name too

* Fixed copy rt_info

* Fixed comments
2020-08-03 18:23:02 +03:00
Ilya Lavrenov 77345a7383 Template documentation update (#1519)
* Updated Inference Engine Plugin developer guide
after inference using ngraph reference backend is added

* Documentation fixes

* Fixed review comments
2020-07-29 19:56:24 +03:00
Anton Pankratv 18836f53cd Implemented inference in template plugin (#1308)
* Implemented inference in template plugin

* Fixed tests

* Removed thirdparty dependency

* Simplified executor configuration

* removed half

* Fixed cmake

* Fixed ngraph node check

* device blob allocation

* Fixed enum error
2020-07-28 17:25:31 +03:00
Ilya Lavrenov a19a8645e8 Removed IInferencePluginAPI interface (#1497)
* Removed legacy library includes from plugin api headers

* Removed IInferencePluginAPI interface; merged with IInferencePlugin

* Removed pluginAPIInterface usage in Core implementation
2020-07-28 11:08:45 +03:00
Ilya Lavrenov 9440561fa4 Documentation updates (#1433) 2020-07-23 13:15:20 +03:00
Alexey Suhov 0064c299c3 add plugin template (#515) 2020-05-22 22:34:00 +03:00