Files
openvino/docs/template_plugin
Mikhail Nosov 8f908db61e [OV20] Set tensors infer req (#9158)
* Fix incomprehensible error message during layout conversion when layout rank doesn't match with shape rank

* Stash

* stash

* Memcpy implementation
Added tests

* Revert "Fix incomprehensible error message during layout conversion when layout rank doesn't match with shape rank"

This reverts commit 37064741b2.

* Fix clang-format and remove redundant headers

* Covered "cached" case (+ tested on Myriad)

* Apply review comments
Introduced 'applyBatchedBlob' function which allows override 'memcpy' on inferefnce time

* clang-format fix

* Added dynamic shape case

* - Review comments
- Deep copy of parameters/results for caching from cnnNetwork. Deep copy logic is moved to Utils
- Caching Tests: return correct inputs/outputs map after ImportNetwork mock call

* Reworked according to discussion

Also introduced 'SetBlobsImpl' which throws 'Not implemented' exception by default.
Template plugin updates internal '_batched_inputs' map

* Updated according to moved tests

* don't support 'memcpy' for ROI tensors

* Fix caching tests

* Just to retrigger CI

* Correct offset padding (however there is no test update as current implementation will not hit here due to other checks)

* Fix clang-format

* Applied review comments

* Added check that 'get_tensor' throws if set_tensors/set_input_tensors is used

* Fix review comments - part 1

* Fix caching tests - mock implementation becomes more complicated
Cached mock model shall identify its inputs/outputs, otherwise core will assert on SetExeNetworkInfo stage

* More comments fix

* More comments fixes

* More cleanup

* And more style comment

* typo fix

* Try fix caching windows tests

* Blind attempt to fix Ubuntu20 CI
2021-12-23 01:19:28 +03:00
..
2021-12-16 17:48:10 +03:00
2021-12-23 01:19:28 +03:00

template-plugin

Template Plugin for Inference Engine which demonstrates basics of how Inference Engine plugin can be built and implemented on top of Inference Engine Developer Package and Plugin API. As a backend for actual computations ngraph reference implementations is used, so the Template plugin is fully functional.

How to build

$ cd $DLDT_HOME
$ mkdir $DLDT_HOME/build
$ cd $DLDT_HOME/build
$ cmake -DENABLE_TESTS=ON -DENABLE_FUNCTIONAL_TESTS=ON ..
$ make -j8
$ cd $TEMPLATE_PLUGIN_HOME
$ mkdir $TEMPLATE_PLUGIN_HOME/build
$ cd $TEMPLATE_PLUGIN_HOME/build
$ cmake -DInferenceEngineDeveloperPackage_DIR=$DLDT_HOME/build ..
$ make -j8