Files
openvino/docs/IE_DG/supported_plugins/HDDL.md
Andrey Zaytsev 5e4cd1127b Integrate UAT fixes (#5517)
* Added info on DockerHub CI Framework

* Feature/azaytsev/change layout (#3295)

* Changes according to feedback comments

* Replaced @ref's with html links

* Fixed links, added a title page for installing from repos and images, fixed formatting issues

* Added links

* minor fix

* Added DL Streamer to the list of components installed by default

* Link fixes

* Link fixes

* ovms doc fix (#2988)

* added OpenVINO Model Server

* ovms doc fixes

Co-authored-by: Trawinski, Dariusz <dariusz.trawinski@intel.com>

* Updated openvino_docs.xml

* Edits to MO

Per findings spreadsheet

* macOS changes

per issue spreadsheet

* Fixes from review spreadsheet

Mostly IE_DG fixes

* Consistency changes

* Make doc fixes from last round of review

* integrate changes from baychub/master

* Update Intro.md

* Update Cutting_Model.md

* Update Cutting_Model.md

* Fixed link to Customize_Model_Optimizer.md

Co-authored-by: Trawinski, Dariusz <dariusz.trawinski@intel.com>
Co-authored-by: baychub <cbay@yahoo.com>
2021-05-06 15:37:13 +03:00

2.6 KiB

HDDL Plugin

Introducing the HDDL Plugin

The Inference Engine HDDL plugin was developed for inference with neural networks on Intel® Vision Accelerator Design with Intel® Movidius™ VPUs. It is designed for use cases that require large throughput for deep learning inference, up to dozens of times more than the MYRIAD Plugin.

Configuring the HDDL Plugin

To configure your Intel® Vision Accelerator Design With Intel® Movidius™ on supported OSs, refer to the Steps for Intel® Vision Accelerator Design with Intel® Movidius™ VPUs section in the installation guides for Linux or Windows.

Supported networks

For the "Supported Networks", please reference to MYRIAD Plugin

Supported Configuration Parameters

See VPU common configuration parameters for the VPU Plugins. When specifying key values as raw strings (that is, when using Python API), omit the KEY_ prefix.

In addition to common parameters for MYRIAD plugin and HDDL plugin, HDDL plugin accepts the following options:

Parameter Name Parameter Values Default Description
KEY_PERF_COUNT YES/NO NO Enable performance counter option.
KEY_VPU_HDDL_GRAPH_TAG string empty string Allows to execute network on specified count of devices.
KEY_VPU_HDDL_STREAM_ID string empty string Allows to execute inference on a specified device.
KEY_VPU_HDDL_DEVICE_TAG string empty string Allows to allocate/deallocate networks on specified devices.
KEY_VPU_HDDL_BIND_DEVICE YES/NO NO Whether the network should bind to a device. Refer to vpu_plugin_config.hpp.
KEY_VPU_HDDL_RUNTIME_PRIORITY signed int 0 Specify the runtime priority of a device among all devices that running a same network Refer to vpu_plugin_config.hpp.

See Also