MYRIAD Plugin

Introducing MYRIAD Plugin

The Inference Engine MYRIAD plugin has been developed for inference of neural networks on Intel® Neural Compute Stick 2.

Installation on Linux* OS

For installation instructions, refer to the Installation Guide for Linux*.

Installation on Windows* OS

For installation instructions, refer to the Installation Guide for Windows*.

Supported networks

The Inference Engine MYRIAD plugin supports the following networks:

Caffe*:

AlexNet
CaffeNet
GoogleNet (Inception) v1, v2, v4
VGG family (VGG16, VGG19)
SqueezeNet v1.0, v1.1
ResNet v1 family (18***, 50, 101, 152)
MobileNet (mobilenet-v1-1.0-224, mobilenet-v2)
Inception ResNet v2
DenseNet family (121,161,169,201)
SSD-300, SSD-512, SSD-MobileNet, SSD-GoogleNet, SSD-SqueezeNet

TensorFlow*:

AlexNet
Inception v1, v2, v3, v4
Inception ResNet v2
MobileNet v1, v2
ResNet v1 family (50, 101, 152)
ResNet v2 family (50, 101, 152)
SqueezeNet v1.0, v1.1
VGG family (VGG16, VGG19)
Yolo family (yolo-v2, yolo-v3, tiny-yolo-v1, tiny-yolo-v2, tiny-yolo-v3)
faster_rcnn_inception_v2, faster_rcnn_resnet101
ssd_mobilenet_v1
DeepLab-v3+

MXNet*:

AlexNet and CaffeNet
DenseNet family (121,161,169,201)
SqueezeNet v1.1
MobileNet v1, v2
NiN
ResNet v1 (101, 152)
ResNet v2 (101)
SqueezeNet v1.1
VGG family (VGG16, VGG19)
SSD-Inception-v3, SSD-MobileNet, SSD-ResNet-50, SSD-300

*** Network is tested on Intel® Neural Compute Stick 2 with BatchNormalization fusion optimization disabled during Model Optimizer import

Supported Configuration Parameters

See VPU common configuration parameters for the VPU Plugins. When specifying key values as raw strings (that is, when using Python API), omit the KEY_ prefix.

In addition to common parameters, the MYRIAD plugin accepts the following options:

Parameter Name	Parameter Values	Default	Description
`KEY_VPU_MYRIAD_PROTOCOL`	empty string/`VPU_MYRIAD_USB`/`VPU_MYRIAD_PCIE`	empty string	If set, the plugin will use a device with specific protocol to allocate a network.
`KEY_VPU_MYRIAD_FORCE_RESET`	`YES`/`NO`	`NO`	Enables force reset of all booted devices when new ExecutableNetwork is created. This is a plugin scope option and must be used with the plugin's SetConfig method only. See Device allocation section for details.
`KEY_VPU_FORCE_RESET`	`YES`/`NO`	`NO`	Deprecated Use `KEY_VPU_MYRIAD_FORCE_RESET` instead. Enables force reset of all booted devices when new ExecutableNetwork is created. This is a plugin scope option and must be used with the plugin's SetConfig method only. See Device allocation section for details.

Device allocation

Each IExecutableNetwork instance tries to allocate new device on InferenceEngine::Core::LoadNetwork, but if all available devices are already allocated it will use the one with the minimal number of uploaded networks. The maximum number of networks single device can handle depends on device memory capacity and the size of the networks.

If KEY_VPU_MYRIAD_FORCE_RESET option is set to YES the plugin will reset all VPU devices in the system.

Single device cannot be shared across multiple processes.

4.0 KiB Raw Blame History