* Doc Migration from Gitlab (#1289) * doc migration * fix * Update FakeQuantize_1.md * Update performance_benchmarks.md * Updates graphs for FPGA * Update performance_benchmarks.md * Change DL Workbench structure (#1) * Changed DL Workbench structure * Fixed tags * fixes * Update ie_docs.xml * Update performance_benchmarks_faq.md * Fixes in DL Workbench layout * Fixes for CVS-31290 * [DL Workbench] Minor correction * Fix for CVS-30955 * Added nGraph deprecation notice as requested by Zoe * fix broken links in api doxy layouts * CVS-31131 fixes * Additional fixes * Fixed POT TOC * Update PAC_Configure.md PAC DCP 1.2.1 install guide. * Update inference_engine_intro.md * fix broken link * Update opset.md * fix * added opset4 to layout * added new opsets to layout, set labels for them * Update VisionAcceleratorFPGA_Configure.md Updated from 2020.3 to 2020.4 Co-authored-by: domi2000 <domi2000@users.noreply.github.com>
7.2 KiB
Configuration Guide for the Intel® Distribution of OpenVINO™ toolkit and the Intel® Vision Accelerator Design with Intel® Movidius™ VPUs on Linux*
NOTES:
- These steps are only required if you want to perform inference on Intel® Vision Accelerator Design with Intel® Movidius™ VPUs.
- If you installed the Intel® Distribution of OpenVINO™ to the non-default install directory, replace
/opt/intelwith the directory in which you installed the software.
Configuration Steps
For Intel® Vision Accelerator Design with Intel® Movidius™ VPUs, the following additional installation steps are required.
- Set the environment variables:
source /opt/intel/openvino/bin/setupvars.sh
Note
: The
HDDL_INSTALL_DIRvariable is set to<openvino_install_dir>/deployment_tools/inference_engine/external/hddl. If you installed the Intel® Distribution of OpenVINO™ to the default install directory, theHDDL_INSTALL_DIRwas set to/opt/intel/openvino//deployment_tools/inference_engine/external/hddl.
- Install dependencies:
${HDDL_INSTALL_DIR}/install_IVAD_VPU_dependencies.sh
Note, if the Linux kernel is updated after the installation, it is required to install drivers again:
cd ${HDDL_INSTALL_DIR}/drivers
sudo ./setup.sh install
Now the dependencies are installed and you are ready to use the Intel® Vision Accelerator Design with Intel® Movidius™ with the Intel® Distribution of OpenVINO™ toolkit.
Optional Steps
-
For advanced configuration steps for your IEI Mustang-V100-MX8 accelerator, see Intel® Movidius™ VPUs Setup Guide for Use with Intel® Distribution of OpenVINO™ toolkit.
-
After you've configured your Intel® Vision Accelerator Design with Intel® Movidius™ VPUs, see Intel® Movidius™ VPUs Programming Guide for Use with Intel® Distribution of OpenVINO™ toolkit to learn how to distribute a model across all 8 VPUs to maximize performance.
Troubleshooting
Unable to run inference with the MYRIAD Plugin after running with the HDDL Plugin
Running inference with the MYRIAD Plugin after running with the HDDL Plugin is failed with the following error generated:
E: [ncAPI] [ 965618] [MainThread] ncDeviceOpen:677 Failed to find a device, rc: X_LINK_ERROR
Possible solutions (use one of the following):
-
Reboot the host system and run with the MYRIAD Plugin
-
Kill the HDDL Plugin backend service (
hddldaemon) and reset all Intel® Movidius™ VPUs before running an application that uses the MYRIAD Plugin:
kill -9 $(pidof hddldaemon autoboot)
pidof hddldaemon autoboot # Make sure none of them is alive
source /opt/intel/openvino/bin/setupvars.sh
${HDDL_INSTALL_DIR}/bin/bsl_reset
Get the "No space left on device" error while loading a network
When the application runs inference of a network with a big size(>4MB) of input/output or if the system is running out of the DMA buffer,
the HDDL Plugin will fall back to use shared memory.
In this case, if the application exits abnormally, the shared memory is not released automatically.
To release it manually, remove files with the hddl_ prefix from the /dev/shm directory:
sudo rm -f /dev/shm/hddl_*
How to solve the permission issue?
Make sure that the following udev rules exist:
/etc/udev/rules.d/97-myriad-usbboot.rules/etc/udev/rules.d/98-hddlbsl.rules/etc/udev/rules.d/99-hddl-ion.rules/etc/udev/rules.d/99-myriad-vsc.rules
Also make sure that the current user is included in the users groups. If not, run the command below to include:
sudo usermod -a -G users "$(whoami)"
setup.sh doesn't install the driver binaries to /lib/modules on CentOS systems
As a temporary workaround, run the commands below to install the drivers. This issue will be fixed in future releases.
sudo mkdir -p /lib/modules/$(uname -r)/kernel/drivers/myd/
sudo cp drv_vsc/myd_vsc.ko /lib/modules/$(uname -r)/kernel/drivers/myd/
sudo cp drv_ion/myd_ion.ko /lib/modules/$(uname -r)/kernel/drivers/myd/
sudo touch /etc/modules-load.d/intel_vision_accelerator.conf
sudo echo "myd_vsc" >> /etc/modules-load.d/intel_vision_accelerator.conf
sudo echo "myd_ion" >> /etc/modules-load.d/intel_vision_accelerator.conf
sudo depmod
sudo modprobe myd_vsc
sudo modprobe myd_ion
Host machine reboots after running an inference application with the HDDL plugin
Symptom: Boot up the host machine, run the inference application with the HDDL plugin. System reboots in a uncertain time.
Root Cause: The I2C address of the reset device of the Intel® Vision Accelerator Design with Intel® Movidius™ VPUs conflicts with another device I2C address in 0x20-0x27 range. If the target Intel® Vision Accelerator Design with Intel® Movidius™ VPUs device needs to be reset (for example, in case of device errors), the libbsl library, which is responsible for reset, expects that the target reset device I2C address is in the 0x20-0x27 range on SMBUS. If there is another device on SMBUS in this address range, libbsl treats this device as the target reset device and writes an unexpected value to this address. This causes system reboot.
Solution: Detect if there is any I2C device on SMBUS with address in 0x20-0x27 range. If yes, do the following:
- Change the DIP switch on the target PCIE card
- Disable autoscan for the reset device by setting
"autoscan": falsein${HDDL_INSTALL_DIR}/config/bsl.json - Set the correct address of the I2C reset device (for example,
0x21) in${HDDL_INSTALL_DIR}/config/bsl.json
{
"autoscan": false,
"ioexpander": {
"enabled": true,
"i2c_addr": [ 33 ]
}
}
###Cannot reset VPU device and cannot find any 0x20-0x27 (Raw data card with HW version Fab-B and before) I2C addresses on SMBUS (using i2c-tools)
Please contact your motherboard vendor to verify SMBUS pins are connected to the PCIe slot.
Get "Error: ipc_connection_linux_UDS : bind() failed" in hddldaemon log.
You may have run hddldaemon under another user. Run the command below and try again:
sudo rm -rf /var/tmp/hddl_*
Get "I2C bus: SMBus I801 adapter at not found!" in hddldaemon log
Run the following command to check if a SMBUS I801 adapter can be found:
i2cdetect -l
Then run:
sudo modprobe i2c-i801
Get "open /dev/ion failed!" in hddldaemon log
Check if myd_ion kernel module is installed by running the following command:
lsmod | grep myd_ion
If you do not see any output from the command, reinstall the myd_ion module.
Constantly get "_name_mapping open failed err=2,No such file or directory" in hddldaemon log
Check if myd_vsc kernel module is installed by running the following command:
lsmod | grep myd_vsc
If you do not see any output from the command reinstall the myd_vsc module.
Get "Required key not available" when trying to install the myd_ion or myd_vsc modules
Run the following commands:
sudo apt install mokutil
sudo mokutil --disable-validation