Ilya Lavrenov
92e3972853
* Added VariableState to Plugin API documentation * More fixes for plugin documentation * Added ie_memory_state.hpp to documentation * Added proper dependencies between C++ and Plugin API targets * Fixed issues in public C++ API reference * Fixed issues in public C++ API reference: part 2 * Removed obsolete entries from EXCLUDE_SYMBOLS in doxygen config * Fixed path to examples, tag files for Plugin API doxygen file * Put impl to a private section for VariableStatebase * Fixed examples path to Plugin API: part 2 * Fixed path to examples in main ie_docs doxygen file * Replaced path to snippets; otherwise path depends on how cloned repo is named * Added path to snippets for ie_docs doxygen file as well * Great amount of fixes for documentation * Removed IE_SET_METRIC * Fixes for C API documentation * More fixes for documentation * Restored Transformations API as a part of Plugin API * Fixed tag files usage for Plugin API * Fixed link to FakeQuantize operation
55 lines
2.5 KiB
Markdown
55 lines
2.5 KiB
Markdown
# Intel® Movidius™ VPUs Programming Guide for Use with Intel® Distribution of OpenVINO™ toolkit {#openvino_docs_install_guides_movidius_programming_guide}
|
|
|
|
## See Also
|
|
|
|
- [Intel® Movidius™ VPUs Setup Guide for use with the Intel® Distribution of OpenVINO™](movidius-setup-guide.md)
|
|
- <a class="download" href="<domain_placeholder>/downloads/595850_Intel_Vision_Accelerator_Design_with_Intel_Movidius™_VPUs-HAL Configuration Guide_rev1.3.pdf">Intel® Vision Accelerator Design with Intel® Movidius™ VPUs HAL Configuration Guide</a>
|
|
- <a class="download" href="<domain_placeholder>/downloads/613514_Intel Vision Accelerator Design with Intel Movidius™ VPUs Workload Distribution_UG_r0.9.pdf">Intel® Vision Accelerator Design with Intel® Movidius™ VPUs Workload Distribution User Guide</a>
|
|
- <a class="download" href="<domain_placeholder>/downloads/613759_Intel Vision Accelerator Design with Intel Movidius™ VPUs Scheduler_UG_r0.9.pdf">Intel® Vision Accelerator Design with Intel® Movidius™ VPUs Scheduler User Guide</a>
|
|
- <a class="download" href="<domain_placeholder>/downloads/Intel Vision Accelerator Design with Intel Movidius™ VPUs Errata.pdf">Intel® Vision Accelerator Design with Intel® Movidius™ VPUs Errata</a>
|
|
|
|
The following section provides information on how to distribute a model across all 8 VPUs to maximize performance.
|
|
|
|
## Programming a C++ Application for the Accelerator
|
|
|
|
### Declare a Structure to Track Requests
|
|
|
|
The structure should hold:
|
|
1. A pointer to an inference request.
|
|
2. An ID to keep track of the request.
|
|
|
|
@snippet snippets/movidius-programming-guide.cpp part0
|
|
|
|
### Declare a Vector of Requests
|
|
|
|
@snippet snippets/movidius-programming-guide.cpp part1
|
|
|
|
Declare and initialize 2 mutex variables:
|
|
1. For each request
|
|
2. For when all 8 requests are done
|
|
|
|
### Declare a Conditional Variable
|
|
|
|
Conditional variable indicates when at most 8 requests are done at a time.
|
|
|
|
For inference requests, use the asynchronous IE API calls:
|
|
|
|
@snippet snippets/movidius-programming-guide.cpp part2
|
|
|
|
@snippet snippets/movidius-programming-guide.cpp part3
|
|
|
|
|
|
### Create a Lambda Function
|
|
|
|
Lambda Function enables the parsing and display of results.
|
|
|
|
Inside the Lambda body use the completion callback function:
|
|
|
|
@snippet snippets/movidius-programming-guide.cpp part4
|
|
|
|
## Additional Resources
|
|
|
|
- [Intel Distribution of OpenVINO Toolkit home page](https://software.intel.com/en-us/openvino-toolkit)
|
|
|
|
- [Intel Distribution of OpenVINO Toolkit documentation](https://docs.openvinotoolkit.org)
|