8883732ca8
* dynamic optimal infer request Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com> * modify test case to match logic Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com> * for CPU_HELP,CPU case, use default value Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com> * update logic for GPU VPUX MYRIAD throughput GPU num = GPU_THROUGHPUT_STREAMS * 2 VPUX = 8 MYRIAD = 4 other mode GPU NUM = 1 VPUX = 1 MYRIAD = 1 Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com> * print GPU_THROUGHTPUT_STRREAM FOR TEST Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com> * get streams num from rangestreams for GPU Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com> * Revert "print GPU_THROUGHTPUT_STRREAM FOR TEST" This reverts commit 06e348d21dfaed626bebcc32837737da9b036e44. * use default variable instead of 4u and 1u Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com> * simple if else logic Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com> * check allow batching key Signed-off-by: fishbell <bell.song@intel.com> * add comment, optimize logic Signed-off-by: fishbell <bell.song@intel.com> Co-authored-by: fishbell <bell.song@intel.com> |
||
|---|---|---|
| .ci | ||
| .github | ||
| cmake | ||
| docs | ||
| inference-engine | ||
| licensing | ||
| samples | ||
| scripts | ||
| src | ||
| tests | ||
| thirdparty | ||
| tools | ||
| .gitattributes | ||
| .gitignore | ||
| .gitmodules | ||
| CMakeLists.txt | ||
| CODEOWNERS | ||
| install_build_dependencies.sh | ||
| Jenkinsfile | ||
| LICENSE | ||
| README.md | ||
| SECURITY.md | ||
OpenVINO™ Toolkit
This toolkit allows developers to deploy pre-trained deep learning models through a high-level C++ Inference Engine API integrated with application logic.
This open source version includes several components: namely Model Optimizer, nGraph and Inference Engine, as well as CPU, GPU, MYRIAD, multi device and heterogeneous plugins to accelerate deep learning inferencing on Intel® CPUs and Intel® Processor Graphics. It supports pre-trained models from the Open Model Zoo, along with 100+ open source and public models in popular formats such as Caffe*, TensorFlow*, MXNet* and ONNX*.
Repository components:
License
Deep Learning Deployment Toolkit is licensed under Apache License Version 2.0. By contributing to the project, you agree to the license and copyright terms therein and release your contribution under these terms.
Resources:
- Docs: https://docs.openvino.ai/
- Wiki: https://github.com/openvinotoolkit/openvino/wiki
- Issue tracking: https://github.com/openvinotoolkit/openvino/issues
- Storage: https://storage.openvinotoolkit.org/
- Additional OpenVINO™ modules: https://github.com/openvinotoolkit/openvino_contrib
- Intel® Distribution of OpenVINO™ toolkit Product Page
- Intel® Distribution of OpenVINO™ toolkit Release Notes
Support
Please report questions, issues and suggestions using:
- The
openvinotag on StackOverflow* - GitHub* Issues
- Forum
* Other names and brands may be claimed as the property of others.