Maciej Smyk
9df5856849
Port from #13549 Fixed the following issues: Switching between C++ and Python docs for "Shape Inference", Removed repetitions, Quote background in bullet list at the beginning of "Multi-device execution", Broken note directives, Fixed video player size in "Inference with OpenVINO Runtime", Standardize Additional Resources throughout Runtime Inference.
46 lines
1.8 KiB
Markdown
46 lines
1.8 KiB
Markdown
# Inference with OpenVINO Runtime {#openvino_docs_OV_UG_OV_Runtime_User_Guide}
|
|
|
|
@sphinxdirective
|
|
|
|
.. _deep learning openvino runtime:
|
|
|
|
.. toctree::
|
|
:maxdepth: 1
|
|
:hidden:
|
|
|
|
openvino_docs_OV_UG_Integrate_OV_with_your_application
|
|
openvino_docs_Runtime_Inference_Modes_Overview
|
|
openvino_docs_OV_UG_Working_with_devices
|
|
openvino_docs_OV_UG_ShapeInference
|
|
openvino_docs_OV_UG_Preprocessing_Overview
|
|
openvino_docs_OV_UG_DynamicShapes
|
|
openvino_docs_OV_UG_Performance_Hints
|
|
openvino_docs_OV_UG_network_state_intro
|
|
|
|
@endsphinxdirective
|
|
|
|
OpenVINO Runtime is a set of C++ libraries with C and Python bindings providing a common API to deliver inference solutions on the platform of your choice. Use the OpenVINO Runtime API to read an Intermediate Representation (IR), ONNX, or PaddlePaddle model and execute it on preferred devices.
|
|
|
|
OpenVINO Runtime uses a plugin architecture. Its plugins are software components that contain complete implementation for inference on a particular Intel® hardware device: CPU, GPU, VPU, etc. Each plugin implements the unified API and provides additional hardware-specific APIs for configuring devices or API interoperability between OpenVINO Runtime and underlying plugin backend.
|
|
|
|
The scheme below illustrates the typical workflow for deploying a trained deep learning model:
|
|
|
|
<!-- TODO: need to update the picture below with PDPD files -->
|
|
|
|
|
|
|
|
## Video
|
|
|
|
@sphinxdirective
|
|
|
|
.. list-table::
|
|
|
|
* - .. raw:: html
|
|
|
|
<iframe allowfullscreen mozallowfullscreen msallowfullscreen oallowfullscreen webkitallowfullscreen height="315" width="560"
|
|
src="https://www.youtube.com/embed/e6R13V8nbak">
|
|
</iframe>
|
|
* - **OpenVINO Runtime Concept**. Duration: 3:43
|
|
|
|
@endsphinxdirective
|