[DOCS] RST fixes for master (#17603)
This commit is contained in:
Maciej Smyk
GitHub
parent
b01cc9297f
commit
d3d249afc6
@ -9,9 +9,9 @@
|
||||
../groupov_dev_api
|
||||
../groupie_transformation_api
|
||||
|
||||
@endsphinxdirective
|
||||
|
||||
The guides below provides extra API references needed for OpenVINO plugin development:
|
||||
|
||||
* [OpenVINO Plugin API](@ref ov_dev_api)
|
||||
* [OpenVINO Transformation API](@ref ie_transformation_api)
|
||||
* `OpenVINO Plugin API <https://docs.openvino.ai/2023.0/groupov_dev_api.html>`__
|
||||
* `OpenVINO Transformation API <https://docs.openvino.ai/2023.0/groupie_transformation_api.html>`__
|
||||
|
||||
@endsphinxdirective
|
||||
|
||||
@ -89,9 +89,12 @@ Following the OpenVINO™ naming convention, the Automatic Device Selection mode
|
||||
| Property | Values and Description |
|
||||
+==============================================+====================================================================+
|
||||
| <device candidate list> | **Values**: |
|
||||
| | empty |
|
||||
| | ``AUTO`` |
|
||||
| | ``AUTO: <device names>`` (comma-separated, no spaces) |
|
||||
| | |
|
||||
| | empty |
|
||||
| | |
|
||||
| | ``AUTO`` |
|
||||
| | |
|
||||
| | ``AUTO: <device names>`` (comma-separated, no spaces) |
|
||||
| | |
|
||||
| | Lists the devices available for selection. |
|
||||
| | The device sequence will be taken as priority from high to low. |
|
||||
@ -99,49 +102,63 @@ Following the OpenVINO™ naming convention, the Automatic Device Selection mode
|
||||
| | and all devices will be "viewed" as candidates. |
|
||||
+----------------------------------------------+--------------------------------------------------------------------+
|
||||
| ``ov::device::priorities`` | **Values**: |
|
||||
| | ``<device names>`` (comma-separated, no spaces) |
|
||||
| | |
|
||||
| | ``<device names>`` (comma-separated, no spaces) |
|
||||
| | |
|
||||
| | Specifies the devices for AUTO to select. |
|
||||
| | The device sequence will be taken as priority from high to low. |
|
||||
| | This configuration is optional. |
|
||||
+----------------------------------------------+--------------------------------------------------------------------+
|
||||
| ``ov::hint::performance_mode`` | **Values**: |
|
||||
| | ``ov::hint::PerformanceMode::LATENCY`` |
|
||||
| | ``ov::hint::PerformanceMode::THROUGHPUT`` |
|
||||
| | ``ov::hint::PerformanceMode::CUMULATIVE_THROUGHPUT`` |
|
||||
| | |
|
||||
| | ``ov::hint::PerformanceMode::LATENCY`` |
|
||||
| | |
|
||||
| | ``ov::hint::PerformanceMode::THROUGHPUT`` |
|
||||
| | |
|
||||
| | ``ov::hint::PerformanceMode::CUMULATIVE_THROUGHPUT`` |
|
||||
| | |
|
||||
| | Specifies the performance option preferred by the application. |
|
||||
+----------------------------------------------+--------------------------------------------------------------------+
|
||||
| ``ov::hint::model_priority`` | **Values**: |
|
||||
| | ``ov::hint::Priority::HIGH`` |
|
||||
| | ``ov::hint::Priority::MEDIUM`` |
|
||||
| | ``ov::hint::Priority::LOW`` |
|
||||
| | |
|
||||
| | ``ov::hint::Priority::HIGH`` |
|
||||
| | |
|
||||
| | ``ov::hint::Priority::MEDIUM`` |
|
||||
| | |
|
||||
| | ``ov::hint::Priority::LOW`` |
|
||||
| | |
|
||||
| | Indicates the priority for a model. |
|
||||
| | |
|
||||
| | IMPORTANT: This property is not fully supported yet. |
|
||||
+----------------------------------------------+--------------------------------------------------------------------+
|
||||
| ``ov::execution_devices`` | Lists the runtime target devices on which the inferences are being |
|
||||
| | executed. |
|
||||
| | |
|
||||
| | Examples of returning results could be ``(CPU)``(``CPU`` is a |
|
||||
| | temporary device, indicating that CPU is used for acceleration at |
|
||||
| | the model compilation stage), ``CPU``, ``GPU``, ``CPU GPU``, |
|
||||
| | ``GPU.0``, etc. |
|
||||
+----------------------------------------------+--------------------------------------------------------------------+
|
||||
| ``ov::intel_auto::enable_startup_fallback`` | **Values**: |
|
||||
| | ``true`` |
|
||||
| | ``false`` |
|
||||
| | |
|
||||
| | ``true`` |
|
||||
| | |
|
||||
| | ``false`` |
|
||||
| | |
|
||||
| | Enables/disables CPU as acceleration (or the helper device) in the |
|
||||
| | beginning. The default value is ``true``, indicating that CPU is |
|
||||
| | used as acceleration by default. |
|
||||
+----------------------------------------------+--------------------------------------------------------------------+
|
||||
| ``ov::intel_auto::enable_runtime_fallback`` | **Values**: |
|
||||
| | ``true`` |
|
||||
| | ``false`` |
|
||||
| | |
|
||||
| | ``true`` |
|
||||
| | |
|
||||
| | ``false`` |
|
||||
| | |
|
||||
| | Enables/disables runtime fallback to other devices and performs |
|
||||
| | the failed inference request again, if inference request fails on |
|
||||
| | the currently selected device. |
|
||||
| | |
|
||||
| | The default value is ``true``. |
|
||||
+----------------------------------------------+--------------------------------------------------------------------+
|
||||
|
||||
|
||||
@ -102,7 +102,7 @@ The hints are used on the presumption that the application queries ``ov::optimal
|
||||
:fragment: [query_optimal_num_requests]
|
||||
|
||||
|
||||
While an application is free to create more requests if needed (for example to support asynchronous inputs population) **it is very important to at least run the ``ov::optimal_number_of_infer_requests`` of the inference requests in parallel**. It is recommended for efficiency, or device utilization, reasons.
|
||||
While an application is free to create more requests if needed (for example to support asynchronous inputs population) **it is very important to at least run the** ``ov::optimal_number_of_infer_requests`` **of the inference requests in parallel**. It is recommended for efficiency, or device utilization, reasons.
|
||||
|
||||
Keep in mind that ``ov::hint::PerformanceMode::LATENCY`` does not necessarily imply using single inference request. For example, multi-socket CPUs can deliver as many requests at the same minimal latency as the number of NUMA nodes in the system.
|
||||
To make your application fully scalable, make sure to query the ``ov::optimal_number_of_infer_requests`` directly.
|
||||
|
||||
@ -338,9 +338,8 @@ Preprocessing Acceleration
|
||||
+++++++++++++++++++++++++++++++++++++++
|
||||
|
||||
The GPU plugin has the following additional preprocessing options:
|
||||
- The ``ov::intel_gpu::memory_type::surface`` and ``ov::intel_gpu::memory_type::buffer`` values for the
|
||||
``ov::preprocess::InputTensorInfo::set_memory_type()`` preprocessing method. These values are intended
|
||||
to be used to provide a hint for the plugin on the type of input Tensors that will be set in runtime to generate proper kernels.
|
||||
|
||||
- The ``ov::intel_gpu::memory_type::surface`` and ``ov::intel_gpu::memory_type::buffer`` values for the ``ov::preprocess::InputTensorInfo::set_memory_type()`` preprocessing method. These values are intended to be used to provide a hint for the plugin on the type of input Tensors that will be set in runtime to generate proper kernels.
|
||||
|
||||
.. tab-set::
|
||||
|
||||
@ -400,38 +399,38 @@ Read-write properties
|
||||
|
||||
All parameters must be set before calling ``ov::Core::compile_model()`` in order to take effect or passed as additional argument to ``ov::Core::compile_model()``.
|
||||
|
||||
- ov::cache_dir
|
||||
- ov::enable_profiling
|
||||
- ov::hint::model_priority
|
||||
- ov::hint::performance_mode
|
||||
- ov::hint::execution_mode
|
||||
- ov::hint::num_requests
|
||||
- ov::hint::inference_precision
|
||||
- ov::num_streams
|
||||
- ov::compilation_num_threads
|
||||
- ov::device::id
|
||||
- ov::intel_gpu::hint::host_task_priority
|
||||
- ov::intel_gpu::hint::queue_priority
|
||||
- ov::intel_gpu::hint::queue_throttle
|
||||
- ov::intel_gpu::enable_loop_unrolling
|
||||
- ``ov::cache_dir``
|
||||
- ``ov::enable_profiling``
|
||||
- ``ov::hint::model_priority``
|
||||
- ``ov::hint::performance_mode``
|
||||
- ``ov::hint::execution_mode``
|
||||
- ``ov::hint::num_requests``
|
||||
- ``ov::hint::inference_precision``
|
||||
- ``ov::num_streams``
|
||||
- ``ov::compilation_num_threads``
|
||||
- ``ov::device::id``
|
||||
- ``ov::intel_gpu::hint::host_task_priority``
|
||||
- ``ov::intel_gpu::hint::queue_priority``
|
||||
- ``ov::intel_gpu::hint::queue_throttle``
|
||||
- ``ov::intel_gpu::enable_loop_unrolling``
|
||||
|
||||
Read-only Properties
|
||||
+++++++++++++++++++++++++++++++++++++++
|
||||
|
||||
- ov::supported_properties
|
||||
- ov::available_devices
|
||||
- ov::range_for_async_infer_requests
|
||||
- ov::range_for_streams
|
||||
- ov::optimal_batch_size
|
||||
- ov::max_batch_size
|
||||
- ov::device::full_name
|
||||
- ov::device::type
|
||||
- ov::device::gops
|
||||
- ov::device::capabilities
|
||||
- ov::intel_gpu::device_total_mem_size
|
||||
- ov::intel_gpu::uarch_version
|
||||
- ov::intel_gpu::execution_units_count
|
||||
- ov::intel_gpu::memory_statistics
|
||||
- ``ov::supported_properties``
|
||||
- ``ov::available_devices``
|
||||
- ``ov::range_for_async_infer_requests``
|
||||
- ``ov::range_for_streams``
|
||||
- ``ov::optimal_batch_size``
|
||||
- ``ov::max_batch_size``
|
||||
- ``ov::device::full_name``
|
||||
- ``ov::device::type``
|
||||
- ``ov::device::gops``
|
||||
- ``ov::device::capabilities``
|
||||
- ``ov::intel_gpu::device_total_mem_size``
|
||||
- ``ov::intel_gpu::uarch_version``
|
||||
- ``ov::intel_gpu::execution_units_count``
|
||||
- ``ov::intel_gpu::memory_statistics``
|
||||
|
||||
Limitations
|
||||
#######################################
|
||||
|
||||
@ -69,11 +69,17 @@ Terminology
|
||||
| Acronym/Term | Description |
|
||||
+==================+==============================================+
|
||||
| FP32 format | Single-precision floating-point format |
|
||||
+------------------+----------------------------------------------+
|
||||
| BF16 format | Brain floating-point format |
|
||||
+------------------+----------------------------------------------+
|
||||
| FP16 format | Half-precision floating-point format |
|
||||
+------------------+----------------------------------------------+
|
||||
| I16 format | 2-byte signed integer format |
|
||||
+------------------+----------------------------------------------+
|
||||
| I8 format | 1-byte signed integer format |
|
||||
+------------------+----------------------------------------------+
|
||||
| U16 format | 2-byte unsigned integer format |
|
||||
+------------------+----------------------------------------------+
|
||||
| U8 format | 1-byte unsigned integer format |
|
||||
+------------------+----------------------------------------------+
|
||||
|
||||
@ -99,10 +105,13 @@ Supported Model Formats
|
||||
|
||||
+------------------+--------------------------+--------------------------+------------------------+
|
||||
| Plugin | FP32 | FP16 | I8 |
|
||||
+==================+==========================+===================================================+
|
||||
+==================+==========================+==========================+========================+
|
||||
| CPU plugin | Supported and preferred | Supported | Supported |
|
||||
+------------------+--------------------------+--------------------------+------------------------+
|
||||
| GPU plugin | Supported | Supported and preferred | Supported |
|
||||
+------------------+--------------------------+--------------------------+------------------------+
|
||||
| GNA plugin | Supported | Supported | Not supported |
|
||||
+------------------+--------------------------+--------------------------+------------------------+
|
||||
| Arm® CPU plugin | Supported and preferred | Supported | Supported (partially) |
|
||||
+------------------+--------------------------+--------------------------+------------------------+
|
||||
|
||||
@ -118,8 +127,11 @@ Supported Input Precision
|
||||
| Plugin | FP32 | FP16 | U8 | U16 | I8 | I16 |
|
||||
+==================+============+================+==============+================+================+================+
|
||||
| CPU plugin | Supported | Supported | Supported | Supported | Supported | Supported |
|
||||
+------------------+------------+----------------+--------------+----------------+----------------+----------------+
|
||||
| GPU plugin | Supported | Supported\* | Supported\* | Supported\* | Not supported | Supported\* |
|
||||
+------------------+------------+----------------+--------------+----------------+----------------+----------------+
|
||||
| GNA plugin | Supported | Not supported | Supported | Not supported | Supported | Supported |
|
||||
+------------------+------------+----------------+--------------+----------------+----------------+----------------+
|
||||
| Arm® CPU plugin | Supported | Supported | Supported | Supported | Not supported | Not supported |
|
||||
+------------------+------------+----------------+--------------+----------------+----------------+----------------+
|
||||
|
||||
@ -136,8 +148,11 @@ Supported Output Precision
|
||||
| Plugin | FP32 | FP16 |
|
||||
+==================+============+================+
|
||||
| CPU plugin | Supported | Supported |
|
||||
+------------------+------------+----------------+
|
||||
| GPU plugin | Supported | Supported |
|
||||
+------------------+------------+----------------+
|
||||
| GNA plugin | Supported | Not supported |
|
||||
+------------------+------------+----------------+
|
||||
| Arm® CPU plugin | Supported | Supported |
|
||||
+------------------+------------+----------------+
|
||||
|
||||
@ -152,8 +167,11 @@ Supported Input Layout
|
||||
| Plugin | NCDHW | NCHW | NHWC | NC |
|
||||
+==================+================+============+============+============+
|
||||
| CPU plugin | Supported | Supported | Supported | Supported |
|
||||
+------------------+----------------+------------+------------+------------+
|
||||
| GPU plugin | Supported | Supported | Supported | Supported |
|
||||
+------------------+----------------+------------+------------+------------+
|
||||
| GNA plugin | Not supported | Supported | Supported | Supported |
|
||||
+------------------+----------------+------------+------------+------------+
|
||||
| Arm® CPU plugin | Not supported | Supported | Supported | Supported |
|
||||
+------------------+----------------+------------+------------+------------+
|
||||
|
||||
@ -182,148 +200,291 @@ The following layers are supported by the plugins:
|
||||
| Layers | GPU | CPU | GNA | Arm® CPU |
|
||||
+================================+================+=================+================+====================+
|
||||
| Abs | Supported | Supported\*\* | Not Supported | Supported |
|
||||
+--------------------------------+----------------+-----------------+----------------+--------------------+
|
||||
| Acos | Supported | Supported\*\* | Not Supported | Supported\*\*\*\* |
|
||||
+--------------------------------+----------------+-----------------+----------------+--------------------+
|
||||
| Acosh | Supported | Supported\*\* | Not Supported | Supported\*\*\*\* |
|
||||
+--------------------------------+----------------+-----------------+----------------+--------------------+
|
||||
| Activation-Clamp | Supported | Supported\*\*\* | Supported | Supported |
|
||||
+--------------------------------+----------------+-----------------+----------------+--------------------+
|
||||
| Activation-ELU | Supported | Supported\*\*\* | Not Supported | Supported |
|
||||
+--------------------------------+----------------+-----------------+----------------+--------------------+
|
||||
| Activation-Exp | Supported | Supported\*\*\* | Supported | Supported |
|
||||
+--------------------------------+----------------+-----------------+----------------+--------------------+
|
||||
| Activation-Leaky ReLU | Supported | Supported\*\*\* | Supported | Not Supported |
|
||||
+--------------------------------+----------------+-----------------+----------------+--------------------+
|
||||
| Activation-Not | Supported | Supported\*\*\* | Not Supported | Not Supported |
|
||||
+--------------------------------+----------------+-----------------+----------------+--------------------+
|
||||
| Activation-PReLU | Supported | Supported\*\*\* | Not Supported | Supported |
|
||||
+--------------------------------+----------------+-----------------+----------------+--------------------+
|
||||
| Activation-ReLU | Supported | Supported\*\*\* | Supported | Supported |
|
||||
+--------------------------------+----------------+-----------------+----------------+--------------------+
|
||||
| Activation-ReLU6 | Supported | Supported\*\*\* | Not Supported | Not Supported |
|
||||
+--------------------------------+----------------+-----------------+----------------+--------------------+
|
||||
| Activation-Sigmoid/Logistic | Supported | Supported\*\*\* | Supported | Supported |
|
||||
+--------------------------------+----------------+-----------------+----------------+--------------------+
|
||||
| Activation-TanH | Supported | Supported\*\*\* | Supported | Supported |
|
||||
+--------------------------------+----------------+-----------------+----------------+--------------------+
|
||||
| ArgMax | Supported | Supported\*\* | Not Supported | Not Supported |
|
||||
+--------------------------------+----------------+-----------------+----------------+--------------------+
|
||||
| Asin | Supported | Supported\*\* | Not Supported | Supported\*\*\*\* |
|
||||
+--------------------------------+----------------+-----------------+----------------+--------------------+
|
||||
| Asinh | Supported | Supported\*\* | Not Supported | Supported\*\*\*\* |
|
||||
+--------------------------------+----------------+-----------------+----------------+--------------------+
|
||||
| Atan | Supported | Supported\*\* | Not Supported | Supported\*\*\*\* |
|
||||
+--------------------------------+----------------+-----------------+----------------+--------------------+
|
||||
| Atanh | Supported | Supported\*\* | Not Supported | Supported\*\*\*\* |
|
||||
+--------------------------------+----------------+-----------------+----------------+--------------------+
|
||||
| BatchNormalization | Supported | Supported | Not Supported | Supported |
|
||||
+--------------------------------+----------------+-----------------+----------------+--------------------+
|
||||
| BinaryConvolution | Supported | Supported | Not Supported | Not Supported |
|
||||
+--------------------------------+----------------+-----------------+----------------+--------------------+
|
||||
| Broadcast | Supported | Supported\*\* | Not Supported | Supported |
|
||||
+--------------------------------+----------------+-----------------+----------------+--------------------+
|
||||
| Ceil | Supported | Supported\*\* | Not Supported | Supported |
|
||||
+--------------------------------+----------------+-----------------+----------------+--------------------+
|
||||
| Concat | Supported | Supported\*\*\* | Supported | Supported |
|
||||
+--------------------------------+----------------+-----------------+----------------+--------------------+
|
||||
| Const | Supported | Supported | Supported | Supported |
|
||||
+--------------------------------+----------------+-----------------+----------------+--------------------+
|
||||
| Convolution-Dilated | Supported | Supported | Not Supported | Supported |
|
||||
+--------------------------------+----------------+-----------------+----------------+--------------------+
|
||||
| Convolution-Dilated 3D | Supported | Supported | Not Supported | Not Supported |
|
||||
+--------------------------------+----------------+-----------------+----------------+--------------------+
|
||||
| Convolution-Grouped | Supported | Supported | Not Supported | Supported |
|
||||
+--------------------------------+----------------+-----------------+----------------+--------------------+
|
||||
| Convolution-Grouped 3D | Supported | Supported | Not Supported | Not Supported |
|
||||
+--------------------------------+----------------+-----------------+----------------+--------------------+
|
||||
| Convolution-Ordinary | Supported | Supported | Supported\* | Supported |
|
||||
+--------------------------------+----------------+-----------------+----------------+--------------------+
|
||||
| Convolution-Ordinary 3D | Supported | Supported | Not Supported | Not Supported |
|
||||
+--------------------------------+----------------+-----------------+----------------+--------------------+
|
||||
| Cos | Supported | Supported\*\* | Not Supported | Supported\*\*\*\* |
|
||||
+--------------------------------+----------------+-----------------+----------------+--------------------+
|
||||
| Cosh | Supported | Supported\*\* | Not Supported | Supported\*\*\*\* |
|
||||
+--------------------------------+----------------+-----------------+----------------+--------------------+
|
||||
| Crop | Supported | Supported | Supported | Not Supported |
|
||||
+--------------------------------+----------------+-----------------+----------------+--------------------+
|
||||
| CTCGreedyDecoder | Supported\*\* | Supported\*\* | Not Supported | Supported\*\*\*\* |
|
||||
+--------------------------------+----------------+-----------------+----------------+--------------------+
|
||||
| Deconvolution | Supported | Supported | Not Supported | Not Supported |
|
||||
+--------------------------------+----------------+-----------------+----------------+--------------------+
|
||||
| Deconvolution 3D | Supported | Supported | Not Supported | Not Supported |
|
||||
+--------------------------------+----------------+-----------------+----------------+--------------------+
|
||||
| DeformableConvolution | Supported | Supported | Not Supported | Not Supported |
|
||||
+--------------------------------+----------------+-----------------+----------------+--------------------+
|
||||
| DepthToSpace | Supported | Supported\*\* | Not Supported | Supported\* |
|
||||
+--------------------------------+----------------+-----------------+----------------+--------------------+
|
||||
| DetectionOutput | Supported | Supported\*\* | Not Supported | Supported\*\*\*\* |
|
||||
+--------------------------------+----------------+-----------------+----------------+--------------------+
|
||||
| Eltwise-And | Supported | Supported\*\*\* | Not Supported | Supported |
|
||||
+--------------------------------+----------------+-----------------+----------------+--------------------+
|
||||
| Eltwise-Add | Supported | Supported\*\*\* | Not Supported | Supported |
|
||||
+--------------------------------+----------------+-----------------+----------------+--------------------+
|
||||
| Eltwise-Div | Supported | Supported\*\*\* | Not Supported | Supported |
|
||||
+--------------------------------+----------------+-----------------+----------------+--------------------+
|
||||
| Eltwise-Equal | Supported | Supported\*\*\* | Not Supported | Supported\* |
|
||||
+--------------------------------+----------------+-----------------+----------------+--------------------+
|
||||
| Eltwise-FloorMod | Supported | Supported\*\*\* | Not Supported | Supported\*\*\*\* |
|
||||
+--------------------------------+----------------+-----------------+----------------+--------------------+
|
||||
| Eltwise-Greater | Supported | Supported\*\*\* | Not Supported | Supported |
|
||||
+--------------------------------+----------------+-----------------+----------------+--------------------+
|
||||
| Eltwise-GreaterEqual | Supported | Supported\*\*\* | Not Supported | Supported |
|
||||
+--------------------------------+----------------+-----------------+----------------+--------------------+
|
||||
| Eltwise-Less | Supported | Supported\*\*\* | Not Supported | Supported\* |
|
||||
+--------------------------------+----------------+-----------------+----------------+--------------------+
|
||||
| Eltwise-LessEqual | Supported | Supported\*\*\* | Not Supported | Supported\* |
|
||||
+--------------------------------+----------------+-----------------+----------------+--------------------+
|
||||
| Eltwise-LogicalAnd | Supported | Supported\*\*\* | Not Supported | Supported |
|
||||
+--------------------------------+----------------+-----------------+----------------+--------------------+
|
||||
| Eltwise-LogicalOr | Supported | Supported\*\*\* | Not Supported | Supported |
|
||||
+--------------------------------+----------------+-----------------+----------------+--------------------+
|
||||
| Eltwise-LogicalXor | Supported | Supported\*\*\* | Not Supported | Supported |
|
||||
+--------------------------------+----------------+-----------------+----------------+--------------------+
|
||||
| Eltwise-Max | Supported | Supported\*\*\* | Not Supported | Supported |
|
||||
+--------------------------------+----------------+-----------------+----------------+--------------------+
|
||||
| Eltwise-Min | Supported | Supported\*\*\* | Not Supported | Supported |
|
||||
+--------------------------------+----------------+-----------------+----------------+--------------------+
|
||||
| Eltwise-Mul | Supported | Supported\*\*\* | Supported | Supported |
|
||||
+--------------------------------+----------------+-----------------+----------------+--------------------+
|
||||
| Eltwise-NotEqual | Supported | Supported\*\*\* | Not Supported | Supported\* |
|
||||
+--------------------------------+----------------+-----------------+----------------+--------------------+
|
||||
| Eltwise-Pow | Supported | Supported\*\*\* | Not Supported | Supported |
|
||||
+--------------------------------+----------------+-----------------+----------------+--------------------+
|
||||
| Eltwise-Prod | Supported | Supported\*\*\* | Supported | Not Supported |
|
||||
+--------------------------------+----------------+-----------------+----------------+--------------------+
|
||||
| Eltwise-SquaredDiff | Supported | Supported\*\*\* | Not Supported | Supported |
|
||||
+--------------------------------+----------------+-----------------+----------------+--------------------+
|
||||
| Eltwise-Sub | Supported | Supported\*\*\* | Supported | Supported |
|
||||
+--------------------------------+----------------+-----------------+----------------+--------------------+
|
||||
| Eltwise-Sum | Supported | Supported\*\*\* | Supported | Supported\*\*\*\* |
|
||||
+--------------------------------+----------------+-----------------+----------------+--------------------+
|
||||
| Erf | Supported | Supported\*\* | Not Supported | Supported\*\*\*\* |
|
||||
+--------------------------------+----------------+-----------------+----------------+--------------------+
|
||||
| Exp | Supported | Supported | Supported | Supported |
|
||||
+--------------------------------+----------------+-----------------+----------------+--------------------+
|
||||
| FakeQuantize | Not Supported | Supported | Not Supported | Supported\* |
|
||||
+--------------------------------+----------------+-----------------+----------------+--------------------+
|
||||
| Fill | Not Supported | Supported\*\* | Not Supported | Not Supported |
|
||||
+--------------------------------+----------------+-----------------+----------------+--------------------+
|
||||
| Flatten | Supported | Supported | Not Supported | Not Supported |
|
||||
+--------------------------------+----------------+-----------------+----------------+--------------------+
|
||||
| Floor | Supported | Supported\*\* | Not Supported | Supported |
|
||||
+--------------------------------+----------------+-----------------+----------------+--------------------+
|
||||
| FullyConnected (Inner Product) | Supported | Supported\*\*\* | Supported | Supported |
|
||||
+--------------------------------+----------------+-----------------+----------------+--------------------+
|
||||
| Gather | Supported | Supported\*\* | Not Supported | Supported\* |
|
||||
+--------------------------------+----------------+-----------------+----------------+--------------------+
|
||||
| GatherTree | Not Supported | Supported\*\* | Not Supported | Supported\*\*\*\* |
|
||||
+--------------------------------+----------------+-----------------+----------------+--------------------+
|
||||
| Gemm | Supported | Supported | Not Supported | Not Supported |
|
||||
+--------------------------------+----------------+-----------------+----------------+--------------------+
|
||||
| GRN | Supported\*\* | Supported\*\* | Not Supported | Supported |
|
||||
+--------------------------------+----------------+-----------------+----------------+--------------------+
|
||||
| HardSigmoid | Supported | Supported\*\* | Not Supported | Supported\*\*\*\* |
|
||||
+--------------------------------+----------------+-----------------+----------------+--------------------+
|
||||
| Interp | Supported\*\* | Supported\*\* | Not Supported | Supported\* |
|
||||
+--------------------------------+----------------+-----------------+----------------+--------------------+
|
||||
| Log | Supported | Supported\*\* | Supported | Supported |
|
||||
+--------------------------------+----------------+-----------------+----------------+--------------------+
|
||||
| LRN (Norm) | Supported | Supported | Not Supported | Supported\* |
|
||||
+--------------------------------+----------------+-----------------+----------------+--------------------+
|
||||
| LSTMCell | Supported | Supported | Supported | Supported |
|
||||
+--------------------------------+----------------+-----------------+----------------+--------------------+
|
||||
| GRUCell | Supported | Supported | Supported | Supported |
|
||||
+--------------------------------+----------------+-----------------+----------------+--------------------+
|
||||
| RNNCell | Supported | Supported | Not Supported | Supported |
|
||||
+--------------------------------+----------------+-----------------+----------------+--------------------+
|
||||
| LSTMSequence | Supported | Supported | Supported | Supported\*\*\*\* |
|
||||
+--------------------------------+----------------+-----------------+----------------+--------------------+
|
||||
| GRUSequence | Supported | Supported | Supported | Supported\*\*\*\* |
|
||||
+--------------------------------+----------------+-----------------+----------------+--------------------+
|
||||
| RNNSequence | Supported | Supported | Not Supported | Supported\*\*\*\* |
|
||||
+--------------------------------+----------------+-----------------+----------------+--------------------+
|
||||
| LogSoftmax | Supported | Supported\*\* | Not Supported | Supported |
|
||||
+--------------------------------+----------------+-----------------+----------------+--------------------+
|
||||
| Memory | Not Supported | Supported | Supported | Not Supported |
|
||||
+--------------------------------+----------------+-----------------+----------------+--------------------+
|
||||
| MVN | Supported | Supported\*\* | Not Supported | Supported\* |
|
||||
+--------------------------------+----------------+-----------------+----------------+--------------------+
|
||||
| Neg | Supported | Supported\*\* | Not Supported | Supported |
|
||||
+--------------------------------+----------------+-----------------+----------------+--------------------+
|
||||
| NonMaxSuppression | Not Supported | Supported\*\* | Not Supported | Supported\*\*\*\* |
|
||||
+--------------------------------+----------------+-----------------+----------------+--------------------+
|
||||
| Normalize | Supported | Supported\*\* | Not Supported | Supported\* |
|
||||
+--------------------------------+----------------+-----------------+----------------+--------------------+
|
||||
| OneHot | Supported | Supported\*\* | Not Supported | Supported\*\*\*\* |
|
||||
+--------------------------------+----------------+-----------------+----------------+--------------------+
|
||||
| Pad | Supported | Supported\*\* | Not Supported | Supported\* |
|
||||
+--------------------------------+----------------+-----------------+----------------+--------------------+
|
||||
| Permute | Supported | Supported | Supported\* | Not Supported |
|
||||
+--------------------------------+----------------+-----------------+----------------+--------------------+
|
||||
| Pooling(AVG,MAX) | Supported | Supported | Supported | Supported |
|
||||
+--------------------------------+----------------+-----------------+----------------+--------------------+
|
||||
| Pooling(AVG,MAX) 3D | Supported | Supported | Not Supported | Supported\* |
|
||||
+--------------------------------+----------------+-----------------+----------------+--------------------+
|
||||
| Power | Supported | Supported\*\* | Supported\* | Supported |
|
||||
+--------------------------------+----------------+-----------------+----------------+--------------------+
|
||||
| PowerFile | Not Supported | Supported\*\* | Not Supported | Not Supported |
|
||||
+--------------------------------+----------------+-----------------+----------------+--------------------+
|
||||
| PriorBox | Supported | Supported\*\* | Not Supported | Supported |
|
||||
+--------------------------------+----------------+-----------------+----------------+--------------------+
|
||||
| PriorBoxClustered | Supported\*\* | Supported\*\* | Not Supported | Supported |
|
||||
+--------------------------------+----------------+-----------------+----------------+--------------------+
|
||||
| Proposal | Supported | Supported\*\* | Not Supported | Supported\*\*\*\* |
|
||||
+--------------------------------+----------------+-----------------+----------------+--------------------+
|
||||
| PSROIPooling | Supported | Supported\*\* | Not Supported | Supported\*\*\*\* |
|
||||
+--------------------------------+----------------+-----------------+----------------+--------------------+
|
||||
| Range | Not Supported | Supported\*\* | Not Supported | Not Supported |
|
||||
+--------------------------------+----------------+-----------------+----------------+--------------------+
|
||||
| Reciprocal | Supported | Supported\*\* | Not Supported | Not Supported |
|
||||
+--------------------------------+----------------+-----------------+----------------+--------------------+
|
||||
| ReduceAnd | Supported | Supported\*\* | Not Supported | Supported\*\*\*\* |
|
||||
+--------------------------------+----------------+-----------------+----------------+--------------------+
|
||||
| ReduceL1 | Supported | Supported\*\* | Not Supported | Supported |
|
||||
+--------------------------------+----------------+-----------------+----------------+--------------------+
|
||||
| ReduceL2 | Supported | Supported\*\* | Not Supported | Supported |
|
||||
+--------------------------------+----------------+-----------------+----------------+--------------------+
|
||||
| ReduceLogSum | Supported | Supported\*\* | Not Supported | Supported |
|
||||
+--------------------------------+----------------+-----------------+----------------+--------------------+
|
||||
| ReduceLogSumExp | Supported | Supported\*\* | Not Supported | Not Supported |
|
||||
+--------------------------------+----------------+-----------------+----------------+--------------------+
|
||||
| ReduceMax | Supported | Supported\*\* | Not Supported | Supported |
|
||||
+--------------------------------+----------------+-----------------+----------------+--------------------+
|
||||
| ReduceMean | Supported | Supported\*\* | Not Supported | Supported |
|
||||
+--------------------------------+----------------+-----------------+----------------+--------------------+
|
||||
| ReduceMin | Supported | Supported\*\* | Not Supported | Supported |
|
||||
+--------------------------------+----------------+-----------------+----------------+--------------------+
|
||||
| ReduceOr | Supported | Supported\*\* | Not Supported | Supported\*\*\*\* |
|
||||
+--------------------------------+----------------+-----------------+----------------+--------------------+
|
||||
| ReduceProd | Supported | Supported\*\* | Not Supported | Supported |
|
||||
+--------------------------------+----------------+-----------------+----------------+--------------------+
|
||||
| ReduceSum | Supported | Supported\*\* | Not Supported | Supported |
|
||||
+--------------------------------+----------------+-----------------+----------------+--------------------+
|
||||
| ReduceSumSquare | Supported | Supported\*\* | Not Supported | Not Supported |
|
||||
+--------------------------------+----------------+-----------------+----------------+--------------------+
|
||||
| RegionYolo | Supported | Supported\*\* | Not Supported | Supported\*\*\*\* |
|
||||
+--------------------------------+----------------+-----------------+----------------+--------------------+
|
||||
| ReorgYolo | Supported | Supported\*\* | Not Supported | Supported |
|
||||
+--------------------------------+----------------+-----------------+----------------+--------------------+
|
||||
| Resample | Supported | Supported\*\* | Not Supported | Not Supported |
|
||||
+--------------------------------+----------------+-----------------+----------------+--------------------+
|
||||
| Reshape | Supported | Supported\*\*\* | Supported | Supported |
|
||||
+--------------------------------+----------------+-----------------+----------------+--------------------+
|
||||
| ReverseSequence | Supported | Supported\*\* | Not Supported | Supported\*\*\*\* |
|
||||
+--------------------------------+----------------+-----------------+----------------+--------------------+
|
||||
| RNN | Not Supported | Supported | Not Supported | Supported |
|
||||
+--------------------------------+----------------+-----------------+----------------+--------------------+
|
||||
| ROIPooling | Supported\* | Supported | Not Supported | Supported\*\*\*\* |
|
||||
+--------------------------------+----------------+-----------------+----------------+--------------------+
|
||||
| ScaleShift | Supported | Supported\*\*\* | Supported | Not Supported |
|
||||
+--------------------------------+----------------+-----------------+----------------+--------------------+
|
||||
| ScatterUpdate | Not Supported | Supported\*\* | Not Supported | Not Supported |
|
||||
+--------------------------------+----------------+-----------------+----------------+--------------------+
|
||||
| Select | Supported | Supported | Not Supported | Supported |
|
||||
+--------------------------------+----------------+-----------------+----------------+--------------------+
|
||||
| Selu | Supported | Supported\*\* | Not Supported | Supported\*\*\*\* |
|
||||
+--------------------------------+----------------+-----------------+----------------+--------------------+
|
||||
| ShuffleChannels | Supported | Supported\*\* | Not Supported | Supported |
|
||||
+--------------------------------+----------------+-----------------+----------------+--------------------+
|
||||
| Sign | Supported | Supported\*\* | Not Supported | Supported |
|
||||
+--------------------------------+----------------+-----------------+----------------+--------------------+
|
||||
| Sin | Supported | Supported\*\* | Not Supported | Supported |
|
||||
+--------------------------------+----------------+-----------------+----------------+--------------------+
|
||||
| Sinh | Supported | Supported\*\* | Not Supported | Supported\*\*\*\* |
|
||||
+--------------------------------+----------------+-----------------+----------------+--------------------+
|
||||
| SimplerNMS | Supported | Supported\*\* | Not Supported | Not Supported |
|
||||
+--------------------------------+----------------+-----------------+----------------+--------------------+
|
||||
| Slice | Supported | Supported\*\*\* | Supported | Not Supported |
|
||||
+--------------------------------+----------------+-----------------+----------------+--------------------+
|
||||
| SoftMax | Supported | Supported\*\*\* | Not Supported | Supported |
|
||||
+--------------------------------+----------------+-----------------+----------------+--------------------+
|
||||
| Softplus | Supported | Supported\*\* | Not Supported | Supported |
|
||||
+--------------------------------+----------------+-----------------+----------------+--------------------+
|
||||
| Softsign | Supported | Supported\*\* | Supported | Not Supported |
|
||||
+--------------------------------+----------------+-----------------+----------------+--------------------+
|
||||
| SpaceToDepth | Not Supported | Supported\*\* | Not Supported | Supported\* |
|
||||
+--------------------------------+----------------+-----------------+----------------+--------------------+
|
||||
| SpatialTransformer | Not Supported | Supported\*\* | Not Supported | Not Supported |
|
||||
+--------------------------------+----------------+-----------------+----------------+--------------------+
|
||||
| Split | Supported | Supported\*\*\* | Supported | Supported |
|
||||
+--------------------------------+----------------+-----------------+----------------+--------------------+
|
||||
| Squeeze | Supported | Supported\*\* | Supported | Supported |
|
||||
+--------------------------------+----------------+-----------------+----------------+--------------------+
|
||||
| StridedSlice | Supported | Supported\*\* | Not Supported | Supported\* |
|
||||
+--------------------------------+----------------+-----------------+----------------+--------------------+
|
||||
| Tan | Supported | Supported\*\* | Not Supported | Supported\*\*\*\* |
|
||||
+--------------------------------+----------------+-----------------+----------------+--------------------+
|
||||
| TensorIterator | Not Supported | Supported | Supported | Supported |
|
||||
+--------------------------------+----------------+-----------------+----------------+--------------------+
|
||||
| Tile | Supported\*\* | Supported\*\*\* | Not Supported | Supported |
|
||||
+--------------------------------+----------------+-----------------+----------------+--------------------+
|
||||
| TopK | Supported | Supported\*\* | Not Supported | Supported\*\*\*\* |
|
||||
+--------------------------------+----------------+-----------------+----------------+--------------------+
|
||||
| Unpooling | Supported | Not Supported | Not Supported | Not Supported |
|
||||
+--------------------------------+----------------+-----------------+----------------+--------------------+
|
||||
| Unsqueeze | Supported | Supported\*\* | Supported | Supported |
|
||||
+--------------------------------+----------------+-----------------+----------------+--------------------+
|
||||
| Upsampling | Supported | Not Supported | Not Supported | Not Supported |
|
||||
+--------------------------------+----------------+-----------------+----------------+--------------------+
|
||||
|
||||
|
||||
@ -16,7 +16,7 @@ Linux
|
||||
To install the latest available **Intel® Graphics Compute Runtime for OpenCL™** for your OS, see the `Install Guides <https://github.com/intel/compute-runtime/releases/latest>`__ .
|
||||
|
||||
.. note::
|
||||
If you use RedHat 8 OS please install OpenCL library as prerequisite via following command line: ```sh rpm -ivh http://mirror.centos.org/centos/8-stream/AppStream/x86_64/os/Packages/ocl-icd-2.2.12-1.el8.x86_64.rpm```
|
||||
If you use RedHat 8 OS please install OpenCL library as prerequisite via following command line: ``sh rpm -ivh http://mirror.centos.org/centos/8-stream/AppStream/x86_64/os/Packages/ocl-icd-2.2.12-1.el8.x86_64.rpm``
|
||||
|
||||
.. note::
|
||||
For instructions specific to discrete graphics platforms, refer to `the dgpu guide <https://dgpu-docs.intel.com/installation-guides/index.html>`__ (Intel® Arc™ A-Series Graphics, Intel® Data Center GPU Flex Series, Intel® Data Center GPU MAX Series, Intel® processor graphics Gen12, and Intel® Iris Xe MAX codename DG1).
|
||||
@ -57,8 +57,11 @@ In the internal OpenVINO validation the following versions of Intel Graphics Dri
|
||||
| Operation System | Driver version |
|
||||
+==================+=====================================================================================+
|
||||
| Ubuntu 20.04 | `22.35.24055 <https://github.com/intel/compute-runtime/releases/tag/22.35.24055>`__ |
|
||||
+------------------+-------------------------------------------------------------------------------------+
|
||||
| Ubuntu 18.04 | `21.38.21026 <https://github.com/intel/compute-runtime/releases/tag/21.38.21026>`__ |
|
||||
+------------------+-------------------------------------------------------------------------------------+
|
||||
| CentOS 7 | `19.41.14441 <https://github.com/intel/compute-runtime/releases/tag/19.41.14441>`__ |
|
||||
+------------------+-------------------------------------------------------------------------------------+
|
||||
| RHEL 8 | `22.28.23726 <https://github.com/intel/compute-runtime/releases/tag/22.28.23726>`__ |
|
||||
+------------------+-------------------------------------------------------------------------------------+
|
||||
|
||||
|
||||
@ -73,11 +73,13 @@ Next Steps
|
||||
##########
|
||||
|
||||
Still unsure if you want to install OpenVINO toolkit? Check out the :doc:`OpenVINO tutorials <tutorials>` to run example applications directly in your web browser without installing it locally. Here are some exciting demos you can explore:
|
||||
|
||||
- `Monodepth Estimation with OpenVINO <https://docs.openvino.ai/latest/notebooks/201-vision-monodepth-with-output.html>`__
|
||||
- `Style Transfer on ONNX Models with OpenVINO <https://docs.openvino.ai/latest/notebooks/212-onnx-style-transfer-with-output.html>`__
|
||||
- `OpenVINO API Tutorial <https://docs.openvino.ai/latest/notebooks/002-openvino-api-with-output.html>`__
|
||||
|
||||
Follow these links to install OpenVINO:
|
||||
|
||||
- :doc:`Install OpenVINO Development Tools <openvino_docs_install_guides_install_dev_tools>`
|
||||
- :doc:`Install OpenVINO Runtime <openvino_docs_install_guides_install_runtime>`
|
||||
- `Build from Source <https://github.com/openvinotoolkit/openvino/blob/master/docs/dev/build.md>`__
|
||||
|
||||
@ -1,6 +1,5 @@
|
||||
# Model Zoo {#model_zoo}
|
||||
|
||||
|
||||
@sphinxdirective
|
||||
|
||||
.. _model zoo:
|
||||
@ -28,10 +27,10 @@
|
||||
omz_model_api_ovms_adapter
|
||||
|
||||
|
||||
Open Model Zoo for OpenVINO™ toolkit delivers a wide variety of free, pre-trained deep learning models and demo applications that provide full application templates to help you implement deep learning in Python, C++, or OpenCV Graph API (G-API). Models and demos are avalable in the `Open Model Zoo GitHub repo <https://github.com/openvinotoolkit/open_model_zoo>`__ and licensed under Apache License Version 2.0.
|
||||
|
||||
Browse through over 200 neural network models, both :doc:`public <omz_models_group_public>` and from :doc:`Intel <omz_models_group_intel>`, and pick the right one for your solution. Types include object detection, classification, image segmentation, handwriting recognition, text to speech, pose estimation, and others. The Intel models have already been converted to work with OpenVINO™ toolkit, while public models can easily be converted using the :doc:`Model Optimizer <openvino_docs_MO_DG_Deep_Learning_Model_Optimizer_DevGuide>` utility.
|
||||
|
||||
Get started with simple :doc:`step-by-step procedures <openvino_docs_get_started_get_started_demos>` to learn how to build and run demo applications or discover the :doc:`full set of demos <omz_demos>` and adapt them for implementing specific deep learning scenarios in your applications.
|
||||
|
||||
@endsphinxdirective
|
||||
|
||||
Open Model Zoo for OpenVINO™ toolkit delivers a wide variety of free, pre-trained deep learning models and demo applications that provide full application templates to help you implement deep learning in Python, C++, or OpenCV Graph API (G-API). Models and demos are avalable in the [Open Model Zoo GitHub repo](https://github.com/openvinotoolkit/open_model_zoo) and licensed under Apache License Version 2.0.
|
||||
|
||||
Browse through over 200 neural network models, both [public](@ref omz_models_group_public) and from [Intel](@ref omz_models_group_intel), and pick the right one for your solution. Types include object detection, classification, image segmentation, handwriting recognition, text to speech, pose estimation, and others. The Intel models have already been converted to work with OpenVINO™ toolkit, while public models can easily be converted using the [Model Optimizer](@ref openvino_docs_MO_DG_Deep_Learning_Model_Optimizer_DevGuide) utility.
|
||||
|
||||
Get started with simple [step-by-step procedures](get_started/get_started_demos.md) to learn how to build and run demo applications or discover the [full set of demos](@ref omz_demos) and adapt them for implementing specific deep learning scenarios in your applications.
|
||||
Loading…
Reference in New Issue
Block a user