IntenseWebs/openvino
3
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity

[DOCS][AUTO] Add enable_runtime_fallback property to AUTO Device Sele… (#16645)

Browse Source 
* [DOCS][AUTO] Add enable_runtime_fallback property to AUTO Device Selection article

* Update docs/OV_Runtime_UG/auto_device_selection.md

Co-authored-by: Karol Blaszczak <karol.blaszczak@intel.com>

* Update docs/OV_Runtime_UG/auto_device_selection.md

Co-authored-by: Karol Blaszczak <karol.blaszczak@intel.com>

* Update docs/OV_Runtime_UG/auto_device_selection.md

---------

Co-authored-by: Karol Blaszczak <karol.blaszczak@intel.com>
This commit is contained in:
Wang Wangwang 2023-04-06 14:35:55 +08:00 committed by GitHub
parent f95fd27c16
commit 362389c733
No known key found for this signature in database
GPG Key ID: 4AEE18F83AFDEB23
1 changed files with 9 additions and 0 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

9
docs/OV_Runtime_UG/auto_device_selection.md
View File

@ -135,6 +135,15 @@ Following the OpenVINO™ naming convention, the Automatic Device Selection mode
| | | | beginning. The default value is ``true``, indicating that CPU is |
| | | | used as acceleration by default. |
+-----------------------------------------------+----------------------------------------------------------------------+
| | ``ov::intel_auto::enable_runtime_fallback`` | | **Values**: |
| | | | ``true`` |
| | | | ``false`` |
| | | | |
| | | | Enables/disables runtime fallback to other devices and performs |
| | | | the failed inference request again, if inference request fails on |
| | | | the currently selected device. |
| | | | The default value is ``true``. |
+-----------------------------------------------+----------------------------------------------------------------------+
Inference with AUTO is configured similarly to when device plugins are used:
you compile the model on the plugin with configuration and execute inference.