IntenseWebs/openvino
3
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity

autoplugin_accelerate (#14838)

Browse Source
This commit is contained in:
Maciej Smyk 2023-01-03 14:55:21 +01:00 committed by GitHub
parent b361c132d6
commit 29b17e1c23
No known key found for this signature in database
GPG Key ID: 4AEE18F83AFDEB23
3 changed files with 1075 additions and 7 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

6
docs/OV_Runtime_UG/auto_device_selection.md
View File

@ -54,7 +54,7 @@ For example, if you use a CPU and a GPU, the first-inference latency of AUTO wil
Note that if you choose to exclude CPU from the priority list, it will be unable to support the initial model compilation stage.
![autoplugin_accelerate]
![](../img/autoplugin_accelerate.svg)
This mechanism can be easily observed in the [Using AUTO with Benchmark app sample](#using-auto-with-openvino-samples-and-benchmark-app) section, showing how the first-inference latency (the time it takes to compile the model and perform the first inference) is reduced when using AUTO. For example:
@ -318,11 +318,9 @@ For more information, refer to the [C++](../../samples/cpp/benchmark_app/README.
No demos are yet fully optimized for AUTO, by means of selecting the most suitable device, using the GPU streams/throttling, and so on.
@endsphinxdirective
## See Also
## Additional Resources
- [Debugging AUTO](AutoPlugin_Debugging.md)
- [Running on Multiple Devices Simultaneously](./multi_device.md)
- [Supported Devices](supported_plugins/Supported_Devices.md)
[autoplugin_accelerate]: ../img/autoplugin_accelerate.png

3
docs/img/autoplugin_accelerate.png
View File

@ -1,3 +0,0 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ba092e65d9c5c6fb585c4a394ba3e6a913bf4f129a386b7a8664b94aeb47878b
size 61218

1073
docs/img/autoplugin_accelerate.svg Normal file
View File

File diff suppressed because it is too large Load Diff
Side by Side

After

Width:  |  Height:  |  Size: 124 KiB