Commit Graph
17 Commits
Author SHA1 Message Date
Wang Wangwang 3a2958b360 [GPU] Fix convert fc to compressed when the input is SubGraphOp (#21687) 2023-12-18 13:29:16 +04:00
Wang Wangwang 1693ef17f0 [HETERO] Fix split subgraphs with parameter of different affinity (#21026) 2023-11-16 12:37:00 +04:00
Wang WangwangandChen Peter 84bd391369 [AUTO] Support setting log_level from config (#17569)
* [AUTO] Support setting log_level from config

* Add test cases

---------

Co-authored-by: Chen Peter <peter.chen@intel.com>
2023-06-07 10:31:27 +08:00
Wang WangwangandWanglei Shen 962df2cdcb [AUTO] Exclude other vendor's GPU device in default candidate list (#17063)
* [AUTO] Plugin takes only Intel dGPU as 1st priority

* Update test case

* Simplify the code

* Support more test cases in GetDeviceList API

* Add notIntelGPU to _deviceBlocklist in AUTO plugin

* Restore some code formats

* Update test cases

* Add some logs to GetValidDevice API

* Simplify the code

---------

Co-authored-by: Wanglei Shen <wanglei.shen@intel.com>
2023-04-26 14:42:53 +01:00
Wang Wangwang 589bd6d076 Add the implementation to GetExecGraphInfo API in AUTO plugin (#16979) 2023-04-17 17:24:07 +08:00
Wang Wangwang 1037f24c46 [AUTO] Remove exclusive_asyc_requests property from AUTO plugin (#16840)
* Remove exclusive_asyc_requests property from AUTO plugin

* Update test case

* Add test case to test incorrect config

* Remove the test case related to exclusive_asyc_requests property of AUTO plugin
2023-04-13 06:35:42 +00:00
Wang Wangwang c2c2143f45 clean AB property from virtual plugin and core global config (#16877)
* Benchmark_app set ov::hint::allow_auto_batching through compile_model

* Remove the process about allow_auto_batching in set_property of core

* Remove allow_auto_batching and auto_batch_timeout property from AUTO plugin

* Reserve the info logs and add API to check auto_batching

* Update test case, rm AB property test from core config tests

* Update some API in AUTO plugin config
2023-04-12 17:37:57 +04:00
Wang Wangwang 57684e28ff [AUTO] Remove cache_dir property from AUTO plugin (#16775)
* Remove cache_dir property from AUTO plugin

* Pass the secondary property to hardware plugin

* Update test case

* Update test case, meta plugin will pass the properties to device without checking
2023-04-10 11:42:24 +04:00
Wang WangwangandChen Peter 53d9b26e1f [AUTO] Show the detailed failure message when AUTO load network failed (#16297)
* Show the detailed failure message when AUTO load network failed

* Add test case

* Update test case to check multi load network failed

* Update test case based master

* RM _availableDevices hard code from AUTO

---------

Co-authored-by: Chen Peter <peter.chen@intel.com>
2023-04-06 15:41:32 +08:00
Wang WangwangandKarol Blaszczak 362389c733 [DOCS][AUTO] Add enable_runtime_fallback property to AUTO Device Sele… (#16645)
* [DOCS][AUTO] Add enable_runtime_fallback property to AUTO Device Selection article

* Update docs/OV_Runtime_UG/auto_device_selection.md

Co-authored-by: Karol Blaszczak <karol.blaszczak@intel.com>

* Update docs/OV_Runtime_UG/auto_device_selection.md

Co-authored-by: Karol Blaszczak <karol.blaszczak@intel.com>

* Update docs/OV_Runtime_UG/auto_device_selection.md

---------

Co-authored-by: Karol Blaszczak <karol.blaszczak@intel.com>
2023-04-06 14:35:55 +08:00
Wang Wangwang 99eda5b5e1 [PYTHON][CAPI][AUTO] Add ENABLE_STARTUP_FALLBACK and ENABLE_RUNTIME_FALLBACK proper… (#16436)
* [AUTO] Add ENABLE_STARTUP_FALLBACK and ENABLE_RUNTIME_FALLBACK properties to Python API

* Add DEVICE_BIND_BUFFER property

* Add AUTO properties to C API

* Update test case && Update AUTO properties in PYTHON API

* Create dedicated files for auto plugin

* Update header files

* Update test case

* Modify code style

* Update variable name

* Add test case for invalid input value
2023-04-03 11:56:48 +08:00
Wang Wangwang 9c7f7b8338 Runtime fallback to other devices (#16015)
* Runtime fallback to other devices

* Update properties.hpp

* Update infer callback in AUTO

* Avoid some hang cases

* Add test cases for AUTO runtime fallback

* Replace mockExecutor with ImmediateExecutor

* Update the runtime fallback logic

* Update test case and support the case thar infer failed on CPU_HELP

* Update the test to detect whether to throw exception

* fix the error of CTPUT

* Add lock to AUTO executable network GetContext

* Update variable name in selectOtherDevice API

* Simplify variables and add testcase to improve test coverage

* Fix the issues when release CPU_HELP device and clean up the code

* Clean up code
2023-03-20 10:13:07 +08:00
83b57e2a64 AUTO cumulative throughput mode ignore candidate device that fail to … (#15420)
* AUTO cumulative throughput mode ignore candidate device that fail to load device

* Simplify the judgement logic of whether Auto set to Multi

* Add description about _AutoSetToMulti variable

* Update variable name to _AutoCallMulti

* Refine logic of AUTO execution_devices

* Add loading error massage

* Add test case

* Add filter to execution_devices of MULTI

* Add execution_devices test in load fail sitution

* Simplify the logic of execution_devices

* Update auto_executable_network.cpp

* Update src/plugins/auto/multi_executable_network.cpp

Co-authored-by: yanlan song <bell.song@intel.com>

* Update src/plugins/auto/auto_executable_network.cpp

Co-authored-by: yanlan song <bell.song@intel.com>

* Update test case

---------

Co-authored-by: Chen Peter <peter.chen@intel.com>
Co-authored-by: yanlan song <bell.song@intel.com>
2023-03-07 11:52:25 +08:00
Wang WangwangandYuan Xu 9e3b3e0566 Docs: Update the doc on execution devices property and enable_startup_fallback property (#14750)
* Docs: Update the doc on default hint and execution devices property (#14836)

* Docs: Update to LATENCY as default hint
* Docs: Update the doc on execution devices property
* Update auto_device_selection.md

Co-authored-by: Yuan Xu <yuan1.xu@intel.com>

* Update docs/OV_Runtime_UG/auto_device_selection.md

* Update docs/OV_Runtime_UG/auto_device_selection.md

* Update docs/OV_Runtime_UG/auto_device_selection.md

Co-authored-by: Yuan Xu <yuan1.xu@intel.com>

* Update docs/OV_Runtime_UG/auto_device_selection.md

Co-authored-by: Yuan Xu <yuan1.xu@intel.com>

* Update docs/OV_Runtime_UG/auto_device_selection.md

Co-authored-by: Yuan Xu <yuan1.xu@intel.com>

* Update docs/OV_Runtime_UG/auto_device_selection.md

* Update docs/OV_Runtime_UG/auto_device_selection.md

---------

Co-authored-by: Yuan Xu <yuan1.xu@intel.com>
2023-02-21 11:24:19 +08:00
d7f47aa122 Provide ENABLE_STARTUP_FALLBACK property to enable/disable CPU as acc… (#14503)
* Provide ENABLE_STARTUP_FALLBACK property to enable/disable CPU as acceleration

* Add more test cases to ENABLE_STARTUP_FALLBACK property

* Remove unnecessary config

* Remove plugin.hpp

* Update test case by PR#14754

* Update copyright

Co-authored-by: River Li <river.li@intel.com>

* Simplify using namespace

---------

Co-authored-by: Chen Peter <peter.chen@intel.com>
Co-authored-by: River Li <river.li@intel.com>
2023-02-17 11:15:07 +08:00
Wang Wangwangandyanlan song b8636222c3 Apply ov::execution_devices to GPU & CPU & AUTO BATCH & MULTI (#14109)
* Apply ov::execution_devices to GPU & CPU & AUTO BATCH & MULTI

* Apply ov::execution_devices to GNA

Co-authored-by: yanlan song <bell.song@intel.com>
2022-12-28 10:41:50 +04:00
Wang Wangwang 7bbd428e48 Docs: Update the doc on how to manually set operations affinity & fix some spelling errors (#13203)
* Docs: Fix spelling errors

* Docs: Update the doc on how to manually set operations affinity
2022-09-26 10:39:44 +04:00