IntenseWebs/openvino
3
0 Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity

AUTO cumulative throughput mode ignore candidate device that fail to … (#15420)

Browse Source 
* AUTO cumulative throughput mode ignore candidate device that fail to load device

* Simplify the judgement logic of whether Auto set to Multi

* Add description about _AutoSetToMulti variable

* Update variable name to _AutoCallMulti

* Refine logic of AUTO execution_devices

* Add loading error massage

* Add test case

* Add filter to execution_devices of MULTI

* Add execution_devices test in load fail sitution

* Simplify the logic of execution_devices

* Update auto_executable_network.cpp

* Update src/plugins/auto/multi_executable_network.cpp

Co-authored-by: yanlan song <bell.song@intel.com>

* Update src/plugins/auto/auto_executable_network.cpp

Co-authored-by: yanlan song <bell.song@intel.com>

* Update test case

---------

Co-authored-by: Chen Peter <peter.chen@intel.com>
Co-authored-by: yanlan song <bell.song@intel.com>
This commit is contained in:
Wang Wangwangyanlan songChen Peter
 authored and GitHub committed 2023-03-07 11:52:25 +08:00
1 parent 6e7bef529f
commit 83b57e2a64
6 files changed
+303 -30
Download Patch File Download Diff File Expand all files Collapse all files

No files matched your search

src/inference/tests/functional/caching_test.cpp
+2 -2
View File
@@ -2256,8 +2256,8 @@ TEST_P(CachingTest, LoadMulti_NoCachingOnDevice) {
EXPECT_CALL(*mockPlugin, LoadExeNetworkImpl(_, _, _)).Times(0);
EXPECT_CALL(*mockPlugin, LoadExeNetworkImpl(_, _)).Times(TEST_DEVICE_MAX_COUNT);
// Load network from file shall not be called by Multi plugin for devices with caching supported
EXPECT_CALL(*mockPlugin, OnLoadNetworkFromFile()).Times(0);
EXPECT_CALL(*mockPlugin, OnLoadNetworkFromFile())
.Times(m_type == TestLoadType::ECNN ? 0 : TEST_DEVICE_MAX_COUNT);
EXPECT_CALL(*mockPlugin, ImportNetwork(_, _, _)).Times(0);
EXPECT_CALL(*mockPlugin, ImportNetwork(_, _)).Times(0);
for (auto& net : networks) {