IntenseWebs/openvino
3
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity

benchmark_app: except ALLOW_AUTO_BATCHING (#17731)

Browse Source 
* benchmark_app: except ALLOW_AUTO_BATCHING

Running benchmark_app.py with -b 1 -d CPU fails with
`Unsupported property ALLOW_AUTO_BATCHING by CPU plugin`.

C++ benchmark_app sets ALLOW_AUTO_BATCHING in
ov::Core::compile_model() call, which doesn't trigger the error.

* Move `ALLOW_AUTO_BATCHING` to `device_config`
This commit is contained in:
Zlobin Vladimir 2023-05-26 18:52:15 +04:00 committed by GitHub
parent cd4b920bc9
commit 84f46bd048
No known key found for this signature in database
GPG Key ID: 4AEE18F83AFDEB23
2 changed files with 1 additions and 4 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

3
tools/benchmark_tool/openvino/tools/benchmark/benchmark.py
View File

@ -59,9 +59,6 @@ class Benchmark:
def set_cache_dir(self, cache_dir: str):
self.core.set_property({'CACHE_DIR': cache_dir})
def set_allow_auto_batching(self, flag: bool):
self.core.set_property({'ALLOW_AUTO_BATCHING': flag})
def read_model(self, path_to_model: str):
model_filename = os.path.abspath(path_to_model)
head, ext = os.path.splitext(model_filename)

2
tools/benchmark_tool/openvino/tools/benchmark/main.py
View File

@ -324,7 +324,7 @@ def main():
## If set batch size, disable the auto batching
if args.batch_size:
logger.warning("Batch size is set. Auto batching will be disabled")
benchmark.set_allow_auto_batching(False)
device_config["ALLOW_AUTO_BATCHING"] = False
topology_name = ""
load_from_file_enabled = is_flag_set_in_command_line('load_from_file') or is_flag_set_in_command_line('lfile')