IntenseWebs/openvino
3
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity

Add warning of benchmark_app about disabling auto batching (#13907)

Browse Source 
* merge master

* reset original format

* remove AUTO

* Update tools/benchmark_tool/openvino/tools/benchmark/main.py

Co-authored-by: Zlobin Vladimir <vladimir.zlobin@intel.com>

* delete condition

* delete condition in py

Co-authored-by: Zlobin Vladimir <vladimir.zlobin@intel.com>
Co-authored-by: Chen Peter <peter.chen@intel.com>
This commit is contained in:
Haiqi Pan
2022-12-15 10:51:57 +08:00
committed by GitHub
parent 2f95de3239
commit befbae28ca
2 changed files with 2 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

1
samples/cpp/benchmark_app/main.cpp
View File

@@ -600,6 +600,7 @@ int main(int argc, char* argv[]) {
// If set batch size, disable the auto batching
if (FLAGS_b > 0) {
slog::warn << "Batch size is set. Auto batching will be disabled" << slog::endl;
core.set_property(ov::hint::allow_auto_batching(false));
}

1
tools/benchmark_tool/openvino/tools/benchmark/main.py
View File

@@ -332,6 +332,7 @@ def main():
## If set batch size, disable the auto batching
if args.batch_size:
logger.warning("Batch size is set. Auto batching will be disabled")
benchmark.set_allow_auto_batching(False)
topology_name = ""