[Benchmark] benchmark_app need disable auto batching if batch size is set. (#12553)

* When set batch_size, disable auto batching

* auto-batch only supprt auto plugin

* Set property allow_auto_batching for devices

* cancel static

* Clean Code

* Add test case for testing allow_auto_batching

* Fix the issue after merging latest master branch code

* Add allow_auto_batching in python benchmark_app

* Fix the quotes issue

* When load_network is set to allow-auto-batching, there is no need to read the value of global

* Fix the clang-format

* Change the location

Co-authored-by: River Li <river.li@intel.com>
Co-authored-by: Chen Peter <peter.chen@intel.com>
This commit is contained in:
RICKIE777
2022-09-22 09:50:30 +08:00
committed by GitHub
parent ce9751a0a4
commit 9d56cfd79b
6 changed files with 49 additions and 0 deletions

View File

@@ -437,6 +437,11 @@ int main(int argc, char* argv[]) {
core.set_property(ov::cache_dir(FLAGS_cache_dir));
}
// If set batch size, disable the auto batching
if (FLAGS_b > 0) {
core.set_property(ov::hint::allow_auto_batching(false));
}
bool isDynamicNetwork = false;
if (FLAGS_load_from_file && !isNetworkCompiled) {