[Benchmark] benchmark_app need disable auto batching if batch size is set. (#12553)
* When set batch_size, disable auto batching * auto-batch only supprt auto plugin * Set property allow_auto_batching for devices * cancel static * Clean Code * Add test case for testing allow_auto_batching * Fix the issue after merging latest master branch code * Add allow_auto_batching in python benchmark_app * Fix the quotes issue * When load_network is set to allow-auto-batching, there is no need to read the value of global * Fix the clang-format * Change the location Co-authored-by: River Li <river.li@intel.com> Co-authored-by: Chen Peter <peter.chen@intel.com>
This commit is contained in:
@@ -437,6 +437,11 @@ int main(int argc, char* argv[]) {
|
||||
core.set_property(ov::cache_dir(FLAGS_cache_dir));
|
||||
}
|
||||
|
||||
// If set batch size, disable the auto batching
|
||||
if (FLAGS_b > 0) {
|
||||
core.set_property(ov::hint::allow_auto_batching(false));
|
||||
}
|
||||
|
||||
bool isDynamicNetwork = false;
|
||||
|
||||
if (FLAGS_load_from_file && !isNetworkCompiled) {
|
||||
|
||||
Reference in New Issue
Block a user