* Added Debian, Raspbian, Ubuntu 22.10 support
* Updated dependencies.cmake
* Fixes in script
* Added RHEL 9.1 support
* Added proper comments
* Compilation of rpm packages for aarch64 is fixed
* Proper generation of requirements.txt files when ENABLE_WHEEL=OFF
* samples build improvements
* Proper name for json library
* Proper condtion in samples
* [AUTO] update property setting logic.
* Update core::set_property() logic to only support primary property for AUTO and MULTI.
* Separate AUTO and MULTI supported properties.
Signed-off-by: Wang, Yang <yang4.wang@intel.com>
* Add test case.
Signed-off-by: Wang, Yang <yang4.wang@intel.com>
* 1. revert the changes for ie core.
2. Enable AUTO/MULTI only accepting its own properties.
3. Enable AUTO/MULTI accepting device properties passed from loadnetwork().
Signed-off-by: Wang, Yang <yang4.wang@intel.com>
* Revert "[AUTO]Update the incorrect config test for Myriad (#13271)"
This reverts commit 0552d98802.
* MULTI only accepts its own properties that is same as AUTO currently.
Signed-off-by: Wang, Yang <yang4.wang@intel.com>
* Add test cases for AUTO/MULTI property test.
Signed-off-by: Wang, Yang <yang4.wang@intel.com>
* Update to enable MULTI supporting hw primary property setting throw the compile_model().
Signed-off-by: Wang, Yang <yang4.wang@intel.com>
* Remove the added test case for setting secondary property through set_property().
Signed-off-by: Wang, Yang <yang4.wang@intel.com>
* Update.
Signed-off-by: Wang, Yang <yang4.wang@intel.com>
* 1. For AUTO/MULTI, property setting will be passed via core::compile_model() instead of core::set_property().
2. update the logic to infer precision setting that will transform into secondary property setting to each hw device.
Signed-off-by: Wang, Yang <yang4.wang@intel.com>
* Update.
Signed-off-by: Wang, Yang <yang4.wang@intel.com>
* set default value for nstreams when -d AUTO/MULTI and no nstreams setting from command line.
Signed-off-by: Wang, Yang <yang4.wang@intel.com>
* Update code format.
Signed-off-by: Wang, Yang <yang4.wang@intel.com>
* Enable BA to support if -d AUTO:MULTI,xxx/MULTI:AUTO,xxx. while AUTO Plugin need to update the logic of generating supported config list to virtual device.
Signed-off-by: Wang, Yang <yang4.wang@intel.com>
* Update.
Signed-off-by: Wang, Yang <yang4.wang@intel.com>
* Update.
Signed-off-by: Wang, Yang <yang4.wang@intel.com>
* update.
Signed-off-by: Wang, Yang <yang4.wang@intel.com>
* move device configuration handling outside form function main.
Signed-off-by: Wang, Yang <yang4.wang@intel.com>
* Revert "move device configuration handling outside form function main."
This reverts commit ef77bfc602.
* Update.
Signed-off-by: Wang, Yang <yang4.wang@intel.com>
* Update.
Signed-off-by: Wang, Yang <yang4.wang@intel.com>
* update.
Signed-off-by: Wang, Yang <yang4.wang@intel.com>
* Update.
Signed-off-by: Wang, Yang <yang4.wang@intel.com>
* Setting property performance hint to 'THROUGHPUT' and passing to executable network if no setting for of AUTO/MULTI.
Signed-off-by: Wang, Yang <yang4.wang@intel.com>
* Update.
Signed-off-by: Wang, Yang <yang4.wang@intel.com>
* Update.
Signed-off-by: Wang, Yang <yang4.wang@intel.com>
* Update.
Signed-off-by: Wang, Yang <yang4.wang@intel.com>
* [PYTHON] Pipeline transfer
* [PYTHON] Align python benchmark
* [PYTHON] Align last step
* [PYTHON] Fix innacuracies of the last step - median
* [PYTHON/CPP] Add Core::get_version method to python API, refactor Ben benchmark to print version with this func
* [PYTHON] Remove get_version_string from API
* [PYTHON/CPP] Align output for model input/output info
* [PYTHON/CPP] Step 4,6 alignment of outputs, step 8 dumps all info stored in config parameters
* [CPP] Fix a bug causing nstreams parameter to never be set to AUTO in CPP benchmark_app
* [CPP] Fix clang format errors
* [CPP] Modify print order and data output for 8th step
* [PYTHON] Add verification checks from C++, modify set_thoughtput_streams to match documentation
* [CPP] Revert changes to C++ benchmark_app
* [CPP] Remove additional spacebar
* Update submodules versions on remote
* Update module from master branch
* Redownload submodules from master and override changes from commit
* [PYTHON] Remove unneccesary parse_status from validation function
* [PYTHON] Check for HINT in map, fix circular import
* [PYTHON] Remove artifacts from commit, fix args.perf_hint set to '' instead to 'none'
* [PYTHON] Reverse changes to perf hint, add key in map check, fix validation function throwing error on set hint
* [PYTHON] Fix linter
* [PYTHON] Remove linter spacebar
* [CPP] Fix wait_all exception throw
* [CPP/PYTHON] Clean artifacts and unwanted changes from work process
* [PYTHON] Fix artifacts from merge, clean submodule update
* [C++ CPU] Fix device name string by removing padding NULL characters from the back
* [CPP] Fix ba infer_request_wrap in other throw-catch clauses
* [PYTHON/CPP] Fix missing latencies in final step for shape group, fix minor misaligned messages, add missing report parameter create infer requests time
* [CPP] Clang fix formatting
* [CPP] Reverse clang fix format on plugin.cpp
* [PYTHON/CPP] Fix C++ progressbar printing endl when disabled, fix rounding in python creating infer request message
* [CPP] Fix foramtiing error
* [PYTHON/C++] Refactor network to model based on naming conventions, provide fresh README output example
* [PYTHON/C++] Add example output to C++ README, remove unnecessary device loop
* [BENCHMARK_APP/C++] Fix artifact from refactoring, remove try-catch clause
* Update samples/cpp/benchmark_app/benchmark_app.hpp
Co-authored-by: Nadezhda Ageeva <nkogteva@gmail.com>
* Update samples/cpp/benchmark_app/main.cpp
Co-authored-by: Nadezhda Ageeva <nkogteva@gmail.com>
* Update tools/benchmark_tool/openvino/tools/benchmark/main.py
Co-authored-by: Nadezhda Ageeva <nkogteva@gmail.com>
* Update samples/cpp/benchmark_app/main.cpp
Co-authored-by: Nadezhda Ageeva <nkogteva@gmail.com>
* [CPP] Fix clang errors
* [CPP/PLUGIN Reverse modification to extract to separate task
* Update tools/benchmark_tool/openvino/tools/benchmark/main.py
Co-authored-by: Nadezhda Ageeva <nkogteva@gmail.com>
* Update tools/benchmark_tool/openvino/tools/benchmark/parameters.py
Co-authored-by: Zlobin Vladimir <vladimir.zlobin@intel.com>
* Update tools/benchmark_tool/openvino/tools/benchmark/utils/utils.py
Co-authored-by: Zlobin Vladimir <vladimir.zlobin@intel.com>
* Update tools/benchmark_tool/openvino/tools/benchmark/main.py
Co-authored-by: Zlobin Vladimir <vladimir.zlobin@intel.com>
* [PYTHON/C++/BENCHMARK_APP] Fix language inconsistencies, remove unnecessary checks
* Update pyopenvino.cpp
* [CPP/BENCHMARK_APP] Remove unnecessary try-catch, fix linter errors
* [PYTHON/CPP/BENCHMARK_APP] Revert changes to Core, align version prints usin only provided methods
* [DOCS/BENCHMARK_APP] Update README with proper model examples
* Update README.md
Co-authored-by: Nadezhda Ageeva <nkogteva@gmail.com>
Co-authored-by: Michal Lukaszewski <michal.lukaszewski@intel.com>
Co-authored-by: Zlobin Vladimir <vladimir.zlobin@intel.com>
* Enable TLV
* [GNA] Add smoke test for Conv with padding on MTL
* [GNA] Allow skipping tests based on gna lib version
Co-authored-by: Krzysztof Bruniecki <krzysztof.bruniecki@intel.com> 🥇
* Improvements in rpm / debian build
* Fixed several debian warnings
* Supported old gflags from CentOS 7
* Reverted back OpenCV version
* Fixed clang-format
* cmake/packaging/rpm.cmake: Added Frontends
* rpm_post_build: Added link to Fedoraproject wiki with rpmlint errors info
* RPM: Throw warning for rpmlint findings instead of FATAL ERROR till there is no filtering/suppression of errors
debian.cmake: Added one more error to suppress
thirdparty/CMakeLists.txt: added CentOS(RHEL) for gflags shared libs case
install_openvino_dependencies: Added gflags installation
* Fixed gflags issues for RHEL/CentOS
Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>
* Create device property for passing nthreads or pin to AUTO or MULTI in benchmark app.
Signed-off-by: Wang, Yang <yang4.wang@intel.com>
* Update the logic of the multi device properties setting for the same target device.
* refactor the logic to pass nthreads and pin to AUTO and MULTI.
Signed-off-by: Wang, Yang <yang4.wang@intel.com>
Signed-off-by: Wang, Yang <yang4.wang@intel.com>
* fix benchmark build error caused by string compare
Signed-off-by: xuejun <Xuejun.Zhai@intel.com>
* [Onlt Test] only for test mac build, will revert after validation
Signed-off-by: xuejun <Xuejun.Zhai@intel.com>
* fix benchmark build error caused by string compare
Signed-off-by: xuejun <Xuejun.Zhai@intel.com>
* [benchmark] change string compare func from strcmp() to std::string::compare
Signed-off-by: xuejun <Xuejun.Zhai@intel.com>
* Revert "[Onlt Test] only for test mac build, will revert after validation"
This reverts commit 313e8428d4.
Signed-off-by: xuejun <Xuejun.Zhai@intel.com>
* Benchmark_app python and c/c++ script add op profiling feature
* Fix compile bug about benchmark c/c++ op profiling
* Fix Compile Bug
* Fix issue in PR#12350 : 1. report_type info update; 2. priority of -pc and -pcsort; 3.align format between c++ and python; 4.check 'proportion' for 0 and print N/A; 5.detect the confusing print info
* Fix 8/17 review suggestion
* Fix 8/23 suggestion
* Fix the clang-format issue
* Fix the win-cc issue
* Fix win-cc issue about conversion from 'double' to 'float', possible loss of data
* Push PR by ODT group account
Co-authored-by: Chen Peter <peter.chen@intel.com>
Co-authored-by: Fiona Zhao <fiona.zhao@intel.com>
* Set 'UNDEFINED' as the performancehint default value. Update benchmark app to pass performance hint with none value to MULTI/AUTO plugin.
Signed-off-by: Wang, Yang <yang4.wang@intel.com>
* Using 'UNDEFINED' as the default value of hint in AUTO/MULTI plugin.
Signed-off-by: Wang, Yang <yang4.wang@intel.com>
* Adding a flag instead of adding a default value of hint to check if user configures the performance hint to AUTO/MULTI plugin.
Signed-off-by: Wang, Yang <yang4.wang@intel.com>
* Update benchmark python version.
Signed-off-by: Wang, Yang <yang4.wang@intel.com>
Signed-off-by: Wang, Yang <yang4.wang@intel.com>
* parent 6e7016ccda
author Ilya Churaev <ilya.churaev@intel.com> 1664281499 +0400
committer Ilya Churaev <ilya.churaev@intel.com> 1664510018 +0400
Fixed warnings on local machine
* Added CMAKE_COMPILE_WARNING_AS_ERROR usage
* Fixed style
* Fixed merge conflicts
* Fixed typo
* Fixed myriad build for macOS
* Fixed warning
* Fixed tests
* Disabled incorrect test
* Try to fix linux tests
* Revert "Try to fix linux tests"
This reverts commit 29224c93ff.
* Fixed tests
* Revert logic with incorrect cast
* Fixed log softmax
* Disable warning as error for cuda
* Try to fix inference_engine_s
* Fixed cmake
* Revert "Fixed cmake"
This reverts commit 87e9e4e674.
* Revert "Try to fix inference_engine_s"
This reverts commit a1adca8b05.
* WA for static symbols in inference_engine_s test library
* Fixed code style
* Fixed static definition for master
* Revert "Fixed static definition for master"
This reverts commit 20d00d215a.
* Revert "Fixed code style"
This reverts commit 0eb2362543.
* Revert "WA for static symbols in inference_engine_s test library"
This reverts commit 75ef86a79d.
* Fixed linker issue for Windows
* Disable WaE by default
* Disable warning as error in the developer package
* Try to fix dev package
* Try to fix Windows Jenkins
* Revert old behavior for tread_warn_as_err variable
* fix benchmark filed to pass on MULTI device when enable num_streams.
Signed-off-by: Wang, Yang <yang4.wang@intel.com>
* Update.
Signed-off-by: Wang, Yang <yang4.wang@intel.com>
* Remove part of test cases because MULTI plguin will not check if the unspported property is valid now.
Signed-off-by: Wang, Yang <yang4.wang@intel.com>
* Remove some incorrect config for MULTI test case since MULTI will pass through those unrecognized config without any exception.
Signed-off-by: Wang, Yang <yang4.wang@intel.com>
* Support MULTI to set nstreams to multi target devices by using ov::device:properties.
Signed-off-by: Wang, Yang <yang4.wang@intel.com>
* Support AUTO to set nstreams with multi target devices bu using ov:device::properties.
Signed-off-by: Wang, Yang <yang4.wang@intel.com>
* Update.
Signed-off-by: Wang, Yang <yang4.wang@intel.com>
* Update.
Signed-off-by: Wang, Yang <yang4.wang@intel.com>
* Update format.
Signed-off-by: Wang, Yang <yang4.wang@intel.com>
Signed-off-by: Wang, Yang <yang4.wang@intel.com>
Co-authored-by: Chen Peter <peter.chen@intel.com>
* When set batch_size, disable auto batching
* auto-batch only supprt auto plugin
* Set property allow_auto_batching for devices
* cancel static
* Clean Code
* Add test case for testing allow_auto_batching
* Fix the issue after merging latest master branch code
* Add allow_auto_batching in python benchmark_app
* Fix the quotes issue
* When load_network is set to allow-auto-batching, there is no need to read the value of global
* Fix the clang-format
* Change the location
Co-authored-by: River Li <river.li@intel.com>
Co-authored-by: Chen Peter <peter.chen@intel.com>
* Solve some code style issues
Change-Id: I06c31ad9513463c758db96dbe33031983a8fd7a5
* Refine ov_dimension with C style structure
Use C style definition to replace opaque C++ handle:
1). Improve partial shape
2). Improve dimension/rank
3). Improve shape
Change-Id: I680fd3e76c63d0c06d9d8b07c67af0440fb15bb7
* Some minor update
Change-Id: I237490a765e6ecd6f3896b1bd75d5f962304f43b
* add partial_shape_is_dynamic and update doc
Change-Id: Ief358f27de8386e35485d08847c8243d1490157f
* Rename property and add basic test cases
Change-Id: Ifbed0bbf7a5e836d2cab186763d7e5f8f2cb7d44
* address reviewer's comments
Change-Id: I9a5d1ede6d086906f3777c3d29237986a505db52
* Fix compile error
Change-Id: I72267a8dda32dd8f43c1ea1522d07b392052358f
* Use ov_any_t to replace ov_property_value_t
Change-Id: Ia4062d0da0941c901990bf5f16497ae3c8f2eb0f
* update doc for ov_model
Change-Id: I80183394f16dd1e07ff998993e26f8b903f2402e
* Property key apply string variables replace enum variable
Change-Id: I0e1699862de3913ccdc06ded5b8f8ac5a2bf8773
* Fix compiling error in windows
Change-Id: I4f9c7c746e218db94491c5f4bc5aeda1b3fde62b
* Change init/deinit method to create/free, remove unnecessary methods
Change-Id: Ibc5de039da94e92db494583ab1ff1a63e0586c73
* Pass by value for single C structure data
Change-Id: I289eb56e2ba1ab90942c8c801c585ab0f792952f
* fix dllexport issue in windows
Change-Id: I1632375e5e651fdfa076cdab2d8d1c3e83986549
* Fix static build error
Change-Id: I6633fe4887edad0b3a8b7e10730fb9d36a6ac0cd
* Use pass by value for all transparent structure
Change-Id: I652f6e70b420ef7c5af5cff3f5d482911cf0d75a
* Unify parameter order in C APIs, input first and then output parameters
Change-Id: Ib89c77d81c314e3a81bfcec9917630abbc896f5e
* Rename preprocess api to be more readable
Change-Id: I0a8ecd005e73e4ba8e90a8f25bedf0739fe31836
* Simplfy property implement for set and get property
Change-Id: Icad41606368cef9520b1623f6207784c295f1b9f
* check string type property issue
Change-Id: Ie8ee6995dda401f1db0cc098e061ffcfd24de92a
* Fix memory leak
Change-Id: Ife8980736be320314eca6fb3f3605e019663e1da
* Check string property data
Change-Id: I542a136ff874cb345c67f7d3c1dbc74981a909df
* Fix issues caused by rebase
Change-Id: I3d675a16cf76980a6414e369a83464a46dec1e49
* Remove some redundant code
Change-Id: Iab6bf7f355ec7a7424d884e620319ed9db80ecf5
* Remove property type from interface
ov_core_set_property will have 2 cases:
1) enum type: <const char* property_key, ov_property_xxx_e property_value>
2) other: <const char* property_key, const char* property_value>
Change-Id: Id7dec1ac40948d45c4f8baee687652aee92ea75d
* Remove redundant code
Change-Id: I66865d3313e305b0109cb63bd049772a01c0688f
* Remove exception log and update propery size argument
Change-Id: Ia1a60c07c9adf08d175d94a7d5e4298adb27bf80
* Apply string for enum property
Change-Id: I591b1db453a52b5ea9000e0cc3e11edf0ef5f790
* Add test case for MULTI_DEVICE_PRIORITIES
Change-Id: I59e4307564a2560724b4dacdb83c3ed45ea1ce8d
* Fix test issues and add more negative test case
Change-Id: Ib849fb8c098e487a537c1b1ab881f5e905871f73
* Add ov_model_output_by tensor name and index function
* Fix the clang format issue
* clang format
* Add ov_output_node_t in input and shape function
* Add ov_oputput_node_t in model_output function
* Fix clang-format
* change ov_output_node_list_t to ov_output_const_node_list_t
* Add ov_output_node_list_t new struct
* Rename oputput_node to be port
* Rename output_node to be port in CAPI test and samples
* Add ov_model_output/outputs/input/inputs function and testcases
* Rename output_ports to ports
* Chage ov_node_list_get_element_type_by_index to ov_node_list_get_element_type
* Change ov_output_node to ov_output_port
* Delete node list and modify the function that used the node list structure before
* Fix clang-format in ov_infer_request_test.cpp
* change node to port in funcation name
* Rebase new master
* Add new API in compile model and model,such as get input/output size
* Add err info in hello_classification_c
* Fix clang-format in hello_classification_c
* Merge the new infer_request
* Initialize ov_output_const_port
* Change the location of initialization
Co-authored-by: River Li <river.li@intel.com>
* Solve some code style issues
Change-Id: I06c31ad9513463c758db96dbe33031983a8fd7a5
* Refine ov_dimension with C style structure
Use C style definition to replace opaque C++ handle:
1). Improve partial shape
2). Improve dimension/rank
3). Improve shape
Change-Id: I680fd3e76c63d0c06d9d8b07c67af0440fb15bb7
* Some minor update
Change-Id: I237490a765e6ecd6f3896b1bd75d5f962304f43b
* add partial_shape_is_dynamic and update doc
Change-Id: Ief358f27de8386e35485d08847c8243d1490157f
* Rename property and add basic test cases
Change-Id: Ifbed0bbf7a5e836d2cab186763d7e5f8f2cb7d44
* address reviewer's comments
Change-Id: I9a5d1ede6d086906f3777c3d29237986a505db52
* Fix compile error
Change-Id: I72267a8dda32dd8f43c1ea1522d07b392052358f
* Use ov_any_t to replace ov_property_value_t
Change-Id: Ia4062d0da0941c901990bf5f16497ae3c8f2eb0f
* update doc for ov_model
Change-Id: I80183394f16dd1e07ff998993e26f8b903f2402e
* Property key apply string variables replace enum variable
Change-Id: I0e1699862de3913ccdc06ded5b8f8ac5a2bf8773
* Fix compiling error in windows
Change-Id: I4f9c7c746e218db94491c5f4bc5aeda1b3fde62b
* Change init/deinit method to create/free, remove unnecessary methods
Change-Id: Ibc5de039da94e92db494583ab1ff1a63e0586c73
* Pass by value for single C structure data
Change-Id: I289eb56e2ba1ab90942c8c801c585ab0f792952f
* fix dllexport issue in windows
Change-Id: I1632375e5e651fdfa076cdab2d8d1c3e83986549
* Fix static build error
Change-Id: I6633fe4887edad0b3a8b7e10730fb9d36a6ac0cd
* Use pass by value for all transparent structure
Change-Id: I652f6e70b420ef7c5af5cff3f5d482911cf0d75a
* Unify parameter order in C APIs, input first and then output parameters
Change-Id: Ib89c77d81c314e3a81bfcec9917630abbc896f5e
* Rename preprocess api to be more readable
Change-Id: I0a8ecd005e73e4ba8e90a8f25bedf0739fe31836
* WA for Benchmark App: Remote tensor use for internaly dynamic original models (NMS) that turn static due to transformation to legacy op and lack of dynamism support
* Style
* Updated ia32 toolchain with system / processor
* Allow pkg-config during cross-compilation
* added error message
* Search TBB using tbb.pc as well
* WA
* Fix for yocto
* Added print
* Use tbb.pc only when system libs are enabled
* Improved OpenVINOConfig.cmake
* Don't find pkg-config as required
* [SAMPLES] Add GNA library version log to speech_sample
* [GNA] Add OV version to TLV export file
Co-authored-by: Szymon Irzabek <szymon.jakub.irzabek@intel.com>
* update logic of setting TPUT by default for MULTI and AUTO.
Signed-off-by: Wang, Yang <yang4.wang@intel.com>
* Set config to MULTI instaed of target device when using -d MULTI:target_device in benchmark app.
Signed-off-by: Wang, Yang <yang4.wang@intel.com>
* Update.
Signed-off-by: Wang, Yang <yang4.wang@intel.com>
* Update logit to check if perfomance hint is set.
Signed-off-by: Wang, Yang <yang4.wang@intel.com>
* Update test cases.
Signed-off-by: Wang, Yang <yang4.wang@intel.com>
* Set the correct _so from passthrough executable network when batch plugin is disabel to fix lifecycle coredump.
Signed-off-by: Wang, Yang <yang4.wang@intel.com>
* Same update for AUTO plugin
Signed-off-by: Wang, Yang <yang4.wang@intel.com>
* Update
Signed-off-by: Wang, Yang <yang4.wang@intel.com>
* Update
Signed-off-by: Wang, Yang <yang4.wang@intel.com>
* Update.
Signed-off-by: Wang, Yang <yang4.wang@intel.com>
Signed-off-by: Wang, Yang <yang4.wang@intel.com>
Co-authored-by: Chen Peter <peter.chen@intel.com>
