* update code deps for rhel
* new neo driver version
* new neo driver version fix
* fix
* fix
* drop not needed gpu packages
* removed not necessry NEO packages, updated ov deps
* add gflag for rhel8 os
* update python on ubuntu18 and add core rhel8 rpm URLs
* add libpython3.8
Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>
* No-break space->space, asssuming->assuming
* benchmark_app: don't print warning each iteration
* Russian с->English c
* Warn no batch only once
* Allow anonymus namespaces
* Keep only one report of model bach size, warn_if_no_batch for static model as well
* [Python API][Tools] Top up upper bound version for dependencies: NumPy, TensorFlow, NetworkX
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Remove upper-bound for TensorFlow and NumPy
* Revert "Remove upper-bound for TensorFlow and NumPy"
This reverts commit 662085df2e.
* Remove upper-bound for NumPy for default installation
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Update docstrings after prohibition of not absolute
paths for plugins
* Use only absolute internal paths to load plugins
After introduction of plugins loading via absolute path,
libraries are still tried to load by names if wasn't found.
So safe last place of search (most common) in order to
get useful error message
Co-authored-by: Ilya Churaev <ilya.churaev@intel.com>
* [LPT] FQ Decomposition modified to create FQ without constants with several consumers
* [LPT] Added subgraph test
* CPUTestsBase: Added the ability to check only fusing results
* [CPU] Added subgraph test
* LPT review comments applied
* CPUTestsUtils: added special string 'anytype' for selectedType check ignore
* update code deps for rhel
* new neo driver version
* new neo driver version fix
* fix
* fix
* drop not needed gpu packages
* removed not necessry NEO packages, updated ov deps
* add gflag for rhel8 os
* update python on ubuntu18 and add core rhel8 rpm URLs
Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>
* serialize gpu memory reuse flag
* added c-tor of reduce_impl
* renamed memory_reuse_by_user as can_reuse_memory, and modified memory allocation logic to be simpler
* [Common] Implement SelectWithOneValueCondition common transformation
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Add transformation tests for select_with_one_value_condition
* Move call of SelectWithOneValueCondition transformation to MOC
* Apply code-review feedback
* Remove corner case with dynamic output shape for Select
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* sync benchmark Python version with benchmark C++ version.
Signed-off-by: Wang, Yang <yang4.wang@intel.com>
* Update.
* Update tools/benchmark_tool/openvino/tools/benchmark/main.py
Co-authored-by: Zlobin Vladimir <vladimir.zlobin@intel.com>
* Update tools/benchmark_tool/openvino/tools/benchmark/utils/utils.py
Co-authored-by: Zlobin Vladimir <vladimir.zlobin@intel.com>
* Update.
Signed-off-by: Wang, Yang <yang4.wang@intel.com>
Co-authored-by: Zlobin Vladimir <vladimir.zlobin@intel.com>
* [AUTO] update property setting logic.
* Update core::set_property() logic to only support primary property for AUTO and MULTI.
* Separate AUTO and MULTI supported properties.
Signed-off-by: Wang, Yang <yang4.wang@intel.com>
* Add test case.
Signed-off-by: Wang, Yang <yang4.wang@intel.com>
* 1. revert the changes for ie core.
2. Enable AUTO/MULTI only accepting its own properties.
3. Enable AUTO/MULTI accepting device properties passed from loadnetwork().
Signed-off-by: Wang, Yang <yang4.wang@intel.com>
* Revert "[AUTO]Update the incorrect config test for Myriad (#13271)"
This reverts commit 0552d98802.
* MULTI only accepts its own properties that is same as AUTO currently.
Signed-off-by: Wang, Yang <yang4.wang@intel.com>
* Add test cases for AUTO/MULTI property test.
Signed-off-by: Wang, Yang <yang4.wang@intel.com>
* Update to enable MULTI supporting hw primary property setting throw the compile_model().
Signed-off-by: Wang, Yang <yang4.wang@intel.com>
* Remove the added test case for setting secondary property through set_property().
Signed-off-by: Wang, Yang <yang4.wang@intel.com>
* Update.
Signed-off-by: Wang, Yang <yang4.wang@intel.com>
* 1. For AUTO/MULTI, property setting will be passed via core::compile_model() instead of core::set_property().
2. update the logic to infer precision setting that will transform into secondary property setting to each hw device.
Signed-off-by: Wang, Yang <yang4.wang@intel.com>
* Update.
Signed-off-by: Wang, Yang <yang4.wang@intel.com>
* set default value for nstreams when -d AUTO/MULTI and no nstreams setting from command line.
Signed-off-by: Wang, Yang <yang4.wang@intel.com>
* Update code format.
Signed-off-by: Wang, Yang <yang4.wang@intel.com>
* Enable BA to support if -d AUTO:MULTI,xxx/MULTI:AUTO,xxx. while AUTO Plugin need to update the logic of generating supported config list to virtual device.
Signed-off-by: Wang, Yang <yang4.wang@intel.com>
* Update.
Signed-off-by: Wang, Yang <yang4.wang@intel.com>
* Update.
Signed-off-by: Wang, Yang <yang4.wang@intel.com>
* update.
Signed-off-by: Wang, Yang <yang4.wang@intel.com>
* move device configuration handling outside form function main.
Signed-off-by: Wang, Yang <yang4.wang@intel.com>
* Revert "move device configuration handling outside form function main."
This reverts commit ef77bfc602.
* Update.
Signed-off-by: Wang, Yang <yang4.wang@intel.com>
* Update.
Signed-off-by: Wang, Yang <yang4.wang@intel.com>
* update.
Signed-off-by: Wang, Yang <yang4.wang@intel.com>
* Update.
Signed-off-by: Wang, Yang <yang4.wang@intel.com>
* Setting property performance hint to 'THROUGHPUT' and passing to executable network if no setting for of AUTO/MULTI.
Signed-off-by: Wang, Yang <yang4.wang@intel.com>
* Update.
Signed-off-by: Wang, Yang <yang4.wang@intel.com>
* Update.
Signed-off-by: Wang, Yang <yang4.wang@intel.com>
* Update.
* 1. Fix the issue that the dumped configuration file retrieves empty config list when using OpenCV to dump configuration.
2. Enable load_config() to load secondary property.
3. ov:device:properties from command line will replace the ov::device::properties loaded from configuration file.
Signed-off-by: Wang, Yang <yang4.wang@intel.com>
* Update the performance statistics showing format.
* Update format.
* Update.
Signed-off-by: Wang, Yang <yang4.wang@intel.com>
* Update samples/cpp/benchmark_app/main.cpp
Co-authored-by: Nadezhda Ageeva <nkogteva@gmail.com>
* Update samples/cpp/benchmark_app/main.cpp
Co-authored-by: Nadezhda Ageeva <nkogteva@gmail.com>
* Update.
Signed-off-by: Wang, Yang <yang4.wang@intel.com>
* Update README to add some simple configuration files loaded into benchmark app.
Signed-off-by: Wang, Yang <yang4.wang@intel.com>
* 1. Enable dump/load function for AUTO to support hw device property setting thorugh configuration JSON.
2. Update README.md to example a simple JSON file containing the hw device properties setting for AUTO/MULTI.
Signed-off-by: Wang, Yang <yang4.wang@intel.com>
* Update.
Signed-off-by: Wang, Yang <yang4.wang@intel.com>
* Update.
* Update.
* Update.
* Drop the changes within dump/load of OpenCV config parsing.
* Update.
* Correct property name. Update ov::num_stream to ov::inference_precision.
Signed-off-by: Wang, Yang <yang4.wang@intel.com>
Co-authored-by: Nadezhda Ageeva <nkogteva@gmail.com>
* Add attribute for last output element type
* Add convert precision transformation and tests
* Update Unique python API with new attribute
* Update Unique-10 op specification
* Update docstrings
* Update visitor tests
* Add type prop tests for the new attribute
* Check axis constant before shape, compare with partial shape
