* py/benchmark_app: fix -hint
Don't warn about values which are explicitly set in -hint.
That aligns C++ and Python implementations.
Ticket 106544
* Remove extra throw
* Fix code style
* [PyOV] Fix issues with RTMap
* update year
* some clean-up and items fix
* tests and small fixes
* Update src/bindings/python/src/pyopenvino/utils/utils.cpp
* undo changes
* fix serialization on python side
* rt_info as rt_map
* undo several changes in tests
* fix mo test
* sadd docstrings
* add tests
* fix codestyle
* try to fix win
* fix master
* apply comments
* [MO][TF FE] Do not print TF FE message in case of fallback
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Correct test model with Switch and Merge
---------
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Ability to provide several source dirs for ncc-style checks
* Fixed include headers; added NCC to TF common
* Fixed NCC for frontends
* Fixed NCC for frontends
* Extra fixes
* Fixest push --f
* Clang-format
* Apply comments
* Add an option to specify required clang-format version
* Update src/frontends/tensorflow/src/decoder_proto.cpp
* Update src/frontends/tensorflow/src/decoder_proto.cpp
* [TF FE] Convert a model with Framework nodes
Now the conversion pipeline will convert all unsupported operations to Framework nodes
It is done with a hope that sub-graphs with Framework Nodes will be cut in later stages
like auto-pruning.
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Fix build issue
* Fix dynamic element type for FusedBatchNorm
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Fix build issue
* Fix build issue
* Continue translation in case translator limitation
* Change undefined to dynamic type
* Have one more change to dynamic type
* Change undefined to dynamic in Const translator
* Expect MO to handle dynamic type
* Exclude TransposeSinking pass if model contains Framework nodes
---------
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Fixed legacy extensions passing to MO tool.
* Added tests.
* Corrected test.
* Add debug print.
* Moved tests to layer tests.
* Added comment.
* Moved legacy ext tests to separate file. Fixed tmp .pb file cleaning.
* Small correction.
* Run MO Python API tests directory in CI.
* Small fix.
* Fix for case of splitted output.
* Corrected imports.
* Corrected imports.
* Added run of legacy extensions tests from subprocess.
* Check if the device is supported when AUTO retrieves the device list based on the ov::device::priorities.
* Update the logic to handle the situation like -d AUTO:-CPU to benchmark APP.
* Remove MYRIAD and add NVIDIA for AUTO supported devices.
---------
Co-authored-by: Chen Peter <peter.chen@intel.com>
Co-authored-by: Shen, Wanglei <wanglei.shen@intel.com>
* [TF FE] Support conversion of models with non-standard extensions in the path
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Update tools/mo/unit_tests/moc_tf_fe/conversion_basic_models.py
---------
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Update ov::hint::performance_hint UNDEFINED value from empty string to "UNDEFINED".
* Update benchmark Python version.
* Update.
* Update.
* Update.
* Update the description about hint setting within benchmark APP README and help message.
* enable --compress_to_fp16 by default in MO
* corrected docs, added warning if user did't specify --compress_to_fp16 explicitly
* fix failing MO unit-tests
* do not wipe out data_type if user defined it explicitly by cli argument
* updated warning message and docs
* corrected phrasing
* corrected phrasing in FP16_Compression.md
* set compress_to_fp16=False for convert tests
* leftover: set compress_to_fp16=False for convert tests
* minor correction
* print info message in main.py, som minor changes
* typos fix
* fix losing information whether arguments set by user or got from defaults
* returned back default values instead of None
* more selective correcting of test_mo_convert_pytorch.py; added test for cases when compression is enabled/disabled or left by default
* fix test_mo_convert_pytorch.py
* Disable set_property() to support ov::device::properties setting.
* Update benchmark APP to set device properties through compile_model() instead of through set_property().
* Update.
* Update.
* Update some test case including ov::device::properties setting via core.ser_property().
* Since core.set_property() didn't support ov::device::properties setting, just remove the test case to check compile_model() works well if setting ov::device::properties via core.set_property() first.
* Update CompileModel in test name to CompiledModel
Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>
* Add corresponding test case.
Signed-off-by: Wang, Yang <yang4.wang@intel.com>
* Update.
* Update.
* Remove the changes of this commit as this modification has nothing to do
with this PR.
This reverts commit 4f04b9f085.
---------
Signed-off-by: Wang, Yang <yang4.wang@intel.com>
Co-authored-by: Chen Peter <peter.chen@intel.com>
Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>
* [WIP]: poc: integrate pt fe to mo.convert_model
* temporaly resolve names using signature inspection
* fix logic
* move to moc frontend
* add rank and data type setting
* add input signature
* apply comments
* move after convert processing
* support work without example_input, provide parameters description
* ignore extensions on fe side
* upd tests
* more tests
* add notes about extensions support and removing onnx path
* remove debug prints
* refactoring
* update BOM
* benchmark_app: factor out advanced options
* cpp/benchmark_app: add usage word
* move api to advanced, group b/shape/data_shape/layout into Input shapes, factor out Statistics dumping options
* Factor out Device-specific performance options
* Factor out Preprocessing options
* Minor regroup
* [C++/BENCHMARK_APP] Introduce Numpy array loading for C++ benchmark app
* [DOCS/BENCHMARK_APP] Update docs to reflect changes, update list of available extensions from OpenCV, align help messages
* Update inputs_filling.cpp
* Update tools/benchmark_tool/openvino/tools/benchmark/utils/inputs_filling.py
Co-authored-by: Zlobin Vladimir <vladimir.zlobin@intel.com>
* Update samples/cpp/benchmark_app/inputs_filling.cpp
Co-authored-by: Zlobin Vladimir <vladimir.zlobin@intel.com>
* [C++/Python] Implement quality-of-life improvements from PR comments
* [C++] Fix compilation errors, fix linter output
* [C++/PYTHON] Apply requested changes
* Update samples/cpp/benchmark_app/main.cpp
Co-authored-by: Zlobin Vladimir <vladimir.zlobin@intel.com>
* Update samples/cpp/benchmark_app/utils.cpp
Co-authored-by: Zlobin Vladimir <vladimir.zlobin@intel.com>
* [PYTHON] Separate loading of numpy arrays similar to images
* [PYTHON] Remove unnecessary 'Prepare xxx file' print
* Update README again because IF OPENCV.. dissapeared for some reason
* Update second README with missing IF OPENCV..
* [C++] Remove unnecessary vector print function
* [C++ Add Numpy processing function - TODO link it to the tensor filling
* Reverse OneDnn plugin modification
* [C++] Numpy array loading for C++
* [C++] Add (almost) all missing types of data
* Reverse submodule modifications
* [C++/PYTHON] Fix compilation errors, clean code
* [C++] Modify supported extensions, add numpy checking to utils, add numpy to get_image_info method
* Update samples/cpp/benchmark_app/inputs_filling.cpp
Co-authored-by: Zlobin Vladimir <vladimir.zlobin@intel.com>
* [C++] Fix utils header file to reflect unordered set change
* [PYTHON/C++] Fix compilation errors in C++ code, fix Python dynamic shapes numpy loading
* [C++] Fix explicit instantiation of NumpyArray reader
* [C++] Clang format, minor syntax fixes
* [PYTHON/C++] Remove unnecessary data types, introduce a new approach to cast data of different types from format_rt_reader, remove uppercase types from Python precision parameters
* [PYTHON] Update README to reflect new precision settings
* [PYTHON] Fix README, fix clang format
* [C++] Clean headers
* [C++] Fix uninitialized variable error
* [C++/PYTHON] Fixed choices in Python benchmark, fixed types in C++ benchmark
* [C++] Fixed ov::float16conversion, fixed Python types map - removed redundancies
* [C++] Add back boolean support
* [C++] Fix compilation errors
---------
Co-authored-by: Zlobin Vladimir <vladimir.zlobin@intel.com>
* Port changes for installing GPU driver from 2022.3 branch.
* install_openvino_dependencies: Fixed syntax after ShellCheck
---------
Co-authored-by: Karol Blaszczak <karol.blaszczak@intel.com>
