* sync benchmark Python version with benchmark C++ version.
Signed-off-by: Wang, Yang <yang4.wang@intel.com>
* Update.
* Update tools/benchmark_tool/openvino/tools/benchmark/main.py
Co-authored-by: Zlobin Vladimir <vladimir.zlobin@intel.com>
* Update tools/benchmark_tool/openvino/tools/benchmark/utils/utils.py
Co-authored-by: Zlobin Vladimir <vladimir.zlobin@intel.com>
* Enable dump/load to support ov::device::properties parsing in benchmark python version.
* Enable benchmark python version to parse configuration file with device properties setting for AUTO/MULTI.
Signed-off-by: Wang, Yang <yang4.wang@intel.com>
* Update usage of benchmark dumping/loading configuration in README and help message.
* Update comment.
* Update comments of the code.
* Update format of '-load_config' help message.
* Update.
Signed-off-by: Wang, Yang <yang4.wang@intel.com>
Co-authored-by: Zlobin Vladimir <vladimir.zlobin@intel.com>
* docs: revise example and update outputs
* docs: revise example and update outputs
* docs: typo fix
* docs: rectify changes
* docs: add <a> tag
* Update README.md
* docs: change example to use asl-recognition model
* docs: fix <a> tag
* docs: update sample outputs
* docs: change example to use asl-recognition model
* docs: revise example to use asl-recognition model
Co-authored-by: Yuan Xu <yuan1.xu@intel.com>
* [FE] Fix freezing placeholder via freeze_placeholder_with_value option
Currently, freezing placeholder via freeze_placeholder_with_value option does not work for any frontends. It happens due to absence of a node in _input_shapes dictionary.
* Add get_element_type method for InputModel
* Revert not needed changes
* Revert not needed changes
* Update freeze_placeholder_test
* Add tests for TF FE with freezing values of different types
* Fix Python API return value
* Correct returned type for get_numpy_ctype
* Apply code-review feedback
* Update src/frontends/tensorflow/src/input_model.hpp
Co-authored-by: Maxim Vafin <maxim.vafin@intel.com>
* Apply code-review feedback: no tf legacy specific routine and parameter names
Co-authored-by: Maxim Vafin <maxim.vafin@intel.com>
* [Python API][Tools] Top up upper bound version for dependencies: NumPy, TensorFlow, NetworkX
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Remove upper-bound for TensorFlow and NumPy
* Revert "Remove upper-bound for TensorFlow and NumPy"
This reverts commit 662085df2e.
* Remove upper-bound for NumPy for default installation
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* sync benchmark Python version with benchmark C++ version.
Signed-off-by: Wang, Yang <yang4.wang@intel.com>
* Update.
* Update tools/benchmark_tool/openvino/tools/benchmark/main.py
Co-authored-by: Zlobin Vladimir <vladimir.zlobin@intel.com>
* Update tools/benchmark_tool/openvino/tools/benchmark/utils/utils.py
Co-authored-by: Zlobin Vladimir <vladimir.zlobin@intel.com>
* Update.
Signed-off-by: Wang, Yang <yang4.wang@intel.com>
Co-authored-by: Zlobin Vladimir <vladimir.zlobin@intel.com>
* Added Debian, Raspbian, Ubuntu 22.10 support
* Updated dependencies.cmake
* Fixes in script
* Added RHEL 9.1 support
* Added proper comments
* Compilation of rpm packages for aarch64 is fixed
* Proper generation of requirements.txt files when ENABLE_WHEEL=OFF
* samples build improvements
* Proper name for json library
* Proper condtion in samples
* convert() method added.
* Moved conversion to convert() method.
* Fixed commits.
* Output dir fix.
* Added objects support for extesions param.
* Added support for transformations_config extension objects.
* Input to str unit tests.
* Added tests, added comments.
* Updated BOM.
* Removed commented code.
* Fixed extension passing.
* Small corrections.
* Fixed for python 3.6.
* Small fix.
* Moved dir creating to ov.serialize(), removed mo.serialize(), small fixes.
* Small fix.
* Small correction.
* Removed coping of params, moved convert implemetation to separate module.
* Import fixes.
* Moved hiding of exceptions to main().
* Updated comment.
* Fixed unit tests.
* Comment changed.
* Fixed dir creating.
* Tests fixed.
* Small fixes.
* Test fix.
* Added meta data generation, removed printing of execution time for silent mode.
* Import fix.
* Conflict fix.
* Fixed error.
* Fix for custom config.
* Added version, data_type params to help.
* Added mo.convert() full-functional tests.
* Small corrections.
* Comment correction.
* Moved convert to openvino package, moved LayotMap and InputCutInfo to openvino.convert.
* Added help param.
* Wrong change removed.
* Small fix.
* Removed unnecessary comments.
* Removed .xml extension check from append_ir_info.
* Added missed file.
* Fixed error.
* Fix for bool value in InputCutInfo.
* Moved InputCutInfo, LayoutMap to openvino.tools.mo.
* Moved InputCutInfo, LayoutMap to openvino.tools.mo.
* Moved check and read_model to emit_ir.
* Small correction.
* Added comment.
* Added unit_tests with convert().
* Small corrections.
* Removed convert alias from openvino.
* Fixed conflicting unit tests.
* Removed unnecessary warnings.
* Params check fix.
* Small correction.
* Added paths checks.
* Added negative tests for to_str methods, fixed errors.
* Added tuples support in input parameter.
* Added direct support of BytesIO and TF1 graph def.
* Moved reminders to update OV and use API 2.0 to main().
* Fixed keras loading.
* Returned .mapping file generating.
* Added positional input_model param.
* Added test for unnamed input_model.
* Optimize imports.
* Added more informative error for brackets syntax in --input.
* Keras direct model support.
* Keras direct model support.
* Small fix.
* Conflict fix.
* Conflict fix.
* Added direct support of BytesIO and TF1 graph def.
* Fixed keras loading.
* Keras direct model support.
* Keras direct model support.
* Small fix.
* Tests for importing from memory.
* Support of other tf/pytorch formats.
* Updated mo_convert extensions tests to use ov models.
* Removed debug output.
* Implemented PyTorch converting logic.
* Small corrections.
* Small corrections.
* Added comments.
* Fixed for single input case.
* Added switching between save to file and BytesIO.
* Small fixes.
* Rename convert() to convert_model().
* Added env variable to disable converting to onnx.
* Tests refactoring.
* Add MO Python API tests to precommit.
* Add MO Python API tests to precommit.
* Added PyTorch to layer tests requirements.
* Added supported formats description.
* Fixed errors, added tests.
* Fixed bugs, added support of numpy and ov.Tensor sample_input.
* Added more torch.Size tests.
* Small correction.
* Renamed sample_input->example_inputs.
* Tests refactoring.
* Code style.
* Added support of dict in example_inputs.
* Small correction.
* Added removing of tmp onnx model in case of conversion error.
* Fix for lists of tensors in example_inputs.
* Support of dynamic axes for Keras layer, Keras module.
* Removed disabling of eager execution.
* Tests fixed.
* Added pytest requirement for layer tests.
* Added convert_model to openvino.runtime, fixed test runs.
* Small fix.
* Tests fix.
* Better help message.
* Error fixed.
* Renamed example_inputs->example_input.
* Small fix.
* Added support of list of layouts.
* Removed wrong change.
* Added tuple support for --layout.
* Removed convert_model from openvino.runtime.
* Use of default onnx opset version.
* Added support of dynamic input shapes without example_input.
* Made better error message.
* Removed stack trace from exceptions.
* Fixed tests.
* Small fix.
* Removed wrong change.
* Added import model from memory tests in unit tests.
* Replaced compare_functions() with MO IR reader compare.
* Removed test.
* Removed not needed change.
* Fixed conflicts.
* Moved MO meta data to RT info.
* Undo wrong change.
* Reformat code.
* Code reformat.
* Corrected error message.
* Test correction.
* Test fix.
* Updated MO IR Reader.
* Added testing of meta data for MO IR reader.
* Code corrections.
* Default params removed from meta data.
* Test corrected, fixed paths cropping.
* Small fix.
* Renamed legacy_path to legacy_frontend.
* Fixed error.
* Added PartialShape from str constructor, added to_string() method.
* Small corrections.
* Moved shape parsing to PartialShape and Dimension classes.
* Fixed errors.
* Added tests for shapes with comma separator.
* Fixed tests.
* Test fixed.
* Fixed test.
* Fixed tests.
* Small fix.
* Removed usage of depricated method.
* Fix in MO IR reader.
* Tests fixed.
* Fix in MO IR reader.
* Test fixed.
* Shape class alignment.
* Code fixes.
* Code fixes.
* Used unnamed namespace.
* Undo change of Shape attribute adapter.
* Undo change of Shape attribute adapter.
* Removed unnecessary includes.
* Removed unnecessary code.
* Test fixed.
* Fix in MO IR reader.
* Moved check_all_digits() to ov::util.
* Moved check_all_digits() to src/core/src/.
* Clang format.
* Apply suggestions from code review
Co-authored-by: Ilya Churaev <ilyachur@gmail.com>
* Removed dimension_util file.
* Removed wrong change.
* Removed extra spaces from string representation of Shape.
* Test fixed.
* Added support of comma separator for value. Updated help.
* Returned old format shape serializing.
Co-authored-by: Ilya Churaev <ilyachur@gmail.com>
* turn on bom_tests
* fixed root directories to search
* leftovers fix
* removed requirements from package_BOM.txt; corrected error messages to install via pip
* removed extract_release_version.py from package_BOM.txt, added requirements files to skip
* removed redundant commented line
* mentioned CustomLayersMapping.xml.example in docs
Co-authored-by: Andrei Kochin <andrei.kochin@intel.com>
* [PYTHON] Pipeline transfer
* [PYTHON] Align python benchmark
* [PYTHON] Align last step
* [PYTHON] Fix innacuracies of the last step - median
* [PYTHON/CPP] Add Core::get_version method to python API, refactor Ben benchmark to print version with this func
* [PYTHON] Remove get_version_string from API
* [PYTHON/CPP] Align output for model input/output info
* [PYTHON/CPP] Step 4,6 alignment of outputs, step 8 dumps all info stored in config parameters
* [CPP] Fix a bug causing nstreams parameter to never be set to AUTO in CPP benchmark_app
* [CPP] Fix clang format errors
* [CPP] Modify print order and data output for 8th step
* [PYTHON] Add verification checks from C++, modify set_thoughtput_streams to match documentation
* [CPP] Revert changes to C++ benchmark_app
* [CPP] Remove additional spacebar
* Update submodules versions on remote
* Update module from master branch
* Redownload submodules from master and override changes from commit
* [PYTHON] Remove unneccesary parse_status from validation function
* [PYTHON] Check for HINT in map, fix circular import
* [PYTHON] Remove artifacts from commit, fix args.perf_hint set to '' instead to 'none'
* [PYTHON] Reverse changes to perf hint, add key in map check, fix validation function throwing error on set hint
* [PYTHON] Fix linter
* [PYTHON] Remove linter spacebar
* [CPP] Fix wait_all exception throw
* [CPP/PYTHON] Clean artifacts and unwanted changes from work process
* [PYTHON] Fix artifacts from merge, clean submodule update
* [C++ CPU] Fix device name string by removing padding NULL characters from the back
* [CPP] Fix ba infer_request_wrap in other throw-catch clauses
* [PYTHON/CPP] Fix missing latencies in final step for shape group, fix minor misaligned messages, add missing report parameter create infer requests time
* [CPP] Clang fix formatting
* [CPP] Reverse clang fix format on plugin.cpp
* [PYTHON/CPP] Fix C++ progressbar printing endl when disabled, fix rounding in python creating infer request message
* [CPP] Fix foramtiing error
* [PYTHON/C++] Refactor network to model based on naming conventions, provide fresh README output example
* [PYTHON/C++] Add example output to C++ README, remove unnecessary device loop
* [BENCHMARK_APP/C++] Fix artifact from refactoring, remove try-catch clause
* Update samples/cpp/benchmark_app/benchmark_app.hpp
Co-authored-by: Nadezhda Ageeva <nkogteva@gmail.com>
* Update samples/cpp/benchmark_app/main.cpp
Co-authored-by: Nadezhda Ageeva <nkogteva@gmail.com>
* Update tools/benchmark_tool/openvino/tools/benchmark/main.py
Co-authored-by: Nadezhda Ageeva <nkogteva@gmail.com>
* Update samples/cpp/benchmark_app/main.cpp
Co-authored-by: Nadezhda Ageeva <nkogteva@gmail.com>
* [CPP] Fix clang errors
* [CPP/PLUGIN Reverse modification to extract to separate task
* Update tools/benchmark_tool/openvino/tools/benchmark/main.py
Co-authored-by: Nadezhda Ageeva <nkogteva@gmail.com>
* Update tools/benchmark_tool/openvino/tools/benchmark/parameters.py
Co-authored-by: Zlobin Vladimir <vladimir.zlobin@intel.com>
* Update tools/benchmark_tool/openvino/tools/benchmark/utils/utils.py
Co-authored-by: Zlobin Vladimir <vladimir.zlobin@intel.com>
* Update tools/benchmark_tool/openvino/tools/benchmark/main.py
Co-authored-by: Zlobin Vladimir <vladimir.zlobin@intel.com>
* [PYTHON/C++/BENCHMARK_APP] Fix language inconsistencies, remove unnecessary checks
* Update pyopenvino.cpp
* [CPP/BENCHMARK_APP] Remove unnecessary try-catch, fix linter errors
* [PYTHON/CPP/BENCHMARK_APP] Revert changes to Core, align version prints usin only provided methods
* [DOCS/BENCHMARK_APP] Update README with proper model examples
* Update README.md
Co-authored-by: Nadezhda Ageeva <nkogteva@gmail.com>
Co-authored-by: Michal Lukaszewski <michal.lukaszewski@intel.com>
Co-authored-by: Zlobin Vladimir <vladimir.zlobin@intel.com>
* [PYTHON] CV2 module required only when loading images
* [PYTHON] Update tools/benchmark_tool/openvino/tools/benchmark/utils/inputs_filling.py
Co-authored-by: Helena Kloosterman <helena.kloosterman@intel.com>
* [PYTHON] Make CV import not global
* [PYTHON] Update format of inputs_filling.py
* [PYTHON] Fix missing newline
* Update tools/benchmark_tool/openvino/tools/benchmark/utils/inputs_filling.py
Co-authored-by: Helena Kloosterman <helena.kloosterman@intel.com>
* [BENCHMARK_APP/PYTHON] Introduce exception when module is installed but fails to import
* [SAMPLES/PYTHON] Sporadic access violation fix through checking whether module was cached
Co-authored-by: Helena Kloosterman <helena.kloosterman@intel.com>
Co-authored-by: Michal Lukaszewski <michal.lukaszewski@intel.com>
