* [C++/BENCHMARK_APP] Introduce Numpy array loading for C++ benchmark app
* [DOCS/BENCHMARK_APP] Update docs to reflect changes, update list of available extensions from OpenCV, align help messages
* Update inputs_filling.cpp
* Update tools/benchmark_tool/openvino/tools/benchmark/utils/inputs_filling.py
Co-authored-by: Zlobin Vladimir <vladimir.zlobin@intel.com>
* Update samples/cpp/benchmark_app/inputs_filling.cpp
Co-authored-by: Zlobin Vladimir <vladimir.zlobin@intel.com>
* [C++/Python] Implement quality-of-life improvements from PR comments
* [C++] Fix compilation errors, fix linter output
* [C++/PYTHON] Apply requested changes
* Update samples/cpp/benchmark_app/main.cpp
Co-authored-by: Zlobin Vladimir <vladimir.zlobin@intel.com>
* Update samples/cpp/benchmark_app/utils.cpp
Co-authored-by: Zlobin Vladimir <vladimir.zlobin@intel.com>
* [PYTHON] Separate loading of numpy arrays similar to images
* [PYTHON] Remove unnecessary 'Prepare xxx file' print
* Update README again because IF OPENCV.. dissapeared for some reason
* Update second README with missing IF OPENCV..
* [C++] Remove unnecessary vector print function
* [C++ Add Numpy processing function - TODO link it to the tensor filling
* Reverse OneDnn plugin modification
* [C++] Numpy array loading for C++
* [C++] Add (almost) all missing types of data
* Reverse submodule modifications
* [C++/PYTHON] Fix compilation errors, clean code
* [C++] Modify supported extensions, add numpy checking to utils, add numpy to get_image_info method
* Update samples/cpp/benchmark_app/inputs_filling.cpp
Co-authored-by: Zlobin Vladimir <vladimir.zlobin@intel.com>
* [C++] Fix utils header file to reflect unordered set change
* [PYTHON/C++] Fix compilation errors in C++ code, fix Python dynamic shapes numpy loading
* [C++] Fix explicit instantiation of NumpyArray reader
* [C++] Clang format, minor syntax fixes
* [PYTHON/C++] Remove unnecessary data types, introduce a new approach to cast data of different types from format_rt_reader, remove uppercase types from Python precision parameters
* [PYTHON] Update README to reflect new precision settings
* [PYTHON] Fix README, fix clang format
* [C++] Clean headers
* [C++] Fix uninitialized variable error
* [C++/PYTHON] Fixed choices in Python benchmark, fixed types in C++ benchmark
* [C++] Fixed ov::float16conversion, fixed Python types map - removed redundancies
* [C++] Add back boolean support
* [C++] Fix compilation errors
---------
Co-authored-by: Zlobin Vladimir <vladimir.zlobin@intel.com>
* [Python] Align pc output in Python benchmark, update sorted output to new headers, print floats with 6-digit precision, fix date format printing to excel-friendly
* [PYTHON/C++] Change precision of raports and pc counters report, simplify code
* [C++] Align C++ benchamrk_app report to Python's by setting the precision value to 3
* [C++] Fix CsvDumper precision
* [C++/PYTHON] Align pcand pcsort outputs, merge C++ printSort methods into one
* Update samples/cpp/common/utils/include/samples/common.hpp
Co-authored-by: Zlobin Vladimir <vladimir.zlobin@intel.com>
* Update samples/cpp/common/utils/include/samples/common.hpp
Co-authored-by: Zlobin Vladimir <vladimir.zlobin@intel.com>
Co-authored-by: Michal Lukaszewski <michal.lukaszewski@intel.com>
Co-authored-by: Zlobin Vladimir <vladimir.zlobin@intel.com>
* [C++] Display a warning if Power Mode is not 'Max Performance' - rebase from master
* [C++] Prevent std::max from colliding with windows.h max macro
* [PYTHON/C++] Update README docs to reflect possible inaccuracies from optimization settings
* [C++] Cleanup windows optimizations
* [PYTHON] Pipeline transfer
* [PYTHON] Align python benchmark
* [PYTHON] Align last step
* [PYTHON] Fix innacuracies of the last step - median
* [PYTHON/CPP] Add Core::get_version method to python API, refactor Ben benchmark to print version with this func
* [PYTHON] Remove get_version_string from API
* [PYTHON/CPP] Align output for model input/output info
* [PYTHON/CPP] Step 4,6 alignment of outputs, step 8 dumps all info stored in config parameters
* [CPP] Fix a bug causing nstreams parameter to never be set to AUTO in CPP benchmark_app
* [CPP] Fix clang format errors
* [CPP] Modify print order and data output for 8th step
* [PYTHON] Add verification checks from C++, modify set_thoughtput_streams to match documentation
* [CPP] Revert changes to C++ benchmark_app
* [CPP] Remove additional spacebar
* Update submodules versions on remote
* Update module from master branch
* Redownload submodules from master and override changes from commit
* [PYTHON] Remove unneccesary parse_status from validation function
* [PYTHON] Check for HINT in map, fix circular import
* [PYTHON] Remove artifacts from commit, fix args.perf_hint set to '' instead to 'none'
* [PYTHON] Reverse changes to perf hint, add key in map check, fix validation function throwing error on set hint
* [PYTHON] Fix linter
* [PYTHON] Remove linter spacebar
* [CPP] Fix wait_all exception throw
* [CPP/PYTHON] Clean artifacts and unwanted changes from work process
* [PYTHON] Fix artifacts from merge, clean submodule update
* [C++ CPU] Fix device name string by removing padding NULL characters from the back
* [CPP] Fix ba infer_request_wrap in other throw-catch clauses
* [PYTHON/CPP] Fix missing latencies in final step for shape group, fix minor misaligned messages, add missing report parameter create infer requests time
* [CPP] Clang fix formatting
* [CPP] Reverse clang fix format on plugin.cpp
* [PYTHON/CPP] Fix C++ progressbar printing endl when disabled, fix rounding in python creating infer request message
* [CPP] Fix foramtiing error
* [PYTHON/C++] Refactor network to model based on naming conventions, provide fresh README output example
* [PYTHON/C++] Add example output to C++ README, remove unnecessary device loop
* [BENCHMARK_APP/C++] Fix artifact from refactoring, remove try-catch clause
* Update samples/cpp/benchmark_app/benchmark_app.hpp
Co-authored-by: Nadezhda Ageeva <nkogteva@gmail.com>
* Update samples/cpp/benchmark_app/main.cpp
Co-authored-by: Nadezhda Ageeva <nkogteva@gmail.com>
* Update tools/benchmark_tool/openvino/tools/benchmark/main.py
Co-authored-by: Nadezhda Ageeva <nkogteva@gmail.com>
* Update samples/cpp/benchmark_app/main.cpp
Co-authored-by: Nadezhda Ageeva <nkogteva@gmail.com>
* [CPP] Fix clang errors
* [CPP/PLUGIN Reverse modification to extract to separate task
* Update tools/benchmark_tool/openvino/tools/benchmark/main.py
Co-authored-by: Nadezhda Ageeva <nkogteva@gmail.com>
* Update tools/benchmark_tool/openvino/tools/benchmark/parameters.py
Co-authored-by: Zlobin Vladimir <vladimir.zlobin@intel.com>
* Update tools/benchmark_tool/openvino/tools/benchmark/utils/utils.py
Co-authored-by: Zlobin Vladimir <vladimir.zlobin@intel.com>
* Update tools/benchmark_tool/openvino/tools/benchmark/main.py
Co-authored-by: Zlobin Vladimir <vladimir.zlobin@intel.com>
* [PYTHON/C++/BENCHMARK_APP] Fix language inconsistencies, remove unnecessary checks
* Update pyopenvino.cpp
* [CPP/BENCHMARK_APP] Remove unnecessary try-catch, fix linter errors
* [PYTHON/CPP/BENCHMARK_APP] Revert changes to Core, align version prints usin only provided methods
* [DOCS/BENCHMARK_APP] Update README with proper model examples
* Update README.md
Co-authored-by: Nadezhda Ageeva <nkogteva@gmail.com>
Co-authored-by: Michal Lukaszewski <michal.lukaszewski@intel.com>
Co-authored-by: Zlobin Vladimir <vladimir.zlobin@intel.com>
* [PYTHON] CV2 module required only when loading images
* [PYTHON] Update tools/benchmark_tool/openvino/tools/benchmark/utils/inputs_filling.py
Co-authored-by: Helena Kloosterman <helena.kloosterman@intel.com>
* [PYTHON] Make CV import not global
* [PYTHON] Update format of inputs_filling.py
* [PYTHON] Fix missing newline
* Update tools/benchmark_tool/openvino/tools/benchmark/utils/inputs_filling.py
Co-authored-by: Helena Kloosterman <helena.kloosterman@intel.com>
* [BENCHMARK_APP/PYTHON] Introduce exception when module is installed but fails to import
* [SAMPLES/PYTHON] Sporadic access violation fix through checking whether module was cached
Co-authored-by: Helena Kloosterman <helena.kloosterman@intel.com>
Co-authored-by: Michal Lukaszewski <michal.lukaszewski@intel.com>