* Fixing run_timest python script for input and output precision
* Update code according to the PR review
* Update run_timetest according to the last review
* Add input_precision and output_precision to test_timetest as well
* Set input/output precision per model
* User can set input and output precision for timetest tool
* Update run_timetest.py with the ip and op options as well
* Use only one getType function
* Add extra line at the end of the file
* Remove unused parameters
* Update comment accordingly
---------
Co-authored-by: Vitaliy Urusovskij <vitaliy.urusovskij@intel.com>
* add time_to_first_inference_result KPI as sum of inf latency values
* append unit time after the value
tested locally, worked
* Revert "append unit time after the value"
This reverts commit 428b8cafdc.
* remove metric
* revert 42dd271c3b
* enable { SCOPED_TIMER(first_inference_latency); }
* enable first_inference_latency
tested locally, it works
* remove trailing whitespace
Co-authored-by: Daria Ilina <daria.krupnova@intel.com>
* Set db_api_handler for pushing to new database in timetests
* Change function of pushing to db.
Co-authored-by: Daria Ilina <daria.krupnova@intel.com>
* add performance hint to time infer
* add reshape methods for time infer tool
* add func declarations to common_utils.h
* add check if node is static (reshape pipeline)
* changes in desc of reshape funcs
* fix logic operator
* add reshape utils.h | move parsing logic in main func
* add tests_shared_lib to CMakeLists.txt
* change fill blobs with setStaticShapesBlobs
* change delimiter
* add performance hint to time infer
* Update time tests with options
* fix mistake in help
* update test conf with GPU models
* move ie configs from load plugin timer
* add performance hint to time infer
* add options for vpu, cpu cache, perf hint
* change VPUX condition
* add perf hint verify
* upd perf hint usage. set as non required
* work with omz: change hardcoded paths for memory_tests, fix paths for memcheck get_testdata.py script
* change paths to omz tools
* revert mo changes
* remove mo from arguments
* remove extra var from cmd string
* remove is_db_used check
* add timeout to proc_exec
* merge master
* move all utils to common folder
* add utils install in CMakeLists.txt
* revert plugin utils
* add log info: test
* add logging info: test
* test imports
* change imports: test
* fix file name
* Fixed return in `run_timetest`
* Fixed `parse_stats()` argument type notation
* Pass message from `timetest` exe to test error msg to be uploaded to DB
* Remove extra functions from run_timetest.py
* Add `log.debug` of raw and aggregated statistics in run_timetest.py
* Implement storing of models locally for test_timetest.py
* Add logging of DB upload to tconf with refs saving
* Prepare `.automation/tgl_test_config.yml` with models from VPUX package
* Add restriction on `exe` and `model` existence in run_timetest.py
* Remove `generate_tmp_path` as unnecessary after refactoring
* Add `check_positive_int` check for `-niter` CLI key
* Replace `TestConfDumper` with number of fixtures:
1. Save all test info in global `request` and `pytestconfig` fixtures
2. Add `test_info` fixture for retrieving test info from test
3. Add `prepare_tconf_with_refs` fixture for test conf dump
