Albert AnglesandDaria Ilina
711e2cbab0
* add time_to_first_inference_result KPI as sum of inf latency values
* append unit time after the value
tested locally, worked
* Revert "append unit time after the value"
This reverts commit 428b8cafdc.
* remove metric
* revert https://github.com/openvinotoolkit/openvino/pull/14829/commits/42dd271c3b96660cd59deb92bfdf5f0d022e37fc
* enable { SCOPED_TIMER(first_inference_latency); }
* enable first_inference_latency
tested locally, it works
* remove trailing whitespace
Co-authored-by: Daria Ilina <daria.krupnova@intel.com>
Time Tests
This test suite contains pipelines, which are executables. The pipelines measure the time of their execution, both total and partial. A Python runner calls the pipelines and calcuates the average execution time.
Prerequisites
To build the time tests, you need to have OpenVINO™ installed or build from source.
Measure Time
To build and run the tests, open a terminal, set OpenVINO™ environment and run the commands below:
- Build tests:
mkdir build && cd build
cmake .. && cmake --build . --target time_tests -j8
- Install tests:
сmake --install <build_dir> --prefix <install_path>
- Run test:
./scripts/run_timetest.py ../../bin/intel64/Release/timetest_infer -m model.xml -d CPU
- Run several configurations using
pytest:
pytest ./test_runner/test_timetest.py --exe ../../bin/intel64/Release/timetest_infer
# For parse_stat testing:
pytest ./scripts/run_timetest.py