Files

Vitaliy Urusovskij c3ff2948a4 Timetests test_runner improvements (#2552 )

* Remove `generate_tmp_path` as unnecessary after refactoring

* Add `check_positive_int` check for `-niter` CLI key

* Replace `TestConfDumper` with number of fixtures:
1. Save all test info in global `request` and `pytestconfig` fixtures
2. Add `test_info` fixture for retrieving test info from test
3. Add `prepare_tconf_with_refs` fixture for test conf dump

2020-10-07 17:15:02 +03:00

include/timetests_helper

Extend timetest_infer pipeline with infer track and blob's support (#2298 )

2020-09-21 02:09:41 +03:00

scripts

Timetests test_runner improvements (#2552 )

2020-10-07 17:15:02 +03:00

src

Add fill_inputs step in timetests (#2413 )

2020-09-25 14:08:03 +03:00

test_runner

Timetests test_runner improvements (#2552 )

2020-10-07 17:15:02 +03:00

CMakeLists.txt

Bump cmake version to 3.13 (#2258 )

2020-09-18 18:58:12 +03:00

README.md

Test timetest MVP (#2345 )

2020-09-21 21:33:42 +03:00

README.md

Time Tests

This test suite contains pipelines, which are executables. The pipelines measure the time of their execution, both total and partial. A Python runner calls the pipelines and calcuates the average execution time.

Prerequisites

To build the time tests, you need to have the build folder, which is created when you configure and build OpenVINO™.

Measure Time

To build and run the tests, open a terminal and run the commands below:

Build tests:

mkdir build && cd build
cmake .. -DInferenceEngineDeveloperPackage_DIR=$(realpath ../../../build) && make time_tests

Run test:

./scripts/run_timetest.py ../../bin/intel64/Release/timetest_infer -m model.xml -d CPU

Run several configurations using pytest:

export PYTHONPATH=./:$PYTHONPATH
pytest ./test_runner/test_timetest.py --exe ../../bin/intel64/Release/timetest_infer