Files

Vitaliy Urusovskij 070fc17087 Extend information to submit to a DB in time_tests (#3018 )

* Optimize imports in time_tests conftest.py

* Extend information to submit to a DB in time_tests:
1. Add `--manifest` and `--db_metadata` CLI keys
2. Add `prepare_db_info` fixture

* Move `validate_test_case` fixture to a const schema, remove extra checks

* Add `manifest_metadata` fixture to parse and validate manifest only once

* Add OS utils to submit os info to DB

2020-11-17 12:07:40 +03:00

include/timetests_helper

Extend timetest_infer pipeline with infer track and blob's support (#2298 )

2020-09-21 02:09:41 +03:00

scripts

Time tests improvements (#2642 )

2020-10-14 20:05:52 +03:00

src

Add fill_inputs step in timetests (#2413 )

2020-09-25 14:08:03 +03:00

test_runner

Extend information to submit to a DB in time_tests (#3018 )

2020-11-17 12:07:40 +03:00

CMakeLists.txt

Bump cmake version to 3.13 (#2258 )

2020-09-18 18:58:12 +03:00

README.md

Test timetest MVP (#2345 )

2020-09-21 21:33:42 +03:00

README.md

Time Tests

This test suite contains pipelines, which are executables. The pipelines measure the time of their execution, both total and partial. A Python runner calls the pipelines and calcuates the average execution time.

Prerequisites

To build the time tests, you need to have the build folder, which is created when you configure and build OpenVINO™.

Measure Time

To build and run the tests, open a terminal and run the commands below:

Build tests:

mkdir build && cd build
cmake .. -DInferenceEngineDeveloperPackage_DIR=$(realpath ../../../build) && make time_tests

Run test:

./scripts/run_timetest.py ../../bin/intel64/Release/timetest_infer -m model.xml -d CPU

Run several configurations using pytest:

export PYTHONPATH=./:$PYTHONPATH
pytest ./test_runner/test_timetest.py --exe ../../bin/intel64/Release/timetest_infer