Files

Ilya Sharikov 5847b35ed2 Make time && stress tests independent from IEDeveloperPackage (#7411 )

* Specify own CXX configuration for time && stress tests

* Included os_flags for build gflags

* Updated README

* Updated commands for build tests in README

* Use new cmake config

2021-09-16 12:54:41 +03:00

.automation

Move all utils to common folder (#7303 )

2021-09-07 23:02:10 +03:00

include/timetests_helper

Align copyright notice in cpp and cmake source files (CVS-51320) (#4950 )

2021-03-25 02:40:09 +03:00

scripts

Move all utils to common folder (#7303 )

2021-09-07 23:02:10 +03:00

src

add new exec with vpu compiler option (set config with MLIR compiler) (#7420 )

2021-09-13 10:52:06 +03:00

test_runner

[requirements] Set TF to 2.5.0 (#6620 )

2021-09-14 18:05:18 +03:00

CMakeLists.txt

Make time && stress tests independent from IEDeveloperPackage (#7411 )

2021-09-16 12:54:41 +03:00

README.md

Make time && stress tests independent from IEDeveloperPackage (#7411 )

2021-09-16 12:54:41 +03:00

README.md

Time Tests

This test suite contains pipelines, which are executables. The pipelines measure the time of their execution, both total and partial. A Python runner calls the pipelines and calcuates the average execution time.

Prerequisites

To build the time tests, you need to have OpenVINO™ installed or build from source.

Measure Time

To build and run the tests, open a terminal, set OpenVINO™ environment and run the commands below:

Build tests:

source <OpenVINO_install_dir>/bin/setupvars.sh
mkdir build && cd build
cmake .. && make time_tests

Run test:

./scripts/run_timetest.py ../../bin/intel64/Release/timetest_infer -m model.xml -d CPU

Run several configurations using pytest:

pytest ./test_runner/test_timetest.py --exe ../../bin/intel64/Release/timetest_infer

# For parse_stat testing:
pytest ./scripts/run_timetest.py