Files

Victor Kuznetsov 6d9a7a108e Stress, Memory tests update to comply with new OMZ tools layout (#7886 )

* work with omz: change hardcoded paths for memory_tests, fix paths for memcheck get_testdata.py script

* change paths to omz tools

* revert mo changes

* remove mo from arguments

* remove extra var from cmd string

* remove is_db_used check

* add timeout to proc_exec

* merge master

2021-10-13 10:42:00 +03:00

.automation

Move all utils to common folder (#7303 )

2021-09-07 23:02:10 +03:00

include/timetests_helper

Align copyright notice in cpp and cmake source files (CVS-51320) (#4950 )

2021-03-25 02:40:09 +03:00

scripts

Stress, Memory tests update to comply with new OMZ tools layout (#7886 )

2021-10-13 10:42:00 +03:00

src

add new exec with vpu compiler option (set config with MLIR compiler) (#7420 )

2021-09-13 10:52:06 +03:00

test_runner

Stress, Memory tests update to comply with new OMZ tools layout (#7886 )

2021-10-13 10:42:00 +03:00

CMakeLists.txt

Make time && stress tests independent from IEDeveloperPackage (#7411 )

2021-09-16 12:54:41 +03:00

README.md

Fixed path to setupvars.sh ti readme (#7537 )

2021-09-17 05:20:28 +03:00

README.md

Time Tests

This test suite contains pipelines, which are executables. The pipelines measure the time of their execution, both total and partial. A Python runner calls the pipelines and calcuates the average execution time.

Prerequisites

To build the time tests, you need to have OpenVINO™ installed or build from source.

Measure Time

To build and run the tests, open a terminal, set OpenVINO™ environment and run the commands below:

Build tests:

source <OpenVINO_install_dir>/setupvars.sh
mkdir build && cd build
cmake .. && make time_tests

Run test:

./scripts/run_timetest.py ../../bin/intel64/Release/timetest_infer -m model.xml -d CPU

Run several configurations using pytest:

pytest ./test_runner/test_timetest.py --exe ../../bin/intel64/Release/timetest_infer

# For parse_stat testing:
pytest ./scripts/run_timetest.py