openvino/tests/time_tests
Vitaliy Urusovskij e4c38e3afd
Port tests/ to API2.0 (#21476)
* Port properties in time and stress tests to API2.0

* Port CC tests infer_tool.py to API2.0

* Update tests/conditional_compilation/tools/infer_tool.py

Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>

---------

Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>
2023-12-06 14:36:43 +04:00
..
.automation [EISW-89824] [master] Rename VPUX to NPU (#19004) 2023-08-10 00:20:07 +04:00
include/timetests_helper Port tests/ to API2.0 (#21476) 2023-12-06 14:36:43 +04:00
scripts Validation: Test AUTO plugin timetests (#17508) 2023-05-31 15:38:57 +02:00
src Validation: Test AUTO plugin timetests (#17508) 2023-05-31 15:38:57 +02:00
test_runner [EISW-89824] [master] Rename VPUX to NPU (#19004) 2023-08-10 00:20:07 +04:00
CMakeLists.txt Updated copyright headers (#15124) 2023-01-16 11:02:17 +04:00
README.md Fixed documentation for tests (#13246) 2022-09-28 23:36:21 +04:00

Time Tests

This test suite contains pipelines, which are executables. The pipelines measure the time of their execution, both total and partial. A Python runner calls the pipelines and calcuates the average execution time.

Prerequisites

To build the time tests, you need to have OpenVINO™ installed or build from source.

Measure Time

To build and run the tests, open a terminal, set OpenVINO™ environment and run the commands below:

  1. Build tests:
mkdir build && cd build
cmake .. && cmake --build . --target time_tests -j8
  1. Install tests:
сmake --install <build_dir> --prefix <install_path>
  1. Run test:
./scripts/run_timetest.py ../../bin/intel64/Release/timetest_infer -m model.xml -d CPU
  1. Run several configurations using pytest:
pytest ./test_runner/test_timetest.py --exe ../../bin/intel64/Release/timetest_infer

# For parse_stat testing:
pytest ./scripts/run_timetest.py