openvino/tests/conditional_compilation
Vitaliy Urusovskij e4c38e3afd
Port tests/ to API2.0 (#21476)
* Port properties in time and stress tests to API2.0

* Port CC tests infer_tool.py to API2.0

* Update tests/conditional_compilation/tools/infer_tool.py

Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>

---------

Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>
2023-12-06 14:36:43 +04:00
..
tools Port tests/ to API2.0 (#21476) 2023-12-06 14:36:43 +04:00
CMakeLists.txt Updated copyright headers (#15124) 2023-01-16 11:02:17 +04:00
conftest.py Updated copyright headers (#15124) 2023-01-16 11:02:17 +04:00
pytest.ini Conditional compilation test can run from open source (#5629) 2021-05-26 11:43:59 +03:00
README.md [47750] Validate conditional compilation with models from OMZ (#7207) 2021-09-13 11:47:04 +03:00
requirements.txt [PyOV] Limit protobuf version for conditional compilation tests (#21130) 2023-12-01 16:13:12 +00:00
test_cc.py Updated copyright headers (#15124) 2023-01-16 11:02:17 +04:00
test_config.yml Remove failing mxnet test (#21151) 2023-11-20 10:17:22 +01:00
test_utils.py Use FindPython3.cmake (#19847) 2023-09-26 20:57:29 +02:00

Conditional compilation tests

This folder contains conditional compilation (CC) test framework code and CC tests file.

Environment preparation:

Install Python modules required for tests:

pip3 install -r requirements.txt 

Clone Open Model Zoo from https://github.com/openvinotoolkit/open_model_zoo

Run tests

pytest test_cc.py

Test parameters:

  • sea_runtool - path to sea_runtool.py file.
  • collector_dir - path to collector file parent folder.
  • artifacts - Path to directory where test write output or read input.
  • openvino_root_dir - Path to OpenVINO repo root directory.
  • omz_repo - Path to Open Model Zoo repository root directory.

Optional:

  • test_conf - path to test cases .yml config.
  • openvino_ref - Path to root directory with installed OpenVINO. If the option is not specified, CC test firstly build and install instrumented package at <artifacts>/ref_pkg folder with OpenVINO repository specified in --openvino_root_dir option.

    If OpenVINO instrumented package has been successfuly installed, in the future you can set --openvino_ref parameter as <artifacts>/ref_pkg for better performance.

  • omz_cache_dir - Path to Open Model Zoo cache directory.

Sample usage:

pytest test_cc.py --sea_runtool=./thirdparty/itt_collector/runtool/sea_runtool.py --collector_dir=./bin/intel64/Release --artifacts=../artifacts --openvino_root_dir=. --omz_repo=../_open_model_zoo