IntenseWebs/openvino
3
0 Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
2,787 Commits 38 Branches 54 Tags
e40a44202efa374b64ab7a928b7a41d445683d16
Commit Graph
86 Commits
Author SHA1 Message Date
Andrey Somsikov 7f8d3aa638 Catch std::except in fuzz tests (#4610) 
Fuzz tests must catch all expected exceptions from IE. IE is using C++ std
library which may raise standard exceptions which IE pass through.
 2021-03-06 13:06:40 +03:00
Victor Kuznetsov 1fef41d083 Fix reference config for MemCheckTests (#4587) 2021-03-04 15:15:07 +03:00
Andrey Somsikov dcce0f549c Add LeakSanitizer default suppressions list (#4473) 2021-02-26 06:32:42 +03:00
Andrey Somsikov 0646219f3e Translate app failures from cond comp tests (#4393) 2021-02-24 22:54:37 +03:00
Victor Kuznetsov 7ba9723242 [Stress] Add precision field to MemCheck configs (#4362) 2021-02-24 14:56:09 +03:00
Olesya Martinyuk 61f1950997 Infer tool code style patch (#4429) 
* Moved input preparation to another function, cleared argparse, minor code improvements

* Minor changes in function description
 2021-02-20 12:19:18 +03:00
Olesya Martinyuk 0c22a9e111 Add infer tool for cond compilation test(#4384) 2021-02-18 21:38:52 +03:00
Andrey Somsikov 4f79d9ccfc Force test use bash for setupvars.sh (#4321) 
setupvars.sh is incomatible with sh shell.
 2021-02-15 13:07:17 +03:00
Andrey Somsikov 9d57d4f52c Fix cond comp environment setup (#4290) 
source command may not be available in sh.
 2021-02-11 21:29:46 +03:00
Victor Kuznetsov 1da8f65b45 Add removing of statistics file in time_tests (#4275) 2021-02-11 12:02:39 +03:00
Andrey Somsikov 8da7f22f1d Activate OV environment from cond comp test_infer (#4244) 2021-02-11 09:59:37 +03:00
Victor Kuznetsov 73f846648c change tempfile usage (#4245) 2021-02-10 10:23:31 +03:00
Vitaliy Urusovskij ba5da4231f Remove use of -f key which isn't defined in openvino/**/sea_runtool.py (#4257) 2021-02-10 08:53:11 +03:00
Victor Kuznetsov a6d9842152 mv getBatchSize to cnnNetwork scope (#4231) 2021-02-09 10:47:44 +03:00
Andrey Somsikov db065d525e Fix cond comp artifacts path (#4200) 2021-02-08 11:18:27 +03:00
Andrey Somsikov 9b5b2bb002 Add collector path for cond. comp. tests (#4159) 2021-02-04 10:35:24 +03:00
Andrey Somsikov 359c2ca018 Upgrade pyyaml to the latest (#4134) 2021-02-03 07:07:01 +03:00
Ilya Lavrenov 685bf830d5 Fixed cldnn compilation with static runtime (#4070) 2021-02-02 20:11:40 +03:00
Vitaliy Urusovskij 8abbfbc855 Design test config and integrate in CC tests (#4051) 2021-01-29 16:54:19 +03:00
Andrey Somsikov 81da815dd8 Add conditional compilation tests (#3996) 2021-01-28 13:27:07 +03:00
Victor Kuznetsov 1217d26f2f rename time test config (#3923) 2021-01-21 12:32:15 +03:00
Vitaliy Urusovskij 1e858830e2 Change json.loads to json.load for --db_metadata (#3871) 2021-01-19 18:33:00 +03:00
Ilya Lavrenov 50f9dd8a6b Enabled CMP0025 as NEW (#3791) 2021-01-11 14:48:27 +03:00
Vitaliy Urusovskij 08f54dbac8 Fix metadata_from_manifest() according to new manifest version (#3771) 2020-12-31 09:57:58 +03:00
Vitaliy Urusovskij fe229ba19d Move time_tests to new manifest version (#3759) 2020-12-30 17:28:22 +03:00
Ilya Lavrenov 278b662e56 Removed global CMAKE_MODULE_PATH in IE DevPackage (#3747) 
* Cleanup

* Added CMAKE_MODULE_LINKER_FLAGS for onecoreuap toolchain

* Fixed ENABLE_FASTER_BUILD mode on Android

* Cosmetic fix

* Fixed fuzzing

* Enabled fuzzing
 2020-12-27 00:02:50 +03:00
Ilya Lavrenov 9465073f58 Introduce IEDevScripts package (#3661) 
* Refactored developer package

* Added fuzzing for CMAKE_MODULE_LINKER_FLAGS as well

* Added options for developer package

* More improvements

* Further improvements

* Removed global CMAKE_MODULE_PATH population

* Fixes

* Final fixes

* Fixed python build

* Fix for TBB

* Fixed Find TBB

* Fixed install

* Fixes for OV features

* Split developer targets per component

* Fixed IE build tree config

* Fixed ITT

* Fixed review comments

* Clean export dependencies

* Fixed export of pugixml

* Added IEDevScripts_DIR for Android

* Fixed Android #2

* Fixed Android #3

* Fixed python cc

* Disabled Core threading tests on GNA
 2020-12-22 18:44:59 +03:00
Andrey Somsikov 7fe21dc6ee Fix windows build for gflags for time_tests (#3504) 
GFlags builds multiple targets, require aligning build
options on windows builds.

FetchModule offloads project configuration to cmake. This also allows
to align build configurations and targets across projects:
https://crascit.com/2015/07/25/cmake-gtest/
 2020-12-11 09:25:14 +03:00
Andrey Somsikov 5cc08367b2 Build time_tests with OpenVINO install (#3484) 2020-12-07 12:56:37 +03:00
Vitaliy Urusovskij e910902c9d Fix paths for squeezenet1.1 in time_tests config (#3415) 2020-11-30 18:45:08 +03:00
Vitaliy Urusovskij 364bf08920 Add several new models to tgl_test_config.yml in time_tests (#3268) 
* Fix wrong path for `yolo-v2-tiny-ava-0001` for time_tests

* Add several new models to `tgl_test_config.yml` in time_tests
 2020-11-24 13:26:16 +03:00
Vitaliy Urusovskij 4bfb353dbd Add fillBlobs to fix issue with negative values in image_info input layer (#3271) 2020-11-23 17:32:49 +03:00
Vitaliy Urusovskij 9f427bbf6e Add WA for OMZ Keras models in stress tests (#3272) 2020-11-23 17:32:35 +03:00
Vitaliy Urusovskij dee00cdc92 Add new model to tgl_test_config.yml (#3236) 2020-11-20 13:33:57 +03:00
Vitaliy Urusovskij b5930eb58e Fix "results" uploading to DB in time_tests (#3215) 2020-11-20 10:49:31 +03:00
Vitaliy Urusovskij 070fc17087 Extend information to submit to a DB in time_tests (#3018) 
* Optimize imports in time_tests conftest.py

* Extend information to submit to a DB in time_tests:
1. Add `--manifest` and `--db_metadata` CLI keys
2. Add `prepare_db_info` fixture

* Move `validate_test_case` fixture to a const schema, remove extra checks

* Add `manifest_metadata` fixture to parse and validate manifest only once

* Add OS utils to submit os info to DB
 2020-11-17 12:07:40 +03:00
Vitaliy Urusovskij 0ef1fb8a09 Update MemCheckTests OMZ part: get_testdata.py and configs (#2722) 2020-10-30 00:37:02 +03:00
Vitaliy Urusovskij e1f4585cb8 Add validate_test_case fixture with using of jsonschema. Specify all required fields for test cases (#2821) 2020-10-29 00:11:01 +03:00
Vitaliy Urusovskij 3c5aefb427 Remove memcheck_pregen_irs_tests MemCheck configs due obsolescence (#2693) 2020-10-19 09:48:38 +03:00
Vitaliy Urusovskij 12b690952c Time tests improvements (#2642) 
* Remove extra functions from run_timetest.py

* Add `log.debug` of raw and aggregated statistics in run_timetest.py

* Implement storing of models locally for test_timetest.py
 2020-10-14 20:05:52 +03:00
Vitaliy Urusovskij a4fe59ba0a Specify cl_cache_dir env var: (#2581) 
1. General behaviour doesn't work for some compute-runtime versions.
Specification of `cl_cache_dir` fixes it
 2020-10-08 15:02:31 +03:00
Vitaliy Urusovskij 474dcc277f Prepare new test configuration for test_timetest.py (#2561) 
* Add logging of DB upload to tconf with refs saving

* Prepare `.automation/tgl_test_config.yml` with models from VPUX package

* Add restriction on `exe` and `model` existence in run_timetest.py
 2020-10-08 10:30:43 +03:00
Vitaliy Urusovskij c3ff2948a4 Timetests test_runner improvements (#2552) 
* Remove `generate_tmp_path` as unnecessary after refactoring

* Add `check_positive_int` check for `-niter` CLI key

* Replace `TestConfDumper` with number of fixtures:
1. Save all test info in global `request` and `pytestconfig` fixtures
2. Add `test_info` fixture for retrieving test info from test
3. Add `prepare_tconf_with_refs` fixture for test conf dump
 2020-10-07 17:15:02 +03:00
Vitaliy Urusovskij 6949d93e42 Add "cl_cache" preparation in test_timetest.py (#2490) 2020-10-06 14:16:50 +03:00
Vitaliy Urusovskij 05d70cfa43 Remove --collect_results_only (#2509) 
* Remove CLI keys from README

* Remove `--collect_results_only` from MemCheckTests
 2020-10-05 17:43:24 +03:00
Vitaliy Urusovskij 639052d0b8 Support references in test_timetest.py (#2431) 2020-10-01 11:35:57 +03:00
Vitaliy Urusovskij c8530201dd Support DB reporting for test_timetest.py (#2359) 2020-10-01 08:39:19 +03:00
Vitaliy Urusovskij 0bd966ad08 Add fill_inputs step in timetests (#2413) 2020-09-25 14:08:03 +03:00
Vitaliy Urusovskij d48d2109dc Test timetest MVP (#2345) 2020-09-21 21:33:42 +03:00
Vitaliy Urusovskij babff1fd15 Extend timetest_infer pipeline with infer track and blob's support (#2298) 2020-09-21 02:09:41 +03:00