Commit Graph

109 Commits

Author SHA1 Message Date
Victor Kuznetsov
5834eef8f0 Change model_path to model_name in timeline report (#5457) 2021-05-06 11:54:16 +03:00
Olesya Martinyuk
d16c215fde Add CPU info to time tests (#5451) 2021-05-04 14:49:10 +03:00
Vitaliy Urusovskij
68ed12cb98 Enable FetchContent for gflags dependency in stress tests (#5449)
* Enable `FetchContent` for `gflags` dependency in stress tests

* Add `HAVE_SYS_STAT_H`, `HAVE_INTTYPES_H`, `INTTYPES_FORMAT` for stress tests
2021-04-29 14:44:12 +03:00
Victor Kuznetsov
e121fbd7de Add int8 models to memcheck tests (#5333) 2021-04-23 12:56:59 +03:00
Vitaliy Urusovskij
ed0b66f31d Fix timeline report for MemCheck by querying target instead of current branch (#5350) 2021-04-22 15:51:35 +03:00
Vitaliy Urusovskij
db2de2fb19 Fix time_tests runs when models_cache enabled (#5265)
* Set ``"additionalProperties": true` to enable 'use_model_cache' in time_tests

* Limit tests scope in desktop_test_config_cache.yml
2021-04-17 00:12:08 +03:00
Vitaliy Urusovskij
c852634055 Remove comparison with references from time_tests as unused (#5248)
* Remove comparison with references from time_tests as unused

* Remove `--dump_refs` from time_tests as unused
2021-04-15 22:24:45 +03:00
Vitaliy Urusovskij
a70d13f9e2 Add support of IE model cache in time_tests (#5192) 2021-04-15 00:11:48 +03:00
Olesya Martinyuk
070201feee Added test validating inference results after conditional compilation (#4840) 2021-04-13 22:16:14 +03:00
Vitaliy Urusovskij
634dc42808 Enable new infer_request_inference memleak test to cover *-52623 (#5183) 2021-04-12 20:00:11 +03:00
Alexander Shchepetov
e864972f83 Add experiments timings to data to submit to DB(#5108) 2021-04-12 09:29:10 +03:00
Mikhail Nosov
ca99333982 [TimeTests] Add test case for testing first time inference with caching enabled (#4933)
Important note: Invoker (e.g. test_timetest.py) must ignore first measurement when cache is not generated
2021-04-07 17:04:45 +03:00
Victor Kuznetsov
69a06f5977 Remove time-tests outliers using Inter Quartile Range (IQR) (#5014)
Change number of times to execute binary to aggregate statistics from 3 to 10.
2021-04-02 11:35:38 +03:00
Taylor Yeonbok Lee
b58c648d2d [IE CLDNN] Build time optimization for OCL kernels (#4725)
Build OCL kernel batches of different buckets in parallel

Co-authored-by: Donghyeon Jeong <donghyeon.jeong@intel.com>
2021-03-31 10:22:19 +03:00
Victor Kuznetsov
83ec2d321a Add json file with tests ids to CC tests (#4425) 2021-03-30 15:31:40 +03:00
Alexey Suhov
a2bf62f488 Align copyright notice in sh, bat, cl, cc, pyx source files (#4995) 2021-03-27 01:26:27 +03:00
Alexey Suhov
6478f1742a Align copyright notice in python scripts (CVS-51320) (#4974)
* Align copyright notice in python scripts (CVS-51320)
2021-03-26 17:54:28 +03:00
Alexey Suhov
a748c26fee Align copyright notice in cpp and cmake source files (CVS-51320) (#4950) 2021-03-25 02:40:09 +03:00
Anton Pankratv
3b3d9a0989 Used IE_THROW macro (#4869)
* Added ie throw macro

* Used IE_THROW macro
2021-03-23 18:57:12 +03:00
Anton Pankratv
a2b8b974b8 Simplified IE Exceptions Implementation (#4258) 2021-03-18 16:30:16 +03:00
Ilya Sharikov
a382934a80 Added test for checking lib sizes, when using conditional compilation option (#4292) 2021-03-17 17:56:47 +03:00
Ilya Lavrenov
24fb09edb3 Improvements in cmake scripts (#4766)
1. Find Threads only once in IEDevScripts package
2. Small refactoring in IE Dev Package
2021-03-15 13:07:38 +03:00
Victor Kuznetsov
3a703d546c [Stress] MemCheck add FP16 models to configs (#4503) 2021-03-12 01:14:40 +03:00
Andrey Somsikov
7f8d3aa638 Catch std::except in fuzz tests (#4610)
Fuzz tests must catch all expected exceptions from IE. IE is using C++ std
library which may raise standard exceptions which IE pass through.
2021-03-06 13:06:40 +03:00
Victor Kuznetsov
1fef41d083 Fix reference config for MemCheckTests (#4587) 2021-03-04 15:15:07 +03:00
Andrey Somsikov
dcce0f549c Add LeakSanitizer default suppressions list (#4473) 2021-02-26 06:32:42 +03:00
Andrey Somsikov
0646219f3e Translate app failures from cond comp tests (#4393) 2021-02-24 22:54:37 +03:00
Victor Kuznetsov
7ba9723242 [Stress] Add precision field to MemCheck configs (#4362) 2021-02-24 14:56:09 +03:00
Olesya Martinyuk
61f1950997 Infer tool code style patch (#4429)
* Moved input preparation to another function, cleared argparse, minor code improvements

* Minor changes in function description
2021-02-20 12:19:18 +03:00
Olesya Martinyuk
0c22a9e111 Add infer tool for cond compilation test(#4384) 2021-02-18 21:38:52 +03:00
Andrey Somsikov
4f79d9ccfc Force test use bash for setupvars.sh (#4321)
setupvars.sh is incomatible with sh shell.
2021-02-15 13:07:17 +03:00
Andrey Somsikov
9d57d4f52c Fix cond comp environment setup (#4290)
source command may not be available in sh.
2021-02-11 21:29:46 +03:00
Victor Kuznetsov
1da8f65b45 Add removing of statistics file in time_tests (#4275) 2021-02-11 12:02:39 +03:00
Andrey Somsikov
8da7f22f1d Activate OV environment from cond comp test_infer (#4244) 2021-02-11 09:59:37 +03:00
Victor Kuznetsov
73f846648c change tempfile usage (#4245) 2021-02-10 10:23:31 +03:00
Vitaliy Urusovskij
ba5da4231f Remove use of -f key which isn't defined in openvino/**/sea_runtool.py (#4257) 2021-02-10 08:53:11 +03:00
Victor Kuznetsov
a6d9842152 mv getBatchSize to cnnNetwork scope (#4231) 2021-02-09 10:47:44 +03:00
Andrey Somsikov
db065d525e Fix cond comp artifacts path (#4200) 2021-02-08 11:18:27 +03:00
Andrey Somsikov
9b5b2bb002 Add collector path for cond. comp. tests (#4159) 2021-02-04 10:35:24 +03:00
Andrey Somsikov
359c2ca018 Upgrade pyyaml to the latest (#4134) 2021-02-03 07:07:01 +03:00
Ilya Lavrenov
685bf830d5 Fixed cldnn compilation with static runtime (#4070) 2021-02-02 20:11:40 +03:00
Vitaliy Urusovskij
8abbfbc855 Design test config and integrate in CC tests (#4051) 2021-01-29 16:54:19 +03:00
Andrey Somsikov
81da815dd8 Add conditional compilation tests (#3996) 2021-01-28 13:27:07 +03:00
Victor Kuznetsov
1217d26f2f rename time test config (#3923) 2021-01-21 12:32:15 +03:00
Vitaliy Urusovskij
1e858830e2 Change json.loads to json.load for --db_metadata (#3871) 2021-01-19 18:33:00 +03:00
Ilya Lavrenov
50f9dd8a6b Enabled CMP0025 as NEW (#3791) 2021-01-11 14:48:27 +03:00
Vitaliy Urusovskij
08f54dbac8 Fix metadata_from_manifest() according to new manifest version (#3771) 2020-12-31 09:57:58 +03:00
Vitaliy Urusovskij
fe229ba19d Move time_tests to new manifest version (#3759) 2020-12-30 17:28:22 +03:00
Ilya Lavrenov
278b662e56 Removed global CMAKE_MODULE_PATH in IE DevPackage (#3747)
* Cleanup

* Added CMAKE_MODULE_LINKER_FLAGS for onecoreuap toolchain

* Fixed ENABLE_FASTER_BUILD mode on Android

* Cosmetic fix

* Fixed fuzzing

* Enabled fuzzing
2020-12-27 00:02:50 +03:00
Ilya Lavrenov
9465073f58 Introduce IEDevScripts package (#3661)
* Refactored developer package

* Added fuzzing for CMAKE_MODULE_LINKER_FLAGS as well

* Added options for developer package

* More improvements

* Further improvements

* Removed global CMAKE_MODULE_PATH population

* Fixes

* Final fixes

* Fixed python build

* Fix for TBB

* Fixed Find TBB

* Fixed install

* Fixes for OV features

* Split developer targets per component

* Fixed IE build tree config

* Fixed ITT

* Fixed review comments

* Clean export dependencies

* Fixed export of pugixml

* Added IEDevScripts_DIR for Android

* Fixed Android #2

* Fixed Android #3

* Fixed python cc

* Disabled Core threading tests on GNA
2020-12-22 18:44:59 +03:00