Commit Graph
117 Commits
Author SHA1 Message Date
Alexander Shchepetov d25e149f76 Conditional compilation test can run from open source (#5629) 2021-05-26 11:43:59 +03:00
Vitaliy Urusovskij 97a9a76ff9 Fix parsing of threads in stress/memory tests (#5695)
* Fix parsing of threads in stress/memory tests

* Replace `char*` with `string` due `char*` can't be modified
2021-05-26 02:04:06 +03:00
Anastasiya Koryachikhina 0e86b095cc Add Inference with streams in MemCheckTests (#5608) 2021-05-26 01:01:51 +03:00
Victor Kuznetsov af915859e3 Add float instance to time_tests parse_stats (#5726) 2021-05-21 11:12:05 +03:00
Vitaliy Urusovskij dcd27f0776 Actualize stress tests README (#5698) 2021-05-20 14:43:48 +03:00
Victor Kuznetsov c907fb9f52 Log have time measures nested (#5402) 2021-05-18 18:00:10 +03:00
Gorokhov Dmitriy a19413c0c0 [CPU] Plugin migration on ngraph (#4344) 2021-05-06 19:49:24 +03:00
Victor Kuznetsov 4790c79eb4 Add time_tests dir path to sys.path (#5498) 2021-05-06 14:57:50 +03:00
Victor Kuznetsov 5834eef8f0 Change model_path to model_name in timeline report (#5457) 2021-05-06 11:54:16 +03:00
Olesya Martinyuk d16c215fde Add CPU info to time tests (#5451) 2021-05-04 14:49:10 +03:00
Vitaliy Urusovskij 68ed12cb98 Enable FetchContent for gflags dependency in stress tests (#5449)
* Enable `FetchContent` for `gflags` dependency in stress tests

* Add `HAVE_SYS_STAT_H`, `HAVE_INTTYPES_H`, `INTTYPES_FORMAT` for stress tests
2021-04-29 14:44:12 +03:00
Victor Kuznetsov e121fbd7de Add int8 models to memcheck tests (#5333) 2021-04-23 12:56:59 +03:00
Vitaliy Urusovskij ed0b66f31d Fix timeline report for MemCheck by querying target instead of current branch (#5350) 2021-04-22 15:51:35 +03:00
Vitaliy Urusovskij db2de2fb19 Fix time_tests runs when models_cache enabled (#5265)
* Set ``"additionalProperties": true` to enable 'use_model_cache' in time_tests

* Limit tests scope in desktop_test_config_cache.yml
2021-04-17 00:12:08 +03:00
Vitaliy Urusovskij c852634055 Remove comparison with references from time_tests as unused (#5248)
* Remove comparison with references from time_tests as unused

* Remove `--dump_refs` from time_tests as unused
2021-04-15 22:24:45 +03:00
Vitaliy Urusovskij a70d13f9e2 Add support of IE model cache in time_tests (#5192) 2021-04-15 00:11:48 +03:00
Olesya Martinyuk 070201feee Added test validating inference results after conditional compilation (#4840) 2021-04-13 22:16:14 +03:00
Vitaliy Urusovskij 634dc42808 Enable new infer_request_inference memleak test to cover *-52623 (#5183) 2021-04-12 20:00:11 +03:00
Alexander Shchepetov e864972f83 Add experiments timings to data to submit to DB(#5108) 2021-04-12 09:29:10 +03:00
Mikhail Nosov ca99333982 [TimeTests] Add test case for testing first time inference with caching enabled (#4933)
Important note: Invoker (e.g. test_timetest.py) must ignore first measurement when cache is not generated
2021-04-07 17:04:45 +03:00
Victor Kuznetsov 69a06f5977 Remove time-tests outliers using Inter Quartile Range (IQR) (#5014)
Change number of times to execute binary to aggregate statistics from 3 to 10.
2021-04-02 11:35:38 +03:00
Taylor Yeonbok LeeandDonghyeon Jeong b58c648d2d [IE CLDNN] Build time optimization for OCL kernels (#4725)
Build OCL kernel batches of different buckets in parallel

Co-authored-by: Donghyeon Jeong <donghyeon.jeong@intel.com>
2021-03-31 10:22:19 +03:00
Victor Kuznetsov 83ec2d321a Add json file with tests ids to CC tests (#4425) 2021-03-30 15:31:40 +03:00
Alexey Suhov a2bf62f488 Align copyright notice in sh, bat, cl, cc, pyx source files (#4995) 2021-03-27 01:26:27 +03:00
Alexey Suhov 6478f1742a Align copyright notice in python scripts (CVS-51320) (#4974)
* Align copyright notice in python scripts (CVS-51320)
2021-03-26 17:54:28 +03:00
Alexey Suhov a748c26fee Align copyright notice in cpp and cmake source files (CVS-51320) (#4950) 2021-03-25 02:40:09 +03:00
Anton Pankratv 3b3d9a0989 Used IE_THROW macro (#4869)
* Added ie throw macro

* Used IE_THROW macro
2021-03-23 18:57:12 +03:00
Anton Pankratv a2b8b974b8 Simplified IE Exceptions Implementation (#4258) 2021-03-18 16:30:16 +03:00
Ilya Sharikov a382934a80 Added test for checking lib sizes, when using conditional compilation option (#4292) 2021-03-17 17:56:47 +03:00
Ilya Lavrenov 24fb09edb3 Improvements in cmake scripts (#4766)
1. Find Threads only once in IEDevScripts package
2. Small refactoring in IE Dev Package
2021-03-15 13:07:38 +03:00
Victor Kuznetsov 3a703d546c [Stress] MemCheck add FP16 models to configs (#4503) 2021-03-12 01:14:40 +03:00
Andrey Somsikov 7f8d3aa638 Catch std::except in fuzz tests (#4610)
Fuzz tests must catch all expected exceptions from IE. IE is using C++ std
library which may raise standard exceptions which IE pass through.
2021-03-06 13:06:40 +03:00
Victor Kuznetsov 1fef41d083 Fix reference config for MemCheckTests (#4587) 2021-03-04 15:15:07 +03:00
Andrey Somsikov dcce0f549c Add LeakSanitizer default suppressions list (#4473) 2021-02-26 06:32:42 +03:00
Andrey Somsikov 0646219f3e Translate app failures from cond comp tests (#4393) 2021-02-24 22:54:37 +03:00
Victor Kuznetsov 7ba9723242 [Stress] Add precision field to MemCheck configs (#4362) 2021-02-24 14:56:09 +03:00
Olesya Martinyuk 61f1950997 Infer tool code style patch (#4429)
* Moved input preparation to another function, cleared argparse, minor code improvements

* Minor changes in function description
2021-02-20 12:19:18 +03:00
Olesya Martinyuk 0c22a9e111 Add infer tool for cond compilation test(#4384) 2021-02-18 21:38:52 +03:00
Andrey Somsikov 4f79d9ccfc Force test use bash for setupvars.sh (#4321)
setupvars.sh is incomatible with sh shell.
2021-02-15 13:07:17 +03:00
Andrey Somsikov 9d57d4f52c Fix cond comp environment setup (#4290)
source command may not be available in sh.
2021-02-11 21:29:46 +03:00
Victor Kuznetsov 1da8f65b45 Add removing of statistics file in time_tests (#4275) 2021-02-11 12:02:39 +03:00
Andrey Somsikov 8da7f22f1d Activate OV environment from cond comp test_infer (#4244) 2021-02-11 09:59:37 +03:00
Victor Kuznetsov 73f846648c change tempfile usage (#4245) 2021-02-10 10:23:31 +03:00
Vitaliy Urusovskij ba5da4231f Remove use of -f key which isn't defined in openvino/**/sea_runtool.py (#4257) 2021-02-10 08:53:11 +03:00
Victor Kuznetsov a6d9842152 mv getBatchSize to cnnNetwork scope (#4231) 2021-02-09 10:47:44 +03:00
Andrey Somsikov db065d525e Fix cond comp artifacts path (#4200) 2021-02-08 11:18:27 +03:00
Andrey Somsikov 9b5b2bb002 Add collector path for cond. comp. tests (#4159) 2021-02-04 10:35:24 +03:00
Andrey Somsikov 359c2ca018 Upgrade pyyaml to the latest (#4134) 2021-02-03 07:07:01 +03:00
Ilya Lavrenov 685bf830d5 Fixed cldnn compilation with static runtime (#4070) 2021-02-02 20:11:40 +03:00
Vitaliy Urusovskij 8abbfbc855 Design test config and integrate in CC tests (#4051) 2021-01-29 16:54:19 +03:00