Commit Graph

122 Commits

Author SHA1 Message Date
Alexander Shchepetov
b0c508d4ff Add layer tests (#5789)
Co-authored-by: alexander.shchepetov <ashchepe@nnlvdp-cflr51.inn.intel.com>
2021-06-16 12:50:16 +03:00
Andrey Somsikov
fb7435a647 Add cnpy fuzz test and fix issues (#6109) 2021-06-14 17:00:49 +03:00
Victor Kuznetsov
089f76cc7f Add branch field to submit to DB in MemCheck/TimeTests (#6073) 2021-06-11 12:57:01 +03:00
Alexander Shchepetov
503d18c80f Enable MYRIAD in stress tests (#6026) 2021-06-08 12:47:20 +03:00
Vitaliy Urusovskij
291a80c84a Make stress and time tests build dependent from gflags from samples (#5883)
* Make timetests dependent on IE gflags 3rdparty from samples/

* Make stress tests dependent on IE gflags 3rdparty from samples/
2021-06-04 10:27:23 +03:00
Alexander Shchepetov
d25e149f76 Conditional compilation test can run from open source (#5629) 2021-05-26 11:43:59 +03:00
Vitaliy Urusovskij
97a9a76ff9 Fix parsing of threads in stress/memory tests (#5695)
* Fix parsing of threads in stress/memory tests

* Replace `char*` with `string` due `char*` can't be modified
2021-05-26 02:04:06 +03:00
Anastasiya Koryachikhina
0e86b095cc Add Inference with streams in MemCheckTests (#5608) 2021-05-26 01:01:51 +03:00
Victor Kuznetsov
af915859e3 Add float instance to time_tests parse_stats (#5726) 2021-05-21 11:12:05 +03:00
Vitaliy Urusovskij
dcd27f0776 Actualize stress tests README (#5698) 2021-05-20 14:43:48 +03:00
Victor Kuznetsov
c907fb9f52 Log have time measures nested (#5402) 2021-05-18 18:00:10 +03:00
Gorokhov Dmitriy
a19413c0c0 [CPU] Plugin migration on ngraph (#4344) 2021-05-06 19:49:24 +03:00
Victor Kuznetsov
4790c79eb4 Add time_tests dir path to sys.path (#5498) 2021-05-06 14:57:50 +03:00
Victor Kuznetsov
5834eef8f0 Change model_path to model_name in timeline report (#5457) 2021-05-06 11:54:16 +03:00
Olesya Martinyuk
d16c215fde Add CPU info to time tests (#5451) 2021-05-04 14:49:10 +03:00
Vitaliy Urusovskij
68ed12cb98 Enable FetchContent for gflags dependency in stress tests (#5449)
* Enable `FetchContent` for `gflags` dependency in stress tests

* Add `HAVE_SYS_STAT_H`, `HAVE_INTTYPES_H`, `INTTYPES_FORMAT` for stress tests
2021-04-29 14:44:12 +03:00
Victor Kuznetsov
e121fbd7de Add int8 models to memcheck tests (#5333) 2021-04-23 12:56:59 +03:00
Vitaliy Urusovskij
ed0b66f31d Fix timeline report for MemCheck by querying target instead of current branch (#5350) 2021-04-22 15:51:35 +03:00
Vitaliy Urusovskij
db2de2fb19 Fix time_tests runs when models_cache enabled (#5265)
* Set ``"additionalProperties": true` to enable 'use_model_cache' in time_tests

* Limit tests scope in desktop_test_config_cache.yml
2021-04-17 00:12:08 +03:00
Vitaliy Urusovskij
c852634055 Remove comparison with references from time_tests as unused (#5248)
* Remove comparison with references from time_tests as unused

* Remove `--dump_refs` from time_tests as unused
2021-04-15 22:24:45 +03:00
Vitaliy Urusovskij
a70d13f9e2 Add support of IE model cache in time_tests (#5192) 2021-04-15 00:11:48 +03:00
Olesya Martinyuk
070201feee Added test validating inference results after conditional compilation (#4840) 2021-04-13 22:16:14 +03:00
Vitaliy Urusovskij
634dc42808 Enable new infer_request_inference memleak test to cover *-52623 (#5183) 2021-04-12 20:00:11 +03:00
Alexander Shchepetov
e864972f83 Add experiments timings to data to submit to DB(#5108) 2021-04-12 09:29:10 +03:00
Mikhail Nosov
ca99333982 [TimeTests] Add test case for testing first time inference with caching enabled (#4933)
Important note: Invoker (e.g. test_timetest.py) must ignore first measurement when cache is not generated
2021-04-07 17:04:45 +03:00
Victor Kuznetsov
69a06f5977 Remove time-tests outliers using Inter Quartile Range (IQR) (#5014)
Change number of times to execute binary to aggregate statistics from 3 to 10.
2021-04-02 11:35:38 +03:00
Taylor Yeonbok Lee
b58c648d2d [IE CLDNN] Build time optimization for OCL kernels (#4725)
Build OCL kernel batches of different buckets in parallel

Co-authored-by: Donghyeon Jeong <donghyeon.jeong@intel.com>
2021-03-31 10:22:19 +03:00
Victor Kuznetsov
83ec2d321a Add json file with tests ids to CC tests (#4425) 2021-03-30 15:31:40 +03:00
Alexey Suhov
a2bf62f488 Align copyright notice in sh, bat, cl, cc, pyx source files (#4995) 2021-03-27 01:26:27 +03:00
Alexey Suhov
6478f1742a Align copyright notice in python scripts (CVS-51320) (#4974)
* Align copyright notice in python scripts (CVS-51320)
2021-03-26 17:54:28 +03:00
Alexey Suhov
a748c26fee Align copyright notice in cpp and cmake source files (CVS-51320) (#4950) 2021-03-25 02:40:09 +03:00
Anton Pankratv
3b3d9a0989 Used IE_THROW macro (#4869)
* Added ie throw macro

* Used IE_THROW macro
2021-03-23 18:57:12 +03:00
Anton Pankratv
a2b8b974b8 Simplified IE Exceptions Implementation (#4258) 2021-03-18 16:30:16 +03:00
Ilya Sharikov
a382934a80 Added test for checking lib sizes, when using conditional compilation option (#4292) 2021-03-17 17:56:47 +03:00
Ilya Lavrenov
24fb09edb3 Improvements in cmake scripts (#4766)
1. Find Threads only once in IEDevScripts package
2. Small refactoring in IE Dev Package
2021-03-15 13:07:38 +03:00
Victor Kuznetsov
3a703d546c [Stress] MemCheck add FP16 models to configs (#4503) 2021-03-12 01:14:40 +03:00
Andrey Somsikov
7f8d3aa638 Catch std::except in fuzz tests (#4610)
Fuzz tests must catch all expected exceptions from IE. IE is using C++ std
library which may raise standard exceptions which IE pass through.
2021-03-06 13:06:40 +03:00
Victor Kuznetsov
1fef41d083 Fix reference config for MemCheckTests (#4587) 2021-03-04 15:15:07 +03:00
Andrey Somsikov
dcce0f549c Add LeakSanitizer default suppressions list (#4473) 2021-02-26 06:32:42 +03:00
Andrey Somsikov
0646219f3e Translate app failures from cond comp tests (#4393) 2021-02-24 22:54:37 +03:00
Victor Kuznetsov
7ba9723242 [Stress] Add precision field to MemCheck configs (#4362) 2021-02-24 14:56:09 +03:00
Olesya Martinyuk
61f1950997 Infer tool code style patch (#4429)
* Moved input preparation to another function, cleared argparse, minor code improvements

* Minor changes in function description
2021-02-20 12:19:18 +03:00
Olesya Martinyuk
0c22a9e111 Add infer tool for cond compilation test(#4384) 2021-02-18 21:38:52 +03:00
Andrey Somsikov
4f79d9ccfc Force test use bash for setupvars.sh (#4321)
setupvars.sh is incomatible with sh shell.
2021-02-15 13:07:17 +03:00
Andrey Somsikov
9d57d4f52c Fix cond comp environment setup (#4290)
source command may not be available in sh.
2021-02-11 21:29:46 +03:00
Victor Kuznetsov
1da8f65b45 Add removing of statistics file in time_tests (#4275) 2021-02-11 12:02:39 +03:00
Andrey Somsikov
8da7f22f1d Activate OV environment from cond comp test_infer (#4244) 2021-02-11 09:59:37 +03:00
Victor Kuznetsov
73f846648c change tempfile usage (#4245) 2021-02-10 10:23:31 +03:00
Vitaliy Urusovskij
ba5da4231f Remove use of -f key which isn't defined in openvino/**/sea_runtool.py (#4257) 2021-02-10 08:53:11 +03:00
Victor Kuznetsov
a6d9842152 mv getBatchSize to cnnNetwork scope (#4231) 2021-02-09 10:47:44 +03:00