Ilya Sharikov
3a28ffaf57
Updated path to gflags ( #7200 )
2021-08-24 13:57:40 +03:00
Victor Kuznetsov
b76c903745
add pytest html ( #7169 )
2021-08-20 16:58:39 +03:00
Victor Kuznetsov
dad76527d6
fixed several issues in time tests ( #7059 )
...
* Fixed return in run_timetest
* Fixed parse_stats() argument type notation
* Pass message from timetest exe to test error msg to be uploaded to DB
2021-08-18 13:15:58 +03:00
Vitaliy Urusovskij
bfdd1a199f
Develop installation rules for time and stress tests ( #6649 ) ( #6738 )
...
* Develop installation rules for time and stress tests (#6649 )
* Prepare `install` rule for time_tests
* Prepare `install` rule for stress tests
* Update path to `gflags`
2021-07-22 10:43:15 +03:00
Victor Kuznetsov
204c4ba79a
add target branch condition (fix null value) ( #6467 )
2021-06-30 17:52:55 +03:00
Ilya Lavrenov
7a316dcde3
Fixed links to OMZ / DL Streamer ( #6257 )
2021-06-21 11:29:54 +03:00
Andrey Somsikov
0accd09c45
Add cnpy fuzz test and fix issues ( #6109 ) ( #6159 )
2021-06-15 11:05:10 +00:00
Alexander Shchepetov
503d18c80f
Enable MYRIAD in stress tests ( #6026 )
2021-06-08 12:47:20 +03:00
Vitaliy Urusovskij
291a80c84a
Make stress and time tests build dependent from gflags from samples ( #5883 )
...
* Make timetests dependent on IE gflags 3rdparty from samples/
* Make stress tests dependent on IE gflags 3rdparty from samples/
2021-06-04 10:27:23 +03:00
Alexander Shchepetov
d25e149f76
Conditional compilation test can run from open source ( #5629 )
2021-05-26 11:43:59 +03:00
Vitaliy Urusovskij
97a9a76ff9
Fix parsing of threads in stress/memory tests ( #5695 )
...
* Fix parsing of threads in stress/memory tests
* Replace `char*` with `string` due `char*` can't be modified
2021-05-26 02:04:06 +03:00
Anastasiya Koryachikhina
0e86b095cc
Add Inference with streams in MemCheckTests ( #5608 )
2021-05-26 01:01:51 +03:00
Victor Kuznetsov
af915859e3
Add float instance to time_tests parse_stats ( #5726 )
2021-05-21 11:12:05 +03:00
Vitaliy Urusovskij
dcd27f0776
Actualize stress tests README ( #5698 )
2021-05-20 14:43:48 +03:00
Victor Kuznetsov
c907fb9f52
Log have time measures nested ( #5402 )
2021-05-18 18:00:10 +03:00
Gorokhov Dmitriy
a19413c0c0
[CPU] Plugin migration on ngraph ( #4344 )
2021-05-06 19:49:24 +03:00
Victor Kuznetsov
4790c79eb4
Add time_tests dir path to sys.path ( #5498 )
2021-05-06 14:57:50 +03:00
Victor Kuznetsov
5834eef8f0
Change model_path to model_name in timeline report ( #5457 )
2021-05-06 11:54:16 +03:00
Olesya Martinyuk
d16c215fde
Add CPU info to time tests ( #5451 )
2021-05-04 14:49:10 +03:00
Vitaliy Urusovskij
68ed12cb98
Enable FetchContent for gflags dependency in stress tests ( #5449 )
...
* Enable `FetchContent` for `gflags` dependency in stress tests
* Add `HAVE_SYS_STAT_H`, `HAVE_INTTYPES_H`, `INTTYPES_FORMAT` for stress tests
2021-04-29 14:44:12 +03:00
Victor Kuznetsov
e121fbd7de
Add int8 models to memcheck tests ( #5333 )
2021-04-23 12:56:59 +03:00
Vitaliy Urusovskij
ed0b66f31d
Fix timeline report for MemCheck by querying target instead of current branch ( #5350 )
2021-04-22 15:51:35 +03:00
Vitaliy Urusovskij
db2de2fb19
Fix time_tests runs when models_cache enabled ( #5265 )
...
* Set ``"additionalProperties": true` to enable 'use_model_cache' in time_tests
* Limit tests scope in desktop_test_config_cache.yml
2021-04-17 00:12:08 +03:00
Vitaliy Urusovskij
c852634055
Remove comparison with references from time_tests as unused ( #5248 )
...
* Remove comparison with references from time_tests as unused
* Remove `--dump_refs` from time_tests as unused
2021-04-15 22:24:45 +03:00
Vitaliy Urusovskij
a70d13f9e2
Add support of IE model cache in time_tests ( #5192 )
2021-04-15 00:11:48 +03:00
Olesya Martinyuk
070201feee
Added test validating inference results after conditional compilation ( #4840 )
2021-04-13 22:16:14 +03:00
Vitaliy Urusovskij
634dc42808
Enable new infer_request_inference memleak test to cover *-52623 ( #5183 )
2021-04-12 20:00:11 +03:00
Alexander Shchepetov
e864972f83
Add experiments timings to data to submit to DB( #5108 )
2021-04-12 09:29:10 +03:00
Mikhail Nosov
ca99333982
[TimeTests] Add test case for testing first time inference with caching enabled ( #4933 )
...
Important note: Invoker (e.g. test_timetest.py) must ignore first measurement when cache is not generated
2021-04-07 17:04:45 +03:00
Victor Kuznetsov
69a06f5977
Remove time-tests outliers using Inter Quartile Range (IQR) ( #5014 )
...
Change number of times to execute binary to aggregate statistics from 3 to 10.
2021-04-02 11:35:38 +03:00
Taylor Yeonbok Lee
b58c648d2d
[IE CLDNN] Build time optimization for OCL kernels ( #4725 )
...
Build OCL kernel batches of different buckets in parallel
Co-authored-by: Donghyeon Jeong <donghyeon.jeong@intel.com >
2021-03-31 10:22:19 +03:00
Victor Kuznetsov
83ec2d321a
Add json file with tests ids to CC tests ( #4425 )
2021-03-30 15:31:40 +03:00
Alexey Suhov
a2bf62f488
Align copyright notice in sh, bat, cl, cc, pyx source files ( #4995 )
2021-03-27 01:26:27 +03:00
Alexey Suhov
6478f1742a
Align copyright notice in python scripts (CVS-51320) ( #4974 )
...
* Align copyright notice in python scripts (CVS-51320)
2021-03-26 17:54:28 +03:00
Alexey Suhov
a748c26fee
Align copyright notice in cpp and cmake source files (CVS-51320) ( #4950 )
2021-03-25 02:40:09 +03:00
Anton Pankratv
3b3d9a0989
Used IE_THROW macro ( #4869 )
...
* Added ie throw macro
* Used IE_THROW macro
2021-03-23 18:57:12 +03:00
Anton Pankratv
a2b8b974b8
Simplified IE Exceptions Implementation ( #4258 )
2021-03-18 16:30:16 +03:00
Ilya Sharikov
a382934a80
Added test for checking lib sizes, when using conditional compilation option ( #4292 )
2021-03-17 17:56:47 +03:00
Ilya Lavrenov
24fb09edb3
Improvements in cmake scripts ( #4766 )
...
1. Find Threads only once in IEDevScripts package
2. Small refactoring in IE Dev Package
2021-03-15 13:07:38 +03:00
Victor Kuznetsov
3a703d546c
[Stress] MemCheck add FP16 models to configs ( #4503 )
2021-03-12 01:14:40 +03:00
Andrey Somsikov
7f8d3aa638
Catch std::except in fuzz tests ( #4610 )
...
Fuzz tests must catch all expected exceptions from IE. IE is using C++ std
library which may raise standard exceptions which IE pass through.
2021-03-06 13:06:40 +03:00
Victor Kuznetsov
1fef41d083
Fix reference config for MemCheckTests ( #4587 )
2021-03-04 15:15:07 +03:00
Andrey Somsikov
dcce0f549c
Add LeakSanitizer default suppressions list ( #4473 )
2021-02-26 06:32:42 +03:00
Andrey Somsikov
0646219f3e
Translate app failures from cond comp tests ( #4393 )
2021-02-24 22:54:37 +03:00
Victor Kuznetsov
7ba9723242
[Stress] Add precision field to MemCheck configs ( #4362 )
2021-02-24 14:56:09 +03:00
Olesya Martinyuk
61f1950997
Infer tool code style patch ( #4429 )
...
* Moved input preparation to another function, cleared argparse, minor code improvements
* Minor changes in function description
2021-02-20 12:19:18 +03:00
Olesya Martinyuk
0c22a9e111
Add infer tool for cond compilation test( #4384 )
2021-02-18 21:38:52 +03:00
Andrey Somsikov
4f79d9ccfc
Force test use bash for setupvars.sh ( #4321 )
...
setupvars.sh is incomatible with sh shell.
2021-02-15 13:07:17 +03:00
Andrey Somsikov
9d57d4f52c
Fix cond comp environment setup ( #4290 )
...
source command may not be available in sh.
2021-02-11 21:29:46 +03:00
Victor Kuznetsov
1da8f65b45
Add removing of statistics file in time_tests ( #4275 )
2021-02-11 12:02:39 +03:00