Victor Kuznetsov
69a06f5977
Remove time-tests outliers using Inter Quartile Range (IQR) ( #5014 )
...
Change number of times to execute binary to aggregate statistics from 3 to 10.
2021-04-02 11:35:38 +03:00
Taylor Yeonbok Lee
b58c648d2d
[IE CLDNN] Build time optimization for OCL kernels ( #4725 )
...
Build OCL kernel batches of different buckets in parallel
Co-authored-by: Donghyeon Jeong <donghyeon.jeong@intel.com >
2021-03-31 10:22:19 +03:00
Victor Kuznetsov
83ec2d321a
Add json file with tests ids to CC tests ( #4425 )
2021-03-30 15:31:40 +03:00
Alexey Suhov
a2bf62f488
Align copyright notice in sh, bat, cl, cc, pyx source files ( #4995 )
2021-03-27 01:26:27 +03:00
Alexey Suhov
6478f1742a
Align copyright notice in python scripts (CVS-51320) ( #4974 )
...
* Align copyright notice in python scripts (CVS-51320)
2021-03-26 17:54:28 +03:00
Alexey Suhov
a748c26fee
Align copyright notice in cpp and cmake source files (CVS-51320) ( #4950 )
2021-03-25 02:40:09 +03:00
Anton Pankratv
3b3d9a0989
Used IE_THROW macro ( #4869 )
...
* Added ie throw macro
* Used IE_THROW macro
2021-03-23 18:57:12 +03:00
Anton Pankratv
a2b8b974b8
Simplified IE Exceptions Implementation ( #4258 )
2021-03-18 16:30:16 +03:00
Ilya Sharikov
a382934a80
Added test for checking lib sizes, when using conditional compilation option ( #4292 )
2021-03-17 17:56:47 +03:00
Ilya Lavrenov
24fb09edb3
Improvements in cmake scripts ( #4766 )
...
1. Find Threads only once in IEDevScripts package
2. Small refactoring in IE Dev Package
2021-03-15 13:07:38 +03:00
Victor Kuznetsov
3a703d546c
[Stress] MemCheck add FP16 models to configs ( #4503 )
2021-03-12 01:14:40 +03:00
Andrey Somsikov
7f8d3aa638
Catch std::except in fuzz tests ( #4610 )
...
Fuzz tests must catch all expected exceptions from IE. IE is using C++ std
library which may raise standard exceptions which IE pass through.
2021-03-06 13:06:40 +03:00
Victor Kuznetsov
1fef41d083
Fix reference config for MemCheckTests ( #4587 )
2021-03-04 15:15:07 +03:00
Andrey Somsikov
dcce0f549c
Add LeakSanitizer default suppressions list ( #4473 )
2021-02-26 06:32:42 +03:00
Andrey Somsikov
0646219f3e
Translate app failures from cond comp tests ( #4393 )
2021-02-24 22:54:37 +03:00
Victor Kuznetsov
7ba9723242
[Stress] Add precision field to MemCheck configs ( #4362 )
2021-02-24 14:56:09 +03:00
Olesya Martinyuk
61f1950997
Infer tool code style patch ( #4429 )
...
* Moved input preparation to another function, cleared argparse, minor code improvements
* Minor changes in function description
2021-02-20 12:19:18 +03:00
Olesya Martinyuk
0c22a9e111
Add infer tool for cond compilation test( #4384 )
2021-02-18 21:38:52 +03:00
Andrey Somsikov
4f79d9ccfc
Force test use bash for setupvars.sh ( #4321 )
...
setupvars.sh is incomatible with sh shell.
2021-02-15 13:07:17 +03:00
Andrey Somsikov
9d57d4f52c
Fix cond comp environment setup ( #4290 )
...
source command may not be available in sh.
2021-02-11 21:29:46 +03:00
Victor Kuznetsov
1da8f65b45
Add removing of statistics file in time_tests ( #4275 )
2021-02-11 12:02:39 +03:00
Andrey Somsikov
8da7f22f1d
Activate OV environment from cond comp test_infer ( #4244 )
2021-02-11 09:59:37 +03:00
Victor Kuznetsov
73f846648c
change tempfile usage ( #4245 )
2021-02-10 10:23:31 +03:00
Vitaliy Urusovskij
ba5da4231f
Remove use of -f key which isn't defined in openvino/**/sea_runtool.py ( #4257 )
2021-02-10 08:53:11 +03:00
Victor Kuznetsov
a6d9842152
mv getBatchSize to cnnNetwork scope ( #4231 )
2021-02-09 10:47:44 +03:00
Andrey Somsikov
db065d525e
Fix cond comp artifacts path ( #4200 )
2021-02-08 11:18:27 +03:00
Andrey Somsikov
9b5b2bb002
Add collector path for cond. comp. tests ( #4159 )
2021-02-04 10:35:24 +03:00
Andrey Somsikov
359c2ca018
Upgrade pyyaml to the latest ( #4134 )
2021-02-03 07:07:01 +03:00
Ilya Lavrenov
685bf830d5
Fixed cldnn compilation with static runtime ( #4070 )
2021-02-02 20:11:40 +03:00
Vitaliy Urusovskij
8abbfbc855
Design test config and integrate in CC tests ( #4051 )
2021-01-29 16:54:19 +03:00
Andrey Somsikov
81da815dd8
Add conditional compilation tests ( #3996 )
2021-01-28 13:27:07 +03:00
Victor Kuznetsov
1217d26f2f
rename time test config ( #3923 )
2021-01-21 12:32:15 +03:00
Vitaliy Urusovskij
1e858830e2
Change json.loads to json.load for --db_metadata ( #3871 )
2021-01-19 18:33:00 +03:00
Ilya Lavrenov
50f9dd8a6b
Enabled CMP0025 as NEW ( #3791 )
2021-01-11 14:48:27 +03:00
Vitaliy Urusovskij
08f54dbac8
Fix metadata_from_manifest() according to new manifest version ( #3771 )
2020-12-31 09:57:58 +03:00
Vitaliy Urusovskij
fe229ba19d
Move time_tests to new manifest version ( #3759 )
2020-12-30 17:28:22 +03:00
Ilya Lavrenov
278b662e56
Removed global CMAKE_MODULE_PATH in IE DevPackage ( #3747 )
...
* Cleanup
* Added CMAKE_MODULE_LINKER_FLAGS for onecoreuap toolchain
* Fixed ENABLE_FASTER_BUILD mode on Android
* Cosmetic fix
* Fixed fuzzing
* Enabled fuzzing
2020-12-27 00:02:50 +03:00
Ilya Lavrenov
9465073f58
Introduce IEDevScripts package ( #3661 )
...
* Refactored developer package
* Added fuzzing for CMAKE_MODULE_LINKER_FLAGS as well
* Added options for developer package
* More improvements
* Further improvements
* Removed global CMAKE_MODULE_PATH population
* Fixes
* Final fixes
* Fixed python build
* Fix for TBB
* Fixed Find TBB
* Fixed install
* Fixes for OV features
* Split developer targets per component
* Fixed IE build tree config
* Fixed ITT
* Fixed review comments
* Clean export dependencies
* Fixed export of pugixml
* Added IEDevScripts_DIR for Android
* Fixed Android #2
* Fixed Android #3
* Fixed python cc
* Disabled Core threading tests on GNA
2020-12-22 18:44:59 +03:00
Andrey Somsikov
7fe21dc6ee
Fix windows build for gflags for time_tests ( #3504 )
...
GFlags builds multiple targets, require aligning build
options on windows builds.
FetchModule offloads project configuration to cmake. This also allows
to align build configurations and targets across projects:
https://crascit.com/2015/07/25/cmake-gtest/
2020-12-11 09:25:14 +03:00
Andrey Somsikov
5cc08367b2
Build time_tests with OpenVINO install ( #3484 )
2020-12-07 12:56:37 +03:00
Vitaliy Urusovskij
e910902c9d
Fix paths for squeezenet1.1 in time_tests config ( #3415 )
2020-11-30 18:45:08 +03:00
Vitaliy Urusovskij
364bf08920
Add several new models to tgl_test_config.yml in time_tests ( #3268 )
...
* Fix wrong path for `yolo-v2-tiny-ava-0001` for time_tests
* Add several new models to `tgl_test_config.yml` in time_tests
2020-11-24 13:26:16 +03:00
Vitaliy Urusovskij
4bfb353dbd
Add fillBlobs to fix issue with negative values in image_info input layer ( #3271 )
2020-11-23 17:32:49 +03:00
Vitaliy Urusovskij
9f427bbf6e
Add WA for OMZ Keras models in stress tests ( #3272 )
2020-11-23 17:32:35 +03:00
Vitaliy Urusovskij
dee00cdc92
Add new model to tgl_test_config.yml ( #3236 )
2020-11-20 13:33:57 +03:00
Vitaliy Urusovskij
b5930eb58e
Fix "results" uploading to DB in time_tests ( #3215 )
2020-11-20 10:49:31 +03:00
Vitaliy Urusovskij
070fc17087
Extend information to submit to a DB in time_tests ( #3018 )
...
* Optimize imports in time_tests conftest.py
* Extend information to submit to a DB in time_tests:
1. Add `--manifest` and `--db_metadata` CLI keys
2. Add `prepare_db_info` fixture
* Move `validate_test_case` fixture to a const schema, remove extra checks
* Add `manifest_metadata` fixture to parse and validate manifest only once
* Add OS utils to submit os info to DB
2020-11-17 12:07:40 +03:00
Vitaliy Urusovskij
0ef1fb8a09
Update MemCheckTests OMZ part: get_testdata.py and configs ( #2722 )
2020-10-30 00:37:02 +03:00
Vitaliy Urusovskij
e1f4585cb8
Add validate_test_case fixture with using of jsonschema. Specify all required fields for test cases ( #2821 )
2020-10-29 00:11:01 +03:00
Vitaliy Urusovskij
3c5aefb427
Remove memcheck_pregen_irs_tests MemCheck configs due obsolescence ( #2693 )
2020-10-19 09:48:38 +03:00