Commit Graph

55 Commits

Author SHA1 Message Date
Victor Kuznetsov
089f76cc7f Add branch field to submit to DB in MemCheck/TimeTests (#6073) 2021-06-11 12:57:01 +03:00
Alexander Shchepetov
503d18c80f Enable MYRIAD in stress tests (#6026) 2021-06-08 12:47:20 +03:00
Vitaliy Urusovskij
291a80c84a Make stress and time tests build dependent from gflags from samples (#5883)
* Make timetests dependent on IE gflags 3rdparty from samples/

* Make stress tests dependent on IE gflags 3rdparty from samples/
2021-06-04 10:27:23 +03:00
Vitaliy Urusovskij
97a9a76ff9 Fix parsing of threads in stress/memory tests (#5695)
* Fix parsing of threads in stress/memory tests

* Replace `char*` with `string` due `char*` can't be modified
2021-05-26 02:04:06 +03:00
Anastasiya Koryachikhina
0e86b095cc Add Inference with streams in MemCheckTests (#5608) 2021-05-26 01:01:51 +03:00
Vitaliy Urusovskij
dcd27f0776 Actualize stress tests README (#5698) 2021-05-20 14:43:48 +03:00
Gorokhov Dmitriy
a19413c0c0 [CPU] Plugin migration on ngraph (#4344) 2021-05-06 19:49:24 +03:00
Victor Kuznetsov
5834eef8f0 Change model_path to model_name in timeline report (#5457) 2021-05-06 11:54:16 +03:00
Vitaliy Urusovskij
68ed12cb98 Enable FetchContent for gflags dependency in stress tests (#5449)
* Enable `FetchContent` for `gflags` dependency in stress tests

* Add `HAVE_SYS_STAT_H`, `HAVE_INTTYPES_H`, `INTTYPES_FORMAT` for stress tests
2021-04-29 14:44:12 +03:00
Victor Kuznetsov
e121fbd7de Add int8 models to memcheck tests (#5333) 2021-04-23 12:56:59 +03:00
Vitaliy Urusovskij
ed0b66f31d Fix timeline report for MemCheck by querying target instead of current branch (#5350) 2021-04-22 15:51:35 +03:00
Vitaliy Urusovskij
634dc42808 Enable new infer_request_inference memleak test to cover *-52623 (#5183) 2021-04-12 20:00:11 +03:00
Taylor Yeonbok Lee
b58c648d2d [IE CLDNN] Build time optimization for OCL kernels (#4725)
Build OCL kernel batches of different buckets in parallel

Co-authored-by: Donghyeon Jeong <donghyeon.jeong@intel.com>
2021-03-31 10:22:19 +03:00
Alexey Suhov
6478f1742a Align copyright notice in python scripts (CVS-51320) (#4974)
* Align copyright notice in python scripts (CVS-51320)
2021-03-26 17:54:28 +03:00
Alexey Suhov
a748c26fee Align copyright notice in cpp and cmake source files (CVS-51320) (#4950) 2021-03-25 02:40:09 +03:00
Anton Pankratv
3b3d9a0989 Used IE_THROW macro (#4869)
* Added ie throw macro

* Used IE_THROW macro
2021-03-23 18:57:12 +03:00
Ilya Lavrenov
24fb09edb3 Improvements in cmake scripts (#4766)
1. Find Threads only once in IEDevScripts package
2. Small refactoring in IE Dev Package
2021-03-15 13:07:38 +03:00
Victor Kuznetsov
3a703d546c [Stress] MemCheck add FP16 models to configs (#4503) 2021-03-12 01:14:40 +03:00
Victor Kuznetsov
1fef41d083 Fix reference config for MemCheckTests (#4587) 2021-03-04 15:15:07 +03:00
Victor Kuznetsov
7ba9723242 [Stress] Add precision field to MemCheck configs (#4362) 2021-02-24 14:56:09 +03:00
Ilya Lavrenov
50f9dd8a6b Enabled CMP0025 as NEW (#3791) 2021-01-11 14:48:27 +03:00
Vitaliy Urusovskij
08f54dbac8 Fix metadata_from_manifest() according to new manifest version (#3771) 2020-12-31 09:57:58 +03:00
Vitaliy Urusovskij
4bfb353dbd Add fillBlobs to fix issue with negative values in image_info input layer (#3271) 2020-11-23 17:32:49 +03:00
Vitaliy Urusovskij
9f427bbf6e Add WA for OMZ Keras models in stress tests (#3272) 2020-11-23 17:32:35 +03:00
Vitaliy Urusovskij
0ef1fb8a09 Update MemCheckTests OMZ part: get_testdata.py and configs (#2722) 2020-10-30 00:37:02 +03:00
Vitaliy Urusovskij
3c5aefb427 Remove memcheck_pregen_irs_tests MemCheck configs due obsolescence (#2693) 2020-10-19 09:48:38 +03:00
Vitaliy Urusovskij
05d70cfa43 Remove --collect_results_only (#2509)
* Remove CLI keys from README

* Remove `--collect_results_only` from MemCheckTests
2020-10-05 17:43:24 +03:00
Evgeny Talanin
fe99e055f2 Bump cmake version to 3.13 (#2258) 2020-09-18 18:58:12 +03:00
Andrey Somsikov
b8a8fe7c0d Sort memcheck timeline report for failures (#2088) 2020-09-09 10:10:22 +03:00
Vitaliy Urusovskij
2386c5d376 [Stress] Define --timeout in run_memcheck.py used in gtest-parallel (#1576) 2020-08-05 12:33:01 +03:00
Vitaliy Urusovskij
f8513d8fd3 [Stress] Remove --env_conf at all after deprecation (#1582) 2020-08-03 12:58:27 +03:00
Vitaliy Urusovskij
25cadb661b [Stress] Enable OMZ info_dumper.py in get_testdata.py (#1485)
* [Stress] Support OMZ model_info.py in get_testdata.py

* [Stress] Copy IRs from OMZ models folder to IRs folder

* [Stress] Support modified configs in C++ tests

* [Stress] Deprecate support of --env_conf due refactoring of configs

* [Stress] Update configs:
1. Removed env configs due deprecation
2. Moved test configs to a new format

* [Stress] Extend MemCheck records with info from test config
2020-07-31 12:13:12 +03:00
Andrey Somsikov
9299e32df0 Add product version to memcheck records (#1508) 2020-07-30 10:17:56 +03:00
Vitaliy Urusovskij
6fcad95c71 [Stress] Redesign of MemCheckTests (#650)
* [Stress] Redesigned MemCheckTests: 1. Added MemCheckPipeline to incapsulate measures and logging. 2. Moved references to array

* [Stress] Added tracking of THREADS in MemCheckTests
2020-07-23 11:07:13 +03:00
Vitaliy Urusovskij
5665ec9b26 [Stress] Small improvement of scripts (#1302)
* [Stress] Extend CLI with arguments checks for compare_memcheck_2_runs.py

* [Stress] Extend requirements.txt with PyYAML
2020-07-22 10:24:15 +03:00
Vitaliy Urusovskij
57779511d6 [Stress] Integrate compare_memcheck_2_runs call in run_memcheck.py (#1036)
* [Stress] Define Database constant arguments in memcheck_upload.py only

* [Stress] Simplify computations using HashableDict in `compare_memcheck_2_runs`

* [Stress] Add comparison using pandas
2020-07-20 10:23:51 +03:00
Vitaliy Urusovskij
930d687ed9 [Stress] Specify OMZ develop branch in get_testdata.py (#1318)
Since in validation OMZ is used from a package (and OMZ is from develop branch), align OMZ default for get_testdata.py
2020-07-16 15:28:25 +03:00
Vitaliy Urusovskij
c0b28daf9c Fix MemCheckTests failures caused by change in OMZ models scope (#1214)
Run only models available in OMZ to prevent failures
Remove person-reidentification-retail-0031.xml from configs
2020-07-08 12:33:39 +03:00
Vitaliy Urusovskij
e085a04d8c [Stress] Move logging after all computations of progress_str (#1226) 2020-07-07 14:23:26 +03:00
Vitaliy Urusovskij
a17366f621 [Stress] Enable StressMemleaksTests on GPU in precommit (#1079)
* [Stress] Fix missing retry for StressMemLeaksTests

* [Stress] Add smoothing with sliding average for StressMemleaksTests

* [Stress] Enable GPU in StressMemleaksTests precommit scope
2020-07-03 11:57:16 +03:00
Vitaliy Urusovskij
0e904405f7 [Stress] Add --ref_db_collection in compare_memcheck_2_runs.py (#1157) 2020-07-02 13:14:07 +03:00
Ilya Lavrenov
a7579d5c35 Removed ICNNNetReader interface (#1042)
* Removed ICNNNetReader interface

* Fixed stress tests

* Fixed comments in VPU plugin

* Removed duplicated stress tests

* Fixed watchdog tests
2020-06-23 22:34:26 +03:00
Andrey Somsikov
52a42624e9 Add memcheck runner script (#1031)
Script executes measurement isolated with gtest-parallel,
handles database uploading and reports generation.
2020-06-22 16:23:09 +03:00
Vitaliy Urusovskij
3417004e6d Add memcheck comparison script (#935)
Add compare_memcheck_2_runs.py compares two runs.
Add handling of broken files for `parse_memcheck_log`
2020-06-19 15:56:32 +03:00
Andrey Somsikov
626bc4f3d4 Add commit links to memcheck report (#820) 2020-06-08 15:08:58 +03:00
Vitaliy Urusovskij
72d9a9fae7 Use pre-defined DB collection names in memcheck_upload.py CLI (#651)
Use argparses `choices` for `--db_collection` option.

Also removed unnecessary redefinition of `db_collection` in memcheck_upload.py
2020-06-03 13:54:38 +03:00
Vitaliy Urusovskij
1d179fdb39 Add parallel downloads to stress tests (#678) 2020-06-02 17:24:22 +03:00
Vitaliy Urusovskij
4a44f84dab [Stress] Updated test_configs with new path to OMZ mtcnn models (#602) 2020-05-26 20:11:46 +03:00
Alexey Suhov
deb008a26f publish master branch snapshot, revision 8d31237e2c3f673cbb0f0ba110fc10f5cce1d2bb 2020-05-22 02:23:12 +03:00
Alexey Suhov
f30dcc218c publish master branch snapshot, revision 9df5eb1f84e13a35720a918f88324561222ab114 2020-05-20 01:13:06 +03:00