Commit Graph

140 Commits

Author SHA1 Message Date
iliya mironov
e1bffcc36c Add json validate (#6449)
* Add json validate

* Fix json schema

* Fix schema loader

* Add unit test

* Update bom file

* Update all requarments

* Update dev requarments

* Update requrments

* Update path to schema

* Update schema

* Add some unit tests

* Move schema to root dir

* Update schema path in bom file

* Fix unit test

* Fix bom

* Change path to schema

* update setup

* Fix setup

* Fix mo args test

* Refactoring some code

* Refactoring according to review

* Update sort imports

* Remove id attribute from schema

* Refactoring validator

* Fix according to review

* Move schema from json to dict. Update unit tests.

* Fix BOM file

* Update bom file
2021-07-22 21:12:44 +03:00
Valentin Dymchishin
55d9e85dc6 [54908] Update MemCheckTests references in nightly config (#6713)
* [54908] Update MemCheckTests references for GPU

* [54908] Update MemCheckTests references in nightly config
2021-07-22 12:50:07 +03:00
Vitaliy Urusovskij
a92a737ba0 Develop installation rules for time and stress tests (#6649)
* Prepare `install` rule for time_tests

* Prepare `install` rule for stress tests
2021-07-16 16:30:20 +03:00
Valentin Dymchishin
fe8ecd72ff Update MemCheckTests references for GPU in precommit (#6647) 2021-07-15 10:59:41 +03:00
Victor Kuznetsov
4efe708023 Make DB query for MemCheckTests optional in precommit (#6526)
* add try/catch

* add error msg
2021-07-07 14:38:49 +03:00
Ilya Sharikov
aea105c14b Remove resnet model for running CC test (#6439) 2021-07-07 12:55:28 +03:00
Ilya Lavrenov
fc7f80a34e CVS-34900: updated pugixml to v1.11.4 (#6301)
* Added pugixml as submodule

* CVS-34900: updated pugixml to v1.11.4

* Fixed link with pugixml

* USe pugixml::static

* Try to fix bug

* Removed GITHUB_PULL_REQUEST

* Replaced  OpenVINO_MAIN_SOURCE_DIR -> OpenVINO_SOURCE_DIR

* Removed some usages of IE_MAIN_SOURCE_DIR

* Use ngraph target directly
2021-07-02 11:36:31 +03:00
Ilya Sharikov
c2e4e64079 Updated path of the executable binary for the Python interpreter (#6494) 2021-07-02 10:53:46 +03:00
Victor Kuznetsov
267f9a3b77 Skip test_lstm_simple_precommit on gpu (#6293)
* skip test on gpu

* try to set timeout

* add timeout param

* rename to infer_timeout

* fix infer_timeout
2021-07-01 20:25:27 +03:00
Vitaliy Urusovskij
31907e51e9 Fixed several issues in time_tests (#6481)
* Fixed return in `run_timetest`

* Fixed `parse_stats()` argument type notation

* Pass message from `timetest` exe to test error msg to be uploaded to DB
2021-07-01 16:37:23 +03:00
Ilya Lavrenov
07f94ea602 Minimized usage of IE_MAIN_SOURCE_DIR (#6422)
* Minimized IE_MAIN_SOURCE_DIR hardcode

* Used COMPILE_OPTIONS instead of COMPILE_FLAGS

* Fixed compilation

* Enabled NGRAPH_DYNAMIC_COMPONENTS_ENABLE by default

* Fixes

* Moved GNA related file

* Fixed backend compilation

* Fixed Windows for ngraph

* Fixed <root>/tests build

* More updates

* Fixed scripts install

* Fixed Windows

* Fixed Windows
2021-06-30 18:15:41 +03:00
Victor Kuznetsov
a1eb5b1fd5 Change target branch field (fix null) (#6433) 2021-06-30 12:53:17 +03:00
Ilya Sharikov
6cf4f7eecf Updated path to executable binary for the Python interpreter (#6340) 2021-06-24 13:54:46 +03:00
Ilya Sharikov
b83a1ab1bc Updated requirements.txt (#6329) 2021-06-24 13:48:31 +03:00
Ilya Lavrenov
2f432980a0 Moved gflags, preprocessing dependencies to root (#6309) 2021-06-23 09:53:18 +03:00
Ilya Lavrenov
ad997410c8 Port to master (#6279)
* add single_layer_test for Interpolate-1 (#6133)

* Fixed InferenceEngineConfig.cmake usage in include() (#6136)

* Deprecated API updates (#6252)

* Fixed links to OMZ / DL Streamer (#6257)

* Added doxygen deprecation for LowLatency

Co-authored-by: Elena Gvozdeva <elena.gvozdeva@intel.com>
2021-06-22 17:43:17 +03:00
Ilya Lavrenov
fa2f9c5201 Migrated to official GoogleTest repo (#6286)
* Move gtest to <root>/wqthirdparty

* Fixed inference engine tests

* Fixed unit-tests

* Fixed GPU

* Fixed clDNN_unit_tests compilation

* Reverted ngraph changes

* Fixed VPU tests

* Fixed deprecated tests compilation

* Removed OpenVINO clone

* Added public submodule

* Removed

* Fixed Windows

* More updates for INSTANTIATE_TEST_SUITE_P

* Use release-1.10.0

* Removed ngraph copy of gtest

* Revert "Removed ngraph copy of gtest"

This reverts commit ec9fe08d79.

* Fixes for TYPED_TEST_CASE

* Fixed GNA tests

* Updated submodule

* Updaed index

* TMP disabled tests

* Revert changes and fix compilation errors

* Fixed caching tests

* Revert back

* Revert back all

Co-authored-by: Michael Nosov <mikhail.nosov@intel.com>
2021-06-22 17:39:39 +03:00
Alexander Shchepetov
020af3dddd add TF Roll op test (#6228) 2021-06-18 17:36:08 +03:00
Alexander Shchepetov
b0c508d4ff Add layer tests (#5789)
Co-authored-by: alexander.shchepetov <ashchepe@nnlvdp-cflr51.inn.intel.com>
2021-06-16 12:50:16 +03:00
Andrey Somsikov
fb7435a647 Add cnpy fuzz test and fix issues (#6109) 2021-06-14 17:00:49 +03:00
Victor Kuznetsov
089f76cc7f Add branch field to submit to DB in MemCheck/TimeTests (#6073) 2021-06-11 12:57:01 +03:00
Alexander Shchepetov
503d18c80f Enable MYRIAD in stress tests (#6026) 2021-06-08 12:47:20 +03:00
Vitaliy Urusovskij
291a80c84a Make stress and time tests build dependent from gflags from samples (#5883)
* Make timetests dependent on IE gflags 3rdparty from samples/

* Make stress tests dependent on IE gflags 3rdparty from samples/
2021-06-04 10:27:23 +03:00
Alexander Shchepetov
d25e149f76 Conditional compilation test can run from open source (#5629) 2021-05-26 11:43:59 +03:00
Vitaliy Urusovskij
97a9a76ff9 Fix parsing of threads in stress/memory tests (#5695)
* Fix parsing of threads in stress/memory tests

* Replace `char*` with `string` due `char*` can't be modified
2021-05-26 02:04:06 +03:00
Anastasiya Koryachikhina
0e86b095cc Add Inference with streams in MemCheckTests (#5608) 2021-05-26 01:01:51 +03:00
Victor Kuznetsov
af915859e3 Add float instance to time_tests parse_stats (#5726) 2021-05-21 11:12:05 +03:00
Vitaliy Urusovskij
dcd27f0776 Actualize stress tests README (#5698) 2021-05-20 14:43:48 +03:00
Victor Kuznetsov
c907fb9f52 Log have time measures nested (#5402) 2021-05-18 18:00:10 +03:00
Gorokhov Dmitriy
a19413c0c0 [CPU] Plugin migration on ngraph (#4344) 2021-05-06 19:49:24 +03:00
Victor Kuznetsov
4790c79eb4 Add time_tests dir path to sys.path (#5498) 2021-05-06 14:57:50 +03:00
Victor Kuznetsov
5834eef8f0 Change model_path to model_name in timeline report (#5457) 2021-05-06 11:54:16 +03:00
Olesya Martinyuk
d16c215fde Add CPU info to time tests (#5451) 2021-05-04 14:49:10 +03:00
Vitaliy Urusovskij
68ed12cb98 Enable FetchContent for gflags dependency in stress tests (#5449)
* Enable `FetchContent` for `gflags` dependency in stress tests

* Add `HAVE_SYS_STAT_H`, `HAVE_INTTYPES_H`, `INTTYPES_FORMAT` for stress tests
2021-04-29 14:44:12 +03:00
Victor Kuznetsov
e121fbd7de Add int8 models to memcheck tests (#5333) 2021-04-23 12:56:59 +03:00
Vitaliy Urusovskij
ed0b66f31d Fix timeline report for MemCheck by querying target instead of current branch (#5350) 2021-04-22 15:51:35 +03:00
Vitaliy Urusovskij
db2de2fb19 Fix time_tests runs when models_cache enabled (#5265)
* Set ``"additionalProperties": true` to enable 'use_model_cache' in time_tests

* Limit tests scope in desktop_test_config_cache.yml
2021-04-17 00:12:08 +03:00
Vitaliy Urusovskij
c852634055 Remove comparison with references from time_tests as unused (#5248)
* Remove comparison with references from time_tests as unused

* Remove `--dump_refs` from time_tests as unused
2021-04-15 22:24:45 +03:00
Vitaliy Urusovskij
a70d13f9e2 Add support of IE model cache in time_tests (#5192) 2021-04-15 00:11:48 +03:00
Olesya Martinyuk
070201feee Added test validating inference results after conditional compilation (#4840) 2021-04-13 22:16:14 +03:00
Vitaliy Urusovskij
634dc42808 Enable new infer_request_inference memleak test to cover *-52623 (#5183) 2021-04-12 20:00:11 +03:00
Alexander Shchepetov
e864972f83 Add experiments timings to data to submit to DB(#5108) 2021-04-12 09:29:10 +03:00
Mikhail Nosov
ca99333982 [TimeTests] Add test case for testing first time inference with caching enabled (#4933)
Important note: Invoker (e.g. test_timetest.py) must ignore first measurement when cache is not generated
2021-04-07 17:04:45 +03:00
Victor Kuznetsov
69a06f5977 Remove time-tests outliers using Inter Quartile Range (IQR) (#5014)
Change number of times to execute binary to aggregate statistics from 3 to 10.
2021-04-02 11:35:38 +03:00
Taylor Yeonbok Lee
b58c648d2d [IE CLDNN] Build time optimization for OCL kernels (#4725)
Build OCL kernel batches of different buckets in parallel

Co-authored-by: Donghyeon Jeong <donghyeon.jeong@intel.com>
2021-03-31 10:22:19 +03:00
Victor Kuznetsov
83ec2d321a Add json file with tests ids to CC tests (#4425) 2021-03-30 15:31:40 +03:00
Alexey Suhov
a2bf62f488 Align copyright notice in sh, bat, cl, cc, pyx source files (#4995) 2021-03-27 01:26:27 +03:00
Alexey Suhov
6478f1742a Align copyright notice in python scripts (CVS-51320) (#4974)
* Align copyright notice in python scripts (CVS-51320)
2021-03-26 17:54:28 +03:00
Alexey Suhov
a748c26fee Align copyright notice in cpp and cmake source files (CVS-51320) (#4950) 2021-03-25 02:40:09 +03:00
Anton Pankratv
3b3d9a0989 Used IE_THROW macro (#4869)
* Added ie throw macro

* Used IE_THROW macro
2021-03-23 18:57:12 +03:00