IntenseWebs/openvino
3
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
7,510 Commits 38 Branches 54 Tags
a454b7371e8fa9ee89c8a8feae892c436fe734bf
Commit Graph

82 Commits

Author SHA1 Message Date
Victor Kuznetsov
21601398d6 Remove dynamism from time_tests (API 1.0) (#10193) 2022-02-09 19:15:16 +08:00
Victor Kuznetsov
857c0bd9dd [Time tests] Update reshape pipeline (use default inputs before reshape for data generation) (#10129) 2022-02-07 22:50:12 +08:00
Victor Kuznetsov
ed6bb8ab2d Update models folder for TimeTests (#10107) 
* add performance hint to time infer

* upd time models
 2022-02-04 11:33:15 +03:00
Victor Kuznetsov
0dd8d895a0 [Time tests] Add API 2.0 support (#9878) 
* add performance hint to time infer

* init commit - add api 2 support

* change imInfo filling

* change copyright dates

* check hw positions to default

* add debug info

* fix mistake

* add check layout funcs for api2 time infer

* reformat code (2 -> 4)

* upd with reshape api2

* upd with master

* --

* fix fillTensors - set as template

* fix common_utils.cpp after merge master
 2022-02-02 12:33:02 +03:00
Victor Kuznetsov
6f60a7d8f0 First time inference validation for dynamic shapes (#9671) 
* add performance hint to time infer

* add reshape methods for time infer tool

* add func declarations to common_utils.h

* add check if node is static (reshape pipeline)

* changes in desc of reshape funcs

* fix logic operator

* add reshape utils.h | move parsing logic in main func

* add tests_shared_lib to CMakeLists.txt

* change fill blobs with setStaticShapesBlobs

* change delimiter
 2022-01-24 16:19:03 +03:00
Alexey Suhov
a79830cb55 Update year to 2022 in copyright notice (#9755) 2022-01-19 01:07:49 +03:00
Victor Kuznetsov
e212a1ac83 [TimeTests] Disable VPU option, rename cache option (#9114) 
* add performance hint to time infer

* Update time tests with options

* fix mistake in help

* update test conf with GPU models

* move ie configs from load plugin timer
 2021-12-17 13:06:56 +03:00
Victor Kuznetsov
0f1c545a19 [Time tests] Change work with perf_hint (#9090) 
* add performance hint to time infer

* upd_time_tests
 2021-12-09 10:29:55 +03:00
Victor Kuznetsov
55f64a505a Expand time tests to cover CPU caching feature (#8938) 
* add performance hint to time infer

* add options for vpu, cpu cache, perf hint

* change VPUX condition

* add perf hint verify

* upd perf hint usage. set as non required
 2021-12-08 15:22:44 +03:00
Victor Kuznetsov
9fc64ea726 add performance hint to time infer (#8480) 2021-11-10 16:07:08 +03:00
Victor Kuznetsov
8a46ead91b add pytest-timeout (#8352) 2021-11-02 13:44:02 +03:00
Victor Kuznetsov
445292b079 change pr type (#8143) 2021-10-26 11:29:57 +03:00
Victor Kuznetsov
b754013aec fix work with query memory timeline (#8063) 
* fix work with query memory timeline

* revert timeout changes

* upd readme

* change README.md
 2021-10-25 16:51:53 +03:00
Victor Kuznetsov
6d9a7a108e Stress, Memory tests update to comply with new OMZ tools layout (#7886) 
* work with omz: change hardcoded paths for memory_tests, fix paths for memcheck get_testdata.py script

* change paths to omz tools

* revert mo changes

* remove mo from arguments

* remove extra var from cmd string

* remove is_db_used check

* add timeout to proc_exec

* merge master
 2021-10-13 10:42:00 +03:00
Ilya Lavrenov
44186c31e4 Fixed path to setupvars.sh ti readme (#7537) 2021-09-17 05:20:28 +03:00
Ilya Sharikov
5847b35ed2 Make time && stress tests independent from IEDeveloperPackage (#7411) 
* Specify own CXX configuration for time && stress tests

* Included os_flags for build gflags

* Updated README

* Updated commands for build tests in README

* Use new cmake config
 2021-09-16 12:54:41 +03:00
Alina Kladieva
fda3f5d237 [requirements] Set TF to 2.5.0 (#6620) 
* [requirements] Set TF to 2.5.0

* [ngraph|paddlepaddle|requirements] Gast to 0.4.0

(required for TensorFlow 2.5)

* [ stress_tests/scripts/requirements] Upd versions

* [time_tests/test_runner/requirements] Upd versions

* [ngraph|paddle|requirements] Paddle strict major

* Gast version to 0.3.3

* Update requirements_dev.txt
 2021-09-14 18:05:18 +03:00
Victor Kuznetsov
92445d4b80 add new exec with vpu compiler option (set config with MLIR compiler) (#7420) 2021-09-13 10:52:06 +03:00
Ilya Sharikov
f44369ce4e Updated requirements (#7397) 2021-09-13 08:50:23 +03:00
Victor Kuznetsov
4d377901bf Move all utils to common folder (#7303) 
* move all utils to common folder

* add utils install in CMakeLists.txt

* revert plugin utils

* add log info: test

* add logging info: test

* test imports

* change imports: test

* fix file name
 2021-09-07 23:02:10 +03:00
Michał Karzyński
d748f2aa99 Remove references to prototxt from documentation and docstrings (#7346) 2021-09-03 08:32:43 +03:00
Victor Kuznetsov
1f4664162a install necessary dirs for tests (#7044) 
* install necessary dirs to tests

* rem RUNTIME from install step

* fix paths

* fix install paths

* fix install paths: add destination dirs

* add pandas

* fix requirements conflict - change pytest version to ~5

* remove comment from requirements.txt

* upd numpy version
 2021-08-24 00:39:12 +03:00
Daria Ilina
5292de5338 Reorganize work with openvino/thirdparty (Copied from PR6744) (#6880) 
* Copied PR6744

* Added CMakeLists.txt into gflags

* Return gflags into .gitmodules

* Added CMakeLists.txt into gtest

* fix: remove extra gflags and gtests from .gitmodules

* Change syntax in set gtest_targets

* Make gtest/CMakeLists.txt as in PR6744 for pre-commit experiment

* Update gtest/CMakeLists.txt

* Change version of gtest repo

* Return gtest info into .gitmodules

* Update gflags version to currently used
 2021-08-11 11:33:52 +03:00
Ilya Sharikov
26c8b29b35 Added missing modules for timetests (#6896) 2021-08-03 12:19:40 +03:00
Ilya Sharikov
252483bb83 Common tests library for shared functionality (#6578) 2021-07-23 10:37:35 +03:00
Vitaliy Urusovskij
a92a737ba0 Develop installation rules for time and stress tests (#6649) 
* Prepare `install` rule for time_tests

* Prepare `install` rule for stress tests
 2021-07-16 16:30:20 +03:00
Ilya Lavrenov
fc7f80a34e CVS-34900: updated pugixml to v1.11.4 (#6301) 
* Added pugixml as submodule

* CVS-34900: updated pugixml to v1.11.4

* Fixed link with pugixml

* USe pugixml::static

* Try to fix bug

* Removed GITHUB_PULL_REQUEST

* Replaced  OpenVINO_MAIN_SOURCE_DIR -> OpenVINO_SOURCE_DIR

* Removed some usages of IE_MAIN_SOURCE_DIR

* Use ngraph target directly
 2021-07-02 11:36:31 +03:00
Vitaliy Urusovskij
31907e51e9 Fixed several issues in time_tests (#6481) 
* Fixed return in `run_timetest`

* Fixed `parse_stats()` argument type notation

* Pass message from `timetest` exe to test error msg to be uploaded to DB
 2021-07-01 16:37:23 +03:00
Ilya Lavrenov
07f94ea602 Minimized usage of IE_MAIN_SOURCE_DIR (#6422) 
* Minimized IE_MAIN_SOURCE_DIR hardcode

* Used COMPILE_OPTIONS instead of COMPILE_FLAGS

* Fixed compilation

* Enabled NGRAPH_DYNAMIC_COMPONENTS_ENABLE by default

* Fixes

* Moved GNA related file

* Fixed backend compilation

* Fixed Windows for ngraph

* Fixed <root>/tests build

* More updates

* Fixed scripts install

* Fixed Windows

* Fixed Windows
 2021-06-30 18:15:41 +03:00
Victor Kuznetsov
a1eb5b1fd5 Change target branch field (fix null) (#6433) 2021-06-30 12:53:17 +03:00
Ilya Lavrenov
2f432980a0 Moved gflags, preprocessing dependencies to root (#6309) 2021-06-23 09:53:18 +03:00
Victor Kuznetsov
089f76cc7f Add branch field to submit to DB in MemCheck/TimeTests (#6073) 2021-06-11 12:57:01 +03:00
Vitaliy Urusovskij
291a80c84a Make stress and time tests build dependent from gflags from samples (#5883) 
* Make timetests dependent on IE gflags 3rdparty from samples/

* Make stress tests dependent on IE gflags 3rdparty from samples/
 2021-06-04 10:27:23 +03:00
Victor Kuznetsov
af915859e3 Add float instance to time_tests parse_stats (#5726) 2021-05-21 11:12:05 +03:00
Victor Kuznetsov
c907fb9f52 Log have time measures nested (#5402) 2021-05-18 18:00:10 +03:00
Victor Kuznetsov
4790c79eb4 Add time_tests dir path to sys.path (#5498) 2021-05-06 14:57:50 +03:00
Olesya Martinyuk
d16c215fde Add CPU info to time tests (#5451) 2021-05-04 14:49:10 +03:00
Vitaliy Urusovskij
db2de2fb19 Fix time_tests runs when models_cache enabled (#5265) 
* Set ``"additionalProperties": true` to enable 'use_model_cache' in time_tests

* Limit tests scope in desktop_test_config_cache.yml
 2021-04-17 00:12:08 +03:00
Vitaliy Urusovskij
c852634055 Remove comparison with references from time_tests as unused (#5248) 
* Remove comparison with references from time_tests as unused

* Remove `--dump_refs` from time_tests as unused
 2021-04-15 22:24:45 +03:00
Vitaliy Urusovskij
a70d13f9e2 Add support of IE model cache in time_tests (#5192) 2021-04-15 00:11:48 +03:00
Alexander Shchepetov
e864972f83 Add experiments timings to data to submit to DB(#5108) 2021-04-12 09:29:10 +03:00
Mikhail Nosov
ca99333982 [TimeTests] Add test case for testing first time inference with caching enabled (#4933) 
Important note: Invoker (e.g. test_timetest.py) must ignore first measurement when cache is not generated
 2021-04-07 17:04:45 +03:00
Victor Kuznetsov
69a06f5977 Remove time-tests outliers using Inter Quartile Range (IQR) (#5014) 
Change number of times to execute binary to aggregate statistics from 3 to 10.
 2021-04-02 11:35:38 +03:00
Alexey Suhov
6478f1742a Align copyright notice in python scripts (CVS-51320) (#4974) 
* Align copyright notice in python scripts (CVS-51320)
 2021-03-26 17:54:28 +03:00
Alexey Suhov
a748c26fee Align copyright notice in cpp and cmake source files (CVS-51320) (#4950) 2021-03-25 02:40:09 +03:00
Anton Pankratv
3b3d9a0989 Used IE_THROW macro (#4869) 
* Added ie throw macro

* Used IE_THROW macro
 2021-03-23 18:57:12 +03:00
Anton Pankratv
a2b8b974b8 Simplified IE Exceptions Implementation (#4258) 2021-03-18 16:30:16 +03:00
Victor Kuznetsov
1da8f65b45 Add removing of statistics file in time_tests (#4275) 2021-02-11 12:02:39 +03:00
Victor Kuznetsov
73f846648c change tempfile usage (#4245) 2021-02-10 10:23:31 +03:00
Victor Kuznetsov
a6d9842152 mv getBatchSize to cnnNetwork scope (#4231) 2021-02-09 10:47:44 +03:00