Commit Graph

20 Commits

Author SHA1 Message Date
Victor Kuznetsov
6d9a7a108e Stress, Memory tests update to comply with new OMZ tools layout (#7886)
* work with omz: change hardcoded paths for memory_tests, fix paths for memcheck get_testdata.py script

* change paths to omz tools

* revert mo changes

* remove mo from arguments

* remove extra var from cmd string

* remove is_db_used check

* add timeout to proc_exec

* merge master
2021-10-13 10:42:00 +03:00
Victor Kuznetsov
4d377901bf Move all utils to common folder (#7303)
* move all utils to common folder

* add utils install in CMakeLists.txt

* revert plugin utils

* add log info: test

* add logging info: test

* test imports

* change imports: test

* fix file name
2021-09-07 23:02:10 +03:00
Michał Karzyński
d748f2aa99 Remove references to prototxt from documentation and docstrings (#7346) 2021-09-03 08:32:43 +03:00
Vitaliy Urusovskij
31907e51e9 Fixed several issues in time_tests (#6481)
* Fixed return in `run_timetest`

* Fixed `parse_stats()` argument type notation

* Pass message from `timetest` exe to test error msg to be uploaded to DB
2021-07-01 16:37:23 +03:00
Victor Kuznetsov
af915859e3 Add float instance to time_tests parse_stats (#5726) 2021-05-21 11:12:05 +03:00
Victor Kuznetsov
c907fb9f52 Log have time measures nested (#5402) 2021-05-18 18:00:10 +03:00
Victor Kuznetsov
4790c79eb4 Add time_tests dir path to sys.path (#5498) 2021-05-06 14:57:50 +03:00
Alexander Shchepetov
e864972f83 Add experiments timings to data to submit to DB(#5108) 2021-04-12 09:29:10 +03:00
Victor Kuznetsov
69a06f5977 Remove time-tests outliers using Inter Quartile Range (IQR) (#5014)
Change number of times to execute binary to aggregate statistics from 3 to 10.
2021-04-02 11:35:38 +03:00
Alexey Suhov
6478f1742a Align copyright notice in python scripts (CVS-51320) (#4974)
* Align copyright notice in python scripts (CVS-51320)
2021-03-26 17:54:28 +03:00
Victor Kuznetsov
1da8f65b45 Add removing of statistics file in time_tests (#4275) 2021-02-11 12:02:39 +03:00
Victor Kuznetsov
73f846648c change tempfile usage (#4245) 2021-02-10 10:23:31 +03:00
Andrey Somsikov
359c2ca018 Upgrade pyyaml to the latest (#4134) 2021-02-03 07:07:01 +03:00
Vitaliy Urusovskij
12b690952c Time tests improvements (#2642)
* Remove extra functions from run_timetest.py

* Add `log.debug` of raw and aggregated statistics in run_timetest.py

* Implement storing of models locally for test_timetest.py
2020-10-14 20:05:52 +03:00
Vitaliy Urusovskij
474dcc277f Prepare new test configuration for test_timetest.py (#2561)
* Add logging of DB upload to tconf with refs saving

* Prepare `.automation/tgl_test_config.yml` with models from VPUX package

* Add restriction on `exe` and `model` existence in run_timetest.py
2020-10-08 10:30:43 +03:00
Vitaliy Urusovskij
c3ff2948a4 Timetests test_runner improvements (#2552)
* Remove `generate_tmp_path` as unnecessary after refactoring

* Add `check_positive_int` check for `-niter` CLI key

* Replace `TestConfDumper` with number of fixtures:
1. Save all test info in global `request` and `pytestconfig` fixtures
2. Add `test_info` fixture for retrieving test info from test
3. Add `prepare_tconf_with_refs` fixture for test conf dump
2020-10-07 17:15:02 +03:00
Vitaliy Urusovskij
6949d93e42 Add "cl_cache" preparation in test_timetest.py (#2490) 2020-10-06 14:16:50 +03:00
Vitaliy Urusovskij
639052d0b8 Support references in test_timetest.py (#2431) 2020-10-01 11:35:57 +03:00
Vitaliy Urusovskij
d48d2109dc Test timetest MVP (#2345) 2020-09-21 21:33:42 +03:00
Vitaliy Urusovskij
20266276ec New layout for time_tests (#2321)
* Change folders' layout for `time_tests`

* Refactoring of namings in `time_tests`
2020-09-18 18:53:49 +03:00