Commit Graph

101 Commits

Author SHA1 Message Date
Victor Kuznetsov
bcd192e882 Revert changes with single-image-super-resolution-1032 - memcheck precommit (#10271) 2022-02-11 20:30:09 +08:00
Victor Kuznetsov
b3a990b0a7 Disable single-image-super-resolution-1032 from MemCheck precommit (#10133)
* add performance hint to time infer

* disable model from memcheck
2022-02-04 18:00:00 +03:00
Lidia Toropova
2f0bcc8542 Moved stress tests to OV API 2.0 (#9791)
* Moved stress tests to OV API 2.0

* Fix for using ouput index instead of get_index

* Removed ov::runtime namespace in stress tests

* Updated stress tests according to latest changes in OV 2.0

* Fix memleaks tests

* Updated run_memcheck.py to process gtest_filter

* Updated fillTensors, added InferAPI1 and InferAPI2 classes

* Updated test_inference_with_streams

* Updated isImage, comments

* Updated fillTensors to fill image_info inputs with positive pseudo-random numbers

* Removed redundant variable in fillTensors
2022-01-31 17:07:25 +03:00
Victor Kuznetsov
013d3f01a0 Change thresholds for MemCheck nightly (#9879)
* add performance hint to time infer

* change th-ds for mtcnn-o
2022-01-25 11:30:51 +03:00
Victor Kuznetsov
0f4f2ebade Change thresholds for MemCheck nightly (#9815)
* add performance hint to time infer

* fix th values for memcheck nightly
2022-01-21 11:54:29 +03:00
Victor Kuznetsov
6a9519be8a Update list of OMZ models for stress tests (#9750)
* add performance hint to time infer

* del octave model
2022-01-19 10:09:49 +03:00
Alexey Suhov
a79830cb55 Update year to 2022 in copyright notice (#9755) 2022-01-19 01:07:49 +03:00
Ilya Sharikov
cb0084718a Update list of OMZ models for stress tests (#9391) 2022-01-10 13:50:03 +03:00
azhogov
bd82e8d000 Fix stress test install: remove requirements-caffe2.in 2021-12-28 12:07:32 +03:00
Pavel Esir
980904c9ec [MO] Align MO namespaces (#7708)
* Moved and merged mo/ and extensions/ into openvino/tools/mo

* edited imports

* edited docs to use mo script from entry_point

* edited MO transformations list loading and setup.py

* changed full path -> 'mo' entry point in docs (leftovers)

* corrected package_BOM

* updated resolving --transformation_config in cli_parser.py

* pkgutil-style __init__.py, added summarize_graph into entry points

* updated DOCs for the new --transformations_config

* fix select

* updated install instructions, fixed setup.py for windows and python_version < 3.8

* fixed typo in requirements.txt

* resolved conflicts

* removed creating custom __init__.py from setup.py

* corrected folder with caffe proto

* corrected loading user defined extensions

* fix openvino.tools.mo import in serialize.py

* corrected layer tests for new namespace

* fix in get_testdata.py

* moved model-optimizer into tools/

* renamed import in POT

* corrected mo.yml

* correct CMakeLists.txt for the newest tools/mo

* corrected find_ie_version.py

* docs and openvino-dev setup.py update for the newest tools/mo

* miscellaneous leftovers and fixes

* corrected CI files, pybind11_add_module in CMakeLists.txt and use of tools/mo path instead of tools/model_optimizer

* add_subdirectory pybind11 for tools/mo

* POT path fix

* updated setupvars.sh setupvars.bat

* Revert "updated setupvars.sh setupvars.bat"

This reverts commit c011142340.

* removed model-optimizer env variables from setupvars

* updated CMakeLists.txt to pack MO properly with tests component

* corrected left imports, corrected loading requirements for layer tests

* mo doc typo correction

* minor corrections in docs; removed summarize_graph from entry_points

* get_started_windows.md, MonoDepth_how_to.md corrections, mo path corrections
2021-12-08 08:53:53 +03:00
Vladimir Paramuzov
ab3a892d48 [GPU] Fixed typo in cache.json (#8756) 2021-11-27 15:06:54 +03:00
Ilya Lavrenov
5719192687 Use ninja multi-config (#8757)
* Use ninja multu-config

* Reused OV_GENERATOR_MULTI_CONFIG

* Try to use config in api_validator post build task

* Fixes

* Revert "[GPU] Fix multi configuration build of onednn_gpu (#8743)"

This reverts commit a862331732.

* Propogate disable deprecated for _RELEASE flags as well
2021-11-27 14:58:24 +03:00
Victor Kuznetsov
67dd586eef Fix omz call in get testdata script [stress] (#8790)
* add performance hint to time infer

* Fix python executable for omz
2021-11-24 15:05:39 +03:00
Victor Kuznetsov
b807800321 upd precommit res for memcheck (#8447) 2021-11-09 13:09:17 +03:00
Anastasiya Koryachikhina
8b0bec4e04 Small changes in memcheck tests (#7128)
* add "" for windows in cmd line

* requirements test

* requirements test

* add requests in requirements

* add scipy in requirements

* add executable python for prepare models

* remove extra requirements

* add window for supported in memcheck tests

* add scipy in requirements

* change check of product_type

* add return for windows

* change form of return arg in run_memcheck

* change form of return arg in run_memcheck

* remove windows check

* change return format

* remove empty line

* change downloader_path
2021-10-25 10:49:33 +03:00
Victor Kuznetsov
6d9a7a108e Stress, Memory tests update to comply with new OMZ tools layout (#7886)
* work with omz: change hardcoded paths for memory_tests, fix paths for memcheck get_testdata.py script

* change paths to omz tools

* revert mo changes

* remove mo from arguments

* remove extra var from cmd string

* remove is_db_used check

* add timeout to proc_exec

* merge master
2021-10-13 10:42:00 +03:00
Alexander Shchepetov
268246e3bc single-model test configs (#7734) 2021-10-04 11:14:13 +03:00
Victor Kuznetsov
5dab18d995 change references for memcheck pre-commit (#7558) 2021-09-20 19:34:19 +03:00
Roman Donchenko
8598ce89a3 Add missing spaces between words in string literals (#7540)
And in one case, a missing period.
2021-09-20 15:38:49 +03:00
Alexander Shchepetov
03cc662717 Static test cases definition + supporting multi-model cases in MemLeaks tests (#7378)
* add multimodel memleaks test runner

* Add support for is_equal_data, get_source_tensor, get_target_tensor methods in ONNX FE API (#6991)

* Change ngraph public api (#6920)

* Moved nGraph function

* Added legacy nGraph function

* Moved export API

* Moved variant

* Added old header for backward compatibility

* Introduce define

* [LPT] LP Transformations refactoring after dynamic shapes support (#6950)

* [LPT] Transformations refactoring after dynamic shapes support

* [LPT] ReshapeTransformation: 2D->2D fix

* [LPT] fixes after review

* [GPU] Fix ScatterNDUpdate unit tests (#7103)

* Deprecate ngraph file utils. Need to have common functions (#7105)

* [GPU] Get rid of memory alloc for input_layout in internal networks (#6897)

* Renamed component name (#7110)

* Propose new MaxPool-8 operation (#5359)

* MaxPool-8: pads_value attribute removal from the operator definition (#7119)

* Remove deprecated option and enable compilation without device (#6022)

* Build openvino wheel package from setup.py (#7091)

* Added ability to build wheel package by executing `setup.py bdist_wheel`

* fix linter issues

* fix formating

* remove blank line

* Support unregistered operations in MO IR Reader (#6837)

* Add support for unregistred operations in MO IR Reader

* Remove commented lines

* Add shapes equality check

* Update comments

* Update groupconv_to_conv function to support case with multiple destinations

* Add ir_data_attrs attribute to restored layers

* Update copy_shape_infer function to new graph api

* Add attribute IE to unsuppurted operations to save their attributes

* Fix wrong attribute name

* Update commentary

* Partially revert updating to new Graph API to fix regression, add appropriate comments

* Update code comments

* Rename copy_shape_infer function and add more comments

* First stage of the AUTO-MULTI merge: redirecting AUTO to the MULTI device plugin (#7037)

* Redirect -d AUTO to MULTI device plugin

Signed-off-by: Shoujiang Ma <shoujiang.ma@intel.com>

* Modify AUTO tests with MULTI config

Signed-off-by: Shoujiang Ma <shoujiang.ma@intel.com>

* Fix CI

Signed-off-by: Shoujiang Ma <shoujiang.ma@intel.com>

* Fix bug: CVS-62424

Signed-off-by: Shoujiang Ma <shoujiang.ma@intel.com>

* Add some tests for AUTO

Signed-off-by: Shoujiang Ma <shoujiang.ma@intel.com>

* Add select device logic to MULTI

Signed-off-by: Shoujiang Ma <shoujiang.ma@intel.com>

* Fix extract device name bug

Signed-off-by: Shoujiang Ma <shoujiang.ma@intel.com>

* Address reviewer's comment

Signed-off-by: Shoujiang Ma <shoujiang.ma@intel.com>

* Delete AUTO plugin source code

Signed-off-by: Shoujiang Ma <shoujiang.ma@intel.com>

* [CPU] Deform. conv. - reference enforced (#6945)

* [CPU] Bump up MKLDNN version to get fix of c26453 warning (#7089)

* OpenVINO ONNX CI Azure - update onnx/models on demand only (#7125)

* [CPU] Added improvements for StridedSlice (#6658)

* Removal of FusedOp inheritance leftovers (#7113)

* Remove FusedOp from v0::Gelu

* Update v0::Gelu NGRAPH_RTTI_DECLARATION

* Enable gelu type_prop tests

* Remove FusedOp from v0::MVN

* Remove FusedOp from HardSigmoid

* Remove FusedOp from LSTMSequence

* Remove supress deprecated

* Add missed NGRAPH_OP_SCOPE to v0 Gelu and HardSigmoid

* Move ngraph::element::Type to ov namespace (#7124)

* Moved ngraph::Type -> ov::Type

* Revert original files

* [GNA] Fix order of SwapMatMulInput transformations (#7137)

* Moved Dimension, PartialShape, Interval, Rank to ov namespace (#7136)

* Mo implementation for If with tf extractor (#6662)

* Add tf2.x impl for If

* Fix ir_engine

* Fix opset

* Fix BOM file

* Added new test

* Fix comments

* Add subgraph_utils

* Fix comments

* Fix transform

* code refactoring

* Fix description

* rewrite support for empty tensor in if

* added onnx extractor

* delete onnx_if

* fix bug with fake_outputs

* Fix test

* Fix control_flow and fix commentaries

* create method results_mapping_and_finding_fake_outputs(output_nodes_in_subgraph,

* [GPU] Fixed 'assigned to self' error in loop_inst.h (#7126)

* [GPU] Fix build for gcc 10 (#7142)

* [GNA] Set input scale factors for imported model (#7139)

* add doc:'Paddle_Support.md' (#7122)

* add doc:'Paddle_Support.md'

* Apply suggestions from code review

Co-authored-by: Tatiana Savina <tatiana.savina@intel.com>

* Apply suggestions from code review

* Update docs/IE_DG/Paddle_Support.md

Co-authored-by: Tatiana Savina <tatiana.savina@intel.com>

Co-authored-by: Tatiana Savina <tatiana.savina@intel.com>

* Remove local configs and it's copying to bin/ for stress tests (#7131)

* Moved DEPRECATION macro and ITT domains to ov namespace (#7153)

* Moved DEPRECATION macro and ITT domains to ov namespace

* Fixed code style

* Enable NormalizeL2Fusion and LeakyReluFusion inside MOC (#7096)

* Enable NormalizeL2Fusion inside MOC

* Fix NormalizewL2 decomposition (KeepDims=True)

* Add support for ONNX Crop operator (#6956)

* Review/update spec for NotEqual operation (#6797)

* Hiding the problem, Validate() changes 'function'

* Review/update spec for NotEqual operation

* Remove unnecessary edits not related to the ticket

* Removing the extra word binary for the short description

* Re-writing detailed description

* Correcting punctuation docs/ops/comparison/NotEqual_1.md

Co-authored-by: Tatiana Savina <tatiana.savina@intel.com>

* Specifying auto_broadcast in the short description is similar to Equal spec

* The range of values for auto_brodcast is similar to Equal spec and includes the missing pdpd

Co-authored-by: Tatiana Savina <tatiana.savina@intel.com>

* Moved DiscreteTypeInfo to ov namespace (#7127)

* Moved DiscreteTypeInfo to new opset

* Revert old header

* Fixed code style

* Revise CTCLoss OP (#6953)

* Add visitor test to CTCLoss

* Add CTC Loss SSLT

* Add CTC Loss template tests

* Use ngraph rtti macros

* Code style fix

* Enable PriorBoxClustered tests (#7078)

* CumSum spec revision (#6966)

* Update detailed description

* Update exclusive attribute description

* Update Inputs/Outpu description

* Update types

* Update descriptions

* Update data input rank info

* Added common.hpp file with aliases (#7158)

* CumSum reference implementation revision (#6915)

* New CumSum implementation init

* Unified ndim approach

* Move transpose to separate function

* Move transpose to original to separate function

* Move slice_count calculation to function

* Negative axes support

* Refactor redundant copy

* Changed copy to move

* Temp more backend tests

* Add const to shape arg

* Use span for slices calculation

* Remove unused headers

* CumSum new ref tests

* Add more ref tests

* Add all cumsum modes ref tests

* new optimized cum_sum reference

* Add reverse mode

* Optimized cumsum ref

* Remove deprecated cumsum backend tests

* Add more CumSum reference tests

* Simplify CumSum shared layer tests SetUp

* Replace auto to size_t in loop

* Change static_cast to T{}

* [LPT] MarkupCanBeQuantized: handled unsupported concat (#7045)

* [LPT] MarkupCanBeQuantized: added check on unsupported concat

* [LPT] ConcatTransformation: added test-case with unsupported concat and convolution

* [LPT] added test on rtInfo check for unsupported concat

* [LPT] ConcatTransformation: added test-case with unsupported axis to plugin tests

* CVS-56144 Enable all OMZ scope (#7084)

* Install layer tests with CMake (#6892)

* add CMakeLists.txt

* add copyright docstring

* add newline after copyright

* set target name

* change TARGET to DIRECTORY

* Rename layer tests dir to avoid name conflict

* cmakelists.txt final version

* Change destination to tests\layer_tests_openvino

* Add cmake_minimum_required to CMakeLists.txt

* Update CMakeLists.txt

* ReverseSequence specification refactored (#7112)

* ReverseSequence specification refactored

* Change attribute description to avoid confusion

* Allow seq_lenghts input to be of floating-point precision

* MemCheck add INT8 models to pre-commit (#7166)

* updated desktop configs with int8 models

* updated desktop reference configs with actual values

* added commit comments

* parametrize proxy (#7174)

* Updated list of supported operations. (#6981)

* Updated list of supported layers.

* Removed Crop, softsign from Kaldi list.

* Updated limitations.

* Corrected limitations.

* Updated limitations.

* Added Einsum, corrected Where.

* Apply suggestions from code review

Co-authored-by: Anastasiya Ageeva <anastasiya.ageeva@intel.com>

Co-authored-by: Anastasiya Ageeva <anastasiya.ageeva@intel.com>

* [MO] turn on MarkSubGraphsWithCorrectLayout for TF NCHW (#7150)

* turned on MarkingSubgraphsWithCorrectLayout for TF NCHW

* restricted MarkSubgraphsWithCorrectLayout.py only to TF

* added comments why need to MarkSubgraphsWithCorrectLayout even for TF NCHW models

* [CPU][TESTS][LPT] MatMulTransformations test-cases removed from skip config (#7181)

* Fixed ngraph_onnx_importer compatibility target creation for older cmake (3.10) (#7176)

* [GPU] Fix clBuildProgram failure with ssd_mobilnet_v1_coco and batch=256 (#7121)

* Fix v0::MVN default constructor (#7175)

* [GPU] Fixes for correct MultiDevice plugin and inference request behavior (#7161)

* Fix op category section in operations spec (#7130)

* add ngraph::pass::LSTMCellDecomposition as mandatory (#7028)

* add ngraph::pass::LSTMCellDecomposition as mandatory

* move LSTMCellDecomposition just after CommonOptimizations before all convert opset transformations

* code review fixes: add flag that prevents some legacy transformations if their ngraph-based analogues were executed

* remove isNgraphPassesUsed from  ModelQuantizer

* cleanups

* [IE] Convert to unsigned NMS:0 ->Gather path (#6474)

* inserted Convert to unsigned

* moved declarations from hpp into cpp, specification corrected

* added static const modifier

* updated convert specification

* minor corrections

* split into 3 passes(Init, Propogate, Update), renamed final pass to ConvertNmsGatherPathToUnsigned

* added description why transformation is needed

* added matcher for several NMS versions, removed TRANSFORMATIONS_API macros from cpp

* applied comments:
- used GraphRewrite instead of FunctionPass
- simplified some expressions
- corrected case when Converts output goes to multiple nodes
- added to MOC transformations
- other minor corrections

* removed redundant namespace prefixes

* fixed #include <ngraph/pass/graph_rewrite.hpp>

* removed matcher_scope, debug code, and redundant dynamic_cast

* [nG] [IE] use GatherBase in negative indices resolver (#7145)

* updated pattern matcher into GatherBase in negative indices resolver, so that it is triggered in all versions of operation

* copy_runtime_info fix

* added constant folding

* Nested loop (#6710)

* initial changes to support nested loop

* fixed issues

* fixed nested loop extraction

* added comments

* removed unneeded comments

* review fix

* added tests

* turned off loop tests on GPU

* set xfail for TF tests

* removed TF test to move it in another repo

* fix typo in comment

* move duplicated code to separate functions;
added asserts

* add function for onnx constant creation;
add function to create body of loop
add comments to test

* move main change for nested loop to separate function

* install necessary dirs for tests (#7044)

* install necessary dirs to tests

* rem RUNTIME from install step

* fix paths

* fix install paths

* fix install paths: add destination dirs

* add pandas

* fix requirements conflict - change pytest version to ~5

* remove comment from requirements.txt

* upd numpy version

* Added openvino infer request API (#7151)

* [CPU] Removed eltwise overhead on execution stage (#6760)

* [GNA] For similar records, the pattern length was increased to 4  in the algorithm for determining infinite cycles. (#7165)

* for similar records, the pattern length was increased to 4

* Added comments

* [CPU] Enable direct copy implementation for u8->u8 reorder. (#7043)

* [CPU] Fix not expected No-Preprocess Exception with RGB to BGR conversion (#6954)

* [CPU] Avoid inserting additional transpose + reorder after RNN node. (#5921)

* [MO] Replacing StridedSlice with Squeeze/Unsqueeze (#6693)

* added reinterp_shape parameter to tf ss extractor

* removed reinterp_shape

* added transformation to replace ss

* updated bom

* fix for e2e tests

* updated a case when shrink_axis_mask and new_axis_mask are both initialized

* unittests

* added comments

* updated graph_condition

* comments resolving

* updated the case, when shrink_axis_mask and new_axis_mask are both initialized

* added layer tests for squeeze/unsqueeze cases

* remove case when shrink and new axis masks are both set

* [VPU] Added ConvertGather7ToGather1 pass to frontend (#7183)

This pr adds ConvertGather7ToGather1 pass to frontend before MergeGatherGatherElements pass, to make it so that when MergeGatherGatherElements is ran, any v7::Gather will be replaced with v1::Gather

* [MO] Add transformation for single CTCGreedyDecoder operation (#7023)

* Add transformation for single CTCGreedyDecoder operation

* Fix style in op specification

* Update transformation logic

* refactor old tests and add tests for new transformation

* Move tf specific front transformations to tf folder

* Update transformation logic and comments

* Add run_after function and update comments

* Add output_sparse_format attribute to extractor

* Update transformation conditions and tests

* Fix incorrect comment

* Move sparse_to_dense_replacer to front/tf folder to fix problems with class registration

* Update import

* Update output ports handling in transformation

* Update test

* Fix BOM file

* Update pattern for ctcloss transformation

* Fix and refactor tests for ctcloss transform

* Update transformation conditions

* Add support opset11 for gemm normalizer (#6733)

* Add support opset11 for gemm normolizer

* Add layer test for gemm opset 11

* Fix layer test

* Fix layer test

* Refactoring according to code review

* Fix

* Update biases norm

* Refactoring matmul norm

* Fix accoding to review

* Fix alpha parameter

* Fix variable naming

* Refactoring according to code review

* Add support for ONNX RandomUniform and RandomUniformLike ops (#7190)

* remove adaptive pool2d shape check in ngraph paddle frontend (#7074)

* remove adaptive pool2d shape check in ngraph paddle frontend

* add ngraph paddle frontend dynamic pool2d test

* Revise ReverseSequence reference implementation (#7117)

* ReverseSequence ngraph op shell revision with type_prop tests

* Add attribute count check in visitor test

* Refactor backend tests to template plugin test with reference values

* Rename cpu SLT instances

* Add op to list of trusted operations

* Rewrite validation check for input type due to backward compatibility

* Reference implementation speed up by replacing index function call of CoordinateTransform by precalculated strides

* Moved attribute_adapter, attribute_visitor files to ov namespave (#7179)

* Fixed nGraph build

* Fixed nGraph unit tests

* Fixed func tests

* Fix some operators

* Fixed build

* Try to fix specialization in different namespace

* Try to fix build

* Fixed element_type

* memleaks multimodel supporting

* revert rebase mistake

* add newline at the end of config file

* fix log messages

* refine memelaks test case class

* remove temporary decision designed to  save in memory pipeline functions parameters

* code consistency

* rework example of new memleak tests config format

* oop in testcases

* mistype

* set num of iterations in example test config to previous value

* add multiproc stress unit tests

* Add more cases

* remove unique_ptr test objects saving logic

* switch memleak test configs to new format

* swith weekly memleak test config to new format

* Clarify new get_testdata script arg

* clang-format

* wrong changes

* Add docstring to generateTestsParamsMemLeaks()

* add explanation what update_item_for_name() doing

* Autodetect stress framework while parsing models

* adjust the wording

* Shorten test cases names

* fix get_testdata for memcheck tests

Co-authored-by: Mateusz Bencer <mateusz.bencer@intel.com>
Co-authored-by: Ilya Churaev <ilya.churaev@intel.com>
Co-authored-by: Vladislav Golubev <vladislav.golubev@intel.com>
Co-authored-by: Sergey Shlyapnikov <sergey.shlyapnikov@intel.com>
Co-authored-by: Vladimir Paramuzov <vladimir.paramuzov@intel.com>
Co-authored-by: Ilya Sharikov <ilya.sharikov@intel.com>
Co-authored-by: Michał Karzyński <michal.karzynski@intel.com>
Co-authored-by: Tomasz Dołbniak <tomasz.dolbniak@intel.com>
Co-authored-by: Daria Mityagina <daria.mityagina@intel.com>
Co-authored-by: Sergey Lyubimtsev <sergey.lyubimtsev@intel.com>
Co-authored-by: Anton Chetverikov <Anton.Chetverikov@intel.com>
Co-authored-by: Shoujiang Ma <shoujiang.ma@intel.com>
Co-authored-by: Yury Gaydaychuk <yury.gaydaychuk@intel.com>
Co-authored-by: Vitaliy Urusovskij <vitaliy.urusovskij@intel.com>
Co-authored-by: Rafal Blaczkowski <rafal.blaczkowski@intel.com>
Co-authored-by: Alexandra Sidorova <alexandra.sidorova@intel.com>
Co-authored-by: Katarzyna Mitrus <katarzyna.mitrus@intel.com>
Co-authored-by: Elizaveta Lobanova <elizaveta.lobanova@intel.com>
Co-authored-by: Eugeny Volosenkov <eugeny.volosenkov@intel.com>
Co-authored-by: Paul Youngsoo Ahn <paul.y.ahn@intel.com>
Co-authored-by: Mikhail Ryzhov <mikhail.ryzhov@intel.com>
Co-authored-by: Liu Bo <bo4.liu@intel.com>
Co-authored-by: Tatiana Savina <tatiana.savina@intel.com>
Co-authored-by: Olesya Martinyuk <olesya.martinyuk@intel.com>
Co-authored-by: Gleb Kazantaev <gleb.nnstu@gmail.com>
Co-authored-by: Nikita Semaev <nikita.semaev@intel.com>
Co-authored-by: Bartosz Lesniewski <bartosz.lesniewski@intel.com>
Co-authored-by: Anton Pankratv <anton.pankratov@intel.com>
Co-authored-by: Anastasiia Urlapova <anastasiia.urlapova@intel.com>
Co-authored-by: Gabriele Galiero Casay <gabriele.galiero.casay@intel.com>
Co-authored-by: Anastasia Popova <anastasia.popova@intel.com>
Co-authored-by: Anastasiya Ageeva <anastasiya.ageeva@intel.com>
Co-authored-by: Pavel Esir <pavel.esir@intel.com>
Co-authored-by: Maksim Shabunin <maksim.shabunin@gmail.com>
Co-authored-by: Andrew Kwangwoong Park <andrew.kwangwoong.park@intel.com>
Co-authored-by: Mikhail Letavin <mikhail.letavin@intel.com>
Co-authored-by: Evgeny Kotov <evgeny.kotov@intel.com>
Co-authored-by: Svetlana Dolinina <svetlana.a.dolinina@intel.com>
Co-authored-by: Victor Kuznetsov <victor.kuznetsov@intel.com>
Co-authored-by: Dmitrii Khurtin <dmitrii.khurtin@intel.com>
Co-authored-by: Ivan Novoselov <ivan.novoselov@intel.com>
Co-authored-by: Aleksandr Pertovsky <aleksandr.pertovsky@intel.com>
Co-authored-by: Nikolay Shchegolev <nikolay.shchegolev@intel.com>
Co-authored-by: Yegor Kruglov <yegor.kruglov@intel.com>
Co-authored-by: Polina Brzezinskaya <polina.brzezinskaya@intel.com>
Co-authored-by: iliya mironov <iliya.mironov@intel.com>
Co-authored-by: mei, yang <yang.mei@intel.com>
2021-09-20 11:47:34 +03:00
Ilya Lavrenov
44186c31e4 Fixed path to setupvars.sh ti readme (#7537) 2021-09-17 05:20:28 +03:00
Ilya Sharikov
5847b35ed2 Make time && stress tests independent from IEDeveloperPackage (#7411)
* Specify own CXX configuration for time && stress tests

* Included os_flags for build gflags

* Updated README

* Updated commands for build tests in README

* Use new cmake config
2021-09-16 12:54:41 +03:00
Alexander Shchepetov
cb80764f85 Add stress unit tests with several processes to config (#7451)
* add multiproc stress unit tests

* Add more cases

* Shorten test cases

* Update desktop_test_config.xml
2021-09-16 12:06:38 +03:00
Alina Kladieva
fda3f5d237 [requirements] Set TF to 2.5.0 (#6620)
* [requirements] Set TF to 2.5.0

* [ngraph|paddlepaddle|requirements] Gast to 0.4.0

(required for TensorFlow 2.5)

* [ stress_tests/scripts/requirements] Upd versions

* [time_tests/test_runner/requirements] Upd versions

* [ngraph|paddle|requirements] Paddle strict major

* Gast version to 0.3.3

* Update requirements_dev.txt
2021-09-14 18:05:18 +03:00
Ilya Sharikov
4aad638d15 Fixed test runner (#7498) 2021-09-14 11:07:21 +03:00
Ilya Sharikov
f44369ce4e Updated requirements (#7397) 2021-09-13 08:50:23 +03:00
Victor Kuznetsov
4d377901bf Move all utils to common folder (#7303)
* move all utils to common folder

* add utils install in CMakeLists.txt

* revert plugin utils

* add log info: test

* add logging info: test

* test imports

* change imports: test

* fix file name
2021-09-07 23:02:10 +03:00
Victor Kuznetsov
b3428b5312 update references for memcheck pre-commit (refs from 2021.4) (#7063)
* update references for memcheck pre-commit (refs from 2021.4)

* add distro==1.5.0

* merge master

* upd only gpu refs

* upd config memcheck
2021-09-01 18:06:39 +03:00
Victor Kuznetsov
1f4664162a install necessary dirs for tests (#7044)
* install necessary dirs to tests

* rem RUNTIME from install step

* fix paths

* fix install paths

* fix install paths: add destination dirs

* add pandas

* fix requirements conflict - change pytest version to ~5

* remove comment from requirements.txt

* upd numpy version
2021-08-24 00:39:12 +03:00
Olesya Martinyuk
a052b07fe6 MemCheck add INT8 models to pre-commit (#7166)
* updated desktop configs with int8 models

* updated desktop reference configs with actual values

* added commit comments
2021-08-20 12:25:59 +03:00
Olesya Martinyuk
133b3b6468 Remove local configs and it's copying to bin/ for stress tests (#7131) 2021-08-19 12:57:47 +03:00
Daria Ilina
5292de5338 Reorganize work with openvino/thirdparty (Copied from PR6744) (#6880)
* Copied PR6744

* Added CMakeLists.txt into gflags

* Return gflags into .gitmodules

* Added CMakeLists.txt into gtest

* fix: remove extra gflags and gtests from .gitmodules

* Change syntax in set gtest_targets

* Make gtest/CMakeLists.txt as in PR6744 for pre-commit experiment

* Update gtest/CMakeLists.txt

* Change version of gtest repo

* Return gtest info into .gitmodules

* Update gflags version to currently used
2021-08-11 11:33:52 +03:00
Alexander Shchepetov
e327c34af0 Add StressMemLeak test with 2 streams (#6964)
* StressMemLeakTests add tests with streams

* little fixes

* Code consistency
2021-08-10 17:04:18 +03:00
Ilya Sharikov
6ee9285fe5 Added Windows OS support to MemCheckTests (#6684)
* Added Windows OS support to MemCheckTests

* Move system headers to cpp file

* Moved includes for windows to cpp file. Was rewrited function to get memory info

* Was rewrite functions for getting information about memory

* Moved implementation run_in_process to cpp file

* Fixed implementation of run_in_process
2021-07-28 13:06:16 +03:00
Ilya Sharikov
252483bb83 Common tests library for shared functionality (#6578) 2021-07-23 10:37:35 +03:00
iliya mironov
e1bffcc36c Add json validate (#6449)
* Add json validate

* Fix json schema

* Fix schema loader

* Add unit test

* Update bom file

* Update all requarments

* Update dev requarments

* Update requrments

* Update path to schema

* Update schema

* Add some unit tests

* Move schema to root dir

* Update schema path in bom file

* Fix unit test

* Fix bom

* Change path to schema

* update setup

* Fix setup

* Fix mo args test

* Refactoring some code

* Refactoring according to review

* Update sort imports

* Remove id attribute from schema

* Refactoring validator

* Fix according to review

* Move schema from json to dict. Update unit tests.

* Fix BOM file

* Update bom file
2021-07-22 21:12:44 +03:00
Valentin Dymchishin
55d9e85dc6 [54908] Update MemCheckTests references in nightly config (#6713)
* [54908] Update MemCheckTests references for GPU

* [54908] Update MemCheckTests references in nightly config
2021-07-22 12:50:07 +03:00
Vitaliy Urusovskij
a92a737ba0 Develop installation rules for time and stress tests (#6649)
* Prepare `install` rule for time_tests

* Prepare `install` rule for stress tests
2021-07-16 16:30:20 +03:00
Valentin Dymchishin
fe8ecd72ff Update MemCheckTests references for GPU in precommit (#6647) 2021-07-15 10:59:41 +03:00
Victor Kuznetsov
4efe708023 Make DB query for MemCheckTests optional in precommit (#6526)
* add try/catch

* add error msg
2021-07-07 14:38:49 +03:00
Ilya Lavrenov
fc7f80a34e CVS-34900: updated pugixml to v1.11.4 (#6301)
* Added pugixml as submodule

* CVS-34900: updated pugixml to v1.11.4

* Fixed link with pugixml

* USe pugixml::static

* Try to fix bug

* Removed GITHUB_PULL_REQUEST

* Replaced  OpenVINO_MAIN_SOURCE_DIR -> OpenVINO_SOURCE_DIR

* Removed some usages of IE_MAIN_SOURCE_DIR

* Use ngraph target directly
2021-07-02 11:36:31 +03:00
Ilya Lavrenov
07f94ea602 Minimized usage of IE_MAIN_SOURCE_DIR (#6422)
* Minimized IE_MAIN_SOURCE_DIR hardcode

* Used COMPILE_OPTIONS instead of COMPILE_FLAGS

* Fixed compilation

* Enabled NGRAPH_DYNAMIC_COMPONENTS_ENABLE by default

* Fixes

* Moved GNA related file

* Fixed backend compilation

* Fixed Windows for ngraph

* Fixed <root>/tests build

* More updates

* Fixed scripts install

* Fixed Windows

* Fixed Windows
2021-06-30 18:15:41 +03:00
Victor Kuznetsov
a1eb5b1fd5 Change target branch field (fix null) (#6433) 2021-06-30 12:53:17 +03:00
Ilya Lavrenov
2f432980a0 Moved gflags, preprocessing dependencies to root (#6309) 2021-06-23 09:53:18 +03:00
Ilya Lavrenov
ad997410c8 Port to master (#6279)
* add single_layer_test for Interpolate-1 (#6133)

* Fixed InferenceEngineConfig.cmake usage in include() (#6136)

* Deprecated API updates (#6252)

* Fixed links to OMZ / DL Streamer (#6257)

* Added doxygen deprecation for LowLatency

Co-authored-by: Elena Gvozdeva <elena.gvozdeva@intel.com>
2021-06-22 17:43:17 +03:00
Ilya Lavrenov
fa2f9c5201 Migrated to official GoogleTest repo (#6286)
* Move gtest to <root>/wqthirdparty

* Fixed inference engine tests

* Fixed unit-tests

* Fixed GPU

* Fixed clDNN_unit_tests compilation

* Reverted ngraph changes

* Fixed VPU tests

* Fixed deprecated tests compilation

* Removed OpenVINO clone

* Added public submodule

* Removed

* Fixed Windows

* More updates for INSTANTIATE_TEST_SUITE_P

* Use release-1.10.0

* Removed ngraph copy of gtest

* Revert "Removed ngraph copy of gtest"

This reverts commit ec9fe08d79.

* Fixes for TYPED_TEST_CASE

* Fixed GNA tests

* Updated submodule

* Updaed index

* TMP disabled tests

* Revert changes and fix compilation errors

* Fixed caching tests

* Revert back

* Revert back all

Co-authored-by: Michael Nosov <mikhail.nosov@intel.com>
2021-06-22 17:39:39 +03:00
Victor Kuznetsov
089f76cc7f Add branch field to submit to DB in MemCheck/TimeTests (#6073) 2021-06-11 12:57:01 +03:00
Alexander Shchepetov
503d18c80f Enable MYRIAD in stress tests (#6026) 2021-06-08 12:47:20 +03:00
Vitaliy Urusovskij
291a80c84a Make stress and time tests build dependent from gflags from samples (#5883)
* Make timetests dependent on IE gflags 3rdparty from samples/

* Make stress tests dependent on IE gflags 3rdparty from samples/
2021-06-04 10:27:23 +03:00
Vitaliy Urusovskij
97a9a76ff9 Fix parsing of threads in stress/memory tests (#5695)
* Fix parsing of threads in stress/memory tests

* Replace `char*` with `string` due `char*` can't be modified
2021-05-26 02:04:06 +03:00