Commit Graph

189 Commits

Author SHA1 Message Date
Victor Kuznetsov
9e79f997e4 [Memory tests] Add timeout to proc_exec (#7942)
* add timeout to proc_exec

* add framework field for db

* upd db fields name
2021-10-13 14:25:44 +03:00
Victor Kuznetsov
6d9a7a108e Stress, Memory tests update to comply with new OMZ tools layout (#7886)
* work with omz: change hardcoded paths for memory_tests, fix paths for memcheck get_testdata.py script

* change paths to omz tools

* revert mo changes

* remove mo from arguments

* remove extra var from cmd string

* remove is_db_used check

* add timeout to proc_exec

* merge master
2021-10-13 10:42:00 +03:00
Alexander Shchepetov
268246e3bc single-model test configs (#7734) 2021-10-04 11:14:13 +03:00
Victor Kuznetsov
dc1a1d70e8 [Memory_tests] Work with DB (#7492)
* uncomment upload db func

* upd CMakeLists.txt

* fix template path

* fix CmakeLists

* fix imports

* fix work with cmd and with models our_dir

* add quotation marks

* fix quotation marks

* add base config for test

* upd work with db instance

* revert changes with test config
2021-10-01 15:44:26 +03:00
Ilya Sharikov
c2ad09472c Update path to MO (#7575)
* Updated path to MO

* Update text message

* Fixed cmd for running on all platform
2021-09-22 18:53:22 +03:00
Ilya Sharikov
d725a17561 Add CMakeLists for install CC_tests (#7541) 2021-09-21 10:06:54 +03:00
Victor Kuznetsov
5dab18d995 change references for memcheck pre-commit (#7558) 2021-09-20 19:34:19 +03:00
Roman Donchenko
8598ce89a3 Add missing spaces between words in string literals (#7540)
And in one case, a missing period.
2021-09-20 15:38:49 +03:00
Alexander Shchepetov
03cc662717 Static test cases definition + supporting multi-model cases in MemLeaks tests (#7378)
* add multimodel memleaks test runner

* Add support for is_equal_data, get_source_tensor, get_target_tensor methods in ONNX FE API (#6991)

* Change ngraph public api (#6920)

* Moved nGraph function

* Added legacy nGraph function

* Moved export API

* Moved variant

* Added old header for backward compatibility

* Introduce define

* [LPT] LP Transformations refactoring after dynamic shapes support (#6950)

* [LPT] Transformations refactoring after dynamic shapes support

* [LPT] ReshapeTransformation: 2D->2D fix

* [LPT] fixes after review

* [GPU] Fix ScatterNDUpdate unit tests (#7103)

* Deprecate ngraph file utils. Need to have common functions (#7105)

* [GPU] Get rid of memory alloc for input_layout in internal networks (#6897)

* Renamed component name (#7110)

* Propose new MaxPool-8 operation (#5359)

* MaxPool-8: pads_value attribute removal from the operator definition (#7119)

* Remove deprecated option and enable compilation without device (#6022)

* Build openvino wheel package from setup.py (#7091)

* Added ability to build wheel package by executing `setup.py bdist_wheel`

* fix linter issues

* fix formating

* remove blank line

* Support unregistered operations in MO IR Reader (#6837)

* Add support for unregistred operations in MO IR Reader

* Remove commented lines

* Add shapes equality check

* Update comments

* Update groupconv_to_conv function to support case with multiple destinations

* Add ir_data_attrs attribute to restored layers

* Update copy_shape_infer function to new graph api

* Add attribute IE to unsuppurted operations to save their attributes

* Fix wrong attribute name

* Update commentary

* Partially revert updating to new Graph API to fix regression, add appropriate comments

* Update code comments

* Rename copy_shape_infer function and add more comments

* First stage of the AUTO-MULTI merge: redirecting AUTO to the MULTI device plugin (#7037)

* Redirect -d AUTO to MULTI device plugin

Signed-off-by: Shoujiang Ma <shoujiang.ma@intel.com>

* Modify AUTO tests with MULTI config

Signed-off-by: Shoujiang Ma <shoujiang.ma@intel.com>

* Fix CI

Signed-off-by: Shoujiang Ma <shoujiang.ma@intel.com>

* Fix bug: CVS-62424

Signed-off-by: Shoujiang Ma <shoujiang.ma@intel.com>

* Add some tests for AUTO

Signed-off-by: Shoujiang Ma <shoujiang.ma@intel.com>

* Add select device logic to MULTI

Signed-off-by: Shoujiang Ma <shoujiang.ma@intel.com>

* Fix extract device name bug

Signed-off-by: Shoujiang Ma <shoujiang.ma@intel.com>

* Address reviewer's comment

Signed-off-by: Shoujiang Ma <shoujiang.ma@intel.com>

* Delete AUTO plugin source code

Signed-off-by: Shoujiang Ma <shoujiang.ma@intel.com>

* [CPU] Deform. conv. - reference enforced (#6945)

* [CPU] Bump up MKLDNN version to get fix of c26453 warning (#7089)

* OpenVINO ONNX CI Azure - update onnx/models on demand only (#7125)

* [CPU] Added improvements for StridedSlice (#6658)

* Removal of FusedOp inheritance leftovers (#7113)

* Remove FusedOp from v0::Gelu

* Update v0::Gelu NGRAPH_RTTI_DECLARATION

* Enable gelu type_prop tests

* Remove FusedOp from v0::MVN

* Remove FusedOp from HardSigmoid

* Remove FusedOp from LSTMSequence

* Remove supress deprecated

* Add missed NGRAPH_OP_SCOPE to v0 Gelu and HardSigmoid

* Move ngraph::element::Type to ov namespace (#7124)

* Moved ngraph::Type -> ov::Type

* Revert original files

* [GNA] Fix order of SwapMatMulInput transformations (#7137)

* Moved Dimension, PartialShape, Interval, Rank to ov namespace (#7136)

* Mo implementation for If with tf extractor (#6662)

* Add tf2.x impl for If

* Fix ir_engine

* Fix opset

* Fix BOM file

* Added new test

* Fix comments

* Add subgraph_utils

* Fix comments

* Fix transform

* code refactoring

* Fix description

* rewrite support for empty tensor in if

* added onnx extractor

* delete onnx_if

* fix bug with fake_outputs

* Fix test

* Fix control_flow and fix commentaries

* create method results_mapping_and_finding_fake_outputs(output_nodes_in_subgraph,

* [GPU] Fixed 'assigned to self' error in loop_inst.h (#7126)

* [GPU] Fix build for gcc 10 (#7142)

* [GNA] Set input scale factors for imported model (#7139)

* add doc:'Paddle_Support.md' (#7122)

* add doc:'Paddle_Support.md'

* Apply suggestions from code review

Co-authored-by: Tatiana Savina <tatiana.savina@intel.com>

* Apply suggestions from code review

* Update docs/IE_DG/Paddle_Support.md

Co-authored-by: Tatiana Savina <tatiana.savina@intel.com>

Co-authored-by: Tatiana Savina <tatiana.savina@intel.com>

* Remove local configs and it's copying to bin/ for stress tests (#7131)

* Moved DEPRECATION macro and ITT domains to ov namespace (#7153)

* Moved DEPRECATION macro and ITT domains to ov namespace

* Fixed code style

* Enable NormalizeL2Fusion and LeakyReluFusion inside MOC (#7096)

* Enable NormalizeL2Fusion inside MOC

* Fix NormalizewL2 decomposition (KeepDims=True)

* Add support for ONNX Crop operator (#6956)

* Review/update spec for NotEqual operation (#6797)

* Hiding the problem, Validate() changes 'function'

* Review/update spec for NotEqual operation

* Remove unnecessary edits not related to the ticket

* Removing the extra word binary for the short description

* Re-writing detailed description

* Correcting punctuation docs/ops/comparison/NotEqual_1.md

Co-authored-by: Tatiana Savina <tatiana.savina@intel.com>

* Specifying auto_broadcast in the short description is similar to Equal spec

* The range of values for auto_brodcast is similar to Equal spec and includes the missing pdpd

Co-authored-by: Tatiana Savina <tatiana.savina@intel.com>

* Moved DiscreteTypeInfo to ov namespace (#7127)

* Moved DiscreteTypeInfo to new opset

* Revert old header

* Fixed code style

* Revise CTCLoss OP (#6953)

* Add visitor test to CTCLoss

* Add CTC Loss SSLT

* Add CTC Loss template tests

* Use ngraph rtti macros

* Code style fix

* Enable PriorBoxClustered tests (#7078)

* CumSum spec revision (#6966)

* Update detailed description

* Update exclusive attribute description

* Update Inputs/Outpu description

* Update types

* Update descriptions

* Update data input rank info

* Added common.hpp file with aliases (#7158)

* CumSum reference implementation revision (#6915)

* New CumSum implementation init

* Unified ndim approach

* Move transpose to separate function

* Move transpose to original to separate function

* Move slice_count calculation to function

* Negative axes support

* Refactor redundant copy

* Changed copy to move

* Temp more backend tests

* Add const to shape arg

* Use span for slices calculation

* Remove unused headers

* CumSum new ref tests

* Add more ref tests

* Add all cumsum modes ref tests

* new optimized cum_sum reference

* Add reverse mode

* Optimized cumsum ref

* Remove deprecated cumsum backend tests

* Add more CumSum reference tests

* Simplify CumSum shared layer tests SetUp

* Replace auto to size_t in loop

* Change static_cast to T{}

* [LPT] MarkupCanBeQuantized: handled unsupported concat (#7045)

* [LPT] MarkupCanBeQuantized: added check on unsupported concat

* [LPT] ConcatTransformation: added test-case with unsupported concat and convolution

* [LPT] added test on rtInfo check for unsupported concat

* [LPT] ConcatTransformation: added test-case with unsupported axis to plugin tests

* CVS-56144 Enable all OMZ scope (#7084)

* Install layer tests with CMake (#6892)

* add CMakeLists.txt

* add copyright docstring

* add newline after copyright

* set target name

* change TARGET to DIRECTORY

* Rename layer tests dir to avoid name conflict

* cmakelists.txt final version

* Change destination to tests\layer_tests_openvino

* Add cmake_minimum_required to CMakeLists.txt

* Update CMakeLists.txt

* ReverseSequence specification refactored (#7112)

* ReverseSequence specification refactored

* Change attribute description to avoid confusion

* Allow seq_lenghts input to be of floating-point precision

* MemCheck add INT8 models to pre-commit (#7166)

* updated desktop configs with int8 models

* updated desktop reference configs with actual values

* added commit comments

* parametrize proxy (#7174)

* Updated list of supported operations. (#6981)

* Updated list of supported layers.

* Removed Crop, softsign from Kaldi list.

* Updated limitations.

* Corrected limitations.

* Updated limitations.

* Added Einsum, corrected Where.

* Apply suggestions from code review

Co-authored-by: Anastasiya Ageeva <anastasiya.ageeva@intel.com>

Co-authored-by: Anastasiya Ageeva <anastasiya.ageeva@intel.com>

* [MO] turn on MarkSubGraphsWithCorrectLayout for TF NCHW (#7150)

* turned on MarkingSubgraphsWithCorrectLayout for TF NCHW

* restricted MarkSubgraphsWithCorrectLayout.py only to TF

* added comments why need to MarkSubgraphsWithCorrectLayout even for TF NCHW models

* [CPU][TESTS][LPT] MatMulTransformations test-cases removed from skip config (#7181)

* Fixed ngraph_onnx_importer compatibility target creation for older cmake (3.10) (#7176)

* [GPU] Fix clBuildProgram failure with ssd_mobilnet_v1_coco and batch=256 (#7121)

* Fix v0::MVN default constructor (#7175)

* [GPU] Fixes for correct MultiDevice plugin and inference request behavior (#7161)

* Fix op category section in operations spec (#7130)

* add ngraph::pass::LSTMCellDecomposition as mandatory (#7028)

* add ngraph::pass::LSTMCellDecomposition as mandatory

* move LSTMCellDecomposition just after CommonOptimizations before all convert opset transformations

* code review fixes: add flag that prevents some legacy transformations if their ngraph-based analogues were executed

* remove isNgraphPassesUsed from  ModelQuantizer

* cleanups

* [IE] Convert to unsigned NMS:0 ->Gather path (#6474)

* inserted Convert to unsigned

* moved declarations from hpp into cpp, specification corrected

* added static const modifier

* updated convert specification

* minor corrections

* split into 3 passes(Init, Propogate, Update), renamed final pass to ConvertNmsGatherPathToUnsigned

* added description why transformation is needed

* added matcher for several NMS versions, removed TRANSFORMATIONS_API macros from cpp

* applied comments:
- used GraphRewrite instead of FunctionPass
- simplified some expressions
- corrected case when Converts output goes to multiple nodes
- added to MOC transformations
- other minor corrections

* removed redundant namespace prefixes

* fixed #include <ngraph/pass/graph_rewrite.hpp>

* removed matcher_scope, debug code, and redundant dynamic_cast

* [nG] [IE] use GatherBase in negative indices resolver (#7145)

* updated pattern matcher into GatherBase in negative indices resolver, so that it is triggered in all versions of operation

* copy_runtime_info fix

* added constant folding

* Nested loop (#6710)

* initial changes to support nested loop

* fixed issues

* fixed nested loop extraction

* added comments

* removed unneeded comments

* review fix

* added tests

* turned off loop tests on GPU

* set xfail for TF tests

* removed TF test to move it in another repo

* fix typo in comment

* move duplicated code to separate functions;
added asserts

* add function for onnx constant creation;
add function to create body of loop
add comments to test

* move main change for nested loop to separate function

* install necessary dirs for tests (#7044)

* install necessary dirs to tests

* rem RUNTIME from install step

* fix paths

* fix install paths

* fix install paths: add destination dirs

* add pandas

* fix requirements conflict - change pytest version to ~5

* remove comment from requirements.txt

* upd numpy version

* Added openvino infer request API (#7151)

* [CPU] Removed eltwise overhead on execution stage (#6760)

* [GNA] For similar records, the pattern length was increased to 4  in the algorithm for determining infinite cycles. (#7165)

* for similar records, the pattern length was increased to 4

* Added comments

* [CPU] Enable direct copy implementation for u8->u8 reorder. (#7043)

* [CPU] Fix not expected No-Preprocess Exception with RGB to BGR conversion (#6954)

* [CPU] Avoid inserting additional transpose + reorder after RNN node. (#5921)

* [MO] Replacing StridedSlice with Squeeze/Unsqueeze (#6693)

* added reinterp_shape parameter to tf ss extractor

* removed reinterp_shape

* added transformation to replace ss

* updated bom

* fix for e2e tests

* updated a case when shrink_axis_mask and new_axis_mask are both initialized

* unittests

* added comments

* updated graph_condition

* comments resolving

* updated the case, when shrink_axis_mask and new_axis_mask are both initialized

* added layer tests for squeeze/unsqueeze cases

* remove case when shrink and new axis masks are both set

* [VPU] Added ConvertGather7ToGather1 pass to frontend (#7183)

This pr adds ConvertGather7ToGather1 pass to frontend before MergeGatherGatherElements pass, to make it so that when MergeGatherGatherElements is ran, any v7::Gather will be replaced with v1::Gather

* [MO] Add transformation for single CTCGreedyDecoder operation (#7023)

* Add transformation for single CTCGreedyDecoder operation

* Fix style in op specification

* Update transformation logic

* refactor old tests and add tests for new transformation

* Move tf specific front transformations to tf folder

* Update transformation logic and comments

* Add run_after function and update comments

* Add output_sparse_format attribute to extractor

* Update transformation conditions and tests

* Fix incorrect comment

* Move sparse_to_dense_replacer to front/tf folder to fix problems with class registration

* Update import

* Update output ports handling in transformation

* Update test

* Fix BOM file

* Update pattern for ctcloss transformation

* Fix and refactor tests for ctcloss transform

* Update transformation conditions

* Add support opset11 for gemm normalizer (#6733)

* Add support opset11 for gemm normolizer

* Add layer test for gemm opset 11

* Fix layer test

* Fix layer test

* Refactoring according to code review

* Fix

* Update biases norm

* Refactoring matmul norm

* Fix accoding to review

* Fix alpha parameter

* Fix variable naming

* Refactoring according to code review

* Add support for ONNX RandomUniform and RandomUniformLike ops (#7190)

* remove adaptive pool2d shape check in ngraph paddle frontend (#7074)

* remove adaptive pool2d shape check in ngraph paddle frontend

* add ngraph paddle frontend dynamic pool2d test

* Revise ReverseSequence reference implementation (#7117)

* ReverseSequence ngraph op shell revision with type_prop tests

* Add attribute count check in visitor test

* Refactor backend tests to template plugin test with reference values

* Rename cpu SLT instances

* Add op to list of trusted operations

* Rewrite validation check for input type due to backward compatibility

* Reference implementation speed up by replacing index function call of CoordinateTransform by precalculated strides

* Moved attribute_adapter, attribute_visitor files to ov namespave (#7179)

* Fixed nGraph build

* Fixed nGraph unit tests

* Fixed func tests

* Fix some operators

* Fixed build

* Try to fix specialization in different namespace

* Try to fix build

* Fixed element_type

* memleaks multimodel supporting

* revert rebase mistake

* add newline at the end of config file

* fix log messages

* refine memelaks test case class

* remove temporary decision designed to  save in memory pipeline functions parameters

* code consistency

* rework example of new memleak tests config format

* oop in testcases

* mistype

* set num of iterations in example test config to previous value

* add multiproc stress unit tests

* Add more cases

* remove unique_ptr test objects saving logic

* switch memleak test configs to new format

* swith weekly memleak test config to new format

* Clarify new get_testdata script arg

* clang-format

* wrong changes

* Add docstring to generateTestsParamsMemLeaks()

* add explanation what update_item_for_name() doing

* Autodetect stress framework while parsing models

* adjust the wording

* Shorten test cases names

* fix get_testdata for memcheck tests

Co-authored-by: Mateusz Bencer <mateusz.bencer@intel.com>
Co-authored-by: Ilya Churaev <ilya.churaev@intel.com>
Co-authored-by: Vladislav Golubev <vladislav.golubev@intel.com>
Co-authored-by: Sergey Shlyapnikov <sergey.shlyapnikov@intel.com>
Co-authored-by: Vladimir Paramuzov <vladimir.paramuzov@intel.com>
Co-authored-by: Ilya Sharikov <ilya.sharikov@intel.com>
Co-authored-by: Michał Karzyński <michal.karzynski@intel.com>
Co-authored-by: Tomasz Dołbniak <tomasz.dolbniak@intel.com>
Co-authored-by: Daria Mityagina <daria.mityagina@intel.com>
Co-authored-by: Sergey Lyubimtsev <sergey.lyubimtsev@intel.com>
Co-authored-by: Anton Chetverikov <Anton.Chetverikov@intel.com>
Co-authored-by: Shoujiang Ma <shoujiang.ma@intel.com>
Co-authored-by: Yury Gaydaychuk <yury.gaydaychuk@intel.com>
Co-authored-by: Vitaliy Urusovskij <vitaliy.urusovskij@intel.com>
Co-authored-by: Rafal Blaczkowski <rafal.blaczkowski@intel.com>
Co-authored-by: Alexandra Sidorova <alexandra.sidorova@intel.com>
Co-authored-by: Katarzyna Mitrus <katarzyna.mitrus@intel.com>
Co-authored-by: Elizaveta Lobanova <elizaveta.lobanova@intel.com>
Co-authored-by: Eugeny Volosenkov <eugeny.volosenkov@intel.com>
Co-authored-by: Paul Youngsoo Ahn <paul.y.ahn@intel.com>
Co-authored-by: Mikhail Ryzhov <mikhail.ryzhov@intel.com>
Co-authored-by: Liu Bo <bo4.liu@intel.com>
Co-authored-by: Tatiana Savina <tatiana.savina@intel.com>
Co-authored-by: Olesya Martinyuk <olesya.martinyuk@intel.com>
Co-authored-by: Gleb Kazantaev <gleb.nnstu@gmail.com>
Co-authored-by: Nikita Semaev <nikita.semaev@intel.com>
Co-authored-by: Bartosz Lesniewski <bartosz.lesniewski@intel.com>
Co-authored-by: Anton Pankratv <anton.pankratov@intel.com>
Co-authored-by: Anastasiia Urlapova <anastasiia.urlapova@intel.com>
Co-authored-by: Gabriele Galiero Casay <gabriele.galiero.casay@intel.com>
Co-authored-by: Anastasia Popova <anastasia.popova@intel.com>
Co-authored-by: Anastasiya Ageeva <anastasiya.ageeva@intel.com>
Co-authored-by: Pavel Esir <pavel.esir@intel.com>
Co-authored-by: Maksim Shabunin <maksim.shabunin@gmail.com>
Co-authored-by: Andrew Kwangwoong Park <andrew.kwangwoong.park@intel.com>
Co-authored-by: Mikhail Letavin <mikhail.letavin@intel.com>
Co-authored-by: Evgeny Kotov <evgeny.kotov@intel.com>
Co-authored-by: Svetlana Dolinina <svetlana.a.dolinina@intel.com>
Co-authored-by: Victor Kuznetsov <victor.kuznetsov@intel.com>
Co-authored-by: Dmitrii Khurtin <dmitrii.khurtin@intel.com>
Co-authored-by: Ivan Novoselov <ivan.novoselov@intel.com>
Co-authored-by: Aleksandr Pertovsky <aleksandr.pertovsky@intel.com>
Co-authored-by: Nikolay Shchegolev <nikolay.shchegolev@intel.com>
Co-authored-by: Yegor Kruglov <yegor.kruglov@intel.com>
Co-authored-by: Polina Brzezinskaya <polina.brzezinskaya@intel.com>
Co-authored-by: iliya mironov <iliya.mironov@intel.com>
Co-authored-by: mei, yang <yang.mei@intel.com>
2021-09-20 11:47:34 +03:00
Ilya Lavrenov
44186c31e4 Fixed path to setupvars.sh ti readme (#7537) 2021-09-17 05:20:28 +03:00
Ilya Sharikov
5847b35ed2 Make time && stress tests independent from IEDeveloperPackage (#7411)
* Specify own CXX configuration for time && stress tests

* Included os_flags for build gflags

* Updated README

* Updated commands for build tests in README

* Use new cmake config
2021-09-16 12:54:41 +03:00
Alexander Shchepetov
cb80764f85 Add stress unit tests with several processes to config (#7451)
* add multiproc stress unit tests

* Add more cases

* Shorten test cases

* Update desktop_test_config.xml
2021-09-16 12:06:38 +03:00
Anastasia Popova
10f0075e90 RandomUniformFusion transformation. (#7187)
* Added RandomUniformFusion transformation.

* Extended transformations for case with Convert, extended transformations for general min and max value case.

* Set to const unchanged variables.

* Apply suggestions from code review

Co-authored-by: Gleb Kazantaev <gleb.nnstu@gmail.com>

* Reformat code, small corrections.

* Added const shape checks.

* Fixed transformation for case of different const ranks.

* Added type checks.

* Apply suggestions from code review

Co-authored-by: Gleb Kazantaev <gleb.nnstu@gmail.com>

* United RandomUniformMulFusion and RandomUniformAddFusion to single transformation.

* Added negative tests.

* Used get_constant_from_source().

* Moved transformation to common fusions.

* Added const refs.

* Update inference-engine/src/transformations/src/transformations/common_optimizations/random_uniform_fusion.cpp

Co-authored-by: Gleb Kazantaev <gleb.nnstu@gmail.com>

* Changed to single class.

* Corrected IRs checks in layer tests.

* Small corrections.

Co-authored-by: Gleb Kazantaev <gleb.nnstu@gmail.com>
2021-09-16 11:07:19 +03:00
Ilya Lavrenov
0df7dab345 New IRC package structure (#6255)
* OV new package structure

* Fixes

* More fixes

* Fixed code style in ngraph tests

* Fixes

* Paths to setupvars inside demo scripts

* Fixed demo_security_barrier_camera.sh

* Added setupvars.sh to old location as well

* Fixed path

* Fixed MO install path in .co

* Fixed install of public headers

* Fixed frontends installation

* Updated DM config files

* Keep opencv in the root

* Improvements

* Fixes for demo scripts

* Added path to TBB

* Fix for MO unit-tests

* Fixed tests on Windows

* Reverted arch

* Removed arch

* Reverted arch back: second attemp

* System type

* Fix for Windows

* Resolve merge conflicts

* Fixed path

* Path for Windows

* Added debug for Windows

* Added requirements_dev.txt to install

* Fixed wheel's setup.py

* Fixed lin build

* Fixes after merge

* Fix 2

* Fixes

* Frontends path

* Fixed deployment manager

* Fixed Windows

* Added cldnn unit tests installation

* Install samples

* Fix samples

* Fix path for samples

* Proper path

* Try to fix MO hardcodes

* samples binary location

* MO print

* Added install for libopencv_c_wrapper.so

* Added library destination

* Fixed install rule for samples

* Updated demo scripts readme.md

* Samples

* Keep source permissions for Python samples

* Fixed python

* Updated path to fast run scripts

* Fixed C samples tests

* Removed debug output

* Small fixes

* Try to unify prefix
2021-09-15 16:49:11 +03:00
Anastasia Popova
cf48792134 Random Uniform MO implementation (#6694)
* Added RandomUniform operation.

* Conflicts fix.

* Fix conflicts.

* Fix conflicts.

* Added ONNX extractor, fixed FP16 conversion, added double implementation.

* int32, int64 types.

* Added initial type attribute.

* Added extractors for MxNet and TF for RandomUniformInt.

* Fixed ChangeRandomUniformOutputType transformation.

* Corrected ONNX, MxNetextractors.

* Fixed extender.

* Code style corrected, updated BOM file.

* Small correction.

* Code reformat.

* Fixed type check.

* Small corrections, code style.

* Added RandomUniform tests to manifest file.

* Include fixed.

* Code style.

* Small corrections.

* Tests fixed.

* Manifest file updated.

* Removed initial type attribute.

* Small correction.

* Fixed problem with Const types change.

* Update ngraph/core/include/ngraph/op/random_uniform.hpp

Co-authored-by: Ilya Churaev <ilyachur@gmail.com>

* Update ngraph/core/src/op/random_uniform.cpp

Co-authored-by: Ilya Churaev <ilyachur@gmail.com>

* Update ngraph/core/src/op/random_uniform.cpp

Co-authored-by: Ilya Churaev <ilyachur@gmail.com>

* Applied comments to shell implementation.

* Applied comments to shell implementation.

* Moved shell and reference to separate PR.

* Moved shell and reference to separate PR.

* Corrected comments, code refactoring.

* Fixed seed attributes.

* Corrected mxnet extractor.

* Returned RandomUniform onnx extractor.

* Small fix.

* Used generator in tests, fixed input ports count in AttributedRandomUniform.

* Temporarily added DropoutWithRandomUniformReplacer and debug output.

* Temporarily added DropoutWithRandomUniformReplacer and debug output.

* Temporarily added DropoutWithRandomUniformReplacer and debug output.

* Temporarily added DropoutWithRandomUniformReplacer and debug output.

* Moved DropoutWithRandomUniformReplacer to ngraph, removed debug output.

* Fixed wrong change.

* Fixed wrong change.

* Added check that RandomUniform is in ShapeOf subgraph.

* Added layer tests, updated supported operations list.

* Small correction.

* Fix conflicts.

* Fix conflicts.

* Small fix.

* Used const for not changing values.

* Apply suggestions from code review

Co-authored-by: Gleb Kazantaev <gleb.nnstu@gmail.com>

* Added IR check in layer tests.

* Fixed error.

* Fixed test.

* Update inference-engine/src/transformations/include/transformations/common_optimizations/dropout_with_random_uniform_replacer.hpp

Co-authored-by: Gleb Kazantaev <gleb.nnstu@gmail.com>

* Removed ShapeOf and Mul from DropoutWithRandomUniformReplacer.

* Replaced register_new_node with make_shared.

* Added fp16 test.

* Extended for RandomUniform->Convert case.

* Used modf().

* Removed modf().

* Update inference-engine/src/transformations/src/transformations/common_optimizations/dropout_with_random_uniform_replacer.cpp

Co-authored-by: Gleb Kazantaev <gleb.nnstu@gmail.com>

* Added negative tests, added nullptr check for add_const_value.

Co-authored-by: Ilya Churaev <ilyachur@gmail.com>
Co-authored-by: Gleb Kazantaev <gleb.nnstu@gmail.com>
2021-09-14 21:26:57 +03:00
Alina Kladieva
fda3f5d237 [requirements] Set TF to 2.5.0 (#6620)
* [requirements] Set TF to 2.5.0

* [ngraph|paddlepaddle|requirements] Gast to 0.4.0

(required for TensorFlow 2.5)

* [ stress_tests/scripts/requirements] Upd versions

* [time_tests/test_runner/requirements] Upd versions

* [ngraph|paddle|requirements] Paddle strict major

* Gast version to 0.3.3

* Update requirements_dev.txt
2021-09-14 18:05:18 +03:00
Andrey Somsikov
ae64b5e202 Exclude 3rd party python packages from lsan (#7489)
When executed with PYTHONMALLOC=malloc lot of leaks
reported on the 3rd parties of the python tests.
Muting those leaks.
2021-09-14 17:48:23 +03:00
Ilya Sharikov
4aad638d15 Fixed test runner (#7498) 2021-09-14 11:07:21 +03:00
Ilya Lavrenov
b373cb844b Removed information about FPGA plugin (#7474) 2021-09-13 14:01:49 +03:00
Valentin Dymchishin
07a3dc6b36 [47750] Validate conditional compilation with models from OMZ (#7207)
* [47750] Validate conditional compilation with models from OMZ

* [47750] Remove model

* [47750] Use generator expression

* [47750] Use f-strings

* [47750] Use resolve() instead of abs_path()

* [47750] Use cmd_exec() instead of subprocess.check_output()

* [47750] Use download_models fixture in test_cc_collect, test_verify

* [47750] Update prepare_models

* [47750] Update test_infer

* [47750] Add models

* [47750] Use custom logger

* [47750] Refactor prepare_models usage

* [47750] Rename model_struct to model

* [47750] Update help description

* [47750] Add function description for prepare_models, prepare_omz_model

* [47750] Move OMZ_NUM_ATTEMPTS to global scope

* [47750] Rename models to model

* [47750] Add "type" property in model

* [47750] Add default path for cache

* [47750] Remove conversion to str

* [47750] Rename prepare_models to prepared_models

* [47750] Remove redundant expand_env_vars call

* [47750] Use lower case "omz" in test_config; do not use default value

* [47750] Use only prepared_models in tests, without models in arguments

* [47750] Remove "framework" property in test_config

* [47750] Use omz_path and omz_cache_dir fixtures

* [47750] Make omz_cache_dir optional

* [47750] Remove validate_path_arg for omz_cache_dir

* [47750] Add validate_path_arg and log.warning for omz_cache_dir

* [47750] Add default value for omz_repo

* [47750] Use OMZ_MODELS_PATH environment variable

* [47750] Use tmpdir instead of OMZ_MODELS_PATH; use precision in test_id_list

* [47750] Update README.md

* [47750] Remove model_path variable

* [47750] Remove try/except for omz_path

* [47750] Rename omz_path to omz_repo
2021-09-13 11:47:04 +03:00
Victor Kuznetsov
92445d4b80 add new exec with vpu compiler option (set config with MLIR compiler) (#7420) 2021-09-13 10:52:06 +03:00
Victor Kuznetsov
8fa386b9ad [Memory tests] Add new tests (#7306)
* add memory_tests

* change readme, add versions to requirements file
2021-09-13 10:47:30 +03:00
Ilya Sharikov
f44369ce4e Updated requirements (#7397) 2021-09-13 08:50:23 +03:00
Ilya Lavrenov
a952540edf Openvino cmake config (#7419)
* Added OpenVINOConfig.cmake

* OpenVINOConfig.cmake part 2

* Trying to fix cmake generation

* Fixes

* Export frontends as well

* Fixed condition

* Added OpenVINO cmake package usage: docs, C samples

* Use more OpenVINO config

* Install OpenVINOConfig.cmake

* Trying to fix private plugins

* Trying to fix .tox

* Trying to fix ARM

* Fixed samples build

* Explicit ngraph duplicated targets

* Fixed fuzzing tests build

* Added IR frontend installation

* Removed install directory for IE reader

* Removed IR frontend from export list

* Reverted ngraph_DIR

* Try to fix .tox

* Fixed ieFuncTests with ONNX extensions

* Attempt #2

* Trying to fix ngraph setup.py

* Fix

* Trying to fix ONNX ngraph .tox CI

* Trying to remove spaces

* Fixed ngraph_DIR -> OpenVINO_DIR

* Removed junk files

* Try to fix ngraph wheel

* Try to fix ie_wheel

* Try to fix ngraph wheel
2021-09-10 15:31:27 +03:00
Victor Kuznetsov
4d377901bf Move all utils to common folder (#7303)
* move all utils to common folder

* add utils install in CMakeLists.txt

* revert plugin utils

* add log info: test

* add logging info: test

* test imports

* change imports: test

* fix file name
2021-09-07 23:02:10 +03:00
Michał Karzyński
d748f2aa99 Remove references to prototxt from documentation and docstrings (#7346) 2021-09-03 08:32:43 +03:00
Victor Kuznetsov
b3428b5312 update references for memcheck pre-commit (refs from 2021.4) (#7063)
* update references for memcheck pre-commit (refs from 2021.4)

* add distro==1.5.0

* merge master

* upd only gpu refs

* upd config memcheck
2021-09-01 18:06:39 +03:00
Ilya Sharikov
ac6c58f03a Updated inter_tool due to IE api was updated (#7217) 2021-08-25 11:49:42 +03:00
Evgeny Lazarev
0587569369 Enable TensorFlow Min operation (#7144)
* Added extractor for the TF operation Min (reduce min)

* Added unit tests for the TF Reduce ops
2021-08-25 09:42:24 +03:00
iliya mironov
80c5f1a325 Add support opset11 for gemm normalizer (#6733)
* Add support opset11 for gemm normolizer

* Add layer test for gemm opset 11

* Fix layer test

* Fix layer test

* Refactoring according to code review

* Fix

* Update biases norm

* Refactoring matmul norm

* Fix accoding to review

* Fix alpha parameter

* Fix variable naming

* Refactoring according to code review
2021-08-24 15:43:19 +03:00
Yegor Kruglov
14dcd43c32 [MO] Replacing StridedSlice with Squeeze/Unsqueeze (#6693)
* added reinterp_shape parameter to tf ss extractor

* removed reinterp_shape

* added transformation to replace ss

* updated bom

* fix for e2e tests

* updated a case when shrink_axis_mask and new_axis_mask are both initialized

* unittests

* added comments

* updated graph_condition

* comments resolving

* updated the case, when shrink_axis_mask and new_axis_mask are both initialized

* added layer tests for squeeze/unsqueeze cases

* remove case when shrink and new axis masks are both set
2021-08-24 13:19:40 +03:00
Victor Kuznetsov
1f4664162a install necessary dirs for tests (#7044)
* install necessary dirs to tests

* rem RUNTIME from install step

* fix paths

* fix install paths

* fix install paths: add destination dirs

* add pandas

* fix requirements conflict - change pytest version to ~5

* remove comment from requirements.txt

* upd numpy version
2021-08-24 00:39:12 +03:00
Svetlana Dolinina
70e0b7817f Nested loop (#6710)
* initial changes to support nested loop

* fixed issues

* fixed nested loop extraction

* added comments

* removed unneeded comments

* review fix

* added tests

* turned off loop tests on GPU

* set xfail for TF tests

* removed TF test to move it in another repo

* fix typo in comment

* move duplicated code to separate functions;
added asserts

* add function for onnx constant creation;
add function to create body of loop
add comments to test

* move main change for nested loop to separate function
2021-08-23 23:11:39 +03:00
Olesya Martinyuk
a052b07fe6 MemCheck add INT8 models to pre-commit (#7166)
* updated desktop configs with int8 models

* updated desktop reference configs with actual values

* added commit comments
2021-08-20 12:25:59 +03:00
Alexander Shchepetov
afd49e662a Install layer tests with CMake (#6892)
* add CMakeLists.txt

* add copyright docstring

* add newline after copyright

* set target name

* change TARGET to DIRECTORY

* Rename layer tests dir to avoid name conflict

* cmakelists.txt final version

* Change destination to tests\layer_tests_openvino

* Add cmake_minimum_required to CMakeLists.txt

* Update CMakeLists.txt
2021-08-20 11:09:42 +03:00
Olesya Martinyuk
133b3b6468 Remove local configs and it's copying to bin/ for stress tests (#7131) 2021-08-19 12:57:47 +03:00
Pavel Esir
4738bbd757 [MO][nG] add Gather-8 to MO, layer tests, nG python api unit-tests and up/down-grading transformations (#6560)
* gather-8 upgrade/downgrade transforms

* bump to opset8

* add Gather-8 to MO

* fix permutation for Gather

* added TF layer tests, ONNX layer tests for negative indices, and nG python api unit-tests for negative indices

* typo fix, disable downgrading transformation

* disable downgrade in clDNN, line width style fix

* all Gathers are converted to 7th version, transformations will be enabled/disabled while op will be added into plugins

* disabled Gather8LayerTest on GPU

* added common function for Op replacement

* concretized meaning of negative indices, fixed some typos

* applied review comments: left only meaningful layer tests

* removed op replacing functions from common utils

* returned back transformations without subroutines

* corrected style, added comments to common_optimizations.cpp
2021-08-13 11:56:49 +03:00
Daria Ilina
5292de5338 Reorganize work with openvino/thirdparty (Copied from PR6744) (#6880)
* Copied PR6744

* Added CMakeLists.txt into gflags

* Return gflags into .gitmodules

* Added CMakeLists.txt into gtest

* fix: remove extra gflags and gtests from .gitmodules

* Change syntax in set gtest_targets

* Make gtest/CMakeLists.txt as in PR6744 for pre-commit experiment

* Update gtest/CMakeLists.txt

* Change version of gtest repo

* Return gtest info into .gitmodules

* Update gflags version to currently used
2021-08-11 11:33:52 +03:00
Alexander Shchepetov
e327c34af0 Add StressMemLeak test with 2 streams (#6964)
* StressMemLeakTests add tests with streams

* little fixes

* Code consistency
2021-08-10 17:04:18 +03:00
Anastasiya Koryachikhina
ad9078d9eb add itt_collector build (#6859)
* add itt_collector build

* changed format for itt_collector build

* replace build_dir with sea_itt_lib_path

* change type of build_target

* replace os.join with Path

* change built_target arg type
2021-08-09 12:40:56 +03:00
Ilya Sharikov
26c8b29b35 Added missing modules for timetests (#6896) 2021-08-03 12:19:40 +03:00
Maxim Vafin
9a36e77f50 Accept stream pointer instead of shared_ptr in paddle frontend (#6807)
* Accept stream pointer instead of shared_ptr

* Fix build

* Fix build tests on centos
2021-07-30 12:58:17 +03:00
Anastasiya Koryachikhina
4d7f6c54ef Change logic for using multiple models in cc tests (#6618)
* Change logic for using multiple models in cc tests

* removed extra key

* moved multiple infer to main function

* moved multiple infer to main function

* change test_config.yml and work with this file

* change test_config.yml and work with this file

* removed extra key

* changed separator symbol

* removed extra param from output

* Rollback comments in test_config.yml

* removed extra key in yml config file, change logic to save .npz for all model seperate instead of common npz file, change logic in parser arg

* removed extra key in yml config file, change logic to save .npz for all model seperate instead of common npz file, change logic in parser arg

* changed save path for infer result, deleted extra param

* updated test_config.yml

* rollback old way to get bin_path

* changed work with save path for inference result

* add empty line in the end for config file

* rollback line order

* removed extra param allow_pickle=True in loading .npz file

* removed mkdir in run_infer

* uncomment resnet model

* added empty line

* changed save folder for cc result
2021-07-30 10:30:38 +03:00
Mikhail Nosov
a95d59014c Rename "pdpd" frontend to "paddle" (#6842)
* Rename "pdpd" frontend to "paddle"
Also renamed mo_pdpd.py+main_pdpd.py to mo_paddle.py+main_paddle.py

Class names were not renamed

* Update package_BOM.txt
2021-07-29 11:43:07 +03:00
Ilya Sharikov
6ee9285fe5 Added Windows OS support to MemCheckTests (#6684)
* Added Windows OS support to MemCheckTests

* Move system headers to cpp file

* Moved includes for windows to cpp file. Was rewrited function to get memory info

* Was rewrite functions for getting information about memory

* Moved implementation run_in_process to cpp file

* Fixed implementation of run_in_process
2021-07-28 13:06:16 +03:00
Ilya Sharikov
33dfcd62c2 Add --verbose option to infer_tool (#6770)
Detailed infer results printing overload output and freeze sea_runtool.
Hiding debug messages by default.
2021-07-26 09:00:56 +03:00
Ivan Tikhonov
6e8b0e0ea6 pdpd Place: remaining methods, refactoring, unit tests (#6637)
* pdpd Place: remaining methods, refactoring, unit tests

* resolve merge issues

* use references instead of shared_ptr for Var and Op descs

* Add import pdpd fuzz test; To enable collection of pdpd models, cmake NGRAPH_PDPD_FRONTEND_ENABLE key should be set, the models will be generated to pdpd_test_models folder.

* fix ngraph codestyle

* fix review comments

* Add new methods for Place class

* fix implementation, add tests

* Place: Return nullptr instead of throwing an exception

* ngraph codestyle

* revert return nullptr

* fix build

* fix tests

* fix fuzzing tests

* fix fuzzing tests

* fix readme file

* Revert "fix readme file"

This reverts commit d061e69a0d.

* Resolve review comments

* ngraph codestyle

Co-authored-by: Somsikov, Andrey <andrey.somsikov@intel.com>
2021-07-23 15:22:05 +03:00
Ilya Sharikov
252483bb83 Common tests library for shared functionality (#6578) 2021-07-23 10:37:35 +03:00
Andrey Somsikov
22b9431a14 Add install target to fuzz tests (#6761) 2021-07-22 23:52:50 +03:00
iliya mironov
e1bffcc36c Add json validate (#6449)
* Add json validate

* Fix json schema

* Fix schema loader

* Add unit test

* Update bom file

* Update all requarments

* Update dev requarments

* Update requrments

* Update path to schema

* Update schema

* Add some unit tests

* Move schema to root dir

* Update schema path in bom file

* Fix unit test

* Fix bom

* Change path to schema

* update setup

* Fix setup

* Fix mo args test

* Refactoring some code

* Refactoring according to review

* Update sort imports

* Remove id attribute from schema

* Refactoring validator

* Fix according to review

* Move schema from json to dict. Update unit tests.

* Fix BOM file

* Update bom file
2021-07-22 21:12:44 +03:00