Commit Graph

3429 Commits

Author SHA1 Message Date
Gleb Kazantaev
b4565b7b4f
Add Model Optimizer --transform option (#5504)
* Execute MO stages inside subprocess to have single IE check

* Add --transform key

* Updated ofline transformations to execute user specified passes; updated logic to raise when --transform is used

* Parametrize LowLatency transformation with num_iterations key

* Fixed MO and IE versions comparision

* Use subprocess for offline transformations execution to catch errors

* remove ie_is_available from IR; fixed typo

* Fix for old IE versions

* Update parse_transform key unit tests

* Show available transformations

* Fixed typo

* Fix review comments

* Fix python2 compatibility

* Fixed review comments

* Fixed __main__ import
2021-05-12 18:42:56 +03:00
Paul Youngsoo Ahn
ed4d3fc4ed
[IE CLDNN] Disable extended eltwise fusing on gen12 (#5584) 2021-05-12 16:00:12 +03:00
iliya mironov
fe5ca28b6e
Smal fix with tf env_setup (#5476)
* Smal fix with tf env_setup

* Fix tf loader

* Fix version checker
2021-05-12 15:33:03 +03:00
Irina Efode
7fa93b226e
[IE TESTS] Skip all tests in conformance suite for myriad plugin (#5560) 2021-05-12 15:01:02 +03:00
Alexander Zhogov
1843d5cc16
Azure CI: Remove empty MklDnnFunctionalTests (#5590) 2021-05-12 14:59:57 +03:00
Irina Efode
bb943e880a
[IE TESTS] Add util which allow to update skip_test_config for conformance (#5493) 2021-05-12 14:59:29 +03:00
Anuj Mittal
b5c43d8a78
plugin_api: fix build with gcc 11 (#5546)
Some C++ Standard Library headers have been changed in gcc 11 to no
longer include other headers that they do need to depend on.

Include exception explicitly to avoid:

| inference-engine/src/plugin_api/ie_system_conf.h:21:31: error: 'exception_ptr' in namespace 'std' does not name a type; did you mean 'exception'?
|    21 | INFERENCE_ENGINE_API_CPP(std::exception_ptr&) CurrentException();
|      |                               ^~~~~~~~~~~~~

Signed-off-by: Anuj Mittal <anuj.mittal@intel.com>
2021-05-12 14:37:23 +03:00
Nico Galoppo
3c93548163
Fix python_tools benchmark installation location (#5539)
* Fix python_tools benchmark installation location

Before this fix, when running "make install", the benchmark python files
would be installed under <python_dest_dir>/openvino/tools, instead of
<python_dest_dir>/openvino/tools/benchmark. This commit fixes this.

* Alternative implementation
2021-05-12 14:35:50 +03:00
Jozef Daniecki
2ba5c344be
Add unit tests for Convert operation (#5558)
* Add Serialization SLT for Convert op.

* Add comment with explanaition to convert ref impl.

* Refactored backend tests for Convert operation.

* Give better names to backend tests.

* Add more backend unit tests.

* Fixed tests related to u1/u4/i4 types.
2021-05-12 14:35:12 +03:00
Ilya Lavrenov
abd663463d
Mak SO objct to be mandatory argument for VariablState (#5572) 2021-05-12 14:17:43 +03:00
Sergey Shlyapnikov
f458bd4384
[IE CLDNN] Disable CoreThreadingTestsWithIterations test skipping (#5495) 2021-05-12 13:56:12 +03:00
Gabriele Galiero Casay
6971303856
Revise BatchNormInference Reference Implementation (#5468)
* Refactor backend tests

* Rewrite reference implementation

 * Align ref impl signature with order of inputs in v5
 * Remove legacy code for training and backprop

* BarchNorminference operation class review

 * Use reference to const in helpers to validate input shapes
 * Refactor type_prop tests to cover v0 and v5

* Add type_prop tests

 * epsilon attribute test with invalid value
 * invalid integer input types

* Add serialization single layer test

* Add attribute visitor test

* Fix arm plugin test failure with dynamic element type

* Remove CoordinateTransform index call

* Add attribute count to visitor test
2021-05-12 13:47:50 +03:00
Ilya Lavrenov
a13bd518fc
[IE CLDNN] Fixed CLDNN internal tests compilation (#5597) 2021-05-12 13:24:18 +03:00
Ilya Lavrenov
c76c0eb39e
Moved ie_tests to legacy (#5561)
* Removed obsolete tests files

* Removed old SLT

* Moved ie_tests to legacy
2021-05-12 12:57:48 +03:00
Taylor Yeonbok Lee
6ecadc1548
[IE CLDNN] Add description for new CLDNN plugin configuration MAX_NUM_THREADS (#5582) 2021-05-12 12:33:24 +03:00
Pavel Esir
b17b526009
Add gather 7 to nG Python API and IE IR reader test (#5276)
* nG Python api for Gather and IE IR reader tests

* also included old IE IR reader test for Gather1

* added a blank line before Gather

* style corrections

* applied review comments

* removed blank line

* removed xfailed for Gather7 with batch_dims since CPU was moved to nGraph (...allows to fallback node execution on ngraph evaluate() method in case if optimized implementation is absent)

* added new visitor tests
2021-05-12 12:11:27 +03:00
Bartosz Sledz
81f9d78541
ONNX Subgraph - Infer types of inputs from top level Graph nodes (#5277) 2021-05-12 10:32:34 +02:00
Bartosz Sledz
932467631e
Change broadcasted shape for mul, add and sub (dequantization) (#4865)
* Change broadcast target shape for mul, add and sub transformation

* Revert "Change broadcast target shape for mul, add and sub transformation"

This reverts commit cb1332ffc4.

* Address comments

* Adjust functests

* Adjust next functests

* Revert "Adjust next functests"

This reverts commit 529b314b70.

* Revert "Address comments"

This reverts commit 9fccfc32b1.

* Revert "Adjust functests"

This reverts commit ef5fea7006.

* Implement new approach

* Address comment

* Add functests
2021-05-12 11:27:02 +03:00
Egor Duplensky
cfc235bd65
[CPU] Do not set BF16 on input port for Eltwise after Input (#5542)
* [CPU] Do not set BF16 on input port for Eltwise after Input

Since Eltwise supports conversion to BF16
Thus unnecessary Reorder is avoided

* Create a separate function for enforcing BF16 on ports

* Add test to verify that no extra Reorder is inserted

Also:
- update legacy test
- remove extra code which is not applicable anymore

* Correct expected precision in legacy test
2021-05-12 11:21:05 +03:00
Chenhu Wang
4c452b8bb6
[CPU] MVN optimization for 1D and 2D input (#5414) 2021-05-12 10:24:07 +03:00
Alexandra Sidorova
87a94e1a49
[CPU][IE TESTS] Fixed Mish (#5462) 2021-05-12 09:57:52 +03:00
Ilya Lavrenov
30fa59126c
Hide some legacy symbols from IE (#5566) 2021-05-12 09:40:06 +03:00
Gabriele Galiero Casay
a78515f3e7
Revise DeformableConvolution operation class (#5244)
* Enhance dynamic shape inference of validate and infer types method

* Review op class of DeformableConvolution

   * Add node validation checks into validate and infer types specific to element type and shape of inputs
   * Refactor validate and infer types method to use common function to validate conv parameters and infer output shape
   * Apply these changes to Convolution and BinaryConvolution for alignment

* Add type_prop unit tests

* Add node validation checks for deformable values spatial dimensions

* Fix type_prop and python api shapes

* Fix deformable values spatial dimensions

* Add validation checks in reference implementation

* Address review comments

 * Remove reference to const for basic types in ref impl
 * Update comment with ticket to add check for u1
 * Change deformable values to offset to align with spec
2021-05-12 09:21:33 +03:00
Jozef Daniecki
6e599eab60
Remove empty files on failed serialization (#5595)
* Add unit-test for case when serialzation fail.

* Delete serialization artifacts on failure.

* Close file streams before file remove.

* Fix typos.
2021-05-12 06:31:19 +03:00
Gabriele Galiero Casay
5a0bcf50c3
Add nGraph visitor tests for reduction operations (#5538)
* Add ngraph visitor tests for reduction operations

* Add check for number of expected attributes

* Add ReduceL1 and ReduceL2 to visitor test typed case of reduce ops

* Instantiate reduce operation type in separate file
2021-05-12 06:23:14 +03:00
Pavel Esir
0b22d6c51c
Add Gather-7 to MO (#5264)
* initial solution

* added unit-tests + some corrections

* axis getting improvements

* fixed MO IR reader for old IR's

* a couple of corrections

* applied review comments

* corrected negative batch_dims normalization for shape calculation, for IR original negative values are kept

* added additional checks and negative tests
2021-05-11 22:29:59 +03:00
Roman Kazantsev
dc22c177d5
Extend MO for operation Einsum-7 (#5401)
* Extend MO for operation Einsum-7

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Add extractor for einsum and optimize code based on review feedback

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Fix the code based on the review: correct code, tests and comments; move insert_transpose

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Fix LayoutChangeForEinsum transformation condition

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Update third-party dependencies

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>
2021-05-11 21:36:04 +03:00
Anton Pankratv
9db7f849df
Fixed return warnings (#5410) 2021-05-11 20:02:00 +03:00
Vladimir Paramuzov
0dc161ad82
[IE CLDNN] Added CACHE_DIR option into docs (#5592) 2021-05-11 16:55:33 +03:00
Anastasia Kazantaeva
42226fccae
Upgrade message for 2021.4 lts (#5471) 2021-05-11 15:58:32 +03:00
Maksim Proshin
d11c5e4c9d
Moving POT to Optimization section in index.md and replacing Toolkit by Tool in a few places (#4272)
* Update get_started_dl_workbench.md

POToolkit => POTool

* Update QuantizedNetworks.md

POToolkit => POTool

* Moving POT to optimizations section

Moving POT to optimizations section
2021-05-11 14:35:33 +03:00
Ilya Lavrenov
a6d8391c4c
Removed details::no_copy (#5553) 2021-05-11 13:05:18 +03:00
Ewa Tusień
f824f914a4
[ONNX] Add Constant op from opset 13 (#5450) 2021-05-11 11:01:27 +02:00
Jozef Daniecki
1e3b06f439
Add ngraph visitor tests for Convert operation. (#5533)
* Add ngraph visitor tests for Convert operation.

* Add attribute count check to Covnert visitor test.
2021-05-11 09:13:35 +03:00
Patryk Elszkowski
3de41ec50a
add zero attribute test for tanh op (#5427)
* add zero attribute test for tanh op

* apply review suggestion

Co-authored-by: Patryk Elszkowski <patryk.elszkowki@intel.com>
2021-05-11 08:54:19 +03:00
Patryk Elszkowski
f089c40bb4
update tanh reference implementation (#5478)
Co-authored-by: Patryk Elszkowski <patryk.elszkowki@intel.com>
2021-05-11 08:53:08 +03:00
Piotr Szmelczynski
cd48b2f6ec
move elu unit-tests from fused_op.in.cpp to elu.in.cpp (#5512) 2021-05-11 08:47:42 +03:00
Bartosz Lesniewski
66b3efbb6c
Revise Squeeze op - tests (#5336) 2021-05-10 12:37:18 +02:00
Tomasz Socha
6c9387d603
[ONNX Importer] Fix dynamism for grouped conv(transpose) operators (#5540) 2021-05-10 12:09:52 +02:00
David Nam
1b8a0f7ae5
[UnitTest] Reset shared-pointer explicitly in MklDnnFunctionalTest (#5543) 2021-05-07 23:40:43 +03:00
Bartosz Lesniewski
af0aa5f430
Revise Unsqueeze op - specification (#5526)
* Revise unsqueeze op spec

* Second input value boundaries fix

* adjust first input description
2021-05-07 17:03:25 +03:00
Anastasia Popova
84b94c9834
Fuse mul transformation fix (#5518)
* Changed fuse_mul behaviour for proper data node connection.

* Corrected the comment.

* Corrected the comment.

* Added permutation attribute saving.

* Added comment.

* Added unit tests, comments corrections.
2021-05-07 17:01:31 +03:00
Ilya Lavrenov
3e25539d79
Moved ie_thread_affinity.hpp to private API (#5554) 2021-05-07 16:33:15 +03:00
Anastasia Popova
4ea09b1f98
ReverseInputChannels mapping fix (#5523)
* Fixed attributes saving to keep tensor debug info in Parameter node.

* Added comment and unit tests.

* Small correction.

* Small correction of unit test.

* Comment corrected.
2021-05-07 16:29:38 +03:00
Gabriele Galiero Casay
b9812a4275
ConvertLike specification refactoring (#5534)
* ConvertLike specification refactoring

* Corrected typos and clean up

* Changed supported types of Convert to align with ConvertLike
2021-05-07 14:53:49 +02:00
Andrei Molotkov
d4a883429d
[IE CLDNN] Fix segmentation fault for hetero plugin mode (#5548) 2021-05-07 15:13:18 +03:00
Gabriele Galiero Casay
b9fe465cf0
BatchNormInference specification refactoring (#5489)
* BatchNormInference specification refactoring

* Address review comments

 * Remove he term Transform from definition
 * Add title of the paper where this operation is introduced
 * Add missing backticks
 * Remove redundant information in attribute epsilon range of values

* Refinement of spec

Remove more mentions to transformation to avoid confusion

* Corrected typos and added changes to improve readability

* Use third person to express operation steps
2021-05-07 14:06:28 +03:00
Alexander Zhogov
102e95f7f5
Azure: Add installing setuptools in linux_onnxruntime.yml (#5547) 2021-05-07 13:59:59 +03:00
Krzysztof Bruniecki
7c07c6154b
[GNA] New flags to select GNA target generation (#5429)
* New flags for GNA trget

* Add new flags to configuration

* Update utest

* Update speech_Sample

* Add unit tests

* Guard for wrong values

* Use gna execution target as consistent device

* Apply review
2021-05-07 13:02:49 +03:00
Gabriele Galiero Casay
edfec9171f
ReduceSum specification refactoring (#5527) 2021-05-07 12:58:06 +03:00