Commit Graph

3447 Commits

Author SHA1 Message Date
Bartosz Lesniewski
61e9d020d4
Revise Unsqueeze op - tests (#5579)
* Add visitor test, separate backend test from common fused op file

* Add SSLT, separate empty axes squeeze case in SLT

* Add unsqueeze to trusted op list

* removing trailing whitespaces

* Add missing newlines at file end

* Review comments - actually running backend tests, fixed typo in visitor test
2021-05-14 07:44:48 +03:00
Bartek Szmelczynski
314a1d7de3
Revise gelu (#5327)
* add type_prop and backend tests for gelu op

* add visitor test for gelu op

* add additional type_prop and backend tests and remove gelu from manifest

* resolve conflicts

* fix indentation and remove unecessary includes

* remove gelu from manifests
2021-05-14 07:39:48 +03:00
Ilya Churaev
6e6e4b7c3a
Added additional check for friendly names (#5586)
* Added additional check for friendly names

* Fixed Functional tests
2021-05-13 23:20:53 +03:00
Gabriele Galiero Casay
4bc98766ed
Revise single layer tests for Reduce ops (#5557)
* Add serialization single layer tests for reduction operations

* Add ReduceSum to the list of trusted ops

* Minor changes in single layer tests for reduction ops
2021-05-13 22:15:01 +03:00
Ilya Lavrenov
f88611e5a2
Removed FPGA constant from tests (#5626) 2021-05-13 21:53:08 +03:00
Sergey Lyubimtsev
5af767a0a2
Add MO extras requires for supported DL frameworks (#5615)
* Add extras requires for supported DL frameworks

* fix pylint issues

* codestyle (PEP8)

* Indentation
2021-05-13 20:20:41 +03:00
Shoujiang Ma
40ffca6fa2
[Auto Plugin] Auto plugin component in IE (#5366)
* Implement AUTO plugin

Usage:
	1. -d AUTO
	2. -d ""

Signed-off-by: Shoujiang Ma <shoujiang.ma@intel.com>

* Add tests for AUTO plugin

Signed-off-by: Shoujiang Ma <shoujiang.ma@intel.com>

* cleaned impl, that was incorrect from the async perspective, ansl also capturing the blobs in the constructor

* Revert benchmark_app modification

Signed-off-by: Shoujiang Ma <shoujiang.ma@intel.com>

* Address reviewer's comments: need CI tests to verify

Signed-off-by: Shoujiang Ma <shoujiang.ma@intel.com>

Co-authored-by: myshevts <maxim.y.shevtsov@intel.com>
2021-05-13 17:04:38 +03:00
Krzysztof Bruniecki
05b62258c7
[GNA] Improve CNN2D kernels/weights quantization (#5370)
* Introduce heuristic for weight reducer
     * handle kernels 3x3 and 7x1 to avoid saturation
     * enable tests
     * issue 54140
2021-05-13 16:31:23 +03:00
Vladimir Zinoviev
9248a5887d
[LPT] Split mixed precision support (#5596) 2021-05-13 15:03:23 +03:00
Chenhu Wang
516479ae20
[CPU]shuffle_channel optimization (#4978) 2021-05-13 13:43:42 +03:00
Tatiana Troilova
5c40613247
updated third-party-programs.txt (#5607) 2021-05-13 13:30:20 +03:00
Vladimir Paramuzov
c1b1e2e7af
[IE CLDNN] Fixed FC weights check (#5568) 2021-05-13 09:17:32 +03:00
Ilya Lavrenov
07a49184c0
Fixed typo in length (#5611) 2021-05-13 07:52:55 +03:00
Bartosz Lesniewski
39fde540d2
Revise Unsqueeze op - op class (#5555)
* revise unsqueeze op class

* Added checks and tests for second input incorrect type and shape

* Remove axes type constraints to keep backward compatibility
2021-05-13 07:45:29 +03:00
Katarzyna Mitrus
f928f7fc56
DeformablePSROIPoolig reference implementation (#5116)
* Reference implementation init

* Backend tests

* Single layer tests

* Update offset range in layer tests

* Align int types with ng op

* Update spatial bins type

* Type update

* Fix sub bin calculation in mkldnn plugin

* Update summarize py file

* Align result  type

* Refactoring

* Apply review comments

* Add serialize layar tests

* Adjust int comparison

* Adjust code style

* Use clamp reference

* Unify style

* Additional check for negative output dim

* Set tensor output shape in evaluate

* Add visit attributes test

* Small refactor

* Code style (namespace comments)

* Fix CommonTestsUtils::fill_data_roi usage.

This function was generalized in PR #5432 and its siganutre has changed.

* Update licenese header with mention about original authors.

* Replace MIT SPDX full license name with short identifier.

* Fix sub bin calculation in mkldnn plugin

Co-authored-by: jdanieck <jozef.daniecki@intel.com>
2021-05-13 07:44:57 +03:00
Pavel Esir
0383b44776
added RNN-t conversion doc (#5139)
* added RNN-t conversion doc

* applied review comments

* a couple of corrections

* added pip3 everywhere

* fixed a typo

* applied review comments

* title name fix

* applied Tatiana's comments round 2

* fixed a typo for 'inference'

* fixed typo in MLCommons name

* moved to PyTorch* specific, applied comments

* pytorch_specific typo

* froze MLCommons revision to r1.0; fixed typo in MLCommons relative path
2021-05-12 22:49:40 +03:00
Mikhail Nosov
4d7eeede35
Add LoadNetwork(modelPath) to plugin interface (#5606) 2021-05-12 21:43:35 +03:00
Anton Chetverikov
f2f44ce160
Add uint64 to data types maps (#5603) 2021-05-12 18:50:38 +03:00
Gleb Kazantaev
b4565b7b4f
Add Model Optimizer --transform option (#5504)
* Execute MO stages inside subprocess to have single IE check

* Add --transform key

* Updated ofline transformations to execute user specified passes; updated logic to raise when --transform is used

* Parametrize LowLatency transformation with num_iterations key

* Fixed MO and IE versions comparision

* Use subprocess for offline transformations execution to catch errors

* remove ie_is_available from IR; fixed typo

* Fix for old IE versions

* Update parse_transform key unit tests

* Show available transformations

* Fixed typo

* Fix review comments

* Fix python2 compatibility

* Fixed review comments

* Fixed __main__ import
2021-05-12 18:42:56 +03:00
Paul Youngsoo Ahn
ed4d3fc4ed
[IE CLDNN] Disable extended eltwise fusing on gen12 (#5584) 2021-05-12 16:00:12 +03:00
iliya mironov
fe5ca28b6e
Smal fix with tf env_setup (#5476)
* Smal fix with tf env_setup

* Fix tf loader

* Fix version checker
2021-05-12 15:33:03 +03:00
Irina Efode
7fa93b226e
[IE TESTS] Skip all tests in conformance suite for myriad plugin (#5560) 2021-05-12 15:01:02 +03:00
Alexander Zhogov
1843d5cc16
Azure CI: Remove empty MklDnnFunctionalTests (#5590) 2021-05-12 14:59:57 +03:00
Irina Efode
bb943e880a
[IE TESTS] Add util which allow to update skip_test_config for conformance (#5493) 2021-05-12 14:59:29 +03:00
Anuj Mittal
b5c43d8a78
plugin_api: fix build with gcc 11 (#5546)
Some C++ Standard Library headers have been changed in gcc 11 to no
longer include other headers that they do need to depend on.

Include exception explicitly to avoid:

| inference-engine/src/plugin_api/ie_system_conf.h:21:31: error: 'exception_ptr' in namespace 'std' does not name a type; did you mean 'exception'?
|    21 | INFERENCE_ENGINE_API_CPP(std::exception_ptr&) CurrentException();
|      |                               ^~~~~~~~~~~~~

Signed-off-by: Anuj Mittal <anuj.mittal@intel.com>
2021-05-12 14:37:23 +03:00
Nico Galoppo
3c93548163
Fix python_tools benchmark installation location (#5539)
* Fix python_tools benchmark installation location

Before this fix, when running "make install", the benchmark python files
would be installed under <python_dest_dir>/openvino/tools, instead of
<python_dest_dir>/openvino/tools/benchmark. This commit fixes this.

* Alternative implementation
2021-05-12 14:35:50 +03:00
Jozef Daniecki
2ba5c344be
Add unit tests for Convert operation (#5558)
* Add Serialization SLT for Convert op.

* Add comment with explanaition to convert ref impl.

* Refactored backend tests for Convert operation.

* Give better names to backend tests.

* Add more backend unit tests.

* Fixed tests related to u1/u4/i4 types.
2021-05-12 14:35:12 +03:00
Ilya Lavrenov
abd663463d
Mak SO objct to be mandatory argument for VariablState (#5572) 2021-05-12 14:17:43 +03:00
Sergey Shlyapnikov
f458bd4384
[IE CLDNN] Disable CoreThreadingTestsWithIterations test skipping (#5495) 2021-05-12 13:56:12 +03:00
Gabriele Galiero Casay
6971303856
Revise BatchNormInference Reference Implementation (#5468)
* Refactor backend tests

* Rewrite reference implementation

 * Align ref impl signature with order of inputs in v5
 * Remove legacy code for training and backprop

* BarchNorminference operation class review

 * Use reference to const in helpers to validate input shapes
 * Refactor type_prop tests to cover v0 and v5

* Add type_prop tests

 * epsilon attribute test with invalid value
 * invalid integer input types

* Add serialization single layer test

* Add attribute visitor test

* Fix arm plugin test failure with dynamic element type

* Remove CoordinateTransform index call

* Add attribute count to visitor test
2021-05-12 13:47:50 +03:00
Ilya Lavrenov
a13bd518fc
[IE CLDNN] Fixed CLDNN internal tests compilation (#5597) 2021-05-12 13:24:18 +03:00
Ilya Lavrenov
c76c0eb39e
Moved ie_tests to legacy (#5561)
* Removed obsolete tests files

* Removed old SLT

* Moved ie_tests to legacy
2021-05-12 12:57:48 +03:00
Taylor Yeonbok Lee
6ecadc1548
[IE CLDNN] Add description for new CLDNN plugin configuration MAX_NUM_THREADS (#5582) 2021-05-12 12:33:24 +03:00
Pavel Esir
b17b526009
Add gather 7 to nG Python API and IE IR reader test (#5276)
* nG Python api for Gather and IE IR reader tests

* also included old IE IR reader test for Gather1

* added a blank line before Gather

* style corrections

* applied review comments

* removed blank line

* removed xfailed for Gather7 with batch_dims since CPU was moved to nGraph (...allows to fallback node execution on ngraph evaluate() method in case if optimized implementation is absent)

* added new visitor tests
2021-05-12 12:11:27 +03:00
Bartosz Sledz
81f9d78541
ONNX Subgraph - Infer types of inputs from top level Graph nodes (#5277) 2021-05-12 10:32:34 +02:00
Bartosz Sledz
932467631e
Change broadcasted shape for mul, add and sub (dequantization) (#4865)
* Change broadcast target shape for mul, add and sub transformation

* Revert "Change broadcast target shape for mul, add and sub transformation"

This reverts commit cb1332ffc4.

* Address comments

* Adjust functests

* Adjust next functests

* Revert "Adjust next functests"

This reverts commit 529b314b70.

* Revert "Address comments"

This reverts commit 9fccfc32b1.

* Revert "Adjust functests"

This reverts commit ef5fea7006.

* Implement new approach

* Address comment

* Add functests
2021-05-12 11:27:02 +03:00
Egor Duplensky
cfc235bd65
[CPU] Do not set BF16 on input port for Eltwise after Input (#5542)
* [CPU] Do not set BF16 on input port for Eltwise after Input

Since Eltwise supports conversion to BF16
Thus unnecessary Reorder is avoided

* Create a separate function for enforcing BF16 on ports

* Add test to verify that no extra Reorder is inserted

Also:
- update legacy test
- remove extra code which is not applicable anymore

* Correct expected precision in legacy test
2021-05-12 11:21:05 +03:00
Chenhu Wang
4c452b8bb6
[CPU] MVN optimization for 1D and 2D input (#5414) 2021-05-12 10:24:07 +03:00
Alexandra Sidorova
87a94e1a49
[CPU][IE TESTS] Fixed Mish (#5462) 2021-05-12 09:57:52 +03:00
Ilya Lavrenov
30fa59126c
Hide some legacy symbols from IE (#5566) 2021-05-12 09:40:06 +03:00
Gabriele Galiero Casay
a78515f3e7
Revise DeformableConvolution operation class (#5244)
* Enhance dynamic shape inference of validate and infer types method

* Review op class of DeformableConvolution

   * Add node validation checks into validate and infer types specific to element type and shape of inputs
   * Refactor validate and infer types method to use common function to validate conv parameters and infer output shape
   * Apply these changes to Convolution and BinaryConvolution for alignment

* Add type_prop unit tests

* Add node validation checks for deformable values spatial dimensions

* Fix type_prop and python api shapes

* Fix deformable values spatial dimensions

* Add validation checks in reference implementation

* Address review comments

 * Remove reference to const for basic types in ref impl
 * Update comment with ticket to add check for u1
 * Change deformable values to offset to align with spec
2021-05-12 09:21:33 +03:00
Jozef Daniecki
6e599eab60
Remove empty files on failed serialization (#5595)
* Add unit-test for case when serialzation fail.

* Delete serialization artifacts on failure.

* Close file streams before file remove.

* Fix typos.
2021-05-12 06:31:19 +03:00
Gabriele Galiero Casay
5a0bcf50c3
Add nGraph visitor tests for reduction operations (#5538)
* Add ngraph visitor tests for reduction operations

* Add check for number of expected attributes

* Add ReduceL1 and ReduceL2 to visitor test typed case of reduce ops

* Instantiate reduce operation type in separate file
2021-05-12 06:23:14 +03:00
Pavel Esir
0b22d6c51c
Add Gather-7 to MO (#5264)
* initial solution

* added unit-tests + some corrections

* axis getting improvements

* fixed MO IR reader for old IR's

* a couple of corrections

* applied review comments

* corrected negative batch_dims normalization for shape calculation, for IR original negative values are kept

* added additional checks and negative tests
2021-05-11 22:29:59 +03:00
Roman Kazantsev
dc22c177d5
Extend MO for operation Einsum-7 (#5401)
* Extend MO for operation Einsum-7

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Add extractor for einsum and optimize code based on review feedback

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Fix the code based on the review: correct code, tests and comments; move insert_transpose

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Fix LayoutChangeForEinsum transformation condition

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Update third-party dependencies

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>
2021-05-11 21:36:04 +03:00
Anton Pankratv
9db7f849df
Fixed return warnings (#5410) 2021-05-11 20:02:00 +03:00
Vladimir Paramuzov
0dc161ad82
[IE CLDNN] Added CACHE_DIR option into docs (#5592) 2021-05-11 16:55:33 +03:00
Anastasia Kazantaeva
42226fccae
Upgrade message for 2021.4 lts (#5471) 2021-05-11 15:58:32 +03:00
Maksim Proshin
d11c5e4c9d
Moving POT to Optimization section in index.md and replacing Toolkit by Tool in a few places (#4272)
* Update get_started_dl_workbench.md

POToolkit => POTool

* Update QuantizedNetworks.md

POToolkit => POTool

* Moving POT to optimizations section

Moving POT to optimizations section
2021-05-11 14:35:33 +03:00
Ilya Lavrenov
a6d8391c4c
Removed details::no_copy (#5553) 2021-05-11 13:05:18 +03:00