Commit Graph

2928 Commits

Author SHA1 Message Date
Alina Alborova
1d76ab7f55
Review Inference Engine Extensibility docs (#4267) 2021-03-23 15:28:16 +03:00
Ilya Churaev
3ee41375a3
Clang-format check for itt collector (#4893)
* Enable clang_format for ITT collector

* Fixed code style

* Bad code style

* Enable clang-format for ITT collector

* Revert "Bad code style"

This reverts commit 82cbd40539.

* Fixed build
2021-03-23 15:08:51 +03:00
Szymon Irzabek
3672fb9817
Enable CNN2D tests for GNA library 2.1 (#3917)
* [GNA] Enable CNN2D tests for GNA library 2.1

* [GNA] Fix test skipping decision
2021-03-23 14:52:45 +03:00
Patryk Elszkowski
a1ed4f1b49
Update Pad specification (#4799)
* udpate Pad specyfication

* apply PR suggestions

Co-authored-by: Patryk Elszkowski <patryk.elszkowki@intel.com>
2021-03-23 13:12:58 +03:00
Ivan Tikhonov
e877272eca
Clarification of Low Latency Transformation and State API documentation (#4771)
* Assign/ReadValue, LowLatency and StateAPI clarifications

* Apply suggestions from code review: spelling mistakes

Co-authored-by: Anastasiya Ageeva <anastasiya.ageeva@intel.com>

* fixed wording

* Resolve review remarks

Co-authored-by: Anastasiya Ageeva <anastasiya.ageeva@intel.com>
2021-03-23 12:40:42 +03:00
Bartek Szmelczynski
910e83b2a2
Rewrite implementation for input and output description (#4506)
* initial split of on_adapter function in order to check if all checks will pass

* remove blank line and change if statements for on_apdapter for void type

* add type checking instead of name checking

* add bracket two if/else if statements and move helper functions to private

* fix style

* revert removing ngarph check for empty pramas and result

* move map_type_from_body method to private, add const& function arguments
2021-03-23 06:16:20 +03:00
Evgeny Lazarev
062bfd88d3
Fix Gelu parameter name (#4895)
* Rename attribute of the "Gelu" operation from "approximation" to "approximation_mode"

* Updated MO file for coverage check
2021-03-22 19:35:32 +03:00
Andrey Dmitriev
9d69c0e0ec
[GNA] Multithread speech sample with iname (#4774) 2021-03-22 17:14:15 +03:00
Taylor Yeonbok Lee
50e1f43e26
[IE CLDNN] Fix permute reorder fusing error (#4876) 2021-03-22 16:33:46 +03:00
Katarzyna Mitrus
b8f36ec354
MatMul reference implementation refactoring (#4671)
* MatMul backend tests

* Single layer tests

* Style apply

* Updaye IE_CPU manifest

* New dot implementation

* Use new dot in MatMul reference

* Fix output batch offset

* Style apply

* Relax tests tolerance

* Remove legacy dot reference file

* Remove usage of broadcast builder

* Add one more broadcast test

* Remove NGRAPH_SUPPRESS_DEPRECATED

* Style apply

* Few more MatMul single layer tests

* Update IE tests manifest

* Move variable declarations to inner loops

* Add const to variables

* Apply review suggestions

* Reuse vector for transposed and broadcasted data
2021-03-22 15:27:31 +03:00
iliya mironov
e64d84b47b
Enable gpu tests. Disable fp16 cpu test. (#4856) 2021-03-22 14:47:07 +03:00
Egor Duplensky
e033b18bce
[CPU] Disable drop excess convert+reorder optimization (#4743)
The optimization does not have a use case at the moment
since in scope of greedy mode we removed insertion of
convert/reorder after input layer.
This logic will be re-implemented after ngraph migration
and then we can bring back the optimization together with
some tests.
2021-03-22 14:40:08 +03:00
Yegor Kruglov
244af264e6
Add remove_value_output attribute to onnx ArgMax extractor (#4831)
* add remove_value_output to onnx argmax extractor

* update TopK extender

* update copyright

* change condition in topk extender based on connection logic
2021-03-22 14:19:27 +03:00
Irina Efode
1f4f449308
[IE TESTS] Add AVG Pass-rates to the report. Identify good refs (#4854)
* [IE TESTS] Add AVG Pass-rates to the report. Identify good refs

* Uncomment extra

* Fixes

* Improve report

* Fix typo

* vers

* Percent
2021-03-22 14:03:45 +03:00
Gleb Kazantaev
aa4cbde1bd
Pruning transformation (#4666)
* Pruning transformation POC

* Reimplement logic with masks and their dependencies

* Remove wrong changes

* Update VisualizeTree with max const lements parameter

* Improved VisualizeTree

* Move Pruning to offline_transformations target

* Added python API for Pruning transformation

* Use NGRAPH_DEBUG for logging

* Added const get_rt_info method

* nGraph Code Style

* get_rt_info methods update

* Commented debug infra

* Code Cleanup

* Removed BN changes

* nGraph Code Style

* Add rt_info copy for output ports

* Use Mask * instead of Mask::Ptr to avoid cross dependency

* Removed dllexport for static library

* resolce pr comments

* fix copyright

* Check fix for traget_link_libraries

* Remove LTO for offline_transformations
2021-03-22 13:28:40 +03:00
Eunsoo Sheen
084117adf0
[IE CLDNN] Permute optimization with tiling for fsv16 format (#4706) 2021-03-22 10:44:48 +03:00
Katarzyna Mitrus
3866896ba6
Add type info to MatMul spec (#4855) 2021-03-22 10:28:58 +03:00
Ivan Tikhonov
a868d88d49
Do not convert Sequences to TensorIterator, when plugin supports the original primitive (#4631)
* do not convert Sequences to TensorIterator when plugin supports Sequence primitive

* fix referece implementations for Sequences, processing seq_len value == 0 case

* Adding new mode for LSTMSequence single layer tests

* update single layer tests

* fix failed unit tests, updated single layer tests for rnn/gru sequences

* fix failed unit tests

* fix single layer tests

* ignore failed single layer tests on gpu (known issue), fix review remarks
2021-03-22 06:46:46 +03:00
Mateusz Bencer
f8c037c238
apply onnx patch only once (#4890) 2021-03-20 17:37:22 +03:00
Mikhail Nosov
2f84b51e17
C API for LoadNetwork by model file name (#4891) 2021-03-20 17:37:07 +03:00
Jan Iwaszkiewicz
8ec59ceda4
[CPU][ONNX] Convert FP64 precision to FP32 (#4681) 2021-03-19 19:28:55 +01:00
Mikhail Nosov
70eb23533c
Proper cleanup of cache_dir on start/end tests (#4888)
Also add ability to skip the test depending on plugins 'skip_test_config'
2021-03-19 20:42:32 +03:00
Mikhail Ryzhov
771a90c523
Fixed mac libs filter (#4871)
* Fixed mac libs filter

* Fixed typo issue
2021-03-19 16:55:16 +03:00
Tomasz Jankowski
636986be3f
[ONNX] Add dynamism to Conv bias input (#4835) 2021-03-19 14:19:32 +01:00
Bartosz Sledz
5ce9e2ae2a
Add support for dynamic input in ONNX Instance Normalization operator (#4805) 2021-03-19 13:57:43 +01:00
Evgeny Lazarev
64e96fbd9a
Fixed dead lock in the telemetry sender (#4883) 2021-03-19 15:12:27 +03:00
Patryk Elszkowski
068e7ec459
Add pad backend test using NDArray (#4823)
Co-authored-by: Patryk Elszkowski <patryk.elszkowki@intel.com>
2021-03-19 13:51:35 +03:00
Pavel Esir
eaa4c7949f
[spec] added spec for Gather-7, some corrections in Gather-1 (#4687)
* added spec for Gather-7, some corrections in Gather-1

* applied review comments

* applied @rkazants comments

* applied @rkazants comments: added separate types for axis, fixed shapes in IR

* applied review

* applied review comments: added example with axis > batch_dims

* apply review comment from @lazarevevgeny

* applied review comments from @tsavina

* Update docs/ops/movement/Gather_7.md

Co-authored-by: Tatiana Savina <tatiana.savina@intel.com>

Co-authored-by: Tatiana Savina <tatiana.savina@intel.com>
2021-03-19 12:08:48 +03:00
Anton Pankratv
35bff0d8a1
Moved executable network implementation from header (#4049) 2021-03-19 11:58:16 +03:00
Mateusz Tabaka
93d2bae95a
Move Mul node before Reshape in GroupConvolutionMultiplyFusion (#4031)
* Move Mul node before Reshape in GroupConvolutionMultiplyFusion

In following scenario:

                                    +-----------+
                                    |  weights  |
                                    +-----------+
                                         |
                                         v
                                    +-----------+
                                    |  Reshape  |
                       ....         +-----------+
                          \              /
                           \            /
                            v          v
                       +--------------------+
                       |  GroupConvolution  |
                       +--------------------+
                                |
                                v
                           +-----------+      +----------+
                           |  Multiply | <--- | Constant |
                           +-----------+      +----------+

if a second input (weights) to GroupConvolution is a Reshape,
we should apply Multiply node directly to weights rather than Reshape node:

                                    +-----------+
                                    |  weights  |
                                    +-----------+
                                         |
                                         v
                                    +-----------+      +----------+
                                    |  Multiply | <--- | Constant |
                                    +-----------+      +----------+
                                         |
                                         v
                                    +-----------+
                                    |  Reshape  |
                       ....         +-----------+
                          \              /
                           \            /
                            v          v
                       +--------------------+
                       |  GroupConvolution  |
                       +--------------------+
                                |
                                v

That approach has no side effects in the usual scenario when weights are constant,
but it's necessary for models with FakeQuantize since it gives possibility to perform
GroupConvolutionTransformation from LPT transformations.

* remove unnecessary new lines

* simplify code

* check if input to reshape has shape that starts with G * O

* add pattern::has_static_dims({0, 1}) to weights

* Use K = 3 in WeightsWithFakeQuantizeAndReshape tests

* Add LPT tests for groupconvolution_qdq_transformation

* fix PullReshapeThroughDequantizationTransformation tests
2021-03-19 10:39:50 +03:00
Tomasz Krupa
e62631c601
Check transformation callback in bidirectional sequence decomposition (#4836)
* Check transformation callback in bidirectional sequence decomposition

* Add BidirectionalSequenceDecomposition tests
2021-03-19 09:46:56 +03:00
Liubov Batanina
f102d3ff0a
Added missed headers to NormalizeL2 reference (#4832) 2021-03-19 09:10:28 +03:00
Evgenya Stepyreva
f4c13b6771
Small shape propagation & evaluators update (#4809)
* Small shape propagation & evaluators update

* minor style changes

* Selu operation shape inference

* Experimental tests for activation operations in the IE test infreastructure

* minor style fixes

* prelu fix
2021-03-18 23:29:35 +03:00
Alexandra Sidorova
704278e09e
[CPU][IE TESTS] Added VariadicSplit and Pad subgraph tests (#4583)
* [IE TESTS] Added VariadicSplit and Pad subgraph tests

* Added more connectedIndexes
2021-03-18 19:07:29 +03:00
iliya mironov
5bb8571980
Add ScatterElements value propagation (#4724)
* Add ScatterElements value propogation

* Add condition for input nodes

* Add asserts

* Refactoring scatter according to review

* Add unit tests for 1d axis tensor

* Refactoring according to review

* refactoring unit test

* Refactoring according to review

* Update unit test

* Update unit test
2021-03-18 16:55:35 +03:00
Anton Pankratv
a2b8b974b8
Simplified IE Exceptions Implementation (#4258) 2021-03-18 16:30:16 +03:00
Mateusz Tabaka
d068810936
Add SoftmaxFusion transformation (#4827)
SoftmaxFusion is based on SoftmaxFromKeras replacement from MO.
2021-03-18 15:31:30 +03:00
Maxim Vafin
f27efeab49
Document YOLACT support (#4749) (#4858)
* Document YOLACT support

* Add preprocessing section

* Apply suggestions from code review

Co-authored-by: Tatiana Savina <tatiana.savina@intel.com>

Co-authored-by: Tatiana Savina <tatiana.savina@intel.com>

Co-authored-by: Tatiana Savina <tatiana.savina@intel.com>
2021-03-18 14:12:37 +03:00
Mikhail Nosov
59707b7937
[Plugins test] Add func tests for import/export support by plugins (#4847)
* [Plugins test] Add functional test for correct import/export support by plugins

Test suite creates number of models with various precisions.
For each model:
- If plugin doesn't support IMPORT_EXPORT_SUPPORT metric - skip the test
- Try LoadNetwork without cache enabled fails - skip the test
- Do one inference
If Load and Infer request is succeeded and plugin has import metric:
- Load network with cache enabled. Infer request and compare outputs with original infer
- Import network, perform inference. Compare outputs with previous ones

* Fix Centos build warnings
Myriad: reset executableNetwork before next load
Myriad: Reduced time consumption for Myriad tests

* Caching test suite - batch size parameter support
2021-03-18 13:03:18 +03:00
Anton Chetverikov
e455a69d07
Add documentation on how to convert F3Net model (#4709)
* Add F3Net to list of supported models

* Add instruction for F3Net model pytorch->onnx conversion

* Add new file to ie_docs.xml

* Update instruction

* Apply comments

* Apply comments

* Apply review comments
2021-03-18 12:15:48 +03:00
Ilya Lavrenov
3435e7acb7
Proper detection of Apple M1 (#4848) 2021-03-18 11:17:13 +03:00
Ilya Lavrenov
25c2fea2f9
Build python wheel w/o strict dependency to _pyngraph (#4837)
* Build python wheel w/o strict dependency to _pyngraph

* Exclude extra components which are not needed for IE python wheel

- myriad_compile
- myriad_perfcheck
- compile_tool
- inference_engine_c
2021-03-18 11:00:14 +03:00
Mateusz Bencer
7602e0cd6a
fix using protobuf-lite on macos (#4850) 2021-03-18 07:28:30 +03:00
Ilya Churaev
1334d7d122
Enable OV clang format command for nGraph (#4792)
* Added add_clang_format commands

* Added clang_format targets as dependencies for original targets

* Update CI scripts

* Fixed code-style for nGraph unit tests

* Change job name

* Disable clang-format for Windows

* Fixed nGraph python build

* Fixed comments and enabled code style for ONNX Editor

* Disable code style check on compilation step
2021-03-18 06:38:10 +03:00
Vladimir Gavrilov
24c31fba6a
Fixed bug in the MO transformation UnsqueezeTileReshapeBlockToInterpolate (#4710)
* Some additional checks in the MO transformation UnsqueezeTileReshapeBlockToInterpolate.

* Refactored transformation UnsqueezeTileReshapeBlockToInterpolate: checks of applicabilty were moved into the separate function.

* Rewritten the MO transformation UnsqueezeTileReshapeBlockToInterpolate.

* Now we replace all block Unsqueeze+Tile+Reshape by Interpolate-4.

* Fixed comment.

* Added comments about applicability criteria.

* Some fixes.

* Small fix.

* Deleted redundant type casts.

* Added an example into comment.

* Now an interpolated axis length is calculated using the function node_to_get_shape_value_of_indices.

* Fixed tests.

* Optimized imports.
2021-03-17 21:56:25 +03:00
Jozef Daniecki
3d838067d8
ScatterNDUpdate operation spec refactoring. (#4851) 2021-03-17 19:40:40 +03:00
Ilya Sharikov
a382934a80
Added test for checking lib sizes, when using conditional compilation option (#4292) 2021-03-17 17:56:47 +03:00
Szymon Irzabek
38d16e24e9
Add basic gna2 model dump function (#4034)
* [GNA] Add gna model dumping

* [GNA] Modify debug layout, add timestamp, fix compound bias dump

* [GNA] Move data dump to another file

* [GNA] Create model data dump file only when needed
2021-03-17 15:51:43 +03:00
Gabriele Galiero Casay
0d0f06a2e4
Clamp specification refactoring (#4663)
* Refactor specification

* Complete detail description section

* Rewrite mathematical formula

* Fix range of values for min and max attributes

* Add note for conversion policy between float and integral type of input tensor

* Address review comments

* Fix typo in max attribute
* Remove redundant examples
2021-03-17 13:37:49 +03:00
Maksim Derbasov
2a19fc2d8a
Fix warnings spotted by cl compiler (#4793)
* Fix warnings spotted by cl compiler

* Use inline instead of anonymous namespace

* Review comments
2021-03-17 13:08:42 +03:00