Commit Graph

1158 Commits

Author SHA1 Message Date
Gladilov, Gleb
4ecdd19653
[IE][VPU]: Introduces annotations of stages memory types (#1991)
* Moves splitLargeKernelConv tests to unit tests

Originally, file with tests has been placed in a wrong place
so it was not integrated into any testing application.
Now it is a part of unit tests on VPU.

Test itself has been disabled due to issue with NCE unit usage
described in #-33366

* Introduces pass I/O memory types annotation of stages

It is useful to see where inputs and outputs are located in
performance report for analysing possible issues.

* Introduces endsWith and tuple2Vector utilities

endsWith checks if source has suffix equals to second
argument. tuple2Vector converts tuple of arbitrary size
containing the same type to vector. It could be useful
working with gtest parameter generators that have
std::tuple as return type.

* Introduces unit tests on annotating stages memory types

* Introduces missing format placeholders

* Makes memory types annotation optional

Enables private option "enableMemoryTypesAnnotation" which
disabled by default. Disabling annotation by default allows
avoid issues with tests which rely on stages names.

Signed-off-by: Gladilov, Gleb <gleb.gladilov@intel.com>
2020-09-04 14:33:10 +03:00
Kamil Magierski
9df59284bc
[GNA] Fix Activation output size not matching convolution if padded. (#1980)
* Fix Activation output size not matching convolution if padded.

* Fix input padding handling in Convolution

* fix static bug

* Use correct value for feature rotation.

* [GNA] Fix regression

* Added tests

* Added tests
2020-09-04 13:23:00 +03:00
Piotr Rozen
b27ce4b04d
Fixed speech demo compilation issue on 2021.1 and models are updated to IRv10 (#2029) 2020-09-04 12:25:45 +03:00
Nikita Kudriavtsev
4b348500d4
[IE][VPU]: Reduce XLink log level in AOTBehaviorTests (#2044) 2020-09-04 11:59:51 +03:00
Vladimir Paramuzov
214b25c49d
[IE CLDNN] Fix performance degradation for brain-tumor-segmentation-0002 (#2038)
JIRA: 37933

Co-authored-by: Egor Churaev <egor.churaev@intel.com>
2020-09-04 11:54:59 +03:00
Nikita Kudriavtsev
35357f686d
[IE][VPU]: Fix for Swish layer (#2034)
* Fix Swish layer serialization.
* Added shared test for Swish
* Firmware update 1326 -> 1349
2020-09-04 11:52:13 +03:00
iliya mironov
0c1b2f836b
Add Mish with SoftPlus transformation (#1815)
* Add Mish with SoftPlus transformation

* Refactoring accrding code review

* Add softplus to mish pass registration

* Add checks customer count for SoftPlus and Tanh ops
2020-09-04 11:07:37 +03:00
Anton Pankratv
8017ac03ea
Hetero plugin dump dot file using ngraph pass (#2042)
* Hetero plugin dump dot file using ngraph pass

* Removed unused code

* Fixed color Index

* reverted prcision forwarding
2020-09-04 10:55:40 +03:00
Alexey Varyzgin
4c87427818
[CPU][BF16] bf16 for Gemm or MatMul was enabled (#1920) 2020-09-04 10:04:02 +03:00
Chenhu Wang
479e13e713
[CPU] Interpolate operation implementation (#1465) 2020-09-04 09:54:05 +03:00
Jedrzej Hajduczenia
021941bf03
[IE CLDNN] Fix i8 regression on single-image-super-resolution-1032 (#1990) 2020-09-04 09:20:16 +03:00
Ivan Tikhonov
2f5a28d44f
LSTMCell/Sequence v1, reference implementations and decompose transformations for LSTM/GRU/RNN Cells (#2000)
* validate_and_infer_types() implementation

* input parameter validation for LSTM, GRU and RNN

* style-check applied

* Add LSTMSequence dynamic shape validation and test props for RNNCell, GRUCell, LSTMCell and LSTMSequence.

* recurrent_sequence.hpp moved to ngraph/core/include/ngraph/op/util/

* style check applied

* removed unused variable from LSTMSequence::validate_and_infer_types

* Add missing newline mark at the end of file.

* Add supression macro for FusedOp deprecation.

* Add element type initialization

* transpose,rnn cell reference implementations

* Apply PR review remarks

* reference implementations for cells op, single layer tests, align lstm cell/sequence according to the spec

* lstm/gru/rnn cell decompostion transformations

* ngraph codestyle

* clean up

* ngraph code style

* change inheritance of Cells, fix build

* fix build

* fix build again

* remove Peepholes from LSTMSeq, fix copy_runtime_info in transformations

* Rewrite tests to use gtest exception assertions.

* resolve tests issues

* ngraph codestyle

* add missed files

* fix typeprop tests

* fix lstm sequence checks

* fix arm build

* fix arm again

* delete unnecessary file

* add convert weghts format function, enable lstm test, resolve review comments

* add ngraph builders

* ngraph codestyle

* fix unit tests

* revert transpose reference implementation

* revert LSTM Cell v0, add LSTMCell v1, update transformation lstm_cell_to_cell_ie

* v1 version of LSTMCell op

* LSTMSequence v1 operation, exclude LSTMSeq from opset4

* fix python api tests

* resolve review comments, tests for decomposition transformations, switch lstm cell to opset4 in mo

Co-authored-by: Szymon Durawa <szymon.durawa@intel.com>
2020-09-04 09:04:36 +03:00
Ilya Churaev
28eed7708e
Removed builders from public API (#2059)
* Removed builders from public API

* Fixed build
2020-09-04 06:06:43 +03:00
Vitaliy Urusovskij
0b61a7568f
First time to inference POC (#1964) 2020-09-03 22:08:37 +03:00
Vladimir Gavrilov
e6a36123db
Reverted conversion of Resize-10 to Interpolate-4 in ONNX Importer. (#2048)
* Reverted conversion of Resize-10 to Interpolate-4. Now Resize with opset version < 11 generates Interpolate-1 again.

* Corrected tests.
2020-09-03 19:34:35 +03:00
Evgeny Latkin
e97100581e
[IE][VPU]: allocate maximum shaves for mish activation (#1995)
* Mish activation calculation costs more time than memory copy, so
allocate more shaves mish activation.

Co-authored-by: Jiang, Renzhi <renzhi.jiang@intel.com>
2020-09-03 19:22:56 +03:00
Ilya Znamenskiy
e862c3b720
[IE CLDNN] Fix result storing in leftover's branch (#2050) 2020-09-03 18:47:32 +03:00
Vladimir Paramuzov
b976782c70
[IE CLDNN] Fallback to FP16 for non-quantized layers in quantized FP16+INT8 IR (#941) 2020-09-03 17:41:29 +03:00
Dmitry Kurtaev
37a7bbc08c
[IE][VPU][Watchdog]: Reduce CPU usage for idle VPU (#2030) 2020-09-03 16:49:48 +03:00
Anna Khakimova
efad27d68c
AVX2/AVX512 32FC1 Resize (#1788) 2020-09-03 16:22:43 +03:00
Evgeny Lazarev
f60b46f3d4
Fixed visitor for Interpolate-1 and Interpolate-4 (#2051)
* Fixed visitor for Interpolate-1 and Interpolate-4

* Code style fix

* Remove unnecessary changes

* Fixed compilation on Linux for Atttribute visitor of vector<size_t>

* Added unit test for IE IR Reader for Interpolate-4

* Updated unit test for IR Reader for Interpolate-4

* Updated unit test
2020-09-03 16:00:46 +03:00
Anastasia Kuporosova
d9e9abcf50
[Python Tools] Replace use of layers in cross-check-tools (#1803) 2020-09-03 15:40:32 +03:00
iliya mironov
5a376477a9
Fix version print (#2022)
* Fix version print
2020-09-03 15:39:02 +03:00
Dmitry S
f57fae9f73
fixed python & glib vers differences (#2057) 2020-09-03 15:10:17 +03:00
Ilya Churaev
6f83889886
Fixed a case with empty order in transpose op (#2043)
* Fixed a case with empty order in transpose op

* Fixed comments

* Fixed transpose tests

* Fixed tests
2020-09-03 14:50:01 +03:00
Pavel Rodionov
166ec394bd
[GNA] Move old headers (#2002) 2020-09-03 14:42:30 +03:00
Andrey Dmitriev
6b2ac800aa
[GNA] Fixed case of unconnected output of split layer (#1344)
[GNA] Fixed case of unconnected output of split layer

[GNA] Fixed case of unconnected output of split layer

test

[GNA] Fixed case of unconnected output of split layer

fixed
2020-09-03 13:23:58 +03:00
Gleb Kazantaev
1f79a4054b
Fix ConvBiasFusion pass for some rare cases (#2032)
* Extended ConvMultiplyFusion tests with bias fusion

* Updated ConvBiasFusion with precise constant validation

* Fix ConBiasFusion tests

* Updated eltwise fusion tests

* Changed test parameters
2020-09-03 11:15:50 +03:00
Ilya Churaev
02c8a3c358
Removed attrs prefix for some layers (#2037)
* Removed attrs prefix for some layers

* Fixed tests
2020-09-03 07:58:07 +03:00
Evgenya Stepyreva
16c1bbeb52
38009: InterpolateReshape fix for TensorFlow style Concat (#2047)
* 38009: InterpolateReshape fix fot TensorFlow Models

* Update interpolate_reshape_test.py

* revert debug code
2020-09-02 23:01:12 +03:00
Evgeny Lazarev
a4c1c6fc46
MO docs update reshape and deprecate (#2021)
* Updated documentation for Reshape, Squeeze and Unsqueeze

* Updated MO documentation about deprecated IR v7
2020-09-02 15:49:32 +03:00
Anton Romanov
152781941a
Added Conda CentOS documentation 2020.4 (#2010) 2020-09-02 13:10:14 +03:00
Evgeny Lazarev
c7bcbb576c
Updated ConcatOptimization to support Concat with 0D input of one dimension (#2012)
* Updated ConcatOptimization transformation to work when one dimension of input to Concat is 0D

* Fixed ConcatOptimization transformation to reconnect input edges to Concat

* Completely re-written ConcatOptimization

* Updated Concat0D optimization transformation

* Fixed order of traversing Concat input ports

* Refactored ConcatOptimization transformation to use `delete_input_port` function

* Detele trailing unconnected ports in the ConcatOptimization.py

* Cleaner implementation of ConcatOptimization + unit test
2020-09-02 10:21:23 +03:00
Lukasz Debski
315274ad12
[IE CLDNN] Fixing eltwise input sizes (#2017) 2020-09-02 09:36:52 +03:00
Mikołaj Życzyński
e3178122ee
[IE CLDNN] Reduce b_fs_yx_fsv16 optimized kernel (#1690) 2020-09-02 09:35:30 +03:00
Konrad Dobros
cca724eac7
[IE CLDNN] Add fc kernel for bfyx with batches (#1946) 2020-09-02 09:32:59 +03:00
Konrad Dobros
af40de9bc1
[IE CLDNN] Add verbose macros for reorder_inputs (#1947) 2020-09-01 19:57:33 +03:00
Vladimir Paramuzov
9d4f1a7555
[IE CLDNN] First conv 3d imad (#1935) 2020-09-01 19:57:13 +03:00
Pavel Rodionov
445fd68423
[GNA] Improve ReadHeader (#1843)
* [GNA] Improve ReadHeader

Issue-34205

* [GNA[ Fix stack corruption issue in ReadHeader

* [GNA] fix code style

Co-authored-by: Kamil Magierski <kamil.magierski@intel.com>
2020-09-01 19:36:56 +03:00
Gleb Kazantaev
34b595d218
Fixed replace_output_update_name method to preserve rt info (#1983)
* Fixed replace_output_update_name method to preserve rt info

* added test
2020-09-01 17:02:46 +03:00
Gleb Kazantaev
25856f4cdc
Fixed SoftPlusDecomposition transformation (#2011) 2020-09-01 16:20:42 +03:00
Jan Iwaszkiewicz
757b1f0d9e
[nGraph] Python tests - move to int32 (#1966) 2020-09-01 15:11:58 +02:00
RomanZm
aeaffef11c
[IE CLDNN] ScatterUpdate layer added (#1839) 2020-09-01 16:07:12 +03:00
Anna Alberska
01700776f2
[GNA] RemovePermutationsNHWCToNCHWPass - check whether permute operation is last one in the model (#1805)
* [GNA] check whether permute operation is last one in the model

* add assert for checking

* change casting to static

* check casting to ConvolutionLayer
2020-09-01 15:32:28 +03:00
Lukasz Debski
b85de7f67a
[IE CLDNN] Loosen restrictions on channels in 3d fsv16 convolution kernel (#1744) 2020-09-01 15:17:03 +03:00
Vladimir Paramuzov
aadd461c11
[IE CLDNN] Disabled choose_impl call for generic nodes in some cases to avoid double compilation (#1989) 2020-09-01 15:00:52 +03:00
Ilya Churaev
c9820a9588
Do not remove convert after the topK (#1950)
* Do not remove convert after the topK

* Added debug message

* Removed xFail

* Revert "Added debug message"

This reverts commit a01ace4ade88d73e2797b47c58db33943b0f508d.

* Added test
2020-09-01 14:36:30 +03:00
Roman Vyunov (Intel)
7796b0f277
[IE][VPU]: Customer model compilation error - fix(#1901)
Fix of 36693 issue. 

* Problem: One of the concat inputs is a constant. Adjust_data_layout pass tries to duplicate all inputs that do not meet the strides requirements, and then copy from the original input to the duplicate with strides. But duplicateData with an argument in the form of a constant also creates a constant, and then, when Copy, an error appears, the presence of a constant output, which cannot be.
* Solution: In addConvertedData create an intermediate date with the same description as the constant, and then copy the constant data into it with the required strides.

Co-authored-by: DariaMityagina <daria.mityagina@intel.com>
2020-09-01 13:03:31 +03:00
Nikolay Shchegolev
43ec4a5695
[CPU] CTCLoss operation implementation. (#1482) 2020-09-01 12:52:31 +03:00
Katarzyna Mitrus
54a24b0e40
[ONNX] Enable ScatterND operator in ONNX importer (#1987)
* Enable ONNX scatter_nd

* Tests update
2020-09-01 12:10:03 +03:00