Commit Graph

2604 Commits

Author SHA1 Message Date
Piotr Szmelczynski
9695076bde
Maxpool spec update (#3758)
* Update spec

* Update outputs section

* Update rounding_type section

* Update spec

* Update input section

* add newline

* fix one xml example

* fix indentation

* Update detailed description

* Update detailed description

* Update spec

* Change reference name

* add new line

* Update spec

* fix typo

* fix style

* fix example 5 description

* Update spec

* Add Types section

* Refactor xml examples

* Update xml examples and add bfloat16 to supported types

* Update supported types
2021-02-05 21:04:53 +03:00
Vladimir Gavrilov
c1136cd7b0
Completely transition of MO to Interpolate-4 (#970)
* Refactored infer function and function supported_attrs for the layer Interpolate.

* Small change.

* Deleted unneeded checks in transformations ResizeToInterpolate2D and ResizeToInterpolate3D.

* Small fix in the extractor of ONNX Resize.

* Now the extractor of TF ResizeBilinear generates Interpolate-1 again, because 'axis' in final version of Interpolate-4 specification is an input but is not attribute.

* Now the extractor of TF ResizeNearest generates Interpolate-1 again, because 'axis' in final version of Interpolate-4 specification is an input but is not attribute.

* Added static method get_axis into class Interpolate.

* Refactored class CanBeFused in the transformation InterpolateSequenceToInterpolate.

* Fixed transformation InterpolateSequenceToInterpolate according to the last version of the specification of Interpolate-4.

* Started to write support of Interpolate-4 in the transformation InterpolateWithConcat.

* Added support for Interpolate-4 into the transformation InterpolateWithConcat.

* Added support for Interpolate-4 into the transformation InterpolateConcat.

* Added support for Interpolate-4 into the transformation InterpolateReshapeWA.

* Added support for Interpolate-4 into the transformation InterpolateTranspose.

* Started to add test for opset4 case of the transformation InterpolateSequenceToInterpolate.

* Added test for InterpolateSequenceToInterpolate (test_2d_interpolate_sequence_1_opset4_case).

* Added test for InterpolateSequenceToInterpolate (test_2d_interpolate_sequence_4_opset4_case).

* Added another test for InterpolateSequenceToInterpolate (test_2d_interpolate_sequence_5_opset4_case).

* Added another test for InterpolateSequenceToInterpolate (test_3d_interpolate_sequence_1_opset4_case).

* Finished addition of tests for opset4 case of InterpolateSequenceToInterpolate.

* Small change.

* Now opset is only opset1 or opset4 in the transformation InterpolateTranspose.

* Small fixes in transformations ResizeToInterpolate2D and ResizeToInterpolate3D.

* Deleted reading of unused ONNX attributes.

* Fixed docstring of the transformation InterpolateV1ToInterpolateV4.

* Added node name in assert about axes input.

* Fixes in the definition of the operation ONNXResize11.

* Now Interpolate-4 cannot have 'extension' as opset.

* Now the transformation InterpolateV1ToInterpolateV4 uses find_and_replace_pattern but not replace_sub_graph.

* Fixed tests for transformations InterpolateReshapeWA and InterpolateConcat.

* Fixed some tests.

* Rewritten operation Interpolate-4 class according to new variant of documentation.

* Some fixes in ONNXResize11 operation class.

* Now the transformation ONNXResize11ToInterpolate generates Interpolate-4 with 4 inputs.

* Now the transformation UpsampleToResample generates Interpolate-4 with 4 inputs.

* Now the transformation NearestNeighborUpsampling generates Interpolate-4 with 4 inputs.

* Now transformations ResizeToInterpolate2D and ResizeToInterpolate3D generate Interpolate-4 with 4 inputs.

* Now the transformation SplitConcatPairToInterpolate generates Interpolate-4 with 4 inputs.

* Now the transformation UnsqueezeTileReshapeBlockToInterpolate generates Interpolate-4 with 4 inputs.

* Now the transformation InterpolateV1ToInterpolateV4 generates Interpolate-4 with 4 inputs.

* Some fixes.

* Fixed the transformation InterpolateSequenceToInterpolate according to new variant of Interpolate-4 specification.

* Fixed typos.

* Added shape_calculation_mode to supported_attrs.

* Small fixes.

* Added operation ONNXResize10 and the transformation ONNXResize10ToInterpolate4.

* Fixed function correct_scales_using_dst_shape.

* Some fixes in InterpolateSequenceToInterpolate.

* Fixed bug in the method __call__ of the class CanBeFused: now self.accumulated_axes is correctly cleared in all cases.

* Small change.

* Fixed tests for the transformation SplitConcatPairToInterpolate.

* Now transformations InterpolateWithConcat, InterpolateReshapeWA, InterpolateConcat support Interpolate-4.

* Fixed the transformation InterpolateTranspose for the case of Interpolate-4.

* Written the back transformation InterpolateV4AxesCorrection to convert 'axes' input of Interpolate-4 from NHWC to NCHW layout.

* Added PermuteInput in Interpolate-4 infer.

* Fixed typos.

* Deleted the transformation InterpolateAxesCorrection.

* Now Interpolate-4 permutes axis, not shape in input port 3.

* Small fix.

* Some fix.

* Fixed bug in the transformation UpsampleToResample.

* Added some debug prints.

* Added more debug prints.

* Now ONNX Upsample-9 operation is read as ONNXResize10.

* Small fix.

* Small fixes.

* Fixed tests for the transformation SplitConcatPairToInterpolate.

* Deleted debug prints.

* Deleted some debug prints.

* Fixes in the transformation UnsqueezeTileReshapeBlockToInterpolate and its tests.

* Small fix in the transformation InterpolateSequenceToInterpolate.

* Started to write nGraph transformation to convert Interpolate-1 to Interpolate-4.

* Deleted redundant files.

* Small fixes.

* Small fix.

* Written draft of the transformation Interpolate-1 -> Interpolate-4.

* Small fix.

* Now ONNX Importer reads Resize-10 as Interpolate-4.

* Fixes in the test onnx_model_resize10_import_only.

* Small fix in the test for the conversion Interpolate-1 -> Interpolate-4.

* Small fixes.

* Fixed NGraphReaderTests for Interpolate.

* Some fixes.

* Deleted class for Resample operation.

* Fix in the transformation NearestNeighborUpsampling: fixed precision of the input 'scales' of generated Interpolate-4.

* Fixed typo.

* Now the TF operations ResizeBilinear is readed as internal MO operation TFResizeBilinear. This internal operation is converted into Interpolate-4.

* Small fix in BOM-file.

* Added checks of existence of attributes of TF  ResizeBilinear operation.

* Small fixes in the conversion of the internal MO operation  TFResizeBilinear to Interpolate-4.

* Small fixes.

* Small fixes.

* Now the transformation ONNXResize10ToInterpolateV4 calculates sizes input as input_shape * (scales + epsilon).

* Added the internal MO operation TFResizeNearestNeighbor.

* Fixes in the transformation SplitConcatPairToInterpolate and its tests.

* Fixes in the transformation UnsqueezeTileReshapeBlockToInterpolate and its tests.

* Written the transformation that converts the internal operation TFResizeNearestNeighbor into Interpolate-4.

* Now MO reads the TF operation ResizeNearestNeighbor as the internal MO operation TFResizeNearestNeighbor.

* Small fix.

* Now the specification of Interpolate-4 clarifies that the mode linear_onnx supports only 2D or 4D input tensors.

* Small fix.

* Some fixes.

* Moved the transformation ONNXResize10ToInterpolateV4 to the front stage.

* Deleted infer function and function supported_attrs for ONNXResize10 operation.

* Deleted supported_attrs() for TFResizeBilinear and TFResizeNearestNeighbor.

* Some fixes.

* Fixes in the shape infer function of the nGraph operation Interpolate-4. Now 'axes' input can be non-constant.  In the such case, all elements of the output shape are Dimension::dynamic().

* Deleted corner cases processing in transformations TFResizeBilinearToInterpolateV4 and TFResizeNearestNeighborToInterpolateV4.

* Rewritten the function replace_resize_bilinear.

* Written inner MO operation TFResize that covers TF operations ResizeBilinear and ResizeNearestNeighbor.

* Now TF operations ResizeBilinear and ResizeNearestNeighbor are read as an internal operation TFResize in MO. Transformations TFResizeNearestNeighborToInterpolateV4 and TFResizeBilinearToInterpolateV4 are fused into one transformation TFResizeToInterpolateV4.

* Some changes in the shape infer function of nGraph op Interpolate-4.

* Small fix.

* Some changes.

* The transformation TFResizeToInterpolateV4 is moved to the front stage.

* Deleted redundant assert.

* Deleted transformations ResizeToInterpolate2D and ResizeToInterpolate3D.

* Some renaming.

* Small change.

* Deleted .copy() in the shape infer function of the internal operation TFResize.

* Small fix.

* Small fixes.

* Added comment about the case when the input 'axes' of Interpolate-4 is non-constant.

* Written test for Interpolate-4 shape infer, for the case when the input 'axes' is non-constant and shape_calculation_mode = scales.

* Some fixes.

* Small fixes.

* Small fix.

* Added yet another test for the case of non-constant 'axes' input of Interpolate-4 (when shape_calculation_mode = sizes).

* Added some comment.

* Small fix.

* Reverted changes for InterpolateWithConcat.

* Added type checks for all inputs of nGraph operation Interpolate-4.

* Added u32 and u64 to supported element types of sizes and axes inputs of nGraph operation Interpolate-4.

* Fixed some functional tests.

* Some changes.

* Added helper function float32_array.

* Now the MO transformation InterpolateV1ToInterpolate preserves names of layers.

* Small fix.

* Small fix.

* Reverted some change.

* Small fixes.

* Small fix.

* Small fix.

* Small fix.

* Small fix.

* Reverted changes in the nGraph reader tests for Interpolate-1.

* Some revert.

* Fixed some copyright year.
2021-02-05 19:20:26 +03:00
Alexander Zhogov
bd3884b602
Azure CI: Increase build speed on Linux (#4124)
* EPHEMERAL_WU2, F8s_v2

* D16ds_v4

* Set LIN_VMSS_VENV_F16S_WU2
2021-02-05 18:41:01 +03:00
Alexander Zhogov
a3dc2649e2
Azure CI: Enable nGaph ONNX check (#2631)
* GitHub CI: Add nGraph ONNX check

* Fix job name

* Fix commands

* Enable nGraph Docker

* Fix

* Fix

* Fix

* Remove Actions

* Decrease a number of workers for executing models tests

* Enable "Docker run tests"

* Unset parallel execution

* Add cloning models

* Update model_zoo_preprocess.sh cmd

* Fix model_zoo_preprocess.sh cmd

* Add share

* ls -alR /mnt/onnxtestdata

* Change path

* move clone models

* Update script

* Add wget

* Update

* Update to master

* Update

* Update

* clone into tmp

* Enable clone

* Fix

* Use model_zoo_preprocess

* Add copy to share

* Enable tests

* Get MSFT

* Run tests

* Try 16 cores

* rub tests

* list models

* run tests

* Run tests, no --model_zoo_xfail

* Run tests, -n 8

* Run tests, -n 1

* Run tests, -n 4

* Run tests, -n 2

* Run with -n 1

* Update info

* First try to run onnx ci:
 * disable MSFT models for first try,
 * try to align onnx_models

* Enable steps

* Update cmake

* Add destination for cmake build

* Try to fix cmake build

* set ninja and instal dependencies

* Revert changes from Blaczkowski, Rafal

* Add swapfile 15 GB, run on AMD CPU 16 cores, 64 GB RAM

* Enable model_zoo_preprocess.sh

* Add reference-if-able

* Update

* test_zoo_models.py -n 8

* Fix clone

* Set LIN_VMSS_VENV_EPHEMERAL_WU2, F8s_v2

* git clone --single-branch

* test_zoo_models.py -n 6, D16as_v4

* -n 4

* clean

* -n 2

* -n 4, swap 48 GB

* E16ds_v4 (16-128), -n 8

* -n 8

* Set LIN_VMSS_VENV_ONNX_WU2

* -n 4

* del -n 16 for ut

Co-authored-by: rblaczko <rafal.blaczkowski@intel.com>
2021-02-05 17:48:16 +03:00
Dmitrii Denisov
d323e43e69
Update install_openvino_dependencies.sh (#4183)
* Update install_openvino_dependencies.sh

Added python packages for CentOS 7

* Update install_openvino_dependencies.sh
2021-02-05 17:45:21 +03:00
Kate Generalova
6c3c0cca24
Skip installing numa pkg in OCL driver script (#4180)
fix internal issue #41229
fix syntax issues
2021-02-05 15:35:16 +03:00
Elizaveta Lobanova
4393525313
[GNA] 1D convolution support for native NCHW models (#4067) 2021-02-05 14:55:11 +03:00
Maxim Vafin
08a527602f
Extend LayerNorm pattern to support onnx bert (#4137)
* Extend LayerNorm pattern to support onnx bert

* Fix test

* Fix test
2021-02-05 14:26:24 +03:00
Tomasz Socha
65e2b4af3f
[ONNX Importer] Switch to opset6 (#4112) 2021-02-05 11:15:13 +01:00
Gladilov, Gleb
90347c2033
[IE][VPU]: Enables Loop Support (#4157)
* Enables StaticShapeLoop -> CNN conversion as TensorIterator
* Enables visit_attributes API for StaticShapeLoop
* Enables Loop support in TensorIterator parser
* Fixes LoopStart/LoopEnd serialization
* Fixes dynamic iterations count for LoopEnd
* Updates firmware on Loop fixes
2021-02-05 11:36:17 +03:00
Maxim Vafin
abf37e1caf
Fix performance regression due to copying of opset (#4184) 2021-02-05 11:25:09 +03:00
Maksim Makridin
e47186aad6
Modifications for Object Detection SSD Python sample (#3976)
* Modifications for Object Detection SSD Sample Python

* Fixes for tests

* Changing the way output checks are processed
2021-02-05 11:10:30 +03:00
Evgenya Stepyreva
47127fb021
opset1::OneHot Fix shape infer function for dynamic input shape case (#4163) 2021-02-05 10:10:40 +03:00
Vladislav Volkov
6083c7fa6b
Fix for switches conditional compilation (#4168) 2021-02-05 09:42:13 +03:00
Yury Gaydaychuk
bf05b4d4f6
[CPU] Disabled inplace for const input in Scatter node (#4148) 2021-02-04 22:42:58 +03:00
Alexey Varyzgin
1bd7b37419
[CPU] BF16 Deconvolution support (#4048)
* disable and cleanup interp and resample that is covered by interpolate

* [BF16] Deconvolution was enabled

* Deconvolution tests were added

* Copyright year was fixed

* Friendly name usage for tests

* Test inherited from CPUTestsBase

* Fusing tests were added

* oneDNN was updated

* Gemm and 1x1 were added with tests

* Number of channels not aligned on vector length was done for blocked cases

* DW deconvolution case was added with tests

* oneDNN changes for BF16 deconvolutions were squashed

Co-authored-by: chenhuwa <chenhu.wang@intel.com>
2021-02-04 22:19:01 +03:00
Tomasz Socha
937c332978
[ONNX][Tests][Python][Models] Increase tolerance for some models (#4150) 2021-02-04 15:54:11 +01:00
Anton Pankratv
945da5ff4f
Removed template from base (#4045)
Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>
2021-02-04 17:43:20 +03:00
Maxim Vafin
e80e5e7ae5
Add python API for MVN-6 (#3816)
* Add python api for MVN-6

* Fix code style

* Fix codestyle

* Apply feedback

* Fix test
2021-02-04 17:36:19 +03:00
Ilya Lavrenov
367cacd2f2
CVS-43973: added HWC layout (#4147)
* CVS-43973: added HWC layout

* Added test
2021-02-04 15:16:31 +03:00
Jozef Daniecki
2d979accab
Added BIN precision convertion to ngraph's u1. (#4160)
* Added BIN precision convertion to ngraph's u1.

* Add test to check if serialization works with BIN precision.
2021-02-04 14:41:54 +03:00
Anton Pankratv
54c889f876
Implemented base cancelation implementation (#3805) 2021-02-04 11:19:44 +03:00
Mingyu Kim
04760cb59a
[IE CLDNN] Added ScatterElementsUpdate op support (#4105) 2021-02-04 11:16:27 +03:00
Ilya Churaev
939ddeac41
Moved ittapi to thirdparty (#4164) 2021-02-04 11:13:44 +03:00
Ilya Lavrenov
956c6dd35f
Extracted toolchain to build with static runtime from OneCore toolchain (#3045)
* Static runtime

* Fixed cldnn compilation with static runtime

* Added separate toolchain for static runtime

* Added toolchain itself
2021-02-04 11:08:30 +03:00
Gladilov, Gleb
47b1244b25
[IE][VPU]: Enables WA for Loop creation (#4153)
Loop operation constructor call is not sufficient to
create Loop operation, such methods as set_special_body_ports,
set_sliced_input and other may need to be called as well.
set_special_body_ports must always be called since it specifies
required attribute body_condition_output_idx. If it has not been
done before validate_and_infer_types call - exception will be thrown
that this required attribute is not set.

Recently, validate_and_infer_types call has been added to
set_sliced_input implementation. As a result, if Loop has sliced
inputs, they must be specified not earlier set_special_body_ports,
otherwise program will fail.

Signed-off-by: Gladilov, Gleb <gleb.gladilov@intel.com>
2021-02-04 10:46:42 +03:00
Andrey Somsikov
9b5b2bb002
Add collector path for cond. comp. tests (#4159) 2021-02-04 10:35:24 +03:00
Chenhu Wang
db84033aa8
[CPU] Introduced Load/Store emitters (#3567)
- Created emitters for jitted load and store and apply to MVN node
- MVN template function removed
- Optimized tiles processing in MVN node implementation
2021-02-04 10:21:26 +03:00
Ilya Lavrenov
69e3ca5ec7
Re-used XML utils (#4170) 2021-02-04 08:42:16 +03:00
Bartek Szmelczynski
18a65b5330
Serialization dynamic layer bug (#3982)
* remove if statement which checks if there is no dynamic shape

* remove reshaping for genericIE operation

* back to the previous version with reshape

* remove blank space

* add plugin_api to cmake in order to use generic_ie.hpp in serialize file

* add SLT for serialization for NonMaxSupperesion operator

* revert the removal of if check for dynamism

* remove the left over from CMakeLists

* fix CmakeLists removal fail

* remove redundant parenthesis

* add test which failed in the first place and fixes to it

* fix wrong spaces
2021-02-04 07:21:37 +03:00
Svetlana Dolinina
dc1b605b7f
Ngraph: add methods for removing parameters from Function (#3854)
* added methods for parameters

* added tests

* remove parameter from low latency

* Revert "remove parameter from low latency"

This reverts commit 86a91ddcb0.

* comment added

* fix style

* review fix

* extended comments

* style fixes

* review fixes

* test fix

* added full pipeline test
2021-02-04 06:59:06 +03:00
Tomasz Socha
4563101c5a
[ONNX Importer] Onnx importer support for brocker names (#4087)
* ONNX Importer changes

* Unit tests

* Style

* Don't set tensor names for result output tensor

* Review fx I

* fix

* Style

Co-authored-by: Vladislav Volkov <vladislav.volkov@intel.com>
2021-02-04 06:53:27 +03:00
Georgiy Manuilov
ff4227cf53
Add missing header for std::tolower (#4156)
* Add missing header for std::tolower

Missing header causes syntax error when compiling for Windows using Visual studio 2017. Closes #4155

* Reordered STL header includes in order to pass style check
2021-02-04 06:52:29 +03:00
Ilya Churaev
22543c4e3f
Fixed cc compilation (#4161) 2021-02-04 06:38:16 +03:00
Ilya Churaev
748780e392
Supports tensor names with delimiter (#4085)
* Supports tensor names with delimiter

* Fixed comments

* Allow to use different delimiters
2021-02-04 06:38:05 +03:00
Artyom Anokhov
da9d42f63b
setupvars.bat: Removed "setlocal enableDelayedExpansion", updated checking python_version (#4162) 2021-02-03 21:16:54 +03:00
Anton Pankratv
0a63b9214a
Used std::string as API paramters (#4050) 2021-02-03 19:21:39 +03:00
Polina Brzezinskaya
64312bc067
[IE][VPU]: Fix SEGFAULT when calling GetExecGraphInfo() from imported network (#3769) 2021-02-03 18:03:56 +03:00
Ilya Lavrenov
75ed35836f
Properly enabled ia32 build (#4145)
* Properly enabled ia32 build

* Fixed OpenCV_DIR env check
2021-02-03 17:26:50 +03:00
Edward Shogulin
f57f1fafc7
[LPT] Q/DQ support integration (#3575)
* [ MO ] New INT weights form

	Ticket #34096

	FQ = Quantize -> Dequantize =
	= FQ` -> Convert(int8) -> Convert(src_dtype) -> FQ =
	= Constant(int8) -> Convert(src_dtype) -> FQ =
	= Constant(int8) -> Convert(src_dtype) -> Subtract(zero_point) -> Multiply(scale)

* [LPT] Q/DQ representation support

Co-authored-by: Evgenya Stepyreva <evgenya.stepyreva@intel.com>
2021-02-03 17:05:34 +03:00
Nikolay Shchegolev
8d7c9de090
[CPU] Enable MVN-6 operation. (#3400) 2021-02-03 16:49:37 +03:00
Jozef Daniecki
4b1efeb858
Group convolution (#3995)
* GroupConvolution SLT style refactoring.

* Add GroupConvolution 1D SLT.

* Add GroupConvolution Serialization SLT.

* Add GroupConvolution ref impl to evaluates_map.

* Add GroupConvolution ref impl.

* Fix compilation on master.

* GroupConvolution specification update.

* Readability refactoring.

* Specification refactoring.

* Added 'output' section in GropuConvolution spec.
2021-02-03 16:07:01 +03:00
Kate Generalova
8b800cc539
add cl_compiler, dl_streamer and opencv deps to install dependencies script for Ubuntu (#4136)
* add cl_compiler, dl_streamer and opencv deps to install dependencies script for Ubuntu

libgl1 - for opencv package from PyPi
vainfo - for gstreamer-vaapi plugin
libtinfo5 - for cl_compiler tool

* remove old DL Streamer deps script

internal fix #40514

* add gstreamer tools as DL Streamer, opencv optional install dependency
2021-02-03 15:51:53 +03:00
Patryk Elszkowski
3ad1360f5f
Compare function - compare attributes - unit test (#4092)
* Enable node attributes comparing in SLT

* Add values of compared values to error message

* Switch from op version to set

* Test for Constant node

* Compare clamp min max attribute tests

* try to fix CentOS build

* use HasSubstr matcher from gMock

* add more tests

* Add DummyConstan op to check if validation handle different types

* use new Function comparison API

* Add test for unsupported type

Co-authored-by: Patryk Elszkowski <patryk.elszkowki@intel.com>
2021-02-03 15:24:25 +03:00
iliya mironov
1419e05032
Add python api for CTCGreedyDecoder (#3947)
* Add python api for CTCGreedyDecoder

* Fix code style

* Fix unit test

* Fix code style

* Fix unit tests

* Fix python tests

* Fix python tests

* Fix python tests

* Fix according to code review

* fix

* Fix api

* fix unit tests

* Fix unit test

* Fix python api
2021-02-03 14:53:53 +03:00
Anton Chetverikov
1b8930c4cb
Remove redundant attributes in back_edges for TI and Loop layers (#4133)
* Remove redundant edge attrs for loop layer

* Update copyright year
2021-02-03 14:50:47 +03:00
Ilya Lavrenov
e71aae9d29
Fixed CVS-47120 (#3919) 2021-02-03 14:27:02 +03:00
Ilya Lavrenov
be772c58bb
Fixed "Reverse input channels" case for common Plugin API (#4142)
* Added preprocessing for GetBlob

* Fixed preprocessing tests

* Added more test cases

* Skipped tests on GPU
2021-02-03 14:21:33 +03:00
Vladimir Paramuzov
a54d9780c5
[IE CLDNN] FP16 fused eltwise fix (#4028) 2021-02-03 13:46:58 +03:00
Kamil Magierski
9ff8e262ee
Dynamic Batch Test (#3936)
* Dynamic Batch Test

Whitespace fixes

style fixes

Include path fix

whiteline fix

Review comments implementation

* MacOS build fix

* Move dynamic batch test to configuration_tests

* change test namespace
2021-02-03 13:16:48 +03:00