Commit Graph

3563 Commits

Author SHA1 Message Date
Bartosz Sledz
81f9d78541
ONNX Subgraph - Infer types of inputs from top level Graph nodes (#5277) 2021-05-12 10:32:34 +02:00
Bartosz Sledz
932467631e
Change broadcasted shape for mul, add and sub (dequantization) (#4865)
* Change broadcast target shape for mul, add and sub transformation

* Revert "Change broadcast target shape for mul, add and sub transformation"

This reverts commit cb1332ffc4.

* Address comments

* Adjust functests

* Adjust next functests

* Revert "Adjust next functests"

This reverts commit 529b314b70.

* Revert "Address comments"

This reverts commit 9fccfc32b1.

* Revert "Adjust functests"

This reverts commit ef5fea7006.

* Implement new approach

* Address comment

* Add functests
2021-05-12 11:27:02 +03:00
Egor Duplensky
cfc235bd65
[CPU] Do not set BF16 on input port for Eltwise after Input (#5542)
* [CPU] Do not set BF16 on input port for Eltwise after Input

Since Eltwise supports conversion to BF16
Thus unnecessary Reorder is avoided

* Create a separate function for enforcing BF16 on ports

* Add test to verify that no extra Reorder is inserted

Also:
- update legacy test
- remove extra code which is not applicable anymore

* Correct expected precision in legacy test
2021-05-12 11:21:05 +03:00
Chenhu Wang
4c452b8bb6
[CPU] MVN optimization for 1D and 2D input (#5414) 2021-05-12 10:24:07 +03:00
Alexandra Sidorova
87a94e1a49
[CPU][IE TESTS] Fixed Mish (#5462) 2021-05-12 09:57:52 +03:00
Ilya Lavrenov
30fa59126c
Hide some legacy symbols from IE (#5566) 2021-05-12 09:40:06 +03:00
Gabriele Galiero Casay
a78515f3e7
Revise DeformableConvolution operation class (#5244)
* Enhance dynamic shape inference of validate and infer types method

* Review op class of DeformableConvolution

   * Add node validation checks into validate and infer types specific to element type and shape of inputs
   * Refactor validate and infer types method to use common function to validate conv parameters and infer output shape
   * Apply these changes to Convolution and BinaryConvolution for alignment

* Add type_prop unit tests

* Add node validation checks for deformable values spatial dimensions

* Fix type_prop and python api shapes

* Fix deformable values spatial dimensions

* Add validation checks in reference implementation

* Address review comments

 * Remove reference to const for basic types in ref impl
 * Update comment with ticket to add check for u1
 * Change deformable values to offset to align with spec
2021-05-12 09:21:33 +03:00
Jozef Daniecki
6e599eab60
Remove empty files on failed serialization (#5595)
* Add unit-test for case when serialzation fail.

* Delete serialization artifacts on failure.

* Close file streams before file remove.

* Fix typos.
2021-05-12 06:31:19 +03:00
Gabriele Galiero Casay
5a0bcf50c3
Add nGraph visitor tests for reduction operations (#5538)
* Add ngraph visitor tests for reduction operations

* Add check for number of expected attributes

* Add ReduceL1 and ReduceL2 to visitor test typed case of reduce ops

* Instantiate reduce operation type in separate file
2021-05-12 06:23:14 +03:00
Pavel Esir
0b22d6c51c
Add Gather-7 to MO (#5264)
* initial solution

* added unit-tests + some corrections

* axis getting improvements

* fixed MO IR reader for old IR's

* a couple of corrections

* applied review comments

* corrected negative batch_dims normalization for shape calculation, for IR original negative values are kept

* added additional checks and negative tests
2021-05-11 22:29:59 +03:00
Roman Kazantsev
dc22c177d5
Extend MO for operation Einsum-7 (#5401)
* Extend MO for operation Einsum-7

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Add extractor for einsum and optimize code based on review feedback

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Fix the code based on the review: correct code, tests and comments; move insert_transpose

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Fix LayoutChangeForEinsum transformation condition

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Update third-party dependencies

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>
2021-05-11 21:36:04 +03:00
Anton Pankratv
9db7f849df
Fixed return warnings (#5410) 2021-05-11 20:02:00 +03:00
Vladimir Paramuzov
0dc161ad82
[IE CLDNN] Added CACHE_DIR option into docs (#5592) 2021-05-11 16:55:33 +03:00
Anastasia Kazantaeva
42226fccae
Upgrade message for 2021.4 lts (#5471) 2021-05-11 15:58:32 +03:00
Maksim Proshin
d11c5e4c9d
Moving POT to Optimization section in index.md and replacing Toolkit by Tool in a few places (#4272)
* Update get_started_dl_workbench.md

POToolkit => POTool

* Update QuantizedNetworks.md

POToolkit => POTool

* Moving POT to optimizations section

Moving POT to optimizations section
2021-05-11 14:35:33 +03:00
Ilya Lavrenov
a6d8391c4c
Removed details::no_copy (#5553) 2021-05-11 13:05:18 +03:00
Ewa Tusień
f824f914a4
[ONNX] Add Constant op from opset 13 (#5450) 2021-05-11 11:01:27 +02:00
Jozef Daniecki
1e3b06f439
Add ngraph visitor tests for Convert operation. (#5533)
* Add ngraph visitor tests for Convert operation.

* Add attribute count check to Covnert visitor test.
2021-05-11 09:13:35 +03:00
Patryk Elszkowski
3de41ec50a
add zero attribute test for tanh op (#5427)
* add zero attribute test for tanh op

* apply review suggestion

Co-authored-by: Patryk Elszkowski <patryk.elszkowki@intel.com>
2021-05-11 08:54:19 +03:00
Patryk Elszkowski
f089c40bb4
update tanh reference implementation (#5478)
Co-authored-by: Patryk Elszkowski <patryk.elszkowki@intel.com>
2021-05-11 08:53:08 +03:00
Piotr Szmelczynski
cd48b2f6ec
move elu unit-tests from fused_op.in.cpp to elu.in.cpp (#5512) 2021-05-11 08:47:42 +03:00
Bartosz Lesniewski
66b3efbb6c
Revise Squeeze op - tests (#5336) 2021-05-10 12:37:18 +02:00
Tomasz Socha
6c9387d603
[ONNX Importer] Fix dynamism for grouped conv(transpose) operators (#5540) 2021-05-10 12:09:52 +02:00
David Nam
1b8a0f7ae5
[UnitTest] Reset shared-pointer explicitly in MklDnnFunctionalTest (#5543) 2021-05-07 23:40:43 +03:00
Bartosz Lesniewski
af0aa5f430
Revise Unsqueeze op - specification (#5526)
* Revise unsqueeze op spec

* Second input value boundaries fix

* adjust first input description
2021-05-07 17:03:25 +03:00
Anastasia Popova
84b94c9834
Fuse mul transformation fix (#5518)
* Changed fuse_mul behaviour for proper data node connection.

* Corrected the comment.

* Corrected the comment.

* Added permutation attribute saving.

* Added comment.

* Added unit tests, comments corrections.
2021-05-07 17:01:31 +03:00
Ilya Lavrenov
3e25539d79
Moved ie_thread_affinity.hpp to private API (#5554) 2021-05-07 16:33:15 +03:00
Anastasia Popova
4ea09b1f98
ReverseInputChannels mapping fix (#5523)
* Fixed attributes saving to keep tensor debug info in Parameter node.

* Added comment and unit tests.

* Small correction.

* Small correction of unit test.

* Comment corrected.
2021-05-07 16:29:38 +03:00
Gabriele Galiero Casay
b9812a4275
ConvertLike specification refactoring (#5534)
* ConvertLike specification refactoring

* Corrected typos and clean up

* Changed supported types of Convert to align with ConvertLike
2021-05-07 14:53:49 +02:00
Andrei Molotkov
d4a883429d
[IE CLDNN] Fix segmentation fault for hetero plugin mode (#5548) 2021-05-07 15:13:18 +03:00
Gabriele Galiero Casay
b9fe465cf0
BatchNormInference specification refactoring (#5489)
* BatchNormInference specification refactoring

* Address review comments

 * Remove he term Transform from definition
 * Add title of the paper where this operation is introduced
 * Add missing backticks
 * Remove redundant information in attribute epsilon range of values

* Refinement of spec

Remove more mentions to transformation to avoid confusion

* Corrected typos and added changes to improve readability

* Use third person to express operation steps
2021-05-07 14:06:28 +03:00
Alexander Zhogov
102e95f7f5
Azure: Add installing setuptools in linux_onnxruntime.yml (#5547) 2021-05-07 13:59:59 +03:00
Krzysztof Bruniecki
7c07c6154b
[GNA] New flags to select GNA target generation (#5429)
* New flags for GNA trget

* Add new flags to configuration

* Update utest

* Update speech_Sample

* Add unit tests

* Guard for wrong values

* Use gna execution target as consistent device

* Apply review
2021-05-07 13:02:49 +03:00
Gabriele Galiero Casay
edfec9171f
ReduceSum specification refactoring (#5527) 2021-05-07 12:58:06 +03:00
Ilya Lavrenov
39717aea39
Revert "Reuse existing cmake variables" (#5550)
This reverts commit ff583ce868.
2021-05-07 12:17:50 +03:00
Sergey Lyubimtsev
d339cbebfb
Updated list of supported OS for PyPi (#5525)
* Updated list of supported OS for PyPi

* merge of Helena branch

* 55103: add instructions to install Microsoft* Visual C++ Redistributable Package
2021-05-07 12:04:51 +03:00
Elizaveta Lobanova
696aa37c37
[GNA] Fix compilation of topologies with only 2 functional layers: convolution and pooling (#5501) 2021-05-07 12:01:44 +03:00
Ilya Lavrenov
349e2910fe
Openvino autogenerated cmake (#5484)
* Exclude xbyak from install

* Added automatically generated InferenceEngineConfig.cmake

* Reverted a version back

* Fixed issues with target aliases

* Make TBB dependency private

* Made ie_parallel.cmake self-sufficient

* Don't expose ie_paralle.cmake to end users

* Fixed compilation with TBB

* Fixes for TBB

* Fixed vpu_graph_transformer compilation

* Fixed tests compilation

* Added install of ie_parallel.cmake

* Switched ENABLE_ALTERNATIVE_TEMP to OFF. Fixed COMPONENTS for TBB

* Fixed file name in install rules

* Added find_dependency for TBB in ie_parallel.cmake

* WA for cmake bug with PACKAGE_PREFIX_DIR

* Fixed no-deprecation to fix speech-library build

* Reverted version from 2.1.0 to 2.1

* Revert "Reverted version from 2.1.0 to 2.1"

This reverts commit 7cb5d1563c.

* Returned custom version file back

* Added InferenceEngineConfig-version.cmake to share as well

* Disabled one more GPU test

* Added one more WA for CI

* WA for CI issue for C API

* WIP
2021-05-07 11:57:51 +03:00
Mikhail Nosov
8a3d826d69
Add VerifyAndClearExpectations for mocked object stored as shared_ptr (#5541)
It is a known internal issue in gtest when holding a shared_ptr to mocked object, which sometimes reports about memory leak
It is recommended to use Mock::VerifyAndClearExpectations at the end of each test when mock object is not needed anymore

After adding this, issue with incorrect TestThrowOnImport expectations is observed
2021-05-07 11:47:57 +03:00
Szymon Irzabek
ed255eee71
[GNA] Additional PWL segments are added to avoid saturation (#5399)
* [GNA] Additional PWL segments are added to avoid saturation

After design phase for PWL segments has finished,
additional segments are added to avoid saturation.

This commit also reduces the number of PWL segments created
for some layer types.

* [GNA] Make PWL unit tests take into account saturation errata
2021-05-07 11:13:05 +03:00
Vladimir Gavrilov
0c288d506c
MO support for operations DFT and IDFT (#5197)
* Written MO classes for DFT and IDFT operations.

* Added class to read TF (I)FFT operations.

* Written extractors for TF operations FFT, FFT2D, FFT3D, IFFT, IFFT2D, IFFT3D.

* Written MO Roll operation and TF Roll operation extractor.

* Started to write needed transformations.

* Written transformation StridedSlices + Complex + Roll + (i)FFTxD + Roll + (Imag, Real) + Pack -> Roll + (I)DFT + Roll.

* Written transformation for Complex + ComplexAbs.

* Written correction of axes of Roll.

* Small fix.

* Small fix.

* Some fixes.

* Some changes.

* Now TF Roll is read as TFRoll. Written inserting Transposes before and after (I)DFT.

* Small fix.

* Written tests for the transformation TFRollToRoll.

* Added comments to some transformations.

* Deleted redundant import.

* Written tests for the transformation TransposeDFT.

* Fixes in MO IR Reader to read/write (I)DFT.

* Fixes in the list of supported TF layers.

* Started to write tests for SSliceComplexRolledFFTPackBlockReplacement transformation.

* Written tests for the MO transformation SSliceComplexRolledFFTPackBlockReplacement.

* Written tests for the MO transformation ComplexAbs.

* Tests for transformations were moved into unit_tests directory.

* All extractors for (I)FFTxD are in one file now.

* Deleted redundant transformations.

* Fixed extractor for TF Roll: now this operation is read as MO Roll.

* Added comments to TFFFT operation.

* The method insert_transpose of classes TransposeDFT and LayoutChangeForGatherND was moved into the separate function in the file model-optimizer/extensions/middle/InsertLayoutPropagationTransposes.py.

* Fixed comment for the transformation TransposeDFT.

* Small fix.

* Some fixes.

* Deleted shape infer function for the operation TFFFT. Sorted imports in complex_abs.py.

* Small fixes.

* Deleted redundant import.

* Fixes in some asserts.

* Small fix.

* Added names for created nodes in the transformation ComplexAbs.

* Added comments to the method canonicalize_axes.

* The transformation SSliceComplexRolledFFTPackBlockReplacement was split into the sequence of transformations SSliceComplexRollReplacement -> RollRealImagPackReplacement -> TFFFTToDFT.

* Written tests for the transformation SSliceComplexRollReplacement.

* Written tests for the transformation RollRealImagPackReplacement.

* Written tests for the transformation TFFFTToDFT.

* Deleted commented code.

* Fixed types of constants in the transformation ComplexAbs.

* Written tests for canonicalization of signal_size value.

* Deleted 'Replacement' from names of files and classes.

* Used comarison of ids, not names.

* replace_sub_graph was replaced with find_and_replace_pattern.

* Now the transformation RollRealImagPack is executed before running transformation model-optimizer/extensions/front/Pack.py.

* The body of the function create_dft_from_tffft is a part of the transformation TFFFTToDFT body now.

* Now method correct_roll_axes of classes RollRealImagPack and SSliceComplexRoll is moved to the function in mo/front/tf/graph_utils.py.

* Small changes.

* Added comment before mark_input_as_in_correct_layout(roll, 2).

* Now the functions correct_roll_axes generates sub-graph in the input port 2 of Roll.

* Corrected tests for the transformation SSliceComplexRoll.

* Corrected tests for the transformation RollRealImagPack.

* Deleted commented code.

* Some renaming.

* Added decomposition of the separate operation ComplexAbs (without Complex before it).

* Added comment to the transformation ComplexAbsAfterComplex.

* Optimized imports for the transformation TFFFTToDFT.

* The transformation SSliceComplexRoll was split into the sequence SSliceComplex -> CorrectRollAxes and disabled.

* Written tests for the transformation ComplexAbs.

* Written tests for the transformation SSliceComplex.

* Written tests for the transformation CorrectRollAxes.

* Deleted the transformation SSliceComplexRoll.

* Deleted renaming nodes.

* Fixed comment.

* Small fixes.

* Small fix.

* The attribute need_correction was renamed as input_rank_changed.

* Small fixes.

* Deleted commented code.

* Now we iterate over all complex_node.out_port(0).get_connection().get_destinations() input ports and mark the corresponding nodes with the marker attribute.

* Added the attribute 'in_ports_count' into the class FFTBase.

* Tests for the transformation TransposeDFT were rewritten using helper functions.

* Now the transformation RollRealImagPack uses existing Roll node instead of creating new one.

* Small fixes.

* Fix in the documentation.

* Written class to read MxNet (I)FFT operations. Written corresponding extractors.

* Corrected shape infer function for MXFFT operation. Written transformation to convert MXFFT to (I)DFT.

* Fixed shape infer function.

* Fixed the conversion MXFFT to (I)DFT.

* Written tests for the transformation MXFFTToDFT.

* The function correct_roll_axes was replaced with more generic function add_constant_to_negative_values.

* Fixes in classes TFFFT, FFTBase, DFT, IDFT, MXFFT.

* Added asserts in constructors of operations TFFFT and MXFFT.

* Refactored transformation MXFFTToDFT: conversion of DFT and IDFT were moved into separated functions.

* Moved some commented code.

* Fixed BOM file.

* Written function convert_ifft_to_dft.

* Started to rewrite tests for MXFFTToDFT transformations, in the case is_inverse=False.

* Small fixes.

* Fixes in the transformation RollRealImagPack.

* Renaming tests class for the transformation SSliceComplex.

* Fixes in the function compare_graphs. Now we get all output nodes of op node, and these output nodes are sorted by names.

* Fixed tests for the transformation MXFFTToDFT.

* Fix in the transformation ThresholdedReluDecomposition: added disconnect for trelu input port.

* Fixes in test for the transformation TFSliceToSlice.

* Small fix in the transformation ObjectDetectionAPIPreprocessor2Replacement.

* Small fix in comment.

* Optimized imports.

* Used remove_node in the transformation ThresholdedReluDecomposition and remove_nodes_from in the transformation RollRealImagPack, instead of ports disconnection.

* Deleted commented code.

* Deleted test case test_slice_replacer_begin_with_2_inputs.
2021-05-07 09:44:24 +03:00
Vladimir Zinoviev
8645c08396
[LPT] Zero point insertion in case of zero value on FQ output high (#5467)
* [LPT] Zero point insertion in case of zero value on FQ output high

* [LPT] Change precision in test on the real default precision[0]
2021-05-06 21:48:36 +03:00
Ilya Lavrenov
a8289b58c4
Fixed TBBBind_2.4 usage for RelWithDebInfo (#5535) 2021-05-06 21:21:23 +03:00
Artemy Skrebkov
a8b5f1f4a3
Update opencv package for yocto (#5536) 2021-05-06 20:57:59 +03:00
Roman Donchenko
2c755aaf6f
Fix incorrect plural: childs -> children (#5532) 2021-05-06 20:08:42 +03:00
Gorokhov Dmitriy
a19413c0c0
[CPU] Plugin migration on ngraph (#4344) 2021-05-06 19:49:24 +03:00
Poliksenov Ivan
2bb8e9facc
[IE][VPU]: Removed constant DDR_MAX_SIZE = 512. (#4372)
* Removed constant DDR_MAX_SIZE = 512.
Removed the DDR_MAX_SIZE constant as it could potentially lead to incorrect behavior of devices with a different DDR size (Prism Creek can be up to 2 GB in size). Removed the use of this constant in methods.
2021-05-06 17:29:06 +03:00
Jozef Daniecki
2896b3af8c
Convert op specification refactoring. (#5530)
* Convert op specification refactoring.

* Minor readability improvements.

* Fixed 'category' formatting.
2021-05-06 17:16:52 +03:00
Anton Chetverikov
b3c1dd9de3
Add sys_platform environment marker to version checker (#5437)
* Add sys_platform environment marker

* Update sys_platform check

* Add unit tests for sys_platform marker

* apply review comments

* Fix typo

* Update checker and tests, apply comments

* Update comments parsing and tests

* Fix commrnt

* Resolve comments and update check logic

* Update tests and fix bug with negative tests

Co-authored-by: achetver <anton.chetverikov@.intel.com>
2021-05-06 16:20:37 +03:00
Anton Chetverikov
e86b9b17b0
Update Gather-7 specification (#5441)
* Allow nagative values for batch_dims

* Update formula

* Update spec according to comments

* clarified cases when batch_dims and axis less than zero and enhanced restriction for index types

Co-authored-by: Pavel Esir <pavel.esir@intel.com>
2021-05-06 16:01:53 +03:00