Commit Graph

3563 Commits

Author SHA1 Message Date
Ilya Churaev
d55b9193c5
Fixed AlignedBuffer destructor (#5752) 2021-05-24 11:41:26 +03:00
Gleb Kazantaev
2f95d25205
Fix non determinism inside Serialization (#5743) 2021-05-24 10:56:33 +03:00
Taylor Yeonbok Lee
e3b4037b69
[IE CLDNN] Fixed permute reorder fusing bug for blocked format => non blocked format (#5754) 2021-05-24 09:46:11 +03:00
Maxim Andronov
cec8ad417f
[CPU] Ngraph migration leftovers: performance fixes (#5680) 2021-05-24 08:43:18 +03:00
Ilya Lavrenov
bb3ea830cc
Returned C++ wrappers creation from interface API (#5729) 2021-05-21 20:50:16 +03:00
Vladimir Gavrilov
2bc69da1d1
Fix in model-optimizer/mo/back/ie_ir_ver_2/emitter.py. (#5742) 2021-05-21 18:58:03 +03:00
Elizaveta Lobanova
ee368fb828
[GNA] Fixed errors about unsupported 1d tensors (#5667) 2021-05-21 18:55:59 +03:00
Yegor Kruglov
40c5d116e3
Updated condition in metadata depersonalize function (#5655)
* updated condition in metadata depersonalize function

* renamed list with keys

* removed unnecessary key
2021-05-21 18:08:57 +03:00
Tatiana Troilova
f843c4af1a
updated third-party-programs.txt (#5740) 2021-05-21 17:05:20 +03:00
Alexandra Sidorova
57d49f3215
[CPU] Added MVN fusion for case with constants inside (#5644) 2021-05-21 14:35:56 +03:00
Anton Voronov
5e4c3c4804
[CPU] Deconvolution int8 support (#5565) 2021-05-21 13:54:56 +03:00
Roman Lyamin
5a42015e76
[IE CLDNN] Memory dependencies fix (#5480) 2021-05-21 13:42:31 +03:00
Mateusz Bencer
3dc1d7f457
[ONNX Editor] Use port indices instead of tensor names, new naming convention of inputs (#5668) 2021-05-21 12:24:51 +02:00
Jozef Daniecki
9e46be75af
Low precision types support in Convert operation (#5640)
* Add initial version of u1 type support.

* Turn off u8_to_u1 test in IE.CPU.

* Fix compilation issue.

* Replace std::memset with std::fill.

* Add u4 type support.

* Add i4 support.

* LP types support generalized.

* Remove std::copy optimization.

* Fix backend test for LP types.

* Fixed arm plugin compilation.

* Add LP types to Serialization SLT.

* Add Convert to summarize.py report.
2021-05-21 13:11:43 +03:00
Daria Mityagina
5ea8437c91
[VPU] Batch support for interpolate (#5520)
* batch support for interpolate

* hash update

* compilation errors solved

* changes in tests, so not to break other plugins

* changes in tests, so not to break other plugins

* Revert "changes in tests, so not to break other plugins"

This reverts commit 67e5c1e4ddba4f0cc858eb1293e50ce9d9ae0227.

* Revert "changes in tests, so not to break other plugins"

This reverts commit f6a537d2236f0b64f0ff028627af9e0e388a2d23.

* review corrections

* Firmware update
2021-05-21 12:54:58 +03:00
Ilya Lavrenov
de58c8d008
WA for DLBench (#5737) 2021-05-21 12:53:18 +03:00
Maksim Doronin
15127712a4
[IE][VPU]: Write info about booted device only on success (#5734)
* Copy a string with an address of the booted device only when the device has been successfully been booted. Otherwise, we should free allocated by strdup memory or we will get a memory leak.
2021-05-21 12:48:07 +03:00
Chen Xu
6595a1cebf
Fix topk failure (#5524) 2021-05-21 12:47:18 +03:00
Svetlana Dolinina
8e956654bf
fix stride for 1d maxpooling (#5710)
* fix stride for 1d maxpooling

* fix test
2021-05-21 11:57:40 +03:00
Victor Kuznetsov
af915859e3
Add float instance to time_tests parse_stats (#5726) 2021-05-21 11:12:05 +03:00
Piotr Szmelczynski
4b860890ed
Revise floor (#5618)
* create type_prop tests

* add visitors test

* fix bug in visitor test

* add RTTI macro

* fix bug in visitors test

* add newline

* update spec

* update spec

* update RTTI definition

* move RTTI definitioion to the top of he file

* Remove broadcast from attribute tests.

* Add Floor-1 to summarize.py report.

Co-authored-by: jdanieck <jozef.daniecki@intel.com>
2021-05-21 07:55:26 +03:00
Nikolay Shchegolev
19ba314764
[CPU] Subgraph tests for MulAdd and EltwiseSimple optimizations conflict. (#5622) 2021-05-20 23:19:46 +03:00
Vladimir Gavrilov
6bb5a2c3cb
Add proper signal_size handling for reference nGraph implementation for operations DFT and IDFT (#5610)
* Added tests for 2D DFT when we have signal_size and axes [0, 2].

* Rewritten reference implementation of DFT and IDFT.

* Code style fixes.

* Reverted changes.

* Added debug prints.

* Temporarily commented some functions.

* Reverted changes in (I)DFT reference.

* Added more debug prints (in evaluates_map.cpp, to evaluate() for IDFT).

* Added setting output shape for DFT and IDFT evaluate() in evaluates_map.cpp.

* Added more tests for signal_size case of DFT.

* Written tests for signal_size case of IDFT.

* Deleted debug prints from (I)DFT reference implementation (the file fft.cpp).

* Deleted debug prints from evaluate() for DFT and IDFT.

* Deleted debug prints from tests for DFT.

* Deleted debug prints from IDFT tests.

* Code style fixes.

* Enabled CPU evaluation tests for DFT and IDFT in CPU supported cases.

* Enabled CPU (I)DFT layer tests.

* Copied fix for specialization of function is_float() for (b)float16 from Pertovsky Aleksandr's PR 5654.

* Reverted changes in the function is_float() from ie_precision.h.

* Disabled BF16 CPU FuncTests for (I)DFT.

* Deleted filling 'buffer' by zeros. Simplified the function lengths_except_given_axis.

* Small fix.

* Code style fix.

* Reverted deleting 'std::fill(buffer.begin(), buffer.end(), complex_type{0.0f, 0.0f});'

* Reverted changes in the function lengths_except_given_axis().

* Changes in the function lengths_except_given_axis().

* Small fix.

* Deleted commented code.

* Simplifications in the function lengths_except_given_axis().

* Deleted commented code.

* Enabled BF16 (I)DFT CPU FuncTests.

* Fixed comments before disabled (I)DFT IE_CPU tests.
2021-05-20 17:57:39 +03:00
Irina Efode
ae637702d9
[IE TESTS][IE CPU] Fix BF16 threshold in ROI tests (#5703) 2021-05-20 17:11:43 +03:00
Shoujiang Ma
370617d909
Auto plugin async infer request implementation (#5707)
* Async auto-request, now with revamped SetCallback (after https://github.com/openvinotoolkit/openvino/pull/5645 merged) it is safe to set.
Also test modification to verify that the callback is called on the same (user's) request and e.g. not on the actual device's request

* Override CreateInferRequestImpl() instead of CreateInferRequest()

Signed-off-by: Shoujiang Ma <shoujiang.ma@intel.com>

Co-authored-by: myshevts <maxim.y.shevtsov@intel.com>
2021-05-20 15:05:37 +03:00
Vitaliy Urusovskij
dcd27f0776
Actualize stress tests README (#5698) 2021-05-20 14:43:48 +03:00
Ilya Lavrenov
1d5d43e402
Fixed condition for versioning (#5719) 2021-05-20 14:30:49 +03:00
Ilya Lavrenov
a7d95bbfa3
Added SetExeNetworkInfo to Plugin API level (#5715) 2021-05-20 14:28:01 +03:00
Roman Kazantsev
d98e954f5d
Make order of port names determined in IR (#5701)
* Make order of port names determined in IR

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Make port names in determined order and adopted tests

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>
2021-05-20 13:44:06 +03:00
Katarzyna Mitrus
82b84c0b61
Fix ng python ShuffleChannels group attribute (#5678) 2021-05-20 12:31:19 +02:00
azhogov
13d5a53aa4 Azure CI: Disable cpuFuncTests on Mac 2021-05-20 12:52:06 +03:00
Mikhail Nosov
fd3338b41a
Multi plugin - override loading network from file (#5677)
* Multi plugin - override loading network from file

When caching is enabled, MULTI plugin will check all devices
- For devices with caching supported - call LoadNetwork(modelPath, ...)
- For others - ReadNetwork once and then LoadNetwork(cnnNetwork) for each device

Caching unit test is added for both cases

Additional helper methods:
- ICore::ToExecutableNetwork - converts internal ExeNetwork to ExecutableNetwork
- ICore::DeviceSupportsImportExport - checks if device supports import and export functionality. Used by Hetero and Multi

* Updated according to review comments

* fixed sporadic failure of 'multi-device' test cases

Root cause:
Currently only one 'ExecutableNetwork' object is created for each LoadNetwork
For Multi-testing several threads could call simultaneously setNetworkInputs/Outputs/SetPointerToPlugin
It caused race condition and invalid data structures

* Fix build issues after rebase

* Multi: Set network inputs/outputs/pointerToPlugin for load-from-file case

Overloaded function doesn't call these methods, thus multi executable network was unusable

Added caching test verifying that inputs/outputs are copied now from first loaded device network
2021-05-20 12:37:44 +03:00
Gleb Kazantaev
1f0381e2b0
Update reshape to restore original shapes if reshape has failed (#5681)
* Update reshape not to throw an exception; restore parameters shape if reshape was wrong

* Early exit

* Fix test
2021-05-20 11:19:46 +03:00
Yunji Kim
cdc98d7286
[IE CLDNN] Fix DetectionOutput cpu implementation to be aligned with ngraph (#5544) 2021-05-20 11:04:50 +03:00
Szymon Irzabek
f6c3b90364
Gna conv2d decompose (#5604)
* adding conv2d decomposition

* save point

* build of conv_2d factorization succeeds

* working 2d conv decomposing transform

* added pseudo code for handling larger kernels

* fix conv splitting due to size

* active work on convolution 1xK without dilation

* validated NHWC ordered networks with convolution kernel sizes:
3x3
3x1
5x1
1x5
1x3

TODO: 2d max pooling

* removed debug printouts

* fusing max pooling/bias/af when -disable_nhwc_to_nchw option is used

* code cleanup

* [GNA] Fixes for CI run

* [GNA] Add tests, fix transform

* [GNA] Fix padded2valid and conv2d decomposition coexistence

* [GNA] Temporarily disable tests due to mock call count issues

* [GNA] Split tests for different hw versions

Co-authored-by: prozen <piotr.rozen@intel.com>
2021-05-20 11:01:29 +03:00
Maksim Derbasov
a5ea4fefbf
Fix warnings and if condition (#5705) 2021-05-20 10:35:53 +03:00
Ilya Lavrenov
2bdd955d6e
Inference engine versioning (#5562)
* Exclude xbyak from install

* Added automatically generated InferenceEngineConfig.cmake

* Reverted a version back

* Fixed issues with target aliases

* Make TBB dependency private

* Made ie_parallel.cmake self-sufficient

* Don't expose ie_paralle.cmake to end users

* Fixed compilation with TBB

* Fixes for TBB

* Fixed vpu_graph_transformer compilation

* Fixed tests compilation

* Added install of ie_parallel.cmake

* Switched ENABLE_ALTERNATIVE_TEMP to OFF. Fixed COMPONENTS for TBB

* Fixed file name in install rules

* Added find_dependency for TBB in ie_parallel.cmake

* WA for cmake bug with PACKAGE_PREFIX_DIR

* Fixed no-deprecation to fix speech-library build

* Reverted version from 2.1.0 to 2.1

* Revert "Reverted version from 2.1.0 to 2.1"

This reverts commit 7cb5d1563c.

* Added versions to cmake

* Added versions to ie_version.hpp

* Returned custom version file back

* Added InferenceEngineConfig-version.cmake to share as well

* Disabled one more GPU test

* Added one more WA for CI

* WA for CI issue for C API

* Added InferenceEngineConfig-version.cmake to share as well

* Added verison parsing from ie_version.hpp

* Revert "[CPU] Add Roll support (#5112)"

This reverts commit 5d8f209df6.

* Revert "[CPU] windows_Interpolate_fused-FQ_nearest-mode_nspc-layout_fix (#5317)"

This reverts commit 0808975a37.

* Revert "[INT8][BF16] INT8 + BF16 feature was enabled (#5059)"

This reverts commit 7d2ec02d65.

* Support for components

* No version for IEDevScripts package

* Removed IE_VS_VER_HAS_VERSION from vs_version.rc.in

* Added compatibility for 2.x old versioning
2021-05-20 10:21:44 +03:00
Egor Shulman
98c35d6a08
[CPU] Changed math to mkldnn_math_node (#5617) 2021-05-20 10:00:38 +03:00
Alexandra Sidorova
dcc288680b
[CPU] Added Gather-7 support (#5552) 2021-05-20 09:09:28 +03:00
Ilya Lavrenov
0a629716de
Follow up for PR #5645 (#5702) 2021-05-20 07:31:34 +03:00
Ilya Lavrenov
46e1e795a2
Removed rpath for ngraph (#5688) 2021-05-20 07:11:02 +03:00
Shoujiang Ma
90a18d9cef
[AUTO] Implement auto-plugin limited devices feature (#5545)
* Update SelectDevice policy in auto plugin

Signed-off-by: Zhengtian Xie <zhengtian.xie@intel.com>

* Implement limit device list for AUTO plugin

Signed-off-by: Shoujiang Ma <shoujiang.ma@intel.com>

* Add tests for AUTO limit device feature

Signed-off-by: Shoujiang Ma <shoujiang.ma@intel.com>

* Add gpu tests for auto-plugin

Signed-off-by: Shoujiang Ma <shoujiang.ma@intel.com>

* Fix CI cpuFuncTests issue due to BATCHED_BLOB

Signed-off-by: Shoujiang Ma <shoujiang.ma@intel.com>

* Override LoadNetwork(modelPath, config) in AUTO plugin

Signed-off-by: Shoujiang Ma <shoujiang.ma@intel.com>

* Update SelectDevice() logic for LoadNetwork(model, config)

Signed-off-by: Shoujiang Ma <shoujiang.ma@intel.com>

* Update GetNetworkPrecision logic for auto-plugin

Signed-off-by: Zhengtian Xie <zhengtian.xie@intel.com>

* Address reviewers' comments

Signed-off-by: Shoujiang Ma <shoujiang.ma@intel.com>

* Add tests for AUTO:GPU,CPU case

Signed-off-by: Shoujiang Ma <shoujiang.ma@intel.com>

* Update logic in GetNetworkPrecision for auto-plugin

Signed-off-by: Zhengtian Xie <zhengtian.xie@intel.com>

* Address reviewer's comment: clean and simplify code

Signed-off-by: Shoujiang Ma <shoujiang.ma@intel.com>

* Fix wrong usage of convolution weight index

Signed-off-by: Shoujiang Ma <shoujiang.ma@intel.com>

* Address reviewer comment: fix get network precision logic

Signed-off-by: Shoujiang Ma <shoujiang.ma@intel.com>

* Fix rebase issue

Signed-off-by: Shoujiang Ma <shoujiang.ma@intel.com>

* Fix ie_core.cpp header change

Signed-off-by: Shoujiang Ma <shoujiang.ma@intel.com>

Co-authored-by: zhengtian.xie <zhengtian.xie@intel.com>
2021-05-19 23:47:54 +03:00
Ilya Lavrenov
bc15656a32
Template set precision for output (#5693) 2021-05-19 22:58:03 +03:00
Anastasia Kazantaeva
e755232a7f
fix date (#5694) 2021-05-19 22:21:51 +03:00
Anton Chetverikov
538f407829
Fix errors for VariadicSplit layer restored from serialized IR (#5613)
* Fix errors in VariadicSplit layer restored from serialized IR

* Update VariadicSplit specification and error message to allow 1D tensors on 1st input

* Update spec

* Resolve comments

* Apply comments, add unit tests

* Update unit tests
2021-05-19 19:03:58 +03:00
Anton Pankratv
ec5aa2fefd
Fixed legacy API set get user data method (#5690) 2021-05-19 18:46:10 +03:00
Mikhail Nosov
94fb9337ed
Returned back original copyrights for npy.hpp (#5692)
Original source code repo: https://github.com/llohse/libnpy
SHA of original commit: d3fd88697889cefb466b647d3034c1d7b7f615ff

In OpenVINO repo there are some modifications, thus Intel's copyrights are kept as well
2021-05-19 18:30:01 +03:00
Irina Efode
9a1f4b6829
[IE TESTS] Skip some ROI BF16 tests after comparision fix (#5697)
* [IE TESTS] Fix BF16 comparation

* Skip

* remove extra
2021-05-19 17:28:01 +03:00
Vladimir Paramuzov
d52c4d433a
[IE CLDNN] QueryAPI extension with gpu device info (#5440) 2021-05-19 16:44:40 +03:00
Andrei Gorbachev
ae9f3ebc5d
[IE CLDNN] Add Gather-7 (#5360) 2021-05-19 15:03:47 +03:00