Commit Graph

7889 Commits

Author SHA1 Message Date
Yuan Hu
bf2d6a72a4
fix a typo in benchmark_app sample (#12507)
Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>

Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>
2022-08-25 07:12:03 +03:00
Mingyu Kim
5cf1b0a124
[GPU] Fix for typo (#12732) 2022-08-25 12:47:58 +09:00
Sungeun Kim
dc7f8249a7
[GPU] optimized out detection_out if nms_threshold is under -1. (#12730) 2022-08-25 11:05:38 +09:00
Xiping Yan
11a869d4d1
refactor cpu func unit tests (#12711)
* Refactor cpuFuncTests and cpuUnitTests to components folder.

Signed-off-by: Yan, Xiping <xiping.yan@intel.com>

* Build pass.

Signed-off-by: Yan, Xiping <xiping.yan@intel.com>

* Add macro to judge if enable func test.

Signed-off-by: Yan, Xiping <xiping.yan@intel.com>

* Rename func_test to functional;
Rename unit_test to unit;
Add "enable_tests" for unit;

Signed-off-by: Yan, Xiping <xiping.yan@intel.com>

Signed-off-by: Yan, Xiping <xiping.yan@intel.com>
2022-08-25 09:30:40 +08:00
Alina Kladieva
10bd602987
Revert "Add decomposition transformation for eye 9 (#12403)" (#12741)
This reverts commit ed7275adf0.
2022-08-24 23:23:20 +04:00
Sergey Shlyapnikov
bf2ae06f29
[GPU] Shared memory optimization for network::execute_impl() call (#12631) 2022-08-24 19:11:21 +04:00
Pawel Raasz
ed7275adf0
Add decomposition transformation for eye 9 (#12403)
* Add eye decomposition transformation

* Fix EyeLike generation when diagonal shift
outside dimensions

* Add batch shape to eye decomposition

* Eye decomposition clean-up

* Remove reference part if no eye decompose in
decomposition tests

* Eye-Like use eye operator

* Disable eye decomposition for CPU plugin

* Use opset9 instead of ops in eye decomposition

* Apply transformations header style
to eye_decomposition.hpp

* Add model reference in eye decomposition tests
- use opset9 instead of ov::op:vX namespace

* Refactor eye decomposition:
- match style of other transformations
- add NodeRegister class to make and collect created nodes
- use `NodeRegister` in transformation for copy runtime info
- use `NodeRegister` in `MatcherPass` to replace new `register_new_node`
2022-08-24 17:59:25 +03:00
Roman Lyamin
3339d5a372
[GPU] MVN shape infer support and dynamic tests (#12685) 2022-08-24 18:29:15 +04:00
Roman Lyamin
19fd77e3d8
[GPU] Broadcast shape infer support (#12588)
* [GPU] Align broadcast with nGraph operation

* [GPU] Broadcast shape infer support

Co-authored-by: Sergey Shlyapnikov <sergey.shlyapnikov@intel.com>
2022-08-24 18:27:15 +04:00
Roman Kazantsev
3595f195f1
[TF FE] Refactor translators for Resize operations and correct Pooling (#12721)
* [TF FE] Refactor translators for Resize operations and correct Pooling

It allows to convert magenta_arbitrary-image-stylization model

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>

* Align TF FE tranlator for Resize with legacy frontend

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>

* Do minor fix for MaxPool

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
2022-08-24 15:55:10 +04:00
Marcin Kusmierski
39b743f7a0
[GNA] Fix issue with inference when input or output first dim is diff… (#12424) 2022-08-24 11:08:43 +02:00
Luo Cheng
cf15b03019
[CPU] default enable avx512 f32 brgconv (#12619) 2022-08-24 09:47:18 +04:00
Luwei Zhou
da0be08f15
[CPU] Fix the strided slice issue when ellipsis_mask has redundant data. (#12608) 2022-08-24 09:43:20 +04:00
Artur Kulikowski
caf547b5eb
Properly reading parameters with whitespaces from IR (#12650)
* Add overrided method to generating vector of strings

* Trim the value from the the left and right

* Add test to verify that output names are correctly read from IR

* Use spaces instead of tabs

* Add C++ tests for read model contains outputs with whitespaces

* Fix test for add output

* Remove python test
2022-08-23 23:19:15 +03:00
Xiping Yan
5b3cc5514a
Warning suppression for C-API. (#12669)
* Warning suppression for C-API.

Signed-off-by: Yan, Xiping <xiping.yan@intel.com>

* Add compiler flags for CI verification.

Signed-off-by: Yan, Xiping <xiping.yan@intel.com>

* Update parent cmake compiler flag, and make it work for total bindings folder.

Signed-off-by: Yan, Xiping <xiping.yan@intel.com>

* Open compiler check.
Move "sign-compare" to below, and make it only work for bindings. Because plugins have many compare errors.

Signed-off-by: Yan, Xiping <xiping.yan@intel.com>

* Remove sign-compare.

Signed-off-by: Yan, Xiping <xiping.yan@intel.com>

Signed-off-by: Yan, Xiping <xiping.yan@intel.com>
Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>
2022-08-23 20:39:48 +04:00
Daniil Lyakhov
28ac460817
[Ngraph Transformations][Pruning] HF Transformers Pruning Support (#10718)
* Support a branch without masks in matmul

* Init transpose mask propagation

* Transpose mask propagation + tests

* Unsqueeze mask propagation support / Fix reshape unsqueeze

* Init Matmul batch dims mask propagation support

* Matmul batch dims mask propagation support

* Broadcasted elementwise support

* Unsuccessfull attempt to remove masks from unit dims in eltwise

* Stricted way to pass broadcasted dims through elementwise

* Refactor reshape

* ReshapedPassThrough propagation

* Hack to enable matmul mask propagation up from right branch to left

* Make ReshapePassThrough common (tests are needed)

* Hacks to enable Bert int8 pruning

* Not reshapeable and big pattern for ReshapedElementwise operation version of transformer pruning

* Reshape shape subgraph support

* Init shrink reshape mask propataion support

* Init reshape shrink mask propagation

* Shrink extend reshape mask propagation suport init

* Complex reshape test

* Duplicated code removed

* Fix accuracy check tests

* Fix rebase

* Fix broadcasted elementwise / update tests

* Fix types

* Remove redundant methods from Mask

* Fix transpose propagation in Matmul mask initialization

* Migrate to CoordinateTransformer

* Add comments

* Fix types

* Make elementwise inputs deterministic

* Fix tests

* Refactor shape size collecting

* Fix rebase

* Fix comments

* Fix comments

* Test MatMul with two outputs is added

* Mask methods comments was added / get_constant_from_node test
2022-08-23 14:47:39 +02:00
Ilya Lavrenov
2ef6e2951c
Use static TBBBind if dynamic one is not found (#12703) 2022-08-23 13:17:35 +04:00
Ilya Lavrenov
7a7bd37a50
Disable CUDA plugin in Azure coverity pipeline (#12712) 2022-08-23 12:51:26 +04:00
Jan Iwaszkiewicz
7f750a4be5
Skip nogil tests (#12658) 2022-08-23 12:00:11 +04:00
Roman Kazantsev
fdac22042c
[TF FE] Support dynamic rank support for Convolutional and Pooling operations (#12661)
* [TF FE] Add dynamic rank support for Convolutional and Pooling operations

Refactor DepthwiseConv2D, AvgPool, and FusedBatchNorm operations

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>

* Fix build issue with rvalue

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>

* Fix build issue with climit

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>

* Skip duplication of Parameter nodes

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>

* Revert changes in StridedSlice and add check for AvgPool operation type

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>

* Revert the rest of changes for StridedSlice

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>

* Fix translator for AvgPool: add pad mode

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>

* Introduce helper default_op_checks

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
2022-08-23 11:57:00 +04:00
Roman Kazantsev
d70d7b2171
[TF FE] Add Transpose Sinking for additional unary elementwise Operations (#12698)
* [TF FE] Add Transpose Sinking for additional unary-wise Operations

It helps to fix performance degradation for MobileNet models

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>

* Add LogicalNot for Transpose sinking

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
2022-08-23 11:56:48 +04:00
Wang, Yang
186efc5125
[MULTI]Fix the issue that QueryNetworkMultiThrows failed to pass (#12670)
* checking config priorities is set by checking if the value of priorities is empty instead of not founding in the config map.

Signed-off-by: Wang, Yang <yang4.wang@intel.com>

* add test case for MULTI without setting device priority.

Signed-off-by: Wang, Yang <yang4.wang@intel.com>

Signed-off-by: Wang, Yang <yang4.wang@intel.com>
2022-08-23 10:34:16 +04:00
Ilya Lavrenov
27cbc1a969
Debian packages for frontends (#12649)
* Created dedicated debian packages for frontends

* Fixed Azure CI

* Install TF FE with both names

* Disabled 2 QN tests

* Install python samples differently
2022-08-23 01:39:23 +04:00
Alina Kladieva
1734f2d673
Run Python checks on Ubuntu 20.04 (#12687)
* Run Python checks on Ubuntu 20.04

* Run py_checks for changes to workflow

* Fix endline
2022-08-22 23:15:27 +04:00
Ilya Lavrenov
4dcbd85ef7
Azure: Try to take into account result of previous step as well (#12695)
* Fix openvino_contrib version

* [linux_arm64] Fix openvino contrib version

* [linux_debian] Fix openvino contrib version

* Azure: Try to take into account result of previous step as well

* Removed excess contrib var

* Disable CUDA plugin build via cmake flags

Co-authored-by: Alina Kladieva <alina.kladieva@intel.com>
2022-08-22 23:08:26 +04:00
Alina Kladieva
4aea944df5
Disable CUDA plugin building Azure (#12694)
* Fix openvino_contrib version

* [linux_arm64] Fix openvino contrib version

* [linux_debian] Fix openvino contrib version

* Disable CUDA plugin build via cmake flags
2022-08-22 21:41:02 +04:00
Maxim Vafin
56808c7aed
Add ScatterUpdate value infer (#12595)
* Add ScatterUpdate value infer

* Add additional test case to ScatterUpdate tests
2022-08-22 17:52:49 +02:00
Artyom Anokhov
9710bde87c
coverage.cmake: Added general target for collecting coverage counters for whole project (#12652) 2022-08-22 18:19:56 +04:00
Nadezhda Ageeva
7106f4b626
Commits from PR11438 (#12337)
Draft version of test

Added i8 test

Some fixes

Fix static build issue
2022-08-22 13:34:24 +01:00
Nadezhda Ageeva
df538196df
Commits from PR11350: (#12157)
copy layer init
Add tests
switch to backwardGraphRewrite for nonfunc subraph search
swith to matcher pass for part of memory/concat cases
docs
clean up
apply review comments
fix test
Comments for non-computational subgraphs transformation/fixes
fix tests depends on order
fix constant case
switch back to minimize copy layers count
Add check for unaligned split

Fix issue that Assign is not catched by matcher pass. Fix tests for transformations inserting Copy layer.

Applying comments. Rename GNAPluginNS -> ov::intel_gna::pass for transformations

Rollback test changes

Rename function

Update src/plugins/intel_gna/ops/copy.hpp

Co-authored-by: Szymon Irzabek <szymon.jakub.irzabek@intel.com>

Update src/plugins/intel_gna/transformations/insert_copy_layer.hpp

Co-authored-by: Szymon Irzabek <szymon.jakub.irzabek@intel.com>

Update src/plugins/intel_gna/transformations/insert_copy_layer.hpp

Co-authored-by: Szymon Irzabek <szymon.jakub.irzabek@intel.com>

Update src/plugins/intel_gna/transformations/insert_copy_layer.hpp

Co-authored-by: Szymon Irzabek <szymon.jakub.irzabek@intel.com>

Update src/plugins/intel_gna/backend/gna_limitations.hpp

Co-authored-by: Szymon Irzabek <szymon.jakub.irzabek@intel.com>

Update src/plugins/intel_gna/backend/gna_limitations.hpp

Co-authored-by: Szymon Irzabek <szymon.jakub.irzabek@intel.com>

Update src/plugins/intel_gna/transformations/insert_copy_layer.cpp

Co-authored-by: Szymon Irzabek <szymon.jakub.irzabek@intel.com>

Apply review comments
2022-08-22 12:30:23 +01:00
guozhong wang
931b343511
Force dynamic network on CPU only if it is in candidate list (#12583)
* change gpunum to 3

* check if CPU is in candidate list before checking dynamic network

Co-authored-by: Chen Peter <peter.chen@intel.com>
2022-08-22 12:14:58 +03:00
Tomasz Dołbniak
a0622a328f
GridSample op check test (#12585)
Co-authored-by: Michal Lukaszewski <michal.lukaszewski@intel.com>
2022-08-22 10:53:13 +03:00
Leonard Sikorski
91546336bc
[MO][Kaldi] RestrictedAttention component support in MO (#12582) 2022-08-22 09:10:20 +02:00
Ilya Lavrenov
0ac5cfd17a
Improved dependencies handling for ie_wheel (#12666)
* Improved dependencies handling for ie_wheel

* Fixed compilation erros

Co-authored-by: Ilya Churaev <ilya.churaev@intel.com>
2022-08-22 11:09:56 +04:00
Roman Lyamin
f26c3d035a
[GPU] Interpolate shape infer support (#12516) 2022-08-22 10:47:07 +04:00
Roman Lyamin
267f2f9c4b
[GPU] Tile shape infer support (#12539) 2022-08-22 10:41:46 +04:00
Roman Lyamin
5128f20cfa
[GPU] Pad shape infer support (#12654)
* [GPU] Align Pad parameters with ngraph

* [GPU] Pad shape infer support
2022-08-22 10:33:15 +04:00
Eddy Kim
0053ed1a65
updated to convert b_fs_yx_fsv16 to o_is_yx_isv16 (#12630) 2022-08-22 14:22:17 +09:00
Ilya Lavrenov
609eb2ced3
Install only required TBB libraries (#12665) 2022-08-22 09:09:30 +04:00
Wang, Yang
1c6f460458
add value verification to check if device priorities value is available (#12069)
* add value verificatioin for the key ov::device::priorities and corresponding test case.

Signed-off-by: Wang, Yang <yang4.wang@intel.com>

* Update.

Signed-off-by: Wang, Yang <yang4.wang@intel.com>

* Retrieve the device name via the DeviceIDParser rather than via the priorities directly.

Signed-off-by: Wang, Yang <yang4.wang@intel.com>

* Add logic to support devices like CPU(x),GPU(x).

Signed-off-by: Wang, Yang <yang4.wang@intel.com>

* Update.

Signed-off-by: Wang, Yang <yang4.wang@intel.com>

* Update.

Signed-off-by: Wang, Yang <yang4.wang@intel.com>

* Add 'mock' as a available device name when checking if ov::device::priorities is correct.

Signed-off-by: Wang, Yang <yang4.wang@intel.com>

* Update.

Signed-off-by: Wang, Yang <yang4.wang@intel.com>

* Update.

Signed-off-by: Wang, Yang <yang4.wang@intel.com>

* Update.

Signed-off-by: Wang, Yang <yang4.wang@intel.com>

* Update format.

Signed-off-by: Wang, Yang <yang4.wang@intel.com>

* do not check if priorities is available when value of priorigies is empty.

Signed-off-by: Wang, Yang <yang4.wang@intel.com>

* Update.

Signed-off-by: Wang, Yang <yang4.wang@intel.com>

Signed-off-by: Wang, Yang <yang4.wang@intel.com>
Co-authored-by: Chen Peter <peter.chen@intel.com>
2022-08-22 12:51:49 +08:00
yanlan song
c35af4c0d0
do not call get_profiling in threads (#12604)
* do not call get_profiling in threads

Signed-off-by: fishbell <bell.song@intel.com>

* indent

Signed-off-by: fishbell <bell.song@intel.com>

Signed-off-by: fishbell <bell.song@intel.com>
2022-08-22 10:04:37 +08:00
Wilson Seok
1c3f3b4ed0
[GPU] Implement can_memory_reuse flag to fix deconvolution NaN input issue (#12082)
* implement can_memory_reuse flag

* apply the option to reduce opt kernel

* add reduce opt kernel for the option

* apply feedback

* consider when user->selected_impl() = nullptr

* apply recursive function to check optimized user
2022-08-22 09:34:12 +09:00
Sieun Kim
495eafb11a
support blocked format for broadcast (#12313)
* support blocked format for broadcast

* remove redundant reorders and reshape so broadcast selects blocked format

* implement broadcast ngraph reference and added blocked format test cases with values bigger than block size

* fix cpplint error

* fix cpplint error 2

* review comments applied

* review comments applied: cleaner GetInputBlockND function

* change from program_helpers::are_layouts_identical() to layout::compatible()

* change from layout::compatible() to layout::identical()
2022-08-21 22:10:37 +09:00
Ilya Churaev
9a4326012c
Fixed generation of plugins.hpp and disabled some proxy tests (#12637) 2022-08-19 18:50:59 +03:00
Maxim Vafin
000f5d8049
Use new reprocessing for legacy MO (#11302) 2022-08-19 15:33:30 +04:00
Maxim Vafin
3e9cc7d52d
[TF FE] Refactor constant reading to not use protobuf directly (#12518)
* Refactor constant reading

* Remove needless code

* Implement compressed value reading

* Remove needless protobuf headers

* Remove commented code

* Remove unnecessary comment

* Apply review feedback

* Fix linux build

* Fix win build

* Fix copyright
2022-08-19 14:29:35 +03:00
Ilya Lavrenov
fe96bb2f7c
Try to use ccache for linker as well (#12641) 2022-08-19 14:32:37 +04:00
Ilya Lavrenov
3089c868b0
Use OSX 11 pool for MacOSX (#12642) 2022-08-19 14:28:51 +04:00
Mateusz Bencer
d7ce8289ac
[MO] Fix SSliceComplex transformation (#12537) 2022-08-19 12:14:10 +02:00
Roman Kazantsev
190d692c4d
[TF FE] Implement translators for ExtractImagePatches and MatrixDiag (#12593)
* [TF FE] Implement translators for ExtractImagePatches and MatrixDiag

It allows to convert Inpaint model and infer it correctly

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>

* Apply code-review feedback: correct comments, use set

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>

* Apply suggestions from code review

Co-authored-by: Maxim Vafin <maxim.vafin@intel.com>

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
Co-authored-by: Maxim Vafin <maxim.vafin@intel.com>
2022-08-19 11:44:41 +03:00