Commit Graph

2144 Commits

Author SHA1 Message Date
Pawel Raasz
56f51135d4 Grey preprocessing yuv nv12 i420 (#18239)
* Add two plane YOV to Grey conversion

* Add i420 to grey conversion

* Add yuv to grey conversion for GPU

* Fix cmakes

* Remove static from local function

* Remove opencv dependency from tests

* Put grey_from_yuv_single_plane into namespace
2023-07-11 12:41:24 +02:00
Nikolay Shchegolev
88703905f4 [CPU] Leftovers for Extension convert I64/U64 to I32. (#16941)
* [CPU] Leftovers for Extension convert I64/U64 to I32.

* Fix as per comments

* Fixes as per commits 2

* Fixes as per commits 3

* Revert "Fixes as per commits 3"

This reverts commit 84022be66f64faccd96a32da5611db0e5137d049.

* Some fixes

* Test fix
2023-07-11 11:42:53 +02:00
Marcin Kacprzak
521c846b72 [GNA] Fix for concat requantization problem (#18008)
* [GNA] Fix for concat requantization problem

* [GNA] Review fixes

* [GNA] Reverted `using namespace std`

* [GNA] Updated transformation description
2023-07-11 10:32:49 +01:00
Maksim Kutakov
900163c484 [CPU] In place memory for dynamic shapes (#17741)
* InPlace memory direction resolution pass

* Partitioned mem mngr

* Concat reshape pattern has been enabled

* Enhanced in place conflicts detection

* Refactor Concat

* Fix Reshape isExecutable call

* Split node refactoring

* Gather node inPlace special case

* Temporal WA to enable zero copy on Split input

* Process inPlace edges in order

* Fixes

* Remove implicit initialization from Edge::getMemory

* Allow NotAllocated edges call allocate

* extract IMemory interface and implements Memory class.

* IMemory fixes after merge

* Prevent input memory modification

* Minor build fixes

* Fix unittest build

* Fix for variadic concat

* Edge reference fix

* Lock based mem manager

* Return value fix

* Naming refactoring

* Use make_unique

* Split output dims check

* Special processing for empty parts

* Concat null memory fix

* Fix downstream inplace resolution

* Concat allocated edge search fix

* Variadic split clean up tests

* Variadic Split tests update

* Fix make_unique conflict

* Split inPlace tests are back

* Concat inPlace dyn shapes tests

* Add safety checks to isInputTensorAtPortEmpty

* Fix partitioned mem mngr zero size reset

* Introduce Static Memory

* Gather InPlace Tests

* InPlace conflict check in merge Reorder Transpose

* Apply review comments

* fix after rebase

---------

Co-authored-by: jialipen <cecilia.peng@intel.com>
2023-07-11 10:39:29 +02:00
Katarzyna Mitrus
827fb0234b [Shape Infer] RNN/GRU/LSTM Cell & Sequence - common shape infer and review (#18009)
* rrn seq base common shape infer init

* Update and add shape infer to all seq rnn based ops

* Use shape_infer in lstm seq core op

* Use shape_infer in rnn seq core op

* Unified shape infer for rnn cell base

* Update and add missing cells shape_infer functions

* Use shpe_infer in rnn_cell

* Update shape_infer map

* shape_infer tests

* Move new shape_infer to TA map

* More tests and shape improvements

* Introduce common base tests

* Fix merge conflict

* Missing setters and default ctor tests

* Use RNNCellBase class instead of template type op

* Update v0 LSTMSequence to use RNNCellBase as parent class

* Style

* V0::LSTMSequence update

* Specify opset in shape infer registry

* Move rank check

* Output vec generation refactor

* Update num_dir_validation

* Tests warining fix

* Test types adjustment

* Commented code cleanup

* Move test helpers to test fixture

* Common default ctor tests for Cell

* Update GRU shape infer tests

* Update LSTM shape infer tests

* Update RNN shape infer tests

* File names update

* Functions renaming

* Cast hidden size in test

* Move v0::LSTMSequence conformance test

---------

Co-authored-by: Pawel Raasz <pawel.raasz@intel.com>
2023-07-11 12:38:31 +04:00
Paul Youngsoo Ahn
ff4ed54bba [GPU] Fix kernel selecting issue on dynamic model with static input shape (#18448)
* [GPU] disable blocked format for dynamic shape model(#18448)

* [GPU] Return default format for output layout rank when user node is reshape in get_preferred_format
- Rollback code to disable blocked formmat for dynamic shape

* [GPU] Add unit test checking has_reshape_user

* [GPU] remove redundant comments
2023-07-10 22:54:56 -07:00
Pavel Durandin
75696f4545 [GPU] Fix DG2 units tests with null users (#18455)
* [GPU] Fix DG2 units tests with null users

* [GPU] Fix DG2 units tests with null users
2023-07-10 19:32:38 +04:00
Oleg Pipikin
d6c0289008 Move common test utils (#18339)
* Move common test utils

* Apply comments

* Comments 2
2023-07-10 12:48:24 +00:00
River Li
3286a405be Don't eliminate Transpose when 0 size of order_value (#18130)
* Don't eliminate Transpose when 0 size of order_value

* Remove invalid test for transpose
2023-07-10 14:58:02 +04:00
Andrei Gorbachev
8f529df763 [Coverity] Fix coverity (#18420)
* fix CVS-112761

* fix CVS-112760

* fix CVS-112770
2023-07-10 09:49:59 +04:00
Andrew Kwangwoong Park
eb3bb52a08 [GPU] Update DepthToSpace to use nGraph shape inference (#18422)
* Update DepthToSpace to use ngraph shape infer

* Remove legacy block_size limitation for static shape

Signed-off-by: Andrew Park <andrew.park@intel.com>

* Add TCs for ov_gpu_func_tests and ov_gpu_unit_tests

Signed-off-by: Andrew Park <andrew.park@intel.com>

---------

Signed-off-by: Andrew Park <andrew.park@intel.com>
2023-07-07 15:13:48 -07:00
Paul Youngsoo Ahn
f940333a1c [GPU] Apply ngraph shape infer for ROIAlign (#18424) 2023-07-07 11:37:21 -07:00
Tomasz Jankowski
e81bcacf33 [Ref_Impl] Add GroupNormalization-12 reference implementation (#18343)
* Add GroupNorm reference implementation

* Clean up

* Handle GroupNorm in ov namespace only

* Simplify the flow

* Add various scale and bias tests

* Fix batches case

* Add more float tests

* Set output shape

* Set output shape

* Fix missing includes

* Move to ov namespace

---------

Co-authored-by: Michal Lukaszewski <michal.lukaszewski@intel.com>
2023-07-07 20:04:44 +02:00
Ilya Churaev
79c37882aa Add variable state for proxy plugin (#18426)
* Added proxy variable state

* Added documentation for some methods

* Fixed code style
2023-07-07 17:44:57 +02:00
Vladislav Golubev
205de6106b [Snippets] BrgemmEmitter: blocking by K & N dimensions (#18302)
* KN blocking draft

* some fixes

* IdentifyBuffers temporary hack

* Emitter cleanup

* IdentifyBuffers cleanup

* BrgemmCopyB validation: N_blk is taken from the child BrgemmCPU

* Added blocking parameters to BrgemCPU

* accuracy fixes

* Buffers insertion removed from BrgemmToBrgemmCPU

* Added blocking parameters to BrgemmCopyB

* blocking parameters

* Blocking params configuration removed from brgemm_to_brgemm_cpu transformation

* Introduced a transformation for blocking parameters configuration

* MHA tokenization alligned with blocking matmul requirements

* Alexandra's comments applied

* Alexandra's comments applied: 2nd round

* Ivan's comments applied

* MHA tokenization: removed kernel_buffer_size related heuristics
2023-07-07 17:44:14 +02:00
Mikhail Ryzhov
df014637c9 [GNA] Fixed concat axis checks (#18281)
* Fixed concat axis checks

* clang fix

* Enabled the rigth concat axis check

* is_concat_supported based on ngraph

* fixed concat patterns checks

* code style fix

* removed unused helpers

---------

Co-authored-by: Marcin Kacprzak <marcin.kacprzak@intel.com>
2023-07-07 14:33:47 +01:00
Yury Gaydaychuk
33b457b097 [CPU] Fix of coverity issues (#17823)
* mvn missing else handled

* negative binarization covered

* coverity 1502464

* coverity 1504685, 1504781, 1504786

* rollback regpool diff

* code review
2023-07-07 15:24:15 +02:00
Katarzyna Mitrus
e42548137e [Pad-12] Negative pads_begin/end tests for Pad reference implementation (#18344)
* Pad ref impl tests for negative pads begin end

* Adjust indentation

* Remove redundant line from the output

* Add tests with removal on middle axis

* Add tests with empty result

---------

Co-authored-by: Michal Lukaszewski <michal.lukaszewski@intel.com>
2023-07-07 10:53:52 +00:00
Vladimir Paramuzov
2939818278 [GPU] Enable shape agnostic quantize_scale_shift kernel (#18188)
* [GPU] Enable shape agnostic quantize_scale_shift kernel

* Resolve conflicts in compile_graph.cpp

* Update compile_graph.cpp

---------

Co-authored-by: Pavel Durandin <pavel.durandin@intel.com>
2023-07-07 10:38:41 +00:00
Ilya Churaev
b69190c2c1 Proxy plugin 2.0 (#17416)
* Initial commit for proxy plugin

* Include proxy to openvino library

* Fixed some tests

* Added plugin properties

* Added readme

* Support Compile model for the proxy plugin

* Fixed python

* Remove gmock

* Fixed some tests

* Fixed load plugin tests

* Removed internal PROXY_FALLBACK_PRIORITIES initialization property

* Fixed code style

* Added new tests

* Create architecture.md

* Fixed some proxy tests

* Implement not implemented functions

* Fixed ICore mock

* Remove redundant code

* Added import/export tests

* Fixed hetero import/export tests

* Fixed ICore mock

* Fixed import tests

* Fixed build

* Remove redundant parse config

* Fixed some comments

* Try to fix Windows build

* Fixed incorrect logic

* Small fix in tests

* Fixed python API

* Fixed typo

* Try to fix python

* Switch GPU under proxy

* Fixed GPU name

* Revert GPU plugin under proxy

* Small changes in CMake files

* Temp commit

* Build without proxy

* Revert "Temp commit"

This reverts commit 1ac9824bdf.

* Fixed test linking

* Removed tests from ncc check

* Add option to disable proxy plugin

* Fixed minor comments

* Disable some proxy tests if IR frontend is disabled

* Enable Intel GPU under the proxy

* Fixed typo

* Fixed segfault in tests

* Small fix for case if only GPU is registered

* Fixed code style

* Added remote context tests

* Added proxy tests to CI

* Fixed mock engine

* Test change

* Revert "Test change"

This reverts commit 2d1d67766f.

* Add new tests

* Removed some tests

* Revert "Removed some tests"

This reverts commit 090398652f.

* Revert incorrect logic

* Removed unused variables

* Use original name for the GPU plugin

* Fixed CMake

* Do not show hidden devices

* Try to fix GPU remote context

* Fixed GPU plugin build

* Added interface for proxy remote context

* Remove local properties

* Remove redundant API

* Fixed typo

* Added remote tensors

* Fixed code style

* Fixed some comments

* Unwrap remote tensors before conversion to Blob

* Added cast for legacy API

* Fixed some cldnn tests

* Do not add preprocessing for proxy plugin

* Enabled more tests and wrap tensors in infer request

* Use hardware request inside conversion wrapper

* Fixed hand on cache calculation

* Try to fix some tests

* Support set tensor for remote tensors in proxy plugin

* Revert "Support set tensor for remote tensors in proxy plugin"

This reverts commit 5a927de590.

* Remove redundant friend from compiled model and fix life time for infer
request

* Fixed code style

* Add additional so pointers to the tensor

* Rewrite approach for compile model and tensor

* Removed API from proxy

* Fixed is/as Blob for wrapped Blobs

* Wrap tensor when set tensor to plugin

* Fixed recursive call

* Don't unwrap tensors for AUTO plugin

* Fixed Some Multi tests with remote blob for proxy

* Align context name with tests

* Fixed code style

* Try to fix more tests

* Some minor changes

* Try to fix OVHoldersTests

* Try to save low level SO in high level wrappers

* Revert "Try to save low level SO in high level wrappers"

This reverts commit 430ff8a526.

* Revert "Try to fix OVHoldersTests"

This reverts commit 32604f0d3e.

* Disable some tests

* Fixed DynamicBatchShapeTests

* Fixed caching tests and skip OVHoldersTest

* Small refactoring

* Fixed import model

* Small fix

* Fix typo which causes fails of caching tests

* Disabled AUTO BATCH for proxy device

* Support Export in Auto batch

* Small changes

* Fixed initialization fallback to plugin with proxy name

* Added more values for tests

* Ask all devices and create context if no device id

* Support export in auto batch

* Fixed some comments

* Fixed some comments and removed auto batch

* Fixed some comments

* Fixed auto batch test and some comments

* Fixed build

* Removed proxy plugin class from dev api

* Fixed code style

* Fixed disabled tests
2023-07-07 13:45:20 +04:00
Luwei Zhou
a3bd0cb4d7 [CPU] oneDNN v3.2 migration (#18094)
* [WA] Comment the onnx test.

Seems this test error would be a little bigger than expected error.

* Remove the softmax CPU function test filter because onednn merge all
ISAs into one primitive.

* Fix zero point issue.

* Remove wino conv test cases because ONEDNN3.2 does not supported.

* Fix cpu debug log verbose

* Update onednn to squash commit version.

* Applied tolerance threashold for onnx_model_bias_gelu test.

* Restore to fix ICX perf regression.

* Clean  winograd related code.

* Update ONEDNN to support ARM.

* Applied review comments.
2023-07-07 11:12:02 +02:00
Paul Youngsoo Ahn
da84027b72 [GPU] Fix setting impl type / format issue on dGPU (#18345)
* [GPU] Add roi_align get_shape_infer_dependencies (#18345)

* [GPU] Fix concat cpu impl for buffer fusing case

* [GPU] Add roi_align shape_infer unit tests

* [GPU] Fix windows build issue

* [GPU] add unit test
2023-07-07 11:04:14 +02:00
Aleksandr Voron
2b795afc09 fix multi-axis reduce transformation (#18414) 2023-07-07 10:56:09 +04:00
Wanglei Shen
d571ab3a12 enable numa_node_id and socket_id in streams_info_table (#18164)
* enable numa_node_id and socket_id in streams_info_table

* fix code style issue

* fix document issue

* update for comments

* update for comments

* update for comments
2023-07-07 12:33:23 +08:00
Andrei Gorbachev
6e49b97dd6 [Coverity] fix type x_channel_idx (#18309)
* fix 112753

* fix 112753
2023-07-07 08:19:20 +04:00
Eddy Kim
42d44ddc84 updated not to propagate events when in-order queue is used (#18415) 2023-07-06 19:57:12 -07:00
Eddy Kim
58d1fc3c6b [GPU] updates to use a graph local net_id for model caching (#18372)
* newly added local_net_id

* updated calls to network ctors

* updated to use uint32_t for local_net_id

* added comments for _local_net_id
2023-07-06 18:34:08 -07:00
Tanmay
e0d7ce691b fix typo in primitive_inst.cpp (#18417) 2023-07-07 01:25:56 +04:00
Andrew Kwangwoong Park
f5baec14aa [GPU] Fix issue in runtime buffer fusing for oneDNN concat and auto padding support for conv (#18393)
* Add auto pad attribute support for conv

* Fix to let concat onednn impl check can_be_optimized in impl_param instead of that in node

* Apply auto padding to kernel param  for conv ocl impl

* conv shape agnostic kernel is not selected if conv is not explicit padding

* Fix failed TCs for ov_gpu_unit_tests

Signed-off-by: Andrew Park <andrew.park@intel.com>

---------

Signed-off-by: Andrew Park <andrew.park@intel.com>
2023-07-06 11:20:34 -07:00
Kelvin Choi
f0ec940fc1 [GPU] Support FC 6d output by compressing as 4d in kernel for dynamic (#17996) 2023-07-06 11:07:28 -07:00
Pavel Durandin
d864d89806 [GPU] Fix misprint in auto plugin (#18402) 2023-07-06 17:39:59 +04:00
Aleksandr Voron
c40d6acfc8 [CPU] [ARM] Enable MVN SLT tests on ARM (#17973)
* enabled MVN SLT tests on ARM

* moved nhwc to common section

* exclude normalizeVariance=true from x64

* fixed comments

* add NCHW+acrossChannels = false test case

* Add comment about unsupported case

* fixed 5d layout in Mvn5D_noAcrossChannels

* MvnLayerCPUTest::isSupportedTestCase() added
2023-07-06 15:09:50 +02:00
Aleksandr Voron
fc9e0ce315 [CPU] [ARM] Enable Reduce SLT tests on ARM (#18006)
* init

* moved NHWC to common section

* experiment to support dynamic shapes in reduce transformation

* support dynamic shapes

* axes sorting fix in reduce transformations
2023-07-06 10:42:46 +02:00
hyunback kim
2e8ef4c200 [GPU] oneDNN 3.2 integration (#18326)
Signed-off-by: hyunback <hyunback.kim@intel.com>
2023-07-06 16:34:47 +09:00
Jade Cho
ebf1199733 [GPU] Optimize conv_b_fs_zyx_fsv16_imad (#18356)
+ Make this kernel do not support asymmetric weight.
2023-07-06 16:28:40 +09:00
Andrei Gorbachev
87ed81f51c [Coverity] fix _type declaration (#18322)
* _type declaration

* fix _type init
2023-07-06 09:32:44 +04:00
Andrew Kwangwoong Park
9069dab72d [GPU] Some fixes to enable dynamic validation model (#18340)
* skip fuse_quantize_f if input or output layout is dynamic

* Update condition of can_fuse_reorder_to_prev for concat in shapeof subgraph

* skip concat_in_place_optimization if concat is shape of subgraph

Signed-off-by: Andrew Park <andrew.park@intel.com>

* Add reorder if eltwise is shapeof subgraph and data type between input and output is different

* Skip reorder optimization if reorder has dynamic shape on remove_redundant_reorders

* Add reproducible TCs for ov_gpu_unit_tests

---------

Signed-off-by: Andrew Park <andrew.park@intel.com>
2023-07-05 10:05:12 -07:00
Kelvin Choi
68e1f07ec9 [GPU] selected format adjusts to the required input rank at get_preferred_format (#18044) 2023-07-05 09:49:19 -07:00
Nikolay Shchegolev
886fd0debb [CPU] ONNX Unique tests failing on CPU (#18100)
* [CPU] ONNX Unique tests failing on CPU

* Fixes as per comments.
2023-07-05 18:16:21 +02:00
Andrei Gorbachev
8a76f4e7fa fix coverity block_size < 1 (#18320) 2023-07-05 12:09:40 +04:00
Andrei Gorbachev
c58bf68bc8 [GPU] fix uninitialized scalar variable (#18199)
* fix uninitialized scalar variable

* fix get_default_params
2023-07-05 10:29:04 +04:00
Kelvin Choi
35e26906ed [GPU] Update pad output shape for dynamic (#17995) 2023-07-05 04:22:49 +00:00
Eddy Kim
4c072ac4b5 [GPU] memory reuse for dynamic models (#18228)
* enable memory reuse for dynamic models

* updated to return dependant events for the shape_of primitive

* fixed memory_pool.release_memory()

* fixed a lint error

* fixed missing default value

* updated to use reset flag for dynamic models

* changed to use is_dynamic_output_layout instead of is_dynamic

* updated to use get_internal_params instread of buffer_ptr

* added a memory reuse test for dynamic models
2023-07-04 18:12:49 -07:00
Ilya Churaev
7fc16c3295 Move OpenVINO core developers API to OpenVINO folder (#18360)
* Move openvino core developers API to OpenVINO folder

* Fixed GPU plugin

* Fixed code style
2023-07-04 22:14:53 +04:00
Luwei Zhou
0b3a004825 [CPU] Combine DQ scales and multiply into DQ scales. (#17276)
* Fix the multible multiply case.

* Add test case.

* Fix CI issues.

* Fix the dynamic shape FC kernel creating issue.

* Expose FC weight with original linear layout to CPU graph.

* Apply review comments.

* Apply review comments.

* Applied review comments.
2023-07-04 13:38:25 +02:00
Alexandra Sidorova
211c56acf9 [CPU] Fixed naming in SwapConvertTranspose pass (#18208)
* [CPU] Fixed naming in SwapConvertTranspose pass

* Applied Vladislav comments
2023-07-04 13:34:07 +04:00
Steve Yoo
6be030be05 Fixed SpaceToBatch and BatchToSpace for 3d case (#18033)
* Added functional tests for SpaceToBatch and BatchToSpace

* Added functional tests for template plugin
2023-07-02 21:39:45 -07:00
Yury Gaydaychuk
a2b7d561e4 [CPU] Checking of nonbias port in FQ-ScaleShift fusing (#17555)
* In FQ-MM fusing added checking of nonbias port during calculating channel dim

* comment added

* test added
2023-06-30 16:01:32 +02:00
Pawel Raasz
f52ab4f9ef Optimize IE_THROW and IE_ASSERT for size reduction (#18284)
* Optimize IE_THROW and IE_ASSERT for size reduction

* Fix build issues
2023-06-30 11:52:21 +04:00
yanlan song
1f7176031d Bell/fix static scan issues (#18285)
* change default value

Signed-off-by: fishbell <bell.song@intel.com>

* fix case failure

Signed-off-by: fishbell <bell.song@intel.com>

* fix post commit failure

Signed-off-by: fishbell <bell.song@intel.com>

* fix sdl issues

Signed-off-by: fishbell <bell.song@intel.com>

---------

Signed-off-by: fishbell <bell.song@intel.com>
2023-06-30 11:41:48 +04:00