Commit Graph

11787 Commits

Author SHA1 Message Date
Nikolay Shchegolev
88703905f4
[CPU] Leftovers for Extension convert I64/U64 to I32. (#16941)
* [CPU] Leftovers for Extension convert I64/U64 to I32.

* Fix as per comments

* Fixes as per commits 2

* Fixes as per commits 3

* Revert "Fixes as per commits 3"

This reverts commit 84022be66f64faccd96a32da5611db0e5137d049.

* Some fixes

* Test fix
2023-07-11 11:42:53 +02:00
Marcin Kacprzak
521c846b72
[GNA] Fix for concat requantization problem (#18008)
* [GNA] Fix for concat requantization problem

* [GNA] Review fixes

* [GNA] Reverted `using namespace std`

* [GNA] Updated transformation description
2023-07-11 10:32:49 +01:00
Mateusz Tabaka
0296008c7e
Add explicit converts for Parameter and Result in ConvertPrecision tr… (#18183)
* Add explicit converts for Parameter and Result in ConvertPrecision transformation

* set friendly name for convert on output

* tests
2023-07-11 13:02:28 +04:00
Mateusz Mikolajczyk
82c65c25da
[PT FE] Add aten::scatter and inplace for aten::sub translation (#18341)
* Add sub inplace

* Add scatter implementation

* Remove debug var

* Add tests for empty index

* Add reduce support

---------

Co-authored-by: Michal Lukaszewski <michal.lukaszewski@intel.com>
2023-07-11 11:00:50 +02:00
Maciej Smyk
0148076ed7
[DOCS] Code block update for master (#18437)
* code-block-1

* Update Convert_Model_From_Paddle.md

* code-block force

* fix

* fix-2

* Update troubleshooting-steps.md

* code-block-2

* Update README.md
2023-07-11 10:43:54 +02:00
Maksim Kutakov
900163c484
[CPU] In place memory for dynamic shapes (#17741)
* InPlace memory direction resolution pass

* Partitioned mem mngr

* Concat reshape pattern has been enabled

* Enhanced in place conflicts detection

* Refactor Concat

* Fix Reshape isExecutable call

* Split node refactoring

* Gather node inPlace special case

* Temporal WA to enable zero copy on Split input

* Process inPlace edges in order

* Fixes

* Remove implicit initialization from Edge::getMemory

* Allow NotAllocated edges call allocate

* extract IMemory interface and implements Memory class.

* IMemory fixes after merge

* Prevent input memory modification

* Minor build fixes

* Fix unittest build

* Fix for variadic concat

* Edge reference fix

* Lock based mem manager

* Return value fix

* Naming refactoring

* Use make_unique

* Split output dims check

* Special processing for empty parts

* Concat null memory fix

* Fix downstream inplace resolution

* Concat allocated edge search fix

* Variadic split clean up tests

* Variadic Split tests update

* Fix make_unique conflict

* Split inPlace tests are back

* Concat inPlace dyn shapes tests

* Add safety checks to isInputTensorAtPortEmpty

* Fix partitioned mem mngr zero size reset

* Introduce Static Memory

* Gather InPlace Tests

* InPlace conflict check in merge Reorder Transpose

* Apply review comments

* fix after rebase

---------

Co-authored-by: jialipen <cecilia.peng@intel.com>
2023-07-11 10:39:29 +02:00
Katarzyna Mitrus
827fb0234b
[Shape Infer] RNN/GRU/LSTM Cell & Sequence - common shape infer and review (#18009)
* rrn seq base common shape infer init

* Update and add shape infer to all seq rnn based ops

* Use shape_infer in lstm seq core op

* Use shape_infer in rnn seq core op

* Unified shape infer for rnn cell base

* Update and add missing cells shape_infer functions

* Use shpe_infer in rnn_cell

* Update shape_infer map

* shape_infer tests

* Move new shape_infer to TA map

* More tests and shape improvements

* Introduce common base tests

* Fix merge conflict

* Missing setters and default ctor tests

* Use RNNCellBase class instead of template type op

* Update v0 LSTMSequence to use RNNCellBase as parent class

* Style

* V0::LSTMSequence update

* Specify opset in shape infer registry

* Move rank check

* Output vec generation refactor

* Update num_dir_validation

* Tests warining fix

* Test types adjustment

* Commented code cleanup

* Move test helpers to test fixture

* Common default ctor tests for Cell

* Update GRU shape infer tests

* Update LSTM shape infer tests

* Update RNN shape infer tests

* File names update

* Functions renaming

* Cast hidden size in test

* Move v0::LSTMSequence conformance test

---------

Co-authored-by: Pawel Raasz <pawel.raasz@intel.com>
2023-07-11 12:38:31 +04:00
Evgeny Kotov
2663b002e8
fix transformation; add unit test (#18346)
Co-authored-by: Ivan Tikhonov <ivan.tikhonov@intel.com>
2023-07-11 10:27:33 +02:00
Andrey Kashchikhin
c738899408
[CI] Introduce Linux pipeline in GitHub Actions (#18355)
* skip validation, always include cmake

* rm unconditional inclusion of zlib

* always include zlib

* correct path for builtin_extensions

* find builtin extensions recursively

* include test_utils always

* add logs for build_samples

* skip tests with dir accessing

* remove platform specification for samples build

* do not pkgconfig on win, use cmake generic on linux for samples

* rm make

* fix num_threads

* use bare numbers

* skip failing

* skip test_lrn_basic

* find zlib

* print error of downloading

* add linux pipeline

* do not save cache from PRs; add skipif only in GHA

* rm caching

* evaluate against a string

* do not include test_utils to the install dir
2023-07-11 11:54:33 +04:00
Maciej Smyk
2ea277fc72
Update installing-openvino-docker-linux.md (#18458) 2023-07-11 09:44:08 +02:00
Irina Efode
b1e250757e
[IE TESTS][CONFORMANCE] Change data_generation initialization to avoid incorrect value (#18193)
* [IE TESTS][CONFORMANCE] Fix data generation

* fix cpu tests

* CPP Lint

* Update ranges.hpp

* change start_from and range according typo

* Update deformable_convolution.cpp

* clenup

* Update activation.cpp

* Update deformable_convolution.cpp

* Update grid_sample.cpp

* Fix tests -> change start_from type
2023-07-11 09:12:25 +03:00
Paul Youngsoo Ahn
ff4ed54bba
[GPU] Fix kernel selecting issue on dynamic model with static input shape (#18448)
* [GPU] disable blocked format for dynamic shape model(#18448)

* [GPU] Return default format for output layout rank when user node is reshape in get_preferred_format
- Rollback code to disable blocked formmat for dynamic shape

* [GPU] Add unit test checking has_reshape_user

* [GPU] remove redundant comments
2023-07-10 22:54:56 -07:00
Evgeny Kotov
ad7caf5d76
Pruning add Pad12 support (#18363)
* fix transformation

* add unit test

---------

Co-authored-by: Ivan Tikhonov <ivan.tikhonov@intel.com>
2023-07-10 23:18:46 +04:00
Ilya Churaev
3278bc1566
Fixed build without proxy (#18442) 2023-07-10 22:38:00 +04:00
Tatiana Savina
d829c8086d
basiq quantization flow changes (#18439) 2023-07-10 18:53:41 +02:00
Pavel Durandin
75696f4545
[GPU] Fix DG2 units tests with null users (#18455)
* [GPU] Fix DG2 units tests with null users

* [GPU] Fix DG2 units tests with null users
2023-07-10 19:32:38 +04:00
Tomasz Dołbniak
975ba2a92b
Optimization of ScatterElementsUpdate ref impl (#18313)
Co-authored-by: Katarzyna Mitrus <katarzyna.mitrus@intel.com>
Co-authored-by: Michal Lukaszewski <michal.lukaszewski@intel.com>
2023-07-10 15:58:37 +02:00
Artyom Anokhov
58de48a491
Temporary block nvidia plugin to enable CPack target first (#18456)
* Temporary block nvidia plugin to enable CPack target first

* rpm.cmake: Added the same block for nvidia
2023-07-10 17:15:59 +04:00
Oleg Pipikin
d6c0289008
Move common test utils (#18339)
* Move common test utils

* Apply comments

* Comments 2
2023-07-10 12:48:24 +00:00
Ilya Churaev
500ac2ab43
Remove vector of so objects from Tensor, Any, VariableState and (#18430)
RemoteContext
2023-07-10 12:41:03 +00:00
River Li
3286a405be
Don't eliminate Transpose when 0 size of order_value (#18130)
* Don't eliminate Transpose when 0 size of order_value

* Remove invalid test for transpose
2023-07-10 14:58:02 +04:00
Przemyslaw Wysocki
6c55937119
[PyOV] Add get_compiled_model binding for InferRequest (#18386) 2023-07-10 12:08:10 +02:00
Andrei Gorbachev
8f529df763
[Coverity] Fix coverity (#18420)
* fix CVS-112761

* fix CVS-112760

* fix CVS-112770
2023-07-10 09:49:59 +04:00
Pavel Esir
1cb4595727
[MO] add support for scalar shapes into cli_parser.py (#18312)
* add support for scalar shapes into cli_parser.py

* add test-case with scalar shapes for convert_model

* reordered inputs in test-case with scalar shapes for convert_model

* minor clarifications

---------

Co-authored-by: Roman Kazantsev <roman.kazantsev@intel.com>
2023-07-08 17:27:07 +00:00
Pavel Esir
af9a8cbbd7
fix GitHub Actions failing tests (#18357)
Co-authored-by: Roman Kazantsev <roman.kazantsev@intel.com>
2023-07-08 18:21:59 +02:00
Andrew Kwangwoong Park
eb3bb52a08
[GPU] Update DepthToSpace to use nGraph shape inference (#18422)
* Update DepthToSpace to use ngraph shape infer

* Remove legacy block_size limitation for static shape

Signed-off-by: Andrew Park <andrew.park@intel.com>

* Add TCs for ov_gpu_func_tests and ov_gpu_unit_tests

Signed-off-by: Andrew Park <andrew.park@intel.com>

---------

Signed-off-by: Andrew Park <andrew.park@intel.com>
2023-07-07 15:13:48 -07:00
Paul Youngsoo Ahn
f940333a1c
[GPU] Apply ngraph shape infer for ROIAlign (#18424) 2023-07-07 11:37:21 -07:00
Tomasz Jankowski
e81bcacf33
[Ref_Impl] Add GroupNormalization-12 reference implementation (#18343)
* Add GroupNorm reference implementation

* Clean up

* Handle GroupNorm in ov namespace only

* Simplify the flow

* Add various scale and bias tests

* Fix batches case

* Add more float tests

* Set output shape

* Set output shape

* Fix missing includes

* Move to ov namespace

---------

Co-authored-by: Michal Lukaszewski <michal.lukaszewski@intel.com>
2023-07-07 20:04:44 +02:00
Evgeny Kotov
0cd4ea29ce
fix ReverseShapeAndTypeInfer; add unit test (#18319)
Co-authored-by: Ivan Tikhonov <ivan.tikhonov@intel.com>
2023-07-07 17:49:47 +02:00
Ilya Churaev
79c37882aa
Add variable state for proxy plugin (#18426)
* Added proxy variable state

* Added documentation for some methods

* Fixed code style
2023-07-07 17:44:57 +02:00
Vladislav Golubev
205de6106b
[Snippets] BrgemmEmitter: blocking by K & N dimensions (#18302)
* KN blocking draft

* some fixes

* IdentifyBuffers temporary hack

* Emitter cleanup

* IdentifyBuffers cleanup

* BrgemmCopyB validation: N_blk is taken from the child BrgemmCPU

* Added blocking parameters to BrgemCPU

* accuracy fixes

* Buffers insertion removed from BrgemmToBrgemmCPU

* Added blocking parameters to BrgemmCopyB

* blocking parameters

* Blocking params configuration removed from brgemm_to_brgemm_cpu transformation

* Introduced a transformation for blocking parameters configuration

* MHA tokenization alligned with blocking matmul requirements

* Alexandra's comments applied

* Alexandra's comments applied: 2nd round

* Ivan's comments applied

* MHA tokenization: removed kernel_buffer_size related heuristics
2023-07-07 17:44:14 +02:00
Ilya Churaev
8e671403b3
Try to fix error: e is outside the range (#18369)
* Try to fix error: e is outside the range

* Fixed code style

* Fixed tests

* Fixed tests

* Fixed code style

* Added error messages

* Fixed code style
2023-07-07 19:36:18 +04:00
Mikhail Ryzhov
df014637c9
[GNA] Fixed concat axis checks (#18281)
* Fixed concat axis checks

* clang fix

* Enabled the rigth concat axis check

* is_concat_supported based on ngraph

* fixed concat patterns checks

* code style fix

* removed unused helpers

---------

Co-authored-by: Marcin Kacprzak <marcin.kacprzak@intel.com>
2023-07-07 14:33:47 +01:00
Yury Gaydaychuk
33b457b097
[CPU] Fix of coverity issues (#17823)
* mvn missing else handled

* negative binarization covered

* coverity 1502464

* coverity 1504685, 1504781, 1504786

* rollback regpool diff

* code review
2023-07-07 15:24:15 +02:00
Ilya Churaev
e5abe855b7
Fixed post commit (#18433) 2023-07-07 16:31:09 +04:00
Maciej Smyk
492bf497d7
[DOCS] Tab reorder for master (#18387)
* tabs-1

* Update configure_devices.md

* tab-2

* tab-order

* Update installing-openvino-from-archive-linux.md

* Update installing-openvino-from-archive-linux.md

* win-linux-fix

* Update GPU_Extensibility.md
2023-07-07 14:31:02 +02:00
Katarzyna Mitrus
e42548137e
[Pad-12] Negative pads_begin/end tests for Pad reference implementation (#18344)
* Pad ref impl tests for negative pads begin end

* Adjust indentation

* Remove redundant line from the output

* Add tests with removal on middle axis

* Add tests with empty result

---------

Co-authored-by: Michal Lukaszewski <michal.lukaszewski@intel.com>
2023-07-07 10:53:52 +00:00
Vladimir Paramuzov
2939818278
[GPU] Enable shape agnostic quantize_scale_shift kernel (#18188)
* [GPU] Enable shape agnostic quantize_scale_shift kernel

* Resolve conflicts in compile_graph.cpp

* Update compile_graph.cpp

---------

Co-authored-by: Pavel Durandin <pavel.durandin@intel.com>
2023-07-07 10:38:41 +00:00
Ilya Churaev
b69190c2c1
Proxy plugin 2.0 (#17416)
* Initial commit for proxy plugin

* Include proxy to openvino library

* Fixed some tests

* Added plugin properties

* Added readme

* Support Compile model for the proxy plugin

* Fixed python

* Remove gmock

* Fixed some tests

* Fixed load plugin tests

* Removed internal PROXY_FALLBACK_PRIORITIES initialization property

* Fixed code style

* Added new tests

* Create architecture.md

* Fixed some proxy tests

* Implement not implemented functions

* Fixed ICore mock

* Remove redundant code

* Added import/export tests

* Fixed hetero import/export tests

* Fixed ICore mock

* Fixed import tests

* Fixed build

* Remove redundant parse config

* Fixed some comments

* Try to fix Windows build

* Fixed incorrect logic

* Small fix in tests

* Fixed python API

* Fixed typo

* Try to fix python

* Switch GPU under proxy

* Fixed GPU name

* Revert GPU plugin under proxy

* Small changes in CMake files

* Temp commit

* Build without proxy

* Revert "Temp commit"

This reverts commit 1ac9824bdf.

* Fixed test linking

* Removed tests from ncc check

* Add option to disable proxy plugin

* Fixed minor comments

* Disable some proxy tests if IR frontend is disabled

* Enable Intel GPU under the proxy

* Fixed typo

* Fixed segfault in tests

* Small fix for case if only GPU is registered

* Fixed code style

* Added remote context tests

* Added proxy tests to CI

* Fixed mock engine

* Test change

* Revert "Test change"

This reverts commit 2d1d67766f.

* Add new tests

* Removed some tests

* Revert "Removed some tests"

This reverts commit 090398652f.

* Revert incorrect logic

* Removed unused variables

* Use original name for the GPU plugin

* Fixed CMake

* Do not show hidden devices

* Try to fix GPU remote context

* Fixed GPU plugin build

* Added interface for proxy remote context

* Remove local properties

* Remove redundant API

* Fixed typo

* Added remote tensors

* Fixed code style

* Fixed some comments

* Unwrap remote tensors before conversion to Blob

* Added cast for legacy API

* Fixed some cldnn tests

* Do not add preprocessing for proxy plugin

* Enabled more tests and wrap tensors in infer request

* Use hardware request inside conversion wrapper

* Fixed hand on cache calculation

* Try to fix some tests

* Support set tensor for remote tensors in proxy plugin

* Revert "Support set tensor for remote tensors in proxy plugin"

This reverts commit 5a927de590.

* Remove redundant friend from compiled model and fix life time for infer
request

* Fixed code style

* Add additional so pointers to the tensor

* Rewrite approach for compile model and tensor

* Removed API from proxy

* Fixed is/as Blob for wrapped Blobs

* Wrap tensor when set tensor to plugin

* Fixed recursive call

* Don't unwrap tensors for AUTO plugin

* Fixed Some Multi tests with remote blob for proxy

* Align context name with tests

* Fixed code style

* Try to fix more tests

* Some minor changes

* Try to fix OVHoldersTests

* Try to save low level SO in high level wrappers

* Revert "Try to save low level SO in high level wrappers"

This reverts commit 430ff8a526.

* Revert "Try to fix OVHoldersTests"

This reverts commit 32604f0d3e.

* Disable some tests

* Fixed DynamicBatchShapeTests

* Fixed caching tests and skip OVHoldersTest

* Small refactoring

* Fixed import model

* Small fix

* Fix typo which causes fails of caching tests

* Disabled AUTO BATCH for proxy device

* Support Export in Auto batch

* Small changes

* Fixed initialization fallback to plugin with proxy name

* Added more values for tests

* Ask all devices and create context if no device id

* Support export in auto batch

* Fixed some comments

* Fixed some comments and removed auto batch

* Fixed some comments

* Fixed auto batch test and some comments

* Fixed build

* Removed proxy plugin class from dev api

* Fixed code style

* Fixed disabled tests
2023-07-07 13:45:20 +04:00
Luwei Zhou
a3bd0cb4d7
[CPU] oneDNN v3.2 migration (#18094)
* [WA] Comment the onnx test.

Seems this test error would be a little bigger than expected error.

* Remove the softmax CPU function test filter because onednn merge all
ISAs into one primitive.

* Fix zero point issue.

* Remove wino conv test cases because ONEDNN3.2 does not supported.

* Fix cpu debug log verbose

* Update onednn to squash commit version.

* Applied tolerance threashold for onnx_model_bias_gelu test.

* Restore to fix ICX perf regression.

* Clean  winograd related code.

* Update ONEDNN to support ARM.

* Applied review comments.
2023-07-07 11:12:02 +02:00
Mateusz Mikolajczyk
63071b21d4
[PT FE] Add translation for aten::fake_quantize_per_tensor_affine and aten::fake_quantize_per_channel_affine (#18176) 2023-07-07 09:05:23 +00:00
Paul Youngsoo Ahn
da84027b72
[GPU] Fix setting impl type / format issue on dGPU (#18345)
* [GPU] Add roi_align get_shape_infer_dependencies (#18345)

* [GPU] Fix concat cpu impl for buffer fusing case

* [GPU] Add roi_align shape_infer unit tests

* [GPU] Fix windows build issue

* [GPU] add unit test
2023-07-07 11:04:14 +02:00
Aleksandr Voron
2b795afc09
fix multi-axis reduce transformation (#18414) 2023-07-07 10:56:09 +04:00
Ilya Lavrenov
df2ed95dab
Fixed RPATH issue for brew (#18418) 2023-07-07 08:55:27 +04:00
Wanglei Shen
d571ab3a12
enable numa_node_id and socket_id in streams_info_table (#18164)
* enable numa_node_id and socket_id in streams_info_table

* fix code style issue

* fix document issue

* update for comments

* update for comments

* update for comments
2023-07-07 12:33:23 +08:00
River Li
e81f85c565
Resolve tensor sharing issue when there are same name output port name (#18379)
* Resolve tensor sharing issue when there are same name output port name

In some case, model has 2 or more same name input/output ports, they aslo have the same
precision and partial_shape. Compiled_model will share the same ov::Descriptor::Tensor pointer
and ov::Tensor between multiple such ports.
Considered solving python segment fault issue to create seperated input/output ports, which also
need handle such tensor shared case, this patch will do it.

* Better method to find shrared tensor desc

* Use port's tensor_ptr to replace creating new tensor_ptr
2023-07-07 08:23:06 +04:00
Andrei Gorbachev
6e49b97dd6
[Coverity] fix type x_channel_idx (#18309)
* fix 112753

* fix 112753
2023-07-07 08:19:20 +04:00
Eddy Kim
42d44ddc84
updated not to propagate events when in-order queue is used (#18415) 2023-07-06 19:57:12 -07:00
Eddy Kim
58d1fc3c6b
[GPU] updates to use a graph local net_id for model caching (#18372)
* newly added local_net_id

* updated calls to network ctors

* updated to use uint32_t for local_net_id

* added comments for _local_net_id
2023-07-06 18:34:08 -07:00
Anastasiya(Asya) Pronina
24bfb29eb8
Switched pointer of open_model_zoo to last master (#18380) 2023-07-07 01:42:25 +02:00