Commit Graph

11742 Commits

Author SHA1 Message Date
River Li
e81f85c565
Resolve tensor sharing issue when there are same name output port name (#18379)
* Resolve tensor sharing issue when there are same name output port name

In some case, model has 2 or more same name input/output ports, they aslo have the same
precision and partial_shape. Compiled_model will share the same ov::Descriptor::Tensor pointer
and ov::Tensor between multiple such ports.
Considered solving python segment fault issue to create seperated input/output ports, which also
need handle such tensor shared case, this patch will do it.

* Better method to find shrared tensor desc

* Use port's tensor_ptr to replace creating new tensor_ptr
2023-07-07 08:23:06 +04:00
Andrei Gorbachev
6e49b97dd6
[Coverity] fix type x_channel_idx (#18309)
* fix 112753

* fix 112753
2023-07-07 08:19:20 +04:00
Eddy Kim
42d44ddc84
updated not to propagate events when in-order queue is used (#18415) 2023-07-06 19:57:12 -07:00
Eddy Kim
58d1fc3c6b
[GPU] updates to use a graph local net_id for model caching (#18372)
* newly added local_net_id

* updated calls to network ctors

* updated to use uint32_t for local_net_id

* added comments for _local_net_id
2023-07-06 18:34:08 -07:00
Anastasiya(Asya) Pronina
24bfb29eb8
Switched pointer of open_model_zoo to last master (#18380) 2023-07-07 01:42:25 +02:00
Tanmay
e0d7ce691b
fix typo in primitive_inst.cpp (#18417) 2023-07-07 01:25:56 +04:00
Andrew Kwangwoong Park
f5baec14aa
[GPU] Fix issue in runtime buffer fusing for oneDNN concat and auto padding support for conv (#18393)
* Add auto pad attribute support for conv

* Fix to let concat onednn impl check can_be_optimized in impl_param instead of that in node

* Apply auto padding to kernel param  for conv ocl impl

* conv shape agnostic kernel is not selected if conv is not explicit padding

* Fix failed TCs for ov_gpu_unit_tests

Signed-off-by: Andrew Park <andrew.park@intel.com>

---------

Signed-off-by: Andrew Park <andrew.park@intel.com>
2023-07-06 11:20:34 -07:00
Kelvin Choi
f0ec940fc1
[GPU] Support FC 6d output by compressing as 4d in kernel for dynamic (#17996) 2023-07-06 11:07:28 -07:00
Ilya Lavrenov
14292b8da5
Allow to find protobuf via MODULE (#18395) 2023-07-06 18:26:55 +04:00
Pavel Durandin
d864d89806
[GPU] Fix misprint in auto plugin (#18402) 2023-07-06 17:39:59 +04:00
Aleksandr Voron
c40d6acfc8
[CPU] [ARM] Enable MVN SLT tests on ARM (#17973)
* enabled MVN SLT tests on ARM

* moved nhwc to common section

* exclude normalizeVariance=true from x64

* fixed comments

* add NCHW+acrossChannels = false test case

* Add comment about unsupported case

* fixed 5d layout in Mvn5D_noAcrossChannels

* MvnLayerCPUTest::isSupportedTestCase() added
2023-07-06 15:09:50 +02:00
Przemyslaw Wysocki
ddab71abca
Limit numpy (#18406) 2023-07-06 14:59:27 +02:00
Aleksandr Voron
fc9e0ce315
[CPU] [ARM] Enable Reduce SLT tests on ARM (#18006)
* init

* moved NHWC to common section

* experiment to support dynamic shapes in reduce transformation

* support dynamic shapes

* axes sorting fix in reduce transformations
2023-07-06 10:42:46 +02:00
Haiqi Pan
c7431be401
Deprecate legacy C API (#18146)
* Deprecate legacy C API

* fix code sytle

* add INFERENCE_ENGINE_1_0_DEPRECATED in ie_c_api.h

* fix code style

* use OPENVINO_SUPPRESS_DEPRECATED

* reset ie_c_api.cpp

* fix code style

* fix code style

* fix definition

* fix code style

* change msg

* [[deprecated(msg)]]

* add cmake fun

* add deprecated message to INFERENCE_ENGINE_C_API

* remove deprecate msg in fun

* add msg

* fix code style

* fix code style

* add OPENVINO_SUPPRESS_DEPRECATED_END in c api test

* move head after OPENVINO_SUPPRESS_DEPRECATED_START

* move declaration to ie_c_api.h

* reset to OPENVINO_DEPRECATED

* reset to OPENVINO_DEPRECATED

* try to fix code style

* Revert "try to fix code style"

This reverts commit cc2b8476de.

* Revert "reset to OPENVINO_DEPRECATED"

This reverts commit 9d158c8163.

* Revert "reset to OPENVINO_DEPRECATED"

This reverts commit f8b2793abc.

* Update src/bindings/c/include/c_api/ie_c_api.h

Co-authored-by: Chen Peter <peter.chen@intel.com>

* Update src/bindings/c/tests/ie_c_api_test.cpp

Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>

* remove noo error in CMakeLists

* remove macro

* ix code style

* change msg

* fix C4996

* add ov_deprecated_no_errors back

* add full msg

---------

Co-authored-by: Chen Peter <peter.chen@intel.com>
Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>
2023-07-06 12:38:43 +04:00
Pawel Raasz
c1f26d119f
Introduce ov element type visitor (#18189)
* Introduce ov::element visitor

* Example usage visitor in shape infer tools

* Example usage of visitor in unsqueeze evaluate

* Example usage of visitor in Round evaluate

* Example usage of visitor in Unique evaluate

* Refactor element visitor
- Use visitor in tanh and tan operators

* Fix enable_if for MSVC compiler

* Update comments in element visitor

* Move test to the core

* Corrects typos

* Apply code style
2023-07-06 12:10:30 +04:00
hyunback kim
2e8ef4c200
[GPU] oneDNN 3.2 integration (#18326)
Signed-off-by: hyunback <hyunback.kim@intel.com>
2023-07-06 16:34:47 +09:00
Jade Cho
ebf1199733
[GPU] Optimize conv_b_fs_zyx_fsv16_imad (#18356)
+ Make this kernel do not support asymmetric weight.
2023-07-06 16:28:40 +09:00
Sergey Lyalin
dfba702c74
Decompose/flatten tuple inputs (#18092)
* prim::TupleUnpack and prim::ListUnpack removing transformation in PT FE to flatten input list and tuples

* Enabled tuples and lists as items in example_inputs

* Applied code style

* Added tests for tuples as inputs and extended test infrastructure to support it

* Negligible performance optimizations

Co-authored-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Fixed duplicated names of test classes

* Added description for tuple flattening transformation

* Removed any support for list flattening on inputs; fixed layer tests

* Fixed style

* Fixed order of new Parameters and Results while flattening tuples

* Fixed style

* Better diagnostics when not all prim::TupleUnpack ops after Parameters are decomposed

* Small fix in diagnostics message

---------

Co-authored-by: Ekaterina Aidova <ekaterina.aidova@intel.com>
Co-authored-by: Andrei Kochin <andrei.kochin@intel.com>
Co-authored-by: Roman Kazantsev <roman.kazantsev@intel.com>
Co-authored-by: Alina Kladieva <alina.kladieva@intel.com>
2023-07-06 11:05:26 +04:00
bstankix
553dab43b4
[DOCS] Add global footer 2023-07-06 08:24:40 +02:00
Sebastian Golebiewski
9b67a9ddb3
[DOCS] Fix references in installation guide (#18382) 2023-07-06 08:04:49 +02:00
Andrei Gorbachev
87ed81f51c
[Coverity] fix _type declaration (#18322)
* _type declaration

* fix _type init
2023-07-06 09:32:44 +04:00
Alexandra Sidorova
2532fdb4f3
[Snippets] Fixed insertion position iterators (#18023)
* [Snippets] Fixed Buffer insertion position

* [Snippets] Fixed unsafe insertion iterators: added asserts

* [Snippets] Applied Ivan comments

* [Snippets] Left only const iterator methods
2023-07-05 21:55:23 +02:00
Andrew Kwangwoong Park
9069dab72d
[GPU] Some fixes to enable dynamic validation model (#18340)
* skip fuse_quantize_f if input or output layout is dynamic

* Update condition of can_fuse_reorder_to_prev for concat in shapeof subgraph

* skip concat_in_place_optimization if concat is shape of subgraph

Signed-off-by: Andrew Park <andrew.park@intel.com>

* Add reorder if eltwise is shapeof subgraph and data type between input and output is different

* Skip reorder optimization if reorder has dynamic shape on remove_redundant_reorders

* Add reproducible TCs for ov_gpu_unit_tests

---------

Signed-off-by: Andrew Park <andrew.park@intel.com>
2023-07-05 10:05:12 -07:00
Kelvin Choi
68e1f07ec9
[GPU] selected format adjusts to the required input rank at get_preferred_format (#18044) 2023-07-05 09:49:19 -07:00
Nikolay Shchegolev
886fd0debb
[CPU] ONNX Unique tests failing on CPU (#18100)
* [CPU] ONNX Unique tests failing on CPU

* Fixes as per comments.
2023-07-05 18:16:21 +02:00
Evgeny Kotov
fb676a9e76
fix ov_transformation_tests duplicates (#18383) 2023-07-05 16:16:00 +02:00
Evgeny Kotov
6a0c6a1a60
fix transformation; add unit test (#18314)
Co-authored-by: Ivan Tikhonov <ivan.tikhonov@intel.com>
2023-07-05 14:36:46 +02:00
Evgeny Kotov
f313dde66b
EliminatePad and PadFusion support Pad12 positive indexes (#18278)
* update opset5::Pad -> PadBase

* rewrite unit tests

* refactor unit tests

* add unit test NegativePadElimination

* fix add destructor

* clang fixes

* fix unit tests

* add unit tests

* bug fix

---------

Co-authored-by: Ivan Tikhonov <ivan.tikhonov@intel.com>
2023-07-05 10:34:01 +00:00
Andrei Gorbachev
8a76f4e7fa
fix coverity block_size < 1 (#18320) 2023-07-05 12:09:40 +04:00
River Li
1abf2a01d8
Fix python segment fault issue of plugin api 2.0 (#18325)
* Fix python segmentfault issue of plugin api 2.0

* Fix onnx_duplicated_output_name due to empty tensor

Co-authored-by: Bell, Song <bell.song@intel.com>

* Remove redundant code

* Keep rt_info to fix test failure in case of legacy public api

* Not to set_name for new port

---------

Co-authored-by: Bell, Song <bell.song@intel.com>
2023-07-05 11:54:13 +04:00
Anastasia Kuporosova
71306e3b38
[PyOV] Model wrappers on Python side (#18368)
* model on py side

* work with diff types

* some tests fix

* try to fix test

* fix fe tests

* codestyle

* fix post commit
2023-07-05 11:44:04 +04:00
Katarzyna Mitrus
9fa1b858dc
[Spec] ScatterElementsUpdate-12 specification (#18025)
* ScatterElementsUpdate-12 init

* Update doc structure with ScatterElementsUpdate-12

* Update Operations_specifications.md

* Typos

* Update descriptions

* Add info about indices normalization

* Add info about negative axis normalization

* Add info about boolean type

* Missing coma and typo

* More examples and reduction descriptions

* Rename reduction "copy" to "none"

* Add more examples with values

* Mean mode and types clarification
2023-07-05 09:40:51 +02:00
Evgeny Kotov
0ab948a1d4
PropagateDownDisableSensitivityForQuantized Pad12 support (#18367)
* fix transformation

* fix clang
2023-07-05 11:29:58 +04:00
Evgeny Kotov
18caac366d
ConvertPadToGroupConvolution support Pad12 with positive indexes (#18301)
* fix transformations

* clang fix

* fix unit tests - check the both Pad versions

* add unit tests checking negative padding

---------

Co-authored-by: Ivan Tikhonov <ivan.tikhonov@intel.com>
2023-07-05 09:25:32 +02:00
Andrei Gorbachev
c58bf68bc8
[GPU] fix uninitialized scalar variable (#18199)
* fix uninitialized scalar variable

* fix get_default_params
2023-07-05 10:29:04 +04:00
Pawel Raasz
0081fd4655
Update setShape TensorMemoryBlob (#18364)
to be with sync with ITensor instance data pointer
2023-07-05 09:26:13 +04:00
Kelvin Choi
35e26906ed
[GPU] Update pad output shape for dynamic (#17995) 2023-07-05 04:22:49 +00:00
Eddy Kim
4c072ac4b5
[GPU] memory reuse for dynamic models (#18228)
* enable memory reuse for dynamic models

* updated to return dependant events for the shape_of primitive

* fixed memory_pool.release_memory()

* fixed a lint error

* fixed missing default value

* updated to use reset flag for dynamic models

* changed to use is_dynamic_output_layout instead of is_dynamic

* updated to use get_internal_params instread of buffer_ptr

* added a memory reuse test for dynamic models
2023-07-04 18:12:49 -07:00
Anastasia Kuporosova
8c648910dc
[PyOV] Expose api to Model class (#18141)
* [PyOV] Expose api to Model class

* assign op

* Update src/bindings/python/src/pyopenvino/graph/ops/assign.cpp

* add remove_ methids

* improve test

* codestyle

* assign operation

* codestyle

* test size

---------

Co-authored-by: Michal Lukaszewski <michal.lukaszewski@intel.com>
2023-07-04 21:54:06 +02:00
Ilya Churaev
7fc16c3295
Move OpenVINO core developers API to OpenVINO folder (#18360)
* Move openvino core developers API to OpenVINO folder

* Fixed GPU plugin

* Fixed code style
2023-07-04 22:14:53 +04:00
Anastasiia Pnevskaia
25ead3a09a
Added tools/ovc to PYTHONPATH for MO unit tests. (#18365)
* Added ovc to PYTHONPATH for MO unit tests.

* Small correction.

* Corrected PYTHONPATH for legacy FE layer tests.

* Corrected PYTHONPATH for TFL FE layer tests.
2023-07-04 22:12:19 +04:00
Anastasiya(Asya) Pronina
84d35ab6f9
Removed compile_tool and benchmark_app_legacy from OpenVINO repo (#18350) 2023-07-04 19:35:51 +04:00
Ilya Lavrenov
642c69115d
Support of protobuf >= 21 (#18351)
* Corrected typo

* Ability to compile with newer protobuf versions
2023-07-04 17:08:29 +04:00
Luwei Zhou
0b3a004825
[CPU] Combine DQ scales and multiply into DQ scales. (#17276)
* Fix the multible multiply case.

* Add test case.

* Fix CI issues.

* Fix the dynamic shape FC kernel creating issue.

* Expose FC weight with original linear layout to CPU graph.

* Apply review comments.

* Apply review comments.

* Applied review comments.
2023-07-04 13:38:25 +02:00
Mateusz Tabaka
2e9e6d2dd4
Preserve tensor legacy name in preprocessing (#18327)
* Preserve tensor legacy name in preprocessing

Ticket: CVS-113702

* supress deprecated
2023-07-04 15:01:15 +04:00
Alexandra Sidorova
211c56acf9
[CPU] Fixed naming in SwapConvertTranspose pass (#18208)
* [CPU] Fixed naming in SwapConvertTranspose pass

* Applied Vladislav comments
2023-07-04 13:34:07 +04:00
Karol Blaszczak
4cc70e22e5
[DOCS] menu bug fix (#18352) 2023-07-04 07:57:47 +00:00
Mateusz Bencer
c0035dfd9a
try to fix model zoo preprocessing (#18303) 2023-07-04 10:37:57 +04:00
Xiuchuan Zhai
454c8155fe
improve log check in PDFE (#17574)
* improve log check in PDFE

* add nullptr check
2023-07-04 09:21:02 +08:00
Mateusz Tabaka
64cecf2c7c
Optimize transpose reference implementation (#18137)
* Optimize transpose reference implementation

Signed-off-by: Mateusz Tabaka <mateusz.tabaka@intel.com>

* different approach for computing input offset

* use std::vector for rev_order

---------

Signed-off-by: Mateusz Tabaka <mateusz.tabaka@intel.com>
2023-07-03 21:27:43 +04:00