Commit Graph

10311 Commits

Author SHA1 Message Date
Andrew Kwangwoong Park
3ec386a741
[GPU] Minor fixes for dynamic BERT models (#16158)
* [GPU] Minor fix for dynamic bert-base-uncased-qqp

Signed-off-by: Andrew Park <andrew.park@intel.com>

* Fix to check full tensor only for static shape during creating onednn gemm

Signed-off-by: Andrew Park <andrew.park@intel.com>

---------

Signed-off-by: Andrew Park <andrew.park@intel.com>
2023-03-09 14:48:08 -08:00
Taylor Yeonbok Lee
dff7f2451b
Revert PR15386's change (#16172)
- Previously, PR15386 changed allocation of memory of primitives which are to be used as shape infer dep to host memory, for better shape infer perf.
- However this causes cache coherence issue in dGPU.
- Reverting this change so that the memory will be allocated to devicet
2023-03-09 22:44:32 +00:00
Mateusz Mikolajczyk
31489931cf
[PT FE] Fix failing translation of aten::index_put_ (#16140)
* Initial commit

* Fix for reading processed list

* Format code

* Cleanup

* cleanup

* Cleanup

* cleanup test

* Add comment

* Add rt_info

* fix type

* Update src/frontends/pytorch/src/transforms/aten_index_put_replacer.cpp

Co-authored-by: Maxim Vafin <maxim.vafin@intel.com>

---------

Co-authored-by: Andrei Kochin <andrei.kochin@intel.com>
Co-authored-by: Maxim Vafin <maxim.vafin@intel.com>
2023-03-09 20:14:58 +00:00
Alina Kladieva
654f3d988f
Revert "Update open_model_zoo submodule (#16181)" (#16189)
This reverts commit a9cc52b462.
2023-03-09 20:10:47 +04:00
Roman Kazantsev
326aedb5f8
[TF FE] Support EmptyTensorList and TensorListPushBack operations (#16183)
* [TF FE] Support EmptyTensorList and TensorListPushBack operations

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>

* Rename a script to generate the test model

* Correct test model generating script

---------

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
2023-03-09 19:06:16 +04:00
Ryszard Jezierski
1051226fc9
Updated GNA lib version to 1906 (#16122) 2023-03-09 14:58:46 +00:00
Zlobin Vladimir
a9cc52b462
Update open_model_zoo submodule (#16181) 2023-03-09 17:06:19 +04:00
Pavel Esir
e43f606750
[LoadTime][MO] flush fp32 subnormals to zero at offline phase (#15929)
* flush fp32 subnormals to zero in IR

* style fix in test_offline_api.py

* simplified call of FlushFP32SubnormalsToZero: is called form offline_transformations.cpp

* reverted offline_transformations.py

* use fpclassify

* style-fix

* Update src/common/transformations/tests/common_optimizations/flush_fp32_subnormals_to_zero_test.cpp

Co-authored-by: Roman Kazantsev <roman.kazantsev@intel.com>

---------

Co-authored-by: Roman Kazantsev <roman.kazantsev@intel.com>
2023-03-09 16:21:28 +04:00
Maksim Proshin
f04507f56c
Added "accuracy" value for "preset" parameter (#16016)
Added "accuracy" value for "preset" parameter
2023-03-09 14:59:29 +04:00
Karol Blaszczak
94b533b284
Update OV_2023_models_supported.pdf (#16179) 2023-03-09 11:57:41 +01:00
River Li
474ea8a8e2
Fix minor build error in ubuntu 22.04 (#16171)
Change-Id: I15180787f3196001d00137664e22d71aff4d0b32
2023-03-09 10:02:36 +00:00
Ilya Churaev
5040f59c96
Use new CPUStreamsExecutor inside the old one (#16164) 2023-03-09 13:41:38 +04:00
Sungeun Kim
0365ebf5ad
disable test case: fusings_gpu/lrn_fp16_eltwise_activation.basic/7 (#16149) 2023-03-09 08:38:33 +00:00
Ilya Lavrenov
cc8295f27e
Fixed PT FE compilation with clang on macOS (#16173) 2023-03-09 12:32:02 +04:00
Mateusz Bencer
c7e479ff78
[ONNX FE] Improved a method of operators registration (#15990)
* initial version of implementation

* styles applied

* fixed and registration

* add more unit tests

* fixed and in legacy opset

* review remarks

* refactor of version name range
2023-03-09 07:22:06 +01:00
Jade Cho
aaeace9740
[GPU] Fix stable diffusion failure (#16052)
* [dGPU] Enable stable diffusion

+ Prevent to fuse swish into oneDNN reorder.
+ Makes concat explicitly if batch size is greater than 1 and the siblings are oneDNN impl.
2023-03-09 14:35:31 +09:00
Andrew Kwangwoong Park
b7ff3a1d64
[GPU] Added shape agnostic Pad kernel implementation (#16160)
Signed-off-by: Andrew Park <andrew.park@intel.com>
2023-03-08 15:36:43 -08:00
Ilya Lavrenov
3d52fc843a
Fixed RelWithDebInfo build (#16159) 2023-03-08 20:00:30 +04:00
Edward Shogulin
75c73a38f8
[nGraph] VisualizeTree cclang quick fix (#16155) 2023-03-08 19:36:25 +04:00
Ilya Lavrenov
c3b22af3f7
CoreImpl small refactoring (#16145)
* Small CoreImpl refactoring

* Removed cache_dirhandling from CPU plugin

* clang-format

* Fixed python tests

* Fix

* Fixed bugs in HETERO case

* Fixed clang-format and warnings in auto plugin

* Added import_export as capability for TEMPLATE plugin

* Commented throw exception from loaded_from_cache

* Fixed clang-formatof ro template plugin
2023-03-08 19:19:52 +04:00
Roman Kazantsev
f3e7e55968
[TF FE] Support multioutput body graph nodes (#16142)
This is a corner case because body graph nodes have named output ports.
This allows to support custom RetinaNet model.

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
2023-03-08 17:29:42 +04:00
Karol Blaszczak
3dbea43ef1
[DOCS] remove mentions of myriad throughout docs (#15690)
* remove ov::device::thermal

ov::device::thermal was only supported on myriad

* additional cleanup

* remove myriad from AUTO and MULTI

auto n multi n hetero

+ remove mentions of listing myriad devices

* two final fixes

* Update ov_auto.py

---------

Co-authored-by: Ilya Churaev <ilya.churaev@intel.com>
2023-03-08 17:29:08 +04:00
Vladimir Paramuzov
75b48f2153
[GPU] Changed impls cache key type to avoid hash collisions (#16130) 2023-03-08 16:09:55 +04:00
Tomasz Dołbniak
e5ef0fee8e
TopK base class cleanup (#16154) 2023-03-08 11:33:38 +00:00
Mateusz Bencer
50b76873e2
[ONNX] Fix external weights loading for the current dir path case (#16124) 2023-03-08 12:12:23 +01:00
Chenhu Wang
0786a963ab
[CPU] Remove unused emitter parameters and API (#16117) 2023-03-08 14:15:44 +04:00
Ekaterina Aidova
6514b7600a
[PT FE]: add translation for aten::cumsum (#16092)
* [PT FE]: add translation for aten::cumsum

* handle out and prim::dtype
2023-03-08 11:07:29 +01:00
Pawel Raasz
cd8999d43b
Fix tile shape inference when repeats got dynamic shape (#15792)
* fix shape infer when repeats got dynamic shape

* Dynamic output shape when repeats dim is dynamic
2023-03-08 11:21:58 +04:00
Ilya Churaev
7c8dc76223
Rename template config and move transformations to code snippets (#16133)
* Rename template config and move transformations to code snippets

* Fixed documentation

* Rename template config
2023-03-08 07:12:05 +00:00
Xiping Yan
68b8d41c43
[CPU]JIRA 93714 fix CPU plugin warning after remove wd4309 wd4018 (#15961)
* Remove warning suppression: wd4018, wd4309

Signed-off-by: Yan, Xiping <xiping.yan@intel.com>

* Remove linux warning suppression no-sign-compare

Signed-off-by: Yan, Xiping <xiping.yan@intel.com>

* ov::intel_cpu::VectorDims base value type is size_t;
dnnl::memory::dims base value type is int64_t;

All compare data up to int64_t can fix warning and there is potential issue.

Signed-off-by: Yan, Xiping <xiping.yan@intel.com>

* channelAxis maybe == -1; means: no exist any more.

Signed-off-by: Yan, Xiping <xiping.yan@intel.com>

* Fix recursive macro: "one_of", "everyone_is" sign-compare warning.
Must pass same value type.

Signed-off-by: Yan, Xiping <xiping.yan@intel.com>

* Fix Windows sign unsign compare warning

Signed-off-by: Yan, Xiping <xiping.yan@intel.com>

* There are 2 instances:

using ov::Dimension::value_type = int64_t
using ov::intel_cpu::StaticDimension::value_type = size_t

All up to int64.

Signed-off-by: Yan, Xiping <xiping.yan@intel.com>

* linux have too many sign-compare issue.
Complete windows sign-compare firstly.

Signed-off-by: Yan, Xiping <xiping.yan@intel.com>

* Fix clang issues.

Signed-off-by: Yan, Xiping <xiping.yan@intel.com>

* Fix warning.
Because instantiate T1=unsigned int, T2=int

Signed-off-by: Yan, Xiping <xiping.yan@intel.com>

* Fix warning for tests unit reorder_node_test.cpp

Signed-off-by: Yan, Xiping <xiping.yan@intel.com>

* Fix warning : ASSERT_GE(step, 1u);

Signed-off-by: Yan, Xiping <xiping.yan@intel.com>

* Fix tests: warning C4018

Signed-off-by: Yan, Xiping <xiping.yan@intel.com>

* Remove auto, using int64_t is more reasonable.

Signed-off-by: Yan, Xiping <xiping.yan@intel.com>

---------

Signed-off-by: Yan, Xiping <xiping.yan@intel.com>
2023-03-08 10:41:00 +04:00
hyunback kim
a9cbccd829
Broadcast for post ops enable enable onednngemm (#16074)
* [GPU] Add data broadcasting for OneDNN binary ops for Gemm primitive
* Based on https://github.com/openvinotoolkit/openvino/pull/15790 and enable onednn gemm from support multiple users and non constant input.

--------

Signed-off-by: hyunback <hyunback.kim@intel.com>
Co-authored-by: Sergey Shlyapnikov <sergey.shlyapnikov@intel.com>
2023-03-08 13:55:51 +09:00
Roman Lyamin
681faadce3
[GPU] Added shape agnostic kernels for GatherElements and Tile (#15798)
* [GPU] Added shape agnostic kernel for GatherElements

* [GPU] Added shape agnostic kernel for Tile
2023-03-08 08:34:24 +04:00
Mateusz Mikolajczyk
b907bfab3b
[PT FE] Fix for prim::Constant tensor with int/float values (#16029)
* Fix constant

* Change

* Remove duplicated code

* Add tests
2023-03-07 20:54:18 +00:00
Sebastian Golebiewski
1bd1eca8d9
[DOCS] Integrate OpenVINO with your application article - add TF Lite (#16020)
* fix snippets

* add tflite

* update tab directives

* Update integrate_with_your_application.md
2023-03-07 23:01:56 +04:00
Maxim Vafin
feb448cc89
Fix MO IR Reader for Eye op (#15996)
* Fix MO IR Reader for Eye op

* Fix eye value infer

* Remove debug output

* Add test for eye value infer

* Fix bom tests

* Fix alphabetical order
2023-03-07 20:30:14 +04:00
Mateusz Mikolajczyk
6358974c1a
[PT FE] Add prim::PythonOp (#15714)
* Add PythonOp

* Fix deprecation & cleanup

* Apply suggestions from code review

* Fix dtype

* Apply suggestions from code review

Co-authored-by: Maxim Vafin <maxim.vafin@intel.com>

* Update to new tensor names handling

* Fix negation

* Apply changes from code review

* Remove unnecesary imports

* Update src/frontends/pytorch/src/op/pythonop.cpp

Co-authored-by: Maxim Vafin <maxim.vafin@intel.com>

---------

Co-authored-by: Maxim Vafin <maxim.vafin@intel.com>
2023-03-07 17:20:13 +01:00
Szymon Irzabek
e79636bfbb
[GNA] Add 3.6 and 4.0 targets (#15735) 2023-03-07 17:14:59 +01:00
Tatiana Savina
cf7dfff35f
delete dlwb imgs (#16066) 2023-03-07 16:05:32 +01:00
Maxim Vafin
82584543ba
[PT FE] Support set/get element type, shape and value in PyTorch FE InputModel (#16100)
* Support setting and getting element type, shape and value in PyTorch FE InputModel

* Fix code style

* Fix code style

* Fix rsub layer test

* Fix py style

* Apply review feedback

* Fix code style

* Fix initial values of input and output flags in Place
2023-03-07 15:45:29 +01:00
Liubov Talamanova
e6ad0a5154
[POT] Removed Multiply from ignored ops for transformers (#15600)
* [POT] Removed Multiply from ignored ops for transformers

* Add VPU to change_configurations_by_model_type
2023-03-07 14:37:29 +00:00
Ilya Lavrenov
15e43e0cc2
Removed explicitl handling for cache_dir from GNA (#16134) 2023-03-07 13:42:56 +00:00
Vladimir Paramuzov
a1eb76ad06
[GPU] Move is_local_block_io_supported WA to kernel selector (#15235) 2023-03-07 15:12:08 +04:00
Zhang Yi
6fbaf4745a
[CPU ]Fix bf16 marking logic & remove useless convert (#15404) 2023-03-07 10:02:14 +00:00
Ilya Churaev
4cea80915d
Added CI documentation (#16129) 2023-03-07 12:55:36 +04:00
Nadezhda Ageeva
0dad7749b5
Fix RTInfo for ReduceL2Decomposition (#16107)
* Fix RTInfo for ReduceL2Decomposition

* Review comments
2023-03-07 10:24:55 +04:00
Min, Byungil
87b18a21c1
[GPU] Optimize eltwise kernel for blocked format (#15717)
* [GPU] Optimize eltwise kernel for blocked format

+ Optimize etlwise_blocked_opt
+ Replace deprecated kernels with eltwise_blocked_opt
+ Remove eltwise_b_fs_yx_fsv16, b_fs_yx_fsv4 kernels
+ Add test-cases in eltwise_gpu_test

Signed-off-by: byungilm <byungil.min@intel.com>
2023-03-07 14:21:09 +09:00
Vladimir Paramuzov
eff0bce7e3
[GPU] Move some op parameters from node to primitive class (#16070)
* [GPU] Move parameters of conv and quantize primitive from node to primitive

---------

Co-authored-by: Eddy Kim <eddy.kim@intel.com>
2023-03-07 08:56:00 +04:00
Mateusz Bencer
e77adca01f
Fix sign-compare warnings in ONNX FE (#16125)
* editor.cpp

* fix scan.cpp

* fix place.cpp

* fix tensor_external_data.cpp

* fix editor.cpp

* remove no-sign

* add sign-comare in os_flags.cmake

* fix place.cpp

* fix tensor_external_data.cpp

* remove sign-compare

* fix onnx_transformations.cpp

* fixed get_input_port + refactor

---------

Co-authored-by: haiqi <haiqi.pan@intel.com>
2023-03-07 08:15:56 +04:00
Wang, Yang
4d3dcfc5d4
Enable AUTO to support execution mode hint. (#15595)
* Enable AUTO to support execution mode hint.

Signed-off-by: Wang, Yang <yang4.wang@intel.com>

* Add test case.

* Set default value "PERFORMANCE" for ov::hint::execution_mode.

* Update.

* Update.

* Correct default ov::hint::execution_mode value for the default value checking test case.

* Update.

* Delete obsolete config.hpp file.

---------

Signed-off-by: Wang, Yang <yang4.wang@intel.com>
2023-03-07 11:58:14 +08:00
River Li
4d7bffa593
[UT][AUTO_BATCH]auto batch plugin unit test (#15211)
* Init auto_batch plugin unit test

* Add more mock test

* Add to ci yml file

* Fix clang issue

* Resolve compilation issue

* Fix symbol multiple definition in static build

* Add test cases for AutoBatchInferRequest

* Add test cases for AutoBatchAsyncInferRequest

* qFixed build error after PR-15229

* Resolve blocked issue when call StartAsync test cases

* add more test for auto batch async inference

---------

Co-authored-by: Chen Peter <peter.chen@intel.com>
2023-03-07 11:55:26 +08:00