Commit Graph

9980 Commits

Author SHA1 Message Date
Wang Wangwang
d7f47aa122
Provide ENABLE_STARTUP_FALLBACK property to enable/disable CPU as acc… (#14503)
* Provide ENABLE_STARTUP_FALLBACK property to enable/disable CPU as acceleration

* Add more test cases to ENABLE_STARTUP_FALLBACK property

* Remove unnecessary config

* Remove plugin.hpp

* Update test case by PR#14754

* Update copyright

Co-authored-by: River Li <river.li@intel.com>

* Simplify using namespace

---------

Co-authored-by: Chen Peter <peter.chen@intel.com>
Co-authored-by: River Li <river.li@intel.com>
2023-02-17 11:15:07 +08:00
Mateusz Tabaka
829257510a
[Pruning] Handle Reshape with nonconstant second input with -1 or 0 dims (#15673)
Ticket: 100573
2023-02-16 23:48:15 +01:00
Irina Efode
414f7fc4f8
[CONFORMANCE] Fix small bug with hours && replace URL for models (#15771) 2023-02-16 22:20:01 +00:00
Irina Efode
b80a77683e
[CONFORMANCE] Enable ref cache if it exists (#15709)
* init

* Implement

* Final

* Update read_ir.cpp
2023-02-17 01:41:29 +04:00
Maxim Vafin
878e24d6f6
[PT FE] Better handle tensor names (#15718)
* Add debugNames, smartly handle tensor names, add TranslateSession

* Add friendly name specification in mark_node

* Fix code style

* Fix supported_impl logic

* Fix supported logic 2

* Optimize includes
2023-02-16 20:26:08 +01:00
Nadezhda Ageeva
0efa17f95c
HETERO move dumping dot files to separate file (#15758) 2023-02-16 18:10:41 +00:00
Roman Kazantsev
4a5452f29b
[TF FE] Optimize DynamicPartition translator (#15750)
* [TF FE] Optimize DynamicPartition translator

It avoid squared complexity to compute split lengths for each partition

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>

* WA a bug in Unique operation: not use axis

---------

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
2023-02-16 14:48:00 +00:00
Maksim Kutakov
3e32a9f2af
[CPU] Use static post ops in the FC node (#15104)
* Use static post ops in the FC node

* Minor fixes
2023-02-16 14:24:58 +01:00
Pawel Raasz
d32da828b4
Review scatter nd update class for shape inference aspects (#15610)
* Review interval shape and labels propagation

* Review shape infer template implementation
- add test for default ctor

* Add evaluate upper, lower and label
- add new default label evaluator which propagates labels
from inputs list

* default_label_evaluator for 0 input only is wrapper for
generic evaluator implementation

* Use default_label_evaluator in ScatterUpdate

* Fix build issues
2023-02-16 13:49:19 +01:00
Jade Cho
71cff0ae62
[GPU] Fix a bug of permute optimization (#15701)
* [GPU] Fix a bug of permute optimization

For int8 models, if there is FakeQuantize between permute and convolution, an operation like data type casting could be fused to permute. In this case, do not optimize permute.
2023-02-16 11:32:23 +00:00
Ryszard Jezierski
56f45acebb
Removed unused IRs from deprecated tests (#15706) 2023-02-16 10:27:41 +00:00
Tomasz Dołbniak
ab0f0da5b4
ONNX functions expanding (#15743) 2023-02-16 10:16:19 +01:00
Roman Kazantsev
1be090abfa
[TF FE] Add Const to Result removing transformation (#15739)
* [TF FE] Add Const to Result removing transformation

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>

* Add test model

* Optimize ConstToResultRemover

---------

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
2023-02-16 08:49:16 +01:00
Leonard Sikorski
fab35896cb
[PT FE ] Add aten::index_put_ operator with layer test (#15668) 2023-02-16 08:28:46 +01:00
Maciej Smyk
70cb829992
[DOCS] Move of developer documentation from wiki to md documents - master (#15372)
* CPU Plugin README creation

* debug capabilities

* Update debug_capabilities.md

* performance_analysis_ITT_counters

* cpu-emulation

* runtime_parameters_cache

* Update README.md

* internal_cpu_plugin_optimization

* See Also update for CPU Plugin

* See Also update for CPU Plugin 2

* intel_gpu

* Update README.md

* source code structure & See Also update for CPU plugin

* Update README.md

* See also update

* basic_data_structure

* memory_allocation_gpu_plugin

* Update memory_allocation_gpu_plugin.md

* simplified workflow

* graph optimization passes

* execution_of_inference

* GPU Plugin

* GPU Plugin fix

* Snippets

* Update README.md

* Update README.md

* fixes

* Snippets fix

* Update README.md

* component description

* Key Contacts

* Apply suggestions from code review

Co-authored-by: Ilya Churaev <ilyachur@gmail.com>

* Update src/plugins/intel_gpu/README.md

* Update src/plugins/intel_cpu/docs/internal_cpu_plugin_optimization.md

* Update src/plugins/intel_cpu/docs/internal_cpu_plugin_optimization.md

* Update src/plugins/intel_cpu/docs/internal_cpu_plugin_optimization.md

* Apply suggestions from code review

* Apply suggestions from code review

* Apply suggestions from code review

Text graphs to mermaid

* Update src/plugins/intel_gpu/docs/simplified_workflow.md

* Delete ov_intel_gpu_plugin_diagram.png

Removal of ov_intel_gpu_plugin_diagram.png file as the mermaid version is replacing it.

* Apply suggestions from code review

* Update src/common/snippets/README.md

---------

Co-authored-by: Sebastian Golebiewski <sebastianx.golebiewski@intel.com>
Co-authored-by: Ilya Churaev <ilyachur@gmail.com>
2023-02-16 11:03:11 +04:00
Taylor Yeonbok Lee
523b516835
[GPU] Support empty tensor (#15631)
* Support empty tensor in gpu plugin

* Common kernel setup for skipping

* Refactor

* Cleanup

* Fix for shape agnostic kernel

* Fix error due to memory allocation conflict for an empty input blob with other input blob

* Fix output blob parsing error

* Fixed quantize unittest error

* Fixed wrong TC

* Rename set_skip_kernels to update_kernels_list_to_skip

* Refactor output blob processing

* Applied review comments : more cleanup
2023-02-15 21:53:22 -08:00
Haiqi Pan
3f06d871bf
Remove catch(...) code style (#14433)
* remove ... in /src/bindings/c and resolve format

* remove ... in auto and resolve format

* remove ... in auto batch and resolve format

* remove ... in hetero and resolve format

* IE exception

* IE exception

* const

* const

* resolve format and ov::Exception

* ov::Exception

* reset IE::Exception

* remove ov::Exception

* InferenceEngine->IE in auto_schedule.cpp

* fix coredump while runing test case smoke_AutoMultiMock_NumStreamsAndDefaultPerfHintToHWTest

* fix coredump issue of running LoadNetworkWithSecondaryConfigsMockTest

* fix commpile fail in CI

* resolve core dump of running exec_network_get_metrics.cpp and disable some test cases for KEEMBAY and MYRIAD in exec_network_get_metrics.cpp

* remove test cases of MYRIAD and resolve core dump of running KEEMBAYin exec_network_get_metrics.cpp

* resolve conflic of common.h

* resolve conflic of common.h

* resolve common.h complie fail

---------

Co-authored-by: guozhong <guozhong.wang@intel.com>
Co-authored-by: Ilya Churaev <ilya.churaev@intel.com>
2023-02-16 11:44:24 +08:00
Sungeun Kim
0a224a8804
[GPU] Geti: Add jit value for fused_ops in strided_slice_ref (#15634)
* Add jit value for fused_ops in strided_slice_ref
* add test-cases for strided_slice_fusion
* add checking supported fusing ops for strided_slice
2023-02-16 12:12:54 +09:00
Andrew Kwangwoong Park
4028d83990
[GPU] Added shape agnostic optimized MVN kernel (#15603)
* [GPU] Added shape agnostic optimized MVN kernel

Signed-off-by: Andrew Park <andrew.park@intel.com>

* Apply code review

Signed-off-by: Andrew Park <andrew.park@intel.com>

* replace built-in log2 with function macro to calculate power from integer

Signed-off-by: Andrew Park <andrew.park@intel.com>

* Move compile-time JIT constants to cl code

Signed-off-by: Andrew Park <andrew.park@intel.com>

---------

Signed-off-by: Andrew Park <andrew.park@intel.com>
2023-02-16 02:51:01 +00:00
Taylor Yeonbok Lee
acced012d9
Minor fix for dynamic shape (#15745)
Should not reshape to 4D for < 4D tensor when new shape infer is used.
2023-02-16 01:02:53 +00:00
Roman Kazantsev
cabe75da1c
[TF FE] Refactor LogSoftmax translator and layer test (#15724)
* [TF FE] Refactor LogSoftmax translator and layer test

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>

* Work around for the legacy frontend

* Update src/frontends/tensorflow_common/src/op/log_softmax.cpp

---------

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
2023-02-15 20:36:46 +00:00
Wilson Seok
c186a56f35
fix mem_lock_type of get_sliced_mem() in loop (#15705) 2023-02-15 10:17:07 -08:00
Ekaterina Aidova
f8aae85183
[PT FE]: add more list construct transformations (#15614) 2023-02-15 16:39:27 +00:00
Roman Kazantsev
c6f7d7c98a
[TF FE] Refactor IdentityN translator and add layer test (#15727)
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
2023-02-15 15:18:18 +01:00
Ekaterina Aidova
13eca30081
[PT FE]: support aten::gelu with tanh approximate and tests (#15715) 2023-02-15 15:11:37 +01:00
jmiaskox
8839c66ea6
[AzurePipeline] Revert changes for openvino-lin-debian related to setupPython3.10 due to nGraph problem (#15728)
* Add env to nGraph step

* Update windows_conditional_compilation.yml

* Add PYTHONPATH to nGraph step

* Revert all changes related with setupPython 3.10 for Linux_debian

Temporary disable on time investigate
2023-02-15 16:00:34 +04:00
Roman Kazantsev
cb5c92f829
[TF FE] Refactor Squeeze and layer test (#15723)
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
2023-02-15 12:34:44 +01:00
Ekaterina Aidova
ba6b2609af
[PT FE]: update masked_fill support for multiple precisions (#15722) 2023-02-15 15:32:06 +04:00
Roman Kazantsev
ad20add992
[TF FE] Refactor Concat layer test and extend pre-commit (#15726)
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
2023-02-15 12:25:05 +01:00
Vladislav Golubev
fb3d785c06
[Snippets] [CPU] FMA Fusion (#8066) 2023-02-15 12:58:37 +04:00
Alexandra Sidorova
d73ee9e59b
[CPU] Optimize number of pass::Validate calls in postLPT, postSnipppets and CPUSpecificOpSet pass managers (#15596) 2023-02-15 09:08:12 +01:00
Ekaterina Aidova
55d667ce32
[PT FE] aten::to extend op support for device tracing case (#15712) 2023-02-15 09:04:09 +01:00
Ekaterina Aidova
38943434b6
[MO][PT FE] POC Integrate PT FE into MO convert_model (#15197)
* [WIP]: poc: integrate pt fe to mo.convert_model

* temporaly resolve names using signature inspection

* fix logic

* move to moc frontend

* add rank and data type setting

* add input signature

* apply comments

* move after convert processing

* support work without example_input, provide parameters description

* ignore extensions on fe side

* upd tests

* more tests

* add notes about extensions support and removing onnx path

* remove debug prints

* refactoring

* update BOM
2023-02-15 08:19:15 +01:00
Xiuchuan Zhai
36cb32a8f5
[CPU] Optimize shape_infer time of matmul (#15601)
* optimize shape infer of matmul

* remove some redundant check

* fix some comments

* fix some comments

* Update src/plugins/intel_cpu/src/nodes/matmul.cpp

fix an implicit bug

Co-authored-by: Maksim Kutakov <maxim.kutakov@gmail.com>

* Update src/plugins/intel_cpu/src/nodes/matmul.cpp

optimize by using OV RTTI instead of dynamic_pointer_cast

Co-authored-by: Maksim Kutakov <maxim.kutakov@gmail.com>

---------

Co-authored-by: Maksim Kutakov <maxim.kutakov@gmail.com>
2023-02-15 03:07:39 +01:00
Kelvin Choi
bd4d74d3dc
[GPU] Update TopK to support non const top_k input (#15429) 2023-02-14 13:51:24 -08:00
Irina Efode
4351c060f3
Fix conformance report (#15710)
* init

* [CONFORMANCE] Fix conformance reporting

* Revert "init"

This reverts commit 0e59ebd2fe.
2023-02-14 22:41:35 +01:00
Wilson Seok
60de5a3454
[GPU] fix getConstTensor() for 1d from [1,N,1,1] to [N,1,1,1] (#15569)
* fix getConstTensor() for 1d from [1,N,1,1} to [N,1,1,1]

* add eltwise comparison op in 1d constant check of eltwise arithmetic/logical
2023-02-14 13:02:22 -08:00
jmiaskox
dbed073f80
[CI][Azure Pipelines] Fix problem with UsePythonVersion task (#15619)
* Az pipeline

* Debug comment

* Update linux.yml

* Update linux.yml

* Add $Library

* Other version

* Update linux.yml

* Remove ld_library

* Update linux.yml

* Add neccesary variables and export LD_LIBRARY in sub task

* Fix problem windows_cc

Allow to download Python from GH Python registry

* Update linux.yml

Remove needless env and add export variable before scripts

* Correct syntax

* Debug: Use Ubuntu22.04 public image for MS hosted agent

Removed variables LD_LIBRARY_PATH and OV_PYTHON_VERSION

* Debug: Use Ubuntu22.04 public image for MS hosted agent

Removed variables LD_LIBRARY_PATH and OV_PYTHON_VERSION

* Update VM image

* Update linux.yml

Fast check if changing VM will help

* Correct wrong syntax in pool section

* update pool for lin_arm64 and linux_cc

* Revert changes with public VM

* Revert VM public in onnxruntime.yml

* Update windows_conditional_compilation.yml

* Update Python setup steps on Windows_CC

* Revert all changes related to win_cc
2023-02-15 00:05:53 +04:00
Ekaterina Aidova
5ead83f315
[PT FE]: fix sporaidic failure in pytorch layer tests (#15713) 2023-02-14 21:35:35 +04:00
Maxim Vafin
5cc1c2c5e5
Add support for aten::_set_item (#15643)
* Add support for aten::_set_item

* Update loop.cpp

* Update tests/layer_tests/pytorch_tests/test_set_item.py

Co-authored-by: Ekaterina Aidova <ekaterina.aidova@intel.com>

* Update test_set_item.py

* Apply code review comments

* Fix code style

* Update tests/layer_tests/pytorch_tests/test_set_item.py

---------

Co-authored-by: Ekaterina Aidova <ekaterina.aidova@intel.com>
2023-02-14 14:11:51 +01:00
Irina Efode
4009fa703c
[CONFORMANCE] Fix ReadMe according option (#15703) 2023-02-14 11:19:11 +00:00
Nadezhda Ageeva
4e5f79b4ea
[GNA]: QueryNetwork support (#13639)
Review comments

Refactor is_op_supported and apply review comments

Fix split checks

Remove split checks

Adjust 2dconv check

Rebase fixes, refactoring, applying comments
2023-02-14 12:17:07 +01:00
Tomasz Jankowski
c62be51cc1
[Transformations] Enable dynamic decomposition BTS and STB ops (#15179)
* Add dynamism for BatchToSpace conversion

* Extend dynamism for BatchToSpace conversion

Only block input needs to be const 'cse axes_order_const is freaky

* Enhace dynamism for BatchToSpace conversion

Block input need not be const now.

* Add dynamism for STB by elements conversion

* Remove const need for crops for BTS by_elements

* temp for review

* Try to fix output tensor overwrite

* Make test to reproduce invalid shape inference

* Reproduce the error with template plugin

* Fix code style

* Fix 0D inputs issue

* Remove 0D shape parts before Concat

* Apply nested namespaces

* Enable non-constant STB Block input

* Fix BTS runtime info

* Fix STB by elems runtime info

* Add dynamism for STB conversion

* Add BTS dynamic data test

* Add STB dynamic data test

* Reduce STB concats

* Add tests naming

* Edit

* style

* Consider other block element types

* Enhance type test

* Use opset10 only

* Check block shape
2023-02-14 14:45:10 +04:00
Evgeny Talanin
fac03ee5f7
Correct random number generation (#15644) 2023-02-14 11:16:49 +01:00
Dohyun Kim (Felix)
5853c78b7f
[GPU][DG2] Fix fusings_gpu/gemm_2in_act_scale_eltwise.basic/4 (#14888)
* Handle hsigmoid by hard_sigmoid
* add onednn_post_op_type::eltwise_hardsigmoid
2023-02-14 17:28:33 +09:00
Dohyun Kim (Felix)
dd0bf817b7
update (#15568) 2023-02-14 17:20:46 +09:00
Dohyun Kim (Felix)
148c7cc617
[GPU][DG2] Adjust expected fuse counts (#15592) 2023-02-14 17:20:07 +09:00
Haiqi Pan
67fff4adcc
Fix sign-compare warnings in PDPD FE (#15635)
* fix warnings in /paddle

* fix bmp_reader.c

* add -Wsign-compare

* fix code style

* fix sum.cpp

* remove paddle sign-compare

* fix return in input_model.cpp

* fix bmp_reader.c
2023-02-14 12:11:59 +04:00
Irina Efode
3d6474a4a3
[CONFORMANCE] Change Name of ReadIR tests and op serialization folder by subgraphsDumper (#15671)
* [CONFORMANCE] Change Name of ReadIR tests and opserialization

* remove  op_name from ir name

* remove extra file
2023-02-14 12:02:01 +04:00
Ilya Churaev
b80d05e0e1
Added classes for Sync and Async infer requests (#15387)
* Added classes for Sync and Async infer requests

* Changed hierarchy of Infer requests

* Fixed code style

* Fixed some tests

* Fixed naming style

* Fixed template plugin build

* Temporary disable python tests

* Revert "Temporary disable python tests"

This reverts commit c9aa9d79f8.

* Fixed template plugin tests

* Disable python tests

* Disable more steps

* Merged CI

* Revert "Merged CI"

This reverts commit 2f69574870.

* Try to fix segfault in python tests

* Remove default constructor

* Fixed documentation

* Fixed CPU tests

* Fixed Windows build

* Fixed comments

* Fixed build
2023-02-14 06:59:53 +04:00