Commit Graph

9801 Commits

Author SHA1 Message Date
Ilya Lavrenov
ed5fa69b41
Fixed compilation on CI (#15787) 2023-02-17 22:28:48 +04:00
Evgeny Kotov
04f300e187
Gather Sinking for Unary operations (#15289)
* initial

* fix year

* CanGatherPropagateForward review fix

* HasSameOutputGatherNodes fix code review

* fix namespaces code review

* fix ReverseGatherIndexes code review

* clang fixes

* clang fixes

* remove unneeded function

* move utils to utils dir + change namespace

* clang fixes

* windows build fixes

* resotore attr file

* resotore attr file

* code review fix
2023-02-17 18:36:22 +01:00
Roman Lyamin
efb51b058c
[GPU] Added operator== for cldnn primitives (#15736) 2023-02-17 19:09:12 +04:00
Ilya Churaev
59542d5cd3
Added header with itt macro (#15775) 2023-02-17 18:11:55 +04:00
Tomasz Jankowski
ed49d51ee1
[Transformations] Add Broadcast v3 nop-elimination (#15765)
* Nop-eliminate Broadcast v3

* Combine multi ops wrapper
2023-02-17 14:12:04 +01:00
Xuejun Zhai
91df0a8aa9
[API remove] remove variantImpl & variantwrapper related class/interfaces (#15580)
* [API remove] remove variantImpl & variantwrapper related class/interfaces

Signed-off-by: xuejun <xuejun.zhai@intel.com>

* [Remove APIs] fix code format issue

Signed-off-by: xuejun <Xuejun.Zhai@intel.com>

* [Remove api] fix python compiler issue caused by deprecated varient

Signed-off-by: xuejun <Xuejun.Zhai@intel.com>

* [Remove APIs] fix code format issue

Signed-off-by: xuejun <xuejun.zhai@intel.com>

---------

Signed-off-by: xuejun <xuejun.zhai@intel.com>
Signed-off-by: xuejun <Xuejun.Zhai@intel.com>
2023-02-17 16:31:26 +04:00
Pavel Esir
0f459c0455
[Core] fix compress_float_constants.cpp for denormal float16 (#15575)
* fix compress_float_constants.cpp for denormal float16

* keep denormals also in fp16; added unit-test

* fixed comment

* removed debug code; added some comments in unit-tests

* fix warning as error

* fix sign
2023-02-17 16:23:31 +04:00
Roman Kazantsev
7d13bc6861
[TF FE] Remove NormalizeL2 translator and refactor layer test (#15760)
It turned out that NormalizeL2 is absent in tf.raw_ops api
and always presented in the decomposed form.

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
2023-02-17 14:37:42 +04:00
Evgenya Stepyreva
eeed1f252a
TFLite vol.2 (#15698)
* Adds base class and first test for tflite_layer tests

* adds layer tests for unary ops

* adds functionality to get tensors from ops

* 1. adds functionality to use custom funcs for input generation
2. removed UNIQUE op from testing ops

* adds functionality to use custom dtypes

* Cast operation support

* Enhanced tfl layer tests

* Cast operation support

* Transpose Sinking: fix dummy case

* Supported 3 more ops: L2_NORMALIZATION, ARG_MAX, ARG_MIN

* Support scalar shapes

* Supported 1 more op: TRANSPOSE_CONV

* Supported 2 more ops: COMPLEX_ABS, RFFT2D (in combination)

* (DE)QUANTIZE as Identity. Questionable

* Trigger tfl layer tests in .ci

* Apply suggestions from code review

* empty constant support

* Commit as-is. Debug prints inside

* Not ready yet

* Style

* Comments resolved

* Style

* Dynamic shape support

* Style

---------

Co-authored-by: rnugmano <ruslan.nugmanov@intel.com>
Co-authored-by: missjane <estepyreva@gmail.com>
2023-02-17 10:30:16 +00:00
Roman Kazantsev
bd0dfbcd7a
[TF FE] Refactor OneHot translator and add layer test (#15763)
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
2023-02-17 13:54:40 +04:00
Edward Shogulin
50090ed03a
[Snippets] Linker issue fix in tests (#15346) 2023-02-17 13:13:04 +04:00
Ekaterina Aidova
225f9b3801
[PT FE]: fix aten::embedding realization for integer-like indicies an… (#15721)
* [PT FE]: fix aten::embedding realization for integer-like indicies and add tests

* more comments

* Update src/frontends/pytorch/src/op/embedding.cpp

Co-authored-by: Maxim Vafin <maxim.vafin@intel.com>

---------

Co-authored-by: Maxim Vafin <maxim.vafin@intel.com>
2023-02-17 08:09:46 +00:00
Vladislav Golubev
f03a3321fc
GraphComparator: stricter requirements for sinks mapping (#15633) 2023-02-17 11:33:20 +04:00
Chen Xu
ff75fdadf3
[CPU] Register printing utilities (#15423) 2023-02-17 11:23:09 +04:00
Shen, Wanglei
c0fa45a1b9
remove invalid KEY_EXCLUSIVE_ASYNC_REQUESTS (#15776) 2023-02-17 11:02:20 +04:00
Wang, Yang
a088d1ab7d
Disable core::set_property() to support ov::device::properties setting (#15175)
* Disable set_property() to support ov::device::properties setting.

* Update benchmark APP to set device properties through compile_model() instead of through set_property().

* Update.

* Update.

* Update some test case including ov::device::properties setting via core.ser_property().

* Since core.set_property() didn't support ov::device::properties setting, just remove the test case to check compile_model() works well if setting ov::device::properties via core.set_property() first.

* Update CompileModel in test name to CompiledModel

Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>

* Add corresponding test case.

Signed-off-by: Wang, Yang <yang4.wang@intel.com>

* Update.

* Update.

* Remove the changes of this commit as this modification has nothing to do
with this PR.

This reverts commit 4f04b9f085.

---------

Signed-off-by: Wang, Yang <yang4.wang@intel.com>
Co-authored-by: Chen Peter <peter.chen@intel.com>
Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>
2023-02-17 10:15:38 +04:00
Ilya Lavrenov
672522492e
Changed sample's format_reader libraries type from dynamic to static (#15756) 2023-02-17 09:30:19 +04:00
guozhong wang
f48a67acc9
Improve test coverage for auto_executable_network.cpp (#14693)
* add test case for device_bind_buffer

* Correct path to header file properties.hpp

* rename remote blob testcase with multi

* add test case for remote blob and device bind buffer

* add logs for debug

* disable test case RemoteBlobInitializedWithoutGPU

* add property for remote blob test case

* remove debug logs for bind_multi_schedule.cpp

* fix MultiDeviceMultipleGPU_Test fail

* add test case for oversubsciption of infer requests

* get optimal number to create inferRequests

* using macro ENABLE_INTEL_CPU to make sure tests need CPU

* fix the issue that canCreateRemoteTensorThenInferWithAffinity test case fails to run

* remove ov::hint::PerformanceMode::UNDEFINED from MultiDeviceMultipleGPU_Test
2023-02-17 11:45:28 +08:00
Roman Kazantsev
bce8b7a04c
[TF FE] Support auto-pruning for Iterator, IteratorGetNext, Queue and Lookup (#15731)
* [TF FE] Support auto-pruning for Iterator, IteratorGetNext, Queue and Lookup operations

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>

* Fix build

* Fix build issue

* Fix build issue

* Fix build issue: use TF NodeContext

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>

* Add hash_table translator

* Simplify code in translate session a bit and remove isolated Parameter nodes

* Update src/frontends/tensorflow/src/translate_session.cpp

---------

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
2023-02-17 07:34:09 +04:00
guozhong wang
12a706452c
improve auto_executable_network line coverage (#14871)
* add test case for get perf_hint from GetMetric

* Increase Mock GetMetric test sleep time

* add mock test case for getMetric

* add new test case OVAutoExecutableNetworkTest

* convert ov::Any to ov::hint::Priority

* resolve conflict of get_metric.hpp

* add macro ENABLE_INTEL_CPU for gpu test case and fix cases not getting instantiated for cpu test

* fix the issue of running Mock GetMetric test cases fail

* add perf_hint test cases to properties_tests.cpp

* Modify the logic of judging whether it is a single device in ctput mode
2023-02-17 11:30:17 +08:00
Wang, Yang
d89615ff9e
[AUTO] Enable AUTO compiledModel::get_property supporting its properties only. (#15003)
* Enable AUTO compiledModel::get_property supporting its properties only.

* Update.

* Update.

* Update some releated test cases.

* Update.

* Update related test case.

Signed-off-by: Wang, Yang <yang4.wang@intel.com>

---------

Signed-off-by: Wang, Yang <yang4.wang@intel.com>
Co-authored-by: Chen Peter <peter.chen@intel.com>
2023-02-17 11:27:51 +08:00
Wang Wangwang
d7f47aa122
Provide ENABLE_STARTUP_FALLBACK property to enable/disable CPU as acc… (#14503)
* Provide ENABLE_STARTUP_FALLBACK property to enable/disable CPU as acceleration

* Add more test cases to ENABLE_STARTUP_FALLBACK property

* Remove unnecessary config

* Remove plugin.hpp

* Update test case by PR#14754

* Update copyright

Co-authored-by: River Li <river.li@intel.com>

* Simplify using namespace

---------

Co-authored-by: Chen Peter <peter.chen@intel.com>
Co-authored-by: River Li <river.li@intel.com>
2023-02-17 11:15:07 +08:00
Mateusz Tabaka
829257510a
[Pruning] Handle Reshape with nonconstant second input with -1 or 0 dims (#15673)
Ticket: 100573
2023-02-16 23:48:15 +01:00
Irina Efode
414f7fc4f8
[CONFORMANCE] Fix small bug with hours && replace URL for models (#15771) 2023-02-16 22:20:01 +00:00
Irina Efode
b80a77683e
[CONFORMANCE] Enable ref cache if it exists (#15709)
* init

* Implement

* Final

* Update read_ir.cpp
2023-02-17 01:41:29 +04:00
Maxim Vafin
878e24d6f6
[PT FE] Better handle tensor names (#15718)
* Add debugNames, smartly handle tensor names, add TranslateSession

* Add friendly name specification in mark_node

* Fix code style

* Fix supported_impl logic

* Fix supported logic 2

* Optimize includes
2023-02-16 20:26:08 +01:00
Nadezhda Ageeva
0efa17f95c
HETERO move dumping dot files to separate file (#15758) 2023-02-16 18:10:41 +00:00
Roman Kazantsev
4a5452f29b
[TF FE] Optimize DynamicPartition translator (#15750)
* [TF FE] Optimize DynamicPartition translator

It avoid squared complexity to compute split lengths for each partition

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>

* WA a bug in Unique operation: not use axis

---------

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
2023-02-16 14:48:00 +00:00
Maksim Kutakov
3e32a9f2af
[CPU] Use static post ops in the FC node (#15104)
* Use static post ops in the FC node

* Minor fixes
2023-02-16 14:24:58 +01:00
Pawel Raasz
d32da828b4
Review scatter nd update class for shape inference aspects (#15610)
* Review interval shape and labels propagation

* Review shape infer template implementation
- add test for default ctor

* Add evaluate upper, lower and label
- add new default label evaluator which propagates labels
from inputs list

* default_label_evaluator for 0 input only is wrapper for
generic evaluator implementation

* Use default_label_evaluator in ScatterUpdate

* Fix build issues
2023-02-16 13:49:19 +01:00
Jade Cho
71cff0ae62
[GPU] Fix a bug of permute optimization (#15701)
* [GPU] Fix a bug of permute optimization

For int8 models, if there is FakeQuantize between permute and convolution, an operation like data type casting could be fused to permute. In this case, do not optimize permute.
2023-02-16 11:32:23 +00:00
Ryszard Jezierski
56f45acebb
Removed unused IRs from deprecated tests (#15706) 2023-02-16 10:27:41 +00:00
Tomasz Dołbniak
ab0f0da5b4
ONNX functions expanding (#15743) 2023-02-16 10:16:19 +01:00
Roman Kazantsev
1be090abfa
[TF FE] Add Const to Result removing transformation (#15739)
* [TF FE] Add Const to Result removing transformation

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>

* Add test model

* Optimize ConstToResultRemover

---------

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
2023-02-16 08:49:16 +01:00
Leonard Sikorski
fab35896cb
[PT FE ] Add aten::index_put_ operator with layer test (#15668) 2023-02-16 08:28:46 +01:00
Maciej Smyk
70cb829992
[DOCS] Move of developer documentation from wiki to md documents - master (#15372)
* CPU Plugin README creation

* debug capabilities

* Update debug_capabilities.md

* performance_analysis_ITT_counters

* cpu-emulation

* runtime_parameters_cache

* Update README.md

* internal_cpu_plugin_optimization

* See Also update for CPU Plugin

* See Also update for CPU Plugin 2

* intel_gpu

* Update README.md

* source code structure & See Also update for CPU plugin

* Update README.md

* See also update

* basic_data_structure

* memory_allocation_gpu_plugin

* Update memory_allocation_gpu_plugin.md

* simplified workflow

* graph optimization passes

* execution_of_inference

* GPU Plugin

* GPU Plugin fix

* Snippets

* Update README.md

* Update README.md

* fixes

* Snippets fix

* Update README.md

* component description

* Key Contacts

* Apply suggestions from code review

Co-authored-by: Ilya Churaev <ilyachur@gmail.com>

* Update src/plugins/intel_gpu/README.md

* Update src/plugins/intel_cpu/docs/internal_cpu_plugin_optimization.md

* Update src/plugins/intel_cpu/docs/internal_cpu_plugin_optimization.md

* Update src/plugins/intel_cpu/docs/internal_cpu_plugin_optimization.md

* Apply suggestions from code review

* Apply suggestions from code review

* Apply suggestions from code review

Text graphs to mermaid

* Update src/plugins/intel_gpu/docs/simplified_workflow.md

* Delete ov_intel_gpu_plugin_diagram.png

Removal of ov_intel_gpu_plugin_diagram.png file as the mermaid version is replacing it.

* Apply suggestions from code review

* Update src/common/snippets/README.md

---------

Co-authored-by: Sebastian Golebiewski <sebastianx.golebiewski@intel.com>
Co-authored-by: Ilya Churaev <ilyachur@gmail.com>
2023-02-16 11:03:11 +04:00
Taylor Yeonbok Lee
523b516835
[GPU] Support empty tensor (#15631)
* Support empty tensor in gpu plugin

* Common kernel setup for skipping

* Refactor

* Cleanup

* Fix for shape agnostic kernel

* Fix error due to memory allocation conflict for an empty input blob with other input blob

* Fix output blob parsing error

* Fixed quantize unittest error

* Fixed wrong TC

* Rename set_skip_kernels to update_kernels_list_to_skip

* Refactor output blob processing

* Applied review comments : more cleanup
2023-02-15 21:53:22 -08:00
Haiqi Pan
3f06d871bf
Remove catch(...) code style (#14433)
* remove ... in /src/bindings/c and resolve format

* remove ... in auto and resolve format

* remove ... in auto batch and resolve format

* remove ... in hetero and resolve format

* IE exception

* IE exception

* const

* const

* resolve format and ov::Exception

* ov::Exception

* reset IE::Exception

* remove ov::Exception

* InferenceEngine->IE in auto_schedule.cpp

* fix coredump while runing test case smoke_AutoMultiMock_NumStreamsAndDefaultPerfHintToHWTest

* fix coredump issue of running LoadNetworkWithSecondaryConfigsMockTest

* fix commpile fail in CI

* resolve core dump of running exec_network_get_metrics.cpp and disable some test cases for KEEMBAY and MYRIAD in exec_network_get_metrics.cpp

* remove test cases of MYRIAD and resolve core dump of running KEEMBAYin exec_network_get_metrics.cpp

* resolve conflic of common.h

* resolve conflic of common.h

* resolve common.h complie fail

---------

Co-authored-by: guozhong <guozhong.wang@intel.com>
Co-authored-by: Ilya Churaev <ilya.churaev@intel.com>
2023-02-16 11:44:24 +08:00
Sungeun Kim
0a224a8804
[GPU] Geti: Add jit value for fused_ops in strided_slice_ref (#15634)
* Add jit value for fused_ops in strided_slice_ref
* add test-cases for strided_slice_fusion
* add checking supported fusing ops for strided_slice
2023-02-16 12:12:54 +09:00
Andrew Kwangwoong Park
4028d83990
[GPU] Added shape agnostic optimized MVN kernel (#15603)
* [GPU] Added shape agnostic optimized MVN kernel

Signed-off-by: Andrew Park <andrew.park@intel.com>

* Apply code review

Signed-off-by: Andrew Park <andrew.park@intel.com>

* replace built-in log2 with function macro to calculate power from integer

Signed-off-by: Andrew Park <andrew.park@intel.com>

* Move compile-time JIT constants to cl code

Signed-off-by: Andrew Park <andrew.park@intel.com>

---------

Signed-off-by: Andrew Park <andrew.park@intel.com>
2023-02-16 02:51:01 +00:00
Taylor Yeonbok Lee
acced012d9
Minor fix for dynamic shape (#15745)
Should not reshape to 4D for < 4D tensor when new shape infer is used.
2023-02-16 01:02:53 +00:00
Roman Kazantsev
cabe75da1c
[TF FE] Refactor LogSoftmax translator and layer test (#15724)
* [TF FE] Refactor LogSoftmax translator and layer test

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>

* Work around for the legacy frontend

* Update src/frontends/tensorflow_common/src/op/log_softmax.cpp

---------

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
2023-02-15 20:36:46 +00:00
Wilson Seok
c186a56f35
fix mem_lock_type of get_sliced_mem() in loop (#15705) 2023-02-15 10:17:07 -08:00
Ekaterina Aidova
f8aae85183
[PT FE]: add more list construct transformations (#15614) 2023-02-15 16:39:27 +00:00
Roman Kazantsev
c6f7d7c98a
[TF FE] Refactor IdentityN translator and add layer test (#15727)
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
2023-02-15 15:18:18 +01:00
Ekaterina Aidova
13eca30081
[PT FE]: support aten::gelu with tanh approximate and tests (#15715) 2023-02-15 15:11:37 +01:00
jmiaskox
8839c66ea6
[AzurePipeline] Revert changes for openvino-lin-debian related to setupPython3.10 due to nGraph problem (#15728)
* Add env to nGraph step

* Update windows_conditional_compilation.yml

* Add PYTHONPATH to nGraph step

* Revert all changes related with setupPython 3.10 for Linux_debian

Temporary disable on time investigate
2023-02-15 16:00:34 +04:00
Roman Kazantsev
cb5c92f829
[TF FE] Refactor Squeeze and layer test (#15723)
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
2023-02-15 12:34:44 +01:00
Ekaterina Aidova
ba6b2609af
[PT FE]: update masked_fill support for multiple precisions (#15722) 2023-02-15 15:32:06 +04:00
Roman Kazantsev
ad20add992
[TF FE] Refactor Concat layer test and extend pre-commit (#15726)
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
2023-02-15 12:25:05 +01:00