Commit Graph

9824 Commits

Author SHA1 Message Date
Konstantin Beluchenko
7f3f576151
[GPU] Permute 5d optimization (#14170) 2023-02-21 14:39:53 +09:00
Wang Wangwang
9e3b3e0566
Docs: Update the doc on execution devices property and enable_startup_fallback property (#14750)
* Docs: Update the doc on default hint and execution devices property (#14836)

* Docs: Update to LATENCY as default hint
* Docs: Update the doc on execution devices property
* Update auto_device_selection.md

Co-authored-by: Yuan Xu <yuan1.xu@intel.com>

* Update docs/OV_Runtime_UG/auto_device_selection.md

* Update docs/OV_Runtime_UG/auto_device_selection.md

* Update docs/OV_Runtime_UG/auto_device_selection.md

Co-authored-by: Yuan Xu <yuan1.xu@intel.com>

* Update docs/OV_Runtime_UG/auto_device_selection.md

Co-authored-by: Yuan Xu <yuan1.xu@intel.com>

* Update docs/OV_Runtime_UG/auto_device_selection.md

Co-authored-by: Yuan Xu <yuan1.xu@intel.com>

* Update docs/OV_Runtime_UG/auto_device_selection.md

* Update docs/OV_Runtime_UG/auto_device_selection.md

---------

Co-authored-by: Yuan Xu <yuan1.xu@intel.com>
2023-02-21 11:24:19 +08:00
Ilya Churaev
a5ec5f5476
Move template infer request (#15696)
* Move Template Infer Requests to new API

* Removed const_pointer_cast from plugin

* Fixed tests

* Fixed async tests

* Fixed some comments

* Added print ov::Tensor

* Fixed ONNX Frontend tests with multiple outputs to the same tensor

* Revert "Added print ov::Tensor"

This reverts commit b752f506bb.

* Fixed ov_core tests

* Fixed some tests

* Fixed batched tensors tests

* Fixed some tests

* Fixed more tests

* Fixed template plugin tests

* Fixed LP tests

* Fixed some comments

* Fixed some documentation issues

* Fixed comments

* Increase timeout because build termenated in case of common changes
2023-02-21 07:03:07 +04:00
Maxim Vafin
ce3ac296ae
[PT FE] Fix aten::len for empty lists (#15820)
* [PT FE] Fix aten::len for empty lists

* Fix code style
2023-02-20 21:34:04 +00:00
Haiqi Pan
1b147c3560
remove no-sign (#15817) 2023-02-20 20:34:23 +04:00
Maxim Vafin
cbd56c3ed9
[PT FE] Enable reverse infer (#15802)
* Enable reverse infer in PT FE

* Inherit channes from weight of convolution

* Except 1

* Add tests

* Add shape propagation for concat
2023-02-20 16:07:28 +01:00
Leonard Sikorski
5d3cd81fd1
Add aten::narrow operator with layer test (#15788) 2023-02-20 15:47:25 +01:00
Anastasiia Pnevskaia
c8c4503672
Error messages correcting in MO extractor (#15783)
* Error messages correcting.

* Error messages correcting.

* Small corrections.
2023-02-20 15:20:54 +01:00
Roman Kazantsev
bc8d0ec71e
[TF FE] Refactor ReverseSequence and add layer test (#15807)
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
2023-02-20 12:26:19 +00:00
Wang, Yang
1a070b225e
[AUTO] Failed to get the ov::model_name when loading network to target device is not ready (#15810)
* Return model name after loading network is ready.

* Update,
2023-02-20 12:16:18 +00:00
Roman Kazantsev
b75a3b3465
[TF FE] Implement layer test for GatherNd translator (#15813)
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
2023-02-20 12:58:52 +01:00
Tomasz Dołbniak
310c4deab9
Allow dynamic data type in NMS (#15684) 2023-02-20 09:01:43 +01:00
Ilya Lavrenov
758ebe5242
Removed cross-check-tool (#15778) 2023-02-20 11:09:08 +04:00
Roman Kazantsev
699a1d1708
[TF FE] Refactor Gather operations and add layer tests (#15808)
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
2023-02-20 11:02:42 +04:00
Xuejun Zhai
d9f0890a84
Xuejun/remove apis in ov node (#15803)
* [Remove APIs] remove get_default_value() in ov::Node

Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>

* [Remove APIs] remove set_op_annotations & get_op_annotations() in ov::Node

Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>

---------

Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>
2023-02-20 10:56:31 +04:00
Pawel Raasz
69728cb4ef
Use new evaluate in template plugin (#15753)
* Use new evaluate method in template plugin

* Add tensor at the end of each iteration

* Remove class TemporaryOverrideOutputs

* Set shape of tensor after evaluate

* Revert "Remove class TemporaryOverrideOutputs"

This reverts commit e345ba9188.

* Update tensors when evaluate passed

* Copy data Tensor when HostTensor was initialized

* Set shape to output tensor in TemporaryOverrideOutputs

* Fix code style

* Add test

* Remove unused code

* Create reshape with scalar when shape is empty

* Reshape, special_zero = true

* Revert "Create reshape with scalar when shape is empty"

This reverts commit 0f901f419a.

* Use Shape with size zero and value max_int for dynamic tensors

* Restore Shape{0} for dynamic tensors

* Revert "Restore Shape{0} for dynamic tensors"

This reverts commit cb2d0e58eb.

* Temporary remove the test

* Use shape{0} for dynamic tensors

* Revert "Use shape{0} for dynamic tensors"

This reverts commit 08460a486b.

* Use Shape{0} for dynamic tensors

* Use new evaluate in template plugin
- Add tensor conversion between ov::Tensor <-> HostTensor
- Add shape utils to create special case shape to be dynamic shape
- Utils are in dev API to remove duplicates

* Move WA for set shape into the ov::tensor.

* Remove dynamic shape from or_tensor helper

* Mark tensor conversion utils as deprecated
- move shape util as core internal only
- update transpose test to not use deprecated functions

* Add missing deprecate suppression macro

---------

Co-authored-by: Artur Kulikowski <artur.kulikowski@intel.com>
2023-02-20 10:50:42 +04:00
Yury Gaydaychuk
7cffe848d6
[Debug tool] Commit slider (#14571) 2023-02-20 10:46:43 +04:00
Xuejun Zhai
749ff8c93f
[Remove APIs] remove api set_data_shape (#15805)
Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>
2023-02-20 00:20:30 +04:00
Dohyun Kim (Felix)
b7bcef6864
[GPU] Improve OV_GPU_DumpLayers debug configuration (#15719)
Co-authored-by: Kim,SungEun <sungeun.kim@intel.com>
2023-02-19 14:57:19 +00:00
Ilya Lavrenov
1d5839fb92
Fixed compilation with clang (#15801) 2023-02-19 16:22:18 +04:00
River Li
9cc8bc882b
[CC]Add CC support for ir reader (#15659)
* Add CC support for ir reader

Change-Id: I3e1c02222800be090a4307bff8c231ad28b23ff7

* Fix clang issue

Change-Id: Idaf7bc5632bd558cfb7b0ecd8891435e5ba5c6ca
2023-02-18 15:43:19 +04:00
Oleg Pipikin
e9f060cce4
Remove WA for myriad plugin (#15786) 2023-02-18 12:42:44 +04:00
Evgenya Stepyreva
5f8f5b5eee
Fix TFL warnings (#15793) 2023-02-18 10:23:57 +04:00
Ilya Lavrenov
ed5fa69b41
Fixed compilation on CI (#15787) 2023-02-17 22:28:48 +04:00
Evgeny Kotov
04f300e187
Gather Sinking for Unary operations (#15289)
* initial

* fix year

* CanGatherPropagateForward review fix

* HasSameOutputGatherNodes fix code review

* fix namespaces code review

* fix ReverseGatherIndexes code review

* clang fixes

* clang fixes

* remove unneeded function

* move utils to utils dir + change namespace

* clang fixes

* windows build fixes

* resotore attr file

* resotore attr file

* code review fix
2023-02-17 18:36:22 +01:00
Roman Lyamin
efb51b058c
[GPU] Added operator== for cldnn primitives (#15736) 2023-02-17 19:09:12 +04:00
Ilya Churaev
59542d5cd3
Added header with itt macro (#15775) 2023-02-17 18:11:55 +04:00
Tomasz Jankowski
ed49d51ee1
[Transformations] Add Broadcast v3 nop-elimination (#15765)
* Nop-eliminate Broadcast v3

* Combine multi ops wrapper
2023-02-17 14:12:04 +01:00
Xuejun Zhai
91df0a8aa9
[API remove] remove variantImpl & variantwrapper related class/interfaces (#15580)
* [API remove] remove variantImpl & variantwrapper related class/interfaces

Signed-off-by: xuejun <xuejun.zhai@intel.com>

* [Remove APIs] fix code format issue

Signed-off-by: xuejun <Xuejun.Zhai@intel.com>

* [Remove api] fix python compiler issue caused by deprecated varient

Signed-off-by: xuejun <Xuejun.Zhai@intel.com>

* [Remove APIs] fix code format issue

Signed-off-by: xuejun <xuejun.zhai@intel.com>

---------

Signed-off-by: xuejun <xuejun.zhai@intel.com>
Signed-off-by: xuejun <Xuejun.Zhai@intel.com>
2023-02-17 16:31:26 +04:00
Pavel Esir
0f459c0455
[Core] fix compress_float_constants.cpp for denormal float16 (#15575)
* fix compress_float_constants.cpp for denormal float16

* keep denormals also in fp16; added unit-test

* fixed comment

* removed debug code; added some comments in unit-tests

* fix warning as error

* fix sign
2023-02-17 16:23:31 +04:00
Roman Kazantsev
7d13bc6861
[TF FE] Remove NormalizeL2 translator and refactor layer test (#15760)
It turned out that NormalizeL2 is absent in tf.raw_ops api
and always presented in the decomposed form.

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
2023-02-17 14:37:42 +04:00
Evgenya Stepyreva
eeed1f252a
TFLite vol.2 (#15698)
* Adds base class and first test for tflite_layer tests

* adds layer tests for unary ops

* adds functionality to get tensors from ops

* 1. adds functionality to use custom funcs for input generation
2. removed UNIQUE op from testing ops

* adds functionality to use custom dtypes

* Cast operation support

* Enhanced tfl layer tests

* Cast operation support

* Transpose Sinking: fix dummy case

* Supported 3 more ops: L2_NORMALIZATION, ARG_MAX, ARG_MIN

* Support scalar shapes

* Supported 1 more op: TRANSPOSE_CONV

* Supported 2 more ops: COMPLEX_ABS, RFFT2D (in combination)

* (DE)QUANTIZE as Identity. Questionable

* Trigger tfl layer tests in .ci

* Apply suggestions from code review

* empty constant support

* Commit as-is. Debug prints inside

* Not ready yet

* Style

* Comments resolved

* Style

* Dynamic shape support

* Style

---------

Co-authored-by: rnugmano <ruslan.nugmanov@intel.com>
Co-authored-by: missjane <estepyreva@gmail.com>
2023-02-17 10:30:16 +00:00
Roman Kazantsev
bd0dfbcd7a
[TF FE] Refactor OneHot translator and add layer test (#15763)
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
2023-02-17 13:54:40 +04:00
Edward Shogulin
50090ed03a
[Snippets] Linker issue fix in tests (#15346) 2023-02-17 13:13:04 +04:00
Ekaterina Aidova
225f9b3801
[PT FE]: fix aten::embedding realization for integer-like indicies an… (#15721)
* [PT FE]: fix aten::embedding realization for integer-like indicies and add tests

* more comments

* Update src/frontends/pytorch/src/op/embedding.cpp

Co-authored-by: Maxim Vafin <maxim.vafin@intel.com>

---------

Co-authored-by: Maxim Vafin <maxim.vafin@intel.com>
2023-02-17 08:09:46 +00:00
Vladislav Golubev
f03a3321fc
GraphComparator: stricter requirements for sinks mapping (#15633) 2023-02-17 11:33:20 +04:00
Chen Xu
ff75fdadf3
[CPU] Register printing utilities (#15423) 2023-02-17 11:23:09 +04:00
Shen, Wanglei
c0fa45a1b9
remove invalid KEY_EXCLUSIVE_ASYNC_REQUESTS (#15776) 2023-02-17 11:02:20 +04:00
Wang, Yang
a088d1ab7d
Disable core::set_property() to support ov::device::properties setting (#15175)
* Disable set_property() to support ov::device::properties setting.

* Update benchmark APP to set device properties through compile_model() instead of through set_property().

* Update.

* Update.

* Update some test case including ov::device::properties setting via core.ser_property().

* Since core.set_property() didn't support ov::device::properties setting, just remove the test case to check compile_model() works well if setting ov::device::properties via core.set_property() first.

* Update CompileModel in test name to CompiledModel

Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>

* Add corresponding test case.

Signed-off-by: Wang, Yang <yang4.wang@intel.com>

* Update.

* Update.

* Remove the changes of this commit as this modification has nothing to do
with this PR.

This reverts commit 4f04b9f085.

---------

Signed-off-by: Wang, Yang <yang4.wang@intel.com>
Co-authored-by: Chen Peter <peter.chen@intel.com>
Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>
2023-02-17 10:15:38 +04:00
Ilya Lavrenov
672522492e
Changed sample's format_reader libraries type from dynamic to static (#15756) 2023-02-17 09:30:19 +04:00
guozhong wang
f48a67acc9
Improve test coverage for auto_executable_network.cpp (#14693)
* add test case for device_bind_buffer

* Correct path to header file properties.hpp

* rename remote blob testcase with multi

* add test case for remote blob and device bind buffer

* add logs for debug

* disable test case RemoteBlobInitializedWithoutGPU

* add property for remote blob test case

* remove debug logs for bind_multi_schedule.cpp

* fix MultiDeviceMultipleGPU_Test fail

* add test case for oversubsciption of infer requests

* get optimal number to create inferRequests

* using macro ENABLE_INTEL_CPU to make sure tests need CPU

* fix the issue that canCreateRemoteTensorThenInferWithAffinity test case fails to run

* remove ov::hint::PerformanceMode::UNDEFINED from MultiDeviceMultipleGPU_Test
2023-02-17 11:45:28 +08:00
Roman Kazantsev
bce8b7a04c
[TF FE] Support auto-pruning for Iterator, IteratorGetNext, Queue and Lookup (#15731)
* [TF FE] Support auto-pruning for Iterator, IteratorGetNext, Queue and Lookup operations

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>

* Fix build

* Fix build issue

* Fix build issue

* Fix build issue: use TF NodeContext

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>

* Add hash_table translator

* Simplify code in translate session a bit and remove isolated Parameter nodes

* Update src/frontends/tensorflow/src/translate_session.cpp

---------

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
2023-02-17 07:34:09 +04:00
guozhong wang
12a706452c
improve auto_executable_network line coverage (#14871)
* add test case for get perf_hint from GetMetric

* Increase Mock GetMetric test sleep time

* add mock test case for getMetric

* add new test case OVAutoExecutableNetworkTest

* convert ov::Any to ov::hint::Priority

* resolve conflict of get_metric.hpp

* add macro ENABLE_INTEL_CPU for gpu test case and fix cases not getting instantiated for cpu test

* fix the issue of running Mock GetMetric test cases fail

* add perf_hint test cases to properties_tests.cpp

* Modify the logic of judging whether it is a single device in ctput mode
2023-02-17 11:30:17 +08:00
Wang, Yang
d89615ff9e
[AUTO] Enable AUTO compiledModel::get_property supporting its properties only. (#15003)
* Enable AUTO compiledModel::get_property supporting its properties only.

* Update.

* Update.

* Update some releated test cases.

* Update.

* Update related test case.

Signed-off-by: Wang, Yang <yang4.wang@intel.com>

---------

Signed-off-by: Wang, Yang <yang4.wang@intel.com>
Co-authored-by: Chen Peter <peter.chen@intel.com>
2023-02-17 11:27:51 +08:00
Wang Wangwang
d7f47aa122
Provide ENABLE_STARTUP_FALLBACK property to enable/disable CPU as acc… (#14503)
* Provide ENABLE_STARTUP_FALLBACK property to enable/disable CPU as acceleration

* Add more test cases to ENABLE_STARTUP_FALLBACK property

* Remove unnecessary config

* Remove plugin.hpp

* Update test case by PR#14754

* Update copyright

Co-authored-by: River Li <river.li@intel.com>

* Simplify using namespace

---------

Co-authored-by: Chen Peter <peter.chen@intel.com>
Co-authored-by: River Li <river.li@intel.com>
2023-02-17 11:15:07 +08:00
Mateusz Tabaka
829257510a
[Pruning] Handle Reshape with nonconstant second input with -1 or 0 dims (#15673)
Ticket: 100573
2023-02-16 23:48:15 +01:00
Irina Efode
414f7fc4f8
[CONFORMANCE] Fix small bug with hours && replace URL for models (#15771) 2023-02-16 22:20:01 +00:00
Irina Efode
b80a77683e
[CONFORMANCE] Enable ref cache if it exists (#15709)
* init

* Implement

* Final

* Update read_ir.cpp
2023-02-17 01:41:29 +04:00
Maxim Vafin
878e24d6f6
[PT FE] Better handle tensor names (#15718)
* Add debugNames, smartly handle tensor names, add TranslateSession

* Add friendly name specification in mark_node

* Fix code style

* Fix supported_impl logic

* Fix supported logic 2

* Optimize includes
2023-02-16 20:26:08 +01:00
Nadezhda Ageeva
0efa17f95c
HETERO move dumping dot files to separate file (#15758) 2023-02-16 18:10:41 +00:00