Commit Graph

9801 Commits

Author SHA1 Message Date
Ilya Lavrenov
de1631d67d
Generalized OpenCL handling (#15253)
* Squashed commit of the following:

commit 62c992f6a0bc3a2f559faac6912be9c5632a359f
Author: Ilya Lavrenov <ilya.lavrenov@intel.com>
Date:   Sun Jan 22 11:38:18 2023 +0400

    Generalized OpenCL handling

* Updates

* Fixes

* Update thirdparty/CMakeLists.txt

test

* Fixed build with CL/cl2.hpp

* Fixes

* Fixes

* Fixed compilation flags

* Fixed build with target OpenCL 120

* Don't use cache
2023-02-03 15:36:47 +00:00
yanlan song
f5fb22e205
remove MYRIAD/HDDL related tests in auto/multi and re-enable unit tests on CI (#15485)
Signed-off-by: fishbell <bell.song@intel.com>
2023-02-03 15:58:04 +01:00
Nadezhda Ageeva
049cfcb72c
[nGraph]: fix fused names for ShuffleChannelsFusion transformation (#15150)
* [nGraph]: fix fused names for ShuffleChannelsFusion transformation

* Review comments
2023-02-03 12:45:12 +00:00
Pavel Esir
4103a931c2
[FP16] call marking for mixed precision inside ConvertPrecision (#14965)
* call marking for mixed precision inside ConvertPrecision

* fix typo in precisions list; moved conversion from f64->f32 to the very beginning

* remove obsolete convert_compressed_to_mixed_precision_test.cpp

* typo fix after merge

* corrected namespace prefix

* fixed align_mixed_fp32_fp16_types_test.cpp by removing redundant ConvertPrecision

* updated ConvertPrecison tests for mixed precision

* style fix
2023-02-03 13:47:57 +04:00
Karol Blaszczak
1e8144f21b
[DOCS] minor adjustments to Add. Res. sections in Install guide (#15462)
add to additional resources and change button formatting
2023-02-03 10:39:30 +01:00
Ilya Churaev
1bb8223ecd
Template ov plugin (#15220)
* Initial migration of TemplatePlugin to ov::IPlugin interface

* Fixed segfault

* Fixed static build and some template tests

* Fixed code style

* Fixed some template tests

* Fixed scale tests

* Disabled transformations in the template plugin

* Fixed ONNX tests

* Fixed compilation

* Fixed core tests

* Fixed some crashes

* Small fixes

* Migrate to ICompiledModel

* Fixed some behaviour tests (add legacy names and supported_properties)

* Fixed output precisions

* Fixed some tests

* Changed parameter->result test

* Fixed some preprocessing tests

* Added mean image preprocessing

* Disabled some tests

* Fixed some template tests

* Try to fix not implemented false

* Try to fix template tests

* Fixed doc

* Catch ov::NotImplemented exception

* Small changes

* Fixed build

* Try to fix build

* Fixed some comments

* Use new properties

* Fixed documentation

* Fixed properties
2023-02-03 13:37:40 +04:00
Pawel Raasz
1de937b66b
Fix tensor vector comparator for set (#15433) 2023-02-03 10:23:01 +01:00
Andrew Kwangwoong Park
ab509ce164
[GPU] Added shape agnostic optimized GEMM kernel (#15317)
* [GPU] Shape agnositc optimized gemm kernel

Signed-off-by: Andrew Park <andrew.park@intel.com>

* Fix CI failure

Signed-off-by: Andrew Park <andrew.park@intel.com>

* Apply code review

Signed-off-by: Andrew Park <andrew.park@intel.com>

* Fix dynamic shape accuracy drop on SQuAD v1.1

- F1: 91.81%, EM: 85.25% @bert-small-uncased-whole-word-masking-squad-0001

Signed-off-by: Andrew Park <andrew.park@intel.com>

* Apply code review

Signed-off-by: Andrew Park <andrew.park@intel.com>

---------

Signed-off-by: Andrew Park <andrew.park@intel.com>
2023-02-03 09:26:35 +04:00
hyunback kim
9d8532e998
[GPU] Use onednn fc/gemm in dGPU. (#15143)
* [GPU] Fix the functional issue using fc:onednn in bert model.

* The issue had happened when input dims are 3 with post-po eltwise.
* oneDNN FC out supports 2-dims only, so OV need to update output and post-op too.
* Fix ACC issue in b16 onednn FC. cldnn updates yxfb format in b16 for opt kernel, but no need in onednn.
* Remove W.A code for running fc cldnn.
* Support gemm primtiive and multi types ForceImplTypes
* Change env name OV_GPU_ForceImplTypes
* Do not change elstwise post-op shape from original node: it caused the ACC issue when multiple users.

Signed-off-by: hyunback <hyunback.kim@intel.com>
2023-02-03 09:58:00 +09:00
Mingyu Kim
e9a208501b
[GPU] Add layout supports for shuffle_channels (#15400)
* [GPU] Add layout supports for shuffle_channels
2023-02-03 09:52:40 +09:00
Ekaterina Aidova
cd340301d8
[PT FE]: support prim::min, prim::ListConstruct as output and fix aten::getitem for prim::ListConstruct (#15470) 2023-02-02 22:36:07 +00:00
Maxim Vafin
3c919134b1
Fix issue with If and bool type (#15457) 2023-02-02 22:32:40 +01:00
Irina Efode
8c428d2e1c
Extend Parallel runner to work in hybrid mode in case cache is not relevant (#15471)
* Extend Parallel runner to work in hybrid mode in case cache is not relevant

* small refactoring

* Fix mistakes
2023-02-03 00:19:13 +04:00
Bartek Szmelczynski
566fae2b01
Add aten stack transformation (#15311)
* add support for aten::stack

* add new lines

* updated aten stack transformation

* add comments to the code

---------

Co-authored-by: Maxim Vafin <maxim.vafin@intel.com>
Co-authored-by: Andrei Kochin <andrei.kochin@intel.com>
2023-02-02 20:15:28 +01:00
Roman Kazantsev
d8dfcac729
[TF FE] Refactor translators for Reduce ops and add layer tests (#15452)
* [TF FE] Refactor translators for Reduce ops and add layer tests

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>

* Correct number of inputs

* Use already implemented logical operations tests

---------

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
2023-02-02 18:24:31 +01:00
Mang Guo
9e83b081f4
Add gather lpt transformation (#14597)
* Add gather lpt transformation

* Add per-channel gather lpt dequantization support

* Fix review comments

* Add GPU test case

* Fix clang-format error gpu case  build error

* Fix comments

* Fix clang-format check fail

* Update docs

* Fix comments

* Add Gather opset1 quantization support
2023-02-02 16:13:52 +01:00
Roman Kazantsev
d86ba0742c
[TF FE] Refactor ExtractImagePatches and add tests (#15456)
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
2023-02-02 15:28:31 +01:00
Vitaliy Urusovskij
8e5ec19d05
Add IE_BUILD_POSTFIX to FE_LIB_SUFFIX (#15461) 2023-02-02 17:29:27 +04:00
Roman Kazantsev
2fd9026289
[TF FE] Refactor ExpandDims translator and add tests (#15454)
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
2023-02-02 16:43:45 +04:00
Nikolay Shchegolev
d167f4c733
[CPU] MEMC loading failed RuntimeError: There should be only one inst… (#15380)
* [CPU] MEMC loading failed RuntimeError: There should be only one instance of RegistersPool per thread.

* Fixes as per comments.
2023-02-02 16:10:21 +04:00
Katarzyna Mitrus
5388a6f2af
[ShapeInference] GatherND improvements review (#15416)
* GatherND shape infer base refactor

* Use accumulate for dims fusing

* Replace accumulate with for_each
2023-02-02 11:44:13 +01:00
yanlan song
15fa07eb5a
fix cases not getting instantiated (#15448)
Signed-off-by: fishbell <bell.song@intel.com>
2023-02-02 14:05:16 +04:00
Min, Byungil
7bdc9ec36b
[GPU] Optimize eltwise kernel for onednn formats (#15087)
+ Bugfix of eltwise_b_fs_yx_fsv16 kernel for int satuation
+ Add optimizing for fsv32, fsv16 using vload
+ Add optimizing for double blocked format eltwise
+ Support mixed format and broadcasting
+ Add test-cases to eltwise_gpu_test

Signed-off-by: Min, Byungil <byungil.min@intel.com>
2023-02-02 18:03:07 +09:00
Anastasiia Pnevskaia
347cd0e180
TF FE import model from memory (#15242)
* Added import model from memory for TF FE using string.

* Small correction.

* Clang format.

* Code correction.

* Implemented model importing to TF FE using temporary file.

* Removed wrong changes.

* Added check.

* Removed code duplication.

* Corrected logging of cli parameters.
2023-02-02 12:07:30 +04:00
Ilya Churaev
ae3bddd25c
Fixed cc build (#15446) 2023-02-02 11:24:18 +04:00
Xuejun Zhai
5030660b9f
Xuejun/fix cvs 98110 (#14534)
* [CAPI][UNITE TEST] 1) create plugin test xml file in runtime; 2) fix arm plugin test error;

Signed-off-by: xuejun <Xuejun.Zhai@intel.com>

* [CAPI] fix format issue

Signed-off-by: xuejun <Xuejun.Zhai@intel.com>

* [CAPI] change the time of Copyright

Signed-off-by: xuejun <Xuejun.Zhai@intel.com>

---------

Signed-off-by: xuejun <Xuejun.Zhai@intel.com>
2023-02-02 11:01:37 +04:00
Roman Lyamin
36df508baf
[GPU] Added shape agnostic ref kernels for Select and Activation (#15016)
* [GPU] Added Select shape agnostic support

* [GPU] Added Activation shape agnostic support
2023-02-02 10:08:36 +04:00
Taylor Yeonbok Lee
864b5075b7
Allocate output to host if it is to be used by other node's shape infer dependency, because it requires copy to host in shape inference. (#15386) 2023-02-02 06:32:49 +01:00
Vitaliy Urusovskij
29b15233c7
Remove OV_FRONTEND_PATH (#15364)
* Remove "OV_FRONTEND_PATH" from `FrontEndManager`

* Remove "OV_FRONTEND_PATH" from layer_tests

* Remove "OV_FRONTEND_PATH" from find_ie_version.py

* Remove "OV_FRONTEND_PATH" from .ci/

* Move `ov::get_plugin_path` to file_util.hpp (ov::util)

* Add `register_front_end(name, path)` FEM public API

* Enable frontend/ tests

* ClangFormat

* Remove OV_FRONTEND_PATH from FE shared utils

* Add `register_front_end()` to PythonAPI

* Update Py tests with registering of "mock_py" FE

* ClangFormat

* Leftovers

* Fix SegFault with `register_front_end(name, lib_path)`

* Add FE_LIB_PRE and FE_LIB_SUFFIX to `ov_core_unit_tests`

* Fix format

* Update `testFailRegisterFEByWrongPath`
2023-02-02 08:19:35 +04:00
Oleg Pipikin
2b86412f03
Fix sanitizer SEGV (#15435) 2023-02-02 08:12:27 +04:00
Maxim Vafin
92649105ed
Add eltwise types resolving. Support big int constants. (#15415)
* Add eltwise types resolving. Support big int constants.

* Update src/bindings/python/src/openvino/frontend/pytorch/decoder.py

* Small fix

* Fix some cases

* Add tests for add in different types

* Add tests for mul

* Add tests for sub and div

* Small fixes

* Return list handling (needed for empty lists)

* Add test for empty list

* Update src/frontends/pytorch/src/op/mul.cpp

Co-authored-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Use refs instead of ptrs

* Apply suggestions from code review

Co-authored-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Apply code review suggestions

* Fix code style

* Add more eltwise ops

---------

Co-authored-by: Roman Kazantsev <roman.kazantsev@intel.com>
2023-02-02 02:15:33 +01:00
Maxim Vafin
8051c2d535
Remove second call for UnrollIf (#15441) 2023-02-01 20:26:34 +00:00
Xiake Sun
302e5497dd
Docs/fix convert tf crnn model document (#14531)
* Fixed freezing tf1 pre-trained model issue due to mix use of tf1 and tf2 API
* Fix review comments
* Apply suggestions from code review
2023-02-01 20:36:48 +01:00
Tatiana Savina
6ac1636191
change extras description (#15279) 2023-02-01 20:10:48 +01:00
Taylor Yeonbok Lee
3910e0b2d0
[GPU] Use ocl for i32 dtype concat / enable_profiling for dump_profiling (#15419)
* Use ocl for i32 concat

* Enabling dgpu profiling
2023-02-01 20:08:58 +01:00
Sebastian Golebiewski
3e70a9206b
[DOCS] Restyling the documentation website - for master (#15409)
* tocsection css

* Update burger.svg
2023-02-01 19:47:01 +01:00
Michael Frank Hansen
631784730d
Docs ov 2022 3 Added results for Sapphire Rapids 6448Y. OV bench results and system config description (#15418)
fixes the FP32 and FP16 swap of results.

* SPR-6448Y updated results

Updated all files with data for SPR 6448Y. New results in benchmark-data.csv, benchmark-performance-data.xls, benchmark-info-detailed.xls and platform-list_22.3.pdf
2023-02-01 21:21:20 +03:00
Chenhu Wang
8fc4c2c6e1
[CPU]FC shape infer with an CPU shapeInfer object (#15092)
* with an shapeInfer object

* more efficient vector creation
2023-02-01 15:35:15 +01:00
Roman Lyamin
2d9a213ed6
[GPU] Added NV12toBGR single plane surface tests (#15417) 2023-02-01 18:26:39 +04:00
guozhong wang
1550a98bd2
Remove the redundant functions in the executable_network.cpp (#14909)
Co-authored-by: yanlan song <bell.song@intel.com>
2023-02-01 21:07:55 +08:00
Anastasia Kuporosova
ce287067d5
[PyOV] Change default opset9->opset10 (#15238) 2023-02-01 13:44:58 +01:00
Marcin Kusmierski
691ccad997
[GNA] Apply Style formatter (#15374)
* [GNA] Enable clang-format

* [GNA] apply fix for formatting

* [GNA] fixes to make code compilable after reformatting
2023-02-01 12:40:02 +01:00
Roman Kazantsev
ab2038041d
[TF FE] Add missed layer tests to nightly (#15424)
It needs to be tested on GPU

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
2023-02-01 11:31:16 +00:00
Mateusz Mikolajczyk
a769cfe7e8
[PT FE]: Add aten::view transformations (#15339) 2023-02-01 12:14:17 +01:00
Leonard Sikorski
cab559b478
[PT FE] Add aten::repeat_interleave operator (#15274) 2023-02-01 11:45:04 +01:00
Pavel Esir
da9470864c
[MO] add extractor for TF Any operation (#15255)
* added extractor for TF Any operation

* enabled existing 'Any' layer test for legacy TF frontend
2023-02-01 08:59:15 +04:00
Kelvin Choi
5bcfdf15df
[GPU] Fix reduce fs_b_yx_fsv16 bug for MIN and MAX mode (#15060) 2023-01-31 16:02:42 -08:00
Pawel Raasz
0da339a7f2
Use ov tensor in validation utils for bounds evaluation (#15252)
* Use ov::Tensor in are_equal

* Use ov::Tensor in bounds evaluation
- remove from node evaluates bounds for HostTensor
- update validation utils
- update operators

* Fix code style

* Fix windows compilation errors

* Fix windows compilation errors in scatter update

* Improve reshape output shape calculation
during shape infer

* Add common bound evaluator
- rename evaluate_bound_t -> evaluate_bound

* Fix code formatting

* Move bound evaluation util functions to dev API

* Fix compilation issues

* Remove from dev API not required bound eval
- extract bound eval functions to separate source

* Add missing doxygen comment

* Use ref evaluate in bounds calc for shape_of
because input data can have dynamic type and
create tensor is not possible and data type has
no meaning for shape calculation.
2023-01-31 19:18:28 +01:00
Ekaterina Aidova
d57862edee
[PT FE]: support transformation for case aten::size + aten::__getitem__ (#15368) 2023-01-31 19:08:13 +01:00
Leonard Sikorski
1dd84e2074
[PT FE] Add aten::unfold operator with layer test (#15316) 2023-01-31 18:29:32 +01:00