Commit Graph

9726 Commits

Author SHA1 Message Date
Roman Lyamin
014a35c3ce
[GPU] Added strided_slice shape agnostic kernel (#15477) 2023-02-06 13:03:00 +04:00
Roman Kazantsev
7845ca499e
[TF FE] Add layer test for Pack (#15518)
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
2023-02-06 08:49:29 +00:00
River Li
b04513c92e
[C API] remote tensor support (#13719)
* [C API] remote tensor support

Provide C interface for remote context and remote tensor:
   1. OCL and VA context and buffer support
   2. unite test for remote context and remote tensor

Change-Id: I2c449aef21cbe928ca470b4e3bcf1e03a1d1ca43

* Fix clang issue

Change-Id: I83c9592d21ff9cb8aeb85148277d96db74b455c7

* [CAPI] Add ocl nv12 input inference test case

1. Add fully nv12(2 ocl remote tensor) as input plus preprocess do csc+resize, then do inference
2. Add get_device_name for remote tensor
3. Add test case for preprocess to set mem type

Change-Id: Ieaab50c8de20e5c7258697030672e0b010627a81

* Update documentation

Change-Id: Ia7dbaea48d38f5534aba60fbb25cd0a1f2f9eab0

* Remove debug code

Change-Id: Ic5c5a24d3c40bb258b7007dcea44594af2d92344

* Fix issues brought by rebase

Change-Id: I2520c5ccf3620349e202ea40c08bb1c437d5af88

* Resolve document issue

Change-Id: Ia14500f8623147f481dda286a0afaa8ecfffa7c9

* Resolve some comments
1. Add specific header file for gpu plugin
2. clang-format issue
3. interface compatible issue

Change-Id: Icc4723af071af30f0422ac9a107e57ddeec94aac

* fix clang issue

Change-Id: I46e1fed3dd9a4e51260b695dc3fb194b9571ed58

* Add gpu header file directory

Change-Id: I8c15d9da58a46c070dcc68530cb2beea8cd4bba9

* Remove HAVE_OCL_SUPPORT macro

Change-Id: I10093a99c1858649f1c5502248729704fcec34ef

* Address some comments

Change-Id: I72830288d063623641e8946c8470631e81fdeb34

* Printov:AnyMmap with the help of ov::Any

Change-Id: I8abd3a8d94ba8116974c59a489cda2af15f225d7
2023-02-06 16:27:53 +08:00
Sergey Shlyapnikov
e003bf3af7
[GPU] Shape agnostic FC opt tiled kernel (#15396) 2023-02-06 12:17:55 +04:00
Sergey Shlyapnikov
cd48d76009
[GPU] Limit legacy fusions usage in Convolution kernels (#15465) 2023-02-06 12:08:22 +04:00
Sebastian Golebiewski
02a6d1a6b8
fix links (#15356) 2023-02-06 15:27:08 +08:00
Yuan Xu
9875c96b66
Add a disclaimer about CentOS for YUM install (#15453) (#15515)
* update step 3

* fix formatting

* fix formatting

* fix formatting

* test formatting

* change code to use sphinx directives

* fix formatting

* test formatting

* test formatting

* rewording

* test formatting

* test formatting

* test formatting

* move content to troubleshooting guide

* fix formatting

* fixes

* remove troubleshooting item and add a disclaimer

* add centos 7
2023-02-06 15:20:28 +08:00
Roman Kazantsev
3605b7de54
[TF FE] Add layer tests for If operation (#15512)
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
2023-02-06 11:16:02 +04:00
Roman Kazantsev
3d0a6a1d04
[TF FE] Refactor ListDiff translator and add layer test (#15499)
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
2023-02-06 11:08:36 +04:00
Kelvin Choi
8ed71a22fa
[GPU] Update ScatterNDUpdate Op to use ngraph shape infer (#15176) 2023-02-05 21:31:33 -08:00
Wang, Yang
3bfd07d535
[AUTO plugin] MULTI_DEVICE_PRIORITIES doesn't return device list by priority order from high to low (#14754)
* 1. Correct the device list by priority order from high to low.
2. Remove GNA, CUDA, HPU, HDDL, NVIDIA from device list supported by AUTO/MULTI.

Signed-off-by: Wang, Yang <yang4.wang@intel.com>

* Filter out supported device when not specify the candidate device for AUTO plugin.

* Add Debug MSG

* Update.

* Update AUTO mock test cases.

* Update.

* Update.

* Update code style.

---------

Signed-off-by: Wang, Yang <yang4.wang@intel.com>
Co-authored-by: Chen Peter <peter.chen@intel.com>
2023-02-06 10:09:54 +08:00
yanlan song
4ba30a4afa
enable tests (#15017)
Signed-off-by: fishbell <bell.song@intel.com>
2023-02-06 10:03:31 +08:00
Ilya Lavrenov
5cb23b9a74
Trying to fix debian packages (#15508)
* Trying to fix debian packages

* Added conflicts for samples for RPM
2023-02-04 15:35:20 +04:00
Ilya Lavrenov
fef775b981
Removed shellcheck suppression for GPU configure script (#15509) 2023-02-04 15:08:35 +04:00
Ilya Lavrenov
3e9ce31d19
Speed-up CC builds on Azure (#15248) 2023-02-04 14:46:24 +04:00
Ilya Lavrenov
5743805bd1
Added warning (#15505) 2023-02-04 14:32:52 +04:00
Jan Iwaszkiewicz
b94e8c2f25
[PyOV] Add ExecutionMode enum and property (#15497) 2023-02-04 13:10:44 +04:00
kyo
bb1e627623
Update README.md (#15504)
Just a small typo.
2023-02-04 12:06:53 +04:00
Ilya Churaev
b5fea2a5fd
Throw an exceptions in case of incorrect pointers in Model creation (#15492) 2023-02-04 12:05:57 +04:00
Zlobin Vladimir
52eefb8fb0
scripts/install_dependencies/install_NEO_OCL_driver.sh: code style (#15484)
* scripts/install_dependencies/install_NEO_OCL_driver.sh: code style

* scripts/install_dependencies/install_NEO_OCL_driver.sh: code style warnings

* scripts/install_dependencies/install_NEO_OCL_driver.sh: add missing !
2023-02-04 12:04:33 +04:00
Edward Shogulin
c1782d9e3d
[LPT] clang merge warning fix (#15502) 2023-02-03 21:21:23 +00:00
Roman Kazantsev
2cae7479a0
[TF FE] Refactor LinSpace translator and add layer test (#15495)
* [TF FE] Refactor LinSpace translator and add layer test

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>

* Remove start_shape from test parameters

---------

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
2023-02-03 20:14:47 +00:00
Roman Kazantsev
d9dbf23ea3
[TF FE] Refactor LeakyRelu and add layer tests (#15487)
* [TF FE] Refactor LeakyRelu and add layer tests

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>

* Support LeakyRELU for TensorFlow Lite

---------

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
2023-02-03 18:28:03 +01:00
Ilya Churaev
21fc5fbd75
Enable clone test after PR 15220 (#15481)
* Enable deep copy template test

* Disable unrol if transformation
2023-02-03 17:41:25 +01:00
Ilya Churaev
1935f3504d
Port PR 15475 (#15483) 2023-02-03 17:29:35 +01:00
Ilya Lavrenov
de1631d67d
Generalized OpenCL handling (#15253)
* Squashed commit of the following:

commit 62c992f6a0bc3a2f559faac6912be9c5632a359f
Author: Ilya Lavrenov <ilya.lavrenov@intel.com>
Date:   Sun Jan 22 11:38:18 2023 +0400

    Generalized OpenCL handling

* Updates

* Fixes

* Update thirdparty/CMakeLists.txt

test

* Fixed build with CL/cl2.hpp

* Fixes

* Fixes

* Fixed compilation flags

* Fixed build with target OpenCL 120

* Don't use cache
2023-02-03 15:36:47 +00:00
yanlan song
f5fb22e205
remove MYRIAD/HDDL related tests in auto/multi and re-enable unit tests on CI (#15485)
Signed-off-by: fishbell <bell.song@intel.com>
2023-02-03 15:58:04 +01:00
Nadezhda Ageeva
049cfcb72c
[nGraph]: fix fused names for ShuffleChannelsFusion transformation (#15150)
* [nGraph]: fix fused names for ShuffleChannelsFusion transformation

* Review comments
2023-02-03 12:45:12 +00:00
Pavel Esir
4103a931c2
[FP16] call marking for mixed precision inside ConvertPrecision (#14965)
* call marking for mixed precision inside ConvertPrecision

* fix typo in precisions list; moved conversion from f64->f32 to the very beginning

* remove obsolete convert_compressed_to_mixed_precision_test.cpp

* typo fix after merge

* corrected namespace prefix

* fixed align_mixed_fp32_fp16_types_test.cpp by removing redundant ConvertPrecision

* updated ConvertPrecison tests for mixed precision

* style fix
2023-02-03 13:47:57 +04:00
Karol Blaszczak
1e8144f21b
[DOCS] minor adjustments to Add. Res. sections in Install guide (#15462)
add to additional resources and change button formatting
2023-02-03 10:39:30 +01:00
Ilya Churaev
1bb8223ecd
Template ov plugin (#15220)
* Initial migration of TemplatePlugin to ov::IPlugin interface

* Fixed segfault

* Fixed static build and some template tests

* Fixed code style

* Fixed some template tests

* Fixed scale tests

* Disabled transformations in the template plugin

* Fixed ONNX tests

* Fixed compilation

* Fixed core tests

* Fixed some crashes

* Small fixes

* Migrate to ICompiledModel

* Fixed some behaviour tests (add legacy names and supported_properties)

* Fixed output precisions

* Fixed some tests

* Changed parameter->result test

* Fixed some preprocessing tests

* Added mean image preprocessing

* Disabled some tests

* Fixed some template tests

* Try to fix not implemented false

* Try to fix template tests

* Fixed doc

* Catch ov::NotImplemented exception

* Small changes

* Fixed build

* Try to fix build

* Fixed some comments

* Use new properties

* Fixed documentation

* Fixed properties
2023-02-03 13:37:40 +04:00
Pawel Raasz
1de937b66b
Fix tensor vector comparator for set (#15433) 2023-02-03 10:23:01 +01:00
Andrew Kwangwoong Park
ab509ce164
[GPU] Added shape agnostic optimized GEMM kernel (#15317)
* [GPU] Shape agnositc optimized gemm kernel

Signed-off-by: Andrew Park <andrew.park@intel.com>

* Fix CI failure

Signed-off-by: Andrew Park <andrew.park@intel.com>

* Apply code review

Signed-off-by: Andrew Park <andrew.park@intel.com>

* Fix dynamic shape accuracy drop on SQuAD v1.1

- F1: 91.81%, EM: 85.25% @bert-small-uncased-whole-word-masking-squad-0001

Signed-off-by: Andrew Park <andrew.park@intel.com>

* Apply code review

Signed-off-by: Andrew Park <andrew.park@intel.com>

---------

Signed-off-by: Andrew Park <andrew.park@intel.com>
2023-02-03 09:26:35 +04:00
hyunback kim
9d8532e998
[GPU] Use onednn fc/gemm in dGPU. (#15143)
* [GPU] Fix the functional issue using fc:onednn in bert model.

* The issue had happened when input dims are 3 with post-po eltwise.
* oneDNN FC out supports 2-dims only, so OV need to update output and post-op too.
* Fix ACC issue in b16 onednn FC. cldnn updates yxfb format in b16 for opt kernel, but no need in onednn.
* Remove W.A code for running fc cldnn.
* Support gemm primtiive and multi types ForceImplTypes
* Change env name OV_GPU_ForceImplTypes
* Do not change elstwise post-op shape from original node: it caused the ACC issue when multiple users.

Signed-off-by: hyunback <hyunback.kim@intel.com>
2023-02-03 09:58:00 +09:00
Mingyu Kim
e9a208501b
[GPU] Add layout supports for shuffle_channels (#15400)
* [GPU] Add layout supports for shuffle_channels
2023-02-03 09:52:40 +09:00
Ekaterina Aidova
cd340301d8
[PT FE]: support prim::min, prim::ListConstruct as output and fix aten::getitem for prim::ListConstruct (#15470) 2023-02-02 22:36:07 +00:00
Maxim Vafin
3c919134b1
Fix issue with If and bool type (#15457) 2023-02-02 22:32:40 +01:00
Irina Efode
8c428d2e1c
Extend Parallel runner to work in hybrid mode in case cache is not relevant (#15471)
* Extend Parallel runner to work in hybrid mode in case cache is not relevant

* small refactoring

* Fix mistakes
2023-02-03 00:19:13 +04:00
Bartek Szmelczynski
566fae2b01
Add aten stack transformation (#15311)
* add support for aten::stack

* add new lines

* updated aten stack transformation

* add comments to the code

---------

Co-authored-by: Maxim Vafin <maxim.vafin@intel.com>
Co-authored-by: Andrei Kochin <andrei.kochin@intel.com>
2023-02-02 20:15:28 +01:00
Roman Kazantsev
d8dfcac729
[TF FE] Refactor translators for Reduce ops and add layer tests (#15452)
* [TF FE] Refactor translators for Reduce ops and add layer tests

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>

* Correct number of inputs

* Use already implemented logical operations tests

---------

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
2023-02-02 18:24:31 +01:00
Mang Guo
9e83b081f4
Add gather lpt transformation (#14597)
* Add gather lpt transformation

* Add per-channel gather lpt dequantization support

* Fix review comments

* Add GPU test case

* Fix clang-format error gpu case  build error

* Fix comments

* Fix clang-format check fail

* Update docs

* Fix comments

* Add Gather opset1 quantization support
2023-02-02 16:13:52 +01:00
Roman Kazantsev
d86ba0742c
[TF FE] Refactor ExtractImagePatches and add tests (#15456)
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
2023-02-02 15:28:31 +01:00
Vitaliy Urusovskij
8e5ec19d05
Add IE_BUILD_POSTFIX to FE_LIB_SUFFIX (#15461) 2023-02-02 17:29:27 +04:00
Roman Kazantsev
2fd9026289
[TF FE] Refactor ExpandDims translator and add tests (#15454)
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
2023-02-02 16:43:45 +04:00
Nikolay Shchegolev
d167f4c733
[CPU] MEMC loading failed RuntimeError: There should be only one inst… (#15380)
* [CPU] MEMC loading failed RuntimeError: There should be only one instance of RegistersPool per thread.

* Fixes as per comments.
2023-02-02 16:10:21 +04:00
Katarzyna Mitrus
5388a6f2af
[ShapeInference] GatherND improvements review (#15416)
* GatherND shape infer base refactor

* Use accumulate for dims fusing

* Replace accumulate with for_each
2023-02-02 11:44:13 +01:00
yanlan song
15fa07eb5a
fix cases not getting instantiated (#15448)
Signed-off-by: fishbell <bell.song@intel.com>
2023-02-02 14:05:16 +04:00
Min, Byungil
7bdc9ec36b
[GPU] Optimize eltwise kernel for onednn formats (#15087)
+ Bugfix of eltwise_b_fs_yx_fsv16 kernel for int satuation
+ Add optimizing for fsv32, fsv16 using vload
+ Add optimizing for double blocked format eltwise
+ Support mixed format and broadcasting
+ Add test-cases to eltwise_gpu_test

Signed-off-by: Min, Byungil <byungil.min@intel.com>
2023-02-02 18:03:07 +09:00
Anastasiia Pnevskaia
347cd0e180
TF FE import model from memory (#15242)
* Added import model from memory for TF FE using string.

* Small correction.

* Clang format.

* Code correction.

* Implemented model importing to TF FE using temporary file.

* Removed wrong changes.

* Added check.

* Removed code duplication.

* Corrected logging of cli parameters.
2023-02-02 12:07:30 +04:00
Ilya Churaev
ae3bddd25c
Fixed cc build (#15446) 2023-02-02 11:24:18 +04:00