Commit Graph

10365 Commits

Author SHA1 Message Date
Karol Blaszczak
f4da729a19
[DOCS] prerelease notes 0329 (#16584) 2023-03-29 11:27:12 +02:00
Yuan Hu
75c62ea320
[CPU] optimize shape infer of Reshape (#16537)
* add reshape shapeinfer in cpu plugin

Signed-off-by: Hu Yuan2 <yuan2.hu@intel.com>

* add squeeze and unsqueeze

Signed-off-by: Hu Yuan2 <yuan2.hu@intel.com>

* add precision i8 i64 on test

Signed-off-by: Hu Yuan2 <yuan2.hu@intel.com>

* fix code out of bounds risk

Signed-off-by: Hu Yuan2 <yuan2.hu@intel.com>

* test performance of this PR

Signed-off-by: Hu Yuan2 <yuan2.hu@intel.com>

* fix code issue

Signed-off-by: Hu Yuan2 <yuan2.hu@intel.com>

* Revert "test performance of this PR"

This reverts commit f4f9f002de28d03bc1c55c24067f75b74824904c.

* fix reviewer comment

fix throw message
not create ov::shape instance
remove i8 test case

Signed-off-by: Hu Yuan2 <yuan2.hu@intel.com>

* fix pytorch layer test failed issue

inputShape(1,0) outpattern(-1) is a valid input

Signed-off-by: Hu Yuan2 <yuan2.hu@intel.com>

* fix windows compile issue

Signed-off-by: Hu Yuan2 <yuan2.hu@intel.com>

* fix rebase mistaken

Signed-off-by: Hu Yuan2 <yuan2.hu@intel.com>

---------

Signed-off-by: Hu Yuan2 <yuan2.hu@intel.com>
2023-03-29 11:26:49 +02:00
Tingqian Li
05ab0f32d7
[CPU] Simple fix of redundant const-weight reordering for brgconv node in dynamic model (#16305) 2023-03-29 10:27:08 +02:00
Mateusz Tabaka
556d469f6b
[PADDLE] add paddle opextension support (#16439)
* add opextension support

* support opconversion

* fix test contructor ambiguous

* fix ci fail

* add tag to avoid compiler ambiguous

* move tests to layer_tests & remove PaddleTag

* static cast

* use create_ov_node_by_name

---------

Co-authored-by: Luo Cheng <cheng.luo@intel.com>
2023-03-29 12:23:47 +04:00
Roman Kazantsev
35e03d33bb
[TF FE] Support frozen models in text protobuf format aka pbtxt (#16604)
* [TF FE] Support frozen models in Text Protobuf format aka pbtxt

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>

* Fix gen_wrapper.py for pbtxt

* Fix is_supported method

* Fix gen_wrapper.py script

* Adopt test_text_frozen_format unit-test

* Update src/frontends/tensorflow/src/frontend.cpp

* Update src/frontends/tensorflow/src/frontend.cpp

---------

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
2023-03-29 11:58:08 +04:00
Min, Byungil
7a95830d24
[GPU] Disable failed onednn tests (#16614)
* Resolved failed unit-tests for fully connected

Signed-off-by: Min, Byungil <byungil.min@intel.com>
2023-03-29 15:53:04 +09:00
Min, Byungil
ea6e3481cd
[GPU] Fix failed onednn tests (#16410)
* Fix failed unit-tests on dGPU

+ modified fully_connected_random_test_i8_3d not to have ambiguous
+ oneDNN does NOT support i64 type for reorder. Added exception.
+ bugfix in prepare_primitive_fusing about exception of activation function
+ Add exception logic for dynamic to select ocl type in is_node_for_onednn

Signed-off-by: Min, Byungil <byungil.min@intel.com>
2023-03-29 15:50:09 +09:00
Roman Kazantsev
966c47e7cd
[MO] Remove Python version check (#16612)
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
2023-03-29 09:23:14 +04:00
Katarzyna Mitrus
f7891aa034
[Interpolate-11] Reference implementation for Interpolate-11 (#16342)
* Reference impl for interpolate-11 init

* ND support init

* Tests clean up

* Add evaluate method for Interpolate-11

* New version tests init

* Type parametrized tests

* Tests duplication clean up and reusage of v4 test cases

* Add clipping to the type bounds

* Style fix

* Add float type tests

* Fix default ports values

* Commented code clean up

* Add passing cube_coeff param

* Tests clean up

* Add separate namespace

* Adjust variable names

* Adjust function name

* Use vectors instead of raw ptrs

* update func to static inline

* Adjust types

* Add Interpolate-11 to template plugin evaluates map

* Revert interpolate-11 core evaluate support

* Use const ref to filter

* Use static cast

* Update link
2023-03-29 07:11:56 +02:00
Taylor Yeonbok Lee
daf562832f
[GPU] Fix malfunction in crop static kernel in dynamic shape scenario (#16586)
* Fix malfunction in crop static kernel in dynamic shape execution

* Add unittest

* Fix lint errort
2023-03-29 04:19:24 +00:00
Sergey Shlyapnikov
6c766a81b5
[GPU] Treat warnings C4267 as errors for Windows (#16345) 2023-03-28 22:56:47 +00:00
Mateusz Tabaka
b82bedd648
Add Conversion and Op Extension to Pytorch frontend (#16434)
Tickets: 98766 and 98767
2023-03-29 00:25:29 +02:00
Wilson Seok
79b267033c
[GPU] Fix program::replace() to copy duplicated connection from single constant (#16529)
* fix program::replace() to copy duplicated connection from single constant

* add unit test

* modified with review feedback
2023-03-28 19:25:22 +00:00
Vitaliy Urusovskij
40cc006bae
Enable MapAllocator in IR Frontend (#12673)
* Enable MapAllocator in IR Frontend

* Fix `ov_infer_request_ppp` test

With `mmap()`ing of IR, .bin can't be deleted until unmapping.
And it shows that there was a leak in test

* Add comment to Win `CreateFile()` regarding
FILE_SHARE_DELETE

* Unmap .bin file before IR files deletion

Wait ov::Model deletion to trigger .bin file unmapping
before IR files deletion

* ClangFormat

* Add `use_map_allocator` switch in FE

In case of direct use of FE (e.g. via MO), `mmap()` is OFF.
But in case of use FE via Core, `mmap()` is ON.
2023-03-28 23:24:13 +04:00
Pawel Raasz
796bd98913
Review convolution classes for shape inference aspects (#16375)
* Review adaptive max pool shape inference

* Review AvgPool and MaxPool

* Review convolution operator

* Review GroupConvolution shape inference

* Review ConvolutionBackpropData operator

* Review GroupConvolutionBackpropData op

* Review BinaryConvolution operator
- add common bases for convolution ops
- refactor convolution ops

* Review DeformableConvolution operator

* Use new convolution shape_infer in GPU

* Fix build and test issues

* Correct set output spatial shape
in default constructed back prop convolutions

* The convolution shape_infer use pads as parameters
the external padding can be operators or other class padding properties shape_infer should not modify operators padding when
called from plugin

* Apply code formatting

* Fix padding validation and update

* Use shape inference with padding instead fallback
for DeformableConvolution from opset1

* Update convertPadding function to be template
2023-03-28 19:10:08 +00:00
Maxim Vafin
8d90c11a35
Fix sporadic fails when beta==0 in baddmm (#16610)
* Fix sporadic fails when beta==0 in baddmm

* Remove sporadic test loop
2023-03-28 18:47:35 +00:00
Mateusz Bencer
4403433309
[ONNX FE] Implementation of ONNX STFT op (#16461) 2023-03-28 20:47:17 +02:00
Eddy Kim
e169c7cd38
fix a bug in permute_bfzyx_to_bfyxz (#16599) 2023-03-28 18:19:35 +00:00
Irina Efode
3849d5aa02
[INSTALL] Fix setupvars (installation for MacOS) and build python (#16514)
* Fix installation + Python build on MacOS

* Update setupvars.sh

* Update setupvars.sh

* Revert

* revert

* Update scripts/setupvars/setupvars.sh

---------

Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>
2023-03-28 22:03:22 +04:00
Chen Peter
a2218ab169
Add notes for oneTBB (#16606)
* Add notes for oneTBB

Signed-off-by: Peter Chen <peter.chen@intel.com>

* Update wording

---------

Signed-off-by: Peter Chen <peter.chen@intel.com>
2023-03-28 21:19:00 +04:00
Alexandra Sidorova
38c924a3ae
[Snippets] Added support of BF16/I8/U8 for MatMul (#15063) 2023-03-28 20:49:26 +04:00
Paul Youngsoo Ahn
253e4eb366
[GPU] Remove duplicated OpenCL kernel compilation on static model (#16262)
* * update kernel_ids using hash value
* Change set to unordered_map for kernels_code
* replace unique_id to hash value
* Remove hash_val params
* remove redundant codes (#16262)
** Remove unique_id in program_node
** Remove gen_kernel_id
** Remove set_kernels_source
** Remove remove_kernels
** Remove kernel_idx in kernels_cache

* * Use kernel_impl_params instead of kernel_id
* Divide batch when entry_point are duplicated
* rollback removing unique_id

* * Fix get_kernel failure issue (#102467)
 - Modify has function of custom_gpu_primitive and generic_layer
 - Add ==operation of generic_layer for _kernels map in kernels_cache
 - Fix invalid kernel_impl_params related to unique_ptr life cycle issue

* Improve kernels_cache (#102467)
* Move add_kernels_source step to build_implementations
* Change replace kernels_code key to kernel_impl_params
* Return kernel vector in get_kernels

* Modify function name to get_kernels (#102467)

* Fix functions related graph serialization (#102467)

* Fix failure to run dynamic model (#102467)

* Add unit test

* Code review follow-up
- Add const to input params
- Add missing code to check kernel duplication in kernels_cache

* Add const to input params (#102467)

* [GPU] update hash and ==operator for generic_layer and custom_gpu_primitive (#102467)

* [GPU] override get_kernels_source in generic_layer and custom_gpu_primitive (#102467)

* [GPU] Fix onednn build error (#102467)

* [GPU] Fix Lin build error (#102467)

* [GPU] kernels_cache::get_kernels return vector of clone of cldnn::kernel (#102467)

* Updated serialization logics for improved kernel caches (#16262)

* primitive key kernel cache for serialization
* kernel serialization with binaries hash
* fix kernel cache init function for deserialization
* removed unnecessary codes

* [GPU] Update commnet and fix test failure (#16262)

* [GPU] Fix custom_gpu_primitive unit test failures (#16262)

* [GPU] Improved kernels cache serialization (#16262)
* removed hash in serialization logic
* update not to create a new kernels_cache for serialization
* code refactoring in serialization logic

* [GPU] Follow-up code review (#16262)

* [GPU] modify lock(#16262)

* [GPU] Fix custom_gpu_primitive unit test failure (#16262)

---------

Co-authored-by: Eddy Kim <eddy.kim@intel.com>
2023-03-28 18:48:19 +02:00
Roman Kazantsev
17c3e67336
[TF FE] Add layer test for Mish activation function (#16557)
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
2023-03-28 18:43:11 +02:00
Maxim Vafin
44f0419a0b
Get mo version once (#16576) 2023-03-28 15:45:08 +00:00
Ilya Churaev
05b0c58521
Add doc for ENABLE_QSPECTRE option (#16605)
* Add doc for ENABLE_QSPECTRE option

* Updated the link
2023-03-28 19:41:20 +04:00
Mikhail Ryzhov
55e9cae54f
[GNA] Pre/Post processing via evaluate (#15691) 2023-03-28 14:50:02 +00:00
Ekaterina Aidova
6fc0b6479e
[PT FE]: revert usage mo.convert_model in pt layer tests (#16573)
* [PT FE]: revert usage mo.convert_model in tests

* fix failed test
2023-03-28 16:06:21 +04:00
Pawel Raasz
49d150b3b8
Review PSROIPooling class for shape inference aspects (#16447)
* Review ROIPooling class
- check interval shape and label propagation
- add template shape_infer
- add shape infer into cpu plugin
- add test with StaticShape

* Use get_output_roi instead of get_output_size

* Add missing includes

* Review PSROIPooling operator
- review interval and label propagation
- add template shape_infer implementation
- add shape_infer to cpu plugin
2023-03-28 15:02:16 +04:00
Marcin Kacprzak
d9d1df2fe3
[GNA] Implemented ExecutionMode support in GNA Plugin (#16396) 2023-03-28 14:47:12 +04:00
Shen, Wanglei
a726f0ae38
Enable new property ov::hint::scheduling_core_type (#16106)
* enable apply_processor_type()

* declare PROCESSOR_TYPE

* enable readProperties

* test case for get_property()

* enable set_property() and test cases

* reduce changes

* fix code style issue

* fix python test case issue

* remove python interface

* move processor type definition out of dev_api

* refine coding

* add dependency

* update header file

* update description

* merge intel_cpu header file

* add inline in-code documentation

* change 'UNDEFINED' to 'DEFAULT'

* remove ProcTypeConfig

* refine change

* refine change

* refine process_type to scheduling_core_type

* refine description

* fix code style issue

* change to ov::hint::scheduling_core_type

* fix code style issue

* fix code style issue

* fix python issue

* fix python issue

* fix python issue

* fix python issue

* change core_type_cfg to ov::hint::SchedulingCoreType

* update test case for comments

* update test case for comments

* add default for comments

* update code style

* update for comments

* update for comments

* fix typo

* move cpu_map_scheduling into threading folder

* update for merge conflict

* update for code style
2023-03-28 10:04:30 +04:00
Vladimir Paramuzov
906939a1f1
[GPU] Fixed invalid is_dynamic flag value for scalar inputs (#16565) 2023-03-28 10:03:51 +04:00
hyunback kim
d06a22f4e4
[GPU] Support FC+eltwise fusion in fp16 for OneDNN (#16303)
* [GPU] Support FC+eltwise fusion in fp16

Signed-off-by: hyunback <hyunback.kim@intel.com>
2023-03-28 14:49:49 +09:00
Ilya Churaev
5dff012233
Fixed Warnings in reference implementations (#16559)
* Fixed Warnings in reference implementations

* Removed suppression from shape_inference
2023-03-28 00:45:40 +04:00
Ilya Churaev
167bf7e16a
Added test to check that layout can be created from serialized format (#16575) 2023-03-28 00:43:30 +04:00
Shen, Wanglei
815d4abc03
enable new property ov::hint::use_hyper_threading (#16176)
* enable apply_processor_type()

* declare PROCESSOR_TYPE

* enable readProperties

* test case for get_property()

* enable set_property() and test cases

* reduce changes

* fix code style issue

* fix python test case issue

* remove python interface

* move processor type definition out of dev_api

* refine coding

* add dependency

* update header file

* update description

* merge intel_cpu header file

* add inline in-code documentation

* change 'UNDEFINED' to 'DEFAULT'

* remove ProcTypeConfig

* refine change

* refine change

* enable new property use hyper threading

* update description

* resume legacy code

* change to ov::hint namespace

* update including header file

* update C API and Python API

* update description for comments

* update test case for comments

* update function location for comments

* fix typo

* fix typo

* fix code style issue and update test case

* move cpu_map_scheduling into threading folder
2023-03-28 00:39:26 +04:00
Orest Chura
aa0df8e535
[Python][Build] Fix building openvino wheel on Windows (#16374)
* Add snippets dependency

* - removed dependency back
- added an INTEL_CPU condition on snippets configuring -> no dependency when configured w/0 CPU

* Disable snippets_ngraph_functions conditionally if inference_engine_snippets are not configured

---------

Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>
2023-03-27 23:52:58 +04:00
Sebastian Golebiewski
68e067062f
Update Doxyfile.config (#16564) 2023-03-27 23:47:10 +04:00
Sebastian Golebiewski
1ca94326cb
DOCS shift to rst - Benchmark Samples and Tools (#16566) 2023-03-27 18:29:05 +02:00
Sebastian Golebiewski
5c5a29d095
DOCS shift to rst -Sync Benchmark Samples (#16561) 2023-03-27 18:28:16 +02:00
Maciej Smyk
6e99b48ecc
DOCS shift to rst - OpenVINO™ Samples and Get Started with C++ Samples (#16577) 2023-03-27 18:26:47 +02:00
Irina Efode
9863b32792
[CONFORMANCE] w/a Api Conformance crash for NVIDIA (#16508) 2023-03-27 17:57:10 +02:00
Maciej Smyk
7ccf1c89cf
DOCS shift to rst - Image Classification Async C++ Sample & Image Classification Async Python* Sample (#16580) 2023-03-27 16:54:50 +02:00
Roman Kazantsev
5e9ea6a146
[TF FE] Refactor utils routine (#16554)
Move all openvino_conversion rountines into utils. Avoid using Squeeze without axis
that can create dynamic output rank

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
2023-03-27 11:10:00 +00:00
Roman Lyamin
5113a5538c
[GPU] Added shape canonicalization mechanism (#16166) 2023-03-27 15:02:06 +04:00
Tomasz Adamowicz
4936d4bb1d
[GNA] Introduce 16Byte memory alignment for LNL (GNA3.6) (#16363)
* [GNA] Introduce 16Byte memory alignment for LNL (GNA3.6)

* update after review
2023-03-27 10:42:34 +01:00
Mang Guo
5e835e327b
[CPU] Fix edge memory share issue (#16202) 2023-03-27 13:20:51 +04:00
Piotr Krzemiński
6b70c449ba
[PT FE] Add aten::Chunk implementation (#16035)
* [PT FE] Add chunk implementation:

* [PT FE] Fix chunk int64 instead of const node errors, add tests for chunking

* [PT FE] Test Chunk-If implementation

* [PT FE] Change the translate to replace chunk implementation, use VariadicSplit instead of Slice

* [PT FE] Reduce artifacts from debugging

* Update test_chunk.py

* [PT FE] Improve & debug chunk implementation:

* [PT FE] Simplify implementation, fix remaining bugs

* [PT FE] Statify the split lenghts output

* [PT FE] Clear code, remove debugging artifacts
2023-03-27 11:16:16 +02:00
Mateusz Mikolajczyk
7d16ee1835
[PT FE] Add torchvision::deform_conv2d translation (#16450)
* Initial commit

* Initial commit

* Cleanup

* Improve tests

* Make NodeContext const
2023-03-27 11:13:32 +02:00
Roman Kazantsev
bb9de29062
[TF FE] Add layer test for Bucketize (#16556)
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
2023-03-27 12:03:07 +04:00
cecilia peng
a1b8a6a941
[CPU] Disable ConvertNMSToNMSIEInternal (#16128) 2023-03-27 11:22:53 +04:00