Commit Graph

920 Commits

Author SHA1 Message Date
Min, Byungil
6ffaa393d5 [GPU] Remove WA for cldnn Reduce fallback (#13663)
+ Use oneDNN reduction when it has fused eltwise

Signed-off-by: Min, Byungil <byungil.min@intel.com>
2022-10-28 16:23:02 +09:00
Krzysztof Bruniecki
fdd047edb9 [GNA] Fix offset and size computation for Crop (#13400)
Fix GetCropParams
    Add test to reproduce crop isue from ticket
    Use convolution in the test
    Cleanup get dim getters using backoffset
2022-10-28 08:46:19 +02:00
yanlan song
3f4c53a779 Bell/fix priority (#13667)
* debug only

Signed-off-by: fishbell <bell.song@intel.com>

* fix model priority with -d AUTO

Signed-off-by: fishbell <bell.song@intel.com>

* add tests

Signed-off-by: fishbell <bell.song@intel.com>

Signed-off-by: fishbell <bell.song@intel.com>
2022-10-28 04:58:25 +03:00
Paul Youngsoo Ahn
694d2f73eb [GPU] Range new shape infer (#13582) (#13582)
- move dynamic functional tests to dynamic folder
2022-10-27 18:29:49 -07:00
Taylor Yeonbok Lee
33c230a40d Fix reshape calc_output_layout failure in squeeze shape_infer test. (#13698)
Failure: Comparing reshape->output_shape with a new tensor() object was not working as intended.
Since the original intention was to check whether cldnn::tensor type output_shape is set or not,
so replaced the comparision to use size of the output_shape.
2022-10-28 04:17:44 +03:00
Egor Duplenskii
7e2cefab8a [CPU] Move to oneDNN v2.7 (#12281) 2022-10-28 01:40:07 +03:00
Ilya Churaev
84710e4440 Bump CMake for Linux Azure (#13652)
* Bump Cmake for Linux

* Fixed environment

* Change CI script

* Disable some warnings

* Fixed compiler flag

* Enabled Warnings as error for Linux

* Revert "Enabled Warnings as error for Linux"

This reverts commit bfb09efb71.

* Use prebuild cmake

* Remove redundant check
2022-10-27 17:08:56 +04:00
Pawel Raasz
d96c25844d Review opset1 unsqueeze for shape inference aspects (#13538)
* Use non-blocking assertions in unsqueeze tests
for independent properties

* Review unsqueeze interval shape propagation:
- extend partial shape propagation tests
- add invalid axis value tests
- fix issues when repeated axes on input

* Shape inference test, unsqueeze using default ctor
- private fields set by setters

* Review unsqeeze bounds propagation:
- preserve and propagate labels
- bounds propagation lowe/upper

* Add template shape inference for unsqueeze
- extract current implementation and unify it for shape types
- add unit test for static shape inference
- add unsqueeze in/out indexes

* Unify axes normalization

* Use common fixture for static shape inference

* Fix build issue in GPU plugin
- include unsqueeze shape inference

* Remove enum with in/out indexes
Due to build issue on Windows

* Remove make move iterator
minor changes validation util

* Add test for label propagation
- expand static shape inference tests

* Add common validation for axes input

* Fix build issues

Co-authored-by: Evgenya Stepyreva <evgenya.stepyreva@intel.com>
2022-10-27 10:28:24 +03:00
Taylor Yeonbok Lee
728c9631b7 Dynamic shape : remaining changes to run bert (#13306)
* Initial dynamic shape smoke test for GPU

* Bert dynamic runs without crash

* Additional fix to resolve error in bert-large-uncased-whole-word-masking-squad-emb-0001

* Fix error in unfusion function: input nodes of the current (fused) node need to be updated with the latest dependency if they are fuesed to other nodes

* Several fixes
(1) Fix program to clear _kernels after all build_program steps finished
(2) Fix update_kernel not to init_kernel when impl_cache hit
(3) Fix update_kernel to clear kernels_cache::_kernels after adding the new impl to impl_cache
(4) No longer need to remove kernel from kernels_cache::_kernels after the corresponding impl is dropped from impl_cache

* Fix crash of bert_emd_4layer

* Applied review comment

* Applied review comment : fix add_required_reorder

* Fix broadcast to propagate dynamic shape properly & reverted change on constant

* Added a new unfusion unittest

* Fix broadcast single input case to use predefined shape properly

* Fixed count_non_zero output to result only one element of count

* Removed output_layout str for gather_nonzero
Removed unused ov_input_rank for count_nonzero

* Fixed create_host_blob to use usm if the target layout is not dynamic.
(Previous impl has an error when the network is dynamic but the output is static)
Moved dyn shape smoke test under dynamic directory

* Fix lint error
2022-10-27 07:20:18 +03:00
Kelvin Choi
a7a14a89c8 [GPU] Support dynamic shape for one-hot and reshape operations (#13516) 2022-10-26 17:12:17 -07:00
OlehKravchyshyn
dc1a8b7795 [GPU] added optimized blocked formats support for 5d interpolation liner onnx and nearest modes (#12977)
This commit contains two features which are split into two commits:
1) linear onnx interpolation of 5d formats
2) Optimize blocked formats for linear_onnx and nearest formats
   - contain correspondent unit and single layer tests
2022-10-26 21:53:38 +09:00
Tetiana Gubanova
632378c930 [GPU] Add blocked layout support to deconvolution reference implementation (#12574)
* Add blocked layout support to deconvolution reference implementation

* Fix crash in tests for corresponded format
2022-10-25 23:27:56 -07:00
Sungeun Kim
168cf0a1a0 [GPU] remove WA for fallback pooling to cldnn. (#13540)
* remove WA for fallback pooling to cldnn.
* remove unnecessary code for deconv
* add format::bfzyx/b_fs_zyx_fsv32 to reduction_onednn
2022-10-26 13:39:20 +09:00
Pawel Raasz
5d710bab2f Review opset8 gather for shape inference aspects (#13578)
* Review interval shape propagation

* Review preserve label, partial value

* Review gather static shape inference
- unify and extend gather static shape inference test

* Introduce OV_EXPECT_THROW test macro
- wrapper for gtest macro with additional matcher for exception what()
- apply OV_EXPECT_THROW in gather type prop tests

* Use gtest `expect` instead of `assert`

* Add gather default ctor test

* Remove leftovers
2022-10-25 21:23:02 +03:00
Ilya Churaev
2a344b66cb Update to the latest cmake for Windows (#13604)
* Update to the latest cmake for Windows

* Skip new warnings

* Added compiler flags for old cmake

* Disabled some warnings

* Suppress new warnings

* Fixed some errors

* Disable some warning for lpt

* Fix some warnings

* Disable new warnings

* Fix some warnings

* Disabled Was error for arm

* Fixed some errors

* Fixed some new warnings

* Fixed auto plugin

* Fixed Windows warning

* Fixed Windows

* Disable some warnings

* Some changes

* Small test fixes

* Fixed python build

* Added skip warnings for legacy python API
2022-10-25 18:11:46 +04:00
Oleksii Khovan
1960746c44 [GPU] ScatterElementsUpdate blocked layout support (#12465)
* add parameterized test
* add blocked layouts support
* support for mixed input formats
* fix RHEL 8.2 build
* add scatter_elements_update to whitelist for blocked formats
* Added bs_fs_yx_bsv16_fsv32 format
2022-10-25 08:22:27 +03:00
Mingyu Kim
0e242b3244 [GPU] update onednn to latest 2.7 (#13518) 2022-10-25 12:21:13 +09:00
Sun Xiaoxia
ec14dd3523 Hybrid-aware P/E Core optimization (#13435)
* add HybridAware stream setting and core binding

* fix clang format issue

* unified code style, add parameter check

* correct input affinity skip NUMA, modify function name

* remove unnecessary floor

* fix ci compile issue on Mac/windows platform

* modify smoke_SetConfigAffinity test

* modify ov_core_set_and_get_property_enum test, affinity HYBRID_AWARE is changed to NUMA

* remove affinity correcting on this pr

* revert ov_core_test.cpp

* merge function by comments

* fix code style issue

Co-authored-by: Shen, Wanglei <wanglei.shen@intel.com>
2022-10-24 22:26:22 +03:00
Gorokhov Dmitriy
086bc00d4c [CPU] Fixed EmbeddingSegmentsSum initialization with dynamic num_segments (#13372) 2022-10-24 18:34:25 +03:00
Gorokhov Dmitriy
9f40eb7196 [CPU] Fixed integer compute for arithmetic operations (#13556) 2022-10-24 15:54:52 +04:00
Min, Byungil
4188f1f181 [GPU] Update for layout query (#13346)
+ support multiple input and output target formats
+ implement generic logic for selection formats and find_data_format
+ Add TCs for select_preferred_formats

Signed-off-by: Min, Byungil <byungil.min@intel.com>
2022-10-24 15:27:09 +09:00
Felix Dohyun Kim
385d87edaf [GPU][DG2] Fix output scale post-op condition (#13567)
* fix bug in oscale post-op condition
2022-10-24 10:17:00 +09:00
Roman Lyamin
478939ea9e [GPU] GEMM dynamic (#13248) 2022-10-21 16:19:35 +04:00
Ilya Churaev
85d78a3ef0 Build code snippets together with doc (#13541)
* Build code snippets together with doc

* Added separate step for code snippets

* Try to enable CI step

* Disabe myriad

* Try to fix Windows

* Detect number of cores

* Reduced build time of code snippets
2022-10-21 06:29:19 +03:00
Oleksii Khovan
2f982b9490 [GPU] reorg_yolo blocked layouts support (#12463)
* add unit test for reorg_yolo
* add validation to reorg_yolo kernel
* add blocked formats support
* remove non-working yxfb optimization
* add reorg_yolo to whitelist for blocked formats
2022-10-20 19:35:43 +03:00
Pavel Durandin
dfd5b461f1 [GPU] Fix gpu unit and functional tests on windows (#13560) 2022-10-20 09:56:29 +04:00
OlehKravchyshyn
3500d75187 [GPU] Add supporting blocked format for reverse operation (#12032) 2022-10-20 14:18:00 +09:00
hyunback kim
71f3c8c786 [GPU] Fix brain-tumor-segmentation-002/INT8/onnx running failed (#13274)
reorder_input has the issue when using generated reorder case.
And handle_reshape has only handle 4 dims (bfyx), so support 5, 6 dimes

Signed-off-by: hyunback <hyunback.kim@intel.com>
2022-10-20 11:29:53 +09:00
Nadezhda Ageeva
a4655bb6b3 [GNA] Insert identity using ngraph transformation (#13317)
* [GNA] Insert identity using ngraph transformation

* Update src/plugins/intel_gna/src/ops/identity.hpp

Co-authored-by: Szymon Irzabek <szymon.jakub.irzabek@intel.com>

* Update src/plugins/intel_gna/src/transformations/rt_info/gna_precision_change_flag.hpp

Co-authored-by: Szymon Irzabek <szymon.jakub.irzabek@intel.com>

* Update src/plugins/intel_gna/src/transformations/rt_info/gna_precision_change_flag.cpp

Co-authored-by: Szymon Irzabek <szymon.jakub.irzabek@intel.com>

* Update src/plugins/intel_gna/src/transformations/insert_identity_layer.hpp

Co-authored-by: Szymon Irzabek <szymon.jakub.irzabek@intel.com>

* Rewrites pass with Identity insertion using recusrive function. Adds test for Split. Adds comments

* Change namespace for element type

Co-authored-by: Szymon Irzabek <szymon.jakub.irzabek@intel.com>
2022-10-19 20:27:55 +03:00
Chen Xu
98dbb91af6 [CPU] Support topk sort for int32 directly (#13448) 2022-10-19 13:38:33 +03:00
Vladislav Golubev
a25c2ba665 [LPT] Precision restrictions extending (#13172)
* [LPT] Precision restrictions extending

* Compilation error fixed

* Markup for SubgraphOps fixed

* cleanup

* Review fixes: removed vector<size_t> wrapper in PrecisionRestriction class

* Review fixes: added comments

* docs compilation fix
2022-10-19 12:29:32 +02:00
Ryszard Jezierski
17e702776b Update GNA library version (#13188)
* Changed GNA library version from 1455.2 to 1815

* fixed new URL to GNA in cmake

* fixed gna lib version in linux CI

* use Gna2ExportTlv from new library

* Updated GNA to 1815.1
2022-10-19 13:40:21 +04:00
Katarzyna Mitrus
3c0b5c7f9b BinaryElementwiseArithmetic - common shape_infer (#13421)
* Use eltwise_shape_infer form shape_inference in validate_and_infer_elementwise_args

* Align Unary ops, remove redundant validate_and_infer_elementwise_args usage

* Add test with default constructor for BinaryElementwiseArithmetic ops

* Style apply

* Fix expected error message

* Add common shape_infer tests for BinaryElementiwiseArithmetic ops

* Remove old Add test

* Update NGRAPH_CHECK to OV ASSERT

* Removal of redundant autob param to the validate function

* Tests update
2022-10-19 11:57:16 +03:00
Vladimir Paramuzov
ef12d3976f [GPU] Fixes for infer request impl in dynamic cases (#13050)
* [GPU] Fixes for infer request impl in dynamic cases

* [GPU] Fixed incosistent output shapes for LSTMSequence op

* [GPU] Update network::get_output_layout method

* [GPU] WA for USM memory allocations with 0 bytes
2022-10-19 09:35:03 +04:00
yanlan song
752ff23582 Bell/remote tensor fix in multi (#13483)
* unify device representations

Signed-off-by: fishbell <bell.song@intel.com>

* fix case failure

Signed-off-by: fishbell <bell.song@intel.com>

* add test cases

Signed-off-by: fishbell <bell.song@intel.com>

* indenting

Signed-off-by: fishbell <bell.song@intel.com>

* fix build error on macos

Signed-off-by: fishbell <bell.song@intel.com>

* keep the original logic, if no device available,multi will throw exeception

Signed-off-by: fishbell <bell.song@intel.com>

Signed-off-by: fishbell <bell.song@intel.com>
2022-10-19 10:15:36 +08:00
yanlan song
5e2869cd14 support cache dir in multi/auto/batch (#13507)
* support cache dir in multi/auto

Signed-off-by: fishbell <bell.song@intel.com>

* support cache_dir in bat h

Signed-off-by: fishbell <bell.song@intel.com>

* fix case failure

Signed-off-by: fishbell <bell.song@intel.com>

* clang format

Signed-off-by: fishbell <bell.song@intel.com>

Signed-off-by: fishbell <bell.song@intel.com>
2022-10-19 10:15:03 +08:00
Vladislav Golubev
2d33f6f603 [CPU] LSTM Sequence test enabled (#13323) 2022-10-18 18:43:03 +04:00
Vladimir Paramuzov
5453965566 [GPU] Refactor kernel selector to make file path a bit shorter (#13419) 2022-10-18 17:41:09 +04:00
Pawel Raasz
4bc36f29f4 Review opset1 concat for shape inference aspects (#13455)
* Add interval dim test to Concat op
- use common test fixture for PartialShape OK scenario

* Use get_shape_labels in Concat tests

* Add label_evaluate test for Concat op

* Add validation util to check no labels in tensor

* Add template shape inference for Concat op

* Move Conact evaluate_label test to evaluate bounds

* Fix cpplint issue
2022-10-18 13:17:21 +04:00
Felix Dohyun Kim
f2bdffb04f [GPU][DG2] Fix some bugs (#13517)
* Bugfix: deconv 2 conv optimization
2022-10-18 15:34:50 +09:00
Sungeun Kim
b21510f9f6 Optimize b16 (#13205)
* optimize models on batch16
* add is_os_yx_isv16_osv8 to format_traits_map
* choose onednn deconv
  - remove checking deconv cross-precision
  - implicit concat could not support byxf.

Co-authored-by: Jade Cho <jade.cho@intel.com>
2022-10-18 13:35:45 +09:00
Ilya Lavrenov
5519fff5c2 Fixed RDFT under Rosetta (#13495) 2022-10-17 15:02:28 +02:00
Andrew Kwangwoong Park
550e59070e [GPU] Baseline primitive, primitive_inst, program_node change for multiple outputs support (#13295)
* Update primitive, primitive_inst, and program_node for multiple outputs support

Signed-off-by: Andrew Park <andrew.park@intel.com>

* Update arg_max_min kernel for multiple outputs support

Signed-off-by: Andrew Park <andrew.park@intel.com>

* Fix failed unittests TCs

- remove duplicate output memory

Signed-off-by: Andrew Park <andrew.park@intel.com>

* Clean up code

Signed-off-by: Andrew Park <andrew.park@intel.com>

* Apply code review

Signed-off-by: Andrew Park <andrew.park@intel.com>

Signed-off-by: Andrew Park <andrew.park@intel.com>
2022-10-17 15:13:19 +09:00
Min, Byungil
f1d816f6aa [GPU] Add planar format to onednn reduction (#13445)
Signed-off-by: Min, Byungil <byungil.min@intel.com>
2022-10-17 15:04:41 +09:00
Ilya Lavrenov
2e336e4bb8 Fixes for brew support on OSX (#13476)
* Fixes for brew support on OSX

* Added new policy

* added quotes

* Used OpenVINODeveloperPackage

* Extra fixes

* Use standard verbose variable

* Fixed pkg-config generation
2022-10-15 00:15:03 +03:00
Pavel Durandin
0a174e6788 [GPU] Fix for windows memory fail (#13489) 2022-10-14 17:31:48 +03:00
Sergey Shlyapnikov
5fea4c3fc3 [GPU] Convert activation's slope buffer data type for OneDNN fusions (#13444) 2022-10-14 13:58:35 +04:00
Sergey Shlyapnikov
0b8f1f8c00 [GPU] Optimize reorder between permute and first convolution (#13459) 2022-10-14 13:57:58 +04:00
Tomasz Jankowski
b424ee2568 [Core] Move op_eval tests into Template plugin (#13001)
* Remove redundant tests

* Remove MatMul op_eval tests

* Remove RoiAlign, RoiPooling op_eval tests

* Move VariadicSplit op_eval tests to TemplatePlugin

* Move Transpose op_eval tests to TemplatePlugin

* Move Interpolate op_eval tests to Template Plugin

* Redo Interpolate_v4 tests

* Adopt to new exception messages
2022-10-14 07:45:28 +03:00
Irina Efode
dafa67cf27 [IE TESTTS] Move Set_Device_Name to correct place (#13473) 2022-10-14 06:17:03 +03:00