Commit Graph
1311 Commits
Author SHA1 Message Date
Sergey Shlyapnikov e23704ef5e [GPU] Update FC batch blocking for INT4 weights (#21228) 2023-11-23 13:24:14 +04:00
Mingyu Kimandhyunback 712c5fbd39 [GPU] Onednn 3.4pc (#21064)
* Update onednn to 3.4pc branch
* [GPU] Add os_yx_is_osv16_isv2 for onednn weight format.
* Add os_y_is_x_osv16_isv4, g_os_yx_is_osv16_isv2

Signed-off-by: hyunback <hyunback.kim@intel.com>
Co-authored-by: hyunback <hyunback.kim@intel.com>
2023-11-22 20:54:20 +09:00
Min, Byungil 7f5ba4e074 [GPU] Update space_to_depth to use nGraph shape inference (#21135)
* [GPU] Update space_to_depth to use nGraph shape inference

+ Added calc_output_layouts to use shape_infer
+ Added relevant test-cases for static and dynamic
+ Modified typo of filename

Signed-off-by: Min, Byungil <byungil.min@intel.com>
2023-11-22 20:47:16 +09:00
Vitaliy Urusovskij b66488e4ff Ngraph to ov (#21185) 2023-11-22 09:44:17 +04:00
Vladimir Paramuzov eb94c80804 [GPU] Enable BroadcastTransition before CommonOptimizations (#21198) 2023-11-21 16:54:04 +01:00
Vladimir Paramuzov a6e4d8fc30 [GPU] Cleanup buffer optimization code (#21012) 2023-11-21 14:43:14 +04:00
Oleg Pipikin 165f574d8f Refactor ngraph builders 2 (#21043)
* Deprecate makeBatchToSpace

* Deprecate makeSpaceToBatch

* Remove makeStridedSlice

* Remove and deprecate makeSlice

* Remove and deprecate makeMVN

* Fix
2023-11-21 13:03:39 +04:00
Pawel RaaszandIlya Lavrenov 5d6d6a2cfe [core]Optimize OV assert macors to reduce CPU plugin binary size (#21180)
* Optimize OV assertions to reduce bin-size of libs

* Migrate assertion leftovers in CPU plugin

* Add NotImplemented::create to support use with macro
OPENVINO_ASSERT_HELPER

* Remove CheckLocInfo struct

---------

Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>
2023-11-21 07:16:30 +01:00
Wilson Seok d2dcdf86ba [GPU] Fix issues in dynamic loops newly created by TF FE support (#21060)
* implementation of loop for new tf fe

* fix loop dynamic shape func test case failure

* backedge memory validation for static shape

* update checking user of backedge_to_prim

* avoid opt out of loop body network reorder result

* fix for batch 2 case

* fix batch2 case for loop

* fix build error

* fix missing condition
2023-11-20 16:15:02 -08:00
Kelvin Choi adbfc53374 [GPU] Add an unittest to check reorder with trucation mode after reshape node not to split (#20783) 2023-11-21 09:00:12 +09:00
Min, Byungil 081f5aad8a [GPU] Fix perf regression from dynamic tensor iterator (#21065)
+ Not to use reference::split. It is very slow.

Signed-off-by: Min, Byungil <byungil.min@intel.com>
2023-11-20 10:03:39 +09:00
Min, Byungil 8181f30a67 [GPU] Fix accuracy issue of blocked format batching on iGPU (#20890)
* [GPU] Fix accuracy issue for blocked format batching on iGPU

+ Bugfix GET_INDEX for batching of b_fs_zyx_fsv16 of target model
+ Updated fetch_data.cl
+ Minor fix of error message

Signed-off-by: Min, Byungil <byungil.min@intel.com>
2023-11-20 09:46:37 +09:00
Oleg Pipikin a9dffa8d70 Refactor ngraph builders (#20998)
* Remove makeInputLayer builders

* Refactor makeBroadcast builder

* Deprecated makeCTC builders

* Fix for broadcast builder

* Remove and deprecate makeSplit builder

* fix

* Fix
2023-11-17 16:10:19 +01:00
Oleg Pipikin 71af0eef38 Refactor ngraph builders 4 (#21100)
* Remove and deprecate some ngraph builders
2023-11-17 14:51:56 +00:00
Paul Youngsoo Ahn 8b5b7a627b [GPU] Fix loop issues (#21091)
* [GPU] Fix loop issues
* if loop does not run inner body, return zero dimension layout for dynamic dimension layout

* Support dynamic sliced input in inner body in creaet concate mapping

* Modify update_shape to call reset_shape_changed() when inputs of loop are not changed
* Add unit test

* Follow-up codereview
2023-11-17 00:16:58 -08:00
Taylor Yeonbok Lee cc463a7757 [GPU] Skip empty subgraph of If operator (#21087)
* Skip empty subgraph of If operator

* Added test
Applied review comment

* Fix for the following case:
1) body network output has only constant input
2) body network output itself is the constant
2023-11-17 09:39:03 +04:00
Oleg Pipikin 819feeb56d Refactor NMS shared tests (#20897)
* Refactor MatrixNmsLayerTest

* Refactor MulticlassNmsLayerTest

* Refactor NmsLayerTest

* Apply comments

* Apply comments
2023-11-16 13:57:56 +00:00
Oleg Pipikin 76459a316f Refactor ngraph builders 5 (#21101)
* Remove makeGatherElements builder

* Remove makeTile builder

* Remove makeNormalizeL2 builder

* Deprecate makeNms buider

* Remove makeOneHot builder

* Remove makeEinsum
2023-11-16 10:29:48 +04:00
Sergey Shlyapnikov af34891750 [GPU] Add more flexible check if user's buffer is USM Host and can be reused (for iGPUs only) (#21018) 2023-11-16 09:46:10 +04:00
Yaroslav Torziuk f45dccad15 [GPU] Multinomial-13 (#20616)
* Update random_uniform in multinomial reference implementation to generate values of the same type as the first input

* Add kernel selector for multinomial

* Add multinomial primitive and its instantiation

* Add calc_outut_layout implementation for slice_inst

* Multinomial builder

* Add multinomial kernel

* Add multinomial single layer test class

* Add GPU multinomial tests instantiation
2023-11-15 16:20:43 -08:00
Xuejun Zhai 8eb529ceac [Func Test] Upgrade func test of QuantGroupConvBackpropDataLayerTest related to 2.0 (#21094)
Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>
2023-11-15 18:14:25 +00:00
Xuejun Zhai 00d0c0ad0d [Func Test] Upgrade func test of QuantConvBackpropDataLayerTest related to 2.0 (#21082)
Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>
2023-11-15 14:12:33 +01:00
Wilson Seok 0180078c70 [GPU] Fix permute reorder fusing bfzyx (#20896)
* fix accuracy issue of permute reorder fusing

* add func test

* remove debug code

* use unit test

* simplify condition

* add additionall condition
2023-11-15 09:33:12 +00:00
Sungeun Kim 5365bfe0a7 [GPU] remove setting threshold manually for dynamic 1d conv (#21028) 2023-11-15 16:54:22 +09:00
Oleg Pipikin 534ec2e9ab Refactor ngraph builders 3 (#21077)
* Remove and deprecate makeSqueezeUnsqueeze

* Remove and deprecate  makeMinMax makeProposal

* Remove makeCumSum makeSelect builders

* Remove makeSpaceToDepth builder

* Remove makeShuffleChannels builder

* Remove makeMatMul builder
2023-11-15 10:41:45 +04:00
Sergey Shlyapnikov c360de0f07 [GPU] Optimize Condition operation by better integrating its subnetwork primitives with the main network (#21062)
* [GPU] Optimize Condition operation by better integrating its subnetwork primitives with the main network

* Reuse main network's stream in sub-networks
2023-11-15 08:47:36 +04:00
Oleksii Khovan 7c027fe19a [GPU] Fix ShapeOf primitive (#20983)
* Determine rank via input layout instead of primitive's member

* Remove unused primitive's member

* fix shape_of() usage - remove unused parameter
2023-11-14 11:09:52 -08:00
Paul Youngsoo Ahn da2a886477 [GPU] Fix acc issue for LSTMSequence w/ -1 seq_length (#21054)
* [GPU] Fix acc issue for LSTMSequence w/ -1 seq_length
* add output port for multiple outputs of node
* add functional test for lstm_sequence

* Fix CI test failures
2023-11-14 10:47:03 -08:00
hyunback kim 03e48f3c17 [GPU] Fix LCM notebook failure issue for int8 model. (#20944)
Fix to use partial_shape in dynamic case. Not get_dims().

Signed-off-by: hyunback <hyunback.kim@intel.com>
2023-11-13 20:39:02 +09:00
Maciej Smyk 5a04359200 [DOCS] Updating links for master 2023-11-13 12:23:23 +01:00
Maksim Kutakov fb3751717f [Inference] Return state ptr by value (#21011)
* Return state ptr by value

* Fix mock class
2023-11-13 14:24:54 +04:00
Vitaliy Urusovskij 1a5b0b70f9 Remove castOps2Nodes and convert2OutputVector (#21015) 2023-11-13 13:29:53 +04:00
Sergey Shlyapnikov 306137f86b [GPU] Make ShapePredictor instance unique for each InferRequest instead of the cldnn::network (#21019) 2023-11-13 08:52:07 +04:00
Paul Youngsoo AhnandAndrew Park 51da30b48d Support LSTMSequence with -1 sequence length (#20935)
* [GPU] Support LSTMSequence w/ -1 seq_length

Co-authored-by:Taylor Yeonbok Lee <taylor.lee@intel.com>
Co-authored-by:Andrew Park <andrew.park@intel.com>

* Fix GetInputInfo to retrieve input pid from LSTMCell

* LSTMCell use ov::PartialShape instead of cldnn::tensor
* implement lstm_elt_inst::calc_output_layouts
* implement lstm_elt_impl::static_canonicalize_shapes

* Add functional tests

* Fix unit test failure

---------

Co-authored-by: Andrew Park <andrew.park@intel.com>
2023-11-11 00:06:08 -08:00
Sungeun Kim b1705e8bd3 [GPU] clean up for extend pad/stride/dilation (#20828)
* clean up for extend pad/stride/dilation
2023-11-09 20:48:34 +09:00
Sungeun Kim 9cc4c25e48 [GPU] print datashape of input for benchmark_app (#20943)
* print datashape of input for benchmark_app
2023-11-09 20:46:50 +09:00
Oleg Pipikin 4bde741de4 Refactor StaticShapeLoopLayerTest (#20963) 2023-11-09 11:08:18 +04:00
Vitaliy Urusovskij bcb38796ce Ngraph helpers/builders cleaning (#20819)
* Delete `getNodeSharedPtr()`

* Remove `makeRoll` ng::builder

* Delete `makeSelect` ng::builder

* Delete `makeDepthToSpace` ng::builder

* Remove `CompareFunctions` and `getConstData` from ng::helpers

* Return `makeSelect` for compatibility with NPU

* Port `QuantizationGranularity`, `MemoryTransformation`

* Restore ng::helpers::QuantGranularity for BWD CMP
2023-11-09 10:51:00 +04:00
Vladimir Paramuzov 8f406067d1 [GPU] Remove binary convolution primitive and all related code (#20889) 2023-11-09 09:54:46 +04:00
Mingyu Kim 319a6584a2 [GPU] Decompose test combination to reduce test time (#20968) 2023-11-09 13:10:08 +09:00
Oleksii Khovan d07f272054 [GPU] Fix cum_sum_partial_sum implementation for dimensions >= BLOCK_SIZE (#20855)
- fix cum_sum_partial_sum kernel;
- add unit test and func test for big shapes;
- add test to compare Partial vs Ref performance;
- change kernels' priorities according to performance measurements;
- move common profiling helpers to test_utils.

Ticket: CVS-123590
2023-11-08 11:26:51 +00:00
Oleg Pipikin ace986cac0 Refactor GenerateProposalsLayerTest, GridSampleLayerTest (#20772)
* Refactor GenerateProposalsLayerTest

* Refactor GridSampleLayerTest

* Fix

* Apply comments

* Apply comments
2023-11-08 14:06:28 +04:00
Andrei Gorbachev 87cef53088 [GPU] Refactor (#20938)
* maxmin

* mvn

* normalize_l2 and fix mvn

* prior_box_clustered

* prior_box

* pad

* roi_align

* scatter_update

* select

* shape_of

* shuffle_channels

* space_to_batch

* space_to_depth

* split

* squeeze_unsqueeze

* tile

* transpose

* variadic_split

* scatter_nd_update
2023-11-08 13:42:44 +04:00
Paul Youngsoo Ahn c42a88a190 Support dynamic tensor_iterator (#20869)
* [GPU] Support dynamic tensoriterator with -1  num_iteration
- remove redundant codes

* [GPU] Refactoring methods for pre_process / post_process for body_network

* Add unit test for dynamic tensoriterator wo trip_count_id

* Follow-up code review
* Set inner network in loading of model cache
* Fix legacy loop unit tests
2023-11-07 15:11:08 -08:00
Vitaliy Urusovskij 0955faef93 Remove use of convertOps2Nodes() & convert2OutVect() (#20837) 2023-11-03 11:00:33 +04:00
Andrei Gorbachev ff7b49c14d add a few tests (#20824) 2023-11-02 16:40:47 +00:00
Vladimir Paramuzov 2afb64b9ea [GPU] Refactor KV cache test (#20802) 2023-11-02 09:54:19 +04:00
Kelvin Choi bb28b71849 [GPU] if the reorder which is an user of reshpae has truncation mode, it should not split the reorder node (#20749) 2023-10-31 19:21:56 +09:00
Min, Byungil 00705e6e58 [GPU] Bugfix adjust padding size for reshape optimizing (#20773)
Signed-off-by: Min, Byungil <byungil.min@intel.com>
2023-10-31 17:24:35 +09:00
Andrei GorbachevandPavel Durandin 44925b580f [GPU] Refactor Comparison, Conversion, ConvertColorI420 (#20374)
* Comparison

* Conversion

* ConvertColorI420

* fix

* Comparison

* Conversion

* ConvertColorI420

* fix

* fix after review

* fix after review

* fix after review

* fixed comparison

---------

Co-authored-by: Pavel Durandin <pavel.durandin@intel.com>
2023-10-31 09:50:20 +04:00