Commit Graph
55 Commits
Author SHA1 Message Date
Jade Cho 81f336b352 [GPU] Fix the mismatch between format and shape. (#21381)
+ Change broadcast type of broadcast node which is added for binary add fusion.
2023-12-18 15:51:47 +09:00
Jade Cho e2b553302b [GPU] Use preferred output format if node impl type is onednn (#19601)
+ Changes to use preferred format in both cldnn and onednn for gemm and
FC when shape inferencing.
2023-09-08 15:56:40 +09:00
Jade Cho 2394732055 [dGPU] Use cldnn concat if data type is fp32. (#19240) 2023-08-17 09:14:26 +00:00
Jade Cho e5e944ccc2 [dGPU] Copy data from gpu_buffer to gpu_usm (#19010)
* [dGPU] Copy data from gpu_buffer to gpu_usm

* Add a unit test.
2023-08-08 11:47:22 +09:00
Jade Cho c0783f16ed [dGPU] Enable user scratchpad mode for onednn primitive. (#18699)
* [dGPU] Enable user scratchpad mode.
* Reuse intermediate buffer.
* Add own id to the memory dependencies at the c-tor of program_node
+ Allocate intermediate memory with memory_pool::get_memory() function.
+ Assign scratchpad memory desc in load() function for onednn primitive
serialization
* Allocate device mem for onednn scratchpad mem
2023-07-30 23:13:45 +09:00
Jade Cho 4d777bd65b [GPU] Copy from usm_host memory to cl_mem memory. (#18555) 2023-07-18 11:27:21 +09:00
Jade Cho ebf1199733 [GPU] Optimize conv_b_fs_zyx_fsv16_imad (#18356)
+ Make this kernel do not support asymmetric weight.
2023-07-06 16:28:40 +09:00
Jade Cho 2cc3a45959 [GPU] Fuse eltwise into MVN (#17473)
* [GPU] Fuse eltwise into MVN
2023-05-17 14:27:24 +09:00
Jade Cho 78cdf22040 [GPU] Add a debug feature to dump by iteration (#17035)
+ 108686
2023-05-08 06:24:27 +00:00
Jade Cho 5c21dcec4d [GPU] Fix detection output kernel build error on dGPU (#17150)
+ Check local memory size used in the kernel and choose proper kernel.
+ 	Select DO_STAGE_0_CAFFE instead of DO_STAGE_0_CAFFE_OPT
2023-04-25 01:00:26 +04:00
Jade Cho 8fbd78fb07 [GPU] Fix a bug of fusing eltwise sum post-op. (#17078)
+ When input of eltwise is full-tensor constant layer, use binary add
instead of sum as post-op on oneDNN.
2023-04-21 20:17:35 +09:00
Jade Cho a20b3631fb Support float64 data type as input of benchmark_app (#16435) 2023-03-23 13:55:55 +09:00
Jade Cho aaeace9740 [GPU] Fix stable diffusion failure (#16052)
* [dGPU] Enable stable diffusion

+ Prevent to fuse swish into oneDNN reorder.
+ Makes concat explicitly if batch size is greater than 1 and the siblings are oneDNN impl.
2023-03-09 14:35:31 +09:00
Jade Cho c749163f72 [GPU] Update unit tests for swap XY (#15833) 2023-02-23 14:38:10 +09:00
Jade Cho 71cff0ae62 [GPU] Fix a bug of permute optimization (#15701)
* [GPU] Fix a bug of permute optimization

For int8 models, if there is FakeQuantize between permute and convolution, an operation like data type casting could be fused to permute. In this case, do not optimize permute.
2023-02-16 11:32:23 +00:00
Jade Cho 06063201d5 [GPU] Optimize permute for acdb format (#15139)
* [GPU] Optimize permute for acdb format

Target subgraphs to be optimized-out
- input(bfyx) - permute(byxf) - conv
- conv(byxf) - permute(bfyx) - output
+ Fix test_device_mem_usage_estimation unit test failed.
2023-01-31 17:32:57 +09:00
Jade Cho c1f6da31b6 [GPU] Add substract post-op for onednn (#14947) 2023-01-06 17:18:25 +09:00
Jade Cho 9427623046 [GPU] Swap XY axis for 1D conv (#14362) 2023-01-05 14:58:55 +09:00
Jade Cho 4831a9ead4 [GPU] Fix a bug to miscalculate feature-axis index for fused-ops (#14737) 2022-12-29 09:29:08 +09:00
Jade Cho 347e844153 [GPU] Fix a bug to not apply f-axis offset to oneDNN concat (#14590) 2022-12-13 17:12:59 +09:00
Jade Cho 6bc7cd73cd [GPU] Remove WA to fallback to cldnn (#14147) 2022-11-28 12:23:32 +09:00
Jade Cho 4c0b8e6ebd [GPU] Prevent that tanh is fused (#13976) 2022-11-22 10:33:48 +09:00
Jade Cho f2d5c0cb5d [GPU] Fix a bug of reorder input (#13840) 2022-11-10 17:30:30 -08:00
Jade Cho f90bd6b524 [GPU][DG2] Select cldnn reduce kernel when dtype of input/output is FP32. (#13747) 2022-11-01 13:43:39 +09:00
Jade Cho 54ea15fbf9 [GPU] Fix a bug that occurred when the optimized layer is executed. (#13568) 2022-11-01 13:43:09 +09:00
Jade Cho 36f28e5618 [GPU] Convert AvgPool to Reduce for onednn (#13037) 2022-10-07 18:25:47 +09:00
Jade Cho 25f85a3beb [GPU] Fix a bug of input buffer reusing for optimized-out layers. (#13349)
- revert f7e05ad402
- It was causing accuracy issue with implicit concat
2022-10-06 17:35:34 +09:00
Jade Cho f7e05ad402 [GPU] Fix a bug of reorder optimized-out (#13180) 2022-10-05 18:04:27 +09:00
Jade Cho d8b6f5485b [GPU] Fix a bug of graph optimization (#12901)
+ Use program_node to find weight node of convolution at eltwise shrinking
2022-09-07 10:43:30 +09:00
Jade Cho d9d4b6d89b [GPU] Fixed a bug of eltwise to support blocked layout when broadcast. (#12770)
+ Support bs_fs_yx_bsv32_fsv32 format
2022-08-31 23:02:08 +09:00
Jade Cho 7b03520395 Check memory allocation size of network graph (#11911)
+ Add exception handling for out of resource
2022-07-18 20:39:21 +09:00
Jade Cho 195f5df2e8 set zero-point as immediate value (#12002) 2022-07-04 19:53:50 +09:00
Jade Cho 6ce6a7662e [GPU] Support implicit crop in input transposition. (#11496)
* [GPU] Support implicit crop in input transposition.

+ Make the crop in front of quantize implicit by changing output format to bfyx.
+ Use implicit concat after quantize nodes.

* Add unit test for implicit crop and concat.

+ remove unnecessary code.
2022-05-13 18:02:13 +09:00
Jade Cho de1db99383 [GPU] Replace out scale attribute of onednn pooling with binary mul (#11674) 2022-05-13 13:34:12 +09:00
Jade Cho 070c47ec09 [GPU] fix a bug of onednn sum post-op (#11254)
+ Add a unit test for this.
2022-03-29 20:35:09 +09:00
Jade Choandhyunback a7df1531db [GPU] Code refactoring to choose between binary_add and sum (#10724)
+ Fix colorization-sig accuracy issue using oneDNN
	Memory crash in case reuse_eltwise_sum_post in oneDNN and memory_pool
	And print node in/out gpu_usm_mem addr at OV_GPU_Verbose >= 1
+ Check the size of z spatial axis for checking fulltensor.
+ Remove program_helpers's functions.

Co-authored-by: hyunback <hyunback.kim@intel.com>
2022-03-22 14:58:36 +09:00
Jade Cho dedcbeafa8 [GPU] Binary post-op support for full tensor. (#9856)
* [GPU] Binary post-op support for full tensor.

* Add unit tests

* Add a reorder if output dtype of conv layer is fp32.
2022-02-11 11:33:31 +09:00
Jade Cho 9e01cbd532 [GPU] fix a minor bug of dump graph (#9659) 2022-01-14 15:06:58 +03:00
Jade Cho 35bcb77182 [GPU] Merge reorder into next onednn conv (#9601)
+ When the format of onednn convolution is bs_fs_yx_bsv32_fsv32, the reorder for dependency primitive of fused eltwise sum is removed.
2022-01-13 18:32:50 +09:00
Jade Cho 113014161d Add a gpu func test to compare with ngraph runtime (#9591)
+ Compare conv result of gpu plugin with ngraph result.
2022-01-13 11:03:52 +03:00
Jade Cho 28e52a0475 [GPU] Fix a bug of logical padding of convolution (#9518)
* [GPU] Fix a bug of logical padding of convolution

+ Transforms logical padding with wrong axis.

* Fix a typo bug.
2022-01-11 10:37:27 +03:00
Jade Cho 2945232982 Split hard sigmoid into eltw linear and eltw clip (#9500)
+ cldnn supports hard sigmoid activation function but onednn doesn't.
+ split it into eltwise linear and eltwise clip in
add_onednn_optimization_attributes pass.
2022-01-04 20:22:11 +09:00
Jade Cho da1261a1d8 [GPU] Fix a bug in post-operation optimization (#9443) 2021-12-28 17:48:29 +03:00
Jade Cho 7bcca1b82d [GPU] Fix some bugs of cldnn eltwise kernel at bs_fs_yx_bsv32_fsv16 format. (#9198)
* Fix some bugs of cldnn eltwise kernel at bs_fs_yx_bsv32_fsv16 format.

+ Add a condition so that the eltwise_simple_vload8 kernel is not selected when the tensor is not aligned as bsv32_fsv16 or bsv32_fsv32.
+ Optimize gws/lws of eltwise_ref kernel for bsv32_fsv16 format.

* Check feature align of b_fs_yx_fsv32 for eltwise vload8 kernel

+ Minor fix for OV_GPU_Help option
2021-12-22 11:43:04 +09:00
Jade Cho a4518ae595 [GPU] Add DumpLayersLimitBatch config to GPU debug utils. (#9196)
* Add DumpLayersLimitBatch config to GPU debug utils.

+ Support OV_GPU_Help config
+ Only run first inference if OV_GPU_DumpLayersPath is set.
+ Fix dump graph bug.

* Apply some comments

* Remove unnecessary code.
2021-12-20 14:19:53 +09:00
Jade Cho 7842b636c9 Fix a bug of benchmark_app for binary input filling. (#8960) 2021-12-07 10:05:17 +09:00
Jade Cho 6d039f7eb5 Add exeception message to check available frontends. (#8914) 2021-12-03 10:47:51 +09:00
Jade Cho a9a583eb42 [GPU] Fix graph dump issue. (#8965) 2021-12-02 17:25:20 +03:00
Jade Cho d4820b1bc7 [GPU] Fix a bug of remove redundant reorder pass (#7995)
+ Avoid dangling node exception
2021-10-14 11:59:10 +03:00
Jade Cho 595222e9c6 [GPU] Merge minor updates. (#7975)
+ Prevent to fuse PRelu if convolution is onednn impl.
+ Prevent to remove input reorder if onednn conv converts format from bfyx to b_fs_yx_fsv32.
+ Add a value to optimal lws values for eltwise kernel selector.
+ Fix a condition of remove redundant reorder. (try_fuse_reorder_bfyx_to_fsv32)
2021-10-14 14:06:05 +09:00
Jade Cho 15c98bbf8c [GPU] Merge prepare_buffer_fusing updates (#7878)
* [GPU] Merge prepare_buffer_fusing updates

+ Disable choosing implementation using TBB if immad is supported

* [GPU] Apply comments
2021-10-08 15:31:51 +09:00
Jade Cho d29648164a [GPU] Merge activation_ref kernel update. (#7767)
+ Support b_fs_yx_fsv32, bs_fs_yx_bsv32_fsv32 and bs_fs_yx_bsv32_fsv16 format.
2021-10-06 12:38:54 +09:00
Jade Cho d89b146259 [GPU] Merge mvn kernel updates (#7736)
* [GPU] Merge mvn kernel updates

+ Support bs_fs_yx_bsv32_fsv32 format for i8 and u8 dtype.
+ Support bs_fs_yx_bfv32_fsv16 format for fp16 dtype.

* [GPU] Fix a bug of resample kernel selector.

* [GPU] fix a build error of mvn unit tests
2021-10-05 16:22:33 +09:00
Jade Cho 1e6fd56e01 [GPU] Merge kernel updates (#7699)
+ fix a bug due to bias type mismatching
  - convolution_gpu_bfyx_to_bfyx_f16

+ refactoring
  - depth_to_space_kernel_base
  - depth_to_space_kernel_ref

+ Adjusting LWS
  - eltwise_kernel_base
2021-09-29 17:10:53 +09:00
Jade Cho 54a7ecb725 [IE CLDNN] Optimize reduce fsv16 primitive when out_x=out_y=1 (#4261) 2021-02-24 10:25:36 +03:00