Commit Graph
609 Commits
Author SHA1 Message Date
Vladimir Dudnik 9fe4db56fe [GPU] fix gpu tests --help and memory leak (#15055) 2023-01-13 14:00:43 +04:00
Taylor Yeonbok Lee 33b2e72048 Fix cl source dump file name not to be overwritten (#15035) 2023-01-12 09:27:57 -08:00
Vladimir Paramuzov 9c7beee5e5 [GPU] Added missing supports_image initialization in EngineInfo. Fix some kernels with image support (#14885) 2023-01-12 12:06:01 +03:00
Andrew Kwangwoong Park 9d574e6041 Fix strided slice for clamped out-of-bounds begin/end with negative stride (#15059)
Signed-off-by: Andrew Park <andrew.park@intel.com>

Signed-off-by: Andrew Park <andrew.park@intel.com>
2023-01-12 07:09:25 +00:00
Vladimir Paramuzov 4feaeaad68 [GPU] Remote context reuse and internal config update (#14635) 2023-01-11 11:14:03 +00:00
Steve Yoo 2e10a1cb13 Added trucation mode to reorder for convert (#14090)
* Apply convert trucation

* Added trucation mode to reorder for convert

* Added unittest

* convert_long not casting
2023-01-10 22:46:15 -08:00
Andrew Kwangwoong Park e0359d3085 [GPU] Enable Deconv/GroupDeconv shape infer (#15005)
* Update deconv primitive APIs for dilations and output_padding

Signed-off-by: Andrew Park <andrew.park@intel.com>

* Add calc_output_layouts for deconv

Signed-off-by: Andrew Park <andrew.park@intel.com>

* Add deconv shape inference TCs for ov_gpu_unit_tests

Signed-off-by: Andrew Park <andrew.park@intel.com>

* Add deconv dynamic TCs for ov_gpu_func_tests

- Disable pre_replace_deconv for dynamic shape
- Update get_expected_layout for deconv_node during reorder_input
- Add I/O swap of weights for shape infernece

Signed-off-by: Andrew Park <andrew.park@intel.com>

* Add group deconv dynamic TCs for ov_gpu_func_tests

- Update op creation for group deconv

Signed-off-by: Andrew Park <andrew.park@intel.com>

* Fix clang-format

Signed-off-by: Andrew Park <andrew.park@intel.com>

* Update test params with swapped I/O dimensions for ov_gpu_unit_tests

Signed-off-by: Andrew Park <andrew.park@intel.com>

* Update for optional output_shape const/param input support

Signed-off-by: Andrew Park <andrew.park@intel.com>

* Update deconv/group deconv dynamic TCs w/ output_shape for ov_gpu_func_tests

Signed-off-by: Andrew Park <andrew.park@intel.com>

* Update deconv/group deconv shape inference TCs w/ output_shape for ov_gpu_unit_tests

Signed-off-by: Andrew Park <andrew.park@intel.com>

* Apply code review

Signed-off-by: Andrew Park <andrew.park@intel.com>

Signed-off-by: Andrew Park <andrew.park@intel.com>
2023-01-10 22:09:47 -08:00
Ilya Lavrenov efa5c51122 Compilation for WebAssembly: part 1 (#15008) 2023-01-10 13:02:22 +04:00
Vladimir Paramuzov 028cf7a34d [GPU] Code cleanup (#14974) 2023-01-09 15:43:26 +04:00
Min, Byungil c7957d8ca6 Bugfix build issue of onednn test (#14998)
* Bugfix build issue of onednn test
+ Remove invalid referencing if ENABLE_INTEL_CPU is off
+ Removed unnecessary include

Signed-off-by: Min, Byungil <byungil.min@intel.com>
2023-01-09 18:20:01 +09:00
Min, Byungil c4cd3e152b [GPU] Make generic logic to find formats from meme::desc (#13730)
* [GPU] Make generic logic to find formats from meme::desc
+ Added test-cases

Signed-off-by: Min, Byungil <byungil.min@intel.com>
2023-01-06 18:12:51 +09:00
Jade Cho c1f6da31b6 [GPU] Add substract post-op for onednn (#14947) 2023-01-06 17:18:25 +09:00
Andrew Kwangwoong Park efb602e13b [GPU] Update strided slice impl for non-constant begin/end/stride support (#14619)
* Add strided slice dynamic TCs for gpuFunctests

Signed-off-by: Andrew Park <andrew.park@intel.com>

* Update StridedSliceLayerGPUTest for rest inputs's type (parameter)

Signed-off-by: Andrew Park <andrew.park@intel.com>

* remove W/A for strided slice

Signed-off-by: Andrew Park <andrew.park@intel.com>

* primitive API updates for dynamic begin/end/stride inputs support

Signed-off-by: Andrew Park <andrew.park@intel.com>

* Update ocl impl and kernel param, and strided_slice_ref kernel w/o memory_deps

Signed-off-by: Andrew Park <andrew.park@intel.com>

* Update TCs for new API w/ vectors on strided_slice_gpu unittests

Signed-off-by: Andrew Park <andrew.park@intel.com>

* Apply code review

Signed-off-by: Andrew Park <andrew.park@intel.com>

* Apply padding when the size of rest input data is smaller than actual input rank

Signed-off-by: Andrew Park <andrew.park@intel.com>

* Update strided_slice_optimize pass to run onyl when all deps are constant

Signed-off-by: Andrew Park <andrew.park@intel.com>

Signed-off-by: Andrew Park <andrew.park@intel.com>
2023-01-05 13:31:32 +03:00
Min, Byungil 0d261dbf83 Add decomposing Reduce for Bugfix of byx reduction (#14449)
+ Add transformation to fix accuracy issue of oneDNN reduction : DecomposeReduceForFalseKeepdims
+ Add Reshape to modify output of Reduce and update keep_dims to true : reduce-reshape
+ Add exception logic for unsupported reduce mode by byx conversion

Signed-off-by: Min, Byungil <byungil.min@intel.com>
2023-01-05 15:44:12 +09:00
Jade Cho 9427623046 [GPU] Swap XY axis for 1D conv (#14362) 2023-01-05 14:58:55 +09:00
Wilson Seok e422b5acb4 [GPU] fix strided_slice_optimize for 5d new axis output, typo in strided_slice cl kernel, avoid handle_reshape when user is only one (#14812)
* fix strided_slice_optimize for 5d new axis output, typo in strided_slice cl kernal, avoid handle_reshape when user is only one

* fix unit test of resample_eltwise_fusing_through/12
2023-01-05 10:36:16 +09:00
Vladimir Paramuzov e23b8492c5 [GPU] Change default infer precision to fp16 (#14752) 2023-01-04 15:55:44 +04:00
Vladimir Paramuzov 5a4dbb6760 [GPU] Enable oneDNN primitives cache (#14835) 2023-01-02 13:44:43 +04:00
Felix Dohyun Kim 9cde294b7f [GPU][DG2] Fix unit test: test_select_preferred_formats.setting_target_conv_format (#14837)
* Fix wrong weight shape
* Output layout initialization
* Ensure preferred output format is selected
2023-01-02 17:36:18 +09:00
Sergey Shlyapnikov 19fde3fee6 [GPU] Peak memory usage optimizations (#14799) 2023-01-02 09:51:19 +04:00
a856dc4776 [FP16] Keep ShapeOf and Sensitive Subgraphs in FP32 for GPU (#14822)
* keep Shape subgraph in FP32 for GPU

* replaced ngraph:: -> ov:: namespace

* renamed ConvertModelToFP16ElementType -> ConvertCompressedToMixedPrecision and other passes; removed unnecessary argument for the pass

Signed-off-by: Pavel Esir <pavel.esir@intel.com>

* Update src/common/transformations/src/transformations/common_optimizations/convert_compressed_to_mixed_precision.cpp

* Update src/common/transformations/src/transformations/common_optimizations/convert_compressed_to_mixed_precision.cpp

* rephrase calling of ConvertPrecision to avoid error of an unused variable

* Update convert_compressed_to_mixed_precision.cpp

* placed calling of ConvertCompressedToMixedPrecision into the beginning of CommonOptimizations

* Update transformations_pipeline.cpp

* refactored unit-tests

* cleared obsolete commented line

* code style fix

* Update src/common/transformations/src/transformations/common_optimizations/common_optimizations.cpp

Co-authored-by: Maxim Vafin <maxim.vafin@intel.com>

Signed-off-by: Pavel Esir <pavel.esir@intel.com>
Co-authored-by: Roman Kazantsev <roman.kazantsev@intel.com>
Co-authored-by: Maxim Vafin <maxim.vafin@intel.com>
2022-12-31 16:25:13 +03:00
Vladimir Paramuzov 13c8b4fdc7 [GPU] Better extension requirements checks in kernels. Subgroups basic emulation (#13926) 2022-12-29 09:08:05 +04:00
Jade Cho 4831a9ead4 [GPU] Fix a bug to miscalculate feature-axis index for fused-ops (#14737) 2022-12-29 09:29:08 +09:00
Vladimir Paramuzov d2d952fb50 [GPU] Rename GPU unit and func tests (#14719) 2022-12-28 11:13:28 +01:00
Felix Dohyun Kim ea3a37b1ba [GPU][DG2] Fix some unit tests (#14413)
* update default_tolerance
2022-12-28 16:10:39 +09:00
Wang Wangwangandyanlan song b8636222c3 Apply ov::execution_devices to GPU & CPU & AUTO BATCH & MULTI (#14109)
* Apply ov::execution_devices to GPU & CPU & AUTO BATCH & MULTI

* Apply ov::execution_devices to GNA

Co-authored-by: yanlan song <bell.song@intel.com>
2022-12-28 10:41:50 +04:00
Vladimir Paramuzov 31d91033d9 [GPU] new shape infer for several trivial primitives (#14803)
* [GPU] new shape infer for several primitives

* [GPU] Make forwatd_input0_shape method tempalte
2022-12-28 09:12:46 +04:00
Felix Dohyun Kim 1c99fa265b [GPU][DG2] Fix gemm unit tests (#14720) 2022-12-27 12:32:42 +09:00
Vladimir Paramuzov 06c2d3da52 [GPU] Fixed debug graph dump (#14806) 2022-12-26 18:47:35 +04:00
Eddy Kim 0ce82204bb [GPU] Serialization of loop primitive (#14703) 2022-12-26 13:28:55 +04:00
Vladimir Paramuzov 3414fc402a [GPU] Rename exec mode options (#14798) 2022-12-23 17:02:31 +04:00
Sergey Shlyapnikov 901e7982d6 [GPU] Fix Experimental Detectron ROI Feature Extractor pyramid levels indexing and Experimental Detectron DO in case of class_agnostic_box_regression option (#14700) 2022-12-21 15:11:33 +04:00
Vladimir Paramuzov 04c0dbbf60 [GPU] Fix shape infer for 0d broadcast (#14744) 2022-12-21 09:39:20 +04:00
Felix Dohyun Kim fcd33063be [GPU][DG2] Fix deconv unit tests (#14176)
* Quantize clamp optimization(prepare_quantization.cpp:227) for cldnn is not proper to onednn.
  * cast intermediate variable to output type after ~
  * cldnn: every fused quantization.
  * onednn: all post-ops are processed.
* A little perf regression expected in onednn because clamp is relatively heavier operation than type casting.
* Remove deconv workaround from PR #14139
2022-12-21 11:39:57 +09:00
Andrei Gorbachev 25671ca219 [GPU] Fix convert color I420 (#14679) 2022-12-20 20:02:46 +03:00
Sergey Shlyapnikov f02c663a1d [GPU] Fix eltwise fusions in case of LT_ALIGNED_READ and vec_size>1 (#14275) 2022-12-20 12:13:15 +04:00
Vladimir Paramuzov 6bc4f00695 [GPU] Refactored GPU verbose utils (#14549)
* [GPU] Refactored GPU verbose utils

* [GPU] More refacoring

* Fix build
2022-12-20 11:06:01 +04:00
Vladimir Paramuzov ee256e801c [GPU] Removed legacy public gpu config and related processing (#14707) 2022-12-19 11:19:07 +04:00
Taylor Yeonbok Lee 05159b8cfb [GPU] Fixed shape infer dep for blocked format (#14646)
* Fixed shape infer dep for blocked format

* Set preferred format for shape_of to be made from input rank
- ShapeOf should get the original output layout of the previous node, which is not reorderd.
2022-12-18 20:03:23 -08:00
Eddy Kim b46dd308d6 [GPU] Updated to get lockable memories for device inputs in prepare_input() (#14418)
* updated to get ockable memory for device inputs

* gpuFuncTest to set f64 scalar tensor

* aligned type names

* updated to get lockable memory for some specific precisions

* add a function to get a supported precision
2022-12-16 09:12:47 +04:00
Vladimir Paramuzov fa1cddf278 [GPU] Use ASSERT_* instead of EXPECT_* in most of the cases (#14535) 2022-12-16 09:09:57 +04:00
Felix Dohyun Kim cecea2ef99 [GPU] Add device suffix option for functional tests (#13808) 2022-12-13 17:17:44 +04:00
Vladimir Paramuzov 78bd280a30 [GPU] Fix invalid memory access in lrn fsv16 kernel (#14536) 2022-12-13 17:16:13 +04:00
Sergey Shlyapnikov 9f481e8eaa [GPU] Fix Pad Primitive shape inference (#14282) 2022-12-13 16:59:55 +04:00
Jade Cho 347e844153 [GPU] Fix a bug to not apply f-axis offset to oneDNN concat (#14590) 2022-12-13 17:12:59 +09:00
Vladimir Paramuzov c581bbd6dd [GPU] Fixed invalid offset for tensor with batch padding (#14460) 2022-12-13 09:14:59 +04:00
Wilson Seok c16cee4624 fix PR14422 regression for using arg_max_min opt kernel (#14487) 2022-12-09 00:37:29 -08:00
Felix Dohyun Kim 4e85612cfb [GPU][DG2] Change tanh to relu in fusion unit tests (#14325)
* fix tanh activation fusecount error
* expected_fused_primitives_onednn
* add onednn fused to mvn test param
* add onednn fused to pooling test param
2022-12-08 16:53:09 +09:00
Sungeun Kim b799e3eb91 [GPU] set b_fs_yx_fsv32 for first conv and dt is U8. (#14454)
* set b_fs_yx_fsv32 for first conv and dt is U8.

* check input format is bfyx.
2022-12-08 16:52:30 +09:00
Vladimir Paramuzov 6df011c9f6 [GPU] Use transformed gemm shapes for layout optimizer checks (#14407) 2022-12-08 09:12:02 +04:00