Commit Graph
7496 Commits
Author SHA1 Message Date
River Li c4fdcafa70 Enable unit test for OV 2.0 C API (#11828) 2022-06-13 13:37:59 +08:00
River Li 0571124fd3 Fix CC issues for transformation and snippets (#11798)
* Fix CC issues for transformation and snippets

Matcher should be enabled if it was hit during analyze stage.

* Fixed 3 naming issue
2022-06-13 13:36:35 +08:00
Luo Cheng c848e138f8 [CPU] cherry-pick: Fix possible data race when accessing global reorder list (#11829)
* [CPU] cherry-pick: Fix possible data race when accessing global reorder list

* rebase onednn
2022-06-13 13:11:53 +08:00
Eddy Kim 3961a241cd Revert "Disable fc_int8_inputs_fused_fp32_sum (#11709)" (#11863) 2022-06-13 13:25:59 +09:00
Sieun Kim 6e3dd4adce Update scatter nd update kernel to support blocked_formats (#11533)
* draft pr for planar and fsv16

* draft pr for general test

* update fusion test (failing)

* update fusing test (pass)

* update fusing test (include exception)

* clean gpu unit test

* review comment applied

* unit test cases added & cpplint applied

* cpplint error fixed

* change gpu test cases for fp16

* fusing test fix generate_unique_indices

* fix typo

* revise cl kernel for occasions when updates shape is altered
2022-06-13 13:25:24 +09:00
Paul Youngsoo Ahn ca7ddae9ba [GPU][Coverity] Fix coverity defects (#86191) (#11852)
- CID 1486993 Big parameter passed by value (PASS_BY_VALUE)
- CID 1489431 Uninitialized scalar variable
- CID 1489432 Uninitialized scalar variable
2022-06-13 02:51:45 +00:00
Sungeun Kim 9bda2bd580 lws quantize/eltwise (#11851) 2022-06-13 11:18:49 +09:00
Felix Dohyun Kim d831047f30 [GPU] Optimize DepthToSpace (#11761)
* lws optimize
2022-06-13 11:17:22 +09:00
Luwei Zhou 0066ddbd22 Update onednn submodule hash to fix 3D deconv post-ops issue. (#11836) 2022-06-13 09:21:29 +08:00
Luwei Zhou c73f6576e0 Luwei/extend reorder test (#10003)
* Extend the reorder unit test.

* Update CMake

* fix somme issues.

* Update

* Update

* Update

* Update

* Update and fix caused by input portconfig only support NCSP.

* Update Copyright

* Add more tests

* Apply review comments.

* Update

* Update

* Fix building error.

* Applied review comments.

* Update

* Update

* Update

* Fix CI

* Update

* Update Cmake
2022-06-11 21:09:26 +08:00
Mateusz Bencer 8e9eaaee91 [FakeQunatize] Use shape from HostTensor instead of FakeQuantize* (#11843) 2022-06-10 17:57:03 +03:00
mei, yang 38a81ec486 update and reorder supported paddle op list (#11601) 2022-06-10 18:46:11 +08:00
guozhong wang 408bdc9f81 add single IECore for core_threading test (#11796) 2022-06-10 08:25:12 +03:00
Bo Liu 79d3fbe3c1 remove limitation usage of brgemm for 'FullyConnected' Node (#11783) 2022-06-10 10:19:41 +08:00
Chenhu Wang 1066d4551f fix_nms_ops_transformation (#11794)
* fix_nms_ops_transformation

* replace node when 5-9
2022-06-10 10:18:28 +08:00
Chenhu Wangandmandrono 604dc4589c [CPU] Deconvolution caching support (#11835)
* Deconvolution caching support

* get ride of deprecated name

Co-authored-by: mandrono <maxim.andronov@intel.com>
2022-06-10 10:17:59 +08:00
Chenhu Wang e2e7417c2a load_store_emitters_optimization_and_apply_to_interpolate (#11742)
* load_store_emitters_opt_and_apply_to_interpolate

* zmm_zero_is_always_needed_on_all_platform
2022-06-10 10:17:29 +08:00
opoluektov-lohika d87233863d Fix experimental detectron do ref impl (#10621) 2022-06-10 03:10:13 +03:00
Tomasz Dołbniak 0932c74ff8 GridSample operator (#11770) 2022-06-09 14:21:53 +00:00
Andrew Kwangwoong Park 5fa669785c [GPU] Update reorder_inputs for data type conversion on fc layer (#11832)
Signed-off-by: Andrew Park <andrew.park@intel.com>
2022-06-09 15:18:28 +09:00
8faf8f2d89 OV 2.0 C API (#11700)
* Initial files & cmakefiles for ov 2.0 c api development

Signed-off-by: xuejun <Xuejun.Zhai@intel.com>

* Add all ov 2.0 C APIs define

Signed-off-by: xuejun <Xuejun.Zhai@intel.com>

* Fix review comments

Signed-off-by: xuejun <Xuejun.Zhai@intel.com>

* Disable test of OV 2.0 C APIs test for tmp

Signed-off-by: xuejun <Xuejun.Zhai@intel.com>

* Add related property key for ov 2.0 C-API

Signed-off-by: xuejun <Xuejun.Zhai@intel.com>

* Add description for ov_property_key_e

Signed-off-by: xuejun <Xuejun.Zhai@intel.com>

* Add EXECEPTION handling

Signed-off-by: xuejun <Xuejun.Zhai@intel.com>

* compiledModel add interface

* add inferrequest interface

* solve cpplint problem

* Finished OV 2.0 C-APIs PPP related development

Signed-off-by: xuejun <Xuejun.Zhai@intel.com>

* Fix code review issues

Signed-off-by: xuejun <Xuejun.Zhai@intel.com>

* Add ov::tensor API

* add compiled model func

* Finished C-API funs about core, model, node development

Signed-off-by: xuejun <Xuejun.Zhai@intel.com>

* [OV 2.0 C-API] add const to ov_output_node

Signed-off-by: xuejun <Xuejun.Zhai@intel.com>

* [OV 2.0 C-API] Using define GET_OV_ELEMENT_TYPE & GET_CAPI_ELEMENT_TYPE in tensor APIs

Signed-off-by: xuejun <Xuejun.Zhai@intel.com>

* [OV 2.0 C-API] add string initialize

Signed-off-by: xuejun <Xuejun.Zhai@intel.com>

* add inferrequest func

* add move construction to runtime_model

* supplement two infer request interface functions

* [OV 2.0 C-API] Add the common framwork of unit test

Signed-off-by: xuejun <Xuejun.Zhai@intel.com>

* modify ov_infer_request_get_profiling_info

* add tests dir

* restore CMakeLists.txt

* Fix the bug of COPY in Tensor

* [OV 2.0 C API] Finished core related function unite test

Signed-off-by: xuejun <Xuejun.Zhai@intel.com>

* Add ov:Tensor API test

* [OV 2.0 C API] fix some review issues

Signed-off-by: xuejun <Xuejun.Zhai@intel.com>

* add some infer request test

* add compiled model test

* [OV 2.0 C API] Finished preprocess related function unite test

Signed-off-by: xuejun <Xuejun.Zhai@intel.com>

* [OV 2.0 C API] Fix review issues

Signed-off-by: xuejun <Xuejun.Zhai@intel.com>

* [OV 2.0 C API] Modify to use default model

Signed-off-by: xuejun <Xuejun.Zhai@intel.com>

* transfer device_name from fix value to parameter

* add some infer request test

* remove compiled model get_property test

* add infer request tests

* Add ov::model Test and modify Tensor Test name

* Determine whether partial shape meets the standard

* Add get tensor name function and Modify reshape test case

* modify fixed tensor name,remove unnecessary comparison

* add ov_model_get_nodes_info, modify according to comments

* Update reshape test

* extract common function, modify interface about get tensor name,shape and type

* modify according comments

* [OV 2.0 C API] Finished hello classification with ov 2.0 c-api development

Signed-off-by: xuejun <Xuejun.Zhai@intel.com>

* [OV 2.0 C API] Fixed hello classification with ov 2.0 c-api review issues

Signed-off-by: xuejun <Xuejun.Zhai@intel.com>

* [OV 2.0 C API] delete inactive code hello classification with ov 2.0 c-api

Signed-off-by: xuejun <Xuejun.Zhai@intel.com>

* Fix clang format issue

* [OV 2.0 C API] rename

Signed-off-by: xuejun <Xuejun.Zhai@intel.com>

* Fix windows build erre

Signed-off-by: xuejun <Xuejun.Zhai@intel.com>

* Apply qsort for sorting data

Apply qsort for sarting data
Fix issues of "potentially uninitialized local pointer variable"

* Not use deprecated INSTANTIATE_TEST_CASE_P for c api gtest

INSTANTIATE_TEST_CASE_P is deprecated, should use INSTANTIATE_TEST_SUITE_P.

* Fix some review issues

Signed-off-by: xuejun <Xuejun.Zhai@intel.com>

* [Ov 2.0 C API] Add error info

Signed-off-by: xuejun <Xuejun.Zhai@intel.com>

* Fix some review issues

Signed-off-by: xuejun <Xuejun.Zhai@intel.com>

* Fix review issues

Signed-off-by: xuejun <Xuejun.Zhai@intel.com>

* polish error message for ov c api

* Redefined ov_shape_t, ov_partial_shape_t and ov_layout_t. Modified functions and test cases involving these variables

* Added the conversion between char* and partial_shape

* Add partial_shape_to_shape

* prune code

* modify split

* Use regex to split and search pattern

* Modify str_to_char_array delete

* Add the judgment of rank

* Fix compiling error

Fix issue: address of array 'shape.dims' will always evaluate to 'true'  if -Wpointer-bool-conversion

Co-authored-by: xuejun <Xuejun.Zhai@intel.com>
Co-authored-by: sunxiaoxia2022 <xiaoxia.sun@intel.com>
Co-authored-by: ruiqi <ruiqi.yang@intel.com>
2022-06-09 10:39:07 +08:00
Roman Baranchuk 0231637441 [CPU] GatherTree: dynamic shapes support (#11544) 2022-06-09 10:18:51 +08:00
Karol Blaszczak fe41b8eacc Docs multiplugin page-wide tabs merge (#11461) (#11784)
* Docs multiplugin page-wide tabs merge

porting to master changes aligning multi plugin with other articles already present in 22.1

* Update docs/snippets/MULTI4.cpp

* Update docs/snippets/MULTI4.cpp
2022-06-08 16:56:37 +02:00
hyunback kim 41a0d3a0f8 [GPU] Add oneDNN zero point value debug log. (#11817)
* [GPU] Add oneDNN zero point value debug log.

Signed-off-by: hyunback <hyunback.kim@intel.com>
2022-06-08 22:01:16 +09:00
Sungeun Kim 2c4cb88862 [83906] DG2 Systolic engine not getting used for fp16 Action Recognition model (#11815)
* shallow feature convolution needs to set by zyx_fsv2

* bug fix: wrong get_output_layout calling in is_mixedLayout
2022-06-08 16:48:40 +09:00
Mykhailo Hnap 9ee9f880bd [GPU] Implement Bucketize-3 (#11738)
* [GPU] Implement Bucketize-3

* Add i8 and u8 to evaluates map for bucketize op.
2022-06-08 15:47:19 +09:00
yanlan songandChen Peter bd02415ad5 enable binder schedule for preview (#11763)
* enable binder schedule

Signed-off-by: fishbell <bell.song@intel.com>

* add cases

Signed-off-by: fishbell <bell.song@intel.com>

* refine

Signed-off-by: fishbell <bell.song@intel.com>

* fix build failure

Signed-off-by: fishbell <bell.song@intel.com>

* fix coredump

Signed-off-by: fishbell <bell.song@intel.com>

Co-authored-by: Chen Peter <peter.chen@intel.com>
2022-06-08 10:02:33 +08:00
Tetiana Gubanova a3cd2bcc49 [GPU] Implement Reverse operation (#11672)
* Reverse operation single-layer test

* Reverse CreateOp(), primitive and kernel selector

* Implement Reverse CL kernel

* Implement reverse GPU unit tests

* Add boolean as extended input type to reverse operation
2022-06-08 09:46:52 +09:00
Steve Yoo 263c184b97 Fix deformable convolution cl kernel for Multi-Groups (#11613)
* Fix deformable convolution cl kernel for multi group and add its test cases

* Add batch 2, 3, 4 test case to multiple groups
2022-06-08 09:45:42 +09:00
David Nam 755394c1cb [GPU] Use IE_THROW() instead of throw std::runtime_error (#11769)
* Use IE_THROW() instead of throw std::runtime_error

* Change all of throw std::runtime_error into IE_THROW()
2022-06-08 09:44:59 +09:00
Karol BlaszczakandYuan Xu e70074d9db DOCS-clear out the integrate_with_app article (#11799)
* DOCS-clear out the integrate_with_app article

* Update docs/OV_Runtime_UG/integrate_with_your_application.md

Co-authored-by: Yuan Xu <yuan1.xu@intel.com>

Co-authored-by: Yuan Xu <yuan1.xu@intel.com>
2022-06-07 21:52:27 +02:00
Karol Blaszczak 275f2adf52 DOCS-add supported PdPd models (#11804) 2022-06-07 21:51:17 +02:00
Eddy Kim 3a5805fce0 quick fix in tests (#11812) 2022-06-07 15:22:39 +00:00
hyunback kim 98f989302a [GPU] Update to use immad with oneDNN test case. (#11808)
Update correct test case

Signed-off-by: hyunback <hyunback.kim@intel.com>
2022-06-07 17:08:23 +03:00
Felix Dohyun Kim 1c9cd04f96 [GPU] Enable blocked formats in Gather primitive (#11486)
* gather blocked format
* enable double blocked
* 5d test
* support cross dimension
* Add some disabled test for later use
* Support non-default planar formats
2022-06-07 17:50:09 +09:00
Felix Dohyun Kim c1f4cc04de [GPU] Enable blocked formats in Border primitive (#11652)
* fix default_value of border tensor parameters
* Enable all in/out layout
2022-06-07 17:39:57 +09:00
Min, Byungil 49942c2f80 [GPU] Forcing to use clDNN FC on small batch size (#11715)
+ forced to use clDNN FC due to perf drop

Signed-off-by: byungilm <byungil.min@intel.com>
2022-06-07 10:25:14 +03:00
Kelvin Choi f9afe07c9d [GPU] Add reorder between FC matmal and reshape (#11706) 2022-06-07 13:10:58 +09:00
Mateusz Bencer 7335984edd [MO] Check only source layout if both changing layout and reverse input channel is applied (#11779) 2022-06-06 17:46:07 +02:00
Min, Byungil 104a9d8d52 Add debug config for forcing impl type of fc (#11713)
+ Added new debugging config OV_GPU_ForceImplType to set impl type

Signed-off-by: Min, Byungil <byungil.min@intel.com>
2022-06-06 23:02:34 +09:00
bb3868d8cd [CPU] OneDNN 2.6 migration (#11627)
* Migrate on OneDNN 2.7

* [CPU] Enabled brconv implementation

* Post ops optimizations

* [CPU] Enabled I8 precision on activations for Convolution node

* [CPU][WA] Disabled Deconvolution + post ops fusing optimization

* Fixed FQ post op optimization

* [CPU] Optimize post ops processing

* [WA] Add node name if tensor names are empty

* [WA] remove  layout compatibility chheck that leads to the fase-positive exceptions

* [CPU] Optimize processing for FQ + Sum + FQ post ops pattern

* [CPU][WA] Enabled ReduceSum -> AvgPool transformation due to perf issues

* fix compiler error

* rebase onednn master

* cherry pick from 2.7 to 2.6

* [WA] make cpu case to run completed

* fix xmm zero check

* reopen 'FuseDeconvolutionAndSimpleOperation' Transform  to fix CPU 'ConvolutionBackpropDataLayerTest' fail issue

* [WR] Removed failed the ReduceMean tests caused by 21f3555.

* group deconv may crash on memory out of bound

* [WA] Remove the moc fail case by #af4731a1

* testcase conv maxpool will check brgconv instead of jit

* test subgraph added nhwc format check

* fix gemm bf16 win crash

* fix avx2 groupconv accuracy problem

* [WA] remove invalid FQ tests

* WR to disable the LPT multiplyToGroupConv test because the  transformation was disabled in d5e16f

* add gemm int8 binary postops to fix GroupConvolutionQDqTransformation fail

* add gemm int8 binary postops to fix GroupConvolutionQDqTransformation fail

* fix gemm bf16 fail

* Fix ConcatConvSumInPlaceTest

* Add cpuDebugFuncTests target

* [WA] bf16 crash due to MemoryInput/Output

* OVClassBasicTest case typo

* testcase subgraph sets default ENFORCE_BF16 to NO

* fix clang check

* Fix primType check issue

* Fix cpplint error

* MemoryInput/Output support bf16; Enforce bf16 'NO' should enable snipptes

* disable BF16 fusing fakequant testcase

* testcase init support amx check

* testcase for conv brgconv avx512/amx

* testcase for conv brgconv avx512/amx

* WR enforce reorder bug and add NSPC into deconv supported list.

* Compiling issue fix.

* [WA] skip fakequantize fusing in bf16

* mix legacy/new binary postops

* make nightly case run. tested on amx/avx512/avx2.

* [CPU] Add BF16 AMX test for Matmul

* Add CPU dump check tool

* Add verbose log

* Generate exec graph in cpu dump check tool

* fix binary prelu post Ops

* fix cpplint

* Update ONEDNN version to fix AVX2 bug.

* cpu dump check supports compare dump files

* Add a new CPU_DEBUG_CAPS: OV_CPU_SUMMARY_PERF

* change VERBOSE_LOG to DEBUG_LOG

* fix oneDNN register_jit_code log

* fix cpplint

* Add OV_CPU_DEBUG_LOG controls debug logs to show

* Revert reorder WR.

* Enhanced CPU debug logs and breakpoint support

* Enhanced cpu_dump_check with --ports

* Fix DEBUG_LOG compile issue

* GroupDeconvolutionLayerCPUTest extend to add amx test cases

* Add Node into DBUEG_LOG

* cpu_dump_check: Dump results even no port is specified

* FIx MergeTransposeAndReorder for blocked input

* Fix cpu_dump_check result names

* Enhance DEBUG_LOG on edges

* Cpu dump check support shape mismatch

* Fix bi-directionl inplace

* Cpu dump check support inference_precion_hing f32.

* fix windows dump fail.

* fix depthwise nwc conv

* add rtol arg

* win debugbreak

* fix pooling accuracy

* GroupDeconvolutionLayerCPUTest remove invalid test param for nspc

* recover ov onednn fork

* revert af4731a1f1 '[WA] remove layout compatibility chheck'

* [WA] disable avx2 conv3d fusing case

* [WA] disable avx2 conv3d fusing case

* [WA] Disabled weights md transpose in FC to prevent perf degradations

Co-authored-by: dmitrygo <dmitry.gorokhov@intel.com>
Co-authored-by: Vladislav Golubev <vladislav.golubev@intel.com>
Co-authored-by: Zhang Yi3 <yi3.zhang@intel.com>
Co-authored-by: liubo-intel <bo4.liu@intel.com>
Co-authored-by: Luwei Zhou <luwei.zhou@intel.com>
Co-authored-by: Li, Tingqian <tingqian.li@intel.com>
Co-authored-by: xuchen-intel <chen.xu@intel.com>
Co-authored-by: ceciliapeng2011 <cecilia.peng@intel.com>
2022-06-06 18:30:32 +08:00
Helena Kloosterman 764a2ec012 Fixes for OpenCV script filename in docs (#11791) 2022-06-06 16:42:04 +08:00
guozhong wang d3b7a1b86c fix cumulative donot handle nireq (#11775) 2022-06-06 10:10:05 +08:00
Artur Kulikowski 32580ca65b Add ReduceMerge transformation (#11746)
Tickets: 60918
2022-06-04 13:44:50 +02:00
Sungeun Kim 8029fd9675 add mixed precision case (#11747) 2022-06-04 11:40:52 +09:00
Mateusz Bencer dba4dbb9d6 Improve L2NormFusion transformation (#11765) 2022-06-03 18:51:21 +02:00
Mateusz Tabaka 4650ecd0b5 Disable fusings_gpu/deconv_scale_activation_quantize_i8_eltwise_quantize_u8.basic/4 (#11777) 2022-06-03 21:07:48 +09:00
aea04e275c [GPU] Enable onednn reduction (#11570)
* It has better performance by using reduction kernel instead of pooling kernel in oneDNN for reduction layer.
* Stop using global pooling instead of reduce primitive
* Use oneDNN reduction if its mode is supported by optimized onedNN kernel
* activation pow is supported
* Use clDNN reduce if 3d or redundant reduce, tensor size mismatch
* Updated thirdparty onednn_gpu

Signed-off-by: Min, Byungil <byungil.min@intel.com>

Co-authored-by: Wei Tang <wei1.tang@intel.com>
Co-authored-by: Chen Kurt <kurt.chen@intel.com>
2022-06-03 18:36:27 +09:00
mei, yang b780c61506 Extend python API for GenerateProposals (#11723) 2022-06-03 10:38:02 +02:00
Krzysztof Bruniecki 4ef0aab166 Create copy of RO IR/bin file mapped Blob to allow converting from NCHW to NHWC (#11771) 2022-06-03 08:38:52 +02:00