Commit Graph
792 Commits
Author SHA1 Message Date
Pawel Raasz 56f51135d4 Grey preprocessing yuv nv12 i420 (#18239)
* Add two plane YOV to Grey conversion

* Add i420 to grey conversion

* Add yuv to grey conversion for GPU

* Fix cmakes

* Remove static from local function

* Remove opencv dependency from tests

* Put grey_from_yuv_single_plane into namespace
2023-07-11 12:41:24 +02:00
Nikolay Shchegolev 88703905f4 [CPU] Leftovers for Extension convert I64/U64 to I32. (#16941)
* [CPU] Leftovers for Extension convert I64/U64 to I32.

* Fix as per comments

* Fixes as per commits 2

* Fixes as per commits 3

* Revert "Fixes as per commits 3"

This reverts commit 84022be66f64faccd96a32da5611db0e5137d049.

* Some fixes

* Test fix
2023-07-11 11:42:53 +02:00
Maksim Kutakovandjialipen 900163c484 [CPU] In place memory for dynamic shapes (#17741)
* InPlace memory direction resolution pass

* Partitioned mem mngr

* Concat reshape pattern has been enabled

* Enhanced in place conflicts detection

* Refactor Concat

* Fix Reshape isExecutable call

* Split node refactoring

* Gather node inPlace special case

* Temporal WA to enable zero copy on Split input

* Process inPlace edges in order

* Fixes

* Remove implicit initialization from Edge::getMemory

* Allow NotAllocated edges call allocate

* extract IMemory interface and implements Memory class.

* IMemory fixes after merge

* Prevent input memory modification

* Minor build fixes

* Fix unittest build

* Fix for variadic concat

* Edge reference fix

* Lock based mem manager

* Return value fix

* Naming refactoring

* Use make_unique

* Split output dims check

* Special processing for empty parts

* Concat null memory fix

* Fix downstream inplace resolution

* Concat allocated edge search fix

* Variadic split clean up tests

* Variadic Split tests update

* Fix make_unique conflict

* Split inPlace tests are back

* Concat inPlace dyn shapes tests

* Add safety checks to isInputTensorAtPortEmpty

* Fix partitioned mem mngr zero size reset

* Introduce Static Memory

* Gather InPlace Tests

* InPlace conflict check in merge Reorder Transpose

* Apply review comments

* fix after rebase

---------

Co-authored-by: jialipen <cecilia.peng@intel.com>
2023-07-11 10:39:29 +02:00
Katarzyna MitrusandPawel Raasz 827fb0234b [Shape Infer] RNN/GRU/LSTM Cell & Sequence - common shape infer and review (#18009)
* rrn seq base common shape infer init

* Update and add shape infer to all seq rnn based ops

* Use shape_infer in lstm seq core op

* Use shape_infer in rnn seq core op

* Unified shape infer for rnn cell base

* Update and add missing cells shape_infer functions

* Use shpe_infer in rnn_cell

* Update shape_infer map

* shape_infer tests

* Move new shape_infer to TA map

* More tests and shape improvements

* Introduce common base tests

* Fix merge conflict

* Missing setters and default ctor tests

* Use RNNCellBase class instead of template type op

* Update v0 LSTMSequence to use RNNCellBase as parent class

* Style

* V0::LSTMSequence update

* Specify opset in shape infer registry

* Move rank check

* Output vec generation refactor

* Update num_dir_validation

* Tests warining fix

* Test types adjustment

* Commented code cleanup

* Move test helpers to test fixture

* Common default ctor tests for Cell

* Update GRU shape infer tests

* Update LSTM shape infer tests

* Update RNN shape infer tests

* File names update

* Functions renaming

* Cast hidden size in test

* Move v0::LSTMSequence conformance test

---------

Co-authored-by: Pawel Raasz <pawel.raasz@intel.com>
2023-07-11 12:38:31 +04:00
Oleg Pipikin d6c0289008 Move common test utils (#18339)
* Move common test utils

* Apply comments

* Comments 2
2023-07-10 12:48:24 +00:00
River Li 3286a405be Don't eliminate Transpose when 0 size of order_value (#18130)
* Don't eliminate Transpose when 0 size of order_value

* Remove invalid test for transpose
2023-07-10 14:58:02 +04:00
Vladislav Golubev 205de6106b [Snippets] BrgemmEmitter: blocking by K & N dimensions (#18302)
* KN blocking draft

* some fixes

* IdentifyBuffers temporary hack

* Emitter cleanup

* IdentifyBuffers cleanup

* BrgemmCopyB validation: N_blk is taken from the child BrgemmCPU

* Added blocking parameters to BrgemCPU

* accuracy fixes

* Buffers insertion removed from BrgemmToBrgemmCPU

* Added blocking parameters to BrgemmCopyB

* blocking parameters

* Blocking params configuration removed from brgemm_to_brgemm_cpu transformation

* Introduced a transformation for blocking parameters configuration

* MHA tokenization alligned with blocking matmul requirements

* Alexandra's comments applied

* Alexandra's comments applied: 2nd round

* Ivan's comments applied

* MHA tokenization: removed kernel_buffer_size related heuristics
2023-07-07 17:44:14 +02:00
Yury Gaydaychuk 33b457b097 [CPU] Fix of coverity issues (#17823)
* mvn missing else handled

* negative binarization covered

* coverity 1502464

* coverity 1504685, 1504781, 1504786

* rollback regpool diff

* code review
2023-07-07 15:24:15 +02:00
Luwei Zhou a3bd0cb4d7 [CPU] oneDNN v3.2 migration (#18094)
* [WA] Comment the onnx test.

Seems this test error would be a little bigger than expected error.

* Remove the softmax CPU function test filter because onednn merge all
ISAs into one primitive.

* Fix zero point issue.

* Remove wino conv test cases because ONEDNN3.2 does not supported.

* Fix cpu debug log verbose

* Update onednn to squash commit version.

* Applied tolerance threashold for onnx_model_bias_gelu test.

* Restore to fix ICX perf regression.

* Clean  winograd related code.

* Update ONEDNN to support ARM.

* Applied review comments.
2023-07-07 11:12:02 +02:00
Aleksandr Voron 2b795afc09 fix multi-axis reduce transformation (#18414) 2023-07-07 10:56:09 +04:00
Wanglei Shen d571ab3a12 enable numa_node_id and socket_id in streams_info_table (#18164)
* enable numa_node_id and socket_id in streams_info_table

* fix code style issue

* fix document issue

* update for comments

* update for comments

* update for comments
2023-07-07 12:33:23 +08:00
Aleksandr Voron c40d6acfc8 [CPU] [ARM] Enable MVN SLT tests on ARM (#17973)
* enabled MVN SLT tests on ARM

* moved nhwc to common section

* exclude normalizeVariance=true from x64

* fixed comments

* add NCHW+acrossChannels = false test case

* Add comment about unsupported case

* fixed 5d layout in Mvn5D_noAcrossChannels

* MvnLayerCPUTest::isSupportedTestCase() added
2023-07-06 15:09:50 +02:00
Aleksandr Voron fc9e0ce315 [CPU] [ARM] Enable Reduce SLT tests on ARM (#18006)
* init

* moved NHWC to common section

* experiment to support dynamic shapes in reduce transformation

* support dynamic shapes

* axes sorting fix in reduce transformations
2023-07-06 10:42:46 +02:00
Nikolay Shchegolev 886fd0debb [CPU] ONNX Unique tests failing on CPU (#18100)
* [CPU] ONNX Unique tests failing on CPU

* Fixes as per comments.
2023-07-05 18:16:21 +02:00
Luwei Zhou 0b3a004825 [CPU] Combine DQ scales and multiply into DQ scales. (#17276)
* Fix the multible multiply case.

* Add test case.

* Fix CI issues.

* Fix the dynamic shape FC kernel creating issue.

* Expose FC weight with original linear layout to CPU graph.

* Apply review comments.

* Apply review comments.

* Applied review comments.
2023-07-04 13:38:25 +02:00
Alexandra Sidorova 211c56acf9 [CPU] Fixed naming in SwapConvertTranspose pass (#18208)
* [CPU] Fixed naming in SwapConvertTranspose pass

* Applied Vladislav comments
2023-07-04 13:34:07 +04:00
Yury Gaydaychuk a2b7d561e4 [CPU] Checking of nonbias port in FQ-ScaleShift fusing (#17555)
* In FQ-MM fusing added checking of nonbias port during calculating channel dim

* comment added

* test added
2023-06-30 16:01:32 +02:00
Vladislav Golubev 18e737493c [Snippets] MatMul: blocking by M dimension at the LIR stage (#18169)
* [Snippets] MatMul: blocking by M dim at LIR level

* Alexandra's comments applied

* Ivan's comments applied

* Fix warning
2023-06-28 19:31:44 +02:00
Irina Efode 31b07c40d9 Add global config for test infra (#17547)
* [IE TESTS] Add Global test config for Subgraph base test

* Replace using option by function redefinition

* fix build

* remove extra changes for gna/template

* code style

* add nvidia to devices

* Fix debian

* remove nvidia
2023-06-24 01:07:36 +04:00
Alexandra Sidorova db4e3bf83d [Snippets] Added tailing processing support for splitted Loops (#17878) 2023-06-23 12:58:53 +04:00
Oleg Pipikin 48b47e754f Rename ngraph with ov in common_test_utils (#17905)
* Rename ngraph with ov in common_test_utils

* Fix comments

* Delete opset includes from commonTestUtils

* Fix CI and code style

* Apply comments

* Fix CI and apply comments
2023-06-23 09:51:47 +02:00
Ilya Lavrenov 15e69c280a Used pip wheel to build OpenVINO wheel (#18029)
* Used pip wheel to build OpenVINO wheel

* Improvements

* Added python api properly into deb / rpm packages

* Use cmake -E variant from cmake 3.13

* Improvements to fix CI

* Some refactoring

* Don't use developer package for scripts projects

* Final fixes
2023-06-23 09:17:02 +04:00
Tingqian Li 54bb74be38 [CPU] Enable f16 inference precision (#16500) 2023-06-22 11:03:38 +04:00
Nesterov Alexander ed087d9bf1 [ARM CPU] Add parallel reference power operation (#18093) 2023-06-22 10:33:10 +04:00
Luwei Zhou 731ef78608 [CPU] Move the FC fusing bias into CPU graph optimizer (#17082) 2023-06-21 10:20:21 +04:00
yanlan songandChen Peter 05e8bd375e Bell/auto api 2.0 (#17805)
* 2.0 innitial

Signed-off-by: fishbell <bell.song@intel.com>

* enable all tests

Signed-off-by: fishbell <bell.song@intel.com>

* remove unecessary files

Signed-off-by: fishbell <bell.song@intel.com>

* move container header to auto foler, remove uncessary macro define

Signed-off-by: fishbell <bell.song@intel.com>

* enable caching

Signed-off-by: fishbell <bell.song@intel.com>

* enable query_model

Signed-off-by: fishbell <bell.song@intel.com>

* support loaded_from_cache property

Signed-off-by: fishbell <bell.song@intel.com>

* fix some build warning

Signed-off-by: fishbell <bell.song@intel.com>

fake inputs/outputs if needed

Signed-off-by: fishbell <bell.song@intel.com>

* resolve conflict

Signed-off-by: fishbell <bell.song@intel.com>

* skip unsupported test

Signed-off-by: fishbell <bell.song@intel.com>

* use mock icore from common foler

Signed-off-by: fishbell <bell.song@intel.com>

* fix failure for remote tensors

Signed-off-by: fishbell <bell.song@intel.com>

* apply ppp related fix in auto

Signed-off-by: fishbell <bell.song@intel.com>

* fix build warning on windows

Signed-off-by: fishbell <bell.song@intel.com>

* fix ppp output layout issue

Signed-off-by: fishbell <bell.song@intel.com>

* fix ppp output layout issue

Signed-off-by: fishbell <bell.song@intel.com>

* clean up headers

Signed-off-by: fishbell <bell.song@intel.com>

* log formatting

Signed-off-by: fishbell <bell.song@intel.com>

* enable fps logging for binder mode

Signed-off-by: fishbell <bell.song@intel.com>

* apply review comments

apply review comments

Signed-off-by: fishbell <bell.song@intel.com>

* remove all legacy namings, exenetwork/network/metric/IE etc

Signed-off-by: fishbell <bell.song@intel.com>

* update readme

Signed-off-by: fishbell <bell.song@intel.com>

* fix build lto issue

Signed-off-by: fishbell <bell.song@intel.com>

* minor wording

Signed-off-by: fishbell <bell.song@intel.com>

* case fix

Signed-off-by: fishbell <bell.song@intel.com>

---------

Signed-off-by: fishbell <bell.song@intel.com>
Co-authored-by: Chen Peter <peter.chen@intel.com>
2023-06-21 00:10:59 +08:00
Egor Duplenskii b7cc327cb8 [IE_TESTS] Correct random data generation for real numbers (#17734) 2023-06-20 10:01:33 +04:00
Chen Xu b4e608cf47 [Snippets] Implement shuffling based horizontal reduction emitter (#18099) 2023-06-20 09:15:18 +04:00
Wanglei Shen a9c4e4ab56 enable node support (#17943)
* enable node support on Linux

* fix code style issue

* enable node support on Windows

* fix merge conflict

* update for comments

* update for comments

* enable numa node id and socket id in proc_type_table and udpate inference unit test

* update get_streams_info_table() and smoke test cases in CPU unit test

* fix code style issue

* update numa node id and socket id in proc_type_table on windows

* update for comments

* update for comments

* update for comments
2023-06-20 10:04:42 +08:00
Egor Duplenskii 6143a4fa42 [CPU] Add early throw for filtering primitive descriptors (#17065)
Otherwise the plugin will throw later when trying to init optimal
primitive descriptor (when there is actually no descriptors at all)
2023-06-19 12:16:02 +00:00
Luo Cheng fa545ffb1c [CPU] MHA will produce NAN when all inputs are negative (#15995) 2023-06-19 09:30:23 +04:00
Georgiy Manuilov 26c4ed7ba8 Add workaround for MSVC141 bug evoking C2440 compilation error (#18122)
MSVC141 fails to handle reinterpret cast of a template function
pointer due to a bug in the compiler:
https://developercommunity.visualstudio.com/t/bug-reinterpret-cast-address-of-templated-static-f/396044
2023-06-17 17:49:41 +04:00
Yury Gaydaychuk f5dc8e7796 [ONNX FE] [CPU] Tests were aligned with DeformableConvolution specification (#10808) 2023-06-16 09:02:25 +02:00
Pavel Esir aa32ff1df3 keep Const + DecompressionConvert for CPU (#15930)
* keep Const+DecompressionConvert pattern for CPU

* temporary disabled failing unit-tests

* disable CF by modifying bounds evaluate as well; minor corrections

* added TODOs with ticket numbers

* join const+decompression markings

* minimized convert_precision.cpp changes

* minor corrections

* refactor fp16 transformations: moved into separate fp16_compression folder

* style-fix

* minor fixes

* do not disable evaluate and CF in shape path

* safer disabling of Const conversion

* style-fix and minor corrections

* restore original placement of ConvertPrecision
2023-06-15 13:07:22 +04:00
Haiqi PanandChen Peter 3e63ab0dc3 Remove ov::core dependency after CPU CompiledModel constructed (#17156)
* fx repr

* remove isNewApi

* add cisLegacyApi

* remove isNewApi

* fix logic

* add test case

* remove comment

* fix bug

* add configuration

* skip in template

* skip failed case

* skip AUTO and MULTI to test

* resolve conflicts

* fix confilcts

* skip AUTO and MULTI to test

* template on

* Revert "template on"

This reverts commit d82a5a4964.

* get log

* add tmp core

* reset to test

* Revert "reset to test"

This reverts commit 7a39d4e24b.

* try to push

* use createCoreWithTemplate()

* remove AUTO and MULTI in skip_config

* Revert "remove AUTO and MULTI in skip_config"

This reverts commit d42420590f.

* fix confilcts

* fix conflicts

* remove AUTO and MULTI in skip config

* fix confilcts

* remove isLegacyAPI

* remove useless code

---------

Co-authored-by: Chen Peter <peter.chen@intel.com>
2023-06-15 01:50:24 +04:00
Wanglei Shen 277e759dcd rebase (#17212) 2023-06-14 21:19:39 +08:00
Alexandra Sidorova 67dc220d38 [Snippets] Added support of MatMuls with transposed inputs (#17819) 2023-06-14 11:55:24 +04:00
Egor Duplenskii d66e322529 [CPU] Add and correct tests for int8 LSTM (#17447) 2023-06-14 09:58:31 +04:00
Tomasz Dołbniak b023119b9a Preprocessor's resize shared tests (#17937) 2023-06-13 17:13:45 +00:00
Fang Xu 661f66b5c5 combine test for stream_info_table (#17930)
* combine test for stream_info_table

* fix failed test cases

* add check for performance hint and core type

* add comments for the parameters of test case
2023-06-14 00:40:08 +08:00
Egor Duplenskii e738c4e83f [CPU] Use primitive priority list more efficiently (#17135) 2023-06-13 13:55:27 +00:00
Egor Duplenskii dcba37d897 [CPU][TESTS] Exclude cpplint check for custom test targets (#17867) 2023-06-13 12:18:59 +00:00
Yury Gaydaychuk b25c8ef860 [Commit slider] Tune shell settings for linux (#17884) 2023-06-13 11:54:45 +04:00
Wang Kai 2d5e087b8b fixing typos in src/plugins/intel_cpu/src/transformations (#18016) 2023-06-13 00:19:46 +04:00
Ilya Churaev 0743e9bfb5 Removed legacy methods SetBatch and SetBlob (#17984)
* Removed legacy methods SetBatch and SetBlob

* Fixed GPU plugin build

* Remove DYN_BATCH_LIMIT from tests

* Revert some changes in GPU plugin
2023-06-12 18:54:23 +00:00
Ilya Churaev df44f92a97 Remove NV12 and I420 blobs and deprecate some legacy API (#17919)
* Remove NV12 and I420 blobs and deprecate some legacy API

* Fixed some errors

* Remove NV12 blobs

* Remote NV12 conversion

* Fixed other warnings

* Suppress version

* Fix some warnings

* Fixed version

* Try to fix some warnings

* Suppress warnings in C header

* Suppress warnings in C

* Fixed Windows exceptions

* Try to fix warnings

* Try to fix C bindings build

* Suppress InferRequest

* Fixed some build issues

* Fixed some errors
2023-06-12 21:15:02 +04:00
Aleksandr Voron 1588a33217 [CPU][ARM] Dynamic shapes support in ARM transformations (#17548) 2023-06-12 14:13:16 +04:00
Pawel Raasz 16bde0bba6 Add static shape adapters to reduce dimension conversion in shape_infer for CPU (#17862)
* Add static shape adapter
- Adapters holds CPU dimension which can be reference to it or vector
- Add ov::optional for holding optional result from shape inference
- Add new `infer` function in `IStaticShapeInfer`

* Temporary support of StaticShape

* Fix build issues

* Correct shape adapter compare
- minor static shape adapter refactor

* Minor corrections in ShapeInferenceTA

* Fix subscript operator in StaticShapeRef
2023-06-12 07:05:46 +02:00
Ivan Tikhonov 74100670ac Delete the deprecated LowLatency (version1) transformation (#17965)
* Delete the deprecated LowLatency (version1) transformation

* detele LowLatency refs from the docs
2023-06-10 12:24:43 +04:00
Egor Duplenskii 36a4c0cb2b [CPU][DEBUG_CAPS] Fix compilation warnings (#17977) 2023-06-10 02:09:59 +04:00