Commit Graph
247 Commits
Author SHA1 Message Date
Mateusz Mikolajczyk 441dad2eea Fix bug with reshape on empty tensor (#17014)
* Fix empty tensor reshape

* Add test
2023-04-18 20:56:03 +04:00
Ilya Lavrenov adc733f1e9 Enabled several ARM CPU tests (#16995)
* Enabled several ARM CPU tests

* Removed not-valid tests

* Fixed several template plugin tests

* Removed non-working suppressions

* Disabled 2 tests on ARM CPU
2023-04-17 22:44:43 +04:00
Ilya Lavrenov f4fe8400a7 Generic ARM fixes (#16994) 2023-04-17 20:37:10 +04:00
Vitaliy Urusovskij 47f0d72f02 Fix broadcasting issue in FQ ref implementation (#16812) 2023-04-17 20:33:07 +04:00
Aleksandr Voron 496a608a28 [CPU] ReduceMean fix for ACL Executor (#16987)
* reduce fix

* enable gru, rnn and lstm tests
2023-04-17 19:17:50 +04:00
Ilya Lavrenov 4a997de4a3 Disabled failed ARM CPU tests (#16989) 2023-04-17 15:34:56 +04:00
Shen, Wanglei 98393c0da1 update number of threads per stream on Ecore to 2 for aggressive model on hybrid platform (#16857)
* update number of threads per stream on Ecore to 2 when  aggressive model run on hybrid platform

* update for corner case and add test case
2023-04-17 18:42:55 +08:00
Egor Duplenskii 175db3523a [CPU] Add few tests to smoke scope (#16963) 2023-04-17 09:04:57 +04:00
Sofya Balandina 9f3bc22e7a [apiConformance] Refactoor core_integration.cpp (#16416) 2023-04-14 23:15:41 +00:00
Edward Shogulin 8bdc5bc85f [LPT] Support ONNX quantized models coming from ORT PTQ (#14811)
* [LPT] FakeQuantize fuse

* GPU & CPU tests alignment

* refactoring & comments

* doc quick fix

* quick fix
2023-04-14 21:22:55 +00:00
Gorokhov Dmitriy cc6fd80d0a [CPU] Fixed Softmax and TopK nodes initilization for ARM devices (#16950) 2023-04-14 22:13:42 +04:00
Aleksandr Voron dc941f69ae fix (#16969) 2023-04-14 22:09:50 +04:00
Aleksandr Voron fe98b8ee13 reduce 6d+ fix (#16931) 2023-04-14 22:09:22 +04:00
Ilya Lavrenov f5c2db73d5 Moved heavy OVInferConsistencyTest tests to nightly (#16967) 2023-04-14 20:02:06 +04:00
Aleksandr Voron 55fa8da5e4 [CPU] MVN 1D fix in ACL Executor (#16930) 2023-04-14 10:00:20 +04:00
Ilya Lavrenov de8f34c8f0 Fixed plugin name in tests for ARM CPU (#16932) 2023-04-13 22:35:21 +04:00
Luwei ZhouandVladislav Golubev 6aeb054e48 [CPU] Use ONEDNN3.x weight/dest scale API to optimize perf (#16805)
* [LPT][CPU] Added callback for AddTransformation

* [WIP] Convolution scales fusion

* Force to use weight sclae to test performance.

* Update on interface.

* Use weight scale to adapt to ONEDNN 3.x API changes.

* Update the code.

* Update ONEDNN fix for gemm_x8s8s32x_conv kernel

* Fix the bug in ONEDNN and deconvFusingScale.

* Fuse FC Bias when having DQscale.

* WR to perf regression on

* Update onednn version.

* Fix bug and clean code.

* FC fusing dq scale bug fix.

* Add more comments and debug information.

* Fix CI issues.

* Merge ONEDNN changes.

* Fix CI issues and bugs.

* Apply review comments.

* Update comments.

* Apply reveiw comments.

* Avoid using LPT BiasAttribute RTInfo.

* Applied review comments.

---------

Co-authored-by: Vladislav Golubev <vladislav.golubev@intel.com>
2023-04-13 19:02:48 +02:00
Wang Wangwang 1037f24c46 [AUTO] Remove exclusive_asyc_requests property from AUTO plugin (#16840)
* Remove exclusive_asyc_requests property from AUTO plugin

* Update test case

* Add test case to test incorrect config

* Remove the test case related to exclusive_asyc_requests property of AUTO plugin
2023-04-13 06:35:42 +00:00
73be9d31b6 Skip CPU tests on ARM platform (#16891)
* [CPU] ARM architecture support

This patch extends existing CPU plugin capabilities with ARM CPUs optimized support

* Fixed undefined reference in unit tests

* refactoring

* Fixed Eltwise node behavior for ARM

* init commit

* tests passed

* fix skip failures

* Apply suggestions from code review

---------

Co-authored-by: dmitrygo <dmitry.gorokhov@intel.com>
Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>
2023-04-13 02:34:36 +04:00
Gorokhov Dmitriy c283d21215 [CPU] ARM architecture support (#15256)
* [CPU] ARM architecture support

This patch extends existing CPU plugin capabilities with ARM CPUs optimized support
2023-04-12 18:42:05 +04:00
Wang Wangwang c2c2143f45 clean AB property from virtual plugin and core global config (#16877)
* Benchmark_app set ov::hint::allow_auto_batching through compile_model

* Remove the process about allow_auto_batching in set_property of core

* Remove allow_auto_batching and auto_batch_timeout property from AUTO plugin

* Reserve the info logs and add API to check auto_batching

* Update test case, rm AB property test from core config tests

* Update some API in AUTO plugin config
2023-04-12 17:37:57 +04:00
Edward Shogulin 586dd4fb0a [Snippets] BF16 enforce in snippets (#16587) 2023-04-12 01:12:17 +02:00
Vladislav Golubev 98afdc848a [LPT] ConvolutionTransformation: support for a new per channel dequantization representation (#16687)
* [LPT][TESTS] GrConv: added test cases with per channel dq on weights and without reshape

* FoldFQ: don't transform FQ with quantization by several dimensions

* ConvolutionTransformation: supported GrConv with per channel dq on weights and without reshape

* fold_reshape: refactoring
2023-04-11 14:07:23 +02:00
Oleg Pipikin efc647a512 [Snippets][CPU] Fix cycle dependency check in snippets tokenizer (#16760) 2023-04-10 22:36:29 +04:00
Sofya Balandina ed50d3782c [apiConformance] Define mandatory scope for infer requiest tests (#16418) 2023-04-10 12:27:20 +04:00
Wang Wangwang 57684e28ff [AUTO] Remove cache_dir property from AUTO plugin (#16775)
* Remove cache_dir property from AUTO plugin

* Pass the secondary property to hardware plugin

* Update test case

* Update test case, meta plugin will pass the properties to device without checking
2023-04-10 11:42:24 +04:00
Egor Duplenskii b5a0497c19 [CPU][TESTS] Fix cmake subset target (#16710)
cmake iterates over a list and cannot iterate over space separated string
2023-04-10 10:00:35 +04:00
Sofya Balandina c6fc8e5adc [apiConformance] Exec_network_base refactor and define mandatory scope (#16413) 2023-04-07 16:17:50 +04:00
Yuan Hu 06cacfe2a7 Revert "[CPU] optimize shape infer of Reshape (#16537)" (#16703)
This reverts commit 75c62ea320.
2023-04-07 06:18:58 +00:00
3be946371d Xuejun/remove api tensor related (#15877)
* [Remove APIs] remove api set_partial_shape()

Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>

* [Remove APIs] remove api set_element_type()

Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>

* [Remove APIs] remove api set_tensor_type()

Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>

* Revert "[Remove APIs] remove api set_tensor_type()"

This reverts commit 96f89e222d.

* Revert "[Remove APIs] remove api set_element_type()"

This reverts commit 33ebb61977.

* Apply suggestions from code review

---------

Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>
Co-authored-by: Evgenya Stepyreva <eva.my.link@gmail.com>
Co-authored-by: Evgenya Stepyreva <evgenya.stepyreva@intel.com>
2023-04-07 06:37:25 +02:00
Nadezhda Ageeva 5e2f424fd0 [HETERO] Enable smoke_Hetero_CachingSupportCase tests (#16711) 2023-04-06 21:19:37 +04:00
Vladislav Golubev 5f416dc4d2 [LPT] Introduced BiasAttribute (#16781)
* Extended check on ConvSum fusing

* [LPT] Introduced 'bias' rt attribute

* [CPU][TESTS] Added FQLayerDQBias tests
2023-04-06 16:01:04 +00:00
Katarzyna Mitrus 7a5c472ccc [ShapeInference] Fix Group Convolution shape infer - relax inputs size check (#16707)
* Relax group conv inputs size check

* Tests

* Relax inputs size checks for Backprop Convs
2023-04-06 10:59:37 +00:00
Shen, Wanglei 9f54504232 update cpu properties name to enable_hyper_threading and enable_hyper_threading (#16723) 2023-04-04 15:25:11 +04:00
Shen, Wanglei f6c7213ae4 support Ecore only in streams calculation (#16552)
* support Ecore only in streams calculation

* fix merge conflict
2023-04-03 23:33:18 +08:00
Shen, Wanglei 86da15e621 enable new property ov::hint::use_cpu_pinning (#16383)
* enable ov::hint::use_cpu_pinning

* update test case for comments

* update header file

* update header file

* Delete cpu_streams_calculation.hpp

* Revert "Delete cpu_streams_calculation.hpp"

This reverts commit a1074ca843.

* update config name

* fix code styple issue

* update for merge conflict
2023-04-03 18:14:33 +08:00
Anton Voronov b64cbff10b [CPU] FQ shape agnostic kernel (#16585) 2023-04-03 09:55:49 +04:00
guozhong wang 341217de99 Unify code path for MULTI and AUTO CTPUT hint (#16349)
[MULTI] pass through to AUTO with CTPUT hint
After this change
-- MULTI doesn't support setting infer request via CPU(4),GPU(8).
-- MULTI doesn't support CompiledModel::set_property() and ExecutableNetwork::GetConfig().
2023-03-31 18:40:41 +02:00
Egor Duplenskii 6d1e5d336d [CPU] Enable execution_mode API property (#16367) 2023-03-31 14:29:18 +04:00
Chen Xu 35398e339d [CPU] Implement TopK-11 to CPU plugin (#16522) 2023-03-31 10:28:20 +02:00
Ilya Lavrenov ee0bb79ed6 Fixed LTO build (#16629)
* Partially fixed LTO

* Fixed issues with cnpy LTO

* CPU

* Disabled failing GPU test
2023-03-31 11:34:42 +04:00
Anton Voronov 43fca3d231 [CPU] Introduced shape agnostic eltwise (#15976) 2023-03-31 11:28:54 +04:00
Ilya Lavrenov ccf9c19f61 Deprecated UNDEFINED values for execution / performance hints (#16563)
* Deprecated UNDEFINED values for execution / performance hints

* Update src/tests/functional/plugin/gpu/shared_tests_instances/behavior/ov_plugin/properties_tests.cpp

* Fixes

* Fixes
2023-03-30 13:48:19 +04:00
Ilya Lavrenov 0250f62d11 Revert inference precision to be a hint (#16634) 2023-03-29 18:59:33 +04:00
Edward Shogulin a9360f8045 [CPU] Element-wise precision selection fix (#16547) 2023-03-29 12:31:30 +00:00
Vladislav Golubev df3c06ecb4 [CPU] Ngram node fusion (#16131) 2023-03-29 13:58:41 +04:00
Yuan Hu 75c62ea320 [CPU] optimize shape infer of Reshape (#16537)
* add reshape shapeinfer in cpu plugin

Signed-off-by: Hu Yuan2 <yuan2.hu@intel.com>

* add squeeze and unsqueeze

Signed-off-by: Hu Yuan2 <yuan2.hu@intel.com>

* add precision i8 i64 on test

Signed-off-by: Hu Yuan2 <yuan2.hu@intel.com>

* fix code out of bounds risk

Signed-off-by: Hu Yuan2 <yuan2.hu@intel.com>

* test performance of this PR

Signed-off-by: Hu Yuan2 <yuan2.hu@intel.com>

* fix code issue

Signed-off-by: Hu Yuan2 <yuan2.hu@intel.com>

* Revert "test performance of this PR"

This reverts commit f4f9f002de28d03bc1c55c24067f75b74824904c.

* fix reviewer comment

fix throw message
not create ov::shape instance
remove i8 test case

Signed-off-by: Hu Yuan2 <yuan2.hu@intel.com>

* fix pytorch layer test failed issue

inputShape(1,0) outpattern(-1) is a valid input

Signed-off-by: Hu Yuan2 <yuan2.hu@intel.com>

* fix windows compile issue

Signed-off-by: Hu Yuan2 <yuan2.hu@intel.com>

* fix rebase mistaken

Signed-off-by: Hu Yuan2 <yuan2.hu@intel.com>

---------

Signed-off-by: Hu Yuan2 <yuan2.hu@intel.com>
2023-03-29 11:26:49 +02:00
Tingqian Li 05ab0f32d7 [CPU] Simple fix of redundant const-weight reordering for brgconv node in dynamic model (#16305) 2023-03-29 10:27:08 +02:00
Pawel Raasz 796bd98913 Review convolution classes for shape inference aspects (#16375)
* Review adaptive max pool shape inference

* Review AvgPool and MaxPool

* Review convolution operator

* Review GroupConvolution shape inference

* Review ConvolutionBackpropData operator

* Review GroupConvolutionBackpropData op

* Review BinaryConvolution operator
- add common bases for convolution ops
- refactor convolution ops

* Review DeformableConvolution operator

* Use new convolution shape_infer in GPU

* Fix build and test issues

* Correct set output spatial shape
in default constructed back prop convolutions

* The convolution shape_infer use pads as parameters
the external padding can be operators or other class padding properties shape_infer should not modify operators padding when
called from plugin

* Apply code formatting

* Fix padding validation and update

* Use shape inference with padding instead fallback
for DeformableConvolution from opset1

* Update convertPadding function to be template
2023-03-28 19:10:08 +00:00
Alexandra Sidorova 38c924a3ae [Snippets] Added support of BF16/I8/U8 for MatMul (#15063) 2023-03-28 20:49:26 +04:00