Commit Graph
208 Commits
Author SHA1 Message Date
Chen Xu 35398e339d [CPU] Implement TopK-11 to CPU plugin (#16522) 2023-03-31 10:28:20 +02:00
Ilya Lavrenov ee0bb79ed6 Fixed LTO build (#16629)
* Partially fixed LTO

* Fixed issues with cnpy LTO

* CPU

* Disabled failing GPU test
2023-03-31 11:34:42 +04:00
Anton Voronov 43fca3d231 [CPU] Introduced shape agnostic eltwise (#15976) 2023-03-31 11:28:54 +04:00
Ilya Lavrenov ccf9c19f61 Deprecated UNDEFINED values for execution / performance hints (#16563)
* Deprecated UNDEFINED values for execution / performance hints

* Update src/tests/functional/plugin/gpu/shared_tests_instances/behavior/ov_plugin/properties_tests.cpp

* Fixes

* Fixes
2023-03-30 13:48:19 +04:00
Ilya Lavrenov 0250f62d11 Revert inference precision to be a hint (#16634) 2023-03-29 18:59:33 +04:00
Edward Shogulin a9360f8045 [CPU] Element-wise precision selection fix (#16547) 2023-03-29 12:31:30 +00:00
Vladislav Golubev df3c06ecb4 [CPU] Ngram node fusion (#16131) 2023-03-29 13:58:41 +04:00
Yuan Hu 75c62ea320 [CPU] optimize shape infer of Reshape (#16537)
* add reshape shapeinfer in cpu plugin

Signed-off-by: Hu Yuan2 <yuan2.hu@intel.com>

* add squeeze and unsqueeze

Signed-off-by: Hu Yuan2 <yuan2.hu@intel.com>

* add precision i8 i64 on test

Signed-off-by: Hu Yuan2 <yuan2.hu@intel.com>

* fix code out of bounds risk

Signed-off-by: Hu Yuan2 <yuan2.hu@intel.com>

* test performance of this PR

Signed-off-by: Hu Yuan2 <yuan2.hu@intel.com>

* fix code issue

Signed-off-by: Hu Yuan2 <yuan2.hu@intel.com>

* Revert "test performance of this PR"

This reverts commit f4f9f002de28d03bc1c55c24067f75b74824904c.

* fix reviewer comment

fix throw message
not create ov::shape instance
remove i8 test case

Signed-off-by: Hu Yuan2 <yuan2.hu@intel.com>

* fix pytorch layer test failed issue

inputShape(1,0) outpattern(-1) is a valid input

Signed-off-by: Hu Yuan2 <yuan2.hu@intel.com>

* fix windows compile issue

Signed-off-by: Hu Yuan2 <yuan2.hu@intel.com>

* fix rebase mistaken

Signed-off-by: Hu Yuan2 <yuan2.hu@intel.com>

---------

Signed-off-by: Hu Yuan2 <yuan2.hu@intel.com>
2023-03-29 11:26:49 +02:00
Tingqian Li 05ab0f32d7 [CPU] Simple fix of redundant const-weight reordering for brgconv node in dynamic model (#16305) 2023-03-29 10:27:08 +02:00
Pawel Raasz 796bd98913 Review convolution classes for shape inference aspects (#16375)
* Review adaptive max pool shape inference

* Review AvgPool and MaxPool

* Review convolution operator

* Review GroupConvolution shape inference

* Review ConvolutionBackpropData operator

* Review GroupConvolutionBackpropData op

* Review BinaryConvolution operator
- add common bases for convolution ops
- refactor convolution ops

* Review DeformableConvolution operator

* Use new convolution shape_infer in GPU

* Fix build and test issues

* Correct set output spatial shape
in default constructed back prop convolutions

* The convolution shape_infer use pads as parameters
the external padding can be operators or other class padding properties shape_infer should not modify operators padding when
called from plugin

* Apply code formatting

* Fix padding validation and update

* Use shape inference with padding instead fallback
for DeformableConvolution from opset1

* Update convertPadding function to be template
2023-03-28 19:10:08 +00:00
Alexandra Sidorova 38c924a3ae [Snippets] Added support of BF16/I8/U8 for MatMul (#15063) 2023-03-28 20:49:26 +04:00
Pawel Raasz 49d150b3b8 Review PSROIPooling class for shape inference aspects (#16447)
* Review ROIPooling class
- check interval shape and label propagation
- add template shape_infer
- add shape infer into cpu plugin
- add test with StaticShape

* Use get_output_roi instead of get_output_size

* Add missing includes

* Review PSROIPooling operator
- review interval and label propagation
- add template shape_infer implementation
- add shape_infer to cpu plugin
2023-03-28 15:02:16 +04:00
Shen, Wanglei a726f0ae38 Enable new property ov::hint::scheduling_core_type (#16106)
* enable apply_processor_type()

* declare PROCESSOR_TYPE

* enable readProperties

* test case for get_property()

* enable set_property() and test cases

* reduce changes

* fix code style issue

* fix python test case issue

* remove python interface

* move processor type definition out of dev_api

* refine coding

* add dependency

* update header file

* update description

* merge intel_cpu header file

* add inline in-code documentation

* change 'UNDEFINED' to 'DEFAULT'

* remove ProcTypeConfig

* refine change

* refine change

* refine process_type to scheduling_core_type

* refine description

* fix code style issue

* change to ov::hint::scheduling_core_type

* fix code style issue

* fix code style issue

* fix python issue

* fix python issue

* fix python issue

* fix python issue

* change core_type_cfg to ov::hint::SchedulingCoreType

* update test case for comments

* update test case for comments

* add default for comments

* update code style

* update for comments

* update for comments

* fix typo

* move cpu_map_scheduling into threading folder

* update for merge conflict

* update for code style
2023-03-28 10:04:30 +04:00
Shen, Wanglei 815d4abc03 enable new property ov::hint::use_hyper_threading (#16176)
* enable apply_processor_type()

* declare PROCESSOR_TYPE

* enable readProperties

* test case for get_property()

* enable set_property() and test cases

* reduce changes

* fix code style issue

* fix python test case issue

* remove python interface

* move processor type definition out of dev_api

* refine coding

* add dependency

* update header file

* update description

* merge intel_cpu header file

* add inline in-code documentation

* change 'UNDEFINED' to 'DEFAULT'

* remove ProcTypeConfig

* refine change

* refine change

* enable new property use hyper threading

* update description

* resume legacy code

* change to ov::hint namespace

* update including header file

* update C API and Python API

* update description for comments

* update test case for comments

* update function location for comments

* fix typo

* fix typo

* fix code style issue and update test case

* move cpu_map_scheduling into threading folder
2023-03-28 00:39:26 +04:00
Mang Guo 5e835e327b [CPU] Fix edge memory share issue (#16202) 2023-03-27 13:20:51 +04:00
cecilia peng a1b8a6a941 [CPU] Disable ConvertNMSToNMSIEInternal (#16128) 2023-03-27 11:22:53 +04:00
Shen, Wanglei 613b66ba35 include nireq during streams calculation (#16378)
* include nireq during streams calculation

* update description for comments

* update description
2023-03-24 15:27:13 +08:00
Fang XuandChen Peter 025115f695 Update prebuilt tbbbind static library for Linux (#15832)
* update prebuilt tbbbind static library

* update LICENSE file

* update SHA256

* update prebuilt tbbbind static library for linux

cmake 3.23.2
centos7

https://github.com/open-mpi/hwloc/archive/refs/tags/hwloc-2.8.0.tar.gz
./autogen.sh
./configure --enable-static --disable-io --disable-libudev --disable-libxml2 --disable-cairo CFLAGS="-fPIE"
make -j$(proc)
make install prefix=$(pwd)/install

https://github.com/oneapi-src/oneTBB/archive/refs/tags/v2021.7.0.tar.gz
sed -i "s/APPLE\s*OR\s*NOT\s*BUILD_SHARED_LIBS/APPLE/g" CMakeLists.txt
export HWLOC_DIR="${hwloc_root_dir}/hwloc-hwloc-2.8.0/install"
export PKG_CONFIG_PATH="${HWLOC_DIR}/lib/pkgconfig"
export CXXFLAGS="-I ${HWLOC_DIR}/include -L ${HWLOC_DIR}/lib"
~/cmake-3.23.2-linux-x86_64/bin/cmake -DTBB_TEST=OFF -DTBB_BUILD=OFF -DTBBMALLOC_BUILD=OFF -DBUILD_SHARED_LIBS=OFF
make -j$(nproc)

* remove changes for windows

---------

Co-authored-by: Chen Peter <peter.chen@intel.com>
2023-03-24 14:27:57 +08:00
Edward Shogulin fb24e91416 [LPT] NNCF GroupConvolution 5D on weights support (#16336)
* [LPT] NNCF GroupConvolution 5D on weights support

* PullReshapeThroughDequantization rollback
2023-03-23 13:24:10 +00:00
Edward Shogulin 087b10ff00 Snippets: precision propagation (#14996) 2023-03-23 13:16:04 +04:00
Yury Gaydaychuk 5290822f8b [CPU] Enabled BatchToSpace and SpaceToBatch with nonconstant inputs support (#16344) 2023-03-22 16:36:05 +00:00
Chen Xu 57c91e0c56 [CPU] Fix issue in reducing HW with small channel size in npsc layout (#16467) 2023-03-22 13:28:38 +04:00
Pawel Raasz 63797db257 Review ROIPooling class for shape inference aspects (#16403)
* Review ROIPooling class
- check interval shape and label propagation
- add template shape_infer
- add shape infer into cpu plugin
- add test with StaticShape

* Use get_output_roi instead of get_output_size

* Add missing includes
2023-03-21 09:02:37 +00:00
0c99135d44 Improved properties handling between Core and plugins (#16296)
* [HETERO]: adopt setting device properties in benchmark_app/speech_sample for HETERO

Fix IEClassHeteroExecutableNetworkGetMetricTest_SUPPORTED_METRICS test

Fix NumStreamsAndDefaultPerfHintToHWTest/PerHintAndDefaultPerfHintToHWTest tests

[HETERO][MULTI][AUTO] Make ov::device::properties regular property

[PYTHON] Update python BA with device properties

Update after rebase

Update src/plugins/auto/auto_executable_network.cpp

Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>

Update src/plugins/auto/multi_executable_network.cpp

Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>

Fix merge conflicts, apply some review comments

* Multiple improvements

* [HETERO]: adopt setting device properties in benchmark_app/speech_sample for HETERO

Fix IEClassHeteroExecutableNetworkGetMetricTest_SUPPORTED_METRICS test

Fix NumStreamsAndDefaultPerfHintToHWTest/PerHintAndDefaultPerfHintToHWTest tests

[HETERO][MULTI][AUTO] Make ov::device::properties regular property

[PYTHON] Update python BA with device properties

Update after rebase

Update src/plugins/auto/auto_executable_network.cpp

Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>

Update src/plugins/auto/multi_executable_network.cpp

Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>

Fix merge conflicts, apply some review comments

* Code style, bugfix after merging improvement

* More improvements

* Even more improvements

* Commit changes in core_impl.cpp

* Added parsing of any maps

* Fixed code-style

* Fixed AB mock tests build

* Fixed comparison

* Added new AB config key

* Improvements and fixes (#147)

* Fix BA, fix GetSupportedConfig call for virtual plugins (#148)

* Fix GPU tests (#149)

* Fix BA, fix GetSupportedConfig call for virtual plugins

* Fix GPU tests

* Code style

* Improvements 10

* Fixed incorrect tests

* Revert removal cache_dir

* Revert removal cache_dir

* Fixed clean

* Supported device ID in CPU

* More fixed tests

* clang-format

* Fix legacy GPU tests (#150)

* Removed clone_map

* clang-format

* Added clone_map back

---------

Co-authored-by: Nadezhda Ageeva <nadezhda.ageeva@intel.com>
Co-authored-by: Nadezhda Ageeva <nkogteva@gmail.com>
2023-03-20 12:42:40 +00:00
Maksim Kutakov 4bf5a77ac9 [CPU] Lazy oneDNN memory object creation (#12972) 2023-03-20 13:56:28 +04:00
Egor Duplenskii a754473689 [CPU][TESTS] Use run_on_model instead of run_on_function (#16359) 2023-03-17 14:18:09 +00:00
Egor Duplenskii e1e44d6bac [CPU] Move to oneDNN v3.1 (#15918) 2023-03-17 14:17:55 +04:00
Xuejun Zhai a9bd5f741d Xuejun/remove api model (#15924)
* [Remove APIs] remove api m_transformation_callback

Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>

* [Remove APIs] remove api run_on_function(), replaced by run_on_model()

Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>

* [Remove APIs] remove set_callback(), use get_pass_config() to configure transformation pipeline

Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>

* [Remove APIs] remove api add_matcher()

Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>

* Fix format issue

Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>

* [Remove APIs] Fix review comments

Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>

* Fix formast issue

Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>

* Fix merge master error

Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>

* Fix CI compiler error

Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>

* Update ONNX Runtime from rel-1.8.1 to rel-1.14.0

Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>

* Revert "Update ONNX Runtime from rel-1.8.1 to rel-1.14.0"

This reverts commit e31a9e04b7.

---------

Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>
2023-03-17 10:44:28 +04:00
Tomasz Dołbniak 6762fe692d Interpolate-11 spec + core op (#16162) 2023-03-16 14:37:57 +01:00
Xiuchuan ZhaiandMaksim Kutakov 9229b4967e [CPU] optimize shape infer of stridedslice (#16069)
* optimize shape infer of stridedslice

* Update src/plugins/intel_cpu/src/nodes/strided_slice.cpp

Co-authored-by: Maksim Kutakov <maxim.kutakov@gmail.com>

* Update src/plugins/intel_cpu/src/nodes/strided_slice.cpp

Co-authored-by: Maksim Kutakov <maxim.kutakov@gmail.com>

* Update src/plugins/intel_cpu/src/nodes/strided_slice.cpp

Co-authored-by: Maksim Kutakov <maxim.kutakov@gmail.com>

* fix accoding to comments

* re-use get_sliced_value func

* re-use get_sliced_value func

---------

Co-authored-by: Maksim Kutakov <maxim.kutakov@gmail.com>
2023-03-16 12:27:14 +01:00
Xiping Yan 2194552dc5 [CPU] Fix crash issue: RuntimeError: Primitive descriptor was not found for… (#16186) 2023-03-16 10:17:06 +04:00
Katarzyna Mitrus f0c153858b [ShapeInference] EmbeddingBag-Offsets/Packed-Sum shape infer improvements (#16072)
* shape_infer

* Register EmbeddingBagPackedSum shape_nfer for CPU

* Tests

* Merge shapes to preserve 2rd input info

* More label tests

* Add emb_table size check

* rename shape infer file

* Add more tests

* Update constexpr

* Use OV_EXPECT_THROW

* Style

* Reuse emb_table for dynamic rank

* Add common util to calculate emb output shape

* Update embd shape infer to use common util

* Update embedding shape infer util
2023-03-15 11:12:57 +01:00
Katarzyna Mitrus 69ba802e03 [ShapeInference] EmbeddingSegmentsSum shape infer improvements (#16119)
* Update shape_infer

* type prop tests

* Preserve interval and label from input

* Add more tests

* Add emb table scalar check

* Update to use OV_EXPECT_THROW

* Update constexpr

* Code refactor
2023-03-15 11:05:52 +01:00
Pawel Raasz bdf1923972 Review bucketize shape inference (#16136)
* Review bucketize shape inference:
- check interval dimension and label propagation
- check template shape_infer implementation
- minor refactoring and add tests

* Add missing using of namespaces
2023-03-15 10:19:57 +01:00
Pawel Raasz 72566cde0d Review pooling classes for shape inference aspects (#16114)
* Review adaptive avg pool shape inference

* Review adaptive max pool shape inference

* Review AvgPool and MaxPool

* Minor improvement for StaticShape

* Update ShapeInferBaseWithPadding's infer
to be compatible with interface after rebase

* Fix build issues

* Set default pads before checks

* Fix include openvino headers
2023-03-13 12:48:44 +00:00
Ilya Lavrenov 1874c072b2 switched public Azure Linux build to clang (#16198)
* switched public Azure Linux build to clang

* Fixed GNA compilation

* Suppressed warning in GNA tests

* switched public Azure Linux build to clang

* Fixed GNA compilation

* Suppressed warning in GNA tests

* More fixes

* Skip test on CPU
2023-03-11 11:01:27 +04:00
Ilya Churaev 45bdbf7486 Changed throw ov::Exception to macro (#16150)
* Changed throw ov::Exception to macro

* Fixed code style

* Revert myriad headers

* CPPlint fixes

* Fixed typo
2023-03-10 11:14:50 +04:00
Xiping Yan 68b8d41c43 [CPU]JIRA 93714 fix CPU plugin warning after remove wd4309 wd4018 (#15961)
* Remove warning suppression: wd4018, wd4309

Signed-off-by: Yan, Xiping <xiping.yan@intel.com>

* Remove linux warning suppression no-sign-compare

Signed-off-by: Yan, Xiping <xiping.yan@intel.com>

* ov::intel_cpu::VectorDims base value type is size_t;
dnnl::memory::dims base value type is int64_t;

All compare data up to int64_t can fix warning and there is potential issue.

Signed-off-by: Yan, Xiping <xiping.yan@intel.com>

* channelAxis maybe == -1; means: no exist any more.

Signed-off-by: Yan, Xiping <xiping.yan@intel.com>

* Fix recursive macro: "one_of", "everyone_is" sign-compare warning.
Must pass same value type.

Signed-off-by: Yan, Xiping <xiping.yan@intel.com>

* Fix Windows sign unsign compare warning

Signed-off-by: Yan, Xiping <xiping.yan@intel.com>

* There are 2 instances:

using ov::Dimension::value_type = int64_t
using ov::intel_cpu::StaticDimension::value_type = size_t

All up to int64.

Signed-off-by: Yan, Xiping <xiping.yan@intel.com>

* linux have too many sign-compare issue.
Complete windows sign-compare firstly.

Signed-off-by: Yan, Xiping <xiping.yan@intel.com>

* Fix clang issues.

Signed-off-by: Yan, Xiping <xiping.yan@intel.com>

* Fix warning.
Because instantiate T1=unsigned int, T2=int

Signed-off-by: Yan, Xiping <xiping.yan@intel.com>

* Fix warning for tests unit reorder_node_test.cpp

Signed-off-by: Yan, Xiping <xiping.yan@intel.com>

* Fix warning : ASSERT_GE(step, 1u);

Signed-off-by: Yan, Xiping <xiping.yan@intel.com>

* Fix tests: warning C4018

Signed-off-by: Yan, Xiping <xiping.yan@intel.com>

* Remove auto, using int64_t is more reasonable.

Signed-off-by: Yan, Xiping <xiping.yan@intel.com>

---------

Signed-off-by: Yan, Xiping <xiping.yan@intel.com>
2023-03-08 10:41:00 +04:00
Zhang Yi 6fbaf4745a [CPU ]Fix bf16 marking logic & remove useless convert (#15404) 2023-03-07 10:02:14 +00:00
Wang, Yang 4d3dcfc5d4 Enable AUTO to support execution mode hint. (#15595)
* Enable AUTO to support execution mode hint.

Signed-off-by: Wang, Yang <yang4.wang@intel.com>

* Add test case.

* Set default value "PERFORMANCE" for ov::hint::execution_mode.

* Update.

* Update.

* Correct default ov::hint::execution_mode value for the default value checking test case.

* Update.

* Delete obsolete config.hpp file.

---------

Signed-off-by: Wang, Yang <yang4.wang@intel.com>
2023-03-07 11:58:14 +08:00
Chenhu Wang 6e7bef529f [CPU] Single place to fill tails of load emitter (#14846) 2023-03-06 21:31:39 +04:00
Xiping YanandMaksim Kutakov e6a65f406d [CPU] Fix warning: sequence point strict aliasing (#15989)
* Remove sequence-point and strict-aliasing

Signed-off-by: Yan, Xiping <xiping.yan@intel.com>

* Replace reinterpret_cast with memcpy to fix warning of -Wstrict-aliasing

Signed-off-by: Yan, Xiping <xiping.yan@intel.com>

* Fix warning: -Wsequence-point

Signed-off-by: Yan, Xiping <xiping.yan@intel.com>

* Fix functional test warning: -Wstrict-aliasing

Signed-off-by: Yan, Xiping <xiping.yan@intel.com>

* Lost ft1 declare.

Signed-off-by: Yan, Xiping <xiping.yan@intel.com>

* Fix warnging: strict-aliasing.

Signed-off-by: Yan, Xiping <xiping.yan@intel.com>

* Fix warnging: strict-aliasing. ie_test_utils

Signed-off-by: Yan, Xiping <xiping.yan@intel.com>

* fix float name error.

Signed-off-by: Yan, Xiping <xiping.yan@intel.com>

* Update src/plugins/intel_cpu/src/nodes/unique.cpp

Co-authored-by: Maksim Kutakov <maxim.kutakov@gmail.com>

* Update src/plugins/intel_cpu/src/nodes/unique.cpp

Co-authored-by: Maksim Kutakov <maxim.kutakov@gmail.com>

* 1: Maybe uint16_t is more reasonable;
2: Replace int16_t with bfloat16_t;

Signed-off-by: Yan, Xiping <xiping.yan@intel.com>

* fix build error.

Signed-off-by: Yan, Xiping <xiping.yan@intel.com>

---------

Signed-off-by: Yan, Xiping <xiping.yan@intel.com>
Co-authored-by: Maksim Kutakov <maxim.kutakov@gmail.com>
2023-03-06 10:57:12 +01:00
Tomasz Dołbniak 4486470e02 TopK v11 core operator (#15910) 2023-03-06 08:31:18 +01:00
Shen, Wanglei e605a4c344 Create streams info table based on processor type table (#15571)
* enable streams info table based on CPU mapping

* add detail processor info for mix stream

* fix code style issue

* fix typo

* fix code style issue for Android build

* update description of streams info table

* move streams info related function to new file

* remove duplicated definition

* add description for parameters of get_streams_info_table()

* update test case file

* fix windows build issue

* fix windows build issue

* fix windows build issue

* fix typo

* update latency mode for hybrid platform

* update limit threads for latency

* update latency mode for 2 sockets platform
2023-03-06 14:06:41 +08:00
Mateusz Tabaka 84a42cde61 [CPU] Add support for dynamic shapes in RDFT (#14458) 2023-03-03 10:43:29 +04:00
Maksim Kutakov fc98454174 [CPU] Internal dynamism support for extensions (#15795) 2023-03-03 09:00:56 +04:00
Zhang Yi 0e9b133de5 [CPU] StridedSlice fix execution for empty output tensor (#16045)
* stridedslice skip execution with 0 dims

* use isExecutable & add subgraph tests

* remove useless code
2023-03-02 15:56:25 +00:00
Vladislav Golubev 57cf23857a [CPU] Split: dynamic split_lengths values support (#15914) 2023-03-02 14:19:45 +00:00
Vladislav Golubev 84285ac317 [CPU] ConvertMatMulToFC fix (#15933) 2023-03-01 14:15:19 +04:00
Vladislav Golubev f0e12cf38b [CPU] Select via Eltwise implementation (#15740) 2023-03-01 14:03:47 +04:00