Commit Graph

400 Commits

Author SHA1 Message Date
River Li
8c84faeecd Add ov::loaded_from_cache checking for CompileModelLoadFromMemoryTest (#15030)
* Add ov::loaded_from_cache checking for CompileModelLoadFromMemoryTestBase

* Skip gna in skip_tests_config
2023-01-11 09:45:11 +03:00
River Li
246a287c34 Add new compile model api to support hash model memory (#14543)
* Add new compile_model api for ONNX RUNTIME OV EP

Allow compile_model() accept model/weight data.

* Update minor place

* Cache model if possible

* Compute hash based on model_xml and model_weight

* Update typo

* Change hash key computation for model's weights

* Resolve test case issue

* Use tensor replace blob for hash computation

* Fix hash computation isssue and add more test cases

* Fix a build issue caused by data format
2023-01-10 16:32:34 +08:00
Tingqian Li
29b8c9e7af [CPU] Add GraphContext & EnforeceBF16 for sub-graphs (#14695) 2023-01-09 15:28:48 +04:00
Sun Xiaoxia
4b80b4850c [CPU] Moved streams number computation to CPU plugin from IStreamsExecutor::Config (#14502) 2023-01-03 14:05:56 +00:00
Nikolay Shchegolev
24f1a9270a [CPU] IsFinite, IsInf and IsNaN operations JIT implementation. (#14697) 2022-12-29 16:21:25 +04:00
Wang, Yang
1f9b2c2ba6 [AUTO Plugin] AUTO/MULTI should not support the meta plugin appearing in candidate device list (#14739)
* Eisable meta plugin repeatedly loading network to itself.

* Remove the test case that  allows device candidate list containing meta plugin.
2022-12-28 10:42:37 +04:00
Wang Wangwang
b8636222c3 Apply ov::execution_devices to GPU & CPU & AUTO BATCH & MULTI (#14109)
* Apply ov::execution_devices to GPU & CPU & AUTO BATCH & MULTI

* Apply ov::execution_devices to GNA

Co-authored-by: yanlan song <bell.song@intel.com>
2022-12-28 10:41:50 +04:00
Vladislav Golubev
ba4edc08d9 [Snippets] Removed limitation on Subgraph creation after Parameters (#13893) 2022-12-26 14:58:13 +04:00
Vladislav Golubev
dea5c1b06e [CPU] Dynamic Pooling fix (#14711) 2022-12-26 09:22:05 +04:00
Katarzyna Mitrus
5d2d2ec623 OneHot - Shape Inference revision (#14602)
* Add type_prop tests

* Add shape_infer tests

* Update shape_infer to preserve interval dim and label

* Unified approach for get_data_as_shape and negative value checks

* Remove redundant gtest header

* rename one hot shape infer test file

* Add test for shape_infer with default ctor and adjust resolve_axis

* Move get_data_as_shape changes to the one hot custom util

* Adjust custom get_data_as_shape
2022-12-23 13:23:43 +04:00
Katarzyna Mitrus
6b5a563748 [Shape Inference] Select - shape inference review (#14708)
* Select shape_infer tests update

* Add Select type_prop tests

* Add evaluate_lower/upper for select

* Revert evaluate_lower/upper for Select

* Use get_node_input_partial_shapes

* Style and headers improvements

* Style apply

* Rename select shape infer file tests

* Use default ctor for output_shapes init

* Use helper for shape_labels init and add more  dim test cases
2022-12-23 13:22:24 +04:00
Xiping Yan
9ba9687301 [CPU] Fix win conditional compilation build failure (#14589) 2022-12-21 16:23:51 +04:00
Sofya Balandina
7856045497 [CompileModelCacheTestBase] Avoid tests with ops and them unsupported precision (#14582)
* [CompileModelCacheTestBase] Avoid tests with ops and them unsupport presicion

* Update functional and plugins tests
2022-12-21 14:23:03 +04:00
Gorokhov Dmitriy
fa55306794 [CPU] Extend StridedSlice dynamic shape support (#14541) 2022-12-20 10:50:41 +00:00
Pawel Raasz
88456e6c3c Review tile class for shape inference aspects (#14673)
* Review tile for shape inference:
- propagate labels and dimension
- template implementation of shape inference
- if repeats is not-positive output dim is always 0

* Refactor Tile shape inference

* Review preserve partial values and labels

* Add support to evaluate bounds from repeats input

* Remove not used code
2022-12-20 12:49:52 +04:00
Egor Duplenskii
e306cbc67a [CPU] [DEBUG CAPS] Extension for snippets and other ngraph transformations (#14223) 2022-12-20 08:49:37 +03:00
Egor Duplenskii
4d44c70c32 [CPU] Improve some error messages (#14668) 2022-12-19 14:56:40 +04:00
Pawel Raasz
b850f422ba Review logical ops for shape inference aspects (#14393)
* Review dims and labels propagation for logical not

* Review dims and labels propagation
for logical and, or, xor

* Remove duplicated tests

* Expand logical ops tests by numpy broadcast
and inputs order

* Review template shape infer of logical ops
 - add static shape inference test
 - add default ctor test

* Default ctor test for LogicalNot op
2022-12-16 14:37:47 +04:00
Katarzyna Mitrus
e0c21ce302 ScatterUpdate CPU shape_infer by entryFirstPassthrough (#13950)
* ScatterUpdate shape_infer tests

* Add ScatterUpdate to entryFirstPassthrough

* Headers cleanup

* Style update

* namespace update
2022-12-16 14:28:16 +04:00
Mateusz Tabaka
43164a6b25 [CPU] RDFT kernel optimizations (#14060) 2022-12-16 11:18:27 +03:00
Nadezhda Ageeva
539f17df62 [HETERO][nGraph] Fix ConstantFolding fused_names handling (#13766)
* [HETERO][CPU][GPU][TEMPLATE][nGraph] Fix ConstantFolding fused_names propogation. Add tests for QN. Fix for unsupported comsumers in QN

Fix ConvolutionMultiplyFusion for CPU

Enable fused_names check for Constants

Fix memory formats rt info for CPU

* Update src/plugins/intel_cpu/src/utils/rt_info/memory_formats_attribute.hpp

Co-authored-by: Ilya Churaev <ilyachur@gmail.com>

* Update src/tests/unit/inference_engine/query_model_test.cpp

Co-authored-by: Ilya Churaev <ilyachur@gmail.com>

* Update src/plugins/intel_cpu/src/utils/rt_info/memory_formats_attribute.hpp

Co-authored-by: Ilya Churaev <ilyachur@gmail.com>

* Update src/plugins/intel_cpu/src/ngraph_transformations/convert_matmul_to_fc.cpp

Co-authored-by: Ilya Churaev <ilyachur@gmail.com>

* Update src/core/src/rt_info.cpp

Co-authored-by: Ilya Churaev <ilyachur@gmail.com>

* Update src/core/src/rt_info.cpp

Co-authored-by: Ilya Churaev <ilyachur@gmail.com>

* Fix review comments

* Fix test

* Code style

* Review comments

* Don't add Parameters/Inputs/Results to supported due to supported consumers/sours. Add tests for that.

* Fix rt_info propogation for ConstantFolding

* Fix test build

* Code stye

* Review comments. Adds ShapeOfBase.

Co-authored-by: Ilya Churaev <ilyachur@gmail.com>
2022-12-16 10:16:50 +04:00
Felix Dohyun Kim
cecea2ef99 [GPU] Add device suffix option for functional tests (#13808) 2022-12-13 17:17:44 +04:00
Egor Duplenskii
43808d9da4 [CPU] [TESTS] Avoid performing extra skip check (#10608) 2022-12-13 15:36:28 +04:00
Sofya Balandina
f5a52dd732 [CONFORMANCE] Fix throws tests on KEY_MULTI_DEVICE_PRIORITIES (#14446)
* [CONFORMANCE] Fix throws tests on KEY_MULTI_DEVICE_PRIORITIES

* Update test name in skip configs
2022-12-12 23:39:42 +03:00
Maksim Kutakov
8ba632f690 [CPU] Fix for the convolution node dummy shapes generation (#14520) 2022-12-12 23:09:09 +04:00
Nikolay Shchegolev
ce5c0ff1dc [Tests][CPU] Move is_inf tests to proper place. (#14559) 2022-12-12 11:56:37 +00:00
Pawel Raasz
9e3b2e0b38 Review opset1 stridedslice for shape inference aspects (#14192)
* Review labels and dimension propagation
- check dimensions propagation with partial dimension
- extend testing for labels an dimensions propagation

* Shape inference support bounds evaluation
on begin, end inputs

* Review static shape inference

* Move sequence generator to dev API
to avoid create unnecessary library dependency

* Fix windows build issue

* Use strided slice in scatter update test
of partial value propagation

* Remove unused constant from test

* Fix strided dim calculation

* Fix clip lb,ub for strided dim calculation

* Use op strides if absent in input_shapes

* Move back SeqGen to shape inference

Co-authored-by: Evgenya Stepyreva <evgenya.stepyreva@intel.com>
2022-12-12 12:14:37 +01:00
Vladislav Golubev
6091b425af [CPU] Convolution shape inference fix (#14548) 2022-12-12 13:59:37 +04:00
Pawel Raasz
45033806fd Review opset7 einsum for shape inference aspects (#14059)
* Review einsum shape and label propagation
- extend type_prop test by check labels and einsum properties

* Review template implementation of shape inference
- rename StaticShape inference test file
- use common fixture and rename test cases
- add default ctor test
- add equation string setter

* Fix einsum label propagation check
due to improvement of dimensions and labels merge

* Remove BWDCMP_RTTI_DEFINITION from einsum op

Co-authored-by: Evgenya Stepyreva <evgenya.stepyreva@intel.com>
2022-12-09 17:04:51 +00:00
Alexandra Sidorova
b1700d97f1 [CPU] Fixed segfault in Generic node creation for dynamic models (#14420) 2022-12-08 17:13:26 +04:00
Xiping Yan
532000a0ce [CPU] Fix conditional compilation for oneDNN brgemm Convolution primitive 2022-12-08 12:07:22 +04:00
Nadezhda Ageeva
a21da85eb9 Fix some tests (#14434) 2022-12-06 22:03:09 +04:00
Luwei Zhou
79f04a704c [CPU] Extend AMX deconv int8 to support oscale+eltwise+eltwise post ops pattern (#14026)
* Extend AMX deconv int8 to support oscale+eltwise+eltwise post ops pattern.

* Add deconv AMX test cases.

* Add multi-eltwise test on deconv AMX int8.

* Applied review comments.

* Update onednn submodule.
2022-12-06 18:32:02 +04:00
Nadezhda Ageeva
23481a5403 Move ReshapePRelu to common transformation to reuse it in NV plugin (#14169) 2022-12-06 16:58:51 +04:00
Luwei Zhou
da5b53e574 [CPU] Fix Deformable Convolution invalid read issue (#14326)
* Fix MACOS compiling issue when enabling CPU_DEBUG_CAPS.

* Fix Deformable Convolution segment fault caused by invalid access offset index.
2022-12-06 15:48:28 +04:00
Luo Cheng
bf0d2cea4b [CPU] Relax threshold for using brgconv1x1 instead of inner product (#14351)
* relax condition

* modify new shape due to threshold changed

* rename M to an exact name

* apply review comments
2022-12-06 09:23:32 +01:00
guozhong wang
796ce53371 change AUTO default hint to Latency (#14236)
* change AUTO default hint to Latency

* Change the comment tput to latency according to wangyang opinion

* fix testcase for MULTI, the hint default value returned by MULTI is throughput

* Remove the redundant testcase and modify the name of the testcase that returns the default value of hint

* Code optimization according to bell opinion, add comments to testcase

* Correct the comments of testcase

* When user sets num_streams, AUTO/MULTI does not set the default hint to HW plugin

* Fix the problem that smoke_AUTO_MULTI_ReturnDefaultHintTest fails to run

* add num_streams and default hint mock testcase

* add auto default perf hint mock testcase
2022-12-06 11:41:43 +08:00
Egor Duplenskii
b585393fee [CPU] Disable memfd kernel memory allocation in oneDNN (#14358)
to avoid segfaults and std::bad_alloc issues
2022-12-05 18:42:53 +04:00
Nikolay Shchegolev
3959890691 [CPU] Unique operation implementation. (#14250) 2022-12-05 17:45:20 +04:00
Anton Voronov
3caebffa5c [CPU] Sparsity weights decompression (#13775) 2022-12-04 22:43:53 +04:00
Chen Xu
541045b0ba [CPU] Ensure mathematical correctness of Convert node (#14174) 2022-12-02 17:10:19 +04:00
yanlan song
3eac2cd613 do not carry batch configs in auto when user does not explicitly set it (#14003)
* temp resolution to support model path for CPU in auto

Signed-off-by: fishbell <bell.song@intel.com>

* disable batch when load through model path

Signed-off-by: fishbell <bell.song@intel.com>

* add mark for future release

Signed-off-by: fishbell <bell.song@intel.com>

* implement step1: donotparse batch config if user not set explictly

Signed-off-by: fishbell <bell.song@intel.com>

* correct typo in case

Signed-off-by: fishbell <bell.song@intel.com>

Signed-off-by: fishbell <bell.song@intel.com>
2022-12-02 10:14:18 +08:00
Vladislav Golubev
a246bdb3a0 [CPU] Unreachable code fix in Interaction fusion transformation (#14353) 2022-12-01 16:12:15 +00:00
Nikolay Shchegolev
add3b11880 [CPU] New operations: IsFinite, IsInf, IsNaN. (#14314) 2022-12-01 16:34:39 +04:00
Tomasz Jankowski
64391cdb3f Transformation component transition to OV namespace (phase 3) (#13653)
* Use openvino pass graph_rewrite

* Use openvino pass pattern matcher

* Remove ngraph opsets

* Remove ngraph.hpp

* Remove ngraph includes

* Remove ngraph includes

* Use transformations API

* Remove ngraph includes

* Remove ngraph rt_info

* Remove unused ngraph includes

* Replace ngraph:: scope with ov:: here and there

* Remove serialize proxy header

* Remove proxy include

* Bring back a file for vpu-plugin

* Fix after upstream merge

* Remove nested namespace conflict

Co-authored-by: Andrei Kochin <andrei.kochin@intel.com>
Co-authored-by: Ivan Tikhonov <ivan.tikhonov@intel.com>
Co-authored-by: Mateusz Tabaka <mateusz.tabaka@intel.com>
2022-12-01 12:34:58 +01:00
Egor Duplenskii
0c6015f669 [CPU][DEBUG_CAPS] Fix build after snippets base class change (#14341) 2022-12-01 12:52:52 +03:00
avoskoboinyk-lohika
62e2a672fb [CPU] Throw an error for LSTMCell-1 with peephole input since it's not supported (#13503) 2022-12-01 11:54:00 +04:00
Maksim Kutakov
1de1029643 [CPU] Dynamic shapes overheads reduction (#13722) 2022-11-30 17:03:47 +04:00
Vladislav Golubev
9eb43bb8b4 [Snippets] [CPU] Serialization/Deserialization enabled (#14064) 2022-11-30 14:37:19 +04:00
Roman Kazantsev
5f06431aec [Install] Remove upper bound for NumPy for default installation and update upper bounds for extras (#13985)
* [Python API][Tools] Top up upper bound version for dependencies: NumPy, TensorFlow, NetworkX

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>

* Remove upper-bound for TensorFlow and NumPy

* Revert "Remove upper-bound for TensorFlow and NumPy"

This reverts commit 662085df2e.

* Remove upper-bound for NumPy for default installation

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
2022-11-30 09:53:06 +04:00