Commit Graph

419 Commits

Author SHA1 Message Date
Pawel Raasz
b44b4fcf2c Refactor shape inference factory (#15004)
* New static shape inference iface using ov::Tensors
- Add new shape inference factory
- Add helpers to create inference factory map entries
- Create map for IShapeInferCommon instead of if else switch
- Create new map for IStaticShapeInfer

* Re-factor tile shape inference to use new iface

* ov::default_label_evaluator uses ov::Tensor now

* Improve cmp::lt for mixed types unsigned and float

* Fix cpp lint issue

* Update using tile shape_inference in GPU plugin

* Do tile shape infer before repeats lock deletion

* Fix label type conversion to element type

* Rename shape infer transformation
to type utils and change namespace from ov::sh_infer_tr to ov::util

* Update shape inference utilities

* Add unit test for safe compare of values

* Update shape infer factory to be a template
and use unordered map

* Remove from_label_type as lebel_t can be used
by element:from<>
2023-01-26 07:44:13 +01:00
Ilya Lavrenov
0970bc8fcf Moved legacy library and deprecated tests to GNA (#15244) 2023-01-25 11:36:22 +04:00
Tomasz Jankowski
988847f559 Transformation component transition to OV namespace (phase 4) (#13558)
* Use openvino pass graph_rewrite

* Replace use of ngraph::pass to ov::pass

* Remove ngraph::pass aliases

* Update after rebase

* Fix post merge conflicts

* Apply code style

* Apply code style

* Remove bypassing inclusion

* Apply code style
2023-01-25 01:02:35 +03:00
Katarzyna Mitrus
c72c6ba331 [ShapeInference] Improvements of GatherElements shape inference (#15264)
* GatherElements shape infer improvements

* Add new tests

* Update test error message
2023-01-24 10:20:28 +01:00
Pawel Raasz
9ee80d67b7 Review topk for shape inference aspects (#14890)
* Review TopK for:
- label and dimension propagation
- partial value and label propagation
- preserve partial value and labels
- add evaluate upper, lower and label

* TopK v1 use shape infer instead fallback
- update static shape inference tests

* TopK shape_infer return output shapes

* Add new way to get tensor data as shape
with custom data processing
- Update tail op to use new function
- Update topk op to use this function
- Add test for negative k

* Add missing include

* Fix compilation issues

* Add support for i4 and u4 element types in
get_raw_data_as

* Fix signed and unsigned and compile warnings

* Remove constexpr from InTypeRange::operator()

* Use forward reference for functor
- minor corrections in InTypeRange class

* Use shape)infer in evaluate
- fix TopK v3 ctor for input data validation

* Fix transformation tests to use correct type for k

* Fix f16 handling in get_raw_data_as

* Correct topk bounds evaluators

* Topk detect overlap for same size dimensions
As op specification not guarantee correct order of
several elements same value

* Remove evaluate bounds
required investigation if required then will be provided

* Remove bound evaluation leftovers

* Update get const data in slice ops
2023-01-24 12:38:08 +04:00
Yuan Hu
ea776672ba [CPU] Allow external blob to be reallocated (#12029) 2023-01-24 09:30:07 +04:00
Egor Duplenskii
66c0dcc742 [CPU][DEBUG_CAPS] Fix Windows build (#15234)
Ensure cross-platform _VA_ARGS_ behavior
2023-01-23 17:17:39 +04:00
Roman Kazantsev
0d201376df [Tests] Fix rest of NumPy deprecated types (#15245)
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
2023-01-21 11:17:52 +00:00
Ivan Novoselov
ffcb83deba [Snippets] FP32 MHA postcommit fixes (#15180) 2023-01-19 14:06:39 +04:00
Vladimir Paramuzov
2201a5f83e Added common ov::execution_mode hint (#15048)
* [GPU] Added common exec mode hint and gpu support

* Add ov::inference precision and update usages. Deprecate ov::hint::inference_precision property

* [GPU] Execution mode tests and fixes

* Fixed code style

* Moved execution_mode test to common. Fixes for python API

* Remove deprecations for hint::inference_precision and just keep both

* Fix test
2023-01-18 20:13:00 +04:00
Alexandra Sidorova
6525dd4727 [Snippets][CPU] Added FP32 MHA tokenization support (#14327) 2023-01-18 16:59:21 +04:00
Katarzyna Mitrus
fd6640b6eb [ShapeInference] GridSample shape infer review (#15102)
* Add more type_prop tests for interval dims and labels

* Add setter for grid sample attributes

* Merge grid sample batch dims

* Add StaticShapeInferenceTest for GridSample

* Fix label test

* Use OpStaticShapeInferenceTest fixture in test
2023-01-18 12:39:05 +00:00
Ilya Lavrenov
c4eeecfec5 Remove myriad plugin (#15131)
* Removed Intel MYRIAD plugin

* Removed Intel MYIAD from CI files

* Removed Intel MYRIAD from cmake folder

* Removed MYRIAD, HDDL from samples

* Removed MYRIAD, HDDL from scripts folder

* Removed MYRIAD from bindings folder (C and Python API)

* Removed MYRIAD tests

* Removed MYRIAD from tests folder

* Removed MYRIAD from tools folder

* Removed HDDL (VAD), MYRIAD (NSC2) from documentation

* Fixed build for AUTO unit tests

* Fixed clang code style

* Fixed comments and issues

* removed MYRIAD from AUTO tests

* Disabled MULTI tests in CI

* Update docs/OV_Runtime_UG/auto_device_selection.md

Co-authored-by: Yuan Xu <yuan1.xu@intel.com>

* Update docs/get_started/get_started_demos.md

Co-authored-by: Yuan Xu <yuan1.xu@intel.com>

* Update docs/OV_Runtime_UG/deployment/local-distribution.md

Co-authored-by: Yuan Xu <yuan1.xu@intel.com>

Co-authored-by: Yuan Xu <yuan1.xu@intel.com>
2023-01-18 15:19:44 +04:00
Pawel Raasz
a1203b931a Review slice for shape inference aspects (#14611)
* Review slice ope for
- Interval dimension and label propagation
- add template shape inference with static shape test
- check preserve partial values on inputs
- check upper/lower evaluate

* Add bounds evaluation for inputs start, stop

* Share code between slice and strided slice
Use same function to calculate elements in step

* Add array includes

* Add to int64_t strides size

* Fix windows compile warnings

* Fix shape inference for unknown axes

* Remove empty lines in slice shape inference

* Correct slice static shape tests

* Use arrays of const chars to store literals
Remove and update exception messages for strided slice

* Fix slice test and apply review comments

* Fix compilation issues

* Fix ellipsis when there is not begin

* Fix get element type for const inputs

* Insert optional axes as const or dynamic param

* Remove temp vectors for dimensions calculation

* Revert set optional input in ctor

* Fix forward slicing for negative start and MAX end
2023-01-18 14:40:53 +04:00
Ilya Lavrenov
c29f111717 Enabled Windows ARM64 build using MSVC cl compiler (#15132)
* Fixed Windows Arm64 build

* Fixed linker warnings in docs

* Fixed Windowd ARM build

* Reverted changes in docs

* Added OpenVINO level macro to define CPU architecture

* Properly remove xbyak from reference kernels optimizations

* Added documentation for cmake functions

* Fixed samples build

* Added installation dir for host protoc

* Fixed installation stage for host_protoc

* Added build dir

* Fixed compilation on Apple

* cççç

* Fixed clang code-style

* Tely on CPU id from xbyak

* Fixed build

* Fixed compilation on mac

* Fixed compilation
2023-01-17 17:29:00 +04:00
Eddy Kim
14a7e443d0 Adding missed conversion logics between layout and string (#15103)
* added missed layout to string conversion

* added an unit test for layout_from_string

* added missing spaces around =

* replaced 95 with SCALAR

* moved layout_to_string into a new file

* changed to parametrized test
2023-01-16 17:32:30 +04:00
Ilya Churaev
0c9abf43a9 Updated copyright headers (#15124)
* Updated copyright headers

* Revert "Fixed linker warnings in docs snippets on Windows (#15119)"

This reverts commit 372699ec49.
2023-01-16 11:02:17 +04:00
Vitaliy Urusovskij
32e74f339e RGB to Gray ConvertColor Preprocessor (#13855)
* Add RGB to Gray ConvertColor Preprocessor

* Revert some changes

* Additional updates

* Polish RGBToGray implementation

Move Conv computations to FP32 and add Round for INT cases

* Extend tests - add comparison with OpenCV

* ClangFormat

* Return commented code

* Make `pre_post_process` tests parametrized

* Add shape calculation for RGB ColorFormat. Make RGB->GRAY 4D only

* Update ov_core_unit_tests

* Update ov_template_func_tests

* Clang Formatting

* Fix python preprocess tests

* Fix warning: truncation from 'double' to 'float'
of RGB->GRAY weights

* Fix flake8 issues

* Fix `convert_color_asserts` test

* Treat GRAY as NHWC

* Resolve review issues with tests

* Fix Py preprocess tests after rebase

* Clang Format

* Add case if C < 0

* Add reference link to RGB coefficients

* Add doxygen documentation for ColorFormat enum
2023-01-13 13:50:30 +04:00
Oleg Pipikin
0ba3a97277 Use unique file names in tests (#15014)
* Add common test api to generate unique test file names

* Use unique file names in ir frontend tests

* Use unique file names in plugin tests

* Fix code style

* fix1

* fix2

* Add unique file names for other tests

* Fix code style 2

* fix3
2023-01-13 12:35:30 +04:00
River Li
8c84faeecd Add ov::loaded_from_cache checking for CompileModelLoadFromMemoryTest (#15030)
* Add ov::loaded_from_cache checking for CompileModelLoadFromMemoryTestBase

* Skip gna in skip_tests_config
2023-01-11 09:45:11 +03:00
River Li
246a287c34 Add new compile model api to support hash model memory (#14543)
* Add new compile_model api for ONNX RUNTIME OV EP

Allow compile_model() accept model/weight data.

* Update minor place

* Cache model if possible

* Compute hash based on model_xml and model_weight

* Update typo

* Change hash key computation for model's weights

* Resolve test case issue

* Use tensor replace blob for hash computation

* Fix hash computation isssue and add more test cases

* Fix a build issue caused by data format
2023-01-10 16:32:34 +08:00
Tingqian Li
29b8c9e7af [CPU] Add GraphContext & EnforeceBF16 for sub-graphs (#14695) 2023-01-09 15:28:48 +04:00
Sun Xiaoxia
4b80b4850c [CPU] Moved streams number computation to CPU plugin from IStreamsExecutor::Config (#14502) 2023-01-03 14:05:56 +00:00
Nikolay Shchegolev
24f1a9270a [CPU] IsFinite, IsInf and IsNaN operations JIT implementation. (#14697) 2022-12-29 16:21:25 +04:00
Wang, Yang
1f9b2c2ba6 [AUTO Plugin] AUTO/MULTI should not support the meta plugin appearing in candidate device list (#14739)
* Eisable meta plugin repeatedly loading network to itself.

* Remove the test case that  allows device candidate list containing meta plugin.
2022-12-28 10:42:37 +04:00
Wang Wangwang
b8636222c3 Apply ov::execution_devices to GPU & CPU & AUTO BATCH & MULTI (#14109)
* Apply ov::execution_devices to GPU & CPU & AUTO BATCH & MULTI

* Apply ov::execution_devices to GNA

Co-authored-by: yanlan song <bell.song@intel.com>
2022-12-28 10:41:50 +04:00
Vladislav Golubev
ba4edc08d9 [Snippets] Removed limitation on Subgraph creation after Parameters (#13893) 2022-12-26 14:58:13 +04:00
Vladislav Golubev
dea5c1b06e [CPU] Dynamic Pooling fix (#14711) 2022-12-26 09:22:05 +04:00
Katarzyna Mitrus
5d2d2ec623 OneHot - Shape Inference revision (#14602)
* Add type_prop tests

* Add shape_infer tests

* Update shape_infer to preserve interval dim and label

* Unified approach for get_data_as_shape and negative value checks

* Remove redundant gtest header

* rename one hot shape infer test file

* Add test for shape_infer with default ctor and adjust resolve_axis

* Move get_data_as_shape changes to the one hot custom util

* Adjust custom get_data_as_shape
2022-12-23 13:23:43 +04:00
Katarzyna Mitrus
6b5a563748 [Shape Inference] Select - shape inference review (#14708)
* Select shape_infer tests update

* Add Select type_prop tests

* Add evaluate_lower/upper for select

* Revert evaluate_lower/upper for Select

* Use get_node_input_partial_shapes

* Style and headers improvements

* Style apply

* Rename select shape infer file tests

* Use default ctor for output_shapes init

* Use helper for shape_labels init and add more  dim test cases
2022-12-23 13:22:24 +04:00
Xiping Yan
9ba9687301 [CPU] Fix win conditional compilation build failure (#14589) 2022-12-21 16:23:51 +04:00
Sofya Balandina
7856045497 [CompileModelCacheTestBase] Avoid tests with ops and them unsupported precision (#14582)
* [CompileModelCacheTestBase] Avoid tests with ops and them unsupport presicion

* Update functional and plugins tests
2022-12-21 14:23:03 +04:00
Gorokhov Dmitriy
fa55306794 [CPU] Extend StridedSlice dynamic shape support (#14541) 2022-12-20 10:50:41 +00:00
Pawel Raasz
88456e6c3c Review tile class for shape inference aspects (#14673)
* Review tile for shape inference:
- propagate labels and dimension
- template implementation of shape inference
- if repeats is not-positive output dim is always 0

* Refactor Tile shape inference

* Review preserve partial values and labels

* Add support to evaluate bounds from repeats input

* Remove not used code
2022-12-20 12:49:52 +04:00
Egor Duplenskii
e306cbc67a [CPU] [DEBUG CAPS] Extension for snippets and other ngraph transformations (#14223) 2022-12-20 08:49:37 +03:00
Egor Duplenskii
4d44c70c32 [CPU] Improve some error messages (#14668) 2022-12-19 14:56:40 +04:00
Pawel Raasz
b850f422ba Review logical ops for shape inference aspects (#14393)
* Review dims and labels propagation for logical not

* Review dims and labels propagation
for logical and, or, xor

* Remove duplicated tests

* Expand logical ops tests by numpy broadcast
and inputs order

* Review template shape infer of logical ops
 - add static shape inference test
 - add default ctor test

* Default ctor test for LogicalNot op
2022-12-16 14:37:47 +04:00
Katarzyna Mitrus
e0c21ce302 ScatterUpdate CPU shape_infer by entryFirstPassthrough (#13950)
* ScatterUpdate shape_infer tests

* Add ScatterUpdate to entryFirstPassthrough

* Headers cleanup

* Style update

* namespace update
2022-12-16 14:28:16 +04:00
Mateusz Tabaka
43164a6b25 [CPU] RDFT kernel optimizations (#14060) 2022-12-16 11:18:27 +03:00
Nadezhda Ageeva
539f17df62 [HETERO][nGraph] Fix ConstantFolding fused_names handling (#13766)
* [HETERO][CPU][GPU][TEMPLATE][nGraph] Fix ConstantFolding fused_names propogation. Add tests for QN. Fix for unsupported comsumers in QN

Fix ConvolutionMultiplyFusion for CPU

Enable fused_names check for Constants

Fix memory formats rt info for CPU

* Update src/plugins/intel_cpu/src/utils/rt_info/memory_formats_attribute.hpp

Co-authored-by: Ilya Churaev <ilyachur@gmail.com>

* Update src/tests/unit/inference_engine/query_model_test.cpp

Co-authored-by: Ilya Churaev <ilyachur@gmail.com>

* Update src/plugins/intel_cpu/src/utils/rt_info/memory_formats_attribute.hpp

Co-authored-by: Ilya Churaev <ilyachur@gmail.com>

* Update src/plugins/intel_cpu/src/ngraph_transformations/convert_matmul_to_fc.cpp

Co-authored-by: Ilya Churaev <ilyachur@gmail.com>

* Update src/core/src/rt_info.cpp

Co-authored-by: Ilya Churaev <ilyachur@gmail.com>

* Update src/core/src/rt_info.cpp

Co-authored-by: Ilya Churaev <ilyachur@gmail.com>

* Fix review comments

* Fix test

* Code style

* Review comments

* Don't add Parameters/Inputs/Results to supported due to supported consumers/sours. Add tests for that.

* Fix rt_info propogation for ConstantFolding

* Fix test build

* Code stye

* Review comments. Adds ShapeOfBase.

Co-authored-by: Ilya Churaev <ilyachur@gmail.com>
2022-12-16 10:16:50 +04:00
Felix Dohyun Kim
cecea2ef99 [GPU] Add device suffix option for functional tests (#13808) 2022-12-13 17:17:44 +04:00
Egor Duplenskii
43808d9da4 [CPU] [TESTS] Avoid performing extra skip check (#10608) 2022-12-13 15:36:28 +04:00
Sofya Balandina
f5a52dd732 [CONFORMANCE] Fix throws tests on KEY_MULTI_DEVICE_PRIORITIES (#14446)
* [CONFORMANCE] Fix throws tests on KEY_MULTI_DEVICE_PRIORITIES

* Update test name in skip configs
2022-12-12 23:39:42 +03:00
Maksim Kutakov
8ba632f690 [CPU] Fix for the convolution node dummy shapes generation (#14520) 2022-12-12 23:09:09 +04:00
Nikolay Shchegolev
ce5c0ff1dc [Tests][CPU] Move is_inf tests to proper place. (#14559) 2022-12-12 11:56:37 +00:00
Pawel Raasz
9e3b2e0b38 Review opset1 stridedslice for shape inference aspects (#14192)
* Review labels and dimension propagation
- check dimensions propagation with partial dimension
- extend testing for labels an dimensions propagation

* Shape inference support bounds evaluation
on begin, end inputs

* Review static shape inference

* Move sequence generator to dev API
to avoid create unnecessary library dependency

* Fix windows build issue

* Use strided slice in scatter update test
of partial value propagation

* Remove unused constant from test

* Fix strided dim calculation

* Fix clip lb,ub for strided dim calculation

* Use op strides if absent in input_shapes

* Move back SeqGen to shape inference

Co-authored-by: Evgenya Stepyreva <evgenya.stepyreva@intel.com>
2022-12-12 12:14:37 +01:00
Vladislav Golubev
6091b425af [CPU] Convolution shape inference fix (#14548) 2022-12-12 13:59:37 +04:00
Pawel Raasz
45033806fd Review opset7 einsum for shape inference aspects (#14059)
* Review einsum shape and label propagation
- extend type_prop test by check labels and einsum properties

* Review template implementation of shape inference
- rename StaticShape inference test file
- use common fixture and rename test cases
- add default ctor test
- add equation string setter

* Fix einsum label propagation check
due to improvement of dimensions and labels merge

* Remove BWDCMP_RTTI_DEFINITION from einsum op

Co-authored-by: Evgenya Stepyreva <evgenya.stepyreva@intel.com>
2022-12-09 17:04:51 +00:00
Alexandra Sidorova
b1700d97f1 [CPU] Fixed segfault in Generic node creation for dynamic models (#14420) 2022-12-08 17:13:26 +04:00
Xiping Yan
532000a0ce [CPU] Fix conditional compilation for oneDNN brgemm Convolution primitive 2022-12-08 12:07:22 +04:00