Commit Graph
476 Commits
Author SHA1 Message Date
Kelvin Choi f9afe07c9d [GPU] Add reorder between FC matmal and reshape (#11706) 2022-06-07 13:10:58 +09:00
bb3868d8cd [CPU] OneDNN 2.6 migration (#11627)
* Migrate on OneDNN 2.7

* [CPU] Enabled brconv implementation

* Post ops optimizations

* [CPU] Enabled I8 precision on activations for Convolution node

* [CPU][WA] Disabled Deconvolution + post ops fusing optimization

* Fixed FQ post op optimization

* [CPU] Optimize post ops processing

* [WA] Add node name if tensor names are empty

* [WA] remove  layout compatibility chheck that leads to the fase-positive exceptions

* [CPU] Optimize processing for FQ + Sum + FQ post ops pattern

* [CPU][WA] Enabled ReduceSum -> AvgPool transformation due to perf issues

* fix compiler error

* rebase onednn master

* cherry pick from 2.7 to 2.6

* [WA] make cpu case to run completed

* fix xmm zero check

* reopen 'FuseDeconvolutionAndSimpleOperation' Transform  to fix CPU 'ConvolutionBackpropDataLayerTest' fail issue

* [WR] Removed failed the ReduceMean tests caused by 21f3555.

* group deconv may crash on memory out of bound

* [WA] Remove the moc fail case by #af4731a1

* testcase conv maxpool will check brgconv instead of jit

* test subgraph added nhwc format check

* fix gemm bf16 win crash

* fix avx2 groupconv accuracy problem

* [WA] remove invalid FQ tests

* WR to disable the LPT multiplyToGroupConv test because the  transformation was disabled in d5e16f

* add gemm int8 binary postops to fix GroupConvolutionQDqTransformation fail

* add gemm int8 binary postops to fix GroupConvolutionQDqTransformation fail

* fix gemm bf16 fail

* Fix ConcatConvSumInPlaceTest

* Add cpuDebugFuncTests target

* [WA] bf16 crash due to MemoryInput/Output

* OVClassBasicTest case typo

* testcase subgraph sets default ENFORCE_BF16 to NO

* fix clang check

* Fix primType check issue

* Fix cpplint error

* MemoryInput/Output support bf16; Enforce bf16 'NO' should enable snipptes

* disable BF16 fusing fakequant testcase

* testcase init support amx check

* testcase for conv brgconv avx512/amx

* testcase for conv brgconv avx512/amx

* WR enforce reorder bug and add NSPC into deconv supported list.

* Compiling issue fix.

* [WA] skip fakequantize fusing in bf16

* mix legacy/new binary postops

* make nightly case run. tested on amx/avx512/avx2.

* [CPU] Add BF16 AMX test for Matmul

* Add CPU dump check tool

* Add verbose log

* Generate exec graph in cpu dump check tool

* fix binary prelu post Ops

* fix cpplint

* Update ONEDNN version to fix AVX2 bug.

* cpu dump check supports compare dump files

* Add a new CPU_DEBUG_CAPS: OV_CPU_SUMMARY_PERF

* change VERBOSE_LOG to DEBUG_LOG

* fix oneDNN register_jit_code log

* fix cpplint

* Add OV_CPU_DEBUG_LOG controls debug logs to show

* Revert reorder WR.

* Enhanced CPU debug logs and breakpoint support

* Enhanced cpu_dump_check with --ports

* Fix DEBUG_LOG compile issue

* GroupDeconvolutionLayerCPUTest extend to add amx test cases

* Add Node into DBUEG_LOG

* cpu_dump_check: Dump results even no port is specified

* FIx MergeTransposeAndReorder for blocked input

* Fix cpu_dump_check result names

* Enhance DEBUG_LOG on edges

* Cpu dump check support shape mismatch

* Fix bi-directionl inplace

* Cpu dump check support inference_precion_hing f32.

* fix windows dump fail.

* fix depthwise nwc conv

* add rtol arg

* win debugbreak

* fix pooling accuracy

* GroupDeconvolutionLayerCPUTest remove invalid test param for nspc

* recover ov onednn fork

* revert af4731a1f1 '[WA] remove layout compatibility chheck'

* [WA] disable avx2 conv3d fusing case

* [WA] disable avx2 conv3d fusing case

* [WA] Disabled weights md transpose in FC to prevent perf degradations

Co-authored-by: dmitrygo <dmitry.gorokhov@intel.com>
Co-authored-by: Vladislav Golubev <vladislav.golubev@intel.com>
Co-authored-by: Zhang Yi3 <yi3.zhang@intel.com>
Co-authored-by: liubo-intel <bo4.liu@intel.com>
Co-authored-by: Luwei Zhou <luwei.zhou@intel.com>
Co-authored-by: Li, Tingqian <tingqian.li@intel.com>
Co-authored-by: xuchen-intel <chen.xu@intel.com>
Co-authored-by: ceciliapeng2011 <cecilia.peng@intel.com>
2022-06-06 18:30:32 +08:00
Artur Kulikowski 32580ca65b Add ReduceMerge transformation (#11746)
Tickets: 60918
2022-06-04 13:44:50 +02:00
Mateusz Bencer dba4dbb9d6 Improve L2NormFusion transformation (#11765) 2022-06-03 18:51:21 +02:00
Katarzyna Mitrus 47155b43d0 [Transformation] Add GeluFusion with Tanh (#11752) 2022-06-03 08:36:12 +02:00
guozhong wang 5b75d69712 add testcase for EXCLUSIVE_AYSNC_REQUESTS when input device is AUTO (#11716)
* add AUTO cpu and gpu testcase for EXCLUSIVE_AYSNC_REQUESTS

* add AUTO myriad testcase for EXCLUSIVE_AYSNC_REQUESTS
2022-06-02 10:28:30 +08:00
cd771ed23b Simple graph correctness test for virtual devices (#11492)
* add cumulative correctness test

* add infer_correctness test

Signed-off-by: Hu, Yuan <yuan2.hu@intel.com>

* add comments

Signed-off-by: Hu, Yuan <yuan2.hu@intel.com>

Co-authored-by: Hu, Yuan <yuan2.hu@intel.com>
Co-authored-by: Chen Peter <peter.chen@intel.com>
Co-authored-by: Shen, Wanglei <wanglei.shen@intel.com>
2022-06-02 09:42:38 +08:00
Mykhailo Hnap d26ed6a180 [GPU] Roll-7 (#11602)
* [GPU] Implement Roll kernel

* [GPU] Add Roll kernel selector

* [GPU] Add Roll primitive

* [GPU] Add Roll helpers

* [GPU] Implement unit tests for the Roll operation

* [GPU] Add Roll operation to GPU plugin

* [GPU] Add single layer tests for the Roll operation

* [GPU] Add changes after review

* [GPU] Improve cldnn unit test
2022-06-02 09:42:11 +09:00
cecilia peng 016c5f537a Cecilia/multiclass nms9/cpu impl (#11246)
* multiclass_nms opset9 spec, api, reference, paddle fe mapper, paddle fe unittest.

* multiclass_nms opset9 cpu node impl.

* multiclass_nms opset9 shape infer fix.

* multiclass_nms opset9: add transform ConvertMulticlassNms8ToMulticlassNms9.

* ConvertMulticlassNmsToMulticlassNmsIE: to MulticlassNmsIEInternal

* add test dependency package paddledet==2.1.0

* 1. fix for roisnum overflow. 2. common shape_infer private function.

Signed-off-by: jialipen <cecilia.peng@intel.com>

* 1. use common infer_shape helper. 2. fix roisnum overflow issue. 3. fix for nmsWithEta.

* test suite for opset9 multiclass_nms smoke tests pass, with both static and dynamic shapes.

code clean for unit test.

* decouple specification from this PR.

* op fuzzy: dynamic input/output

* reference impl refactor

* multiclass_nms_base no need clone_inputs.

* code clean

* restrict ppdet import

* fix clang format error

* change ppdet import to resolve CI fail issue related to its dependency.

* fix CI

* refactor: multiclass_nms_shape_inference for opset9 and reference impl.
TODO: could be applied to opset8 and even matrix_nms.

* fix CI build failure.

* CI fix for ambiguous namespace reference issue when
building static libs.

* update nms save_model python scripts.

* dynamic inputs for NMS with CPU plugin.

* copyright header for test scripts.

* op comformance test for multiclass_nms_9.

* minor update: is_type

* python opset9 and multiclass_nms

* flake8 CI fix

flake8 CI fix

flake8 CI fix

* remove NmsBase. stage1.

flake8 CI fix

remove NmsBase. stage 1 fix.

* rm NmsBase. stage2.

* more multiclass_nms prop tests and fix.

* remove unchanged ops from binding opset9.

* dependcy of paddle_tests.

* fix: add MulticlassNms to op mapper.

* clang format fix

* fix merge error.
2022-05-31 07:56:01 +08:00
Paul Youngsoo AhnandVladimir Paramuzov c185198785 [GPU] Added UUID property(#81574) (#11567)
Co-authored-by: Ahn, Paul Y <paul.y.ahn@intel.com>

Co-authored-by: Vladimir Paramuzov <vladimir.paramuzov@intel.com>
2022-05-26 16:44:53 +09:00
opoluektov-lohikaandtgubanova-lohika ccd001f25b [GPU] Support axis 0 for Softmax (#10364)
* [GPU] Modify Softmax single layer tests to check Softmax-8 is supported with axes in [-rank, rank) interval

* [GPU] Fix cldnn::softmax::dimension_t documentation

* [GPU] Fix ParamsKey::EnableSoftmaxDim

Support Z dimension.

* [GPU] Add Softmax single layer test that checks 5D case

Since some Softmax kernel code contains ifdef on 5-dimensional case,
a test case is needed that covers this functionality.

* [GPU] Support axis 0 in Softmax

* [GPU] Modify Softmax single layer tests to check axis 0

* [GPU] Modify Softmax items class optimized kernel to handle axis 0 correctly

Modify single layer test accordingly.

* [GPU] Modify Softmax unit-test to check softmax::normalize_b

* Split SoftMaxLayerTest into opset1 and opset8 versions

Use SoftMax8LayerTest in the tests throughout repository.
SoftMaxLayerTest now defaults to SoftMax1LayerTest for compatibility.

* [GPU] Add f16 test-case for Softmax single-layer test

Co-authored-by: tgubanova-lohika <tgubanova@lohika.com>
2022-05-26 12:06:08 +09:00
Tetiana Gubanova eb36b891eb [GPU] Impelement ExperimentalDetectronPriorGridGenerator-6 gpu implementation (#11632)
* Implement experimental_detectron_prior_grid_generator kernel

* register experimental_detectron_prior_grid_generator operation

* implement single layer tests

* add unit tests to detectron
2022-05-25 18:52:03 +09:00
Krzysztof Bruniecki 81adc47e83 [GNA] Implement GNA memory region splitting (RO/Input/Output/State/Scratch) and export in GNA format enabled (#11577) 2022-05-25 11:40:50 +02:00
4b08ce4787 [GPU] (I)Dft with single layer test (#9891)
* dft with single layer test

* idft with single layer test

* fix output param usage in dft

* update dft according to the clang-format

* move output layout setup to calc_output_layout

* add support for other dimensions

* add clDNN unit test for DFT/IDFT

* remove unnecessary original rank

* use defined formats in kernel

* fix dft docs

* changes after review

* Revert "fix dft docs"

This reverts commit 45b05172dfd161d92dae6d26e0f1b74748e56fd5.

Co-authored-by: Serhii Pavlovskyi <spavlovskyi@lohika.com>
Co-authored-by: Mykhailo Hnap <mhnap@lohika.com>
2022-05-25 16:24:46 +09:00
Chenhu Wang fa7ca20425 NMS-9 op creation and ref implementation and CPU plugin (#11132)
* operation creation

* refrence implementation

* code style

* soft_nms_supported_by_nms9

* IE core and cpu plugin update

* apply review

* add transformation test
2022-05-25 06:27:12 +03:00
Tetiana Gubanova 22ee17fda6 [GPU] AdaptiveMaxPool and AdaptiveAvgPool gpu implementations (#11556)
* Add kernel for AdaptivePooling

* Add GPU primitive for AdaptivePooling

* Add single-layer tests for GPU

* Add adaptive pooling unit tests
2022-05-24 00:48:55 +09:00
Szymon Irzabek 714601cf5b [GNA] Change Constants' precision in MVN decomposition (#11665) 2022-05-20 13:21:32 +02:00
Tetiana GubanovaandOleksii Khovan 91ab69e0c7 [GPU] Implement ExperimentalDetectronGenerateProposalsSingleImage-6 (#11616)
* Add single layer tests for GPU

* Add GPU primitive for ExperimentalDetectronGenerateProposalsSingleImage

* Add kernel for ExperimentalDetectronGenerateProposalsSingleImage

* Add unit test

* rename abbreviation edgpsi to the full name experimental_detectron_generate_proposal_single_image

* Add f16 support to operation

* Add f16 support to the unit test

* Add notification about the second output in primitive

Co-authored-by: Oleksii Khovan <okhovan@lohika.com>
2022-05-20 17:02:29 +09:00
Chen Xu 8886d0fde7 [CPU] Fix shape mismatching in fusing per channel (#11162)
* Fix shape mismatching in fusing per channel

* channelAxis data type changes to int
2022-05-20 11:05:17 +08:00
yanlan songandChen Peter 35ba009cd6 Bell/cache refine (#11414)
* cache compliance

Signed-off-by: fishbell <bell.song@intel.com>

* clang format

Signed-off-by: fishbell <bell.song@intel.com>

* fix crash

Signed-off-by: fishbell <bell.song@intel.com>

* enable test cases

Signed-off-by: fishbell <bell.song@intel.com>

* enable more tests

Signed-off-by: fishbell <bell.song@intel.com>

* refine cases

Signed-off-by: fishbell <bell.song@intel.com>

* do not use try catch

Signed-off-by: fishbell <bell.song@intel.com>

* case refine

Signed-off-by: fishbell <bell.song@intel.com>

* fix unicode failure

Signed-off-by: fishbell <bell.song@intel.com>

* use model_path.empty instead of try catch

Signed-off-by: fishbell <bell.song@intel.com>

* add mock test

Signed-off-by: fishbell <bell.song@intel.com>

* add more mock test

Signed-off-by: fishbell <bell.song@intel.com>

* disable unicode test on windows

Signed-off-by: fishbell <bell.song@intel.com>

* add hetero caching/stateful mode support

Signed-off-by: fishbell <bell.song@intel.com>

* remove the disable label for CPU

Signed-off-by: fishbell <bell.song@intel.com>

* resolve the CI failure

Signed-off-by: fishbell <bell.song@intel.com>

remove redundant lines

Signed-off-by: fishbell <bell.song@intel.com>

Co-authored-by: Chen Peter <peter.chen@intel.com>
2022-05-20 10:17:40 +08:00
76dfeceb93 [Eye-9] Reference and CPU implementation for Eye-9 (#11538)
* Added shell for Eye-9

* Updated spec for Eye-9

* Added reference for Eye-9

* eye cpu

* Added op impl check for Eye-9

* Fix unallowed dynamic to static dim conversion in eye shape_infer

* Add template plugin tests for dynamic shapes

* Add template plugin tests for dynamic shapes batch input

* Enable batch shape input dynamic rank

* Uncomment 3D batch cpu Eye tests

* Update assertions and messages

* use ov::element type

* Remove redundant evaluate from eval map

* Style fix

* Add static_cast<T>(1) to cpu eye

* Add defaults to eye cpu class members

* Reuse out_ptr and checks

* Reutrn if onesPerBatchNum == 0

* Add Eye CPU Dynamic shape tests with 2D batch

* Additional test cases for CPU and reference

* Disable 3D batch eye cpu tests

* Fix CPU implementation for matrix with not equal cols and rows

* Update CPU test name

* Disable CPU Eye 3D batch static shapes tests

Co-authored-by: Alexandra Sidorova <alexandra.sidorova@intel.com>
Co-authored-by: Yury Gaydaychuk <yury.gaydaychuk@intel.com>
2022-05-19 16:37:00 +03:00
Mateusz Bencer 4d0a572f13 Move RemoveConcatZeroDimInput and RemoveMultiSubGraphOpDanglingParams to CNNNetworkNGraphImpl ctor (#11547) 2022-05-19 10:50:22 +02:00
9648080fbc Meiyang/paddle generate proposals 2 (#11285)
* create new op v9::GenerateProposalsSingleImage and support paddle generate proposal v2

* support scale in GenerateProposals

* Add output roi_num in GenerateProposal; change anchor's shape to [H, W, A, 4]

* fix paddle generate proposals frontend issue

* rename MKLDNNGenerateProposalsSingleImage to GenerateProposalsSingleImage

* add GenerateProposals attribute 'roi_num_type'

* fuse type togenerate_proposals

* multibatch support

* fix review comments; paddle tests added

* use pad instead of concat

* fix generate proposals visitor test parameter

* add testcase for generate proposal scale and fix generate proposals reference issue

* rename to GenerateProposals

* add generate proposals ngraph reshape test; opset9 support and test;

* fix compiling issue

* add dependency 'paddledet' on paddle frontend test

* Update src/core/include/ngraph/op/generate_proposals.hpp

Co-authored-by: Ilya Churaev <ilyachur@gmail.com>

* Update src/core/include/openvino/op/generate_proposals.hpp

Co-authored-by: Ilya Churaev <ilyachur@gmail.com>

* Update src/core/reference/include/ngraph/runtime/reference/generate_proposal.hpp

Co-authored-by: Ilya Churaev <ilyachur@gmail.com>

* Update src/core/src/op/generate_proposals.cpp

Co-authored-by: Ilya Churaev <ilyachur@gmail.com>

* Update src/core/include/ngraph/op/generate_proposals.hpp

Co-authored-by: Ilya Churaev <ilyachur@gmail.com>

* Update src/core/src/op/generate_proposals.cpp

Co-authored-by: Ilya Churaev <ilyachur@gmail.com>

* Update src/core/src/op/generate_proposals.cpp

Co-authored-by: Ilya Churaev <ilyachur@gmail.com>

* Update src/core/src/op/generate_proposals.cpp

Co-authored-by: Ilya Churaev <ilyachur@gmail.com>

* Update src/core/include/openvino/op/generate_proposals.hpp

Co-authored-by: Ilya Churaev <ilyachur@gmail.com>

* Update src/core/include/openvino/op/generate_proposals.hpp

Co-authored-by: Ilya Churaev <ilyachur@gmail.com>

* fix compiling issue after newly added commit

* clang fix

* fix compiling issue

* add paddledet dependency

* fix compiling issue

* fix compiling issue

* clang fix

* skip ppdet.modeling.ops in paddle generate proposals test

* single layer update after rebase master

* set pycocotools to 2.0.4

* skip ppdet.modeling.ops.__init__

* add paddle test dependency

* fix template issue

* rename mkldnn to dnnl

* fix template issue

* fix windows compiling issue

* update testcase vector construction

* add shape check and test; add some annotation; apply review suggestion

* Revert "add paddle test dependency"

This reverts commit 959a2d770d3f6cb28d4609981c79cc49a25847fd.

* rm dependency of paddledet for paddle frontend test

* update opset9 number

* fix windows issue

Co-authored-by: Luo Cheng <cheng.luo@intel.com>
Co-authored-by: Ilya Churaev <ilyachur@gmail.com>
2022-05-16 09:13:52 +08:00
Jan Iwaszkiewicz 62d17a070a [SoftSign-9] Shell, reference impl and decomposition for SoftSign-9 (#11546) 2022-05-11 16:44:15 +02:00
Katarzyna Mitrus 7851020cd3 [ONNX] Enable ONNX ROIAlign-16 (by ov::v9::ROIAlign) (#11633) 2022-05-11 11:43:15 +02:00
Wilson Seok 5456631517 Cleanup eltwise skipped testcase in gpu single layer test (#11525)
* cleanup eltwise skipped test cases in gpu plugin

* update comment clearly
2022-05-11 18:07:36 +09:00
Bo Liu eddd31f58f Liubo/roi align 9 ov core cpu plugin (#11188)
* roi_align_9: ov_core, transformations, template_plugin

* roi_align_9: CPU Plugin

* keep only constructor with enums which is aligned with spec

* remove evaluate function for ROIAlign_9

* Add op check test for operation ROIAlign-9

* Apply suggestions from code review

* fix version name from 'v0' to 'v3' in transform part

* use common shape_infer function for v3 and v9

* remove'tf_' prefix for ROIAlign::AlignedMode to avoid misleading for models from different platforms
2022-05-10 08:14:37 +08:00
yanlan songandTaylor Yeonbok Lee 35ad252003 Bell/rule out device (#11516)
* Fix batchability check of MAX_BATCH_SIZE

* Applied review comment

* new implementation

Signed-off-by: fishbell <bell.song@intel.com>

* enable device removing

Signed-off-by: fishbell <bell.song@intel.com>

* enable tests

Signed-off-by: fishbell <bell.song@intel.com>

* Update plugin.hpp

cpplint error

Co-authored-by: Taylor Yeonbok Lee <taylor.lee@intel.com>
2022-05-07 17:41:59 +08:00
yanlan song 912f40e74d stateful inferface impl for AUTO/HETERO (#11590)
* CPU for stateful model

Signed-off-by: fishbell <bell.song@intel.com>

* log

Signed-off-by: fishbell <bell.song@intel.com>

* hetero impl

Signed-off-by: fishbell <bell.song@intel.com>

* enable tests

Signed-off-by: fishbell <bell.song@intel.com>
2022-05-06 12:43:56 +08:00
Mateusz Tabaka b92e10ff6e Fix setting default affinity property in cpuFuncTests (#11609)
CPU plugin sets default affinity to HYBRID_AWARE
if it's running on AlderLake, so we need to reflect that
in cpuFuncTests.
2022-05-04 12:42:43 +02:00
Tetiana GubanovaandOleksii Khovan 7dd8fbd47e [GPU] Einsum with repeated labels and ellipsis support (#11615)
* Einsum test helper

* Einsum single layer tests

* Add Einsum decomposition with repeated labels and ellipsis support
to GPU transformations pipeline

Co-authored-by: Oleksii Khovan <okhovan@lohika.com>
2022-05-03 20:46:22 +09:00
opoluektov-lohika 1ed03bbe6b Fix conformance test runner handling of input directories (#11611)
Check first whether the path specified by --input_dirs is a directory.

Otherwise the argument is always treated as a .lst file,
and in case it is a directory it silently fails,
which causes the test runner to not execute any tests intended.
2022-05-02 22:00:21 +09:00
Mateusz Tabaka 54e5af95da Disable two cases from smoke_Conv_3D_FP32_fusingScaleShiftAndFakeQuantizePerChannel (#11536)
They sporadically fail in precommit.
Ticket: 84153
2022-04-20 14:34:46 +02:00
Mateusz Tabaka e53f702f81 Handle negative axis in SimplifySecondInputOfReshape (#11524)
Fixes #11501
2022-04-19 12:20:21 +02:00
Alexandra Sidorova 9dffa706fb Added shell for Eye-9 (#11210) 2022-04-12 12:49:07 +02:00
Ilya Lavrenov c2703c81f6 Don't install nlohmann_json_schema_validator for samples (#11446)
* Try to improve gflags

* Try to improve gflags: part 2

* Tried to use dependencies on system

* Use nlohmann_jsonConfig from system

* Enabled nlohmann_json from system

* Improvements

* handle system gflags in developer package

* Simplifications

* Simplify dependency management

* Corrected package names

* Fixed subgraphsDumper configure stage

* Try to fix rhel8

* Try to fix macosx

* Fixed VPUX build

* Fixed aliasing issues

* Suppress some wanrings

* export gflags when build it

* Fixed some LTO

* Try to fix Mac

* revert

* use gflags as private dependency

* Aligned targets in developer package

* Fixed frontends tests build on U20 with LTO

* PAssed

* Don't use pkg_search_module(zlib ..) during cross-compilation

* Removed unused variables

* Fixed finding of zlib during cross-compilation

* CVS-83529

* Use nothreads_static

* Fixed python
2022-04-05 19:16:32 +00:00
Irina Efode 01f530d443 API Conformance refactoring (#11421)
* ie_infer_request + ie_exec_net

* build

* build

* ov_compiled_model

* ov_infer_request

* ov_plugin

* ie_plugin

* build
2022-04-05 18:43:36 +03:00
Irina Efode 3f953b37c1 Reduce conformance execution time (#11416) 2022-04-05 18:40:33 +03:00
3a36d90c11 [GNA] Moved PWL functional tests (#10731)
* Moving PWL to ngraph

* improving the running time of php_search; refactoring the pwl operation

* fixed erros & refactored code

* moved PWL op to GNA

* Update src/plugins/intel_gna/ops/pwl.hpp

Co-authored-by: Elizaveta Lobanova <elizaveta.lobanova@intel.com>

* Update src/plugins/intel_gna/ops/reference/pwl.hpp

Co-authored-by: Elizaveta Lobanova <elizaveta.lobanova@intel.com>

* Update src/plugins/intel_gna/ops/pwl.cpp

Co-authored-by: Elizaveta Lobanova <elizaveta.lobanova@intel.com>

* Update src/plugins/intel_gna/transformations/transpose_to_pwl.hpp

Co-authored-by: Elizaveta Lobanova <elizaveta.lobanova@intel.com>

* Update src/plugins/intel_gna/transformations/transpose_to_pwl.cpp

Co-authored-by: Elizaveta Lobanova <elizaveta.lobanova@intel.com>

* fixed compilation error

* Update inference-engine/tests/unit/gna/ngraph/transformations/gna_pwl.cpp

Co-authored-by: Elizaveta Lobanova <elizaveta.lobanova@intel.com>

* added some tests; changed algorithm of checking accuracy of pwl; refactoring

* added first and last segments; added fq and fixed errors

* fixed after review & rewrote some tests on ngraph

* removed debug logs & fixed code style check error

* s/ngraph_helper/ngraph_util

* removed TRANSFORMATIONS_API in PWLApproximation class declaration

* removed OPENVINO_API in Pwl class declaration

* replaced the deprecated version of evaluate() with a new one

* fixed some problems after reviewing

* fixed a problem when a value of function of left point of segment is less than minimum of function

* corrected a value of the right point of last segments

* [GNA] Moved pwl func tests

* Deleted deprecated test

* s/OPENVINO_RTTI/OPENVINO_OP

* Deleted conflicted test file

* fixed after review

Co-authored-by: Dmitrii Khurtin <dmitrii.khurtin@intel.com>
Co-authored-by: Elizaveta Lobanova <elizaveta.lobanova@intel.com>
2022-04-05 11:43:24 +03:00
Maksim Doronin 4edf85c928 [RT][VPU]: Fixes for dynamic models (#10826)
* DynamicShapeResolver is able to save information about dynamic output in order to pass it in INFER_DYNAMIC_SHAPE mode. Previously, it propagated fully dynamic output shape (however ranks were equal) and dynamic Convolutions and Poolings were performed incorrectly. Now in the case of dynamic batch, DSR propagates only dynamic batch and Convolutions and Poolings are performed properly as a Loop of single-batch operations.
* Fixed dynamicToStaticShapeTranspose transformation. There was a bug: transposition indices could not be applied with Scatter because the formula is not applicable for this. Replaced with Gather.
i.e. Shape of output tensor of Transpose with transition [0,3,1,2] indices (NHWC [1, 224, 224, 3]->NCHW [1, 3, 224, 224]) was calculated by ScatterElementsUpdate. So output_shape[transposition[i]] = input_shape[i] and the result was output_shape=[1, 224, 3, 224] which was wrong. Vise-versa Gather does output_shape[i] = input_shape[transposition[i]] and the result is [1, 3, 224, 224] which is right.
* MaxPool and AvgPool can be sliced for loop in case of dynamic batch
* Convert stage for inputs is not inserted in the VPU model in the case of OV API 2.0. It did not cause a problem with non-dynamic functions because Graph Transformer has a pass to eliminate redundant converts (u8->f16, ~f16->f16~). In the case of dynamic inputs, yet another inserted Convert breaks data<->shape relations.
2022-04-05 11:19:43 +03:00
Egor Shulman ed190374fd [CPU] Added support of 'Batched' memory type (#10909) 2022-04-05 09:20:19 +03:00
Ilya Lavrenov 4ad20fb53f Use system dependencies (#11419)
* Try to improve gflags

* Try to improve gflags: part 2

* Tried to use dependencies on system

* Use nlohmann_jsonConfig from system

* Enabled nlohmann_json from system

* Improvements

* handle system gflags in developer package

* Simplifications

* Simplify dependency management

* Corrected package names

* Fixed subgraphsDumper configure stage

* Try to fix rhel8

* Try to fix macosx

* Fixed VPUX build

* Fixed aliasing issues

* Suppress some wanrings

* export gflags when build it

* Fixed some LTO

* Try to fix Mac

* revert

* use gflags as private dependency

* Aligned targets in developer package

* Fixed frontends tests build on U20 with LTO

* PAssed

* Don't use pkg_search_module(zlib ..) during cross-compilation

* Removed unused variables

* Fixed finding of zlib during cross-compilation
2022-04-05 04:47:22 +03:00
Vladislav Volkov d654071b51 CPU Plugin refactoring: Transition from Intel MKL-DNN to oneDNN (#11023) 2022-04-05 01:10:53 +03:00
Svetlana Dolinina c75bc65b83 added recursive run for transformation to fix fp16 IR with Interpolate inside If/Loop/TI (#10905)
* added recursive run for transformation to fix fp16 IR with Interpolate inside If

* added test for interpolate inside If

* remove useless variable

* fixed transformaion for divide

* fix code style

* commit auto change

* review fix

* add test for recursive call of divide marks

* removed empty line
2022-04-04 23:33:59 +03:00
Mikhail Letavin 417d75d80b [GPU] Fix allocation for cached USM remote blobs (#11304) 2022-04-04 18:16:53 +03:00
Elizaveta Lobanova 9b4e8f5b59 [GNA] Fixed cascade concats binding (#11326) 2022-04-04 15:56:13 +03:00
Maxim Andronov 65a182aaea [CPU] Extract weight cache to executable network (#11118) 2022-04-04 10:47:58 +03:00
Edward Shogulin 5d821453ae [LPT] Introduce new granularity attribute instead of OperationPerTensorQuantizationRestriction (#11330) 2022-04-03 19:35:04 +03:00
Vladislav Golubev a02b3f4995 [Transformation] MarkPrecisionSensitiveDivides extending to mark fp32 divides (#11391)
* MarkPrecisionSensitiveDivides: fp32 divides marking enabled

* ConvertDivide: added a negative test-case with fp32 divide on precision sensitive subgraph
2022-04-01 17:31:23 +03:00
Maksim Derbasov 56df3962e3 Fix for warnings spotted by clang compiler (#11384) 2022-04-01 16:10:51 +03:00