Commit Graph

5574 Commits

Author SHA1 Message Date
myshevts
43266c585e improved remote-blobs tests 2021-11-30 19:09:05 +03:00
myshevts
515a0f7591 clang 2021-11-30 17:42:53 +03:00
myshevts
e34131b83f fixed the ieUnitTests with adding CreateContext stub to the MockICore 2021-11-30 17:39:19 +03:00
myshevts
ceedfb8f53 CreateContext and LoadNEtwork with context for the Auto-Batching plus remote-blobs tests 2021-11-30 17:26:18 +03:00
myshevts
1e461a3b47 brushed names a bit 2021-11-30 12:22:48 +03:00
myshevts
b5480373bb remote blobs tests for the auto-batching (old API) 2021-11-30 12:13:48 +03:00
myshevts
d17b4acbf7 Merge remote-tracking branch 'github/master' into auto-batch-master
# Conflicts:
#	inference-engine/src/CMakeLists.txt
2021-11-29 16:08:31 +03:00
myshevts
a32d006465 removing home-baked MAX_BATCH_SZIE and swicthing to the official impl by GPU team 2021-11-29 15:59:33 +03:00
myshevts
e88f2e28f2 brushing, disabling CPU's HETERO tests until planned activity for 22.2 2021-11-29 15:52:11 +03:00
Svetlana Dolinina
980ad59ac4
Correct ReverseV2ToReverseSequence transformation (#8120)
* add subgraph instead of constant with fixed shape to allow model have undefined batch

* updated transformation (not checked yet)

* changed ReverseV2ToReverseSequence to support dynamic shapes/reshape;
added transformation to reverse_tensor_iterator to support new subgraph got from ReverseV2ToReverseSequence

* remove changes that should not be on this branch

* added tests;
fixed old transformation

* added delete of reversesequences to avoid run of transformation twice

* fixed pattern check for case with dynamic value for input of reversesequence

* Revert "fixed pattern check for case with dynamic value for input of reversesequence"

This reverts commit 0c04164e

* Revert "added delete of reversesequences to avoid run of transformation twice"

This reverts commit fcb7de9c

* reversed changes in reverse_tensorr_iterator for Squeeze case;
update reverse_tensor_iterator with shapeof subgraph
added permutations for attributes to pass layer test

* minor fix for dynamic shape

* updated test;
fixed backward compatibility in reverse_tensor_iterator transformation

* revew comments fixed:
added comments;
refactoring done;
fixed framework name saving for rank = 1

* minor review fixes

* small fix
2021-11-29 15:29:00 +03:00
Vitaliy Urusovskij
c084f8aa42
Clean up evaluate of boolean (#8843)
Remove  evaluate of `boolean` for ops
inherited from `UnaryElementwiseArithmetic`
2021-11-29 15:24:17 +03:00
Ilya Churaev
7678ab2b18
Move hetero plugin (#8872) 2021-11-29 14:05:08 +03:00
Tingqian Li
b0da652e46
[CPU] Native dynamic shapes support in the ReorgYolo node (#8642) 2021-11-29 13:31:23 +03:00
Edward Shogulin
e2ed99a93e
[CPU] Dynamism support for EmbeddingSegmentsSum & EmbeddingBagOffsetSum & EmbeddingBagPackedSum nodes (#8387) 2021-11-29 12:28:16 +03:00
Maxim Andronov
c8d5b20c95
[CPU] Interpolate dynamism support (#8717) 2021-11-29 12:16:14 +03:00
Vladislav Golubev
63822e0bdb
ROIAlign cpu tests disabled (#8887) 2021-11-29 12:03:21 +03:00
Mateusz Tabaka
541c8721c7
[GPU] fix Constant handling when it has multiple users and one if it … (#8832)
* [GPU] fix Constant handling when it has multiple users and one if it is bprop conv

When constant is connected to ConvolutionBackpropData or GroupConvolutionBackpropData weights,
we need to swap 'O' and 'I' dimensions. That can be problematic if the same constant
is also connected to other nodes - since after swap - the dimensions may not match
the other node's dimensions.
To handle that, we can create a copy of that constant, replace backprop convolution weights
with that copy and create additional (to the original constant) cldnn::data primitive with swapped dimensions.

* fix windows build

* address review comments
2021-11-29 11:53:08 +03:00
Kelvin Choi
2d996c1354
[GPU] Update GatherND primitive (#8813)
* Cldnn output memory size at GatherND functional-test is aligned with TensorDesc of output blob
* Add param for rank of input data
* Update unittests to add rank of input data
* Update gpu fusing tests
2021-11-29 11:51:19 +03:00
Yuan Hu
d50f20b977
Add log utils for Auto plugin (#8309)
* add log utils

Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>

* optimize

Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>

* remove env support in log util

Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>

* add IE LOG CONFIG support in auto model

Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>

* Add LOG

Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>

* fix compile error

Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>

* add test

Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>

* fix set config error

Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>

* fix code error

Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>

* add more log and support no arguments format string

Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>

* fix some review issue

change name from HDEBUG to LOG_DEBUG and so on
remove redundance code
move log config into log util

Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>

* modify log hpp name

Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>

* try to fix macos support issue

Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>

* enable env AUTO_LOG_LEVEL

Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>

* add comment for WaitActualNetworkReady()

Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>

* add error log when all device failed

Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>

* fix rebase issue

Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>

* fix add log in code cause auto_select_device_failed_test failed issue

Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>

* add test code

Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>

* change the Name from AUOT_LOG_LEVEL to OPENVINO_LOG_LEVEL

Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>

* use just GLOB_SOURCES in cmake

Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>

* add singleton test

Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>

* try to fix macos compile issue

Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>

* move printing config info to async loading

Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>

* keep CheckConfig as origin code

Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>

* fix compile issue caused by icore->GetMetric API change

Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>

* use confMutex instead of a new mutex

Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>

* try to fix windows compile issue

Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>
2021-11-29 16:41:48 +08:00
Elizaveta Lobanova
b10409da5b
[GNA] Support NHWC convolutions with 3d transposes (#8599)
* [GNA] Support NHWC convolutions with 3d transposes

* [GNA] Removed calculation of permutations for unsupported layouts

* [GNA] Added comments
2021-11-29 10:55:31 +03:00
Chen Xu
f38fa4d845
[CPU] Reduce node dynamism support + perf optimizations (#8555)
* Reduce node feature extension

* Reduce node dynamism support
2021-11-29 10:28:11 +03:00
Ilya Churaev
a148e126b8
Fixed coverage paths (#8873) 2021-11-29 09:38:06 +03:00
Bo Liu
25b2131d21
priorbox_8 ngraph and inference-engine parts (#8114)
* ngraph and inference-engine parts

* add priorbox_8 python api

* remove 'PriorBoxAttrs' and 'PriorBox' from outside of opset namespace

* add common nGraph transformation 'ConvertPriorBox8To0'

* remove redundant alias of PriorBox::Attributes

* use new Tensor api for evaluate method

* change v0operation back to the former api, pass Attribute structure to the reference implement

* use new Tensor api for constant_fold

* add support for dynamic shapes of constant_fold new Tensor api

* fix Node 'create temp tensors' issue when shape==0'

* revert to 'HostTensor' api for PriorBox8

* Apply suggestions from code review and 'template_plugin reference' testcase replaced 'backend INTERPRETER' testcase

* transformation part Apply suggestions from code review

* python init file updated for opset8

* keep backward compatibility to fix CI issue

* rebase to new structure of OpenVINO repo

* revert 'thirdparty/onednn_gpu' mistake changes
2021-11-29 07:28:49 +03:00
Ilya Churaev
07651aa5c0
Fixed some inference-engine paths (#8878) 2021-11-29 07:17:36 +03:00
Sergey Shlyapnikov
497aaf9b46
[GPU] Relax batch size limitaions for DO GPU implementation usage for some of Gen12HP dGPUs (#8801) 2021-11-29 11:41:39 +09:00
Ilya Churaev
a09f4ded79
Fixed codeowners (#8875) 2021-11-29 01:15:56 +03:00
Ilya Lavrenov
c02fe4b813
Static OpenVINO frontends (#8868)
* Static OpenVINO frontends

* ONNX tests with shared extension CustomOpUser_ONNXImporter

* Resolved issues with ONNX's NCC style check

* Reverted openvino => ngraph for frontend includes install

* Try to fix ONNX / Protobuf

* Try to fix CI

* Try

* Fixed cmake stage with BUILD_SHARED_LIBS

* Fixed export for linkable frontends

* Fixed warnings on Linux

* Fixed after ngraph => src
2021-11-28 21:36:24 +03:00
Mang Guo
cf3c9ae04b
[CPU]Adaptive pooling dynamic shape support (#8703) 2021-11-28 17:45:29 +03:00
Chenhu Wang
7edcf47454
[CPU] CTCLoss dynamism support (#8777) 2021-11-28 17:44:07 +03:00
Ilya Churaev
77f6a0076b
Move core components (#8869)
* Moved openvino to src

* Moved ngraph and frontends to src

* Fixed cmake generation

* Moved inference_engine libs to src

* Moved C API to src

* Fixed CMake generation

* Moved readers to tests, snippets and preprocessing to common

* Fixed CMake

* Moved transformations and lp_transformations

* Fixed transformations cmake

* Fixed build

* Fixed unit-tests and ci paths

* Fixed docs

* Fixed C API build

* Try to fix static build

* More clear order

* Renamed inference_engine_legacy_api to legacy

* Fixed some cmake scripts

* Fixed path to legacy

* Fixed Myriad plugin

* Fixed v7 reader

* Fixed plugin.hpp

* Fixed developer config

* Fixed ie_parallel
2021-11-27 18:53:12 +03:00
Ilya Churaev
9b3e12006f
Fixed error: expression result unused (#8862) 2021-11-27 15:54:35 +03:00
Sergey Shlyapnikov
e76fc14ae1
[GPU] Use b_fs_yx_fsv16 format for OneDNN convolutins in case of FP32 output (#8808) 2021-11-27 15:08:06 +03:00
Vladimir Paramuzov
ab3a892d48
[GPU] Fixed typo in cache.json (#8756) 2021-11-27 15:06:54 +03:00
Ilya Lavrenov
5719192687
Use ninja multi-config (#8757)
* Use ninja multu-config

* Reused OV_GENERATOR_MULTI_CONFIG

* Try to use config in api_validator post build task

* Fixes

* Revert "[GPU] Fix multi configuration build of onednn_gpu (#8743)"

This reverts commit a862331732.

* Propogate disable deprecated for _RELEASE flags as well
2021-11-27 14:58:24 +03:00
Ilya Churaev
b1fba3a675
Rename runtime to src (#8842)
* Renamed runtime to src

* Removed old paths

* Fixed cmake

* Fixed doc
2021-11-27 11:28:25 +03:00
Ilya Churaev
7cb378c92b
Changed add_output API (#8833)
* Changed add_output API

* Added C++ tests

* Added bython tests

* Try to fix python tests

* Fixed python tests

* Try to fix build

* Cannot compare pointers
2021-11-27 11:08:48 +03:00
Ilya Churaev
909dea8b5d
Removed preprocessor library (#8845) 2021-11-27 10:06:25 +03:00
Ilya Churaev
5e91ef4640
Fixed error message for unrecognized attribute (#8815) 2021-11-27 07:34:38 +03:00
Gorokhov Dmitriy
1cc9ca481f
Fixed master build (#8857)
* [Tests] Added missed ostream operators

* Disabled ROIAlign tests with bf16

Co-authored-by: Alexandra Sidorova <alexandra.sidorova@intel.com>
2021-11-26 23:42:55 +03:00
Steve Yoo
42f5034892
Migrate Sort (MatrixNms-8, MulticlassNms-8, NonMaxSuppression-5) (#8394)
* Migrate Sort (MatrixNms-8, MulticlassNms-8, NonMaxSuppression-5)

* Add right multiclass_nms.cpp

* Add struct Attributes to matrix_nms

* Add constructors to opset8::MatrixNms::Attributes

* Fix code format of opset8::MatrixNms::Attributes::Attributes
2021-11-26 22:35:43 +03:00
Luo Cheng
38aebd4463
[CPU] MulticlassNms/MatrixNms support dynamic shape (#8161) 2021-11-26 20:23:26 +03:00
Vladislav Golubev
f59ece3cde
[CPU] ROIAlign: dynamic shapes support (#8571) 2021-11-26 18:45:51 +03:00
Vladislav Golubev
734185c04c
[CPU] LRN: dynamic shapes support (#8724) 2021-11-26 17:41:48 +03:00
Jan Iwaszkiewicz
bcf0879785
Fix queue fails on callbacks (#8809) 2021-11-26 12:44:11 +01:00
Tatyana Raguzova
31ae69ac2d
[setupvars] Removed unnecessary double brackets (#8796)
they cause a problem on raspbianOS
2021-11-26 13:42:13 +03:00
Ilya Lavrenov
533bab2b78
Export more enum names from nrgaph (#8828) 2021-11-26 13:40:27 +03:00
Anastasia Popova
b3869cb127
Fixed tensors propagation in GlobalPoolingToReduce. (#8835) 2021-11-26 13:02:46 +03:00
Liubov Batanina
2d0ae6028a
[POT] Added quantization inside subgraphs (#8530)
* [POT] Support subgraphs

* Add support for inplace statistics

* Fixed cascade models

* Fixed bug

* Fixed import

* Fix name

* Add test

* Fix comments

* Replace test model

* Replace test model

* Add recursively flag

* Fix pylint

* Updated AA node names

* Fix adding results to node

* Disable subgraph quantization

* Disable recursion search in graph

* Skip test with subgraphs quantization
2021-11-26 12:42:33 +03:00
Mateusz Tabaka
7f6b004a33
[VPU] filter out unused outputs in RNN layer handler (#8778)
[VPU] Filter out unused outputs in RNN layer handler
Ticket: 60540
2021-11-26 12:31:21 +03:00
Anton Pankratov
bd3e4fbe78
Added openvino any (#8288) 2021-11-26 12:23:25 +03:00