Commit Graph
3308 Commits
Author SHA1 Message Date
Ilya Znamenskiy 607814828d [GPU] Rollback to cldnn from onednn and some fixes and improvements (#8761) 2021-12-02 11:28:38 +03:00
Katarzyna Mitrus 9e3b9b8fbc [Slice-8] Serialization single layer tests (#8959)
* Serialize Slice single layer tests

* Extend bounds type prop test case

* Disable tests for lower bounds serialization
2021-12-02 11:20:52 +03:00
Vladimir Paramuzov 0f667b90ff [GPU] Renamed GPU plugin to ov_intel_gpu_plugin (#8957) 2021-12-02 11:06:00 +03:00
Evgenya Stepyreva 84ebe77f62 Shape inference 2nd batch (#8781) 2021-12-02 10:47:41 +03:00
Alexandra Sidorova 802b5bcfbb [CPU] Reduced overheads in inference stage (#6794) 2021-12-02 01:20:07 +03:00
Sergey Shlyapnikov fa1d9867f2 [GPU] Fix incorrect output result in primitives with two outputs (#8902) 2021-12-01 19:23:38 +03:00
Ilya Lavrenov 5a52a8e4a3 Don't install content of openvino-dev; install wheels (#8820)
* Don't install content of openvino-dev

* Install MO in tests

* Install python's BA tool only for tests
2021-12-01 14:34:50 +03:00
Vladislav Volkov 8a1b63ec51 Memory leaks in tbbbind and onednn were fixed (#8825) 2021-12-01 12:56:29 +03:00
Alina Kladieva 0c1902b8c5 Revert "Temporarily pin setuptools version (#8416)" (#8931)
This reverts commit 2ed4e9c05f.
2021-12-01 12:22:03 +03:00
Edward Shogulin 9ec7bf286e [CPU] Dynamism support for RegionYolo node (#8542) 2021-12-01 10:18:03 +03:00
Vladislav Golubev 803531ea14 [CPU] ROIPooling: dynamic shapes support (#8547) 2021-12-01 09:30:49 +03:00
Gorokhov Dmitriy 7879839a56 Revert "[CPU] Set lower bound for nstreams to 1 (#8747)" (#8924)
This reverts commit 251883001c.
2021-12-01 09:24:55 +03:00
Wang, Yang 232aadf518 Add test case for device parameter to LoadNetwork. (#8786)
Signed-off-by: Wang, Yang <yang4.wang@intel.com>
2021-12-01 09:07:08 +03:00
Gorokhov Dmitriy 263c4d7b02 [CPU][Tests] Remove reshape_1d_ops_test cpp (#8942) 2021-12-01 00:53:44 +03:00
Irina Efode 1cd8156d3d [IE TEMPLATE] Fix operation set in QueryNetwork (#8824)
* [IE TEMPLATE] Fix opeartion set in QueryNetwork

* Apply review comments

* Prepare for review

* Return extra removed

* code style

* Update template_plugin.cpp

* Code style
2021-11-30 23:28:59 +03:00
Mateusz Bencer 461d6e8a1d Added RemoveConcatZeroDimInput and RemoveMultiSubGraphOpDanglingParams transformations (#8035)
* fix expand_onnx_functions

* refactor + unit test

* fixed function in function case

* fixed expand_onnx_functions

* fixed default value of shape in ValueInfo

* enable xpass model

* changed MergeFrom to Swap

* added xfail with missing test data

* added more unit tests

* styles applied

* used std::rotate, review remarks

* removed debug code

* after offline discussion remarks

* fix checking input/output names on Windows

* names comparator refactor

* replace regex with custom comparison

* review remarks

* added RemoveConcatZeroDimInput transformation

* added RemoveLoopDanglingParameters transformation

* chage place of passes during replace

* missing comment

* code refactor + unit tests

* remove unused headers

* used std::any_of in RemoveConcatZeroDimInput

* changed headers and namespaces to new ov convention

* used std::any_of in RemoveConcatZeroDimInput

* RemoveLoopDanglingParameters refactored

* changed names to RemoveMultiSubGraphOpDanglingParams

* handling multi-body cases

* Handling If case during RemoveMultiSubGraphOpDanglingParams

* comments and names refactor

* More tests for If and TensorIterator

* handle removing dagling param from one body and update all descriptors

* fixed test

* revert if change

* moved RemoveConcatZeroDimInput and RemoveMultiSubGraphOpDanglingParams to NopElimantion

* return false if node is not replaced

* added validate_nodes_and_infer_types

* Revert "moved RemoveConcatZeroDimInput and RemoveMultiSubGraphOpDanglingParams to NopElimantion" + remarks

* review remarks

* review remarks

* fixed subgraph rtti

* adjust passes to new structure
2021-11-30 23:19:26 +03:00
Aleksandr Pertovsky 13f3f351b7 [CPU] Add MoveEltwiseUpThroughDataMov (#7488) 2021-11-30 19:41:14 +03:00
Vladimir Paramuzov 9b97619687 [GPU] Move plugin to new source dir (#8890) 2021-11-30 17:26:09 +03:00
Alexey Varyzgin 9b6b184e5e [CPU] Native 1D models support (#8168) 2021-11-30 15:30:53 +03:00
Mikhail Nosov e2172cd38a [OV2.0] Preprocessing api cleanup (#8898)
* Removed 'inline' Preprocessing API

Even though this API provided a way to specify all pre/post-processing in one line - it was considered inconvinient
With 'getters' API preprocessing code looks more clear for user, so old' inline' API is removed

* Fix pyopenvino build issues

* Update after merged PR#8717
2021-11-30 12:30:13 +03:00
Mikhail Ryzhov cccec6942e GNA Input/Output buffers reusage (#7332)
* Init implementation

# Conflicts:
#	thirdparty/ade

* Switched to shared class

* Refactoring memory commit()

* Added unit tests

* Fixed output order

* Fixed input order

* Fixed split case

* fixed compiling issue in debug mode

* Enabled compact mode by default

* Fixed default order for inputs and outputs

* Changed unit test

* Enabled compact mode bye default

* reverted compac_mode flag order
2021-11-30 10:36:54 +03:00
Vladislav Golubev caa7d853b3 [CPU] Security fixes (#8783) 2021-11-29 22:22:13 +03:00
Andrey Noskov d24a48901e [GNA] add MultipleActivationsTest (#7504)
* add MultipleActivationsTest

* renamed files, changed structure

* [GNA] switched to single layer tests

* [GNA] fix review comments

* [GNA] Test changes
   -model structure
   -test name
   -moved to subgraph tests

* Deleted commented code

* Renamed test
2021-11-29 17:44:46 +03:00
Nikolay Shchegolev a113c823a7 [CPU] Slice-8 operation implementation. (#7521) 2021-11-29 17:28:12 +03:00
Andrey Noskov 2022b70d8b [GNA] added test multi_input_scale (#7939)
* [GNA] added test multi_input_scale

* [GNA] fixed test params after review

* Changed scale factors
2021-11-29 16:16:55 +03:00
Ilya Churaev 7678ab2b18 Move hetero plugin (#8872) 2021-11-29 14:05:08 +03:00
Tingqian Li b0da652e46 [CPU] Native dynamic shapes support in the ReorgYolo node (#8642) 2021-11-29 13:31:23 +03:00
Edward Shogulin e2ed99a93e [CPU] Dynamism support for EmbeddingSegmentsSum & EmbeddingBagOffsetSum & EmbeddingBagPackedSum nodes (#8387) 2021-11-29 12:28:16 +03:00
Maxim Andronov c8d5b20c95 [CPU] Interpolate dynamism support (#8717) 2021-11-29 12:16:14 +03:00
Vladislav Golubev 63822e0bdb ROIAlign cpu tests disabled (#8887) 2021-11-29 12:03:21 +03:00
Mateusz Tabaka 541c8721c7 [GPU] fix Constant handling when it has multiple users and one if it … (#8832)
* [GPU] fix Constant handling when it has multiple users and one if it is bprop conv

When constant is connected to ConvolutionBackpropData or GroupConvolutionBackpropData weights,
we need to swap 'O' and 'I' dimensions. That can be problematic if the same constant
is also connected to other nodes - since after swap - the dimensions may not match
the other node's dimensions.
To handle that, we can create a copy of that constant, replace backprop convolution weights
with that copy and create additional (to the original constant) cldnn::data primitive with swapped dimensions.

* fix windows build

* address review comments
2021-11-29 11:53:08 +03:00
Kelvin Choi 2d996c1354 [GPU] Update GatherND primitive (#8813)
* Cldnn output memory size at GatherND functional-test is aligned with TensorDesc of output blob
* Add param for rank of input data
* Update unittests to add rank of input data
* Update gpu fusing tests
2021-11-29 11:51:19 +03:00
Yuan Hu d50f20b977 Add log utils for Auto plugin (#8309)
* add log utils

Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>

* optimize

Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>

* remove env support in log util

Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>

* add IE LOG CONFIG support in auto model

Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>

* Add LOG

Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>

* fix compile error

Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>

* add test

Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>

* fix set config error

Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>

* fix code error

Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>

* add more log and support no arguments format string

Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>

* fix some review issue

change name from HDEBUG to LOG_DEBUG and so on
remove redundance code
move log config into log util

Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>

* modify log hpp name

Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>

* try to fix macos support issue

Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>

* enable env AUTO_LOG_LEVEL

Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>

* add comment for WaitActualNetworkReady()

Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>

* add error log when all device failed

Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>

* fix rebase issue

Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>

* fix add log in code cause auto_select_device_failed_test failed issue

Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>

* add test code

Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>

* change the Name from AUOT_LOG_LEVEL to OPENVINO_LOG_LEVEL

Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>

* use just GLOB_SOURCES in cmake

Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>

* add singleton test

Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>

* try to fix macos compile issue

Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>

* move printing config info to async loading

Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>

* keep CheckConfig as origin code

Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>

* fix compile issue caused by icore->GetMetric API change

Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>

* use confMutex instead of a new mutex

Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>

* try to fix windows compile issue

Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>
2021-11-29 16:41:48 +08:00
Elizaveta Lobanova b10409da5b [GNA] Support NHWC convolutions with 3d transposes (#8599)
* [GNA] Support NHWC convolutions with 3d transposes

* [GNA] Removed calculation of permutations for unsupported layouts

* [GNA] Added comments
2021-11-29 10:55:31 +03:00
Chen Xu f38fa4d845 [CPU] Reduce node dynamism support + perf optimizations (#8555)
* Reduce node feature extension

* Reduce node dynamism support
2021-11-29 10:28:11 +03:00
Bo Liu 25b2131d21 priorbox_8 ngraph and inference-engine parts (#8114)
* ngraph and inference-engine parts

* add priorbox_8 python api

* remove 'PriorBoxAttrs' and 'PriorBox' from outside of opset namespace

* add common nGraph transformation 'ConvertPriorBox8To0'

* remove redundant alias of PriorBox::Attributes

* use new Tensor api for evaluate method

* change v0operation back to the former api, pass Attribute structure to the reference implement

* use new Tensor api for constant_fold

* add support for dynamic shapes of constant_fold new Tensor api

* fix Node 'create temp tensors' issue when shape==0'

* revert to 'HostTensor' api for PriorBox8

* Apply suggestions from code review and 'template_plugin reference' testcase replaced 'backend INTERPRETER' testcase

* transformation part Apply suggestions from code review

* python init file updated for opset8

* keep backward compatibility to fix CI issue

* rebase to new structure of OpenVINO repo

* revert 'thirdparty/onednn_gpu' mistake changes
2021-11-29 07:28:49 +03:00
Ilya Churaev 07651aa5c0 Fixed some inference-engine paths (#8878) 2021-11-29 07:17:36 +03:00
Sergey Shlyapnikov 497aaf9b46 [GPU] Relax batch size limitaions for DO GPU implementation usage for some of Gen12HP dGPUs (#8801) 2021-11-29 11:41:39 +09:00
Ilya Lavrenov c02fe4b813 Static OpenVINO frontends (#8868)
* Static OpenVINO frontends

* ONNX tests with shared extension CustomOpUser_ONNXImporter

* Resolved issues with ONNX's NCC style check

* Reverted openvino => ngraph for frontend includes install

* Try to fix ONNX / Protobuf

* Try to fix CI

* Try

* Fixed cmake stage with BUILD_SHARED_LIBS

* Fixed export for linkable frontends

* Fixed warnings on Linux

* Fixed after ngraph => src
2021-11-28 21:36:24 +03:00
Mang Guo cf3c9ae04b [CPU]Adaptive pooling dynamic shape support (#8703) 2021-11-28 17:45:29 +03:00
Chenhu Wang 7edcf47454 [CPU] CTCLoss dynamism support (#8777) 2021-11-28 17:44:07 +03:00
Ilya Churaev 77f6a0076b Move core components (#8869)
* Moved openvino to src

* Moved ngraph and frontends to src

* Fixed cmake generation

* Moved inference_engine libs to src

* Moved C API to src

* Fixed CMake generation

* Moved readers to tests, snippets and preprocessing to common

* Fixed CMake

* Moved transformations and lp_transformations

* Fixed transformations cmake

* Fixed build

* Fixed unit-tests and ci paths

* Fixed docs

* Fixed C API build

* Try to fix static build

* More clear order

* Renamed inference_engine_legacy_api to legacy

* Fixed some cmake scripts

* Fixed path to legacy

* Fixed Myriad plugin

* Fixed v7 reader

* Fixed plugin.hpp

* Fixed developer config

* Fixed ie_parallel
2021-11-27 18:53:12 +03:00
Sergey Shlyapnikov e76fc14ae1 [GPU] Use b_fs_yx_fsv16 format for OneDNN convolutins in case of FP32 output (#8808) 2021-11-27 15:08:06 +03:00
Vladimir Paramuzov ab3a892d48 [GPU] Fixed typo in cache.json (#8756) 2021-11-27 15:06:54 +03:00
Ilya Lavrenov 5719192687 Use ninja multi-config (#8757)
* Use ninja multu-config

* Reused OV_GENERATOR_MULTI_CONFIG

* Try to use config in api_validator post build task

* Fixes

* Revert "[GPU] Fix multi configuration build of onednn_gpu (#8743)"

This reverts commit a862331732.

* Propogate disable deprecated for _RELEASE flags as well
2021-11-27 14:58:24 +03:00
Gorokhov DmitriyandAlexandra Sidorova 1cc9ca481f Fixed master build (#8857)
* [Tests] Added missed ostream operators

* Disabled ROIAlign tests with bf16

Co-authored-by: Alexandra Sidorova <alexandra.sidorova@intel.com>
2021-11-26 23:42:55 +03:00
Luo Cheng 38aebd4463 [CPU] MulticlassNms/MatrixNms support dynamic shape (#8161) 2021-11-26 20:23:26 +03:00
Vladislav Golubev f59ece3cde [CPU] ROIAlign: dynamic shapes support (#8571) 2021-11-26 18:45:51 +03:00
Vladislav Golubev 734185c04c [CPU] LRN: dynamic shapes support (#8724) 2021-11-26 17:41:48 +03:00
Mateusz Tabaka 7f6b004a33 [VPU] filter out unused outputs in RNN layer handler (#8778)
[VPU] Filter out unused outputs in RNN layer handler
Ticket: 60540
2021-11-26 12:31:21 +03:00