Commit Graph

4248 Commits

Author SHA1 Message Date
Vladimir Paramuzov
0e92000b56
[IE CLDNN] ocl includes cleanup (#6362) 2021-06-29 16:50:22 +03:00
Irina Efode
d1aed21441
[IE TESTS] Fix Shared::Summary::SetOutputFolder() for CentOS (#6441) 2021-06-29 16:40:14 +03:00
Xie Zhengtian
c0f227bddd
[AUTO][IE TESTS] Fix IE test issue for auto-device plugin (#6113)
* Auto will throw with incorrect config

* Update func tests for auto-device plugin

Signed-off-by: Zhengtian Xie <zhengtian.xie@intel.com>
2021-06-29 16:14:28 +03:00
Patryk Elszkowski
65aa58a06f
update spec for DepthToSpace operation (#6315)
* Update speck

* remove ONNX link and fix type of output

* fix `block_size` description
2021-06-29 16:02:57 +03:00
Shoujiang Ma
3aa5413363
[AUTO] AUTO inferences with CPU while the actual accelerator loads the network (#5944)
* DRAFT: hot-swap async request (when VPU or other acceleratore finally loaded)

* DRAFT2: communicating the hot-swap back to the AutoExecNetwork, added logic for blobs (and keeping them internally to the AutoRequest), added lot's of comments for fixme (items to close the semantics and behaviour)

* Rebase/refactor code and fix tests issue

Signed-off-by: Shoujiang Ma <shoujiang.ma@intel.com>

* Fix logic for AutoExecutableNetwork

1. force loadNetwork in parallel by std::launch::async
2. address some fixme in auto_exec_network.cpp
3. capture by reference

Signed-off-by: Shoujiang Ma <shoujiang.ma@intel.com>

* Fix core dump

Signed-off-by: Shoujiang Ma <shoujiang.ma@intel.com>

* Lambda explicit capture by value

Signed-off-by: Shoujiang Ma <shoujiang.ma@intel.com>

* Add debug log to detect destory order of plugin and core

Signed-off-by: Shoujiang Ma <shoujiang.ma@intel.com>

* Use sync to load cpu and gpu to check ci

Signed-off-by: Shoujiang Ma <shoujiang.ma@intel.com>

* Revert "Use sync to load cpu and gpu to check ci"

This reverts commit 66e09ccd47321e26f68392976d59b1e69cd3df1a.

* Copy network in lambda

Signed-off-by: Shoujiang Ma <shoujiang.ma@intel.com>

* Try to fix CanCreateInferRequest test in Centos

Signed-off-by: Shoujiang Ma <shoujiang.ma@intel.com>

* Remove print log

Signed-off-by: Shoujiang Ma <shoujiang.ma@intel.com>

* Fix CI issues in AUTO because GPU execNetwork doesn't support SetConfig

Signed-off-by: Shoujiang Ma <shoujiang.ma@intel.com>

* Address reviewer's comment: handle load network failure

Signed-off-by: Shoujiang Ma <shoujiang.ma@intel.com>

* weak_ptr rather than plain ICore* to make sure we hold the Core (whihc holds the plugins in turn) from the destruction in case we need that

* Replace ie::ICore* to shared_ptr<ie::ICore>

Signed-off-by: Shoujiang Ma <shoujiang.ma@intel.com>

Co-authored-by: myshevts <maxim.y.shevtsov@intel.com>
2021-06-29 15:54:40 +03:00
Maxim Shevtsov
9422a7b240
fixed multi/hetero setConfig to throw on unsupported config keys (#6373)
* fixed multi setConfig to throw on unsupported config keys

* fixed hetero setConfig to throw on unsupported config keys. simplified the test on the incorrect keys

* aligning MULTI tests to the new (fixed) behaviour - also aligned with AUTO and HETERO

* fixed multi setConfig to throw on unsupported config keys- updating the MYX tests
2021-06-29 15:52:12 +03:00
Mikhail Nosov
e98be7dc04
[PaddlePaddle][Klocwork] Klocwork fixes for PaddlePaddle frontend core part (#6431) 2021-06-29 15:36:13 +03:00
Szymon Durawa
055a70bdf9
Add output_padding and output_shape into GroupConvolutionBackprop SLTs. (#6302)
* Add output_padding and output_shape into GroupConvolutionBackprop SLTs.

* Add legacy API for arm-plugin dependency.

* Replaced templated input, output and filter with one template.

* Apply correct format.

* Change to use INSTANTIATE_TEST_SUITE_P macro.
2021-06-29 15:34:29 +03:00
Ilya Lavrenov
f6a0195e18
Updated install rules for tests targets (#6420)
* Move tests

* Fixed Windows
2021-06-29 15:24:27 +03:00
Vladislav Golubev
5ba1e8aa1c
[LPT] Dynamic shapes support (#6129)
* [LPT][TESTS] Base LPT classes: dynamic shapes support

* [LPT][TESTS] Convolution & GroupConvolutionTransformation: dynamic shapes support

* [LPT][TESTS] FakeQuantizeTransformation: dynamic shapes support

* [LPT][TESTS] Relu & PReluTransformation: dynamic shapes support

* [LPT][TESTS] AvgPool & MaxPoolTransformation: dynamic shapes support

* [LPT][TESTS] MVNTransformation: dynamic shapes support

* [LPT][TESTS] NormalizeL2Transformation: dynamic shapes support

* [LPT][TESTS] TransposeTransformation: dynamic shapes support

* [LPT][TESTS] Reduce*Transformation: dynamic shapes support

* [LPT][TESTS] FuseFakeQuantizeTransformation: dynamic shapes support

* [LPT][TESTS] MultiplyToGroupConvolutionTransformation: dynamic shapes support

* [LPT][TESTS] StridedSliceTransformation: dynamic shapes support

* [LPT][TESTS] Squeeze & UnsqueezeTransformation: dynamic shapes support

* [TESTS] AddTransformation: added test-cases with dynamic shapes

* [TESTS] ClampTransformation: added test-cases with dynamic shapes

* [TESTS] DepthToSpaceTransformation: added test-cases with dynamic shapes

* [TESTS] MultiplyTransformation: added test-cases with dynamic shapes

* [TESTS] FoldConvertTransformation: added test-cases with dynamic shapes

* [LPT][TESTS] FuseConvertTransformation: dynamic shapes support

* [TESTS] FuseSubractToFakeQuantizeTransformation: added test-cases with dynamic shapes

* [TESTS] FuseMultiplyToFakeQuantizeTransformation: added test-cases with dynamic shapes

* [TESTS] SubtractMultiplyToMultiplyAddTransformation: added test-cases with dynamic shapes

* [TESTS] Split & VariadicSplitTransformation: added test-cases with dynamic shapes

* [LPT][TESTS] ReshapeTransformation: dynamic shapes support

* [LPT][TESTS] MatMulTransformation: dynamic shapes support

* [TESTS] InterpolateTransformation: added test-cases with dynamic shapes

* [TESTS] ConvolutionBackpropData: added test-cases with dynamic shapes

* [LPT][TESTS] ConcatTransformation: dynamic shapes support

* [TESTS] ShuffleChannelsTransformation: added test-cases with dynamic shapes

* [LPT] fixes after review

* [LPT] LPT behaviour alligned with master

* [TESTS] ClampTransformation: functional tests quick fix

* [TESTS] windows compilation error fix
2021-06-29 12:59:40 +03:00
Anton Voronov
dcce22bd81
[CPU] fixed conv + dw conv fusing (#6333) 2021-06-29 09:54:29 +03:00
Patryk Elszkowski
cf5c8610b0
remove temporary ReshapeLayerTestRevise (#6371) 2021-06-29 09:53:26 +03:00
Ilya Lavrenov
e050b5f97a
CLDNN cmake simplification (#6384)
* CLDNN cmake simpplification

* bfbgf
2021-06-28 22:50:41 +03:00
Irina Efode
7580bd3b5d
Output folder (#6383)
* [IE TESTS] Fix output folder for funcTests

* remove extra
2021-06-28 18:48:29 +03:00
Tomasz Jankowski
d9b6c43201
[ONNX] Fix fp16 Tensor data loading (#6338) 2021-06-28 16:05:54 +02:00
Katarzyna Mitrus
6c42540ea4
NormalizeL2 nGraph op revision - FusedOp removal (#6310)
* Remove FusedOp inheritance

* Add l2 to normalize type_prop tests file

* Add l2 to normalize type_prop tests name

* Add type_prop tests for expected and dynamic shape

* Comments update

* Headers cleanup

* Update default constructor

* Style refactor

* Update attribute tests

* Add NGRAPH_OP_SCOPE to validate_and_infer_types

* Reduce code duplication for NormalizeL2 attributes tests

* Remove using v0::Normalize from op namespace

* Revert removing using v0::NormalizeL2 from op namespace
2021-06-28 16:31:30 +03:00
Gabriele Galiero Casay
9753716e86
Revise reference implementation for ReduceMean operation (#5806)
* Revise reference implementation for ReduceMean operation

* Added minor changes

 * Replace CoordinateTransform for CoordinateTransformBasic
 * Added constant expression to set keep_dims as false

* Add const qualifier to local variables

* Use host tensor to retrieve and normalize axes

* Clean up manifest

* Add helper function for summation of elements to improve readability

* Fix issue with template to produce overloads based on type traits
2021-06-28 16:07:34 +03:00
Evgenya Stepyreva
7762505129
Dynamic shapes support for PowerToStatic (#6387) 2021-06-28 12:15:41 +03:00
Vladimir Paramuzov
837865879d
[IE CLDNN] Fixed code gen with custom locale (#6336) 2021-06-28 11:57:10 +03:00
Mateusz Tabaka
813531f45d
Add StrideOptimization pass (#5314)
* Add StrideOptimization pass

It's based on model-optimizer/mo/middle/passes/fusing/resnet_optimization.py

* use BackwardGraphRewrite

* code style

* handle other nodes

* address review comments

* rename files

* fix comment

* fix narrowing warning

* add squeeze after pool if its input was reshaped

* address review comments
2021-06-28 10:41:36 +03:00
Ilya Churaev
9eb80071b0
Fixed IE_DEFINE_EXTENSION_CREATE_FUNCTION macro (#6339)
* Fixed IE_DEFINE_EXTENSION_CREATE_FUNCTION macro

* Revert old creator
2021-06-28 09:53:27 +03:00
Patryk Elszkowski
119bd705b9
DepthToSpace - revise reference implementation (#6210)
* move evaluate method to runtime/reference

* move backend test from fused_op.in.cpp to depth_to_space.in.cpp

* cleanup test

* Drop unnecessary reshapes

* add some comment

* cleanup names

* add visitor test

* Add backend test for DepthToSpace

* Add serialization test

* add empyt lines to get more readable code

* cleanup headers

* fix used types

* remove unnecessary includes
2021-06-28 07:54:16 +03:00
Tingqian Li
068f7c8806
Revise Mish op (#6009)
* use RTTI macro

Signed-off-by: Li, Tingqian <tingqian.li@intel.com>

* add backend test

Signed-off-by: Li, Tingqian <tingqian.li@intel.com>

* add visitor API test

Signed-off-by: Li, Tingqian <tingqian.li@intel.com>

* add checks for input size and type in validate_and_infer_types()

Signed-off-by: Li, Tingqian <tingqian.li@intel.com>

* add test for incompatible input data types to type_prop

Signed-off-by: Li, Tingqian <tingqian.li@intel.com>

* disable fp16 tests for IE backend

Signed-off-by: Li, Tingqian <tingqian.li@intel.com>

* fix bugs:
add static linkage to mish_test
use T instead of double for calculation of expected answer

Signed-off-by: Li, Tingqian <tingqian.li@intel.com>
2021-06-28 06:59:25 +03:00
Ilya Lavrenov
632709012f
Fixed / improved cmake for ngraph frontends (#6376) 2021-06-27 18:10:25 +03:00
Maksim Doronin
4b7c58ac11
Disable IEClassNetworkTestP.LoadNetworkActualNoThrow test (#6348) 2021-06-25 22:02:48 +03:00
Maksim Proshin
a0091768ea
[doc] Improved description of OpenVINO workflow (#6128)
* Update get_started_dl_workbench.md

POToolkit => POTool

* Update QuantizedNetworks.md

POToolkit => POTool

* Moving POT to optimizations section

Moving POT to optimizations section

* structure

* links

* step 1

* step 1 diagram

* step 2

* typo

* step 4

* step 4 diagram

* step 3

* minor corrections

* Applied comments

* Applied comments from Tatiana

* Applied comments from Alex
2021-06-25 19:54:07 +03:00
Ilya Lavrenov
035221a5e5
Installed C API tests (#6386) 2021-06-25 19:11:50 +03:00
Alexey Varyzgin
e8301fb545
[INT8+BF16] x8s8s32x_deconv_fwd bf16 output case elimination (#6237) 2021-06-25 16:47:47 +03:00
Mikhail Nosov
9868bde421
[Frontend] pickle.dumps support for FrontEndManager (#6370)
* [Frontend] pickle.dumps support for FrontEndManager

* Fix clang-format

* Reorganize imports in test_frontendmanager.py
2021-06-25 15:51:33 +03:00
Ilya Lavrenov
391aeebf7e
Added install rules for tests (#6344)
* Moved cmake/templates to <root>

* Removed ngraph versioning, reused IE one

* Merged converage

* Removed duplicatde ngraph cmake options

* Moved dependencies to <root>/cmake

* Removed installing of VERSION

* Start #1

* cpack

* Added component type

* Added installation of tests targets

* Added ngraph tests target install

* Fixed runtime dependencies location

* Disable GNA unit tests

* Revert "Disable GNA unit tests"

This reverts commit da5398622f.

* Installed only core component

* Replaced ENABLE_DEV_PKG_INSTALL with EXCLUDE_FROM_ALL

* Removed extra cmake options
2021-06-25 15:17:17 +03:00
Polina Brzezinskaya
5f90f33731
[IE][VPU]: changed calling of sem_timedwait() to account for EINTR error code (#6213)
changed calling of sem_timedwait() to account for EINTR error code, so it would be restarted.
2021-06-25 13:16:59 +03:00
Ilya Lavrenov
56adef710a
Added missed include(ExternalProject) (#6366) 2021-06-25 12:54:24 +03:00
Denis Orlov
9eb5d875cd
[Doc] Reference POT in documentation for GNA plugin (#6248) (#6346) 2021-06-25 12:29:33 +03:00
Evgeny Lazarev
635ab37a86
MO now shows a hint when --disable_nhwc_to_nchw is needed (#6350)
* MO now shows a hint when --disable_nhwc_to_nchw is needed

* Updated message to be printed using log.error

* Small code refactoring
2021-06-25 12:12:52 +03:00
Anna Khakimova
27441c2310
Pre-processing: Resize Linear U8C3/C4 refactoring (#6356)
* Resize Linear U8 C3C4toPlanes refactoring

* Fix alignment and remove unused code

* Delete extern template specializations
2021-06-25 10:03:32 +03:00
Vladimir Paramuzov
f0abf9ebe3
[IE CLDNN] Fixed config test cases (#6357) 2021-06-25 10:03:11 +03:00
Vladimir Paramuzov
7b6238b47d
[IE CLDNN] Cleanup source tree (#6355) 2021-06-25 09:53:45 +03:00
Michał Karzyński
653fe824d2
[ONNX] Pin Python dependencies (#6102)
* Pin Python dependencies

* Pin Python dependencies

* Update dependency versions

* Remove merge artifact
2021-06-24 21:24:35 +03:00
Vladimir Paramuzov
52d9b81613
[IE CLDNN] Removed events pool usage and updated events class hierarchy (#6229) 2021-06-24 19:05:29 +03:00
Yegor Kruglov
10e5936dee
[MO] Fixes in Merge infer function (#6125)
* move output shape setting to the conditions

* e2e fix

* updated unittests
2021-06-24 18:53:13 +03:00
iliya mironov
7211cd3aa6
Fix transpose with reverse (#6234)
* Fix transpose with reverse

* Add unit test
2021-06-24 18:12:32 +03:00
Mikhail Nosov
6736188526
PaddlePaddle frontend - Core Part (#6036)
* PaddlePaddle frontend - Core Part

Basic functionality, only limited number of supported operations

Rest of operations will be submitted in separate PR

* Remove copy-paste for 'protobuf-generate'

* Remove copy-paste for 'protobuf-generate'

* Disable all installs for static protobuf

* Fixed error in protobuf generator script

* Disable compilation warnings for generated Protobuf code

* Cmake - move PDPD frontend to the bottom
Add install rules for PDPD and Frontend_manager

* Separate working directory for static protobuf

* Use system 'protoc' code generator in case of cross-compiling mode

* Pass SYSTEM_PROTOC to static protobuf subproject

Needed for cross compiling

* Enable back commented out PDPD unit tests

* Fix TODOs

* Fix some comments

* Update according to new gtest

* Removed NGRAPH_EXPORT_TARGETS_ENABLE for PDPD frontend
2021-06-24 16:58:41 +03:00
Irina Burgun
23f689bf74
fixed comments for filters (#6331) 2021-06-24 16:18:28 +03:00
Ilya Sharikov
6cf4f7eecf
Updated path to executable binary for the Python interpreter (#6340) 2021-06-24 13:54:46 +03:00
Ilya Sharikov
b83a1ab1bc
Updated requirements.txt (#6329) 2021-06-24 13:48:31 +03:00
Ilya Lavrenov
92239b39bf
Partially merge ngraph / IE cmakes (#6316)
* Moved cmake/templates to <root>

* Removed ngraph versioning, reused IE one

* Merged converage

* Removed duplicatde ngraph cmake options

* Moved dependencies to <root>/cmake

* Removed installing of VERSION
2021-06-24 13:14:04 +03:00
Vladimir Paramuzov
730577294f
[IE CLDNN] USM refactoring (#6230) 2021-06-24 13:05:49 +03:00
Mikhail Nosov
d49405a0e8
[MO] Initial support of nGraph Frontend API (#6001)
* [NG Frontend] Introduce classes and macros for Frontend-specific exceptions

* [nGraph Frontend] Python bindings

Exposing Python API for nGraph FrontEndManager introduced in PR #5470

* Exposing 'Dimension' class to Python nGraph API

* Model optimizer code from pdpd_frontend

Removed 'use_legacy_frontend' option as not needed for PDPD integration

* Added XML/BIN prints for 'ngraph-FE' serialization path

* Update python bindings to latest code from PR #5995

* Add OV_FRONTEND_PATH to LD_LIBRARY_PATH by default for Model Optimizer

* Test with 'mock' frontend

* Added meta info to generated IR

Added more tests to cover currently supported scenarios
Clang config for MO mock frontend

* some flake8 and pylint fixes

* Try to 'import' ngraph-related packages on top of python files

This will help to specify type of function arguments, but can break unit tests if they're using functions directly without ngraph

* CI fixes

* Run tests from 'main_test.py' inside ngraph environment

* Fixed review comments

* Fixed comments
Added more tests for checking if inputs and outputs are same

* Renamed front_ng to moc_frontend

* Update package_BOM.txt
2021-06-24 12:21:15 +03:00
Patryk Elszkowski
4ed0cdb0dd
update ReshapeLayerTest to have unsigned in output axis (#6276) 2021-06-24 10:32:45 +03:00
Anna Khakimova
c24b302c45
Pre-processing: Resize Linear 1C refactoring (#6330)
* * Resize 8UC1 refactoring

* * Resize 32FC1 refactoring

* Applied comments
2021-06-24 09:39:09 +03:00