Commit Graph

223 Commits

Author SHA1 Message Date
Mikhail Letavin
fcb93b161d [IE CLDNN] Implement nGraph function support in QueryNetwork() (#1601) 2020-08-05 18:26:14 +03:00
Alexander Peskov
9d3292dd15 Fix clang build
Signed-off-by: Alexander Peskov <alexander.peskov@intel.com>
2020-08-05 17:01:35 +03:00
Anton Zaytsev
8570015347 [IE TESTS] Add VariadicSplit in SingleLayerTest (#1468)
* [IE TESTS] add variadic split

* [IE TESTS] update  variadic split

* [IE TESTS] update instance variadic split

* [IE TESTS] update variadic_split.cpp
2020-08-05 15:06:55 +03:00
Ilya Lavrenov
ae4bd370ea Added conversion of execution graph to old representation (#1626)
* Added conversion of execution graph to old representation

* Fixed compilation on Windows
2020-08-04 20:30:35 +03:00
Alexander Perepelkin
0a5d6409ff Allow descendants to reuse LayerTestsCommon (#1625) 2020-08-04 18:10:29 +03:00
Ivan Tikhonov
80b6bf28c2 Align with the specification SpaceToBatch, BatchToSpace ops (#1140)
* Aligned SpaceToBatch/BatchToSpace with the spec, converted from fused_op to op

* Implemented transformation to decompose STB/BTS

* Added unit tests

* Added new mode (INTERPRETER_TRANSFOMATIONS) for functional tests
2020-08-04 12:35:24 +03:00
Gleb Kazantaev
c518667e0a ngraph::pass::ConvertPrecision transformation (#1312)
* In this PR I'll add ngraph::pass::ConvertPrecision transformation and change only CPU Plugin to decrease number of changes. Other plugins will be updated in separate PR.

* This PR also includes changes for TI body transformations. We need to call the same sequence of transformations including ConvertPrecision for TI body.
2020-08-03 22:21:38 +03:00
Ilya Churaev
d791d295aa Use clone_function instead of specialize_function (#1523)
* Try to use clone_function instead of specialize_function

* Try to fix stress tests

* Remove redundant specialize_function

* Fixed TI clone

* Removed redundant code

* Uncomment threading tests

* Fixed docs

* copy function friendly name too

* Fixed copy rt_info

* Fixed comments
2020-08-03 18:23:02 +03:00
Roman Lyamin
15f91be168 [IE CLDNN] Added fsv16 and int8 support in BatchToSpace and SpaceToBatch (#1381) 2020-08-03 15:04:49 +03:00
Ilya Lavrenov
9f767f7b93 Hide implementation of SharedObjectLoader to cpp files (#1556)
* Hide implementation of SharedObjectLoader to cpp files

* Fixed GPU tests compilation

* Fixes for Unix; check OpenCL headers with strict flags

* Fixed Windows

* More fixes for Windows

* Fixed Unit tests

* Enabled compilation with libVA for new GPU tests

* Fixes for case when libVA is not available

* Removed useless NOMINMAX

* Useless include

* Fix

* Fixes

* Fixes for Intel compiler

* Fix for Windows + Intel compiler

* Fixed samples compilation with Intel compiler
2020-08-03 14:01:56 +03:00
Ilya Lavrenov
b58d03ae05 Removed dirty skip from tests definitions (#1591) 2020-08-03 13:22:13 +03:00
Ilya Lavrenov
80f2459e8e Removed ie_parallel include from task executors (#1588) 2020-08-03 10:56:44 +03:00
Lukasz Debski
a17472fed0 [IE CLDNN] Gather 5d/6d support (#1553) 2020-08-03 10:05:53 +03:00
Alexander Perepelkin
d8502bf7d3 Virtual inheritance to allow inheriting test classes and overriding common logic (#1557) 2020-07-30 23:57:01 +03:00
Andrey Dmitriev
861bcc2949 [GNA] Support for cascade concat with non functional layers between concats (#598)
[GNA] Support for cascade concat with non functional layers between concats
2020-07-30 16:45:18 +03:00
Daria Mityagina
e38106239c [IE][VPU]: Enable new tests for adjust_data_batch pass (#1219)
* New tests for adjust_data_batch pass
2020-07-30 13:19:33 +03:00
Roman Vyunov (Intel)
00630127e7 [IE][VPU]: Enabling of NonZero single layer tests (#1502) 2020-07-30 13:14:51 +03:00
Gleb Kazantaev
531a7209d5 Disable MatMul to FC conversion for VPU (#1520)
* Splited MatmulToFCorGemm transformation

* Updated VPU transformation predicate to check that MatMul has DSR as input
2020-07-30 11:50:52 +03:00
Ilya Lavrenov
9351547707 Removed public headers / dependencies for readers plugins (#1534)
* Removed public headers / depedencies for readers plugins

* Refactored cmake for onnx reader plugin as well
2020-07-30 07:00:44 +03:00
Ilya Lavrenov
77345a7383 Template documentation update (#1519)
* Updated Inference Engine Plugin developer guide
after inference using ngraph reference backend is added

* Documentation fixes

* Fixed review comments
2020-07-29 19:56:24 +03:00
Ilya Churaev
6c3b7ee8ca Avoid redundant clone and reshape (#1376)
* Avoid redundant clone and reshape

* Removed some constructors

* Fixed output precision
2020-07-29 19:30:59 +03:00
Vladimir Paramuzov
6e0001a189 [IE CLDNN] Changed weights layout for 1d scaleshift (#1483) 2020-07-29 14:08:58 +03:00
Nikita Kudriavtsev
a644cb85d2 [IE Myriad] Use instance of InferenceEngine::Core via ie::ICore interface in Myriad plugin (#1316)
* [ci-skip][IE Myriad] ie::ICore pointer passed into FrontEnd from plugin

* [ci-skip][IE Myriad] Added MockICore to fix graph transformer tests

* [ci-skip][IE Myriad] IN renamed to I_N to avoid compile error in Windows build: C2513: 'int': no variable declared before '='
2020-07-29 11:30:30 +03:00
Vladislav Vinogradov
0b1ef99fd7 [IE] Add Blob::createROI method (#882)
* Add default implementation that throws exception.
* Implement `createROI` for `TBlob` and existing compound blobs.
* Use reference couting for TBlob memory buffer to prolong its life time for ROI blobs.
* Add private extension for ND ROI and use it as implementation detail for now:
  * Add `DimSlice` and `TensorSlice` structures for generic ND ROI support.
  * Add `make_roi_desc` function to create `TensorDesc` for ROI.
2020-07-28 11:26:38 +03:00
Ilya Lavrenov
a19a8645e8 Removed IInferencePluginAPI interface (#1497)
* Removed legacy library includes from plugin api headers

* Removed IInferencePluginAPI interface; merged with IInferencePlugin

* Removed pluginAPIInterface usage in Core implementation
2020-07-28 11:08:45 +03:00
Ilya Churaev
534fe35c0a Remove old transformation passes (#1463) 2020-07-28 08:54:50 +03:00
Alexey Tarakanov
e5dfb71178 Tests for keep_constant_inputs (#1366)
* First variant of tests for keep_constant_inputs

* Redone tests to check number of inputs

* Count inputs of layer via ngraph::Function

* Add additional transformations for CNNNetwork

* Modified work with CNNNetwork via iterators

* Add tests for FullyConnected Network

* Rename function for counting of inputs

* Debug output was deleted

* transformations_callback was removed

* Change ASSERT_GT on ASSERT_EQ
2020-07-28 05:56:48 +03:00
Gleb Kazantaev
bd42f09e98 nGraph Transformations refactoring (#931)
This PR introduces next changes:
1. Transformations *_tbl.hpp files were replaced with direct registration in cpp files.
2. Plugins use pass::Manager to call conversion passes.
3. Transformations callback was moved to PassBase class as there is no more need to keep it in separate class
4. All pattern based transformations must be inherited from MatcherPass class. GraphRewrite class will be used only for matchers registration and execution on function.
MatcherPass class adds new features to pattern-based transformations approach:
* Allows to run matcher pass on a single node.
* Operations that were created inside transformation callback can be added to execution list to be available for pattern matching within single GraphRewrite.
5. GraphRewrite MatchClosure was replaced with MatcherPass. So all matchers will be registered as a MatcherPass.
6. Added pass::Manager::clear_state() method to avoid dependency with nodes that no longer belongs to function after replacement.
7.  Some representative transformations were updated to use MatcherPass as an example.
8.  Mul->Add sequence fusion transformation was replaced with LinOpSequenceFusion.
9. Pattern and callback registration code was moved to class c-tors (will be finished for remaining passes in other PR) .
10. Updated pass::Manager to get pass names only when NGRAPH_PROFILE_PASS_ENABLE enabled.
11. Moving towards removing PassProperty.
12. Added ngraph::pattern::wrap_type<T>(inputs, pred) to simplify pattern creation.
13. GraphRewrite was updated to execute MatcherPass more efficient.
2020-07-27 19:47:37 +03:00
Irina Efode
0560b61cbd [IE TESTS] Add Interpolate single layer test (#1456) 2020-07-27 11:45:19 +03:00
Irina Efode
db176dfc5d [IE TESTS] Add Minimum tests (#1470) 2020-07-24 17:51:21 +03:00
Liubov Batanina
a38e9f9059 Add input transposing for MatMul (#1462) 2020-07-24 15:15:20 +03:00
Nikita Kudriavtsev
8a6bd1dba3 [IE][VPU]: Added Mish layer (#1158)
* Add Mish stage in GraphTransformer
* Add Mish per-layer tests
2020-07-23 16:58:03 +03:00
Ilya Lavrenov
07bedc5d6f Network serializer for v7 is removed (#1414)
* Network serializer for v7 is removed

* Fixed compilation

* Fixed Windows build

* WA for GPU

* Create function 2 times

* Fixed compilation

* Added return
2020-07-23 16:23:19 +03:00
Ilya Churaev
82aa1e112d Remove deprecated methods from node (#1369) 2020-07-23 14:44:32 +03:00
Andrew Bakalin
f00cdddede [IE][VPU][GT]: Change begin and end masks serialization for StridedSlice (#1417)
* In order to support cases when begin and end size is less than input rank, the serialization was changed.
* Add tests
* Update firmware
2020-07-23 12:20:08 +03:00
Andrew Bakalin
dce1063526 [IE][VPU][NGraph] Move dynamic NMS from common to vpu folder (#1409)
* [IE][VPU]: Moves UpgradeNMS4ToNMSDynamic transformation into myriad plugin

* [IE][VPU]: Moves UpgradeNMS4ToNMSDynamic from common to vpu folder

* [IE][VPU]: Moves Dynamic NMS from common folder to vpu

* [VPU]: Makes NMS conversion unconditional

* [VPU][NGraph]: Changes dynamic NMS base class from v3 to v4

* [VPU]: Moves NMS4toDynamic transformation before common optimization
2020-07-23 10:23:35 +03:00
Ilya Churaev
141b24cf44 Replaced copy_with_new_args() to clone_with_new_inputs() (#1395) 2020-07-22 13:44:22 +03:00
Ilya Lavrenov
8e081c8388 Removed CNNLayer entries from ie_common.h (#1420)
* Removed useless header include

* Removed CNNLayer entries from ie_common.h
2020-07-22 06:44:05 +03:00
Roman Lyamin
613d822458 [IE TESTS] Added single layer test Mish (#1401) 2020-07-21 15:11:05 +03:00
Nikita Kudriavtsev
a482e32911 [IE][VPU]: Added Gelu layer (#1195)
* Implement Gelu stage in GraphTransformer
* Disable GeLU decomposition in the nGraph transformations
2020-07-21 11:36:35 +03:00
Ilya Churaev
54ae67414e Remove redundant node methods (#1324)
* Remove placement

* Removed validate and infer eltwise

* Remove is eltwise

* Remove support broadcast and decompose

* Removed is_op, is_parameter, is_pattern

* Fixed code style

* Added is_constant and is_output

* Removed is_communicative and is_null

* Fixed code style

* Fixed typo

* Fixed comments

* Fixed typo

* Revert is_parameter, is_output, is_result for OpenCV build
2020-07-21 06:02:00 +03:00
Vladislav Volkov
41f8086765 Header length for supported model detection is increased (#1363) 2020-07-20 18:11:22 +03:00
Ilya Lavrenov
2ddf08d14b Removed tests for old IR reader (#1368) 2020-07-18 12:42:40 +03:00
Nikita Kudriavtsev
73ee68afb2 [IE][VPU]: CMX limit compile option (#1268)
In some networks, mvTensor would request a large CMX-DMA transfer (<512K). That starves DMA for other timing critical tasks such as SIPP. Limit CMX-DMA request size as an option in myriad_compile:
* Add compile option TILING_CMX_LIMIT_KB
* Declare compile option TILING_CMX_LIMIT_KB in IE tools (compile_tool and vpu_compile)
* Add tests for compile option TILING_CMX_LIMIT_KB. Small fix for naming behavior tests.
2020-07-16 19:54:53 +03:00
Irina Efode
bfd318cbd3 [IE TESTS] Add PReLu single layer test (#1306)
* [IE TESTS] Add PReLu single layer test

* [IE TESTS] Small refactoring of test infrastructure

* [IE TESTS] Add shape for activation
2020-07-16 18:16:57 +03:00
Rafal Blaczkowski
e7861c7455 Revert "Header length for supported model detection is increased (#1340)" (#1354)
This reverts commit 5b2ec7840a.
2020-07-16 18:09:45 +03:00
Ilya Lavrenov
949fee3cfc Remove implicit conversion from getInputTo, getLayerCreator (#1274)
* Added ctor for CNNNetworkImpl to convert from ngraphImpl

* Re-use in all places instead of manual conversion

* Hide convertToCNNNetworkImpl usage

* Removed conversion from getCreatorLayer

* Fixes 2

* Fixes 3

* Fixes 4

* Fixed ieFuncTests

* Fixed more tests

* Fixed LPT tests

* Remove useless test

* Fixed GNA

* Fixed Gleb's comments

* Fixed Core integration tests

* Trying to fix python

* Fixed GPU tests

* Small fixes

* Fixed QueryNetwork after removing implicit conversion

* Fixed Core integration tests for QueryNetwork

* Fixed python; MULTI device QueryNetwork

* Fixed MULTI QueryNetwork

* Removed unused methods

* Enabled LPT FullyConnectedTestModel test

* Fixed typo in python
2020-07-16 16:44:48 +03:00
Irina Efode
afee06ec3d [IE TESTS] Small refactoring of test infrastructure (#1332) 2020-07-16 14:20:08 +03:00
Vladislav Volkov
5b2ec7840a Header length for supported model detection is increased (#1340) 2020-07-16 11:12:40 +03:00
Andrew Bakalin
382b442ab3 [IE Common][Tests] saturated_cast: refactoring & tests (#1304)
* [IE Common] Refactor saturated_cast

* [IE Common][Tests] Add tests for saturated casts

* [IE Common] Review fixes

* [IE Common] Make enable_if check a template parameter
2020-07-15 13:48:57 +03:00