Commit Graph

5484 Commits

Author SHA1 Message Date
Ilya Lavrenov
df30694699
Added apiValidator checks for frontends (#8655) 2021-11-17 23:19:15 +03:00
Alexandra Sidorova
83b8099363
[CPU] Added dynamism support for StridedSlice (#8532) 2021-11-17 22:52:23 +03:00
Ilya Lavrenov
ff1f73910f
Move OpenCV find_package closely to benchmark_app (#8654) 2021-11-17 19:47:33 +03:00
Edward Shogulin
2fc4856b8a
[LPT] GroupConvolution: 3D tensor support (#8401) 2021-11-17 19:44:19 +03:00
Gleb Kazantaev
58b0793386
Avoid excess validations for preprocessing which doesn't require shape/type propagation (#8602) 2021-11-17 18:04:44 +03:00
Bartek Szmelczynski
099d451d35
add read_model from buffer (#8593)
* add read_model from buffer

* add new line

* remove bad quotes

* rename functin args

* fix read_model from buffer, add tests with empty weights

* remove redundant include

* add blank line

* fix indentation

Co-authored-by: Anastasia Kuporosova <anastasia.kuporosova@intel.com>
2021-11-17 16:45:01 +03:00
Mikhail Nosov
c81e1aef05
[OV20] I420toRGB and I420toBGR operations specification (#8292) 2021-11-17 16:06:27 +03:00
Katarzyna Mitrus
6855efd315
[ONNX] Support ONNX importer Slice by ov::opset8::Slice (#7888) 2021-11-17 12:23:28 +01:00
Artur Kulikowski
9c6cf6171d
Revert "Remove opset8 from compatibility ngraph python API (#8452)" (#8625) 2021-11-17 11:39:39 +01:00
Andrey Somsikov
b53a0dca2a
Update README.md (#8638) 2021-11-17 12:51:53 +03:00
Anton Chetverikov
67f982ff09
GatherND_8 pythonAPI (#8374)
* Add GatherND_8 operation

* Update shape infer function and tests

* Initial commit for nGraph GatherND_8 operation

* Add GatherNDBase class implementation

* Fix base class errors

* Add missrd header

* Update base class

* Update GatherND_8 implementation

* Fix codestyle

* Fix wrong rank

* Implement tests for gatherND_8 shape inference function

* fix codestyle

* Add limitation to doc

* Siplyfy check in shape inference

* Add more test cases

* Update shape inference function

* Add more test cases to cover all case with dynamic input shapes

* Update shape inference function

* Refactor tests

* Initial commit for gatherND_8 reference implementation

* Add visitor tests for gatherND_8 operation

* Add visitor tests for gatherND_8 operation

* Correct comment

* Add additional check is shape inference function

* Update shape inference implementation for gathernd operartion

* Fix codestyle

* Remove restriction for data is fully defined

* Update shape inference functon

* Add gatherND_8 reference to evaluate map

* Add tests for gathernd_8 reference in batch_dims > 1

* Fix codestyle

* Fix codestyle

* Fix missed check for nonetype

* Remove redundant checks for batch_dims

* Use get_shape method instead of get_input_shape in GatherND reference implementation call

* update reference implementation call

* Properly add GatherND_8 to test opset table

* Update GatherND reference implementation for support opset8 version

* Add unit tests for gatherND_8 reference implementation

* Update gatherND reference implementation call in evaluate map

* Mark failed tests for missed plugin gatherND_8 implementations

* Fix codestyle

* Fix codestyle

* Initial commit for gaherND_8 python api

* Fix codestyle

* Update tests

* Move common methods to base class

* Fix codestyle

* Revert clone_with_new_input function moving

* Add more test for reference

* partially revert API changes

* Fix test

* Fix codeslyle
2021-11-17 12:41:39 +03:00
Aleksandr Korolev
b9b50527fd
[IE[[VPU] Coverity issues fix (#8598)
- Coverity issues fix
- profinfo.execution_index was uninitialized in some cases
- Removal deadcode
2021-11-17 12:28:22 +03:00
Andrew Kwangwoong Park
af19b26980
[GPU] Fix CLDNN_CACHE_PATH for destination path to which cache.json will be copied (#8614)
Signed-off-by: Andrew Kwangwoong Park <andrew.kwangwoong.park@intel.com>
2021-11-17 11:57:26 +03:00
Roman Kazantsev
8e327bd2ff
[MO, TF] Support Custom Wide and Deep CTR model by MO (#8505)
* [MO, TF] Support Custom Wide and Deep CTR model by MO

It implements implicit support of EmbeddingSegmentsMean operation through decomposition.
Also, this extends the current transformation to fuse TensorFlow sub-graph (for Wide and Deep model family)
containing SparseSegmentSum and SparseSegmentMean operations into EmbeddingSegmentsSum or EmbeddingSegmentsMean.

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Fix unit-tests after modifications of SparseToDense and EmbeddingSegmentsOperationFusing

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Document SparseSegmentMean support

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Add computation scheme for normalization coeffs and correct documentation

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>
2021-11-17 11:44:04 +03:00
Gleb Kazantaev
c307f206dc
Optimize Function Topological Sort (#8519)
* Initial optimization implementation

* Add tests

* Updated function and node accessors

* Avoid using static mutex in get_ordered_ops

* Apply comments

* resolve PR comments

* Move mutex up

* Simplify shared info

* Fix info copying in node copy c-tor

* Move friend declarations to public

* Fix to support node access from multiple functions in different threads
2021-11-17 11:43:19 +03:00
Maxim Andronov
14d1f7c844
[CPU] Pooling dynamism support (#8361) 2021-11-17 11:25:45 +03:00
Wang, Yang
fb05f36611
Support PERF_COUNT and KEY_EXCLUSIVE_ASYNC_REQUESTS for AUTO plugin. (#8558)
Add test case for the two newly keys within AUTO Plugin.

Signed-off-by: Wang, Yang <yang4.wang@intel.com>
2021-11-17 11:15:08 +03:00
Elizaveta Lobanova
45999b3b84
[GNA] Improved Log activation accuracy (#8437)
* [GNA] Improved Log activation accuracy

* [GNA] rename PWL_MAX_ITERATIONS to PWL_MAX_ITERATIONS_DEFAULT

* [GNA] Fixed invalid macros using for max segments number
2021-11-17 10:51:23 +03:00
Vladimir Gavrilov
2017667543
Insert Transpose layers around the Interpolate layer with axes that are unsupported in MKLDNN (#8204)
* Started to write transformation that allows MKLDNN Interpolate to work with axes {1,2} or {1,2,3}.

* Written the transformation that wraps Interpolate into Transposes.

* Some fixes.

* Written transformation tests.

* Added debug prints.

* Fixed order inputs calculations for inserted Transposes.

* Fixed the transformation tests.

* Deleted commented code.

* Fixed includes.

* Small fix.

* In some places, int64_t was replaced by size_t.

* Small change.

* Small fix.

* The function transformation_is_applicable() was inlined.

* Inlined the helper function get_non_interpolated_axes().

* Inlined the function create_set_of_all_axes().

* Code style fix.

* Small fix.

* Added test.

* Some fixes.

* Fixed shapes of start, stop, step inputs of Range in the test.

* Added more tests.

* Small fix.

* Added TransposeSinking after WrapInterpolateIntoTransposes (in MKLDNN plugin).
2021-11-17 10:41:26 +03:00
Aleksandr Korolev
4c27bdb2ee
[VPU] vpu_scale changes (#7512) 2021-11-17 10:29:43 +03:00
Alexandra Sidorova
27901a87af
[CPU] Added dynamism support for GatherND and added GatherND-8 support (#8495) 2021-11-17 10:15:35 +03:00
Egor Shulman
2518f88d7c
[CPU] Proposal dynamic done (#8574) 2021-11-17 09:38:47 +03:00
cecilia peng
d587fb2844
Cecilia/fix/slice decrease axis (#8342)
* 1. fix for CVS-69011 2.add more test cases for slice w/ decrease_axis

* add test case simulating the last reshape2 of ocrnet which accepts slice (with decrease_axes in all dims) as its parents.

* exportModel as a helper function.

* fix: rank get_length type
2021-11-17 07:25:10 +03:00
Ilya Lavrenov
51b9dff1bc
Windows static (#8578)
* Enable LTO for oneDNN GPU

* Use importer target for onednn_gpu

* Fixed install of OpenCL, ittapi

* Try to enable samples build

* Fixed ie_wheel build

* Disabled samples

* Fixed incorrect install of pugixml in dynamic build

* Fixed clDNN_unit_tests64 link

* Minimized a number of hardcoded paths

* Switched off ITT

* Disable TBBBind for static Windows

* Fixed link on Windows

* Fixes

* Static build for Window

* Disable unit-tests

* Disabled TF

* Fixed add dependency for PDPD unit tests

* Disabled GNA

* Enabled ngraph test utils

* Fixes

* Fixes

* Disable clDNN for static build on Windows

* Dynamic MCVS runtime for OpenCL

* Disable ITT traces for static libs

* Ability to switch TBBBind_2_5 OFF

* Disabled GPU on Windows build

* Fixed libGNA link

* Disabled some GNA tests

* Fixed multiple definitions issue

* Hide FrontEnd::load in DLL

* Install libGNAStubs

* Trying to fix Windows

* Trying to fix frontends

* Passed compilation on Windows

* Updated install rules for ngraph backends

* Try CPU, TEMPLATE tests

* Enabled unit-tests

* Enabled ngraph tests

* Try to fix unit-test

* Fixed unit-test on Linux

* Fixed compilation with ENABLE_IR_V7_READER=OFF

* Fixed tests on Linux

* Enable cpuFuncTests only in static build

* Try to fix testMockPluginFrontEnd test

* Try to enable TF

* Fixed python tests

* Partial revert

* Removed OV_FRONTEND_PATH
2021-11-17 01:22:04 +03:00
Mikhail Nosov
c2d09afab9
PreProcess API change: (#8629)
- PrePostProcessor takes 'function' argument in constructor
- PrePostProcessor::build() doesn't take any function anymore
- PrePostProcessor::input() method to get reference to input
- PrePostProcessor::output() method to get reference to output
- InputInfo - add getters of tensor, preprocess, network
- OutputInfo - add getters of tensor, preprocess, network

Samples:
ClassificationSampleAsync - use new getters

Inference engine:
- Use new getters in ie_network_reader.cpp

TODO: Consider removal of builder-like API in PrePostProcessor, InputInfo, OutputInfo
2021-11-17 00:51:19 +03:00
Piotr Szmelczynski
7d7ac87a85
[PYTHON] Expose layout helpers (#8507)
* create layout_helpers

* @pszmel

* fix typo

* Create tests

* style fix
2021-11-17 00:47:18 +03:00
Jan Iwaszkiewicz
4247a9d6b0
[PYTHON] Improve API with compact functions and Python wrappers (#8603)
* Added new Tensor dispatch and improvements, replace injections with inheritance of pybind objects, remove Blob from public python API.

* Clean-up tests and API from unused classes

* Remove unused import

* cpp codestyle

* Update AsyncInferQueue with python wrapper

* Codestyle cpp

* Applying comments

* Common tensor setting for requests
2021-11-17 00:09:47 +03:00
Katarzyna Mitrus
c171be238f
Slice-8 to StridedSlice transformation (#8295)
* SliceToStridedSlice transformation

* Slice SLT

* ONNX import

* Disable throw

* Add Slice evaluate, re-enable mkldnn graph throw

* Use ScatterUpdate instead of Gather to adjust indices

* Add CmpValues::CONST_VALUES to Slice transformation tests

* Apply smaller review comments

* Adjust indices lenght type

* Use ov namespace

* Refactor indices alignment function

* Move SliceToStridedSlice transformation to separate file

* Style alignment

* Resolve xfails

* Update tests and remove redundant const folding

* Remove evaluate and onnx changes

* Add use_shapes switch to the Slice transformation

* Style fix
2021-11-16 22:40:34 +03:00
Alexey Suhov
3d68ba6480
[README.md] change latest release to 2021.4.2 2021-11-16 22:12:20 +03:00
Vladimir Zinoviev
5e0daae87e
[LPT] int4 inference via 16 levels int8 (#5249) 2021-11-16 18:00:48 +03:00
Vladislav Golubev
5d86cce4eb
[CPU] FullyConnectedNode: fix dimension normalization in case with 2D input and 3D output (#8595) 2021-11-16 17:37:59 +03:00
Smirnov Grigorii
d2c2b5e45c
add tests for EliminateSplit pass (#8537)
* add three simple tests for EliminateSplit pass

* remove function_ref
2021-11-16 16:55:38 +03:00
Anton Chetverikov
4a8554a76d
Add links to missed ops in opset_8.md file (#8620) 2021-11-16 15:23:14 +03:00
Maxim Andronov
b726aa2c9b
[CPU] Fix problem with inplace input blob (#8506) 2021-11-16 15:04:39 +03:00
Maxim Andronov
b9c5a477b4
[CPU] Concat dynamism support (#8405) 2021-11-16 14:32:03 +03:00
Anton Romanov
5512c36358
remove opencv dependecies in samples (#8123)
* remove opencv dependecies ins samples

* fixed output
2021-11-16 14:13:16 +03:00
Maxim Andronov
46fea0fe48
[CPU] Split dynamism support (#8419) 2021-11-16 14:13:02 +03:00
Aleksandr Korolev
da0b8a84b4
[IE][VPU] Fix memory leak (#8554)
[VPU] heap-use-after-free fix
2021-11-16 11:52:49 +03:00
Evgeny Kotov
6860fd3ef4
Substitute soft sign pass port to ngraph (#8167)
* add base ngraph::SoftSign operation wrapper; add substite softsign pass draft code

* add SoftSign convertor from ngraph to CNNNetwork

* add unit tests; write DoTransformation

* cpplint fixes

* add pass description

* cleanups; always use add layer

* remove bf16 since it is CPU specific

* add softsign evaluate unit test; code review fixes

* add unit tests on checking const values

* inherit softsign from :UnaryElementwiseArithmetic; code review fixes

* remove unneeded visit_attributes

* remove NGRAPH_TYPE_CASE macro

* use ngraph::op::util::get_single_value in pattern checking

* use legacy SubstituteSoftSignPass if there are FQ layers; build fix

* remvoe deprecated softsign tests

* fix deprecated error

* add draft unit tests on softsign operation with new api

* use new test API for softsign

* use another evaluate virtual method
2021-11-16 11:27:37 +03:00
Katarzyna Mitrus
95e1a423c6
[ONNX FE] ONNX Clip type aligned default min/max fix (#8489) 2021-11-16 09:25:21 +01:00
Anton Chetverikov
d0f16d205a
GatherND_8 reference implementation (#8257)
* Add GatherND_8 operation

* Update shape infer function and tests

* Initial commit for nGraph GatherND_8 operation

* Add GatherNDBase class implementation

* Fix base class errors

* Add missrd header

* Update base class

* Update GatherND_8 implementation

* Fix codestyle

* Fix wrong rank

* Implement tests for gatherND_8 shape inference function

* fix codestyle

* Add limitation to doc

* Siplyfy check in shape inference

* Add more test cases

* Update shape inference function

* Add more test cases to cover all case with dynamic input shapes

* Update shape inference function

* Refactor tests

* Initial commit for gatherND_8 reference implementation

* Add visitor tests for gatherND_8 operation

* Add visitor tests for gatherND_8 operation

* Correct comment

* Add additional check is shape inference function

* Update shape inference implementation for gathernd operartion

* Fix codestyle

* Remove restriction for data is fully defined

* Update shape inference functon

* Add gatherND_8 reference to evaluate map

* Add tests for gathernd_8 reference in batch_dims > 1

* Fix codestyle

* Fix codestyle

* Fix missed check for nonetype

* Remove redundant checks for batch_dims

* Use get_shape method instead of get_input_shape in GatherND reference implementation call

* update reference implementation call

* Properly add GatherND_8 to test opset table

* Update GatherND reference implementation for support opset8 version

* Add unit tests for gatherND_8 reference implementation

* Update gatherND reference implementation call in evaluate map

* Mark failed tests for missed plugin gatherND_8 implementations

* Fix codestyle

* Fix codestyle

* Fix codestyle

* Update tests

* Move common methods to base class

* Fix codestyle

* Revert clone_with_new_input function moving

* Add more test for reference

* partially revert API changes
2021-11-16 10:58:06 +03:00
Mikhail Letavin
b6bdc4a567
[GPU] Enable new OV2.0 infer request behavior tests (#8358) 2021-11-16 10:07:39 +03:00
Steve Yoo
90094e8a8a
Migrate Sequence (CTCGreedyDecoder-1, CTCGreedyDecoderSeqLen-6, GRUCell-3, LSTMCell-4, OneHot-1, RNNCell-1) and Sort (ExperimentalDetectronTopKROIs-6) (#8314) 2021-11-16 08:46:21 +03:00
Zhibin Li
4edb7c6f34
NMS: change back threshold for comparison (#8553) 2021-11-16 07:49:50 +03:00
Ilya Lavrenov
9676e643cf
Fixed ie_mark_target_as_cc (#8608) 2021-11-16 06:48:02 +03:00
Ilya Lavrenov
09653b0d9c
Fixed coverity issue (#8572) 2021-11-16 06:42:26 +03:00
song, bell
9ccc308523
Bell/revise lstm cell sequence (#7638)
* revise LSTM spec

Signed-off-by: fishbell <bell.song@intel.com>

* add param check and related test case

Signed-off-by: fishbell <bell.song@intel.com>

* fix clang-format

Signed-off-by: fishbell <bell.song@intel.com>

* use static_cast to replace c style force conversion

Signed-off-by: fishbell <bell.song@intel.com>
2021-11-16 06:13:26 +03:00
Steve Yoo
f66d9216ef
Migrate Movement 2 (BatchToSpace-2, DepthToSpace-1, Roll-7, ShuffleCha… (#8158)
* Migrate Movement2 (BatchToSpace-2, DepthToSpace-1, Roll-7, ShuffleChannels-1, SpaceToBatch-2, SpaceToDepth-1)

* Fix typos while copying

* Update to opset namespace and add i4, u4, bf16 tests when available

* Remove i4, u4 tests from BatchToSpace and Roll
2021-11-16 03:32:29 +03:00
Mateusz Tabaka
c5d0dc3e5f
[GPU] fix constant shape if its user has scalar inputs (#8564)
* [GPU] fix constant shape if its user has scalar inputs

Currently for nodes like:
```
Multiply(input{}, mul_const{2}) -> mul{2}
```
cldnn sets 'mul_const' shape to (1, 2, 1, 1), which may not be correct if it's followed by
```
Add(mul{2}, add_const{2}) -> add{2}
```
because 'mul' shape is (1, 2, 1, 1), 'add_const' shape is (2, 1, 1, 1)
and the result becomes (2, 2, 1, 1) instead of expected (2, 1, 1, 1)

* Add tests for the issue
2021-11-15 22:08:02 +03:00
Artur Kulikowski
2e9f83d705
Axis normalizing in ArgMin/ArgMax operations (#8589) 2021-11-15 16:10:24 +01:00