Commit Graph

5555 Commits

Author SHA1 Message Date
Alexandra Sidorova
802b5bcfbb
[CPU] Reduced overheads in inference stage (#6794) 2021-12-02 01:20:07 +03:00
Mikhail Nosov
3ab533a89c
Fix array out-of-bounds error (#8966) 2021-12-02 00:07:37 +03:00
Alexey Lebedev
4e6eeea6ff
[PYTHON API] move frontend bindings to pyopenvino + move MO to use new Python API (#8301)
* move frontend folder to pyopenvino

* rename includes and add compile options

* include frontend to pyopenvino

* move __init__.py

* move tests

* remove mock from tests_compatibility

* rename import module

* Fix code style cpp

* refactor a few lines

* update few lines in mo

* Add pyopenvino to dependencies

* Fix mock

* update docstring

* Fix mo test

* remove module local

* fix code style

* update comment

* fix return type

* update docs

* fix code style

* fix building

* fix code style

* try to move MO to use new api

* Export more enum names from nrgaph

* [Python API] quick fix of packaging

* update tests

* fix setup.py

* small fix

* small fixes according to comments

* skip mo frontend tests

* update mo to new imports

* try to fix win wheel

* fix win wheel

* fix code style

Co-authored-by: Anastasia Kuporosova <anastasia.kuporosova@intel.com>
Co-authored-by: y <ilya.lavrenov@intel.com>
2021-12-01 21:31:16 +03:00
Sergey Shlyapnikov
fa1d9867f2
[GPU] Fix incorrect output result in primitives with two outputs (#8902) 2021-12-01 19:23:38 +03:00
Eugeny Volosenkov
81b003e688
Python API for If operation (#7934)
* add if in python_api

* add test for if python api

* fix code style

* fix typr of output_desc

* move to ne api

* Revert "add if in python_api"

This reverts commit fca6e5a449.

* Revert compatibility if_op

* fix codestyle

* add new tests, disable test where bug is appear

* fix codestyle

* fix test

* rewrite interface if python_api

* fix dict_attribute_visitor.cpp

* fix codestyle

* fix codestyle

* update dict_attribute_visitor.cpp

* add comapti

* add compatibilty tests

* fix if_op description, and paths

* add compatible test

* fix comp opset

* fix opset 8 whitespace

* fix codestyle

* fix tests

* delete old tests

* Revert fixes in test_reduction.py, test_node_factory.py

* Revert fixes in test_reduction.py, test_node_factory.py

* fix tuple

* fix tuple

* fix tuple

* fix tuple

* fix test path

* fix test path
2021-12-01 18:07:02 +03:00
Mikhail Nosov
caf1f22f63
Update according to new file structure (#8235)
Reworked according to comments

Tested manually only, as there is no way to change priority frontends list on test time
2021-12-01 16:53:20 +03:00
Indira Salyahova
9d776ffc2f
feat: symmetic fq in self attention block transformer (#8616) 2021-12-01 15:34:40 +03:00
Alexey Lebedev
246e628c79
[PYTHON API] fix tensor naming (#8918)
* bind any_names

* Update src/bindings/python/src/pyopenvino/graph/node_output.hpp

Co-authored-by: Jan Iwaszkiewicz <jan.iwaszkiewicz@intel.com>

* add properties and tests

Co-authored-by: Jan Iwaszkiewicz <jan.iwaszkiewicz@intel.com>
Co-authored-by: Anastasia Kuporosova <anastasia.kuporosova@intel.com>
2021-12-01 14:57:24 +03:00
Ilya Lavrenov
5a52a8e4a3
Don't install content of openvino-dev; install wheels (#8820)
* Don't install content of openvino-dev

* Install MO in tests

* Install python's BA tool only for tests
2021-12-01 14:34:50 +03:00
Bartek Szmelczynski
f211749e15
Expose enum version (#8893)
* add version param to offline_transofmations serialize

* fix style

* fix style

* remove redundant commented code
2021-12-01 13:49:28 +03:00
Vladislav Volkov
8a1b63ec51
Memory leaks in tbbbind and onednn were fixed (#8825) 2021-12-01 12:56:29 +03:00
Alina Kladieva
0c1902b8c5
Revert "Temporarily pin setuptools version (#8416)" (#8931)
This reverts commit 2ed4e9c05f.
2021-12-01 12:22:03 +03:00
Pavel Esir
6c0fa03ca6
[MO] dynamic shape calculatoin for GatherElements, Sparse ops (#8478)
* dynamic shape calculation for GatherElements

* dynamic shape calculation for sparse_reshape, corrections for sparse_segment_mean/sqrtn/sum

* corrected dynamic_dimension_value, added two unit-test cases

* simplified solution, added missing Nones

* some corrections

* added a couple of more unit-tests
2021-12-01 12:07:01 +03:00
Alexey Suhov
89911caa5a
Add licensing folder to cmake install (#8948) 2021-12-01 11:42:52 +03:00
undef-nnov
c1515d92e8
Reverse infer (#8767) 2021-12-01 10:49:04 +03:00
Vladimir Gavrilov
ab22d7d041
Incorrect output shape of Gather operation for some models (#8899)
* Fix in the MO infer function of Gather.

* Added comment about done fix.

* Added more tests.

* Now Gather and AttributedGather are always marked as reinterp_shape=True.
2021-12-01 10:22:30 +03:00
Edward Shogulin
9ec7bf286e
[CPU] Dynamism support for RegionYolo node (#8542) 2021-12-01 10:18:03 +03:00
Dmitry Kurtaev
ae633c5b2d
[MO] Fix ONNX Unsqueeze with 2 inputs (#8399) 2021-12-01 10:17:04 +03:00
Ivan Tikhonov
20bf6ca6c4
Implement TelemetryExtension and enable op statistic collection in ONNX/Paddle/TF FrontEnds (#8666)
* Moved so loader to utils

* Fixed extension tests

* Fixed tests and style

* Fixed style and tests

* Fixed ARM build

* Fix windows

* Fix ieFuncTests

* Wrap runtime exception

* Fixed tests

* Added separate new extension

* Fixed unicode extension loading

* Try to fix windows

* Fixed windows

* Fixed macro

* Fixed doc

* Fixed build

* Fixed comments

* Try to fix build

* Fixed build

* Fixed build

* Fixed shared_from_this

* Temp commit

* Changed extension

* Fixed merge conflicts

* Removed ngraph namespace from new extensions

* Fixed code style

* Added core add_extension methods and tests

* Added new tests

* Implement tile operation

* Enabled new extensions support

* Fixed build

* Fixed code style

* Try to fix windows

* Changed base extension class

* Removed redundant Ptr

* Fixed comments

* Fixed friend decl

* Fixed Windows export

* Fixed centos

* Added template add_extension method

* WIP: experiments with FE extensions, python callback in C++ code, draft of transformation, op and telemetry extensions

* Move destructor to public

* WIP: merge with core extension WIP branch

* Temporary WA for defualt ctor in VariantTemp. TODO: revert back before merging to master

* Removed BaseExtension class

* Added variadic add_extension methods

* Fixed doc and typo

* Added BaseOpDestructor

* Allow to create new extension only for new operations

* Revert tests

* Fixed comments

* Fixed comments

* WIP with various types of extensions, finalizing merge

* Fixed merge artefacts and finalized Json extensions

* TelemetryExtension initial commit

* Telemetry tests

* Add telemetry to frontends

* delete debug prints

* missprint

* Resolve review comments

* update tests

* fix tests

* Collect op statistics in InputModel for PDPD, TF; Update tests

* delete debug prints, codestyle

* fix paddle frontend

* Add event_category to TelemetryExtension ctor, update event_send calls, update tests

* Add convertion_method Temetry event to MO

* pass TelemetryExtension to ONNX frontend

* Fix default argument

* Clean up

* delete unnecessary m_telemetry members

* fix windows build

* fix win build again

* try to link frontend manager statically to ONNXFrontEnd

* use static frontend_manager in unit tests

* fix win build: split declaration and definition of TelemetryException

* Resolve review remarks

* send Telemetry events for subgraph ops in ONXX, fix unit tests

* fix build

* add missign files

* resolve review comments, fix centos

* Add blank lines

* Set correct TID for Telemetry

* resolve review commetns

Co-authored-by: Ilya Churaev <ilya.churaev@intel.com>
Co-authored-by: Lyalin, Sergey <sergey.lyalin@intel.com>
2021-12-01 09:51:00 +03:00
Vladislav Golubev
803531ea14
[CPU] ROIPooling: dynamic shapes support (#8547) 2021-12-01 09:30:49 +03:00
Gorokhov Dmitriy
7879839a56
Revert "[CPU] Set lower bound for nstreams to 1 (#8747)" (#8924)
This reverts commit 251883001c.
2021-12-01 09:24:55 +03:00
Wang, Yang
232aadf518
Add test case for device parameter to LoadNetwork. (#8786)
Signed-off-by: Wang, Yang <yang4.wang@intel.com>
2021-12-01 09:07:08 +03:00
Anton Chetverikov
e9a15b70f5
[MO] Update Select shape inference function to support dynamic shapes (#8892)
* Update Select shape inference function to support dynamic shapes

* Update unit test for Select shape inference
2021-12-01 05:00:55 +03:00
Anastasia Kuporosova
184b602a49
[Python API] Remove DescriptorTensor constructor (#8903) 2021-12-01 02:09:25 +03:00
Gorokhov Dmitriy
263c4d7b02
[CPU][Tests] Remove reshape_1d_ops_test cpp (#8942) 2021-12-01 00:53:44 +03:00
Irina Efode
1cd8156d3d
[IE TEMPLATE] Fix operation set in QueryNetwork (#8824)
* [IE TEMPLATE] Fix opeartion set in QueryNetwork

* Apply review comments

* Prepare for review

* Return extra removed

* code style

* Update template_plugin.cpp

* Code style
2021-11-30 23:28:59 +03:00
Mateusz Bencer
461d6e8a1d
Added RemoveConcatZeroDimInput and RemoveMultiSubGraphOpDanglingParams transformations (#8035)
* fix expand_onnx_functions

* refactor + unit test

* fixed function in function case

* fixed expand_onnx_functions

* fixed default value of shape in ValueInfo

* enable xpass model

* changed MergeFrom to Swap

* added xfail with missing test data

* added more unit tests

* styles applied

* used std::rotate, review remarks

* removed debug code

* after offline discussion remarks

* fix checking input/output names on Windows

* names comparator refactor

* replace regex with custom comparison

* review remarks

* added RemoveConcatZeroDimInput transformation

* added RemoveLoopDanglingParameters transformation

* chage place of passes during replace

* missing comment

* code refactor + unit tests

* remove unused headers

* used std::any_of in RemoveConcatZeroDimInput

* changed headers and namespaces to new ov convention

* used std::any_of in RemoveConcatZeroDimInput

* RemoveLoopDanglingParameters refactored

* changed names to RemoveMultiSubGraphOpDanglingParams

* handling multi-body cases

* Handling If case during RemoveMultiSubGraphOpDanglingParams

* comments and names refactor

* More tests for If and TensorIterator

* handle removing dagling param from one body and update all descriptors

* fixed test

* revert if change

* moved RemoveConcatZeroDimInput and RemoveMultiSubGraphOpDanglingParams to NopElimantion

* return false if node is not replaced

* added validate_nodes_and_infer_types

* Revert "moved RemoveConcatZeroDimInput and RemoveMultiSubGraphOpDanglingParams to NopElimantion" + remarks

* review remarks

* review remarks

* fixed subgraph rtti

* adjust passes to new structure
2021-11-30 23:19:26 +03:00
Ilya Lavrenov
1b0ff2979c
Small fixes in extensions docs (#8934) 2021-11-30 22:13:49 +03:00
Aleksandr Pertovsky
13f3f351b7
[CPU] Add MoveEltwiseUpThroughDataMov (#7488) 2021-11-30 19:41:14 +03:00
Vladimir Paramuzov
9b97619687
[GPU] Move plugin to new source dir (#8890) 2021-11-30 17:26:09 +03:00
Alexey Varyzgin
9b6b184e5e
[CPU] Native 1D models support (#8168) 2021-11-30 15:30:53 +03:00
Andrei Kochin
d9acc137f8
[MO] simple change in ie bindings to avoid unnecessary warning (#8847) 2021-11-30 15:03:23 +03:00
Ilya Churaev
e07cef0191
Fixed coverage typo (#8889)
* Fixed coverage typo

* Renamed legacy

* Fixed names
2021-11-30 13:10:19 +03:00
Mikhail Nosov
84a16513df
Layout::find_permutation - support of dynamic layouts (#8766)
Covered case for 'trivial convert' where no permutation is needed
It is needed for Model Optimizer for logic which will guess model's layout, like "?c??"
2021-11-30 12:40:38 +03:00
Mikhail Nosov
e2172cd38a
[OV2.0] Preprocessing api cleanup (#8898)
* Removed 'inline' Preprocessing API

Even though this API provided a way to specify all pre/post-processing in one line - it was considered inconvinient
With 'getters' API preprocessing code looks more clear for user, so old' inline' API is removed

* Fix pyopenvino build issues

* Update after merged PR#8717
2021-11-30 12:30:13 +03:00
Anastasia Kuporosova
f6df0a9c13
[Python API] quick fix of packaging (#8870)
* [Python API] quick fix of packaging

* update tests

* fix setup.py

* small fix

* small fixes according to comments

* skip mo frontend tests
2021-11-30 12:28:34 +03:00
Mikhail Ryzhov
cccec6942e
GNA Input/Output buffers reusage (#7332)
* Init implementation

# Conflicts:
#	thirdparty/ade

* Switched to shared class

* Refactoring memory commit()

* Added unit tests

* Fixed output order

* Fixed input order

* Fixed split case

* fixed compiling issue in debug mode

* Enabled compact mode by default

* Fixed default order for inputs and outputs

* Changed unit test

* Enabled compact mode bye default

* reverted compac_mode flag order
2021-11-30 10:36:54 +03:00
Vladislav Golubev
caa7d853b3
[CPU] Security fixes (#8783) 2021-11-29 22:22:13 +03:00
Maxim Vafin
e4b5c54006
Automatically detect --disable_nhwc_to_nchw option in MO (#8450)
Clean code

Fix Result runtime info

Fix documentation

Fix documentation

Apply suggestions from code review

Co-authored-by: Tatiana Savina <tatiana.savina@intel.com>

Update docs/MO_DG/prepare_model/customize_model_optimizer/Customize_Model_Optimizer.md

Co-authored-by: Tatiana Savina <tatiana.savina@intel.com>

Apply review feedback

Apply review feedback

Apply review feedback
2021-11-29 19:58:43 +03:00
Andrey Noskov
d24a48901e
[GNA] add MultipleActivationsTest (#7504)
* add MultipleActivationsTest

* renamed files, changed structure

* [GNA] switched to single layer tests

* [GNA] fix review comments

* [GNA] Test changes
   -model structure
   -test name
   -moved to subgraph tests

* Deleted commented code

* Renamed test
2021-11-29 17:44:46 +03:00
Nikolay Shchegolev
a113c823a7
[CPU] Slice-8 operation implementation. (#7521) 2021-11-29 17:28:12 +03:00
Andrey Noskov
2022b70d8b
[GNA] added test multi_input_scale (#7939)
* [GNA] added test multi_input_scale

* [GNA] fixed test params after review

* Changed scale factors
2021-11-29 16:16:55 +03:00
Svetlana Dolinina
980ad59ac4
Correct ReverseV2ToReverseSequence transformation (#8120)
* add subgraph instead of constant with fixed shape to allow model have undefined batch

* updated transformation (not checked yet)

* changed ReverseV2ToReverseSequence to support dynamic shapes/reshape;
added transformation to reverse_tensor_iterator to support new subgraph got from ReverseV2ToReverseSequence

* remove changes that should not be on this branch

* added tests;
fixed old transformation

* added delete of reversesequences to avoid run of transformation twice

* fixed pattern check for case with dynamic value for input of reversesequence

* Revert "fixed pattern check for case with dynamic value for input of reversesequence"

This reverts commit 0c04164e

* Revert "added delete of reversesequences to avoid run of transformation twice"

This reverts commit fcb7de9c

* reversed changes in reverse_tensorr_iterator for Squeeze case;
update reverse_tensor_iterator with shapeof subgraph
added permutations for attributes to pass layer test

* minor fix for dynamic shape

* updated test;
fixed backward compatibility in reverse_tensor_iterator transformation

* revew comments fixed:
added comments;
refactoring done;
fixed framework name saving for rank = 1

* minor review fixes

* small fix
2021-11-29 15:29:00 +03:00
Vitaliy Urusovskij
c084f8aa42
Clean up evaluate of boolean (#8843)
Remove  evaluate of `boolean` for ops
inherited from `UnaryElementwiseArithmetic`
2021-11-29 15:24:17 +03:00
Ilya Churaev
7678ab2b18
Move hetero plugin (#8872) 2021-11-29 14:05:08 +03:00
Tingqian Li
b0da652e46
[CPU] Native dynamic shapes support in the ReorgYolo node (#8642) 2021-11-29 13:31:23 +03:00
Edward Shogulin
e2ed99a93e
[CPU] Dynamism support for EmbeddingSegmentsSum & EmbeddingBagOffsetSum & EmbeddingBagPackedSum nodes (#8387) 2021-11-29 12:28:16 +03:00
Maxim Andronov
c8d5b20c95
[CPU] Interpolate dynamism support (#8717) 2021-11-29 12:16:14 +03:00
Vladislav Golubev
63822e0bdb
ROIAlign cpu tests disabled (#8887) 2021-11-29 12:03:21 +03:00
Mateusz Tabaka
541c8721c7
[GPU] fix Constant handling when it has multiple users and one if it … (#8832)
* [GPU] fix Constant handling when it has multiple users and one if it is bprop conv

When constant is connected to ConvolutionBackpropData or GroupConvolutionBackpropData weights,
we need to swap 'O' and 'I' dimensions. That can be problematic if the same constant
is also connected to other nodes - since after swap - the dimensions may not match
the other node's dimensions.
To handle that, we can create a copy of that constant, replace backprop convolution weights
with that copy and create additional (to the original constant) cldnn::data primitive with swapped dimensions.

* fix windows build

* address review comments
2021-11-29 11:53:08 +03:00