Commit Graph
547 Commits
Author SHA1 Message Date
Oleg Pipikin 1c564226f3 Deprecate util functions in public api (#16716)
* Deprecate util functions in public api

* Add deprecation suppression for usage inside openvino

* Fix clang-format

* Fix1
2023-04-06 06:32:04 +04:00
Vitaliy Urusovskij 7442a17240 Add Core property to switch from mmap to read in IR Frontend (#16600)
* Add Core property to switch from `mmap` to `read`
in IR FrontEnd

* Add tests on `ov::enable_mmap` property

* Add `enable_mmap` in C & Py APIs

* ClangFormat
2023-04-05 18:22:11 +04:00
Ekaterina Aidova 837f5a7d53 [PT FE]: fix aten::index inconsistent reshape (#16741)
* [PT FE]:  fix aten::index inconsistent reshape

* add index name, return false

* Update src/frontends/pytorch/src/transforms/aten_index_replacer.cpp
2023-04-05 10:44:25 +02:00
Roman Kazantsev 45daa2095f [TF FE] Add diagnostics capabilities via Framework nodes (#16706)
* [TF FE] Add diagnostics capabilities via Framework nodes

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>

* Refactor normalize logic

* Applied code-review feedback: fix in get_unsupported_operations_and_failures

* Handle unknown exception type

* Store only first encountered failure

* Update src/frontends/tensorflow/tests/convert_unsupported.cpp

* Apply code-review ffeedback: use stringstream

* Correct Key for exception message

* Fix build

* Use helper for creation of fw node with exception message inside

* Add test for conversion with unknown exception

---------

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
2023-04-05 11:28:10 +04:00
Ivan Tikhonov 093990118d Remove legacy TransposeSinking transformation (#16731)
* delete TransposeSinkingOVTF transformation

* delete include from tf_lite frontend
2023-04-04 18:51:10 +04:00
Roman Kazantsev 9a5a8f6abc [TF FE] Move to TopK-11 operation and update downgrading TopK transformation (#16590)
* [TF FE] Move to TopK-11 operation

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>

* Update downgrading transformation

---------

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
2023-03-31 17:44:58 +02:00
Ilya Lavrenov ee0bb79ed6 Fixed LTO build (#16629)
* Partially fixed LTO

* Fixed issues with cnpy LTO

* CPU

* Disabled failing GPU test
2023-03-31 11:34:42 +04:00
Roman Kazantsev fc95d8e544 [TF FE] Align opset usage in utils (#16656)
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
2023-03-30 17:58:46 +00:00
Vladislav GolubevandRoman Kazantsev b0e6b1e83c [TF FE] NgramCompilation test fix (#16636)
* [TF FE] NgramCompilation test fixed

---------

Co-authored-by: Roman Kazantsev <roman.kazantsev@intel.com>
2023-03-29 18:34:23 +00:00
Roman Kazantsev 0c2308506f [TF FE] Fix leftovers from review (#16619)
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
2023-03-29 16:28:37 +04:00
Przemyslaw Wysocki 591c3e61c5 [PyOV] Simplify requirement files (#15343)
* Partial progress

* Finish v1

* Cleanup

* Remove useless files

* Fix path to pdpd

* Fix onnx path

* Minor change

* Rework MO

* Minor change

* Remove some costraints

* Add MO constraints

* Update gitignore for MO

* Minor change

* Apply tech sync discussion

* Cleanup

* CR comment

* Debug ONNX FE

* simplify ONNX FE

* Update cmake

* Hardcode ONNX requirement

* Add dependency resolver to cmake

* Add constraints for openvino/tests

* Add missing pytest-html

* Fix -c path

* Revert debug changes to path

* Add cmake to copy constraints.txt

* Update dependabot

* Remove slash

* Remove cmake

* Debug prints

* Minor changes

* Move reqs check to separate file

* Add requirements parser to benchmark_tool

* Fix smoke tests constraints

* Minor fixes

* Minor change

* My fixes were apparently wrong

* Debug - self.executable_path

* Debug - add singledispatch to tests and tools

* Debug - print IE_APP_PATHs

* Revert "Debug - print IE_APP_PATHs"

This reverts commit 67ccb6d3f5.

* Revert "Debug - add singledispatch to tests and tools"

This reverts commit 3b945931e2.

* Revert "Debug - self.executable_path"

This reverts commit 3aa724eff6.

* update dependabot

* update dependabot

* Skip benchmark_app tests

* Use CMAKE_CURRENT_BINARY_DIR in cmake

* Remove debug prints

* minor change

---------

Signed-off-by: p-wysocki <przemyslaw.wysocki@intel.com>
2023-03-29 14:27:27 +04:00
Ilya Churaev f3dcf93f96 Remove suppression Wno-delete-non-abstract-non-virtual-dtor (#16560)
* Remove suppression Wno-delete-non-abstract-non-virtual-dtor

* Fixed Allocator warning

* Suppress warning for GPU plugin

* Skip warning for GNA

* Fixed preprocessing

* Added virtual constructor for base plugin class

* Some fix for CPU

* Suppress for CPU

* Fixed any

* Fixed meta

* Disable warning for paddle

* Fixed Allocator tests

* Move suppress to paddle

* Fixed benchmark_app
2023-03-29 14:19:30 +04:00
Vladislav Golubev df3c06ecb4 [CPU] Ngram node fusion (#16131) 2023-03-29 13:58:41 +04:00
Mateusz TabakaandLuo Cheng 556d469f6b [PADDLE] add paddle opextension support (#16439)
* add opextension support

* support opconversion

* fix test contructor ambiguous

* fix ci fail

* add tag to avoid compiler ambiguous

* move tests to layer_tests & remove PaddleTag

* static cast

* use create_ov_node_by_name

---------

Co-authored-by: Luo Cheng <cheng.luo@intel.com>
2023-03-29 12:23:47 +04:00
Roman Kazantsev 35e03d33bb [TF FE] Support frozen models in text protobuf format aka pbtxt (#16604)
* [TF FE] Support frozen models in Text Protobuf format aka pbtxt

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>

* Fix gen_wrapper.py for pbtxt

* Fix is_supported method

* Fix gen_wrapper.py script

* Adopt test_text_frozen_format unit-test

* Update src/frontends/tensorflow/src/frontend.cpp

* Update src/frontends/tensorflow/src/frontend.cpp

---------

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
2023-03-29 11:58:08 +04:00
Mateusz Tabaka b82bedd648 Add Conversion and Op Extension to Pytorch frontend (#16434)
Tickets: 98766 and 98767
2023-03-29 00:25:29 +02:00
Vitaliy Urusovskij 40cc006bae Enable MapAllocator in IR Frontend (#12673)
* Enable MapAllocator in IR Frontend

* Fix `ov_infer_request_ppp` test

With `mmap()`ing of IR, .bin can't be deleted until unmapping.
And it shows that there was a leak in test

* Add comment to Win `CreateFile()` regarding
FILE_SHARE_DELETE

* Unmap .bin file before IR files deletion

Wait ov::Model deletion to trigger .bin file unmapping
before IR files deletion

* ClangFormat

* Add `use_map_allocator` switch in FE

In case of direct use of FE (e.g. via MO), `mmap()` is OFF.
But in case of use FE via Core, `mmap()` is ON.
2023-03-28 23:24:13 +04:00
Mateusz Bencer 4403433309 [ONNX FE] Implementation of ONNX STFT op (#16461) 2023-03-28 20:47:17 +02:00
Ekaterina Aidova 6fc0b6479e [PT FE]: revert usage mo.convert_model in pt layer tests (#16573)
* [PT FE]: revert usage mo.convert_model in tests

* fix failed test
2023-03-28 16:06:21 +04:00
Roman Kazantsev 5e9ea6a146 [TF FE] Refactor utils routine (#16554)
Move all openvino_conversion rountines into utils. Avoid using Squeeze without axis
that can create dynamic output rank

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
2023-03-27 11:10:00 +00:00
Piotr Krzemiński 6b70c449ba [PT FE] Add aten::Chunk implementation (#16035)
* [PT FE] Add chunk implementation:

* [PT FE] Fix chunk int64 instead of const node errors, add tests for chunking

* [PT FE] Test Chunk-If implementation

* [PT FE] Change the translate to replace chunk implementation, use VariadicSplit instead of Slice

* [PT FE] Reduce artifacts from debugging

* Update test_chunk.py

* [PT FE] Improve & debug chunk implementation:

* [PT FE] Simplify implementation, fix remaining bugs

* [PT FE] Statify the split lenghts output

* [PT FE] Clear code, remove debugging artifacts
2023-03-27 11:16:16 +02:00
Mateusz Mikolajczyk 7d16ee1835 [PT FE] Add torchvision::deform_conv2d translation (#16450)
* Initial commit

* Initial commit

* Cleanup

* Improve tests

* Make NodeContext const
2023-03-27 11:13:32 +02:00
Ilya Lavrenov 2638014d00 Enable build with system version of snappy (#16549)
* Enable build with system version of snappy

* Create Snappy::snappy alia
2023-03-27 10:01:11 +04:00
Ekaterina Aidova 1ef94ec069 [PT FE]: support aten::linalng_vector_norm (#16109)
* [PT FE]: support aten::linalng_vector_norm

* more norm ops

* update tests
2023-03-24 21:00:17 +01:00
Ekaterina Aidova 179403ddc9 [PT FE]: improve integration into mo.convert_model (#16243) 2023-03-24 16:55:07 +01:00
Ivan Tikhonov 5a8a195dad TransposeSinking: add support for Slice and Reshape ops (#16208)
* Resolve the performance issues in TransposeSinking transformation

* codestyle

* fix warning as error, fix tests failures

* fix ts for Concat and Reduce

* Fix TransposeReduceBackward

* fix the issue in TransposeFuse transformation

* fix TransposeReduce transformations

* Fix TransposeReduction, fix TransposeSinkingSplit, add unsqueeze support

* delete debug print

* Add additional validations

* fix node validation

* Fix validate for split, revert changes for concat, add BatchToSpace/SpaceToBatch

* Add SpaceToBatch/BatchToSpace

* fix TS for Interpolate + codestyle

* fix gna build

* Support TS for Interpolate, VariadicSplit, IsInf, IsNan, IsFinite + refactoring

* add the missed line

* add include

* TransposeSinking tests refactoring: part1

* TransposeSinking tests refactoring: part2

* Add limited support for StridedSlice op

* codestye

* TransposeReduction: skip the case when 2nd input for Squeeze is not provided

* Transpose sinking tests refactoring: part 3. + Revert changes in MOC.

* fix build

* codestyle

* Add tests for TS backward transformations, update TransposeSinkingFuse transformation, delete StridedSlice transformation prototype + tests refactoring

* fix unary tests

* Fix warning as error on Windows

* Add new tests for Unsqueeze/Squeeze; refactoring; remove debug code

* TransposeSinking: add support for Slice op

* Add descriptions to the transformations, add additional checks

* fix a warning

* TransposeSinking Rafactoring part2: move the transformations to a separate folder, align namespaces

* TransposeSinking refactoring: class names, namespaces

* codestyle

* resolve merge conflicts

* codestyle

* TSReduction refactoring, move Unsqueeze/Squeeze transformations to separate files, added limited support for Reshape op + tests

* fix minor mistakes

* fix warnings

* Added TSSlice transformation to TSGeneral, created TransposeSinkingGeneral alias in ov::pass namespace

* refactoring

* codestyle

* fix TSSqueeze/TSUnsqueeze transformations

* delete debug serialize

* remove TransposeSinking from MOC

* fix TSSqueeze/TSUnsqueeze transformations in case of Reshape op

* delete debug code

* codestyle

* fix unit tests, revert changes for TSSlice transformation

* fix TSSqueeze transformation

* resolve review comments

* codestyle
2023-03-24 17:01:15 +04:00
Georgy Krivoruchko c5b348dd4f [POC][TF FE] Support SavedModel format (with compression) (#16317)
* Added Saved Model proto descriptors

* Included Google's protobuf repository

* Added wstring version of ov::util::directory_exists

* Added initial implementation of Saved Model iterator

# Conflicts:
#	src/frontends/tensorflow/src/frontend.cpp

* Added missing proto files to repository

* Implemented reading of variables index and data files

# Conflicts:
#	src/frontends/tensorflow/src/frontend.cpp

* Renamed class

# Conflicts:
#	src/frontends/tensorflow/src/frontend.cpp

* Fix for cross-platform directory_exists

* Fixed codestyle and simplified code

* CI fixes

* Separeted Saved Model iterator from Proto iterator

* Moved variables index into separate class

* Added initial implementation of reading a variables from
saved model

# Conflicts:
#	src/frontends/tensorflow/src/frontend.cpp

* Added external variable mapping

* Code cleanup

* Commit is for discussion purposes!!!
Implemented RestoreV2 with a workaround for strings
Not optimized, includes mem leak

* In progress...

* Added DT_STRING coverage into decoder_proto

* m_variables_index moved into underlying class

* Updated copyrgihts, added space between license and code

* Moved string constant to separate class

* Added AssignVariableOp operation

* Changed behavior of RestoreV2
Updated stubs for other ops

* Second working implementation, enabled:
Program-only models
Variables reading from data files

* Extended docs

* Fixed dynamic type

* Fixed naming

* Added Snappy submodule to support compression in TF FE

* Enabled Snappy Compression for TF FE

* Make static linkage of Snappy
Changing Warning as error behavior for 3rd party

* CI fixes

* Added Snappy copyright info

* Aligned behavior of StringConstant with UnsupportedConstant

* Added correct naming and removing unused inputs/outputs
2023-03-24 15:07:16 +04:00
Maxim Vafin 86c4489aca [PT FE] Add telemetry extension support (#16438)
* Initial telemetry introduction in PyTorch frontend

* Add test

* remove obsolete checks from test

* Move statistics gathering into TranslateSession

* Fix code style

* Fix codestyle
2023-03-24 10:11:12 +01:00
Roman Kazantsev 3f4b1e8205 [TF FE] Post leftovers to support the MUSE model in SavedModel format (#16520)
* [TF FE] Post leftovers to support the MUSE model in SavedModel format

It contains tests imitating a case with Tokenizer extension and raised problems:
setting custom type for body graph Parameter, named ports for RaggedTensorToSparse
and Unique operations.

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>

* Update src/frontends/tensorflow/tests/convert_tricky_models.cpp

---------

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
2023-03-24 11:07:56 +04:00
Tomasz Dołbniak 1b89ecdbae Interpolate v11 usage in ONNX FE (#16463) 2023-03-24 02:06:22 +00:00
Maxim VafinandMateusz abaf61d059 Improve detectron2 support (#16011)
* Improve op support for detectron mask rcnn

* Initial commit

* Fix for reading processed list

* Format code

* Cleanup

* cleanup

* Cleanup

* cleanup test

* Add comment

* Add rt_info

* fix type

* More fixes for detectron

* Fix build

* Add tests for if

* Revert changes in index

* Add comment

* Fix test

* Fix get_axes_range

* Add tests and fix if type alignment

* Fix code style

---------

Co-authored-by: Mateusz <mateusz.mikolajczyk@intel.com>
2023-03-23 22:30:03 +00:00
Przemyslaw Wysocki 52b27d82c5 Upgrade ONNX to 1.13, protobuf to 3.20.3 and relax tensorflow (#14773)
* Bump ONNX version

* Bump protobuf

* Add xfails and skips

* Add tickets

* Skip ONNX Serialization tests

* Compile ONNX with C++17

* Force cpp17 - 2

* Use MSVC check

* Update tensorflow

* Minor change

* Bump onnx to 1.13.1

* Bump protobuf to 3.20.3

* Debug test tf

* Xfail tests in comp

* Update comp tests

* Update tf reqs

* Remove deprecated ONNX function

* Align PDPD FE protobuf req with 2.4.1

* Satisfy dependency review

* Attempt to fix dependency review

* Revert pdpd protobuf

* Skip pdpd tests

* Fix MO-TF-PB test

* Skip TF test case

* Add ticket numbers, rewrite reqs

* Fix requirements

* Minor change

* Set TF to 2.12

* Remove wrapt and skip test
2023-03-24 00:43:01 +04:00
Mateusz Bencer a004601774 [ONNX FE] Fix Windows warnings (#16141) 2023-03-23 10:59:00 +01:00
Roman Kazantsev aaa4a4c210 [TF FE] Skip Assert operation and add test (#16484)
At the conversion stage we can't resolve Assert node because the condition
is computed only during inference time.

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
2023-03-23 11:49:46 +04:00
Xuejun Zhai 8509d0dd82 [Deprecated API] remove version (#16426)
* [Remove version] Remove version from py openvino

Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>

* Modify caused by remove version

Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>

* Fix clang format issue

Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>

* Revert "Fix clang format issue"

This reverts commit 132787286f.

* Fix CI format issue

Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>

* Fix CI format issue

Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>

* Fix merge conflict error

Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>

---------

Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>
2023-03-22 16:09:14 +01:00
Roman Kazantsev 0070e8d939 [TF FE] Fix problems with invalidation of decoders (#16464)
* [TF FE] Fix problems with invalidation of decoders

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>

* Fix comment

---------

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
2023-03-22 12:02:59 +04:00
Tomasz Dołbniak 234f36e9b7 TopK v11 usage in ONNX FE (#16449) 2023-03-21 17:23:29 +00:00
Roman Kazantsev 82a992b95d [TF FE] Fix leftovers from code review (#16422)
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
2023-03-21 08:31:10 +00:00
Roman Kazantsev 5cb20f8858 [TF FE] Refactor StridedSlice translator and add layer test to precommit (#16376)
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
2023-03-21 08:54:48 +04:00
Maxim Vafin 7f8786d9aa [PT FE] Make NodeContext constant inside conversion rules (#16165)
* Make NodeContext constant inside conversion rules

* Use shared_ptr

* Fix ptr

* Fix logical not
2023-03-20 22:08:24 +01:00
Ekaterina Aidova 71167df234 [PT FE]: enable dtype in softmax and constant filling, extend logical ops support (#16276) 2023-03-20 14:12:12 +00:00
Roman Kazantsev 86f0285db2 [TF FE] Support dynamic type for all operation translators (#16380)
* [TF FE] Support dynamic type for all operation translators

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>

* Add test of conversion with dynamic type

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>

---------

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
2023-03-20 17:41:45 +04:00
Evgenya Stepyreva ecc2f13dd2 CVS-105549 TFL OneHot renamed (#16388)
We rename one hot to fit the requirements of tensorflow common library.
2023-03-20 14:35:02 +01:00
Ekaterina Aidova f39684a7f8 [PT FE]: support mixed precision in floor divide (#16362)
* [PT FE]: support mixed precision in floor divide

* Update floordiv.cpp
2023-03-20 11:00:26 +01:00
Mateusz Mikolajczyk 134ebb8889 [PT FE] Add aten::new_empty (#16312)
* Add new_empty

* Remove duplicated code for new_empty
2023-03-20 10:03:33 +01:00
mei, yang 4411a6ea45 WA to resolve conflict between paddlepaddle and protobuf 3.20.3 (#16315) 2023-03-20 12:50:49 +04:00
Roman Kazantsev 3f06a9b6fb [TF FE] Test MatrixDiag translator in the pre-commit (#16377)
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
2023-03-20 12:20:13 +04:00
Egor Duplenskii e1e44d6bac [CPU] Move to oneDNN v3.1 (#15918) 2023-03-17 14:17:55 +04:00
Ivan Tikhonov e1ee8f0ec8 TransposeSinking refactoring: part 2 (class names, folders, file names) (#16291)
* Add descriptions to the transformations, add additional checks

* fix a warning

* TransposeSinking Rafactoring part2: move the transformations to a separate folder, align namespaces

* TransposeSinking refactoring: class names, namespaces

* codestyle

* resolve merge conflicts
2023-03-15 17:18:39 +04:00
Georgy KrivoruchkoandRoman Kazantsev 36c18e29a8 [TF FE] Added Tensorflow CTCLoss layer test (#13644)
Co-authored-by: Roman Kazantsev <roman.kazantsev@intel.com>
2023-03-15 08:18:29 +00:00