Commit Graph
573 Commits
Author SHA1 Message Date
Roman Kazantsev 7cf9d109e8 [TF FE] Implement optimal conversion of body graphs (#17211)
* [TF FE] Implement optimal conversion of body graphs

Preliminary setting input shapes and types for body graph InputModel
provides more optimal conversion of body-graphs.

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>

* Fix build issue

---------

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
2023-04-26 12:12:54 +04:00
Ilya Lavrenov 2e3deb8d8f Windows arm64 support for CPU plugin (#17075)
* ARM32 support

* ARM32 support

* Fixed packaging

* Windows arm64 support

* Updated submodule

* 32 bits support in Intel CPU plugin

* Fixed FIndAcl.cmake

* Enable proper conditional  compilation for Windows ARM64

* Enable proper conditional  compilation for Windows ARM64

* Updated submodule

* Updated submodule

* Updated submodule

* Updated submodule

* Updated submodule

* Added template_extension to CPU func tests dependencies

* Updated submodule

* Enabled runtime model tests

* Updated submodule

* Submodule update
2023-04-25 16:41:28 +04:00
Evgenya StepyrevaandTatiana Savina ee4ccec190 TensorFlow Lite FrontEnd: documentation changes (#17187)
* First glance doc changes

* Apply suggestions from code review

Co-authored-by: Tatiana Savina <tatiana.savina@intel.com>

* Update docs/MO_DG/prepare_model/convert_model/Convert_Model_From_TensorFlow_Lite.md

Co-authored-by: Tatiana Savina <tatiana.savina@intel.com>

---------

Co-authored-by: Tatiana Savina <tatiana.savina@intel.com>
2023-04-25 16:18:24 +04:00
Georgy Krivoruchko 3f07c8b48b [TF FE] Added MetaGraph file format (#16524)
* Separeted SavedModelVariablesIndex class from Saved Model

* Renamed SavedModelVariablesIndex class

* Enabled Tensorflow MetaGraph

* Enabled Tensorflow MetaGraph

* Covered VariableV2 and Assign nodes

* Applied review comments

* Added tests

* Added names to input/output ports too

* Fixed naming for using with MO

* Applied part of review comments

* Renamed meta.cpp and saved_model.cpp

* Applied shared_ptr for memory management of PtrNode

* Fixing CI

* Prevent cycles while passing thru graph

* Released requirement for Checkpointable Object Graph

* Changed naming approach to align port order

* Changed renaming order (before reordering)

* Added a Placeholder translator which checks updated shape

* WA missing Identity name

* Fix CI and restored lost translators after rebase

* WA for output names

* Removing unused params after cutting a model

* Prevents crash in case VariableV2 appears in freezed model

* Fixed saved model in case no variables.index found, but
variables exists

* Changed approach for handling native formats support

* Aligned behavior with freezing .meta files

* Fixed behavior for cutting a model by input tensor

* Applied review comments
2023-04-25 13:46:06 +04:00
Ekaterina Aidova 39ed9a624f [PT FE]: extend batch norm to support training mode (#17040) 2023-04-25 11:27:00 +02:00
Roman Kazantsev 3830125e3b [TF FE] Report the full list of unsupported operations (#17143) 2023-04-24 21:33:07 +00:00
Piotr KrzemińskiandMichal Lukaszewski 22a81e0e58 [PT FE] Enable stable tests for sort & argsort (#16415)
* [PT FE] Enable stable tests for sort & argsort

* Update test_argsort.py

* [PT FE] Update to opset11

* [PT FE] Remove redundant argument from argsort test

---------

Co-authored-by: Michal Lukaszewski <michal.lukaszewski@intel.com>
2023-04-25 01:21:16 +04:00
Tomasz DołbniakandMichal Lukaszewski 6ea9cc7149 ONNX FE - model loading fix (#17091)
* Path retrieval fix

* More detailed messages in the failing test

* Exe path with model name

---------

Co-authored-by: Michal Lukaszewski <michal.lukaszewski@intel.com>
2023-04-21 15:25:26 +04:00
Mateusz Bencer 77a5d1aa03 [ONNX FE] Fixed handling duplicates during graph extraction (#17071) 2023-04-20 11:10:09 +00:00
Evgenya Stepyreva 497a19edf6 CVS-102308 Read tflite model to vector (#17048) 2023-04-19 13:27:41 +00:00
Ilya Churaev 566ef01a3f Remove constructors for ov Exceptions (#16938)
* Remove constructors for ov Exceptions

* Fixed linux build

* Fixed ONNX Frontend

* Fixed paddle

* Fixed exceptions in tests

* Deprecate constructors for ov::Exception

* Suppress some warnings

* Merge several exceptions

* Some small changes

* Suppress more warnings

* More warnings

* mode warnings

* Suppress more warnings

* More warnings
2023-04-18 21:02:26 +04:00
Katarzyna Mitrus 2a5c69abc6 [ONNX FE] Fix ONNX DequantizeLinear-13 import dynamic shape (#16966) 2023-04-18 13:03:55 +02:00
Przemyslaw WysockiandIlya Lavrenov d72d833a96 [PyOV] Enable Python 3.11 (#15144)
* Bump ONNX version

* Bump protobuf

* Add xfails and skips

* Add tickets

* Skip ONNX Serialization tests

* Compile ONNX with C++17

* Force cpp17 - 2

* Use MSVC check

* Relax python reqs, enable 311 in azure

* Fix setupvars error

* Ignore watchdog error

* Update tensorflow

* Minor change

* Bump onnx to 1.13.1

* Bump protobuf to 3.20.3

* Debug test tf

* Xfail tests in comp

* Update comp tests

* Update tf reqs

* Remove deprecated ONNX function

* Align PDPD FE protobuf req with 2.4.1

* Satisfy dependency review

* Attempt to fix dependency review

* Revert pdpd protobuf

* Skip pdpd tests

* Fix MO-TF-PB test

* Skip TF test case

* Enable py311 on rest of jobs

* Try disabling pdpd req

* Exclude pdpd form cmake

* Update .ci/azure/linux.yml

Fixed unmerged merge-conflict

* CR

* Fix reqs

* Skip pdpd tests

* Disable pdpd tests building in cmake

* Skip another pdpd cmake

* Add file

* Add paddle constraint to tests

* Disable paddle reqs

* Debug prints

* Skip TF test if Python ver is 3.11

* Apply Mish cr comments

* Debug

* Debug

* Constrain tensorflow_addons

* Fix pdpd skipping

* Add debug prints

* Update skips

* Remove prints

* Minor change

* Update OMZ commit

* Fix some tests

* Minor change

* Disable pdpd at all

* Disable pdpd at all

---------

Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>
2023-04-17 13:30:17 +04:00
Maxim Vafin 25015f9790 [PT FE] Support prim::DictConstruct on the output (#16894)
* Support dict on the output

* Preserve output order
2023-04-13 16:42:17 +00:00
Mateusz Tabaka 5d80bca16e [TF frontend] Add test for Split->Conv->Concat scenario (#16816) 2023-04-13 10:42:17 +02:00
Mateusz Bencer e737e18b02 [ONNX FE] Fix Squeeze v1 (#16865) 2023-04-12 14:33:49 +02:00
Przemyslaw Wysocki 69d6ef33fc [PyOV] Align and bump numpy, further tidy up requirements (#16652)
* Align numpy

* Simplify the rest

* Minor change

* Minor change

* Restart CI

* Update paddle reqs
2023-04-12 13:14:38 +04:00
Bo Liu 4bb9222c6e fix Paddle unit tests unexpected exceptions and seg fault issue (#16808)
* fix Paddle unit tests unexpected exceptions and seg fault issue

* parse confine from reqfile to keep algin with other requirements

* Apply suggestions from code review

* Apply suggestions from code review
2023-04-12 11:13:25 +04:00
Ivan Tikhonov 920900fbda Delete the redundant check in convert method of TF FrontEnd class (#16846)
* remove a check in convert method

* delete unused variables and comment

* leave only one pass::Manager in normalize method
2023-04-12 01:05:16 +04:00
Roman Kazantsev 9e89b6c5f6 [TF FE] Support NonMaxSuppression with named outputs (#16835)
* [TF FE] Support NonMaxSuppression with named outputs

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>

* Simplify the test for NMS named outputs

* Share a script for test model generation

---------

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
2023-04-11 19:14:59 +02:00
Ekaterina Aidova ca2265395d [PT FE]: fix aten::mean behaviour for provided dtype (#16790) 2023-04-11 14:29:29 +04:00
Ekaterina Aidova d41663694c [PT FE]: aten::gather (#16784)
* [PT FE]: aten::gather

* add detach and sign
2023-04-11 14:28:05 +04:00
Ekaterina Aidova d407bc1b3b [PT FE] fix invalid reshape shape after aten::index (#16821)
* [PT FE] fix invalid reshape shape after aten::index

* support aten::index_select
2023-04-11 12:41:59 +03:00
Roman Kazantsev f991f92f8c [TF FE] Test ResourceGather operation and fix debug caps (#16819)
* [TF FE] Test ResourceGather operation and fix debug caps

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>

* Fix test generation script

---------

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
2023-04-11 11:33:32 +04:00
Ivan Tikhonov 72952bdc45 Disable ConstantFolding for ShapeOf subgraph in TS transformation (#16765)
* Disable ConstantFolding for ShapeOf expressions in TS transformation

* update ModelWithEmptyTensorListAndPushBack: add ShapeOf subgraph
2023-04-07 14:50:59 +04:00
Maxim VafinandSergey Lyalin 8b7e6878e8 [TF FE] Better support for named ports in tensorflow frontend (#16697)
* Fix in create_same_type_const_scalar; accurate updating type for parameter when inlining function call body

* Added Unique to the list of operations with named output ports (another MUSE fix)

* Draft: working version of extension with named ports in TF

* Merge fixes

* Refactor and productize POC

* Clean up

* Fix build

* Fix code style

* Fix lib so extension test

* Fix namespaces

* Remove usage of Any from CreatorFunction

* Fix build

* Fix arm build

* Apply review feedback

* Fix build after merge

* Apply suggestions from code review

---------

Co-authored-by: Sergey Lyalin <sergey.lyalin@intel.com>
2023-04-07 14:16:23 +04:00
Oleg Pipikin 1c564226f3 Deprecate util functions in public api (#16716)
* Deprecate util functions in public api

* Add deprecation suppression for usage inside openvino

* Fix clang-format

* Fix1
2023-04-06 06:32:04 +04:00
Vitaliy Urusovskij 7442a17240 Add Core property to switch from mmap to read in IR Frontend (#16600)
* Add Core property to switch from `mmap` to `read`
in IR FrontEnd

* Add tests on `ov::enable_mmap` property

* Add `enable_mmap` in C & Py APIs

* ClangFormat
2023-04-05 18:22:11 +04:00
Ekaterina Aidova 837f5a7d53 [PT FE]: fix aten::index inconsistent reshape (#16741)
* [PT FE]:  fix aten::index inconsistent reshape

* add index name, return false

* Update src/frontends/pytorch/src/transforms/aten_index_replacer.cpp
2023-04-05 10:44:25 +02:00
Roman Kazantsev 45daa2095f [TF FE] Add diagnostics capabilities via Framework nodes (#16706)
* [TF FE] Add diagnostics capabilities via Framework nodes

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>

* Refactor normalize logic

* Applied code-review feedback: fix in get_unsupported_operations_and_failures

* Handle unknown exception type

* Store only first encountered failure

* Update src/frontends/tensorflow/tests/convert_unsupported.cpp

* Apply code-review ffeedback: use stringstream

* Correct Key for exception message

* Fix build

* Use helper for creation of fw node with exception message inside

* Add test for conversion with unknown exception

---------

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
2023-04-05 11:28:10 +04:00
Ivan Tikhonov 093990118d Remove legacy TransposeSinking transformation (#16731)
* delete TransposeSinkingOVTF transformation

* delete include from tf_lite frontend
2023-04-04 18:51:10 +04:00
Roman Kazantsev 9a5a8f6abc [TF FE] Move to TopK-11 operation and update downgrading TopK transformation (#16590)
* [TF FE] Move to TopK-11 operation

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>

* Update downgrading transformation

---------

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
2023-03-31 17:44:58 +02:00
Ilya Lavrenov ee0bb79ed6 Fixed LTO build (#16629)
* Partially fixed LTO

* Fixed issues with cnpy LTO

* CPU

* Disabled failing GPU test
2023-03-31 11:34:42 +04:00
Roman Kazantsev fc95d8e544 [TF FE] Align opset usage in utils (#16656)
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
2023-03-30 17:58:46 +00:00
Vladislav GolubevandRoman Kazantsev b0e6b1e83c [TF FE] NgramCompilation test fix (#16636)
* [TF FE] NgramCompilation test fixed

---------

Co-authored-by: Roman Kazantsev <roman.kazantsev@intel.com>
2023-03-29 18:34:23 +00:00
Roman Kazantsev 0c2308506f [TF FE] Fix leftovers from review (#16619)
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
2023-03-29 16:28:37 +04:00
Przemyslaw Wysocki 591c3e61c5 [PyOV] Simplify requirement files (#15343)
* Partial progress

* Finish v1

* Cleanup

* Remove useless files

* Fix path to pdpd

* Fix onnx path

* Minor change

* Rework MO

* Minor change

* Remove some costraints

* Add MO constraints

* Update gitignore for MO

* Minor change

* Apply tech sync discussion

* Cleanup

* CR comment

* Debug ONNX FE

* simplify ONNX FE

* Update cmake

* Hardcode ONNX requirement

* Add dependency resolver to cmake

* Add constraints for openvino/tests

* Add missing pytest-html

* Fix -c path

* Revert debug changes to path

* Add cmake to copy constraints.txt

* Update dependabot

* Remove slash

* Remove cmake

* Debug prints

* Minor changes

* Move reqs check to separate file

* Add requirements parser to benchmark_tool

* Fix smoke tests constraints

* Minor fixes

* Minor change

* My fixes were apparently wrong

* Debug - self.executable_path

* Debug - add singledispatch to tests and tools

* Debug - print IE_APP_PATHs

* Revert "Debug - print IE_APP_PATHs"

This reverts commit 67ccb6d3f5.

* Revert "Debug - add singledispatch to tests and tools"

This reverts commit 3b945931e2.

* Revert "Debug - self.executable_path"

This reverts commit 3aa724eff6.

* update dependabot

* update dependabot

* Skip benchmark_app tests

* Use CMAKE_CURRENT_BINARY_DIR in cmake

* Remove debug prints

* minor change

---------

Signed-off-by: p-wysocki <przemyslaw.wysocki@intel.com>
2023-03-29 14:27:27 +04:00
Ilya Churaev f3dcf93f96 Remove suppression Wno-delete-non-abstract-non-virtual-dtor (#16560)
* Remove suppression Wno-delete-non-abstract-non-virtual-dtor

* Fixed Allocator warning

* Suppress warning for GPU plugin

* Skip warning for GNA

* Fixed preprocessing

* Added virtual constructor for base plugin class

* Some fix for CPU

* Suppress for CPU

* Fixed any

* Fixed meta

* Disable warning for paddle

* Fixed Allocator tests

* Move suppress to paddle

* Fixed benchmark_app
2023-03-29 14:19:30 +04:00
Vladislav Golubev df3c06ecb4 [CPU] Ngram node fusion (#16131) 2023-03-29 13:58:41 +04:00
Mateusz TabakaandLuo Cheng 556d469f6b [PADDLE] add paddle opextension support (#16439)
* add opextension support

* support opconversion

* fix test contructor ambiguous

* fix ci fail

* add tag to avoid compiler ambiguous

* move tests to layer_tests & remove PaddleTag

* static cast

* use create_ov_node_by_name

---------

Co-authored-by: Luo Cheng <cheng.luo@intel.com>
2023-03-29 12:23:47 +04:00
Roman Kazantsev 35e03d33bb [TF FE] Support frozen models in text protobuf format aka pbtxt (#16604)
* [TF FE] Support frozen models in Text Protobuf format aka pbtxt

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>

* Fix gen_wrapper.py for pbtxt

* Fix is_supported method

* Fix gen_wrapper.py script

* Adopt test_text_frozen_format unit-test

* Update src/frontends/tensorflow/src/frontend.cpp

* Update src/frontends/tensorflow/src/frontend.cpp

---------

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
2023-03-29 11:58:08 +04:00
Mateusz Tabaka b82bedd648 Add Conversion and Op Extension to Pytorch frontend (#16434)
Tickets: 98766 and 98767
2023-03-29 00:25:29 +02:00
Vitaliy Urusovskij 40cc006bae Enable MapAllocator in IR Frontend (#12673)
* Enable MapAllocator in IR Frontend

* Fix `ov_infer_request_ppp` test

With `mmap()`ing of IR, .bin can't be deleted until unmapping.
And it shows that there was a leak in test

* Add comment to Win `CreateFile()` regarding
FILE_SHARE_DELETE

* Unmap .bin file before IR files deletion

Wait ov::Model deletion to trigger .bin file unmapping
before IR files deletion

* ClangFormat

* Add `use_map_allocator` switch in FE

In case of direct use of FE (e.g. via MO), `mmap()` is OFF.
But in case of use FE via Core, `mmap()` is ON.
2023-03-28 23:24:13 +04:00
Mateusz Bencer 4403433309 [ONNX FE] Implementation of ONNX STFT op (#16461) 2023-03-28 20:47:17 +02:00
Ekaterina Aidova 6fc0b6479e [PT FE]: revert usage mo.convert_model in pt layer tests (#16573)
* [PT FE]: revert usage mo.convert_model in tests

* fix failed test
2023-03-28 16:06:21 +04:00
Roman Kazantsev 5e9ea6a146 [TF FE] Refactor utils routine (#16554)
Move all openvino_conversion rountines into utils. Avoid using Squeeze without axis
that can create dynamic output rank

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
2023-03-27 11:10:00 +00:00
Piotr Krzemiński 6b70c449ba [PT FE] Add aten::Chunk implementation (#16035)
* [PT FE] Add chunk implementation:

* [PT FE] Fix chunk int64 instead of const node errors, add tests for chunking

* [PT FE] Test Chunk-If implementation

* [PT FE] Change the translate to replace chunk implementation, use VariadicSplit instead of Slice

* [PT FE] Reduce artifacts from debugging

* Update test_chunk.py

* [PT FE] Improve & debug chunk implementation:

* [PT FE] Simplify implementation, fix remaining bugs

* [PT FE] Statify the split lenghts output

* [PT FE] Clear code, remove debugging artifacts
2023-03-27 11:16:16 +02:00
Mateusz Mikolajczyk 7d16ee1835 [PT FE] Add torchvision::deform_conv2d translation (#16450)
* Initial commit

* Initial commit

* Cleanup

* Improve tests

* Make NodeContext const
2023-03-27 11:13:32 +02:00
Ilya Lavrenov 2638014d00 Enable build with system version of snappy (#16549)
* Enable build with system version of snappy

* Create Snappy::snappy alia
2023-03-27 10:01:11 +04:00
Ekaterina Aidova 1ef94ec069 [PT FE]: support aten::linalng_vector_norm (#16109)
* [PT FE]: support aten::linalng_vector_norm

* more norm ops

* update tests
2023-03-24 21:00:17 +01:00