Commit Graph
724 Commits
Author SHA1 Message Date
Vitaliy Urusovskij 78ef7e85c9 Return missed return pmc; (#20118) 2023-10-02 14:01:18 +04:00
Roman Kazantsev b409ea1930 [TF FE] Support TF1 While Control flow (#20105)
* [TF FE] Support TF1 While Control flow

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>

* Apply code-style fix

* Update API for OpPlace to store back edge

* Fix build: no rvalue by reference passing

* Fix build issue: correct type

* Fix TF FE unit-tests

* Apply code-review feedback: remove unused vars

* Fix fusing complicated case of TF1 While

* Remove unused variable

* Update MO unit test

* Fix layer tests for While

* Handle Switch and NextIteration nodes connected directly

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>

---------

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
2023-10-02 09:56:10 +04:00
Maxim VafinandAlina Kladieva f38b5f4f06 [PT FE] Support moving TupleConstruct inside If body (#20081)
* Support moving TupleConstruct inside If body

* Fix win build

---------

Co-authored-by: Alina Kladieva <alina.kladieva@intel.com>
2023-09-28 23:11:09 +02:00
Maxim Vafin 64cc3a96bb Restrict version of pytorch-quantization (#20137) 2023-09-28 23:11:41 +04:00
Mikhail RyzhovandIlya Lavrenov f85a276782 [GHA] Azure pip cache (#20029)
* switched PyTorch_Models

* fixed root issue

* upgrade pip

* set bash environments

* install pip deps

* added git installation

* added g++ deps

* added python-dev package

* get particular python-dev package

* fixed package name

* removed python-dev

* cython dep

* debug

* fixed inlude path

* test cache

* set home dir

* changed disk space calculation

* crosspipeline pip cache

* added tag for source builded deps

* immutable deps

* use commit id instead of tag

* Update .github/workflows/linux.yml

Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>

* fixed logs upload condition

* removed pip upgrade

* changed  detectotron version

* Update tests/model_hub_tests/torch_tests/requirements_secondary.txt

Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>

* changed wheel installation way

* reset onednn

* added cleanup workload

* cleanup test

* fixed reqs install

* test cache depending on pip version

* syntax fix

* env overwriting test

* test env output

* fixed set env step

* move pip cahc initialization to step

* changed pip ver regexp

* set custom pip cahce for each step

* cleanup code and enabled test cleanup job

* test cleanup 2

* speedup removal

* check existed dir

* Enabled cache for samples job

* removed debug job

* changed way how to get pip ver

* improved pip version extration

* revert omz

* switched PyTorch_Models

* fixed root issue

* upgrade pip

* set bash environments

* install pip deps

* added git installation

* added g++ deps

* added python-dev package

* get particular python-dev package

* fixed package name

* removed python-dev

* cython dep

* debug

* fixed inlude path

* test cache

* set home dir

* changed disk space calculation

* crosspipeline pip cache

* added tag for source builded deps

* immutable deps

* use commit id instead of tag

* Update .github/workflows/linux.yml

Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>

* fixed logs upload condition

* removed pip upgrade

* changed  detectotron version

* Update tests/model_hub_tests/torch_tests/requirements_secondary.txt

Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>

* changed wheel installation way

* added cleanup workload

* reset onednn

* cleanup test

* fixed reqs install

* test cache depending on pip version

* syntax fix

* env overwriting test

* test env output

* fixed set env step

* move pip cahc initialization to step

* changed pip ver regexp

* set custom pip cahce for each step

* cleanup code and enabled test cleanup job

* test cleanup 2

* speedup removal

* check existed dir

* Enabled cache for samples job

* removed debug job

* changed way how to get pip ver

* improved pip version extration

* revert omz

* review fixes

* remove  cache files using atime

* mtime->atime

---------

Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>
2023-09-28 22:21:32 +04:00
Maxim Vafin 84d98d8bf7 [PT FE] Add support for aten::pixel_shuffle (#20124)
* [PT FE] Add support for aten::pixel_shuffle

* Add comments

* Update src/frontends/pytorch/src/op/pixel_shuffle.cpp
2023-09-28 19:09:54 +02:00
Maxim Vafin fea6db1a5f [PT FE] Fix issue when cat input is folded to tensor (#20090)
* [PT FE] Fix issue when cat input is folded to tensor

* CHeck real first input

* Update src/frontends/pytorch/src/op/cat.cpp
2023-09-28 10:52:09 +02:00
Ilya LavrenovandOleg Pipikin 8349849e1c Use FindPython3.cmake (#19847)
* Use FindPython3.cmake

* Fixed compilation on macOS 14 with new core development tools

* Try to use Python3_SOABI instead of PYTHON_MODULE_EXTENSION

* Use Development.Module

* Keep specifying only Python3_EXECUTABLE

* Print PYTHON_MODULE_EXTENSION

* Added check for minimal cmake version for python API

* Returned Python3_INCLUDE_DIR for cross-compilation case

* Try to allow cmake older than 3.18

* Use build python interpreter to check cython dependency

* revert changes in .ci/openvino-onnx/Dockerfile

* removed unused code

* Fixed issue with variables scope

* Experiment: remove include dirs

* Corrected docs

* Use pybind11 function to set extension

* Revert "Experiment: remove include dirs"

This reverts commit 6f7f90211c.

* Refactor ConvolutionBackpropDataLayerTest, ConvolutionLayerTest, DeformableConvolutionLayerTest (#19810)

* Refactor ConvolutionBackpropDataLayerTest

* Refactor ConvolutionLayerTest

* Refactor DeformableConvolutionLayerTest

* Apply comments

* Apply comments

* Fix

* Updated minimum cmake version for Windows

* Simplified check

* Removed useless message status

* Use puiblic option

---------

Co-authored-by: Oleg Pipikin <oleg.pipikin@intel.com>
2023-09-26 20:57:29 +02:00
Anastasiia Pnevskaia 2bbfe7b44d Added support of shapes and types from original FW in ov.convert_model() (#20009)
* Added support of shapes and types from paddle, torch and tf.

* Removed changes from requirements.

* Corrected test.

* Moved helper methods to utils.

* Separated tests by frameworks.

* Removed changes from complex_params test.
2023-09-26 17:41:01 +04:00
Ilya Lavrenov 85145cd60c Refactored Linix GHA pipeline (#20021)
* Refactored Linix GHA pipeline

* Move ONNX tests to Unit

* Install tests together with openvino

* Added checks for GNA usage in docs python snippets

* Install openssl for working pip

* Disabled onnx_dyn_shapes_expand_1_dyn_shape ONNX test

* exclude dyn shapes from onnx

* Migrated samples tests

* Fixed ONNX tests

* caches for PT tests dependencies

* Build Contrib separately from main OpenVINO

* More fixes

* Added python install for samples stage

* Installed manifests for ONNX FE tests

* Try to avoid libgl1 dependency in tests

* Clean-up

* Fixed issue with manifests in ONNX tests
2023-09-25 17:00:30 +04:00
Maxim Vafin f735999e7b Improve testing for hf models (#20017) 2023-09-22 20:10:33 +00:00
Ekaterina Aidova c76475288b [PT FE]: support aten::scatter_reduce and extend aten::scatter (#19980)
* [PT FE]: support aten::scatter_reduce and extend aten::scatter out arg support

* create mapping inside function
2023-09-22 15:05:33 +04:00
Pavel Esir 9271b79540 [OVC] do not parse inputs for py_api (#19742)
* [OVC] do not parse inputs

* fix unit-tests

* remove redundant lines, add test case

* add one more unit-test

* skip None values

* replace str with List in test_mo_import_from_memory

* corrected type hints, added a safety assert
2023-09-22 15:05:21 +04:00
Ekaterina Aidova 26d18c924b [PT FE]: support aten::broadcast_tensors (#19994)
* broadcast tensors

* [PT FE]: support aten::broadcast_tensors

* apply review comments

* remove add
2023-09-22 13:54:44 +04:00
Maxim Vafin 2151e5f979 [PT FE] Add tests for timm models (#19997)
* Add tests for timm models

* Apply suggestions from code review

* Some improvements

* Update tests/model_hub_tests/torch_tests/test_transformers.py
2023-09-22 10:34:07 +02:00
Ekaterina Aidova 8d59fcd34f [PT FE]: extend logical operations support (#19981)
* [PT FE]: extend logical operations support

* tests

* more tests
2023-09-22 10:11:36 +04:00
Ekaterina Aidova fde054e4a6 [PT FE]: support aten::minimum aten::maximum (#19996) 2023-09-22 09:30:57 +04:00
Maxim Vafin 058b45e608 [PT FE] Fix aten::repeat regression (#19991)
* Revert "[PT FE] Simplify repeat operation (#19926)"

This reverts commit f926e0e392.

* Fix aten::repeats regression

* Simplify

* Update src/frontends/pytorch/src/op_table.cpp

* Add impacted model
2023-09-21 23:58:09 +02:00
Maxim Vafin 02f5b7a7e3 [PT FE] Add huggingface hub tests (#19858)
* [PT FE] Add huggingface hub tests

* Update requirements.txt

* natten can't be installed

* Remove librosa

* Add xfail and skip marks

* Remove t5

* Free up space

* Apply suggestions from code review

* Report free space

* Clean pip cache

* Temporarily disable det2 models

* More du info

* Remove tmp info

* More du stats

* Fix du report

* Optimize du

* Ignore error

* Finalize changes

* Update tests/model_hub_tests/torch_tests/test_transformers.py
2023-09-21 17:30:17 +02:00
Vitaliy Urusovskij b00fbd04c5 Fix StressMemLeaksTests with several models (#19986)
* Fix `StressMemLeaksTests` with several models

* Fix OMZ branch name in `get_testdata.py`
2023-09-21 15:59:18 +02:00
Maxim Vafin 37d54bcb42 [PT FE] Support prim::TupleIndex operation (#19978)
* [PT FE] Support prim::TupleIndex

* Update src/frontends/pytorch/src/op/tuple_index.cpp

* Update src/frontends/pytorch/src/op/tuple_index.cpp
2023-09-21 15:57:42 +02:00
Ekaterina Aidova 2c88fbf798 [PT FE]: support mixed precision in aten::min/max (#19936)
* [PT FE]: support mixed precision in aten::min/max

* fix eltwise dtype alignment for float16
2023-09-20 11:26:18 +04:00
Anastasiia Pnevskaia 215a2f435b tf.Graph decoder accuracy fixes (#19903)
* Fixed outputs passing from decoder.

* Fixed get_variable method.

* Code style.

* Removed xfails from precommit models.

* Minor fix.

* Comment fixed.

* Added test.
2023-09-19 19:04:24 +02:00
dependabot[bot] 472ad39a9d Update numpy requirement from <1.26,>=1.16.6 to >=1.16.6,<1.27 in /tests (#19938)
Updates the requirements on [numpy](https://github.com/numpy/numpy) to permit the latest version.
- [Release notes](https://github.com/numpy/numpy/releases)
- [Changelog](https://github.com/numpy/numpy/blob/main/doc/RELEASE_WALKTHROUGH.rst)
- [Commits](https://github.com/numpy/numpy/compare/v1.16.6...v1.26.0)

---
updated-dependencies:
- dependency-name: numpy
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-09-19 18:18:42 +04:00
Roman Kazantsev a139fb48b7 [TF FE][JAX] Add upper bound for jax dependencies (#19943)
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
2023-09-19 14:00:54 +04:00
Vitaliy Urusovskij 6b5a22a656 Add bert-base-ner in MemLeak tests (#19817)
* Add `bert-base-ner` in MemLeak tests

* Fix segfault caused by `fillTensorRandom()`
2023-09-19 11:27:23 +04:00
Roman Kazantsev 6556d07c32 [TF FE][Tests] Fix sporadic failure in CTCLoss test (#19920) 2023-09-18 20:25:44 +00:00
Maxim Vafin c10b45fe9e [PT FE] Fix issue with http error when using torch.hub (#19901)
* [PT FE] Fix issue with http error when using torch.hub

* Mark failing models as xfail

* Remove incorrect model names
2023-09-18 17:04:39 +02:00
Roman Kazantsev d90ceb93d1 [TF Hub][TF FE] Fix 5D case for FusedBatchNorm (#19904)
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
2023-09-18 12:51:33 +00:00
Roman Kazantsev df19699e3a [TF Hub API][TF FE] Support TF Keras Model OOB without example_input (#19892)
* [TF Hub] Cover TF Hub use cases with adoption to OpenVINO

This is necessarily to demonstrate support of models programmed with TF Hub API
through OV notebooks.

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>

* Preserve original keras input and output tensor names

* Add tests with TF Hub API models

* No KerasLayer handling

* Handle specific signature

---------

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
2023-09-18 12:18:05 +00:00
Maxim VafinandRoman Kazantsev a4cbac3dee [PT FE] Add tests for detectron2 models (#19888)
* [PT FE] Add tests for detectron2 models

* Fix names of tests

* Apply suggestions from code review

Co-authored-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Create secondary requirements file

---------

Co-authored-by: Roman Kazantsev <roman.kazantsev@intel.com>
2023-09-18 13:40:40 +02:00
Ilya Lavrenov ba67db66ae Properly enable CMAKE_COMPILE_WARNING_AS_ERROR (#19828)
* Properly enable CMAKE_COMPILE_WARNING_AS_ERROR_DEFAULT

* Properly enable CMAKE_COMPILE_WARNING_AS_ERROR
2023-09-15 01:20:00 +04:00
Anastasiia Pnevskaia 18f29c02d2 Fixed scalar creating in tf.Graph decoder (#19735)
* Fixed scalar logic in tf.Graph decoder.

* Passed memory sharing flag to all Tensor constructors.

* Small correction.

* Test correction.
2023-09-14 23:36:22 +04:00
Przemyslaw Wysocki b1b3343ffc [PyOV] Bump scipy to a secure version and bump OMZ (#19458)
* Bump omz and scipy

* Separate versions per python version

* Change scipy in pot
2023-09-14 13:41:27 +02:00
Maxim Vafin 1a950f9e8d [PT FE] Torchvision NMS can accept negative scores (#19826) 2023-09-14 11:07:24 +02:00
Maxim Vafin 4f92676c85 [PT FE] Support aten::one_hot (#19779)
* [PT FE] Support aten::one_hot

* Apply code style
2023-09-13 20:37:47 +02:00
Maxim Vafin 3c762240f3 [PT FE] Add tests for torchvision models (#19702)
* [PT FE] Add tests for torchvision models

* Update tests/model_hub_tests/torch_tests/requirements.txt

* Apply review comments

* Clean tmp directory and make this separate job

* Update .github/workflows/linux.yml

* Update tests/model_hub_tests/torch_tests/test_torchvision_models.py
2023-09-13 15:24:09 +04:00
Roman Kazantsev d1a8c8f914 [TF Hub] Set seed for input data generation and fix integer input data (#19765)
* [TF Hub] Set seed for input data generation and fix integer input data

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>

* Clean-up workflow

* Update precommit model scope

* Avoid legacy generator

---------

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
2023-09-13 00:30:39 +04:00
Maxim Vafin a6bc78dd0f [PT FE] Separate tracing and scripting modes (#19676)
* [PT FE] Separate scripting and tracing in decoder

* Fix convert_model to accept decoder

* Some fixes

* Fix code style

* Fix preprocessor tests

* Fix tests

* Fix tests

* Fix more tests

* Fix ovc tests
2023-09-12 12:40:20 +04:00
Roman Kazantsev 530da61a4e [TF Hub] Fix compute output size issue in test (#19719)
It helps to get 4 new models passed and other 2 models failed with accuracy issue.

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
2023-09-11 12:14:09 +04:00
Roman Kazantsev 37f61551a3 [TF FE][TF Hub] Use ConcreteFunc input and output signatures (#19690)
* [TF Hub][TF FE] Preserve outputs of ConcreteFunction from signature and their names

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>

* Fix naming and complete TODO

* Apply code-review: extra assert to check input_signature

* Fix inputs for fw

* Fix input data preparation and import convert_model

* Correct variable detection among all inputs

* Handle special input and output signature

* Fix adjust_saved_model_names

---------

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
2023-09-10 03:46:01 +00:00
Maxim VafinandPiotr Krzemiński e83697ded4 [PT FE] Implement override_all_inputs, override_all_outputs (#19642)
* Implement override_all_inputs, override_all_outputs

* Apply suggestions from code review

Co-authored-by: Piotr Krzemiński <piotrkrzeminski1234@gmail.com>

* Update src/frontends/pytorch/src/input_model.cpp

* Update src/frontends/pytorch/src/input_model.cpp

* Resolve problem with self input

* Update place.cpp

* Update place.cpp

* Fix build

---------

Co-authored-by: Piotr Krzemiński <piotrkrzeminski1234@gmail.com>
2023-09-08 22:31:49 +02:00
Roman KazantsevandAndrey Kashchikhin 63a6d4c41e [TF Hub][GA] Set correct scheduler and model scope for regular validation (#19658)
* [TF Hub][GA] Set correct scheduler and model scope for regular validation

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>

* Remove empty line

* Update .github/workflows/linux.yml

Co-authored-by: Andrey Kashchikhin <andrey.kashchikhin@intel.com>

* Correct a path to output html report

---------

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
Co-authored-by: Andrey Kashchikhin <andrey.kashchikhin@intel.com>
2023-09-06 22:51:31 +02:00
Maxim Vafin bacb83f8a2 Support aten::tile op (#19645) 2023-09-06 17:28:22 +00:00
Roman Kazantsev 4f7ac430fc [TF Hub][TF FE][GA] Establish regular validation for all TF Hub models (#19649)
* [TF Hub][TF FE] Establish regular validation for all TF Hub models

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>

* Correct names of reports

* Simplify configuration

---------

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
2023-09-06 17:02:59 +02:00
Roman Kazantsev 023a2f462a [TF Hub][Notebook] Secure future notebook models in the precommit (#19652)
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
2023-09-06 18:43:30 +04:00
Roman Kazantsev 188d53d813 [TF Hub][TF FE] Clean-up all downloaded files for TF Hub models validation (#19612)
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
2023-09-05 13:07:13 +00:00
Roman Kazantsev 4eadef9e61 [TF Hub][TF FE] Make TF Hub validation more robust and add convenient xfail test marking (#19596)
* [TF Hub][TF FE] Use multiprocessing based tests for TF Hub validation

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>

* Fix import and initialization

* [TF Hub][TF FE] Make TF Hub validation more robust and add convenient marking for failing cases

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>

---------

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
2023-09-05 09:41:01 +04:00
Mateusz Mikolajczyk c46f6bf115 [PT FE] Add aten::swapaxes (#19483)
* Add aten::swapaxes

* Add comment

* Improve swapaxes tests
2023-09-04 13:04:28 +02:00
Ekaterina AidovaandPiotr Krzemiński 90ef7096b9 [PT FE]: support PReLU (#19515)
* [PT FE]: support PReLU

* Update tests/layer_tests/pytorch_tests/test_prelu.py

* Apply suggestions from code review

Co-authored-by: Piotr Krzemiński <piotrkrzeminski1234@gmail.com>

---------

Co-authored-by: Piotr Krzemiński <piotrkrzeminski1234@gmail.com>
2023-09-04 07:36:42 +00:00