Commit Graph
825 Commits
Author SHA1 Message Date
Vitaliy UrusovskijandIlya Lavrenov e4c38e3afd Port tests/ to API2.0 (#21476)
* Port properties in time and stress tests to API2.0

* Port CC tests infer_tool.py to API2.0

* Update tests/conditional_compilation/tools/infer_tool.py

Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>

---------

Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>
2023-12-06 14:36:43 +04:00
Andrey Kashchikhin 62f5bd6570 [CI] [GHA] Introduce the Linux ARM64 workflow (#20809)
* add arm as a matrix for build job

* uncomment

* comment

* try inside pipeline

* check location

* another dirs

* try to privide correct action path

* use corrected action

* use newer commit

* use newer commit

* use newer commit

* use newer action commit

* add setting

* rm from pipeline, adapt action iteslf

* add missing deps

* enable samples and debian jobs

* correct yml

* correct image name

* correct syntax, use self-hosted option

* enable onnx runtime and c++, use newer action

* enable Python and CPU Func tests

* add missing deps for arm64

* increase timeout for python tests

* disable some tests, add more time

* skip failing tests

* skip speech sample test on arm

* dummy chang

* skip mxnet mo on arm, run all tests

* rm quotes

* separate linux x86 and arm64 workflows

* rm unused matrix refs, add timeouts

* add skips for c++ tests and some Python tests

* correct cache keys, extend timeout

* skip more python tests

* add more skips: for python and CPU func

* extend cpu func list with skips

* disable cpu func tests and python api 2.0 tests

* rm disable job

* styling, rm pr trigger, rm always(), rm unnecessary changes

* revert

* use ifs instead of comments, provide better wording for skips
2023-12-05 12:14:02 +04:00
Roman Kazantsev f9d20d5aa0 [TF FE] Support different types: tf.i8, u8, i16, u16, i32, u32, i64, u64, f16, f32, bf16 (#21439)
* [TF FE] Support different types: u16, u64, u32, boolean

Support constants of different types and dtype attribute values

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>

* Use map instead of unordered_map

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>

* Add tests with different types

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>

---------

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
2023-12-05 11:08:46 +04:00
8427493446 [PyOV] Limit protobuf version for conditional compilation tests (#21130)
* Initial commit

* Add protobuf version bound

* Revert "Initial commit"

This reverts commit 5fd6b521df.

* Cleanup of accidental commits

* Cleanup of accidental commits

---------

Co-authored-by: Anastasia Kuporosova <anastasia.kuporosova@intel.com>
Co-authored-by: Michal Lukaszewski <michal.lukaszewski@intel.com>
2023-12-01 16:13:12 +00:00
Ekaterina Aidova bf760b663e PT FE - aten::alias, aten::alias_copy, aten::cross, aten::linalg_cross (#21265)
* [PT FE]: support aten::alias, aten::alias_copy, aten::cross, aten::linalg_cross

* add type alignment

* fix code style
2023-12-01 14:59:03 +01:00
Ekaterina Aidova d1f72e2d01 add gptq model test in pytorch hub tests (#21399)
* conflict

* refactor test

* fix for case if can not instantiate config
2023-12-01 10:56:05 +00:00
Maxim Vafin db6aeb7a65 [PT FE] Add torchbenchmark models to GHA tests (#21401)
* [PT FE] Add torchbenchmark models to GHA tests

* Fix teardown

* Fix requirements

* Update tests/model_hub_tests/torch_tests/torchbench_models

* Update tests/model_hub_tests/torch_tests/torchbench_models

* Update tests/model_hub_tests/torch_tests/test_torchbench.py
2023-12-01 09:44:12 +01:00
Roman Kazantsev c1cfb00f81 [TF Hub] Fix typo in test file name (#21408)
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
2023-11-30 23:49:01 +00:00
Maxim Vafin fa7a4f44b5 [PT FE] Update torch to 2.1 in GHA tests (#21391)
* [PT FE] Update torch to 2.1 in GHA tests

* Adjust requirements for natten

* Add upper bound

* Use sys.executable
2023-11-30 17:48:40 +00:00
Pavel EsirandMaxim Vafin d5d9fd11b3 [tests] resolve skipped HF tests: 1st batch (#21305)
* initial

* some corrections for the first batch

* corrected classes for generate, corrected xfail

* leave only models with correct example input

* remove an obsolete line

* Update tests/model_hub_tests/torch_tests/test_hf_transformers.py

Co-authored-by: Maxim Vafin <maxim.vafin@intel.com>

* update musicgen

* cleanup test_hf_transformers.py

* typo fix

* Update tests/model_hub_tests/torch_tests/test_hf_transformers.py

* Update tests/model_hub_tests/torch_tests/test_hf_transformers.py

* move to up: corrected xfail

* revert back accidentally deleted elif

* Update tests/model_hub_tests/torch_tests/test_hf_transformers.py

* Update tests/model_hub_tests/torch_tests/test_hf_transformers.py

---------

Co-authored-by: Maxim Vafin <maxim.vafin@intel.com>
2023-11-30 14:37:41 +00:00
Maxim Vafin 3cae6e7aea [PT FE] Fix timm model list according to newest version (#21376)
* [PT FE] Fix timm model list according to newest version

* Remove xfail for hf model passed in latest nightly

* Fix code for loading vit_h model

* Restore torchvision
2023-11-30 08:17:21 +04:00
Maxim Vafin 007b6fd82c [PT FE] Add support for GFPGAN model (#21371)
* [PT FE] Add support for GFPGAN model

* Remove logs

* Fix codestyle

* Add support for aten::normal
2023-11-29 23:05:46 +00:00
Roman Kazantsev cb5377fb1d [TF FE] Correct ArgMinMax translators and add tests (#21364)
* [TF FE] Correct ArgMinMax translators and add tests

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>

* Update tests/layer_tests/tensorflow_tests/test_tf_ArgMinMax.py

---------

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
2023-11-30 00:00:43 +04:00
Maxim Vafin b3a13af9ef [PT FE] Support aten::softplus (#21367)
* [PT FE] Support aten::softplus

* Fix name
2023-11-29 14:38:31 +00:00
Ekaterina Aidova 2b14ea97fc [PT FE]: support aten:resolve_neg, aten::resolve_conj (#21362)
* [PT FE]: support aten:resolve_neg, aten::resolve_conj

* Update src/frontends/pytorch/src/op_table.cpp
2023-11-29 10:34:46 +00:00
Maxim Vafin 258c72555c [PT FE] Support bool in aten::prod (#21351) 2023-11-29 11:07:21 +01:00
Maxim Vafin f3fe6b3f00 [PT FE] Add EDSR models to GHA tests (#21350)
* [PT FE] Add EDSR models to GHA tests

* Apply suggestions from code review
2023-11-28 21:05:33 +00:00
Roman Kazantsev 7c590bf180 [Hub Tests] Apply Python code formatting (#21286)
* Apply Python code formatting

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>

* Apply Python code formatting

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>

---------

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
2023-11-28 16:54:02 +04:00
Maxim Vafin e52f922d35 [PT FE] Unify hub tests, add marks for timm models (#21283)
* Unify hub tests, add marks for timm models

* Fix hf tests
2023-11-27 12:22:13 +04:00
Ekaterina AidovaandMaxim Vafin eaae00c2ca [PT FE]: support aten::empty_like (#21258)
* [PT FE]: support aten::empty_like

* Update src/frontends/pytorch/src/op/full.cpp

Co-authored-by: Maxim Vafin <maxim.vafin@intel.com>

---------

Co-authored-by: Maxim Vafin <maxim.vafin@intel.com>
2023-11-27 07:15:19 +00:00
Ekaterina Aidova a5d53aeaef [PT FE]: fix for aten::index_put_ if values.r > indices.r (#21255)
* [PT FE]: fix for aten::index_put_ if values.r > indicies.r

* add more complex test case
2023-11-27 07:01:16 +00:00
Luo Cheng 91660b1c05 [CPU] Fix ScaledDotProductAttension accuracy problem (#21217) 2023-11-26 14:47:04 +04:00
965313ba0b [TF Hub][Perf Tests]Implement performance tests in precommit to compare read_model and convert_model paths (#21023)
* begin

* fixes

* measure time and compare

* fix bug + update precommint models

* cleanup

* add wget to install requirements; add to linux.yml

* fixes + improvements

* output results to html

* remove unneeded code

* fix

* code review fixes

* store downloaded models in cache

* use 1000 runs

* use model paths from tf-hub tests

* use tf hub api to download instead of wget; measure some time stats

* small fixes

* remove unneeded files

* use own list of models

* remove uneeded if

* remove unstable models

* remove unstable models

* fix requirements

* code review fixes

* Update .github/workflows/linux.yml

Co-authored-by: Roman Kazantsev <roman.kazantsev@intel.com>

* fix round_num function

* remove unstable network

* Update tests/model_hub_tests/models_hub_common/test_performance_model.py

Co-authored-by: Roman Kazantsev <roman.kazantsev@intel.com>

* code review fixes

* build fix

* code review fixes

* code review fixes

* code review fixes

* Update tests/model_hub_tests/models_hub_common/test_performance_model.py

Co-authored-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Update tests/model_hub_tests/performance_tests/test_tf_hub_perfomance_model.py

Co-authored-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Update tests/model_hub_tests/performance_tests/test_tf_hub_perfomance_model.py

Co-authored-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Update tests/model_hub_tests/models_hub_common/test_performance_model.py

Co-authored-by: Roman Kazantsev <roman.kazantsev@intel.com>

* code review fixes: use autoflake

* remove unneeded tensorflow_text

* Update .github/workflows/linux.yml

* Update linux.yml

Added TensorFlow_Hub_Performance_Models_Tests to final status check

---------

Co-authored-by: Roman Kazantsev <roman.kazantsev@intel.com>
Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>
2023-11-24 18:13:44 +04:00
Maxim Vafin 0e08ba1edc [PT FE] Support aten::prod and aten::fmod (#21243) 2023-11-23 11:26:08 +01:00
Anastasiia Pnevskaia 823d327476 Fixed verbose param. (#21234) 2023-11-22 17:32:20 +04:00
Maxim Vafin 1a288f0e9a [PT FE] Recognize empty non-frozen lists (#21224)
* [PT FE] Recognize empty non-frozen lists

* Do not produce alias for aten::clone
2023-11-22 11:58:53 +01:00
Maxim VafinandRoman Kazantsev 570817998d Update reverse infer to allow changing shape if it already partially defined (#21073)
* Update reverse infer to allow changing shape if it already partially defined

* Update tests

* Remove changes in If

---------

Co-authored-by: Roman Kazantsev <roman.kazantsev@intel.com>
2023-11-20 21:57:43 +00:00
Roman Kazantsev bb773137f1 [TF Hub] Move all nightly scope to Kaggle links (#21169)
7 models are skipped since they are not moved there. Now they are not available.

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
2023-11-20 13:33:21 +04:00
Przemyslaw Wysocki bd5bd56d29 Remove failing mxnet test (#21151) 2023-11-20 10:17:22 +01:00
Maxim Vafin 276153d1ce [PT FE] Support aten::_weight_norm and aten::full with scalar size (#21160)
* Support aten::_weight_norm and aten::full with scalar size

* Add op_table changes

* Add comments
2023-11-17 19:13:15 +00:00
Maxim Vafin b2e14f9fad [PT FE] Fix pad value dtype for pooling (#21139)
* [PT FE] Fix pad value dtype for pooling

* Apply suggestions from code review

* Apply suggestions from code review
2023-11-17 16:09:56 +01:00
Maxim Vafin 6bdc1597ed [PT FE] Align types for aten::clamp_max and aten::clamp_min (#21137)
* Align types for aten::clamp_max and aten::clamp_min

* Add tests
2023-11-17 10:26:44 +01:00
Roman Kazantsev 2928b6bfed [TF Hub] Move pre-commit to Kaggle model links (#21113)
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
2023-11-16 14:24:45 +04:00
Anastasiia Pnevskaia d304be0bd7 [OVC] Fixed error in --output_model param. (#20969)
* Fixed error in get_model_name_from_args(), added tests.

* Corrected output_model description.

* Corrected test.
2023-11-15 17:42:14 +04:00
Maxim Vafin 369831caef [PT FE] Use system model cache when running torch hub tests locally (#21047)
* Use system model cache when running torch hub tests locally

* Update tests/model_hub_tests/torch_tests/test_torchvision_models.py

* Update tests/model_hub_tests/torch_tests/test_torchvision_models.py
2023-11-14 11:43:06 +01:00
dependabot[bot] fd403e552a Bump pytest-html from 3.2.0 to 4.1.1 in /tests (#20949)
Bumps [pytest-html](https://github.com/pytest-dev/pytest-html) from 3.2.0 to 4.1.1.
- [Release notes](https://github.com/pytest-dev/pytest-html/releases)
- [Changelog](https://github.com/pytest-dev/pytest-html/blob/master/docs/changelog.rst)
- [Commits](https://github.com/pytest-dev/pytest-html/compare/v3.2.0...4.1.1)

---
updated-dependencies:
- dependency-name: pytest-html
  dependency-type: direct:production
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-11-13 17:43:35 +04:00
Roman Kazantsev 75c72157dd [TF Hub] Add yamnet with complex tensors into precommit (#21035)
After fixing ov.Tensor creation for empty numpy array, we are ready to support yamnet

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
2023-11-13 17:42:13 +04:00
Anastasiia Pnevskaia 5fa53aa715 Input and output order Keras tests. (#20902)
* Input/output order Keras tests.

* Added precommit mark.

* Added xfail.

* Small correction.

* Check input/outputs by names in FW.

* Moved output order tests to Python API group.

* Corrected comments.
2023-11-13 14:01:35 +04:00
Roman Kazantsev b64d6be8ba [TF FE] Fix TF1 OD SSD PPN model conversion (#20994)
* [TF FE] Fix TF1 SSD PPN model conversion

It contains a case when one Merge node eliminated different conditional flows.

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>

* Add layer test

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>

---------

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
2023-11-10 11:44:28 +00:00
854158612f Scaled dot product attention (#20492)
* Added experimental ScaledDotProductAttention operation in opset12. Supported in PT FE for aten::scaled_dot_product_attention translation. Decomposed in the common optimizations as functional reference.

* Better ScaledDotProductAttention

- Moved decomposition to the decomposing transformation
- Implemented more ctors for the op
- Renamed is_causal to causal
- Shape/type inference native code instead of using decomposition
- Moved the op from opset12 to opset13
- Added Python wrapper for ScaledDotProductAttention

* Fix test that counts ops in the opsets

* Update src/core/src/op/scaled_dot_product_attention.cpp

Co-authored-by: Katarzyna Mitrus <katarzyna.mitrus@intel.com>

* Update src/core/src/op/scaled_dot_product_attention.cpp

Co-authored-by: Katarzyna Mitrus <katarzyna.mitrus@intel.com>

* Move ScaledDotProductAttentionDecomposition from fusions to decompositions.

* Remove not used legacy shape inference in ScaledDotProductAttention

* Better namespace usage

* Register all nodes in ScaledDotProductDecomposition for correct tracking of nodes and running next mather passes on all new nodes.

* Don't use register_new_node_

* ScaledDotProductAttention specification (with an extra scale argument)

* Code style fix

* Scale input implementation for ScaledDotProductAttention

* Handle attention_mask=0 case in the op spec

* Better description of scale input

* N->M in scale description

* Code style fix, remove debug print.

* Apply suggestions from code review

Co-authored-by: Katarzyna Mitrus <katarzyna.mitrus@intel.com>
Co-authored-by: Mateusz Mikolajczyk <mateusz.mikolajczyk@intel.com>

* Fix for case when is_causal is not passed

* Extended description of ScaledDotProduct op

* Better description in py op wrapper

* Basic shape propagation tests for ScaledDotProductAttention

* Added ScaledDotProductAttention to toc.

* Add op impl check

---------

Co-authored-by: Katarzyna Mitrus <katarzyna.mitrus@intel.com>
Co-authored-by: Mateusz Mikolajczyk <mateusz.mikolajczyk@intel.com>
2023-11-08 20:17:13 +01:00
Roman Kazantsev c6ca7865fb [TF FE] Fix conversion of TF1 OD models out-of-the-box (#20916)
* [TF FE] Fix conversion of TF1 OD models out-of-the-box

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>

* Add test While with nested If operation

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>

* Update tests/layer_tests/tensorflow_tests/test_tf_While.py

---------

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
2023-11-07 17:44:09 +00:00
Maxim Vafin cdd342ea49 [PT FE] Add ALIKED to model tests (#20899)
* Add ALIKED to model tests

* Update tests/model_hub_tests/torch_tests/test_aliked.py

* Update tests/model_hub_tests/torch_tests/test_aliked.py
2023-11-07 09:34:26 +01:00
Maxim Vafin e976e7b90c [PT FE] Add tests for Speech-Transformer (#20847)
* Add tests for Speech-Transformer

* Update tests/model_hub_tests/torch_tests/test_speech-transformer.py

* Update tests/model_hub_tests/torch_tests/test_speech-transformer.py
2023-11-07 08:32:22 +01:00
Roman Kazantsev 494a9cf9a9 [TF FE] Refine tests for complex tensors support (#20905)
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
2023-11-07 10:29:45 +04:00
Roman Kazantsev d0eb27bd3b [TF FE] Support Complex Tensors (#20860)
* [TF FE] Support complex tensors

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>

* Align output type for Real and Imag operations

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>

* Update decoding complex types

* Add support for ComplexAbs, FFT and IFFT operations

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>

* Correct axes based on a number of inner-most dimensions

* Add layer tests

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>

* Update supported ops documentation

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>

* Add a comment for ComplexTypeMark

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>

---------

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
2023-11-06 16:57:05 +04:00
Anastasiia Pnevskaia cc389c23ca Removed logic of building example_input by shape. (#20859) 2023-11-03 20:45:34 +04:00
Roman Kazantsev 4a6e6e64c5 [TF FE] Fix conversion of FILM of keras.Model format (#20825)
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
2023-11-02 12:46:57 +04:00
Andrey Kashchikhin eea49f3c9e [CI] [GHA] Remove full cloning of the OV repository in the Python unittests job in the Win and Mac workflows (#20810)
* rm full cloning of the OV repo in win and mac workflows

* skip tests on mac

* increase timeout for win C++ tests; skip more mac tests

* rm triggers
2023-11-01 22:20:22 +04:00
Roman Kazantsev 26c9c41b8e Revert "[TF FE] Switch off TF1 While support totally (#20774)" (#20800)
This reverts commit 38b6092120.
2023-10-31 22:53:35 +04:00
Roman Kazantsev 38b6092120 [TF FE] Switch off TF1 While support totally (#20774)
* [TF FE] Switch off TF1 While support totally

This is a total switch off due to GPU limitation

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>

* Need additional fallback in Enter to avoid shapes problem

* Disable tests with While op

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>

* Disable layer test for TF1 While

* Remove extra spaces

---------

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
2023-10-31 12:46:36 +04:00