Commit Graph
13725 Commits
Author SHA1 Message Date
Sergey Shlyapnikov 032ac898e2 [GPU] Apply is_non_decompression_multiply() callback only for compressed models (#21719) 2023-12-18 12:20:20 +00:00
Mateusz MikolajczykandAnastasia Kuporosova 98e8caad79 [PyAPI][Opset13] ScaledDotProductAttention-13 PyAPI improvements + tests (#21422)
* Improve ScaledDotProductAttention PyAPI

* Add tmp tests

* Improve PyAPI & add tests

* Fix test issue

* Fix pytest type

* Update src/bindings/python/tests/test_graph/test_scaled_dot_product_attention.py

Co-authored-by: Anastasia Kuporosova <anastasia.kuporosova@intel.com>

* Improve const creation

---------

Co-authored-by: Anastasia Kuporosova <anastasia.kuporosova@intel.com>
2023-12-18 12:35:14 +01:00
Piotr Krzemiński 8ff25cf4a2 [SPEC] Update ScaledDotProductAttention specification for broadcasting of batch dimensions (#21714)
* [SPEC] Update spec for broadcasting of batch dimensions, improve clarity

* [SPEC] Update code block style, comments in xml, attention_mask details
2023-12-18 12:19:06 +01:00
Pawel Raasz a6f3c7d1b2 Us dynamic dim in pattern if only one valid bound (#21694) 2023-12-18 15:02:01 +04:00
Mateusz MikolajczykandRoman Kazantsev a1e296eaa8 [TF FE][Opset13] Enable Multinomial operator in TF frontend (#20646)
* Enable Multinomial operator in TF frontend

* Implement requested changes

* Update tests/layer_tests/tensorflow_tests/test_tf_Multinomial.py

Co-authored-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Align with CPU implementation

---------

Co-authored-by: Roman Kazantsev <roman.kazantsev@intel.com>
2023-12-18 12:00:04 +01:00
Tomasz Jankowski a29843013d [Ref] Fix ScatterElementsUpdate lowest value bounding (#21669)
* Use lowest for value bounding

* Add test for lowest on float
2023-12-18 11:57:01 +01:00
Nikolay Shchegolev 554e7d6730 [CPU] Dynamically shaped model with string tensor output fails (#21713) 2023-12-18 14:44:36 +04:00
Mateusz Mikolajczyk be476519fb [PT FE] ScaledDotProductAttention fix issue with other float dtypes (#21638)
* Fix scale input

* Improve torch scaled dot tests
2023-12-18 14:32:54 +04:00
Ivan TikhonovandIlya Lavrenov e224e4f4f0 Introduce OriginalPrecision attribute (#21696)
* Introduce OriginalPrecision attribute

* resolve review comments

---------

Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>
2023-12-18 14:10:46 +04:00
Georgy Krivoruchko 62c9469f52 [ONNX] Reflected Shell-scripts to run on Windows (#18672)
* Reflected Shell-scripts to run on Windows

* Fixes

* Removed script from tests_compatibility
2023-12-18 13:51:20 +04:00
Eddy Kim 35dafce513 [GPU] move convert after gather to reduce memory usage (#21616) 2023-12-18 13:34:46 +04:00
Mateusz MikolajczykandMichal Lukaszewski 610e0fab5c [Opset13] ScaledDotProductAttention-13 input validation improvements (#21281)
* Improve test naming to match op

* Initial draft for scaleddot shape infer

* Fix formatting

* Improve shape & type infer

* Add shape tests

* Fix issues in shape infer

* Fix type infer

* Improve type_prop tests

* Ignore attention when causal

* Fix template type shape infer

* Fix issues with scalar inputs + test improvement

* Fix `get_node_input_partial_shapes`

* Improve shape/type validation and tests

* Allow for broadcastable inputs

* Improve tests

* Add CPU shape infer test

* Add broadcast shape infer test

* Use const

* Use const &

* Improve query input handling

* Fix test issues

* Change broadcast rules

---------

Co-authored-by: Michal Lukaszewski <michal.lukaszewski@intel.com>
2023-12-18 10:30:54 +01:00
Wang Wangwang 3a2958b360 [GPU] Fix convert fc to compressed when the input is SubGraphOp (#21687) 2023-12-18 13:29:16 +04:00
Vitaliy UrusovskijandIlya Lavrenov e71707b7d6 Remove extra includes (#21699)
Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>
2023-12-18 13:20:54 +04:00
Irina Efode d613bb0e65 [CPU][ARM] Fix build CPU ARM plugin (#21722) 2023-12-18 13:20:33 +04:00
Piotr Krzemiński acb3f5ef28 [Core][Tests] Add attribute tests and decompotion tests for Scaled Dot Product Attention (#21356)
* [CORE][TESTS] Add attribute tests and decompotion tests for scaled dot product attention

* Update batch_norm_decomposition_test.cpp

* Clang fix

* Update scaled_dot_product_decomposition_test.cpp

* [TESTS]STS] Fix CIs with rename and clang fix

* [TESTS] Fix decomposition for CIs

* [TESTS] Remove constant mode

* [TESTS] Fix visitor test for CI

* [Tests] Add suggested broadcast tests
2023-12-18 10:18:48 +01:00
Jan Iwaszkiewicz 57b1916f8d [PyOV] Remove restrictions on opset13.constant to align with opset1-12 (#21674) 2023-12-18 10:02:43 +01:00
Sebastian Golebiewski a9a935ee6e [DOCS] Fix notebooks sections in menu (#21695)
* Fix notebooks sections in menu

* prepend commands in cmake
2023-12-18 13:01:22 +04:00
Mateusz MikolajczykandRoman Kazantsev 1783aad48d [PT FE][Opset13] Add translation for torchscript aten::multinomial operator (#20397)
* Enable aten::multinomial in PT FE

* Add aten::multinomial test

* Fix typo

* Update tests/layer_tests/pytorch_tests/test_multinomial.py

Co-authored-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Update multinomial to changes in specification

* rm ;

* Add temporary convert for multinomial i64 support

* Revert convert

* Fix torch test

---------

Co-authored-by: Roman Kazantsev <roman.kazantsev@intel.com>
2023-12-18 09:54:06 +01:00
Georgy Krivoruchko 0972de4da8 [ONNX] Refactoring tests on API 2.0 (#21712)
* Moved test in onnx_import_com_microsoft to new API
* Updated onnx_import_constant_folding.in.cpp to new API
* Tests in onnx_import_controlflow.in.cpp moved to new API
* Tests in onnx_import_convpool.in.cpp moved to new API
* Test in onnx_import_deprecated.in.cpp moved to API 2.0
2023-12-18 11:31:32 +04:00
Ivan Tikhonov c4a49a3987 Add reset_state method to Python API (#21660)
* Add reset_state method to Python API

* fix missprint

* codestyle

* extend python tests

* delete debug code

* resolve review comments
2023-12-18 11:26:53 +04:00
Roman Lyamin 0e7248430c [Transformations] Support precision conversion for PriorBox (#21702) 2023-12-18 11:19:59 +04:00
Jade Cho 81f336b352 [GPU] Fix the mismatch between format and shape. (#21381)
+ Change broadcast type of broadcast node which is added for binary add fusion.
2023-12-18 15:51:47 +09:00
Chenhu Wang 6aa0a6677d [SnippetS] Binary size reduce, executor cache disabled if enable perf count (#21494) 2023-12-18 09:53:43 +04:00
Sungeun Kim da662116d4 parameter's event will be included execution args (#21377)
- all primitives generate event.
- remove reorder from test-case
2023-12-18 10:40:20 +09:00
Georgy KrivoruchkoandIlya Lavrenov 7b00e804de [ONNX] Refactoring tests on API 2.0 (#21707)
* Removed usage of API1.0 in onnx_reader_external_data.cpp

* Removed API1.0 usage in onnx_import.in.cpp

* Replaced old calls by convert_model in onnx_import.in.cpp

* Removed a deprecated API in onnx_import.in.cpp

* Fixed code style

---------

Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>
2023-12-17 13:44:38 +04:00
Georgy Krivoruchko 58a3debaa7 Try to fix download issue (#21710) 2023-12-17 12:31:01 +04:00
Eddy Kim e109f735dc [GPU] faster model caching (#21479)
* faster large data loading by double buffering

* added get_allocating_order() that is cached for faster loading

* added offset usm memory copy tests

* removed negative_same_names_within_different_networks_cache

* replaced get_processing_order() with processing_order
2023-12-16 04:50:58 -08:00
Ivan TikhonovandMaksim Kutakov fc88e14e83 Update evaluate methods of ReadValue/Assign operations (#21372)
* Update evaluate methods of ReadValue/Assign operations

* Update evaluate methods of ReadValue/Assign operations

* Prepare IVariable interface

* Support initializing subgraph

* Add exception types to the edge conflict searching algo

* Add test for init graph edge conflict

* Remove ShapeOf from consumer nodes in memory conflicts detection algo

* update template plugin

* Fix template tests; synchronize reset flag between VariableState and VariableValue objects

* fix legacy (Assign/ReadValue v3 + CNN Network) tests

* fix python tests

* fix python tests

* resolve review comments, apply cpu patch

---------

Co-authored-by: Maksim Kutakov <maksim.kutakov@intel.com>
2023-12-16 11:26:39 +01:00
Andrey Kashchikhin adb372fc8a [CI] [GHA] Add overview document (#20845)
* add first several sections of the overview document

* add missing step about artefacts collection

* formatting

* add runners section

* add stub documents

* clarity for caches, rename title

* clarify, better wording

* rm todos

* wording
2023-12-16 12:49:37 +04:00
Alina Kladieva 29d55ef7f3 Add doc file for Smart CI (#21557) 2023-12-16 12:49:19 +04:00
Georgy Krivoruchko 9e8c259ae2 [TFLite] Allows failing when model isn't generated (#21706)
* [TFLite] Allows failing when model isn't generated

* Use alternate way for downloading file
2023-12-16 12:46:13 +04:00
Andrey Kashchikhin 24b414c168 [CI] [GHA] Introduce ONNX Models Tests job in Linux workflow (#21581)
* add onnx models test job

* rm sudo

* add missing update

* add missing git-lfs

* add missing package

* correct var

* correct command

* try with pytest

* provide path to models

* use mounted path

* add msft models

* use symlinks

* correct name for model

* use -h

* create and use directory for models

* use share as source for models

* fix test names, use fresh onnx repo

* return names

* fix test names

* change folder structure for onnx model downloading

* skip tests; clean up logs; adapt azure counterpart

* make skip names lowercase

* increase parallel

* add missing git-lfs

* fix dir

* install git-lfs properly

* use sudo

* use 12 parallels; rm -f

* use skip

* rm unnecessary requirements

* rm pytorch from installing

* disable test
2023-12-16 12:37:37 +04:00
Chen Peter c8125e7e3b Update nlohmann_json to tag 3.11.3 (#21632)
Signed-off-by: Peter Chen <peter.chen@intel.com>
2023-12-16 12:36:32 +04:00
Alina Kladieva 9e3b1fa7d6 [GHA] Add openvino ref input to workflow_dispatch for coverity (#21704)
Needed to be able to run coverity on a specific commit from nightly, like we did in Azure (workflow_dispatch doesn't support running workflow from sha by default).
2023-12-16 12:31:34 +04:00
Zhang Yi 17fb201433 [CPU] SDPA supports multi-query and different input layout (#21513) 2023-12-16 00:38:04 +01:00
Jan Iwaszkiewicz eff9ba76ba [PyOV] String type support (#21532)
* WIP working Tensor with automatic casting

* Update infer functions and minor fixes

* Impl for multi-dim arrays with fixes for strides

* Fix strides for S kind and refactor tests

* Added str_data and bytes_data to Tensor, cleaning up the solution

* Add test of warning while using data property

* Allow lists as inputs for single Tensors, refactor infer code to return OVDict with decoded strings, some refactoring, tests

* Replace string with another invalid input

* Added bytes_str and string_str properties, clean up common part of bindings, added test cases

* Improve string element type to be created from numpy/python counterparts, refactor of common code, small improvements

* Add tests for types

* Remove print

* Small fix for tensors from pointers

* Small fix for asserts

* Add tests for data dispatcher

* Fix comments

* fix tests

* Fix edge-case for scalar-like values and unlock tests for data dispatcher
2023-12-15 21:14:55 +01:00
Ilya LavrenovandAlina Kladieva 7a311635bd Enabled smart CI for Win CC (#21690)
* Enabled smart CI for Win CC

* Remove paths-ignore filters

---------

Co-authored-by: Alina Kladieva <alina.kladieva@intel.com>
2023-12-15 20:49:02 +04:00
Ilya Lavrenov ccc79fb691 Updated versions for upload / download artifacts actions (#21691) 2023-12-15 20:43:22 +04:00
Pavel Esir 137180bce5 [tests] resolves skipped HF tests: 3rd batch (#21678)
* resolves skipped HF tests: 3rd batch

* remove comments

* minor corrections

* replace example input *argc -> **kwargc

* use config instead of dict in example input

* add kwargs
2023-12-15 19:58:12 +04:00
Ahmad Chalhoub c087fb4206 support UniqueWithCounts for TF FE (#21565)
* support UniqueWithCounts for TF FE

* set node name and fix code style
2023-12-15 18:33:29 +04:00
Ilya Lavrenov 4b66fbfe21 Revert "[TFLite] Allows failing when model isn't generated (#21621)" (#21701)
This reverts commit 8c634ce4b0.
2023-12-15 18:15:52 +04:00
Georgy Krivoruchko 993d503a28 [ONNX] Refactoring tests on API 2.0 (#21685)
* Refactored tests in onnx_editor_topological_sort.cpp

* Moved importer tests to new API
2023-12-15 17:30:13 +04:00
Maxim VafinandIvan Tikhonov 4799e021bf Fuse same MaxPools, Pads, etc (#21481)
* Fuse same MaxPools, Pads, etc

* Update src/common/transformations/src/transformations/common_optimizations/shared_ops_optimization.cpp

* Fix codestyle

* Fix includes

* Fix max pool

* Update src/common/transformations/src/transformations/common_optimizations/shared_ops_optimization.cpp

---------

Co-authored-by: Ivan Tikhonov <ivan.tikhonov@intel.com>
2023-12-15 17:25:42 +04:00
Przemyslaw Wysocki c691dc483d [PyOV][torchvision] Fix Resize for non-square images and expose missing interpolation modes (#21673) 2023-12-15 13:43:47 +01:00
Sun XiaoxiaandWanglei Shen 406593a6d8 Avoid unexpected scheduling to ECore on Hybrid Cores Windows platform (#21543)
* set core_type = MAIN_CORE_PROC with latency mode and enable hyper threading in pecore machine

* add test case

* change pcore_only to ecore_used

---------

Co-authored-by: Wanglei Shen <wanglei.shen@intel.com>
2023-12-15 11:24:43 +00:00
Ilya Lavrenov 7a09894bdc Added smart CI condition for PDPD tests (#21692) 2023-12-15 15:15:34 +04:00
Nikolay Shchegolev e00508368d [CPU] Enable String data type (#21465) 2023-12-15 12:01:39 +01:00
Areeb Syed 948b7405c7 [Python API] Added exception handling for 'None' model argument in save_model function (#21611) 2023-12-15 11:36:57 +01:00
Georgy Krivoruchko 6fdd0418ad Code in onnx_editor.cpp moved to using OpenVINO namespace (#21684) 2023-12-15 14:27:36 +04:00