Commit Graph

774 Commits

Author SHA1 Message Date
Anastasia Kuporosova
5da132bdfe [PyOV] Delete compatibility tests (#21820)
Co-authored-by: Michal Lukaszewski <michal.lukaszewski@intel.com>
Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>
2023-12-22 17:13:21 +01:00
Surya Siddharth Pemmaraju
a88679aeb8 Fixed a bug in input validation for torch.compile options (#21787)
* Fixed bug in input validation for torch.compile options

* Added default device if device is None

* Addressed PR comments

---------

Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>
2023-12-22 13:51:08 +04:00
Anastasia Kuporosova
62dda1bd3e [PyOV] delete test models from tests (#21821) 2023-12-21 17:45:40 +01:00
Anastasia Kuporosova
d10f49441d [PyOV] Remove deprecated py api (#21675)
* [PyOV][Draft] Remove deprecated py api

* clean up

* remove symbol

* fix failure

* fix ci

* remove shared_memory from arguments

* update tests
2023-12-21 16:57:22 +01:00
Anastasiia Pnevskaia
3ab5ee861d Fixed names for GraphDef. (#21799) 2023-12-21 17:04:05 +04:00
Ilya Lavrenov
80618b0498 Drop POT (#21805)
* Drop POT

* Removed POT transformations
2023-12-21 16:46:37 +04:00
rghvsh
1a0f0ccd2a [ONNX] Extend ONNX Frontend with BitwiseOr-18 operator (#21755)
* Create bitwise_or.hpp
* Update ops_bridge.cpp
* Added protobuf(.prototxt) files via upload.
* Update onnx_import.in.cpp
* Update test_backend.py
* Skip "test_bitwise_or_ui64_bcast_3v1d_cpu"
2023-12-21 12:27:28 +04:00
River Li
dc64268564 Remove ov::hint::PerformanceMode::UNDEFINED (#21592)
* Remove ov::hint::PerformanceMode::UNDEFINED

* Update for reviewer comments and build issue

* Fix build error - may be used uninitialized

* Update

---------

Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>
2023-12-20 21:15:26 +04:00
Jan Iwaszkiewicz
712e374519 [PyOV] Allow replacing of invalid bytes in string-based data (#21761)
* [PyOV] Allow replacing of invalid bytes in string-based data

* Fix linter
2023-12-19 23:25:52 +04:00
Georgy Krivoruchko
27c9ca749d [ONNX] Switched to ONNX 1.15.0 (#20929)
* [ONNX] Switched to ONNX 1.15.0

* Updated usage of ONNX serialization API

* Updated xfailed lists

* Updated xfailed lists

* Added xfailed ML-operators

* Added xfailed float8 cases

* Fixing mo tests

* Reverted legacy tests

* Sets default opset version in layer tests

* Skipped test which breaks moving on 1.15

* Updated xfailed list

* Fixed typo and added more tests to skipped

* Added xfailed tests

* Reduced opset due to need to work on onnx 1.13

* Removed unnecessary xfails

* Skipped misaligned tests

* WA for old compiler build
2023-12-19 18:55:32 +00:00
rghvsh
a4e8f9d98c [ONNX] Extend ONNX Frontend with BitwiseAnd-18 operator (#21585) 2023-12-19 09:54:55 +04:00
Jan Iwaszkiewicz
c59498be9c [PyOV] Allow single inputs in form of lists of simple types (#21734) 2023-12-18 22:14:31 +01:00
Eddy Kim
01967bdbff [GPU] Adding a switch to change the caching policy (#21443)
* added a new property to enable full model caching

* added a new public property cache_mode

* updated according to clang-format guide

* changed default caching policy to optimize_speed
2023-12-18 17:50:33 +00:00
Mateusz Mikolajczyk
98e8caad79 [PyAPI][Opset13] ScaledDotProductAttention-13 PyAPI improvements + tests (#21422)
* Improve ScaledDotProductAttention PyAPI

* Add tmp tests

* Improve PyAPI & add tests

* Fix test issue

* Fix pytest type

* Update src/bindings/python/tests/test_graph/test_scaled_dot_product_attention.py

Co-authored-by: Anastasia Kuporosova <anastasia.kuporosova@intel.com>

* Improve const creation

---------

Co-authored-by: Anastasia Kuporosova <anastasia.kuporosova@intel.com>
2023-12-18 12:35:14 +01:00
Jan Iwaszkiewicz
57b1916f8d [PyOV] Remove restrictions on opset13.constant to align with opset1-12 (#21674) 2023-12-18 10:02:43 +01:00
Ivan Tikhonov
c4a49a3987 Add reset_state method to Python API (#21660)
* Add reset_state method to Python API

* fix missprint

* codestyle

* extend python tests

* delete debug code

* resolve review comments
2023-12-18 11:26:53 +04:00
Ivan Tikhonov
fc88e14e83 Update evaluate methods of ReadValue/Assign operations (#21372)
* Update evaluate methods of ReadValue/Assign operations

* Update evaluate methods of ReadValue/Assign operations

* Prepare IVariable interface

* Support initializing subgraph

* Add exception types to the edge conflict searching algo

* Add test for init graph edge conflict

* Remove ShapeOf from consumer nodes in memory conflicts detection algo

* update template plugin

* Fix template tests; synchronize reset flag between VariableState and VariableValue objects

* fix legacy (Assign/ReadValue v3 + CNN Network) tests

* fix python tests

* fix python tests

* resolve review comments, apply cpu patch

---------

Co-authored-by: Maksim Kutakov <maksim.kutakov@intel.com>
2023-12-16 11:26:39 +01:00
Jan Iwaszkiewicz
eff9ba76ba [PyOV] String type support (#21532)
* WIP working Tensor with automatic casting

* Update infer functions and minor fixes

* Impl for multi-dim arrays with fixes for strides

* Fix strides for S kind and refactor tests

* Added str_data and bytes_data to Tensor, cleaning up the solution

* Add test of warning while using data property

* Allow lists as inputs for single Tensors, refactor infer code to return OVDict with decoded strings, some refactoring, tests

* Replace string with another invalid input

* Added bytes_str and string_str properties, clean up common part of bindings, added test cases

* Improve string element type to be created from numpy/python counterparts, refactor of common code, small improvements

* Add tests for types

* Remove print

* Small fix for tensors from pointers

* Small fix for asserts

* Add tests for data dispatcher

* Fix comments

* fix tests

* Fix edge-case for scalar-like values and unlock tests for data dispatcher
2023-12-15 21:14:55 +01:00
Przemyslaw Wysocki
c691dc483d [PyOV][torchvision] Fix Resize for non-square images and expose missing interpolation modes (#21673) 2023-12-15 13:43:47 +01:00
Areeb Syed
948b7405c7 [Python API] Added exception handling for 'None' model argument in save_model function (#21611) 2023-12-15 11:36:57 +01:00
Ilya Lavrenov
94a21d606c Ability to exclude TBB from install package (#21624) 2023-12-15 09:49:38 +04:00
Anastasia Kuporosova
0a21205ad4 [PyOV] move rest of start_async tests to test_async (#21643) 2023-12-14 15:51:42 +01:00
Anastasia Kuporosova
1aa0c0ca0d [PyOV] OVDict as input for infer/call methods (#21275)
* [PyOV] OVDict as input for infer/call methods

* for copied inputs

* improvement

* add test

* apply comments

* add test assert

---------

Co-authored-by: Michal Lukaszewski <michal.lukaszewski@intel.com>
2023-12-13 18:13:18 +00:00
Surya Siddharth Pemmaraju
1b2eed0bbe Enable options for openvino backend in torch.compile (#20946)
* Added backend options for openvino torch.compile

* Added config options to enable openvino configs

* Fixed linter issues

* Addressed review comments

---------

Co-authored-by: Maxim Vafin <maxim.vafin@intel.com>
2023-12-13 20:10:48 +04:00
Anastasia Kuporosova
3e42ddbde5 [PyOV] support Type as arg in convert op (#21603)
* [PyOV] support Type as arg in convert op

* add test

* fix linter
2023-12-12 18:21:47 +01:00
Maciej Smyk
2f65827f9f [DOCS] Moving files to new location for master (#21575)
* repo update

* repo update

* repo update

* Update LowPrecisionModelRepresentation.rst

* Update LowPrecisionModelRepresentation.rst

* Update CMakeLists.txt

* Update QuantizedNetworks.rst

* separate location for pypi publishing files

* Update src/bindings/python/CMakeLists.txt

fixing path in src/bindings/python/CMakeLists.txt

---------

Co-authored-by: Karol Blaszczak <karol.blaszczak@intel.com>
Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>
2023-12-12 16:27:01 +04:00
Anastasia Kuporosova
889f2f54a2 [PyOV] Improve warning throwing in Const op (#21576)
* [PyOV] Improve warning throwing in Const op

* wrap warn to lambda

* fix linter
2023-12-11 23:18:59 +01:00
Anastasia Kuporosova
ba34fa77e8 [PyOV] Expose result op (#21482)
* [PyOV] Expose result op

* update docs with op.Result

* codestyle

* add test and fix flake8 errors

* add result test

* fix transformation tests

* update return type
2023-12-08 13:57:11 +00:00
_bhaskar365
4c67ab7381 Merge changes from upstream/master referencing - test_infer_request.py renamed to test_sync_infer_request.py and new f… #21436 (#21516) 2023-12-08 09:48:13 +01:00
Anastasia Kuporosova
5e3176d617 [PyOV] Hide warning in const op (#21529) 2023-12-08 09:36:10 +01:00
Wang, Yang
fd0809ead4 [AUTO] Enable round robin policy for cumulative throughput mode of AUTO plugin (#20439)
* Add and implement the logic of property SCHEDULE_POLICY for MULTI plugin.

* Updated.

* Enable test case for schedule policy test.

* enable test case for property ov::intel_auto::schedule_policy.

* Update.

* Updated.

* Updated.

* Update.

* Update the lock logic here by considering the runtime fallback case.

* Update.

* Update.

* Update.

* Update default value of schedule policy to DEVICE_PRIORITY

* Enable the function test case for schedule policy.

* Add description for inference requests schedule policy within AUTO plugin cumulative mode.

* Updated.

* Python bindings for enum SchedulePolicy and property ov::intel_auto::schedule_policy.

* Update.

* Update.

* Update.

* Updated.

---------

Co-authored-by: Chen Peter <peter.chen@intel.com>
Co-authored-by: Wanglei Shen <wanglei.shen@intel.com>
2023-12-07 07:04:56 +01:00
Maxim Vafin
8a0317101c [PT FE] Disable freezing (#20679)
* Disable freezing

* Add rules for freezing

* Update src/bindings/python/src/openvino/frontend/pytorch/ts_decoder.py

* Update src/bindings/python/src/openvino/frontend/pytorch/ts_decoder.py
2023-12-06 15:39:54 +01:00
Anastasia Kuporosova
ca87784a29 [PyOV] Missed variable API in Model class (#21434)
* [PyOV] Missed variable API in Model class

* fixes in model docstr and codestyle

* add test

* fix ci

* fix ci
2023-12-04 15:44:23 +01:00
Anastasiia Pnevskaia
525c031959 Fixed Trackable import. (#21429) 2023-12-04 12:25:41 +04:00
Piotr Krzemiński
44f7bf7e3f [CPU] Multinomial implementation (#20406)
* [CPU] Temp save commit

* [CPU] Add initial CPU implementation of Multinomial

* [CPU] Add parallel implementation with mock randomuniform

* [CPU] Fix accumulate incorrect iterator provided

* [CPU] Add tests for multinomial

* [CORE] Add lost tests

* [CPU] Add dynamic shape inference and descriptors init

* [CPU] Revamp tests to multiple files

* [CPU/SPEC] Apply suggested changes

* [CPU] Fix test compilation issues, clang fix

* Update multinomial.cpp

* [CPU] Fix Incorrect Primitive Descriptor for multiple combinations

* [CPU] Change params to inputs in testing function

* [CPU] Fix dynamic shape inference tensor access error

* [CPU] Save stable version

* [CPU] Add template execute for different input dtypes

* [CPU] Introduce new method of loading data to tests, fix dynamic shape inference

* [CPU] Improve parralelism

* [CPU] Improve pararrelism - fix indexes

* [CPU] Fix no_replacement tests, fix randomness in tests

* [CPU] Split tests into log and no_log version to avoid rounding when values are close to 0

* [CPU] Add mersenne-twister seed and random_uniform distribution as source for randomness, add debug prints

* [CPU] Apply suggestions from review, fix 4x4 log tests

* [CPU] Force i32 convert format

* [CPU] Fix double to float conversion warning

* [CPU] Remove debugging prints, fix CIs float error

* [CPU] Fix for convert_type in CIs

* Update src/plugins/intel_cpu/src/shape_inference/custom/multinomial.hpp

Co-authored-by: Mateusz Mikolajczyk <mateusz.mikolajczyk@intel.com>

* Update src/plugins/intel_cpu/src/nodes/multinomial.hpp

Co-authored-by: Mateusz Mikolajczyk <mateusz.mikolajczyk@intel.com>

* Update src/plugins/intel_cpu/src/shape_inference/custom/multinomial.hpp

Co-authored-by: Mateusz Mikolajczyk <mateusz.mikolajczyk@intel.com>

* [CPU] Migrate to CPU API 2.0

* [Ref/CPU] Remove support for 1D tensors, use Core Shape Inference

* [CPU] Remove unnecessary symbols

* Update multinomial.cpp

* Update multinomial.cpp

* Update ops.py

* [CPU] Fix const identifier missing after reinterpret cast

* [CPU] Fix Mac cpplint error

* [CPU] Apply recommended changes - 0-seed nondeterminism, casts in testsshape_infer optimization

* [CPU] Apply iterator optimization suggestion

* [CPU] Replace casts with class constructors in tests

* [CPU] Remove unnecessary static_casts to void*

* Update multinomial.cpp

* [CPU] Apply suggestions from review - move template, fix i64 precision, redturn off shape precision for const inputs, set always-execute for const inputs

* [CPU] Relocate tests to shared, remove using namespace from header files

* [CPU] Add definitions for files eaten by clang fix

* [CPU] Fix seed for Mersenne Twister Engine

* [CPU] Try fix incorrect 1x3 for 3 samples test (bf16)

* [CPU] Use only mersenne for seed generation

* [CPU] Relocate test, add debug prints

* [CPU] Add relocated test that got eaten

* [CPU] Remove uniform distribution, replace with division by max value

* Update multinomial.cpp

* Update multinomial.cpp

* [CPU] Add explicit float cast for CIs

* Update multinomial.cpp

* [CPU] Use intel_cpu::bfloat16 to reduce innacuracies

* [CPU] Remove debug caps, all tests pass

* [CPU] Clang fix

* [GPU] Remove GPU 1D test case

* [CPU] Modify tests to add seed=0 case, add ignore statement for this test and add subtask to complete after current release

---------

Co-authored-by: Michal Lukaszewski <michal.lukaszewski@intel.com>
Co-authored-by: Mateusz Mikolajczyk <mateusz.mikolajczyk@intel.com>
2023-12-02 12:46:17 +01:00
Anastasia Kuporosova
0e642e984b [PyOV] tests refactoring (#21410)
* [PyOV] tests refactoring

* remove ngraoh mentioning

* codestyle

* replace func
2023-12-01 14:53:33 +01:00
Kristián Körmöndi
74bf3d4e38 Extend Python API with ScatterNDUpdate-3 (#21325)
Co-authored-by: Anastasia Kuporosova <anastasia.kuporosova@intel.com>
2023-11-30 15:32:45 +00:00
Anastasiia Pnevskaia
b0b28e3853 Disable memory sharing for GPU. (#21370) 2023-11-30 11:05:25 +00:00
Jan Iwaszkiewicz
bc78fd359e [PyOV] Dynamic attributes for Python based operators (#21256) 2023-11-27 16:16:02 +01:00
Ivan Tikhonov
57d794c810 ConvertPrecision transformation: handle Assign, ReadValue and Variable (#21266)
* ConvertPresicion transformation: handle Assign, ReadValue and Variable

* revert debug code

* use correct commit for onednn_gpu

* codestyle
2023-11-27 18:34:31 +04:00
Anastasia Kuporosova
815980f290 [PyOV] Replace legacy assert (#21268)
* [PyOV] Replace legacy assert

* codestyle

* apply comments

* Update src/bindings/python/src/pyopenvino/graph/dict_attribute_visitor.cpp
2023-11-27 11:51:01 +04:00
Anastasia Kuporosova
ccfe58cf84 [PyOV] Update imports in py api tests (#21252)
* [PyOV] Update imports in py api tests

* update year and back test_compression_4bit.py

* missed import
2023-11-24 11:16:57 +04:00
Helena Kloosterman
309539667a Add hint to install patchelf with pip (#21237) 2023-11-22 16:19:11 +04:00
Maxim Vafin
1a288f0e9a [PT FE] Recognize empty non-frozen lists (#21224)
* [PT FE] Recognize empty non-frozen lists

* Do not produce alias for aten::clone
2023-11-22 11:58:53 +01:00
Ivan Tikhonov
a329611349 Support dynamic shapes in ReadValue/Assign ops and MakeStateful transformation (#20404)
* Support for dynamic shapes in ReadValue/Assign ops and MakeStateful transformation

* fix unit tests

* codestyle

* fix warning

* fix visitors test

* Fix lowLatency transformation, fix functional tests

* fix LowLatency2

* codestyle

* Fix CPU/GNA tests

* fix shape inference of assign operation

* fix python API

* fix mypy error

* Fix read_value operation version in python API for opsets7-13

* Update python API and fix tests

* set the same Varibable obj to Assign/ReadValue in py API, disable fp16 memory tests

* Update shape inference methods of Assign, ReadValue; update tests; fix codestyle

* fix python codestyle

* fix tests

* Resolve review comments

* codestyle

* resolve review comments

* codestyle

* Update ReadValue op in kaldi frontend, fix GNA tests

* fix Assign/ReadValue bindings, fix read_value test

* Apply suggestions from code review

Co-authored-by: cecilia peng <cecilia.peng@intel.com>

* Fix functional tests, add ov::Type support as an argument for read_value py binding

* temporary disable test_query_state_write_buffer fp16 tests

* Fix backward compatibility with the IRs with ReadValue/Assign ops generated via prev versions of OV; fix func tests

* fix python test, support type as str in read_value/assign bindings

* fix model binding

* fix pre-commit tests: variables vector cleanup

* fix integration with cpu changes

* codestyle

* fix warning

* Fix type/shape validation for read_value op

* fix a type_prop test for assign op

---------

Co-authored-by: cecilia peng <cecilia.peng@intel.com>
2023-11-21 20:59:36 +04:00
Mateusz Mikolajczyk
54a68c8a13 [Opset13][pyAPI] Python API FakeConvert-13 (#21155)
* [Opset13][pyAPI] Python API FakeConvert-13

* Fix typo

* Add experimental warning

* Add missing py opset in docs

* Fix flake

* Apply suggestions from code review

Co-authored-by: Anastasia Kuporosova <anastasia.kuporosova@intel.com>

* Apply suggestions from code review

Co-authored-by: Katarzyna Mitrus <katarzyna.mitrus@intel.com>

* Apply requested changes

---------

Co-authored-by: Anastasia Kuporosova <anastasia.kuporosova@intel.com>
Co-authored-by: Katarzyna Mitrus <katarzyna.mitrus@intel.com>
2023-11-21 14:25:02 +00:00
Meet Patel
20af42cfd9 Add python bindings for PILLOW interpolation modes (#21188) 2023-11-20 22:39:05 +00:00
Anastasia Kuporosova
56301d8878 [PyOV] add param-result to offline transformation (#21140) 2023-11-20 15:59:02 +01:00
Jan Iwaszkiewicz
0c041d7ebc [PyOV] Adjust opset13 Constant to utilize runtime.op.Constant functionalities (#21046) 2023-11-20 15:29:46 +01:00
Przemyslaw Wysocki
dddc85f68f Add lower bound to sympy (#21127) 2023-11-20 10:17:47 +01:00