Commit Graph

622 Commits

Author SHA1 Message Date
Katarzyna Mitrus
d026ae74ce [ONNX] Use ov::v12::ScatterElementsUpdate in ONNX FE ScatterElements (enable reduction) (#18462)
* Update ONNX FE scatter_elements to use ScatterElementsUpdate-12

* ONNX tests update

* Set reduction update

* Enable xfailed tests

* Add more onnx tests

* Fix reference implementation to support negative indices

* Style alignment
2023-07-13 12:16:31 +02:00
Anastasia Kuporosova
acc13a70e8 [PyOV] py wrappers for clone/deepcopy model (#18502)
* [PyOV] py wrappers for clone/copy model

* -amend

* py wrap for clone_model

* codestyle

* mypy checks

* enable mypy for new file

* apply comment

* deprecate clone_model

* deepcopy removal from cpp
2023-07-13 01:10:38 +00:00
Jan Iwaszkiewicz
59052d846e [PyOV] Memory flow control with share_inputs and share_outputs (#18275)
* Added ReturnPolicy and updated common array helpers

* Clean up

* Remove ReturnPolicy initial

* Add share_inputs and share_outputs

* Tests and minor fixes

* Fix docstrings

* Fix whitespace

* Fix typing
2023-07-11 21:05:22 +04:00
Oleg Pipikin
d6c0289008 Move common test utils (#18339)
* Move common test utils

* Apply comments

* Comments 2
2023-07-10 12:48:24 +00:00
Przemyslaw Wysocki
6c55937119 [PyOV] Add get_compiled_model binding for InferRequest (#18386) 2023-07-10 12:08:10 +02:00
Pavel Esir
af9a8cbbd7 fix GitHub Actions failing tests (#18357)
Co-authored-by: Roman Kazantsev <roman.kazantsev@intel.com>
2023-07-08 18:21:59 +02:00
Ilya Churaev
b69190c2c1 Proxy plugin 2.0 (#17416)
* Initial commit for proxy plugin

* Include proxy to openvino library

* Fixed some tests

* Added plugin properties

* Added readme

* Support Compile model for the proxy plugin

* Fixed python

* Remove gmock

* Fixed some tests

* Fixed load plugin tests

* Removed internal PROXY_FALLBACK_PRIORITIES initialization property

* Fixed code style

* Added new tests

* Create architecture.md

* Fixed some proxy tests

* Implement not implemented functions

* Fixed ICore mock

* Remove redundant code

* Added import/export tests

* Fixed hetero import/export tests

* Fixed ICore mock

* Fixed import tests

* Fixed build

* Remove redundant parse config

* Fixed some comments

* Try to fix Windows build

* Fixed incorrect logic

* Small fix in tests

* Fixed python API

* Fixed typo

* Try to fix python

* Switch GPU under proxy

* Fixed GPU name

* Revert GPU plugin under proxy

* Small changes in CMake files

* Temp commit

* Build without proxy

* Revert "Temp commit"

This reverts commit 1ac9824bdf.

* Fixed test linking

* Removed tests from ncc check

* Add option to disable proxy plugin

* Fixed minor comments

* Disable some proxy tests if IR frontend is disabled

* Enable Intel GPU under the proxy

* Fixed typo

* Fixed segfault in tests

* Small fix for case if only GPU is registered

* Fixed code style

* Added remote context tests

* Added proxy tests to CI

* Fixed mock engine

* Test change

* Revert "Test change"

This reverts commit 2d1d67766f.

* Add new tests

* Removed some tests

* Revert "Removed some tests"

This reverts commit 090398652f.

* Revert incorrect logic

* Removed unused variables

* Use original name for the GPU plugin

* Fixed CMake

* Do not show hidden devices

* Try to fix GPU remote context

* Fixed GPU plugin build

* Added interface for proxy remote context

* Remove local properties

* Remove redundant API

* Fixed typo

* Added remote tensors

* Fixed code style

* Fixed some comments

* Unwrap remote tensors before conversion to Blob

* Added cast for legacy API

* Fixed some cldnn tests

* Do not add preprocessing for proxy plugin

* Enabled more tests and wrap tensors in infer request

* Use hardware request inside conversion wrapper

* Fixed hand on cache calculation

* Try to fix some tests

* Support set tensor for remote tensors in proxy plugin

* Revert "Support set tensor for remote tensors in proxy plugin"

This reverts commit 5a927de590.

* Remove redundant friend from compiled model and fix life time for infer
request

* Fixed code style

* Add additional so pointers to the tensor

* Rewrite approach for compile model and tensor

* Removed API from proxy

* Fixed is/as Blob for wrapped Blobs

* Wrap tensor when set tensor to plugin

* Fixed recursive call

* Don't unwrap tensors for AUTO plugin

* Fixed Some Multi tests with remote blob for proxy

* Align context name with tests

* Fixed code style

* Try to fix more tests

* Some minor changes

* Try to fix OVHoldersTests

* Try to save low level SO in high level wrappers

* Revert "Try to save low level SO in high level wrappers"

This reverts commit 430ff8a526.

* Revert "Try to fix OVHoldersTests"

This reverts commit 32604f0d3e.

* Disable some tests

* Fixed DynamicBatchShapeTests

* Fixed caching tests and skip OVHoldersTest

* Small refactoring

* Fixed import model

* Small fix

* Fix typo which causes fails of caching tests

* Disabled AUTO BATCH for proxy device

* Support Export in Auto batch

* Small changes

* Fixed initialization fallback to plugin with proxy name

* Added more values for tests

* Ask all devices and create context if no device id

* Support export in auto batch

* Fixed some comments

* Fixed some comments and removed auto batch

* Fixed some comments

* Fixed auto batch test and some comments

* Fixed build

* Removed proxy plugin class from dev api

* Fixed code style

* Fixed disabled tests
2023-07-07 13:45:20 +04:00
Haiqi Pan
c7431be401 Deprecate legacy C API (#18146)
* Deprecate legacy C API

* fix code sytle

* add INFERENCE_ENGINE_1_0_DEPRECATED in ie_c_api.h

* fix code style

* use OPENVINO_SUPPRESS_DEPRECATED

* reset ie_c_api.cpp

* fix code style

* fix code style

* fix definition

* fix code style

* change msg

* [[deprecated(msg)]]

* add cmake fun

* add deprecated message to INFERENCE_ENGINE_C_API

* remove deprecate msg in fun

* add msg

* fix code style

* fix code style

* add OPENVINO_SUPPRESS_DEPRECATED_END in c api test

* move head after OPENVINO_SUPPRESS_DEPRECATED_START

* move declaration to ie_c_api.h

* reset to OPENVINO_DEPRECATED

* reset to OPENVINO_DEPRECATED

* try to fix code style

* Revert "try to fix code style"

This reverts commit cc2b8476de.

* Revert "reset to OPENVINO_DEPRECATED"

This reverts commit 9d158c8163.

* Revert "reset to OPENVINO_DEPRECATED"

This reverts commit f8b2793abc.

* Update src/bindings/c/include/c_api/ie_c_api.h

Co-authored-by: Chen Peter <peter.chen@intel.com>

* Update src/bindings/c/tests/ie_c_api_test.cpp

Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>

* remove noo error in CMakeLists

* remove macro

* ix code style

* change msg

* fix C4996

* add ov_deprecated_no_errors back

* add full msg

---------

Co-authored-by: Chen Peter <peter.chen@intel.com>
Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>
2023-07-06 12:38:43 +04:00
Nikolay Shchegolev
886fd0debb [CPU] ONNX Unique tests failing on CPU (#18100)
* [CPU] ONNX Unique tests failing on CPU

* Fixes as per comments.
2023-07-05 18:16:21 +02:00
Anastasia Kuporosova
71306e3b38 [PyOV] Model wrappers on Python side (#18368)
* model on py side

* work with diff types

* some tests fix

* try to fix test

* fix fe tests

* codestyle

* fix post commit
2023-07-05 11:44:04 +04:00
Anastasia Kuporosova
8c648910dc [PyOV] Expose api to Model class (#18141)
* [PyOV] Expose api to Model class

* assign op

* Update src/bindings/python/src/pyopenvino/graph/ops/assign.cpp

* add remove_ methids

* improve test

* codestyle

* assign operation

* codestyle

* test size

---------

Co-authored-by: Michal Lukaszewski <michal.lukaszewski@intel.com>
2023-07-04 21:54:06 +02:00
Ilya Churaev
7fc16c3295 Move OpenVINO core developers API to OpenVINO folder (#18360)
* Move openvino core developers API to OpenVINO folder

* Fixed GPU plugin

* Fixed code style
2023-07-04 22:14:53 +04:00
Mateusz Bencer
c0035dfd9a try to fix model zoo preprocessing (#18303) 2023-07-04 10:37:57 +04:00
Anastasiia Pnevskaia
5d399faa64 convert_model() in openvino.runtime. (#18080)
* Used pip wheel to build OpenVINO wheel

* Added convert_model() to openvino.runtime.

* Removed duplication of InputCutInfo, LayoutMap

* Switched Model Conversion API tests to convert_model from openvino.runtime.

* Small correction.

* Format correction.

* Small correction.

* Removed duplication of moc frontend files.

* Small correction.

* Removed duplication of cli_parser, offline_transformations.

* Code corrections.

* Removed code duplications.

* Removed code duplications.

* Updated codeowners.

* Switched layer tests to convert_model().

* Improvements

* Small correction.

* Caffe parser path fix.

* Added python api properly into deb / rpm packages

* Moved implementation to ovc tool.

* Moved implementation to ovc tool.

* Small correction.

* Use cmake -E variant from cmake 3.13

* Namespace fixes.

* Minor fixes.

* Pylint fixes.

* Fixed BOM file.

* Small corrections.

* Minor corrections.

* Minor fix.

* Error fixes.

* Added telemetry requirement.

* Improvements to fix CI

* Some refactoring

* Don't use developer package for scripts projects

* Added exception in case when MO is not imported.

* Removed exception from init.

* Removed changes from cmake.

* Added unit ovc tests, fixed minor errors.

* Added ovc unit tests to azure.

* Corrected imports.

* Fixed path to tests.

* Added missed files.

* Corrected github labels.

* Removed benchmark app from dev package.

* Small fix.

* Small corrections.

* Comment fixed.

* Removed changes from setup.py

* Removed not needed change.

* Removed duplicating unit tests.

* Removed wrong change.

* Removed not needed change.

* Apply suggestions from code review

Co-authored-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Added ovc tool test, corrected imports.

* Added legacy TF config test.

* Removed not needed files.

---------

Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>
Co-authored-by: Roman Kazantsev <roman.kazantsev@intel.com>
2023-06-30 18:26:14 +04:00
Pawel Raasz
f52ab4f9ef Optimize IE_THROW and IE_ASSERT for size reduction (#18284)
* Optimize IE_THROW and IE_ASSERT for size reduction

* Fix build issues
2023-06-30 11:52:21 +04:00
Jan Iwaszkiewicz
4fc0b22012 [PyOV] Force copy of not writable numpy arrays (#18194) 2023-06-28 07:56:29 +02:00
Ilya Lavrenov
975616980b Removed benchmark_tool from openvino since opencv dependency is still not solved (#18206) 2023-06-24 12:00:31 +04:00
Jan Iwaszkiewicz
a8ce60b651 Fix flake8 warnings and ignore VNE001 for Python samples (#18204)
* Ignore VNE001 for Python samples

* Add explanation

* Fix flake8 on wheel setup.py

* Fix onnx test reporting VNE001
2023-06-23 17:06:02 +04:00
Ilya Lavrenov
b7e14deddd Revert "[PyOV] Model wrappers on Python side (#18027)" (#18201)
This reverts commit b022137d80.
2023-06-23 11:44:39 +04:00
Ilya Lavrenov
15e69c280a Used pip wheel to build OpenVINO wheel (#18029)
* Used pip wheel to build OpenVINO wheel

* Improvements

* Added python api properly into deb / rpm packages

* Use cmake -E variant from cmake 3.13

* Improvements to fix CI

* Some refactoring

* Don't use developer package for scripts projects

* Final fixes
2023-06-23 09:17:02 +04:00
Anastasia Kuporosova
b022137d80 [PyOV] Model wrappers on Python side (#18027) 2023-06-22 10:05:44 +02:00
Luwei Zhou
731ef78608 [CPU] Move the FC fusing bias into CPU graph optimizer (#17082) 2023-06-21 10:20:21 +04:00
Ekaterina Aidova
a8a366de08 [PT FE]: use example input for dtype and rank detection (#18083)
* [PT FE]: use example input for dtype and rank detection, support unordered input dict

* Apply suggestions from code review

* restore old behaviour for old torch versions

* move info addition after parsing
2023-06-20 17:31:30 +04:00
Przemyslaw Wysocki
b63e8433b0 Update labeler and numpy (#18136) 2023-06-19 14:21:10 +00:00
Haiqi Pan
3c619d8339 ov_remote_context -> Remote Context (#18132) 2023-06-19 12:58:14 +04:00
Xuejun Zhai
e56405ef3b [C API] Fix str copy to char* issue in debug & release mode, issue number 18019 (#18097)
Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>
2023-06-16 12:31:31 +04:00
Maxim Vafin
77584d301e Fix automatic scripting for quantized models (#18089) 2023-06-16 08:51:21 +02:00
Maxim Vafin
10ace822ef [PT FE] Do not freeze for quantized models (#18082)
* Do not freeze for quantized models

* Update tests/layer_tests/pytorch_tests/pytorch_layer_test_class.py

* Fix getitem
2023-06-15 19:41:06 +02:00
Maxim Vafin
9684f9184a [PT FE] Improve operation naming (#17997)
* Improve operation naming

* Use set to reduce operations with indexes, fix code style

* Refactor

* Make good names in transformations

* Remove tensor index from input/output names

* Fix tests
2023-06-15 14:28:38 +02:00
Maxim Vafin
caedb6a6b4 [PT FE] Print better exception message (#18015)
* [PT FE] Print better exception message

* Sort ops and fix code style

* Apply feedback

* Remove obsolete variable

* Rearrange newlines

* Apply feedback, add messages in transformations

* Fix style

* Add exceptions in cat and getitem replacers

* Add test

* Fix test regex
2023-06-15 12:04:01 +04:00
Anastasia Kuporosova
7fd394e87e [PyOV] AsyncInferQueue documentation notice about iteration limit (#18042) 2023-06-15 09:23:26 +02:00
Anastasiia Pnevskaia
5993c4942a Fixed load_by_model() test. (#18060) 2023-06-14 18:43:40 +04:00
Anastasia Kuporosova
d95c49d888 [PyOV] Deprecate python IE and nG API (#17791) 2023-06-13 13:18:30 +00:00
Anastasiia Pnevskaia
77711be786 tf.Graph decoder. (#16355)
* tf.Graph decoder.

* Fix conflicts.

* Fixed det_input_node()

* Added support of non-frozen models.

* Cleaned code.

* Small fix.

* Small corrections.

* Error fixes.

* Code style.

* Code style.

* Code style.

* Small correction.

* Fixed float32 attributes.

* Small correction.

* Fixed tests.

* Fixed errors.

* Added statefull partitioned call test.

* Import fix.

* Code corrections.

* BOM test fixed.

* Corrected check, added comment.

* Added checks.

* Supported TF Fraph Iterator in load_by_model().

* Clang format.

* Small correction.

* Fixed example_input logic, added tests.

* Added comment.

* Small correction.

* Corrected example_input description.

* Moved load_by_model test to MO Python API tests.

* Minor corrections.

* Code corrections.

* Small correction.

* Clang format.

* Fixed tests.

* Import change.

* Moved GraphIterator to common FE.

* Tests refactoring, minor fixes.

* Small test correction.

* Removed not needed change.

* Removed commented code.

* Removed not needed change.

* Unit tests fix.

* Temporarily added debug output.

* Test fix.

* Applied comments.

* Fixed test.
2023-06-13 16:04:26 +04:00
Maxim Vafin
48dec1000e [PT FE] Support inplace operations on aliases of tensors (#17856)
* Support operations on aliases of tensors

* Add tests

* Fix issue with convnd

* Fix code style

* Fix issue with tensor index of mutated tensor

* Fix if types alignment

* Fix issues in keypoint detectron2

* Fix issue with masks in detectron2

* Fix acuracy issue in mobilevitv2 models

* Remove unused includes

* Return upsample case in lictconstruct replacer

* Fix types, apply review feedback

* Apply feedback

* Revert change of not using shared_from_this for getitem

* Fix issue in prim::device transformation

* Fix layer tests

* Apply review feedback

* Fix issue with not existing alias to tensor
2023-06-13 13:30:48 +02:00
Ilya Churaev
df44f92a97 Remove NV12 and I420 blobs and deprecate some legacy API (#17919)
* Remove NV12 and I420 blobs and deprecate some legacy API

* Fixed some errors

* Remove NV12 blobs

* Remote NV12 conversion

* Fixed other warnings

* Suppress version

* Fix some warnings

* Fixed version

* Try to fix some warnings

* Suppress warnings in C header

* Suppress warnings in C

* Fixed Windows exceptions

* Try to fix warnings

* Try to fix C bindings build

* Suppress InferRequest

* Fixed some build issues

* Fixed some errors
2023-06-12 21:15:02 +04:00
Ilya Lavrenov
90a0e5f81a Refactored setup.py; used pip wheel to build package (#17991) 2023-06-12 14:42:09 +00:00
Wang Kai
7b86b427cb fixing some typos (#17980) 2023-06-10 01:13:31 +04:00
Ilya Lavrenov
2799fe9855 Install all python build artifacts to a single folder (#17883) 2023-06-05 18:12:17 +02:00
Xuejun Zhai
0e4855a87c Fix C API registers unit test failed (#17800)
* Fix C API registers unit test failed

Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>

* Fix compile error in macos

Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>

* Fix CI format issue

Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>

* using the getExecutableDirectory() func from openvino::utils

Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>

---------

Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>
2023-06-01 12:52:47 +04:00
Ilya Churaev
ea04f8217d Mark as deprecated nGraph API (#17647)
* Mark as deprecated nGraph API

* Fixed code style

* Added IN_OV_LIBRARY define

* Suppress warnings for log

* Suppress warning

* Updated nGraph headers

* Fixed build for macOS

* Fixed lpt and snippets

* Fixed build all on macOS

* Suppress some warnings

* Fixed some new warnings

* Fixed new warnings

* Try to fix some warnings

* More warnings

* Soome change

* Suppress more warnings

* Suppress warnings for transformations

* Suppress warnings for LPT

* One more fix

* Suppress more warnings

* Try to fix opset error

* Remove opset constructor

* Cannot fix opset warning

* Suppress warnings for offline transfromations

* Fixed some warnings for Windows

* Fixed code style

* Suppress some warnings for onnx FE

* Revert "Suppress some warnings for onnx FE"

This reverts commit 75d23b64fc.

* Revert "Fixed code style"

This reverts commit c6eba63116.

* Revert "Fixed some warnings for Windows"

This reverts commit 23d7ed88b6.

* Revert "Suppress warnings for offline transfromations"

This reverts commit 0b9f6317bf.

* Revert "Cannot fix opset warning"

This reverts commit 19ea658639.

* Revert "Remove opset constructor"

This reverts commit 06afb1bc20.

* Revert "Suppress warnings for LPT"

This reverts commit 58b1c0f5a0.

* Revert "Suppress warnings for transformations"

This reverts commit f8bb9814a1.

* Revert "Suppress more warnings"

This reverts commit f9f0da9acb.

* Revert "Soome change"

This reverts commit e545d4984e.

* Remove deprecation for ngraph::OpSet and FactoryRegistry
2023-06-01 12:44:28 +04:00
Tomasz Dołbniak
02124aece4 GroupNormalization core op (#17781) 2023-06-01 08:49:02 +02:00
Haiqi Pan
2dd0b75529 [C API] some contents missed in doxygen (#17671)
* remove @param and separate line

* separate line of ov_remote_context_free

* fix code style

* Update src/bindings/c/include/openvino/c/ov_remote_context.h

Co-authored-by: Chen Peter <peter.chen@intel.com>

* add ...

* add ...

---------

Co-authored-by: Chen Peter <peter.chen@intel.com>
2023-06-01 10:22:08 +08:00
Maciej Smyk
dc36ec11b5 [DOCS] Link adjustment for dev docs + fix to build.md CPU link for master (#17744)
* link-update-1

* link update

* Update build.md

* dl workbench

* Update README.md
2023-05-31 13:27:20 +04:00
Anastasia Kuporosova
9c63a9bbd0 [PyOV] Add objects representations (#17519) 2023-05-30 11:47:40 +00:00
Ilya Lavrenov
bd0117d648 Vcpkg conan fixes (#17765)
* Small fixes for openvino::pugixml creation for Dev packages

* Flexiable components installation

* Fixed compilation for x86

* Added extra checks for ENABLE_NCC_STYLE

* Fixed typo in RPM
2023-05-29 15:40:51 +04:00
Ilya Lavrenov
6a562268d3 Avoid global targets in thirdparty dependencies (#17755)
* Added dependencies via vcpkg

* Try to remove global imported targets

* Fix for conan

* Fixed RHEL case

* Fixed RHEL, U18 cases

* Returned OpenCV finding

* Update cmake/templates/OpenVINOConfig.cmake.in

Fixed IMPORTED_GLOBAL => GLOBAL in OpenVINOConfig.cmake.in template file

* Apply suggestions from code review

Properply used NAMES in find_package

* Fixed case with zlib

* Final fixes

* Fixes

* Removed CONFIG from find package ZLIB

* Fixed RHEL

* Reverted changes with gflags back

* Turn off LTO after thirdparty dependencies are built
2023-05-27 10:47:41 +04:00
Ilya Lavrenov
a21fe95ae6 Enabled fdupes checks for Linux arm64 (#17711) 2023-05-24 23:14:29 +04:00
Maciej Smyk
13c966f293 [DOCS] Link adjustment (Snippets) for master (#17659)
* link fix

* diagram_workflow

Removal of not used diagram_workflow.svg images

---------

Co-authored-by: Karol Blaszczak <karol.blaszczak@intel.com>
2023-05-24 14:03:54 +04:00
Ilya Lavrenov
02b848d0b8 Unified cmake find_host_package and other host commands (#17662)
* Unified cmake find_host_package and other host commands

* should work

* Moved files
2023-05-24 08:43:59 +00:00