Commit Graph

460 Commits

Author SHA1 Message Date
Maxim Vafin
4fac7eabc0 Use shared constant in pytorch decoder (#15917)
* Use shared constant in pytorch decoder

* Fix contigious array

* Support scalars

* Apply suggestions from code review

* Apply suggestions from code review

Co-authored-by: Ekaterina Aidova <ekaterina.aidova@intel.com>

---------

Co-authored-by: Ekaterina Aidova <ekaterina.aidova@intel.com>
2023-02-26 11:39:27 +01:00
Artyom Anokhov
bd8c7506f0 requirements-dev: top-limited setuptools with 65.7.0 (#15946) 2023-02-25 14:54:50 +04:00
Jan Iwaszkiewicz
6c0e2686ad [PyOV] Fix passing of the key in data dispatcher (#15941) 2023-02-24 23:07:59 +04:00
Ilya Lavrenov
bd61d317f8 Revert "Install patchelf for aarch64 linux (#15865)" (#15919)
This reverts commit e34d4e4664.
2023-02-23 23:02:00 +04:00
Jan Iwaszkiewicz
3373c6743f [PyOV] Shared memory improvements for Tensor and Constant classes (#15814) 2023-02-23 13:46:41 +01:00
Anastasia Kuporosova
592ad68455 [PyOV] Fix deprecation warning in tests (#15830)
* [PyOV] Fix deprecation warning in tests

* Update src/bindings/python/tests/test_graph/test_manager.py
2023-02-22 18:08:49 +01:00
Ilya Lavrenov
e34d4e4664 Install patchelf for aarch64 linux (#15865) 2023-02-22 12:55:27 +04:00
Ilya Lavrenov
1d5839fb92 Fixed compilation with clang (#15801) 2023-02-19 16:22:18 +04:00
Ilya Lavrenov
ed5fa69b41 Fixed compilation on CI (#15787) 2023-02-17 22:28:48 +04:00
Xuejun Zhai
91df0a8aa9 [API remove] remove variantImpl & variantwrapper related class/interfaces (#15580)
* [API remove] remove variantImpl & variantwrapper related class/interfaces

Signed-off-by: xuejun <xuejun.zhai@intel.com>

* [Remove APIs] fix code format issue

Signed-off-by: xuejun <Xuejun.Zhai@intel.com>

* [Remove api] fix python compiler issue caused by deprecated varient

Signed-off-by: xuejun <Xuejun.Zhai@intel.com>

* [Remove APIs] fix code format issue

Signed-off-by: xuejun <xuejun.zhai@intel.com>

---------

Signed-off-by: xuejun <xuejun.zhai@intel.com>
Signed-off-by: xuejun <Xuejun.Zhai@intel.com>
2023-02-17 16:31:26 +04:00
Ilya Lavrenov
672522492e Changed sample's format_reader libraries type from dynamic to static (#15756) 2023-02-17 09:30:19 +04:00
Maxim Vafin
878e24d6f6 [PT FE] Better handle tensor names (#15718)
* Add debugNames, smartly handle tensor names, add TranslateSession

* Add friendly name specification in mark_node

* Fix code style

* Fix supported_impl logic

* Fix supported logic 2

* Optimize includes
2023-02-16 20:26:08 +01:00
Haiqi Pan
3f06d871bf Remove catch(...) code style (#14433)
* remove ... in /src/bindings/c and resolve format

* remove ... in auto and resolve format

* remove ... in auto batch and resolve format

* remove ... in hetero and resolve format

* IE exception

* IE exception

* const

* const

* resolve format and ov::Exception

* ov::Exception

* reset IE::Exception

* remove ov::Exception

* InferenceEngine->IE in auto_schedule.cpp

* fix coredump while runing test case smoke_AutoMultiMock_NumStreamsAndDefaultPerfHintToHWTest

* fix coredump issue of running LoadNetworkWithSecondaryConfigsMockTest

* fix commpile fail in CI

* resolve core dump of running exec_network_get_metrics.cpp and disable some test cases for KEEMBAY and MYRIAD in exec_network_get_metrics.cpp

* remove test cases of MYRIAD and resolve core dump of running KEEMBAYin exec_network_get_metrics.cpp

* resolve conflic of common.h

* resolve conflic of common.h

* resolve common.h complie fail

---------

Co-authored-by: guozhong <guozhong.wang@intel.com>
Co-authored-by: Ilya Churaev <ilya.churaev@intel.com>
2023-02-16 11:44:24 +08:00
Maxim Vafin
6c72ea4bea [PT FE] Check number of inputs, use rank function (#15656)
* Check number of inputs, use rank function

* Change min inputs in flatten

* Fix code style

* Fix aten::tensor and aten::_convolution number of inputs

* Refactor NodeCOntext a little

* Fix codestyle
2023-02-13 09:58:21 +01:00
Anastasia Kuporosova
6f0313b2c4 [PyOV] Support BytesIO in read_model and load (#15498)
* [PyOV] Support BytesIO in read_model

* fix path

* load support

* apply comments

* add test

* apply comments

* add error msg

* Update src/bindings/python/src/pyopenvino/core/core.cpp

* Update src/bindings/python/src/pyopenvino/core/core.cpp

* codestyle

* Update src/bindings/python/tests/test_runtime/test_core.py

* add space
2023-02-10 23:00:56 +01:00
Jan Iwaszkiewicz
2769e22767 [PyOV] Adding optimizations and shared memory mode to inference calls (#15290)
* Proposal of data_dispatcher

* Fix C-style for array-like objects

* Added test cases

* Add InferRequestInternal to hold lifetime of converted data

* Change name and location of InferRequestInternal to _InferRequestWrapper

* Fixes for shared data mode to match previous tests, codestyle refactoring

* Fix annotations and style

* Add initial testing

* Fix dtype capture

* Fix set_request_tensor

* Extend doc strings

* Fix docs

* Docs fix

* Change to ndarray in docs

* Fix async case

* Fix async test 2

* Remove linter issue
2023-02-09 10:50:39 +01:00
Ilya Lavrenov
84ecacda26 Windows ARM64 support via LLVM (#15585) 2023-02-09 11:30:07 +04:00
Ilya Lavrenov
1f3e469c5e Added -Wall for Clang and GCC (#15513)
* Added -Wall for Clang and GCC

* Fixes

* Don't use /J

* Fixed warnings

* Fixed warnings

* More fixes

* Fixed for MSVC

* Fixed more warnings on Windows

* Suppressed some warnings in template plugin

* Update src/tests/functional/plugin/shared/include/behavior/plugin/caching_tests.hpp

* Added suppression for PT FE

* Suppressed warnings in TF FE

* Suppressed warnings on Core unit tests

* Suppress warnings in python

* Suppressed Windows warning for 3rd party modules

* Suppresed one more warning
2023-02-08 15:01:00 +04:00
Ilya Churaev
26108b1b67 Deprecate clone_model API, use model->clone() instead of (#15482)
* Deprecate clone_model API, use model->clone() instead of

* Renamed clone_nodes function

* Fixed exception
2023-02-07 23:53:17 +04:00
Ilya Lavrenov
6865f8f147 Fixed C API tests build (#15530) 2023-02-06 19:08:33 +04:00
River Li
b04513c92e [C API] remote tensor support (#13719)
* [C API] remote tensor support

Provide C interface for remote context and remote tensor:
   1. OCL and VA context and buffer support
   2. unite test for remote context and remote tensor

Change-Id: I2c449aef21cbe928ca470b4e3bcf1e03a1d1ca43

* Fix clang issue

Change-Id: I83c9592d21ff9cb8aeb85148277d96db74b455c7

* [CAPI] Add ocl nv12 input inference test case

1. Add fully nv12(2 ocl remote tensor) as input plus preprocess do csc+resize, then do inference
2. Add get_device_name for remote tensor
3. Add test case for preprocess to set mem type

Change-Id: Ieaab50c8de20e5c7258697030672e0b010627a81

* Update documentation

Change-Id: Ia7dbaea48d38f5534aba60fbb25cd0a1f2f9eab0

* Remove debug code

Change-Id: Ic5c5a24d3c40bb258b7007dcea44594af2d92344

* Fix issues brought by rebase

Change-Id: I2520c5ccf3620349e202ea40c08bb1c437d5af88

* Resolve document issue

Change-Id: Ia14500f8623147f481dda286a0afaa8ecfffa7c9

* Resolve some comments
1. Add specific header file for gpu plugin
2. clang-format issue
3. interface compatible issue

Change-Id: Icc4723af071af30f0422ac9a107e57ddeec94aac

* fix clang issue

Change-Id: I46e1fed3dd9a4e51260b695dc3fb194b9571ed58

* Add gpu header file directory

Change-Id: I8c15d9da58a46c070dcc68530cb2beea8cd4bba9

* Remove HAVE_OCL_SUPPORT macro

Change-Id: I10093a99c1858649f1c5502248729704fcec34ef

* Address some comments

Change-Id: I72830288d063623641e8946c8470631e81fdeb34

* Printov:AnyMmap with the help of ov::Any

Change-Id: I8abd3a8d94ba8116974c59a489cda2af15f225d7
2023-02-06 16:27:53 +08:00
Jan Iwaszkiewicz
b94e8c2f25 [PyOV] Add ExecutionMode enum and property (#15497) 2023-02-04 13:10:44 +04:00
Ilya Lavrenov
de1631d67d Generalized OpenCL handling (#15253)
* Squashed commit of the following:

commit 62c992f6a0bc3a2f559faac6912be9c5632a359f
Author: Ilya Lavrenov <ilya.lavrenov@intel.com>
Date:   Sun Jan 22 11:38:18 2023 +0400

    Generalized OpenCL handling

* Updates

* Fixes

* Update thirdparty/CMakeLists.txt

test

* Fixed build with CL/cl2.hpp

* Fixes

* Fixes

* Fixed compilation flags

* Fixed build with target OpenCL 120

* Don't use cache
2023-02-03 15:36:47 +00:00
Ilya Churaev
1bb8223ecd Template ov plugin (#15220)
* Initial migration of TemplatePlugin to ov::IPlugin interface

* Fixed segfault

* Fixed static build and some template tests

* Fixed code style

* Fixed some template tests

* Fixed scale tests

* Disabled transformations in the template plugin

* Fixed ONNX tests

* Fixed compilation

* Fixed core tests

* Fixed some crashes

* Small fixes

* Migrate to ICompiledModel

* Fixed some behaviour tests (add legacy names and supported_properties)

* Fixed output precisions

* Fixed some tests

* Changed parameter->result test

* Fixed some preprocessing tests

* Added mean image preprocessing

* Disabled some tests

* Fixed some template tests

* Try to fix not implemented false

* Try to fix template tests

* Fixed doc

* Catch ov::NotImplemented exception

* Small changes

* Fixed build

* Try to fix build

* Fixed some comments

* Use new properties

* Fixed documentation

* Fixed properties
2023-02-03 13:37:40 +04:00
Maxim Vafin
3c919134b1 Fix issue with If and bool type (#15457) 2023-02-02 22:32:40 +01:00
Xuejun Zhai
5030660b9f Xuejun/fix cvs 98110 (#14534)
* [CAPI][UNITE TEST] 1) create plugin test xml file in runtime; 2) fix arm plugin test error;

Signed-off-by: xuejun <Xuejun.Zhai@intel.com>

* [CAPI] fix format issue

Signed-off-by: xuejun <Xuejun.Zhai@intel.com>

* [CAPI] change the time of Copyright

Signed-off-by: xuejun <Xuejun.Zhai@intel.com>

---------

Signed-off-by: xuejun <Xuejun.Zhai@intel.com>
2023-02-02 11:01:37 +04:00
Vitaliy Urusovskij
29b15233c7 Remove OV_FRONTEND_PATH (#15364)
* Remove "OV_FRONTEND_PATH" from `FrontEndManager`

* Remove "OV_FRONTEND_PATH" from layer_tests

* Remove "OV_FRONTEND_PATH" from find_ie_version.py

* Remove "OV_FRONTEND_PATH" from .ci/

* Move `ov::get_plugin_path` to file_util.hpp (ov::util)

* Add `register_front_end(name, path)` FEM public API

* Enable frontend/ tests

* ClangFormat

* Remove OV_FRONTEND_PATH from FE shared utils

* Add `register_front_end()` to PythonAPI

* Update Py tests with registering of "mock_py" FE

* ClangFormat

* Leftovers

* Fix SegFault with `register_front_end(name, lib_path)`

* Add FE_LIB_PRE and FE_LIB_SUFFIX to `ov_core_unit_tests`

* Fix format

* Update `testFailRegisterFEByWrongPath`
2023-02-02 08:19:35 +04:00
Maxim Vafin
92649105ed Add eltwise types resolving. Support big int constants. (#15415)
* Add eltwise types resolving. Support big int constants.

* Update src/bindings/python/src/openvino/frontend/pytorch/decoder.py

* Small fix

* Fix some cases

* Add tests for add in different types

* Add tests for mul

* Add tests for sub and div

* Small fixes

* Return list handling (needed for empty lists)

* Add test for empty list

* Update src/frontends/pytorch/src/op/mul.cpp

Co-authored-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Use refs instead of ptrs

* Apply suggestions from code review

Co-authored-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Apply code review suggestions

* Fix code style

* Add more eltwise ops

---------

Co-authored-by: Roman Kazantsev <roman.kazantsev@intel.com>
2023-02-02 02:15:33 +01:00
Anastasia Kuporosova
ce287067d5 [PyOV] Change default opset9->opset10 (#15238) 2023-02-01 13:44:58 +01:00
Anastasia Kuporosova
de74d3c837 [PyOV] Try to fix PosixPath error in CI (#15377) 2023-01-31 11:58:15 +01:00
Ilya Lavrenov
d092f5d7dd Setup minimum supported version for pybind11 (#15397) 2023-01-31 11:48:15 +04:00
Mateusz Bencer
e409f708e0 [ONNX FE] Added support of DFT operator (#15280) 2023-01-30 08:46:09 +01:00
Ilya Churaev
635bfd848e Introduce ov::ICompiledModel interface (#15276)
* Introduce ov::ICompiledModel interface

* Fixed code style

* Fixed mock

* Fixed Inference Functional tests

* Fixed typo

* Fixed supported properties

* Fixed tests

* Changed API

* Added comments

* Fixed python build
2023-01-30 07:39:09 +04:00
dependabot[bot]
d18f518582 Bump pytest from 7.2.0 to 7.2.1 in /src/bindings/python (#15351)
Bumps [pytest](https://github.com/pytest-dev/pytest) from 7.2.0 to 7.2.1.
- [Release notes](https://github.com/pytest-dev/pytest/releases)
- [Changelog](https://github.com/pytest-dev/pytest/blob/main/CHANGELOG.rst)
- [Commits](https://github.com/pytest-dev/pytest/compare/7.2.0...7.2.1)

---
updated-dependencies:
- dependency-name: pytest
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-01-27 13:33:18 +04:00
Anastasia Kuporosova
2cd1a574b7 [PyOV] Add deepcopy for Model (#15273)
* [PyOV] Add deepcopy for Model

* apply comment

* error for copy

* codestyle
2023-01-27 10:09:31 +01:00
Vitaliy Urusovskij
ea48786bc6 Fix "(un)register_plugin(s)" C and Py tests (#15291)
* Fix "(un)register_plugin(s)" tests

* Remove test skips on Debian after tests are fixed
2023-01-27 09:54:43 +04:00
Evgenya Stepyreva
0513a79a79 Tensorflow Lite frontend (#14977)
* Infrastructure for tflite

* Removed submodule flatbuffers

* Added flatbuffers submodule. Fixed version to v22.12.06 aka acf39ff

* Move headers back

* Flatbuffers integration

* Small fixes

* Started parsing the Model

* flatbuffer changes

* decoder_flatbuffer changes

* Lite Input Model -- not needed as of now but looks cool

* Rolled back inherritance from ov::frontend::tensorflow::InputModel

* Results are not treated as outputs, but its ok

* Fix missplaced input vs output

* Refactor

* Load model op-by-op. Frontend API finalized

* Debugging still, there are prints here and there. Decoder is not sane

* Convolution with all attributes is translated and quantization is applied for inputs and constatants. TODO: quantize intermediate tensors, separate decoder specific logic?

* Float ssd and posenet models are showing good accuracy

* Need to refactor but work flawlessly

* Telemetry and lightweight model cutting

* Code style and test changes. Extensions supported

* Quantization and style

* Style refinements

* Move onednn back

* New portion of operations enabled

* TFLite FE doesn't inherrit TF FE

* Moved files to another directory

* Rename header op_table.hpp to common_op_table.hpp for all files in src/frontends/tensorflow_common/src/op/

* Removed visability macroses

* CMake changes

* Unit-test execution in .ci

* Update labeler.yml

* Codeowners

* Style check and fix

* Static Build arrangement

* Addressing the comments

* install common headers to previous place

* New approach with public decoder and graph_iterator

* New approach with public decoder and graph_iterator

* Move GraphIterator back

* Comments addressed

* Comments adressed

* Preliminary TF FE README.md changes

* Added target_compile_definitions OPENVINO_STATIC_LIBRARY for static build

* Fixed conflicts and added TF to common places

* Frontends use only openvino::core::dev API

* Merged common tensorflow changes and made code build and work on selective number of models

* Style

* Rollback unnecessary changes from Tensorflow FE

* Rollback unnecessary changes from Tensorflow Common

* Minor refactor

* cmake minor refactoring

* Mixed commit

* Style and merge fix

* Low hanging fruit operations

* Fix windows build

* Refactor quantization parameters representation

* license compliance. approved by OS PDT

* copyrights in generic file

* dependabot

* labeler

* Unit Test to be triggered in CI

* cmake variables naming. corrected copyright years in copyrights/generic file

* library renamed in .ci/ calls

* Copyright year update

* Set openvino-tf-frontend-maintainers as owner of /src/frontends/tensorflow_lite/

* Fixed flatc corss-compilation

* Cleaned flatbuffers header usage

* Nitpicks solved

* Update cmake/templates/OpenVINOConfig.cmake.in

* Compile with flatbuffers headers

* Fixed "which is prefixed in the source directory"

* Fixed typo in flatbuffers cmake

* Removed flatbuffers submodule

* Added fork submodule

* Fixed static build

* Fixed cross-compilatio

* Fixed -Wshadow warning

* Fixed warning on Windows

* Use only headers from flatbuffers library

* Added LTO and fixed compilation errors on Windows

* Fixed warnings in tensorflow_common

* Move ctors implementation to cpp file

* Added information about new frontends to common FEm part

* Temporaryily disable warnings

* Fixed code style using clang-format

* Fixed Windows

* reverted changes in onnx

* Revert changes in onnx_common

* Removed pragma once frm cpp

Co-authored-by: missjane <estepyreva@gmail.com>
Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>
2023-01-27 06:27:59 +04:00
Jan Iwaszkiewicz
37317b130d [PyOV] Fix UserWarning in setup.py (#15334) 2023-01-26 22:02:17 +03:00
Anastasia Kuporosova
b4f069b9f9 [PyOV] Remove obsolete requirements (#15178)
* [PyOV] Remove obsolete requirements

* add cond for onnx

* cond

* cond

* cond
2023-01-26 19:51:48 +01:00
Anastasia Kuporosova
dd17aeead3 [PyOV] Update futureWarning in offline_transformations (#15319) 2023-01-26 17:12:21 +01:00
Maxim Vafin
994b227b86 Remove None at outputs of the model, improve types handling in frontend (#15258)
* Remove None at outputs of the model, improve types handling in frontend

* Fix py code style

* Add torch dependency in pybind tests

* Fix tests if fe is disabled and add backward type cpnversion

* Move decoder tests to layer tests

* Fix codestyle

* Add comment

* Move tests to separate folder

* Update .ci/azure/linux.yml
2023-01-25 13:28:47 +03:00
Tomasz Jankowski
988847f559 Transformation component transition to OV namespace (phase 4) (#13558)
* Use openvino pass graph_rewrite

* Replace use of ngraph::pass to ov::pass

* Remove ngraph::pass aliases

* Update after rebase

* Fix post merge conflicts

* Apply code style

* Apply code style

* Remove bypassing inclusion

* Apply code style
2023-01-25 01:02:35 +03:00
Vitaliy Urusovskij
54ea2612ae [Core] Safe loading of default plugins (#15073)
* Safe loading of default plugins

1. In case of default plugins.xml all plugins is registered by
absolute paths
2. In case of user API user is able to specify abs or rel path
or plugin name to be found in ENV
3. Update `ov::util::get_absolute_file_path()` in order to prevent
checking file exists or can be accessed
4. Add tests + delete duplicated tests

* Add `OV_CORE_CALL_STATEMENT` to `Core()` ctor
to convert InferenceEngine::Exception to
ov::Exception

* Add `ie_plugins.hpp` dependency to `ov_infer_unit_tests`

* Update C and Py docstrings

* Comment fix

* Update LD_LIB_PATH in openvino-onnx/Dockerfile

* Skip `test_register_plugin*` for Debian job
2023-01-24 14:53:00 +04:00
Ilya Lavrenov
90a7c083c6 Use manylinux2014 instead of manylinux_2_17 as a platform tag (#15224) 2023-01-23 23:46:10 +04:00
Anastasia Kuporosova
2cb3e6486e [PyOV] skip dynamic test for arm (#15257)
* [PyOV] skip dynamic test for arm

* Update src/bindings/python/tests/test_runtime/test_infer_request.py

Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>

Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>
2023-01-23 17:54:20 +01:00
Roman Kazantsev
0d201376df [Tests] Fix rest of NumPy deprecated types (#15245)
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
2023-01-21 11:17:52 +00:00
Anastasia Kuporosova
ceab44eee6 [Docs][PyOV] Add information about testing pyapi (#14645)
* [Docs][PyOV] Add information about testing pyapi

* apply comments and add links

* apply comments

* empty

* apply changes

* apply comments

* comments
2023-01-19 20:40:14 +01:00
Anastasia Kuporosova
fda677f153 [PyOV] Skip tests with bool for arm (#15208)
* [PyOV] Skip tests with bool for arm

* exec_net export test rewrite
2023-01-19 23:12:14 +04:00
Vitaliy Urusovskij
d5f3bfa43e RGB->Gray C and Py API2.0 (#15050)
* Add RGB to GRAY to C API 2.0

* Add RGB to GRAY to Py API 2.0

* ClangFormat + PyFlake8
2023-01-19 10:51:32 +04:00
Vladimir Paramuzov
2201a5f83e Added common ov::execution_mode hint (#15048)
* [GPU] Added common exec mode hint and gpu support

* Add ov::inference precision and update usages. Deprecate ov::hint::inference_precision property

* [GPU] Execution mode tests and fixes

* Fixed code style

* Moved execution_mode test to common. Fixes for python API

* Remove deprecations for hint::inference_precision and just keep both

* Fix test
2023-01-18 20:13:00 +04:00