Commit Graph

312 Commits

Author SHA1 Message Date
Ilya Churaev
a730ef18eb Moved Task, Streams, CPUStreams Executors to new API (#15913)
* Moved Task, Streams, CPUStreams Executors to new API

* Fixed some build issues

* Fixed new build issues

* Try to fix tests

* Fixed inference unit tests

* Small build fix

* Added more system headers

* Try to fix naming style

* Fixed namespace

* Fixed android build
2023-02-24 15:20:32 +04:00
Haiqi Pan
3cc888555a fix ov::shutdown align definition (#15901) 2023-02-23 17:31:34 +04:00
Ilya Churaev
893f96a7da Extend tensor API (#15811)
* Added some new tensor API

* Added tests on constructors

* Small changes

* Fixed tensor tests

* Fixed tests

* Added parametrized tests

* Extend tests and delete copy_to from remote tensor
2023-02-22 17:43:15 +01:00
Ilya Churaev
27ea9eab32 Moved executor manager to new API (#15871)
* Moved executor manager to new API

* Fixed template plugin build

* Remove setTBBFlag API

* Fixed export

* Added new files

* Revert "Added new files"

This reverts commit 981c3c863f.

* Fixed template plugin tests

* Remove redundant wrapper

* Remove wrappers for executor manager

* Fixed build
2023-02-22 17:19:35 +01:00
Ilya Churaev
877018bab6 Moved Cache manager to new API (#15872)
* Moved Cache manager to new API

* Moved cache guard to ov namespace

* Added new files
2023-02-22 10:51:33 +00:00
Ilya Churaev
548f972e19 Added ov::IVariableState (#15843)
* Added ov::IVariableState

* Added variable state

* Try to fix Windows

* Fixed export
2023-02-22 14:30:46 +04:00
Wang, Yang
7f3ea9a59c Conversion fail for ov::hint::performance_mode with UNDEFINED value (#15629)
* Update ov::hint::performance_hint UNDEFINED value from empty string to "UNDEFINED".

* Update benchmark Python version.

* Update.

* Update.

* Update.

* Update the description about hint setting within benchmark APP README and help message.
2023-02-22 13:01:18 +04:00
Ilya Churaev
a5ec5f5476 Move template infer request (#15696)
* Move Template Infer Requests to new API

* Removed const_pointer_cast from plugin

* Fixed tests

* Fixed async tests

* Fixed some comments

* Added print ov::Tensor

* Fixed ONNX Frontend tests with multiple outputs to the same tensor

* Revert "Added print ov::Tensor"

This reverts commit b752f506bb.

* Fixed ov_core tests

* Fixed some tests

* Fixed batched tensors tests

* Fixed some tests

* Fixed more tests

* Fixed template plugin tests

* Fixed LP tests

* Fixed some comments

* Fixed some documentation issues

* Fixed comments

* Increase timeout because build termenated in case of common changes
2023-02-21 07:03:07 +04:00
Pawel Raasz
69728cb4ef Use new evaluate in template plugin (#15753)
* Use new evaluate method in template plugin

* Add tensor at the end of each iteration

* Remove class TemporaryOverrideOutputs

* Set shape of tensor after evaluate

* Revert "Remove class TemporaryOverrideOutputs"

This reverts commit e345ba9188.

* Update tensors when evaluate passed

* Copy data Tensor when HostTensor was initialized

* Set shape to output tensor in TemporaryOverrideOutputs

* Fix code style

* Add test

* Remove unused code

* Create reshape with scalar when shape is empty

* Reshape, special_zero = true

* Revert "Create reshape with scalar when shape is empty"

This reverts commit 0f901f419a.

* Use Shape with size zero and value max_int for dynamic tensors

* Restore Shape{0} for dynamic tensors

* Revert "Restore Shape{0} for dynamic tensors"

This reverts commit cb2d0e58eb.

* Temporary remove the test

* Use shape{0} for dynamic tensors

* Revert "Use shape{0} for dynamic tensors"

This reverts commit 08460a486b.

* Use Shape{0} for dynamic tensors

* Use new evaluate in template plugin
- Add tensor conversion between ov::Tensor <-> HostTensor
- Add shape utils to create special case shape to be dynamic shape
- Utils are in dev API to remove duplicates

* Move WA for set shape into the ov::tensor.

* Remove dynamic shape from or_tensor helper

* Mark tensor conversion utils as deprecated
- move shape util as core internal only
- update transpose test to not use deprecated functions

* Add missing deprecate suppression macro

---------

Co-authored-by: Artur Kulikowski <artur.kulikowski@intel.com>
2023-02-20 10:50:42 +04:00
River Li
9cc8bc882b [CC]Add CC support for ir reader (#15659)
* Add CC support for ir reader

Change-Id: I3e1c02222800be090a4307bff8c231ad28b23ff7

* Fix clang issue

Change-Id: Idaf7bc5632bd558cfb7b0ecd8891435e5ba5c6ca
2023-02-18 15:43:19 +04:00
Xuejun Zhai
91df0a8aa9 [API remove] remove variantImpl & variantwrapper related class/interfaces (#15580)
* [API remove] remove variantImpl & variantwrapper related class/interfaces

Signed-off-by: xuejun <xuejun.zhai@intel.com>

* [Remove APIs] fix code format issue

Signed-off-by: xuejun <Xuejun.Zhai@intel.com>

* [Remove api] fix python compiler issue caused by deprecated varient

Signed-off-by: xuejun <Xuejun.Zhai@intel.com>

* [Remove APIs] fix code format issue

Signed-off-by: xuejun <xuejun.zhai@intel.com>

---------

Signed-off-by: xuejun <xuejun.zhai@intel.com>
Signed-off-by: xuejun <Xuejun.Zhai@intel.com>
2023-02-17 16:31:26 +04:00
Wang, Yang
a088d1ab7d Disable core::set_property() to support ov::device::properties setting (#15175)
* Disable set_property() to support ov::device::properties setting.

* Update benchmark APP to set device properties through compile_model() instead of through set_property().

* Update.

* Update.

* Update some test case including ov::device::properties setting via core.ser_property().

* Since core.set_property() didn't support ov::device::properties setting, just remove the test case to check compile_model() works well if setting ov::device::properties via core.set_property() first.

* Update CompileModel in test name to CompiledModel

Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>

* Add corresponding test case.

Signed-off-by: Wang, Yang <yang4.wang@intel.com>

* Update.

* Update.

* Remove the changes of this commit as this modification has nothing to do
with this PR.

This reverts commit 4f04b9f085.

---------

Signed-off-by: Wang, Yang <yang4.wang@intel.com>
Co-authored-by: Chen Peter <peter.chen@intel.com>
Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>
2023-02-17 10:15:38 +04:00
Wang Wangwang
d7f47aa122 Provide ENABLE_STARTUP_FALLBACK property to enable/disable CPU as acc… (#14503)
* Provide ENABLE_STARTUP_FALLBACK property to enable/disable CPU as acceleration

* Add more test cases to ENABLE_STARTUP_FALLBACK property

* Remove unnecessary config

* Remove plugin.hpp

* Update test case by PR#14754

* Update copyright

Co-authored-by: River Li <river.li@intel.com>

* Simplify using namespace

---------

Co-authored-by: Chen Peter <peter.chen@intel.com>
Co-authored-by: River Li <river.li@intel.com>
2023-02-17 11:15:07 +08:00
Ilya Churaev
b80d05e0e1 Added classes for Sync and Async infer requests (#15387)
* Added classes for Sync and Async infer requests

* Changed hierarchy of Infer requests

* Fixed code style

* Fixed some tests

* Fixed naming style

* Fixed template plugin build

* Temporary disable python tests

* Revert "Temporary disable python tests"

This reverts commit c9aa9d79f8.

* Fixed template plugin tests

* Disable python tests

* Disable more steps

* Merged CI

* Revert "Merged CI"

This reverts commit 2f69574870.

* Try to fix segfault in python tests

* Remove default constructor

* Fixed documentation

* Fixed CPU tests

* Fixed Windows build

* Fixed comments

* Fixed build
2023-02-14 06:59:53 +04:00
Fang Xu
62dd3c5218 remove tbb version check for using tbbbind static library (#15627)
* remove tbb version check for using tbbbind static library

* fix build error

---------

Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>
2023-02-13 17:34:04 +00:00
Shen, Wanglei
115014d3ad Enable test cases for windows parser for CPU mapping table (#15589)
* update test cases for windows cpu mapping parser

* fix code style issue

* fix code style issue

* fix code style issue

* update test data for Linux parser to align with Windows test case

* ufix code style issue

* update test data for Android build

* update linux CPU map parser fix

* fix code style issue

* fix test data issue

* fix size_t warning

* fix size_t warning
2023-02-13 15:55:39 +08:00
Ilya Lavrenov
646778b63f Fixed warnings on Windows in CC build (#15666) 2023-02-13 11:52:20 +04:00
Shen, Wanglei
8b1b4de21d fix clang issue of parser test cases for Android build (#15626)
* fix clang issue for Android build

* update test data for parser

* update Linux CPU map parser
2023-02-10 21:37:17 +08:00
Ilya Lavrenov
84ecacda26 Windows ARM64 support via LLVM (#15585) 2023-02-09 11:30:07 +04:00
Shen, Wanglei
d72deb955d move CPU mapping parser API from dev_api header file to specific header file (#15558)
* move CPU mapping parser API to specific header file

* keep all enum defination in ie_system_conf.h

* move hpp file to inference/src

* fix code style issue
2023-02-08 18:27:14 +04:00
Ilya Lavrenov
1f3e469c5e Added -Wall for Clang and GCC (#15513)
* Added -Wall for Clang and GCC

* Fixes

* Don't use /J

* Fixed warnings

* Fixed warnings

* More fixes

* Fixed for MSVC

* Fixed more warnings on Windows

* Suppressed some warnings in template plugin

* Update src/tests/functional/plugin/shared/include/behavior/plugin/caching_tests.hpp

* Added suppression for PT FE

* Suppressed warnings in TF FE

* Suppressed warnings on Core unit tests

* Suppress warnings in python

* Suppressed Windows warning for 3rd party modules

* Suppresed one more warning
2023-02-08 15:01:00 +04:00
Ilya Churaev
68ccd078dc Export TBlob specialization for Windows (#15516)
* Export TBlob specialization for Windows

* Changed macro in define

---------

Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>
2023-02-07 22:11:49 +04:00
Shen, Wanglei
79cad1032b enable new method to generate CPU information and CPU map on Windows (#14710)
* enable new method to generate CPU information and CPU map

* fix code style issue

* fix initialization issue of variable-sized object

* fix dependency issue

* add sample of CPU map

* add description and sample for CPU map

* fix code style issue

* fix code style issue

* add comments on using second processor as physical core

* enable new method to generate CPU information and CPU map on windows

* remove debug output

* add description for CPU map table

* remove changes for linux

* update description for better understanding

* update CPU mapping table on Windows

* fix precision issue of log2()

* fix memory leak

* use shared_ptr to manage  memory life cycle

* Wrap parser for Windows into a separate function for mock testing later

* Revert "Wrap parser for Windows into a separate function for mock testing later"

This reverts commit 614ad718c2.

* add core type table for each socket on windows

* separate CPU map parser on Windows for validation

* fix core type table definition

* fix DWORD issue in header file

* update parser interface for validation

* fix socket count

* update processor count for XEON

* add discrption and example for processor type table

* remove conflicts

* fix merge conflicts

* fix document issue
2023-02-07 20:28:49 +08:00
Shen, Wanglei
63b2c072c0 update Linux CPU map parser and add unit test (#15113)
* update linux CPU map parser and add unit test

* add one more test data

* fix clang issue

* update test case by using TEST_P

* fix code style issue

* add one more test data with hyper threading off

* remove duplicated test data

* fix issue for Windows build

* fix issue for Windows build

* add description for test data

* add core type table for each socket

* fix code style issue

* fix code style issue

* remove redundant content

* remove parse_processor_info_linux() from INFERENCE_ENGINE_API_CPP

* fix code style issue

* update example of core type table

* fix code style issue
2023-02-07 13:54:40 +08:00
Nadezhda Ageeva
049cfcb72c [nGraph]: fix fused names for ShuffleChannelsFusion transformation (#15150)
* [nGraph]: fix fused names for ShuffleChannelsFusion transformation

* Review comments
2023-02-03 12:45:12 +00:00
Ilya Churaev
1bb8223ecd Template ov plugin (#15220)
* Initial migration of TemplatePlugin to ov::IPlugin interface

* Fixed segfault

* Fixed static build and some template tests

* Fixed code style

* Fixed some template tests

* Fixed scale tests

* Disabled transformations in the template plugin

* Fixed ONNX tests

* Fixed compilation

* Fixed core tests

* Fixed some crashes

* Small fixes

* Migrate to ICompiledModel

* Fixed some behaviour tests (add legacy names and supported_properties)

* Fixed output precisions

* Fixed some tests

* Changed parameter->result test

* Fixed some preprocessing tests

* Added mean image preprocessing

* Disabled some tests

* Fixed some template tests

* Try to fix not implemented false

* Try to fix template tests

* Fixed doc

* Catch ov::NotImplemented exception

* Small changes

* Fixed build

* Try to fix build

* Fixed some comments

* Use new properties

* Fixed documentation

* Fixed properties
2023-02-03 13:37:40 +04:00
Ilya Churaev
ae3bddd25c Fixed cc build (#15446) 2023-02-02 11:24:18 +04:00
Vitaliy Urusovskij
29b15233c7 Remove OV_FRONTEND_PATH (#15364)
* Remove "OV_FRONTEND_PATH" from `FrontEndManager`

* Remove "OV_FRONTEND_PATH" from layer_tests

* Remove "OV_FRONTEND_PATH" from find_ie_version.py

* Remove "OV_FRONTEND_PATH" from .ci/

* Move `ov::get_plugin_path` to file_util.hpp (ov::util)

* Add `register_front_end(name, path)` FEM public API

* Enable frontend/ tests

* ClangFormat

* Remove OV_FRONTEND_PATH from FE shared utils

* Add `register_front_end()` to PythonAPI

* Update Py tests with registering of "mock_py" FE

* ClangFormat

* Leftovers

* Fix SegFault with `register_front_end(name, lib_path)`

* Add FE_LIB_PRE and FE_LIB_SUFFIX to `ov_core_unit_tests`

* Fix format

* Update `testFailRegisterFEByWrongPath`
2023-02-02 08:19:35 +04:00
Artur Kulikowski
4e064b02a0 Add test to verify add_extension with relative path (#15212)
* Add test to verify add_extension with relative path

* Fix code style

* Use std::string::find instead of std::regex

* Remove unnecessary include

* Add comments about generating relative path

* Don't add empty tokens when splitting path
2023-01-31 11:40:31 +04:00
Ilya Churaev
76a0abf3cf Fixed compiled model leftovers (#15385) 2023-01-30 11:28:23 +04:00
Ilya Churaev
635bfd848e Introduce ov::ICompiledModel interface (#15276)
* Introduce ov::ICompiledModel interface

* Fixed code style

* Fixed mock

* Fixed Inference Functional tests

* Fixed typo

* Fixed supported properties

* Fixed tests

* Changed API

* Added comments

* Fixed python build
2023-01-30 07:39:09 +04:00
Ilya Churaev
369bce2e07 Remove legacy constant folding from core (#15315) 2023-01-27 09:09:05 +04:00
Vitaliy Urusovskij
ef8481d008 Apply snake_case to ov::Core API (#15313) 2023-01-27 00:47:04 +00:00
Ilya Churaev
033368caab Removed redundant convert_model from CoreImpl (#15231)
* Removed redundant convert_model from CoreImpl

* Fixed code style

* Removed redundant clones and fixed tests

* Removed methods from header

* Fixed CC

* Fixed tests

* Removed code duplication

* Removed caching from v7 logic

* Completely remove compute hash for CNNNetwork

* Removed legacy code

* Revert logic which is used in tests

* Try to understand the issue

* Revert "Try to understand the issue"

This reverts commit 72abf3a354.

* Revert "Revert logic which is used in tests"

This reverts commit 845e392bdd.

* Fixed tests

* Remove legacy test

* Revert query_model logic

* Revert "Revert query_model logic"

This reverts commit b694cd6999.

* Revert "Revert "Revert query_model logic""

This reverts commit 0df850838a.

* Fixed master build

* Revert "Revert "Revert "Revert query_model logic"""

This reverts commit 3bb2af2250.

* Revert changes with query_model
2023-01-26 13:29:02 +04:00
Mateusz Tabaka
3ad92084d6 Fix MarkDequantizationSubgraph when Mul has Convert on both inputs (#14997)
Ticket: 100042
2023-01-26 08:55:23 +00:00
Ilya Lavrenov
0970bc8fcf Moved legacy library and deprecated tests to GNA (#15244) 2023-01-25 11:36:22 +04:00
Ilya Churaev
a3fafda1bc Ignore empty tensor for hash calculation (#15282)
* Ignore empty tensor for hash calculation

* Added test
2023-01-25 10:02:51 +04:00
Tomasz Jankowski
988847f559 Transformation component transition to OV namespace (phase 4) (#13558)
* Use openvino pass graph_rewrite

* Replace use of ngraph::pass to ov::pass

* Remove ngraph::pass aliases

* Update after rebase

* Fix post merge conflicts

* Apply code style

* Apply code style

* Remove bypassing inclusion

* Apply code style
2023-01-25 01:02:35 +03:00
Vitaliy Urusovskij
54ea2612ae [Core] Safe loading of default plugins (#15073)
* Safe loading of default plugins

1. In case of default plugins.xml all plugins is registered by
absolute paths
2. In case of user API user is able to specify abs or rel path
or plugin name to be found in ENV
3. Update `ov::util::get_absolute_file_path()` in order to prevent
checking file exists or can be accessed
4. Add tests + delete duplicated tests

* Add `OV_CORE_CALL_STATEMENT` to `Core()` ctor
to convert InferenceEngine::Exception to
ov::Exception

* Add `ie_plugins.hpp` dependency to `ov_infer_unit_tests`

* Update C and Py docstrings

* Comment fix

* Update LD_LIB_PATH in openvino-onnx/Dockerfile

* Skip `test_register_plugin*` for Debian job
2023-01-24 14:53:00 +04:00
Ilya Churaev
07c68ffc36 Fixed Windows crash: map/set iterators incompatible (#15267) 2023-01-23 18:15:30 +00:00
Ilya Churaev
ba908e8e2f Fixed some leftovers (#15251)
* Fixed some leftovers

* Remove callback

* Changed logic
2023-01-23 16:02:58 +04:00
Ilya Churaev
7ff9f80c68 Remove plugin.hpp (#15229) 2023-01-21 04:30:38 +04:00
Ilya Churaev
e2635a0053 Introduce ov::ICore (#15096)
* Added new ov::ICore

* Fixed style and removed unused functions

* Fixed mock core

* Fixed linker issue

* Fixed inference functional tests

* Update copyrights

* Use new plugin API inside the new API

* Fixed CPU tests

* Removed old plugin from ov::IPlugin

* Fixed Inference tests

* Added comments and some other minor changes

* Split core interfaces

* Added logic to load v7 IRs without crash

* Fixed thread tests

* Fixed comments:

 * Add const keyword for core methods
 * Rename core methods

* Fixed mock core

* Added more const methods

* Fixed tests

* Remove unnecessary exception catch

* Fixed some comments

* Remove default implementations of get/set property

* Fix additional comments

* Removed set property

* Try to fix linux build

* Revert function move
2023-01-20 13:43:48 +04:00
Vladimir Paramuzov
2201a5f83e Added common ov::execution_mode hint (#15048)
* [GPU] Added common exec mode hint and gpu support

* Add ov::inference precision and update usages. Deprecate ov::hint::inference_precision property

* [GPU] Execution mode tests and fixes

* Fixed code style

* Moved execution_mode test to common. Fixes for python API

* Remove deprecations for hint::inference_precision and just keep both

* Fix test
2023-01-18 20:13:00 +04:00
Alexandra Sidorova
6525dd4727 [Snippets][CPU] Added FP32 MHA tokenization support (#14327) 2023-01-18 16:59:21 +04:00
Artur Kulikowski
6ec71c376a Resolve relative path to the extension (#15047)
* Resolve relative path to the extension

* Add symbol to library inside cwd

* Set relative path to the current path

* Remove test
2023-01-18 16:48:11 +04:00
Ilya Lavrenov
c4eeecfec5 Remove myriad plugin (#15131)
* Removed Intel MYRIAD plugin

* Removed Intel MYIAD from CI files

* Removed Intel MYRIAD from cmake folder

* Removed MYRIAD, HDDL from samples

* Removed MYRIAD, HDDL from scripts folder

* Removed MYRIAD from bindings folder (C and Python API)

* Removed MYRIAD tests

* Removed MYRIAD from tests folder

* Removed MYRIAD from tools folder

* Removed HDDL (VAD), MYRIAD (NSC2) from documentation

* Fixed build for AUTO unit tests

* Fixed clang code style

* Fixed comments and issues

* removed MYRIAD from AUTO tests

* Disabled MULTI tests in CI

* Update docs/OV_Runtime_UG/auto_device_selection.md

Co-authored-by: Yuan Xu <yuan1.xu@intel.com>

* Update docs/get_started/get_started_demos.md

Co-authored-by: Yuan Xu <yuan1.xu@intel.com>

* Update docs/OV_Runtime_UG/deployment/local-distribution.md

Co-authored-by: Yuan Xu <yuan1.xu@intel.com>

Co-authored-by: Yuan Xu <yuan1.xu@intel.com>
2023-01-18 15:19:44 +04:00
Ilya Lavrenov
c29f111717 Enabled Windows ARM64 build using MSVC cl compiler (#15132)
* Fixed Windows Arm64 build

* Fixed linker warnings in docs

* Fixed Windowd ARM build

* Reverted changes in docs

* Added OpenVINO level macro to define CPU architecture

* Properly remove xbyak from reference kernels optimizations

* Added documentation for cmake functions

* Fixed samples build

* Added installation dir for host protoc

* Fixed installation stage for host_protoc

* Added build dir

* Fixed compilation on Apple

* cççç

* Fixed clang code-style

* Tely on CPU id from xbyak

* Fixed build

* Fixed compilation on mac

* Fixed compilation
2023-01-17 17:29:00 +04:00
Eddy Kim
14a7e443d0 Adding missed conversion logics between layout and string (#15103)
* added missed layout to string conversion

* added an unit test for layout_from_string

* added missing spaces around =

* replaced 95 with SCALAR

* moved layout_to_string into a new file

* changed to parametrized test
2023-01-16 17:32:30 +04:00
Ilya Churaev
0c9abf43a9 Updated copyright headers (#15124)
* Updated copyright headers

* Revert "Fixed linker warnings in docs snippets on Windows (#15119)"

This reverts commit 372699ec49.
2023-01-16 11:02:17 +04:00