Commit Graph
326 Commits
Author SHA1 Message Date
Ilya Churaev 5040f59c96 Use new CPUStreamsExecutor inside the old one (#16164) 2023-03-09 13:41:38 +04:00
Ilya Lavrenov c3b22af3f7 CoreImpl small refactoring (#16145)
* Small CoreImpl refactoring

* Removed cache_dirhandling from CPU plugin

* clang-format

* Fixed python tests

* Fix

* Fixed bugs in HETERO case

* Fixed clang-format and warnings in auto plugin

* Added import_export as capability for TEMPLATE plugin

* Commented throw exception from loaded_from_cache

* Fixed clang-formatof ro template plugin
2023-03-08 19:19:52 +04:00
Karol BlaszczakandIlya Churaev 3dbea43ef1 [DOCS] remove mentions of myriad throughout docs (#15690)
* remove ov::device::thermal

ov::device::thermal was only supported on myriad

* additional cleanup

* remove myriad from AUTO and MULTI

auto n multi n hetero

+ remove mentions of listing myriad devices

* two final fixes

* Update ov_auto.py

---------

Co-authored-by: Ilya Churaev <ilya.churaev@intel.com>
2023-03-08 17:29:08 +04:00
Szymon Irzabek e79636bfbb [GNA] Add 3.6 and 4.0 targets (#15735) 2023-03-07 17:14:59 +01:00
Nadezhda Ageeva 0dad7749b5 Fix RTInfo for ReduceL2Decomposition (#16107)
* Fix RTInfo for ReduceL2Decomposition

* Review comments
2023-03-07 10:24:55 +04:00
83b57e2a64 AUTO cumulative throughput mode ignore candidate device that fail to … (#15420)
* AUTO cumulative throughput mode ignore candidate device that fail to load device

* Simplify the judgement logic of whether Auto set to Multi

* Add description about _AutoSetToMulti variable

* Update variable name to _AutoCallMulti

* Refine logic of AUTO execution_devices

* Add loading error massage

* Add test case

* Add filter to execution_devices of MULTI

* Add execution_devices test in load fail sitution

* Simplify the logic of execution_devices

* Update auto_executable_network.cpp

* Update src/plugins/auto/multi_executable_network.cpp

Co-authored-by: yanlan song <bell.song@intel.com>

* Update src/plugins/auto/auto_executable_network.cpp

Co-authored-by: yanlan song <bell.song@intel.com>

* Update test case

---------

Co-authored-by: Chen Peter <peter.chen@intel.com>
Co-authored-by: yanlan song <bell.song@intel.com>
2023-03-07 11:52:25 +08:00
Xuejun Zhai 9b97235902 Xuejun/remove api in ov any (#15667)
* [Remove APIs] remove ov::any api  &

Signed-off-by: xuejun <Xuejun.Zhai@intel.com>

* [Remove APIs] remove ov::any api

Signed-off-by: xuejun <Xuejun.Zhai@intel.com>

* [Remove APIs] remove interfaces in ov::any  Base* operator->() & const Base* operator->()

Signed-off-by: xuejun <Xuejun.Zhai@intel.com>

* [Remove APIs] remove ov::any interfaces Base* get() & const Base* get()

Signed-off-by: xuejun <Xuejun.Zhai@intel.com>

* [Remove APIs] remove ov::any interfaces call(const Any& any) & dynamic_pointer_cast(const ::ov::Any& any) & static_pointer_cast(const ::ov::Any& any)

Signed-off-by: xuejun <Xuejun.Zhai@intel.com>

* [Remove APIs] fix code format issues in ov::any

Signed-off-by: xuejun <Xuejun.Zhai@intel.com>

* [Remove APIs] fix review issue

Signed-off-by: xuejun <xuejun.zhai@intel.com>

* [Remove APIs] clear code

Signed-off-by: xuejun <xuejun.zhai@intel.com>

* [Remove APIs] fix review issue

Signed-off-by: xuejun <xuejun.zhai@intel.com>

* [Remove APIs] fix compiler issue

Signed-off-by: xuejun <xuejun.zhai@intel.com>

* [Remove APIs] fix compiler issue

Signed-off-by: xuejun <xuejun.zhai@intel.com>

* [Remove APIs] fix compiler issue

Signed-off-by: xuejun <xuejun.zhai@intel.com>

* Fix variant error

Signed-off-by: xuejun <xuejun.zhai@intel.com>

---------

Signed-off-by: xuejun <Xuejun.Zhai@intel.com>
Signed-off-by: xuejun <xuejun.zhai@intel.com>
2023-03-06 10:24:08 +04:00
Shen, Wanglei e605a4c344 Create streams info table based on processor type table (#15571)
* enable streams info table based on CPU mapping

* add detail processor info for mix stream

* fix code style issue

* fix typo

* fix code style issue for Android build

* update description of streams info table

* move streams info related function to new file

* remove duplicated definition

* add description for parameters of get_streams_info_table()

* update test case file

* fix windows build issue

* fix windows build issue

* fix windows build issue

* fix typo

* update latency mode for hybrid platform

* update limit threads for latency

* update latency mode for 2 sockets platform
2023-03-06 14:06:41 +08:00
Ilya Lavrenov 7be7f25566 Added TF / TF Lite in API reference docs (#16023) 2023-03-02 16:45:18 +04:00
Ilya Churaev 65a45a6232 Fix coverity uninialized variable (#16039) 2023-03-02 13:20:14 +04:00
Maksim Kutakov 6ae024f86e [CPU] Fix OMP build (#16006)
* Fix OMP build

* Apply comments
2023-03-01 17:07:48 +04:00
Ilya Churaev 113aefa3ff Move internal api to ov (#15964)
* Move cpu streams executor to new API

* Remove legacy headers from new dev API

* Fixed build issues

* Fixed build

* Fixed typo

* Fixed typo

* Fixed build

* Fixed code style

* Add exception for template constructor of SoPtr
2023-03-01 14:00:55 +04:00
Maxim Vafin 2ced2ad929 Add removing dangling results in MultiSubGraphOp transformation (#15862)
* Add removing dangling results in MultiSubGraphOp transformation

* Add recursive call for nested subgraphs

* Fix frontend build

* Add tests

* Add more tests and fix special port

* Add more tests, fix LSTM tests

* Preserve merged inputs

* Fix code style

* Fix paddle tests

* Fix special output
2023-02-27 14:31:53 +01:00
Ilya Churaev 957ff6edd8 Fixed some leftovers after plugin API merge (#15932) 2023-02-27 05:35:38 +01:00
Ilya Churaev a730ef18eb Moved Task, Streams, CPUStreams Executors to new API (#15913)
* Moved Task, Streams, CPUStreams Executors to new API

* Fixed some build issues

* Fixed new build issues

* Try to fix tests

* Fixed inference unit tests

* Small build fix

* Added more system headers

* Try to fix naming style

* Fixed namespace

* Fixed android build
2023-02-24 15:20:32 +04:00
Haiqi Pan 3cc888555a fix ov::shutdown align definition (#15901) 2023-02-23 17:31:34 +04:00
Ilya Churaev 893f96a7da Extend tensor API (#15811)
* Added some new tensor API

* Added tests on constructors

* Small changes

* Fixed tensor tests

* Fixed tests

* Added parametrized tests

* Extend tests and delete copy_to from remote tensor
2023-02-22 17:43:15 +01:00
Ilya Churaev 27ea9eab32 Moved executor manager to new API (#15871)
* Moved executor manager to new API

* Fixed template plugin build

* Remove setTBBFlag API

* Fixed export

* Added new files

* Revert "Added new files"

This reverts commit 981c3c863f.

* Fixed template plugin tests

* Remove redundant wrapper

* Remove wrappers for executor manager

* Fixed build
2023-02-22 17:19:35 +01:00
Ilya Churaev 877018bab6 Moved Cache manager to new API (#15872)
* Moved Cache manager to new API

* Moved cache guard to ov namespace

* Added new files
2023-02-22 10:51:33 +00:00
Ilya Churaev 548f972e19 Added ov::IVariableState (#15843)
* Added ov::IVariableState

* Added variable state

* Try to fix Windows

* Fixed export
2023-02-22 14:30:46 +04:00
Wang, Yang 7f3ea9a59c Conversion fail for ov::hint::performance_mode with UNDEFINED value (#15629)
* Update ov::hint::performance_hint UNDEFINED value from empty string to "UNDEFINED".

* Update benchmark Python version.

* Update.

* Update.

* Update.

* Update the description about hint setting within benchmark APP README and help message.
2023-02-22 13:01:18 +04:00
Ilya Churaev a5ec5f5476 Move template infer request (#15696)
* Move Template Infer Requests to new API

* Removed const_pointer_cast from plugin

* Fixed tests

* Fixed async tests

* Fixed some comments

* Added print ov::Tensor

* Fixed ONNX Frontend tests with multiple outputs to the same tensor

* Revert "Added print ov::Tensor"

This reverts commit b752f506bb.

* Fixed ov_core tests

* Fixed some tests

* Fixed batched tensors tests

* Fixed some tests

* Fixed more tests

* Fixed template plugin tests

* Fixed LP tests

* Fixed some comments

* Fixed some documentation issues

* Fixed comments

* Increase timeout because build termenated in case of common changes
2023-02-21 07:03:07 +04:00
Pawel RaaszandArtur Kulikowski 69728cb4ef Use new evaluate in template plugin (#15753)
* Use new evaluate method in template plugin

* Add tensor at the end of each iteration

* Remove class TemporaryOverrideOutputs

* Set shape of tensor after evaluate

* Revert "Remove class TemporaryOverrideOutputs"

This reverts commit e345ba9188.

* Update tensors when evaluate passed

* Copy data Tensor when HostTensor was initialized

* Set shape to output tensor in TemporaryOverrideOutputs

* Fix code style

* Add test

* Remove unused code

* Create reshape with scalar when shape is empty

* Reshape, special_zero = true

* Revert "Create reshape with scalar when shape is empty"

This reverts commit 0f901f419a.

* Use Shape with size zero and value max_int for dynamic tensors

* Restore Shape{0} for dynamic tensors

* Revert "Restore Shape{0} for dynamic tensors"

This reverts commit cb2d0e58eb.

* Temporary remove the test

* Use shape{0} for dynamic tensors

* Revert "Use shape{0} for dynamic tensors"

This reverts commit 08460a486b.

* Use Shape{0} for dynamic tensors

* Use new evaluate in template plugin
- Add tensor conversion between ov::Tensor <-> HostTensor
- Add shape utils to create special case shape to be dynamic shape
- Utils are in dev API to remove duplicates

* Move WA for set shape into the ov::tensor.

* Remove dynamic shape from or_tensor helper

* Mark tensor conversion utils as deprecated
- move shape util as core internal only
- update transpose test to not use deprecated functions

* Add missing deprecate suppression macro

---------

Co-authored-by: Artur Kulikowski <artur.kulikowski@intel.com>
2023-02-20 10:50:42 +04:00
River Li 9cc8bc882b [CC]Add CC support for ir reader (#15659)
* Add CC support for ir reader

Change-Id: I3e1c02222800be090a4307bff8c231ad28b23ff7

* Fix clang issue

Change-Id: Idaf7bc5632bd558cfb7b0ecd8891435e5ba5c6ca
2023-02-18 15:43:19 +04:00
Xuejun Zhai 91df0a8aa9 [API remove] remove variantImpl & variantwrapper related class/interfaces (#15580)
* [API remove] remove variantImpl & variantwrapper related class/interfaces

Signed-off-by: xuejun <xuejun.zhai@intel.com>

* [Remove APIs] fix code format issue

Signed-off-by: xuejun <Xuejun.Zhai@intel.com>

* [Remove api] fix python compiler issue caused by deprecated varient

Signed-off-by: xuejun <Xuejun.Zhai@intel.com>

* [Remove APIs] fix code format issue

Signed-off-by: xuejun <xuejun.zhai@intel.com>

---------

Signed-off-by: xuejun <xuejun.zhai@intel.com>
Signed-off-by: xuejun <Xuejun.Zhai@intel.com>
2023-02-17 16:31:26 +04:00
a088d1ab7d Disable core::set_property() to support ov::device::properties setting (#15175)
* Disable set_property() to support ov::device::properties setting.

* Update benchmark APP to set device properties through compile_model() instead of through set_property().

* Update.

* Update.

* Update some test case including ov::device::properties setting via core.ser_property().

* Since core.set_property() didn't support ov::device::properties setting, just remove the test case to check compile_model() works well if setting ov::device::properties via core.set_property() first.

* Update CompileModel in test name to CompiledModel

Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>

* Add corresponding test case.

Signed-off-by: Wang, Yang <yang4.wang@intel.com>

* Update.

* Update.

* Remove the changes of this commit as this modification has nothing to do
with this PR.

This reverts commit 4f04b9f085.

---------

Signed-off-by: Wang, Yang <yang4.wang@intel.com>
Co-authored-by: Chen Peter <peter.chen@intel.com>
Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>
2023-02-17 10:15:38 +04:00
d7f47aa122 Provide ENABLE_STARTUP_FALLBACK property to enable/disable CPU as acc… (#14503)
* Provide ENABLE_STARTUP_FALLBACK property to enable/disable CPU as acceleration

* Add more test cases to ENABLE_STARTUP_FALLBACK property

* Remove unnecessary config

* Remove plugin.hpp

* Update test case by PR#14754

* Update copyright

Co-authored-by: River Li <river.li@intel.com>

* Simplify using namespace

---------

Co-authored-by: Chen Peter <peter.chen@intel.com>
Co-authored-by: River Li <river.li@intel.com>
2023-02-17 11:15:07 +08:00
Ilya Churaev b80d05e0e1 Added classes for Sync and Async infer requests (#15387)
* Added classes for Sync and Async infer requests

* Changed hierarchy of Infer requests

* Fixed code style

* Fixed some tests

* Fixed naming style

* Fixed template plugin build

* Temporary disable python tests

* Revert "Temporary disable python tests"

This reverts commit c9aa9d79f8.

* Fixed template plugin tests

* Disable python tests

* Disable more steps

* Merged CI

* Revert "Merged CI"

This reverts commit 2f69574870.

* Try to fix segfault in python tests

* Remove default constructor

* Fixed documentation

* Fixed CPU tests

* Fixed Windows build

* Fixed comments

* Fixed build
2023-02-14 06:59:53 +04:00
Fang XuandIlya Lavrenov 62dd3c5218 remove tbb version check for using tbbbind static library (#15627)
* remove tbb version check for using tbbbind static library

* fix build error

---------

Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>
2023-02-13 17:34:04 +00:00
Shen, Wanglei 115014d3ad Enable test cases for windows parser for CPU mapping table (#15589)
* update test cases for windows cpu mapping parser

* fix code style issue

* fix code style issue

* fix code style issue

* update test data for Linux parser to align with Windows test case

* ufix code style issue

* update test data for Android build

* update linux CPU map parser fix

* fix code style issue

* fix test data issue

* fix size_t warning

* fix size_t warning
2023-02-13 15:55:39 +08:00
Ilya Lavrenov 646778b63f Fixed warnings on Windows in CC build (#15666) 2023-02-13 11:52:20 +04:00
Shen, Wanglei 8b1b4de21d fix clang issue of parser test cases for Android build (#15626)
* fix clang issue for Android build

* update test data for parser

* update Linux CPU map parser
2023-02-10 21:37:17 +08:00
Ilya Lavrenov 84ecacda26 Windows ARM64 support via LLVM (#15585) 2023-02-09 11:30:07 +04:00
Shen, Wanglei d72deb955d move CPU mapping parser API from dev_api header file to specific header file (#15558)
* move CPU mapping parser API to specific header file

* keep all enum defination in ie_system_conf.h

* move hpp file to inference/src

* fix code style issue
2023-02-08 18:27:14 +04:00
Ilya Lavrenov 1f3e469c5e Added -Wall for Clang and GCC (#15513)
* Added -Wall for Clang and GCC

* Fixes

* Don't use /J

* Fixed warnings

* Fixed warnings

* More fixes

* Fixed for MSVC

* Fixed more warnings on Windows

* Suppressed some warnings in template plugin

* Update src/tests/functional/plugin/shared/include/behavior/plugin/caching_tests.hpp

* Added suppression for PT FE

* Suppressed warnings in TF FE

* Suppressed warnings on Core unit tests

* Suppress warnings in python

* Suppressed Windows warning for 3rd party modules

* Suppresed one more warning
2023-02-08 15:01:00 +04:00
Ilya ChuraevandIlya Lavrenov 68ccd078dc Export TBlob specialization for Windows (#15516)
* Export TBlob specialization for Windows

* Changed macro in define

---------

Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>
2023-02-07 22:11:49 +04:00
Shen, Wanglei 79cad1032b enable new method to generate CPU information and CPU map on Windows (#14710)
* enable new method to generate CPU information and CPU map

* fix code style issue

* fix initialization issue of variable-sized object

* fix dependency issue

* add sample of CPU map

* add description and sample for CPU map

* fix code style issue

* fix code style issue

* add comments on using second processor as physical core

* enable new method to generate CPU information and CPU map on windows

* remove debug output

* add description for CPU map table

* remove changes for linux

* update description for better understanding

* update CPU mapping table on Windows

* fix precision issue of log2()

* fix memory leak

* use shared_ptr to manage  memory life cycle

* Wrap parser for Windows into a separate function for mock testing later

* Revert "Wrap parser for Windows into a separate function for mock testing later"

This reverts commit 614ad718c2.

* add core type table for each socket on windows

* separate CPU map parser on Windows for validation

* fix core type table definition

* fix DWORD issue in header file

* update parser interface for validation

* fix socket count

* update processor count for XEON

* add discrption and example for processor type table

* remove conflicts

* fix merge conflicts

* fix document issue
2023-02-07 20:28:49 +08:00
Shen, Wanglei 63b2c072c0 update Linux CPU map parser and add unit test (#15113)
* update linux CPU map parser and add unit test

* add one more test data

* fix clang issue

* update test case by using TEST_P

* fix code style issue

* add one more test data with hyper threading off

* remove duplicated test data

* fix issue for Windows build

* fix issue for Windows build

* add description for test data

* add core type table for each socket

* fix code style issue

* fix code style issue

* remove redundant content

* remove parse_processor_info_linux() from INFERENCE_ENGINE_API_CPP

* fix code style issue

* update example of core type table

* fix code style issue
2023-02-07 13:54:40 +08:00
Nadezhda Ageeva 049cfcb72c [nGraph]: fix fused names for ShuffleChannelsFusion transformation (#15150)
* [nGraph]: fix fused names for ShuffleChannelsFusion transformation

* Review comments
2023-02-03 12:45:12 +00:00
Ilya Churaev 1bb8223ecd Template ov plugin (#15220)
* Initial migration of TemplatePlugin to ov::IPlugin interface

* Fixed segfault

* Fixed static build and some template tests

* Fixed code style

* Fixed some template tests

* Fixed scale tests

* Disabled transformations in the template plugin

* Fixed ONNX tests

* Fixed compilation

* Fixed core tests

* Fixed some crashes

* Small fixes

* Migrate to ICompiledModel

* Fixed some behaviour tests (add legacy names and supported_properties)

* Fixed output precisions

* Fixed some tests

* Changed parameter->result test

* Fixed some preprocessing tests

* Added mean image preprocessing

* Disabled some tests

* Fixed some template tests

* Try to fix not implemented false

* Try to fix template tests

* Fixed doc

* Catch ov::NotImplemented exception

* Small changes

* Fixed build

* Try to fix build

* Fixed some comments

* Use new properties

* Fixed documentation

* Fixed properties
2023-02-03 13:37:40 +04:00
Ilya Churaev ae3bddd25c Fixed cc build (#15446) 2023-02-02 11:24:18 +04:00
Vitaliy Urusovskij 29b15233c7 Remove OV_FRONTEND_PATH (#15364)
* Remove "OV_FRONTEND_PATH" from `FrontEndManager`

* Remove "OV_FRONTEND_PATH" from layer_tests

* Remove "OV_FRONTEND_PATH" from find_ie_version.py

* Remove "OV_FRONTEND_PATH" from .ci/

* Move `ov::get_plugin_path` to file_util.hpp (ov::util)

* Add `register_front_end(name, path)` FEM public API

* Enable frontend/ tests

* ClangFormat

* Remove OV_FRONTEND_PATH from FE shared utils

* Add `register_front_end()` to PythonAPI

* Update Py tests with registering of "mock_py" FE

* ClangFormat

* Leftovers

* Fix SegFault with `register_front_end(name, lib_path)`

* Add FE_LIB_PRE and FE_LIB_SUFFIX to `ov_core_unit_tests`

* Fix format

* Update `testFailRegisterFEByWrongPath`
2023-02-02 08:19:35 +04:00
Artur Kulikowski 4e064b02a0 Add test to verify add_extension with relative path (#15212)
* Add test to verify add_extension with relative path

* Fix code style

* Use std::string::find instead of std::regex

* Remove unnecessary include

* Add comments about generating relative path

* Don't add empty tokens when splitting path
2023-01-31 11:40:31 +04:00
Ilya Churaev 76a0abf3cf Fixed compiled model leftovers (#15385) 2023-01-30 11:28:23 +04:00
Ilya Churaev 635bfd848e Introduce ov::ICompiledModel interface (#15276)
* Introduce ov::ICompiledModel interface

* Fixed code style

* Fixed mock

* Fixed Inference Functional tests

* Fixed typo

* Fixed supported properties

* Fixed tests

* Changed API

* Added comments

* Fixed python build
2023-01-30 07:39:09 +04:00
Ilya Churaev 369bce2e07 Remove legacy constant folding from core (#15315) 2023-01-27 09:09:05 +04:00
Vitaliy Urusovskij ef8481d008 Apply snake_case to ov::Core API (#15313) 2023-01-27 00:47:04 +00:00
Ilya Churaev 033368caab Removed redundant convert_model from CoreImpl (#15231)
* Removed redundant convert_model from CoreImpl

* Fixed code style

* Removed redundant clones and fixed tests

* Removed methods from header

* Fixed CC

* Fixed tests

* Removed code duplication

* Removed caching from v7 logic

* Completely remove compute hash for CNNNetwork

* Removed legacy code

* Revert logic which is used in tests

* Try to understand the issue

* Revert "Try to understand the issue"

This reverts commit 72abf3a354.

* Revert "Revert logic which is used in tests"

This reverts commit 845e392bdd.

* Fixed tests

* Remove legacy test

* Revert query_model logic

* Revert "Revert query_model logic"

This reverts commit b694cd6999.

* Revert "Revert "Revert query_model logic""

This reverts commit 0df850838a.

* Fixed master build

* Revert "Revert "Revert "Revert query_model logic"""

This reverts commit 3bb2af2250.

* Revert changes with query_model
2023-01-26 13:29:02 +04:00
Mateusz Tabaka 3ad92084d6 Fix MarkDequantizationSubgraph when Mul has Convert on both inputs (#14997)
Ticket: 100042
2023-01-26 08:55:23 +00:00
Ilya Lavrenov 0970bc8fcf Moved legacy library and deprecated tests to GNA (#15244) 2023-01-25 11:36:22 +04:00