IntenseWebs/openvino
3
0 Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
13,806 Commits 38 Branches 54 Tags
master
Commit Graph
208 Commits
Author SHA1 Message Date
Oleg PipikinandPavel Durandin 26576b0a30 Rework makeConstant builder (#21319) 
* Rework make_constant node builder

* Fix

* Apply comments

* Apply comments

* Fix

---------

Co-authored-by: Pavel Durandin <pavel.durandin@intel.com>
 2023-12-22 14:57:05 +01:00
Ilya Lavrenov c79ae17bbf Removed GNA plugin from 2024.0 (#21800) 2023-12-21 13:39:06 +01:00
Oleg Pipikin 12a9d55c3e Use new builders instead of old ones in tests (#21742) 
* Use new make_convolution instead of old one

* Use new make_group_convolution instead of old one

* Use new make_convolution_backprop_data instead of old one

* Use new make_group_convolution_backprop_data instead of old one

* Use new make_binary_conv instead of old one

* Remove makeVariadicSplit builder

* Use new make_activation instead of old one

* Use new make_eltwise instead of old one

* Use new make_embedding_bag_packed_sum  instead of old one

* Remove augru builder

* Fix clang-format

* Fix
 2023-12-21 11:26:39 +04:00
Oleg Pipikin 758e6b3428 Change exception message for CompiledModel::set_property (#21652) 
* Change exception message for CompiledModel::set_property

* Apply comments
 2023-12-15 14:01:09 +04:00
Wang, Yang 825778308b updated. (#21569) 2023-12-15 08:18:03 +01:00
Vitaliy Urusovskij 4fde957689 Additional changes in src/ to API2.0 (#21601) 
* `src/core/` to API2.0

* `src/plugins/auto/` to API2.0

* `src/plugins/hetero/` to API2.0

* ClangFormat

* Fix build
 2023-12-14 14:13:18 +00:00
Vitaliy Urusovskij dcf9247bc8 Clean up of tests/ov_helpers leftovers (#21416) 
* CLean up ov_helpers headers from ngraph/

* Move `ngraph/` includes from ov_helpers to tests

* Remove include of all opsets in builders.hpp

* Remove opsets includes from ov_helpers

* Fix GNA tests

* Delete comments

* ClangFormat

* Fix build

* Fix `-fpermissive`

* Fix build #2

* Fix `<` && `>` in includes

* Fix build #3

* Build fix
 2023-12-13 14:45:19 +00:00
Wang, Yang 7e88a9d6c8 [AUTO] Fix the issue of querying the optional property unsupported by HW plugin via AUTO compiled model (#21518) 
* 1. Update the logic for handling the unsupported property querying from hw device.
2. Add test cases.

* Updated.

* Updated.

* Updated.

* Updated.
 2023-12-13 18:06:59 +08:00
Ilya Lavrenov 402d251483 Removed legacy cmake utils from IE 1.0 (#21559) 2023-12-11 11:26:16 +04:00
Ilya Lavrenov fbec7be5e0 Try to run arm64 without system tbb (#21524) 
* Try to run arm64 without system tbb

* Moved files

* Moved cmake files for auto batch
 2023-12-08 13:59:48 +04:00
Wang, YangChen PeterWanglei Shen
 		fd0809ead4 [AUTO] Enable round robin policy for cumulative throughput mode of AUTO plugin (#20439) 
* Add and implement the logic of property SCHEDULE_POLICY for MULTI plugin.

* Updated.

* Enable test case for schedule policy test.

* enable test case for property ov::intel_auto::schedule_policy.

* Update.

* Updated.

* Updated.

* Update.

* Update the lock logic here by considering the runtime fallback case.

* Update.

* Update.

* Update.

* Update default value of schedule policy to DEVICE_PRIORITY

* Enable the function test case for schedule policy.

* Add description for inference requests schedule policy within AUTO plugin cumulative mode.

* Updated.

* Python bindings for enum SchedulePolicy and property ov::intel_auto::schedule_policy.

* Update.

* Update.

* Update.

* Updated.

---------

Co-authored-by: Chen Peter <peter.chen@intel.com>
Co-authored-by: Wanglei Shen <wanglei.shen@intel.com>
 2023-12-07 07:04:56 +01:00
Wang, YangandChen Peter 1e2b7c66f7 [AUTO] Update AUTO logic to support state-full model (#21061) 
* 1. Update the logic for filtering out the device that supports the stateful model.
2. Enable the function to create stateful model in the test case.

* 1. Enable unit test cases for stateful model support.
2. disable accelerator device(CPU_HELP) if model is stateful.

Signed-off-by: Wang, Yang <yang4.wang@intel.com>

* Update.

* Updated.

* Updated.

* Updated.

---------

Signed-off-by: Wang, Yang <yang4.wang@intel.com>
Co-authored-by: Chen Peter <peter.chen@intel.com>
 2023-12-04 10:51:10 +08:00
River Li ec239b3d5f [Fixing]Fix some scan coverity issues (#21378) 
* Fix some scan coverity issues

* Fix an error
 2023-11-30 14:39:55 +04:00
Sun Xiaoxia b7edd5df69 migrate threading related interface from API 1.0 to 2.0 (#21167) 
* migrate threading related interface from API 1.0 to 2.0

* fix code style

* fix @ref issue in doc

* change <> to quotation marks

* restore threading related interface API 1.0

* restore the changes of legacy code
 2023-11-24 10:52:44 +04:00
Oleg Pipikin a9dffa8d70 Refactor ngraph builders (#20998) 
* Remove makeInputLayer builders

* Refactor makeBroadcast builder

* Deprecated makeCTC builders

* Fix for broadcast builder

* Remove and deprecate makeSplit builder

* fix

* Fix
 2023-11-17 16:10:19 +01:00
Wang, Yang 859319e2a5 [AUTO] Fix segment fault appeared in the compiled model.get_property() of AUTO (#20777) 
* disable CPU_HELP context if it released.

* Enable test case.

* Updated.

* Updated.

* Updated.
 2023-11-15 10:20:35 +08:00
Maciej Smyk 5a04359200 [DOCS] Updating links for master 2023-11-13 12:23:23 +01:00
Ilya Lavrenov 56d74a82cb Relocatable developer package (#20327) 
* Merge Linux CC + static build + clang compiler

* Improvements

* Removed ie prefixes from cmake scripts

* Fixes for NPU

* Initial relocatable OpenVINO Developer package

* Improvements

* Try to fix

* improvements

* Export a lot of headers

* Removed NVIDIA pipeline; make it to be a job

* Fixes

* Fixes 2

* Try ilya-lavrenov repo

* Clean-up

* More imrpovements

* Even more improvements

* Override export, install

* Override export, install

* Disable pythonwheel generation for relocatable OV dev package

* Fixed issues with versions

* Fixed android build

* Fixed android build

* Fixed NPU build

* Update src/bindings/python/CMakeLists.txt
 2023-10-12 22:59:04 +00:00
Ilya Lavrenov e30f75bb4d Rpath story (#20297) 2023-10-10 06:27:26 +02:00
Ilya Lavrenov ead4b8a0ec Moved cmake functions, variables to API 2.0 naming style (#20281) 
* Merge Linux CC + static build + clang compiler

* Improvements

* Removed ie prefixes from cmake scripts

* Fixes for NPU
 2023-10-09 22:30:32 +04:00
Ilya Lavrenov cba4721cf6 Fixed wrong target usage in auto func tests (#20314) 2023-10-09 15:11:15 +04:00
yanlan song ad41d0f52f rework auto test cases (#19862) 
* initial commit

Signed-off-by: fishbell <bell.song@intel.com>

* clean up

Signed-off-by: fishbell <bell.song@intel.com>

* fix windows build failure

Signed-off-by: fishbell <bell.song@intel.com>

* enable auto func tests

Signed-off-by: fishbell <bell.song@intel.com>

* enable auto_func_test to ci

Signed-off-by: fishbell <bell.song@intel.com>

* some clean up in gpu case

Signed-off-by: fishbell <bell.song@intel.com>

* clang

Signed-off-by: fishbell <bell.song@intel.com>

* fix build warning

Signed-off-by: fishbell <bell.song@intel.com>

* enable new tests

Signed-off-by: fishbell <bell.song@intel.com>

* fix build warning

Signed-off-by: fishbell <bell.song@intel.com>

* enable consistency test

Signed-off-by: fishbell <bell.song@intel.com>

* try fix build error on manylinux

Signed-off-by: fishbell <bell.song@intel.com>

* enable cpplint

Signed-off-by: fishbell <bell.song@intel.com>

* enable clang-format

Signed-off-by: fishbell <bell.song@intel.com>

enable some tests

Signed-off-by: fishbell <bell.song@intel.com>

* fix typo

Signed-off-by: fishbell <bell.song@intel.com>

* clang for unit tests

Signed-off-by: fishbell <bell.song@intel.com>

* fix merge conflict

Signed-off-by: fishbell <bell.song@intel.com>

---------

Signed-off-by: fishbell <bell.song@intel.com>
 2023-10-07 14:44:25 +04:00
Ilya Lavrenov d6c2a10b38 Merge Linux CC + static build + clang compiler (#20243) 
* Merge Linux CC + static build + clang compiler

* Improvements

* Fixes
 2023-10-06 00:30:11 +04:00
Ivan Tikhonov 3d6fb85a99 Model builders refactoring: rename dirs, targets, file names (#19885) 
* Model builders refactoring

* Apply review comments

* resolve review commets: update cmake target names

* fix build: use correct headers

* fix headers

* fix build

* fix docs
 2023-10-04 18:08:24 +02:00
Ilya Lavrenov a6e7bac962 Added RISC-V Conan build (#20064) 2023-09-27 12:24:20 +04:00
yanlan songandIlya Churaev b8942b6dd6 Ensure so is there for lifecycle (#19510) 
* ensure so is there for lifecycle

Signed-off-by: fishbell <bell.song@intel.com>

* batch plugin + batch not triggered case

Signed-off-by: fishbell <bell.song@intel.com>

* clang

Signed-off-by: fishbell <bell.song@intel.com>

* fix settensor failure

Signed-off-by: fishbell <bell.song@intel.com>

* fix model info mismatch when load with 1.0 API with ppp info

Signed-off-by: fishbell <bell.song@intel.com>

* remove unncessary ppp code

Signed-off-by: fishbell <bell.song@intel.com>

* Update src/plugins/auto_batch/src/compiled_model.cpp

Co-authored-by: Ilya Churaev <ilyachur@gmail.com>

* enable the meta holder cases

Signed-off-by: fishbell <bell.song@intel.com>

---------

Signed-off-by: fishbell <bell.song@intel.com>
Co-authored-by: Ilya Churaev <ilyachur@gmail.com>
 2023-09-18 14:13:38 +08:00
Ilya Lavrenov 35a0706dff Replaced several cmake utilities with new ov_ prefix (#19819) 
* Replaced several cmake utilities with new ov_ prefix

* Replaced several cmake utilities with new ov_ prefix
 2023-09-14 16:22:50 +04:00
Ilya Churaev 1d62f0141d Rename cmake ie_ macros and ie_parallel script (#19606) 
* Rename cmake ie_ macros and ie_parallel script

* Add warning messages
 2023-09-05 19:31:52 +02:00
Ilya Churaev 75b6a24787 Remove ICore legacy mock object (#19573) 2023-09-05 00:42:42 +04:00
Maciej Smyk 3677dda457 [DOCS] 23.0 to 23.1 link update for master (#19584) 
* 2023.1 link fix

* 2023.1 link fix

* 2023.1 link fix

* 2023.1 link fix

* 2023.1 link fix
 2023-09-04 15:40:02 +02:00
yanlan songandChen Peter 498731f8fd [AUTO] Fix static code scan issue (#19295) 
* fix scan issue

Signed-off-by: fishbell <bell.song@intel.com>

* clang

Signed-off-by: fishbell <bell.song@intel.com>

* clang

Signed-off-by: fishbell <bell.song@intel.com>

---------

Signed-off-by: fishbell <bell.song@intel.com>
Co-authored-by: Chen Peter <peter.chen@intel.com>
 2023-08-24 10:01:11 +00:00
Stefania HerganeandDan 24f8c4105e [EISW-89824] [master] Rename VPUX to NPU (#19004) 
* Change `VPUX`/`VPU` occurrences to `NPU`

* Switch `HARDWARE_AWARE_IGNORED_PATTERNS` VPU to NPU

* Rename `MYRIAD plugin`

* Rename vpu_patterns to npu_patterns in tools/pot

* Rename vpu.json to npu.json in tools/pot

* Rename restrict_for_vpu to restrict_for_npu in tools/pot

* Change keembayOptimalBatchNum to npuOptimalBatchNum

---------

Co-authored-by: Dan <mircea-aurelian.dan@intel.com>
 2023-08-10 00:20:07 +04:00
Wang, Yang 5db7579bea [AUTO Plugin] Update document for testing AUTO plugin from benchmark app (#18809) 
* Update guide document to show the detailed steps of testing AUTO plugin from benchmark app
 2023-08-09 13:37:06 +08:00
yanlan song 2c3e17ef2a Respect secondary property of performance hint (#18728) 
* enable feature

Signed-off-by: fishbell <bell.song@intel.com>

* do not overwrite secondary property

Signed-off-by: fishbell <bell.song@intel.com>

* enable new tests

Signed-off-by: fishbell <bell.song@intel.com>

* revert changes

Signed-off-by: fishbell <bell.song@intel.com>

* update tests

Signed-off-by: fishbell <bell.song@intel.com>

* resolve merge conflict

Signed-off-by: fishbell <bell.song@intel.com>

* azure failure dbug

Signed-off-by: fishbell <bell.song@intel.com>

* debug azure failure

Signed-off-by: fishbell <bell.song@intel.com>

* fix missing dependency

Signed-off-by: fishbell <bell.song@intel.com>

* fix case fail by merge

Signed-off-by: fishbell <bell.song@intel.com>

cpplint

Signed-off-by: fishbell <bell.song@intel.com>

* fix build error on windows

Signed-off-by: fishbell <bell.song@intel.com>

* rewrite case to remove dependent on public API

Signed-off-by: fishbell <bell.song@intel.com>

* resolve master conflict

Signed-off-by: fishbell <bell.song@intel.com>

---------

Signed-off-by: fishbell <bell.song@intel.com>
 2023-08-04 12:37:04 +08:00
Oleg Pipikin ff0b51f3ca Rename CommonTestUtils namespace (#18590) 
* Rename CommonTestUtils namespace 1

* Rename CommonTestUtils namespace 2

* Rename CommonTestUtils namespace 3

* Rename CommonTestUtils namespace 4

* Fix1

* Fix2

* Fix3

* Apply comments

* Fix4

* Fix5
 2023-07-26 21:06:50 +02:00
yanlan song ff3399a87a enable auto handle GPU.invalid_index case (#18658) 
* let auto handle GPU.valid_index case

Signed-off-by: fishbell <bell.song@intel.com>

* resolve merge conflict

Signed-off-by: fishbell <bell.song@intel.com>

* add suppress macro

Signed-off-by: fishbell <bell.song@intel.com>

* revert changes

Signed-off-by: fishbell <bell.song@intel.com>

* update case

Signed-off-by: fishbell <bell.song@intel.com>

---------

Signed-off-by: fishbell <bell.song@intel.com>
 2023-07-25 15:31:53 +08:00
Wang, YangandChen Peter 1be4b21905 [AUTO] Set property optimal_number_of_infer_requests to hw device with default value (#17848) 
* Query the property optimal_number_of_infer_requests from plugin first if plugin supported.

Signed-off-by: Wang, Yang <yang4.wang@intel.com>

* Query the property ov::optimal_number_of_infer_request of actual device first and use it as the result of AutoExecutableNetwork property.

* Updated.

* Updated.

* Update.

* Update.

---------

Signed-off-by: Wang, Yang <yang4.wang@intel.com>
Co-authored-by: Chen Peter <peter.chen@intel.com>
 2023-07-25 10:05:18 +08:00
Wang, YangandChen Peter 85f514788e [AUTO] Clean up the logic of AUTO device priorities (#18557) 
* Update selection logic for 3rd part devices within AUTO plugin.

* Remove MYRAID from AUTO test case.

* Update.

* Update.

* Update.

---------

Signed-off-by: Wang, Yang <yang4.wang@intel.com>
Co-authored-by: Chen Peter <peter.chen@intel.com>
 2023-07-25 10:03:14 +08:00
Wang, Yang 68c0711758 [AUTO] Update Auto unit test cases (#18634) 
* 1. Setting property ov::compilation_num_threads for actual device (not CPU) selected by AUTO.
2. Add the test case.

Signed-off-by: Wang, Yang <yang4.wang@intel.com>

* check if the selected device supports this property before enabling this property.

* Update.

Signed-off-by: Wang, Yang <yang4.wang@intel.com>

* Updated.

* Updated.

* Using the ov::device::properties, instead of the device name, to check if secondary property is set for hardware device.

* Update.

* Update.

* Update.

* Update the  property handling logic to support the ov::device::properties setting.

* Update.

* Update.

* Update the case to check if the secondary propery has high priority.

---------

Signed-off-by: Wang, Yang <yang4.wang@intel.com>
 2023-07-24 11:54:16 +08:00
yanlan song a51d9494fa support context in auto and re-enable tests (#18554) 
wrap hardware remote context to compiled model

Signed-off-by: fishbell <bell.song@intel.com>
 2023-07-20 06:53:07 +00:00
Mircea-Aurelian Dan 5397e299fd [EISW-81712] Rename VPUX to VPU in openvino codebase (#17949) 
* Change `VPUX` occurrences to `VPU`

* Switch `VPU` library name

* Change remaining references to `VPUX`
 2023-07-19 15:55:24 +04:00
Oleg Pipikin cdef86c366 Move unit and func test utils (#18423) 
* Move unit and func test utils. Rename targets

* Fix1
 2023-07-18 16:23:58 +02:00
Ilya Churaev 93e30468b1 Change plugin api (#18441) 
* Remove vector of so objects from Tensor, Any, VariableState and
RemoteContext

* Change IRemoteContext

* Fixed build without Proxy

* Moved API to ITensor

* Remove friends from Tensor class

* Changed query_state API

* Remote SoPtr for some returned values

* Fixed auto plugin

* Add so to converted objects

* Fixed build all on macOS

* Check that tensor pointers != nullptr

* Add SO to converter

* Added new constructors for SO ptrs

* Changed IVariableState API

* Remove proxy friend

* Remove friends and nullptrs from auto

* Fixed build

* Fixed HETERO plugin

* Fixed code style
 2023-07-14 10:47:53 +04:00
yanlan song 77f065e4b1 refactor code (#18475) 
Signed-off-by: fishbell <bell.song@intel.com>
 2023-07-13 13:58:44 +04:00
Wang, YangandChen Peter 7b9f6c47b1 [AUTO] AUTO can't fall back if target device throws the exception before compiling model via AUTO (#18311) 
* 1. Update AUTO candidate device filtering logic.
2. Add AUTO handling the exception logic when generating the target device infomation.

Signed-off-by: Wang, Yang <yang4.wang@intel.com>

* Update.

* Update.

* Update.

* Update.

---------

Signed-off-by: Wang, Yang <yang4.wang@intel.com>
Co-authored-by: Chen Peter <peter.chen@intel.com>
 2023-07-13 09:09:25 +08:00
Nadezhda Ageeva 3330cd69a7 [GPU] Introduce ov::config_device_id internal property to the new API (#17820) 
* [GPU] Introduce ov::config_device_id internal property to the new API. Fix setting property for specific device

* Introduce ov::internal::supported_properties

* Fix caching tests

* Fix win tests

* Fix Proxy tests

* Replace CONFIG_KEY_INTERNAL(CONFIG_DEVICE_ID) by ov::internal::config_device_id in PROXY plugin

* Review comments
 2023-07-12 10:03:35 +00:00
Pavel Durandin d864d89806 [GPU] Fix misprint in auto plugin (#18402) 2023-07-06 17:39:59 +04:00
yanlan song 1f7176031d Bell/fix static scan issues (#18285) 
* change default value

Signed-off-by: fishbell <bell.song@intel.com>

* fix case failure

Signed-off-by: fishbell <bell.song@intel.com>

* fix post commit failure

Signed-off-by: fishbell <bell.song@intel.com>

* fix sdl issues

Signed-off-by: fishbell <bell.song@intel.com>

---------

Signed-off-by: fishbell <bell.song@intel.com>
 2023-06-30 11:41:48 +04:00
yanlan songandChen Peter 05e8bd375e Bell/auto api 2.0 (#17805) 
* 2.0 innitial

Signed-off-by: fishbell <bell.song@intel.com>

* enable all tests

Signed-off-by: fishbell <bell.song@intel.com>

* remove unecessary files

Signed-off-by: fishbell <bell.song@intel.com>

* move container header to auto foler, remove uncessary macro define

Signed-off-by: fishbell <bell.song@intel.com>

* enable caching

Signed-off-by: fishbell <bell.song@intel.com>

* enable query_model

Signed-off-by: fishbell <bell.song@intel.com>

* support loaded_from_cache property

Signed-off-by: fishbell <bell.song@intel.com>

* fix some build warning

Signed-off-by: fishbell <bell.song@intel.com>

fake inputs/outputs if needed

Signed-off-by: fishbell <bell.song@intel.com>

* resolve conflict

Signed-off-by: fishbell <bell.song@intel.com>

* skip unsupported test

Signed-off-by: fishbell <bell.song@intel.com>

* use mock icore from common foler

Signed-off-by: fishbell <bell.song@intel.com>

* fix failure for remote tensors

Signed-off-by: fishbell <bell.song@intel.com>

* apply ppp related fix in auto

Signed-off-by: fishbell <bell.song@intel.com>

* fix build warning on windows

Signed-off-by: fishbell <bell.song@intel.com>

* fix ppp output layout issue

Signed-off-by: fishbell <bell.song@intel.com>

* fix ppp output layout issue

Signed-off-by: fishbell <bell.song@intel.com>

* clean up headers

Signed-off-by: fishbell <bell.song@intel.com>

* log formatting

Signed-off-by: fishbell <bell.song@intel.com>

* enable fps logging for binder mode

Signed-off-by: fishbell <bell.song@intel.com>

* apply review comments

apply review comments

Signed-off-by: fishbell <bell.song@intel.com>

* remove all legacy namings, exenetwork/network/metric/IE etc

Signed-off-by: fishbell <bell.song@intel.com>

* update readme

Signed-off-by: fishbell <bell.song@intel.com>

* fix build lto issue

Signed-off-by: fishbell <bell.song@intel.com>

* minor wording

Signed-off-by: fishbell <bell.song@intel.com>

* case fix

Signed-off-by: fishbell <bell.song@intel.com>

---------

Signed-off-by: fishbell <bell.song@intel.com>
Co-authored-by: Chen Peter <peter.chen@intel.com>
 2023-06-21 00:10:59 +08:00
Ilya Churaev 0743e9bfb5 Removed legacy methods SetBatch and SetBlob (#17984) 
* Removed legacy methods SetBatch and SetBlob

* Fixed GPU plugin build

* Remove DYN_BATCH_LIMIT from tests

* Revert some changes in GPU plugin
 2023-06-12 18:54:23 +00:00