IntenseWebs/openvino
3
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
12,829 Commits 38 Branches 54 Tags
5170350cf5004ebe109fe07c582e55401105d81c
Commit Graph

191 Commits

Author SHA1 Message Date
Ilya Lavrenov
56d74a82cb Relocatable developer package (#20327) 
* Merge Linux CC + static build + clang compiler

* Improvements

* Removed ie prefixes from cmake scripts

* Fixes for NPU

* Initial relocatable OpenVINO Developer package

* Improvements

* Try to fix

* improvements

* Export a lot of headers

* Removed NVIDIA pipeline; make it to be a job

* Fixes

* Fixes 2

* Try ilya-lavrenov repo

* Clean-up

* More imrpovements

* Even more improvements

* Override export, install

* Override export, install

* Disable pythonwheel generation for relocatable OV dev package

* Fixed issues with versions

* Fixed android build

* Fixed android build

* Fixed NPU build

* Update src/bindings/python/CMakeLists.txt
 2023-10-12 22:59:04 +00:00
Ilya Lavrenov
e30f75bb4d Rpath story (#20297) 2023-10-10 06:27:26 +02:00
Ilya Lavrenov
ead4b8a0ec Moved cmake functions, variables to API 2.0 naming style (#20281) 
* Merge Linux CC + static build + clang compiler

* Improvements

* Removed ie prefixes from cmake scripts

* Fixes for NPU
 2023-10-09 22:30:32 +04:00
Ilya Lavrenov
cba4721cf6 Fixed wrong target usage in auto func tests (#20314) 2023-10-09 15:11:15 +04:00
yanlan song
ad41d0f52f rework auto test cases (#19862) 
* initial commit

Signed-off-by: fishbell <bell.song@intel.com>

* clean up

Signed-off-by: fishbell <bell.song@intel.com>

* fix windows build failure

Signed-off-by: fishbell <bell.song@intel.com>

* enable auto func tests

Signed-off-by: fishbell <bell.song@intel.com>

* enable auto_func_test to ci

Signed-off-by: fishbell <bell.song@intel.com>

* some clean up in gpu case

Signed-off-by: fishbell <bell.song@intel.com>

* clang

Signed-off-by: fishbell <bell.song@intel.com>

* fix build warning

Signed-off-by: fishbell <bell.song@intel.com>

* enable new tests

Signed-off-by: fishbell <bell.song@intel.com>

* fix build warning

Signed-off-by: fishbell <bell.song@intel.com>

* enable consistency test

Signed-off-by: fishbell <bell.song@intel.com>

* try fix build error on manylinux

Signed-off-by: fishbell <bell.song@intel.com>

* enable cpplint

Signed-off-by: fishbell <bell.song@intel.com>

* enable clang-format

Signed-off-by: fishbell <bell.song@intel.com>

enable some tests

Signed-off-by: fishbell <bell.song@intel.com>

* fix typo

Signed-off-by: fishbell <bell.song@intel.com>

* clang for unit tests

Signed-off-by: fishbell <bell.song@intel.com>

* fix merge conflict

Signed-off-by: fishbell <bell.song@intel.com>

---------

Signed-off-by: fishbell <bell.song@intel.com>
 2023-10-07 14:44:25 +04:00
Ilya Lavrenov
d6c2a10b38 Merge Linux CC + static build + clang compiler (#20243) 
* Merge Linux CC + static build + clang compiler

* Improvements

* Fixes
 2023-10-06 00:30:11 +04:00
Ivan Tikhonov
3d6fb85a99 Model builders refactoring: rename dirs, targets, file names (#19885) 
* Model builders refactoring

* Apply review comments

* resolve review commets: update cmake target names

* fix build: use correct headers

* fix headers

* fix build

* fix docs
 2023-10-04 18:08:24 +02:00
Ilya Lavrenov
a6e7bac962 Added RISC-V Conan build (#20064) 2023-09-27 12:24:20 +04:00
yanlan song
b8942b6dd6 Ensure so is there for lifecycle (#19510) 
* ensure so is there for lifecycle

Signed-off-by: fishbell <bell.song@intel.com>

* batch plugin + batch not triggered case

Signed-off-by: fishbell <bell.song@intel.com>

* clang

Signed-off-by: fishbell <bell.song@intel.com>

* fix settensor failure

Signed-off-by: fishbell <bell.song@intel.com>

* fix model info mismatch when load with 1.0 API with ppp info

Signed-off-by: fishbell <bell.song@intel.com>

* remove unncessary ppp code

Signed-off-by: fishbell <bell.song@intel.com>

* Update src/plugins/auto_batch/src/compiled_model.cpp

Co-authored-by: Ilya Churaev <ilyachur@gmail.com>

* enable the meta holder cases

Signed-off-by: fishbell <bell.song@intel.com>

---------

Signed-off-by: fishbell <bell.song@intel.com>
Co-authored-by: Ilya Churaev <ilyachur@gmail.com>
 2023-09-18 14:13:38 +08:00
Ilya Lavrenov
35a0706dff Replaced several cmake utilities with new ov_ prefix (#19819) 
* Replaced several cmake utilities with new ov_ prefix

* Replaced several cmake utilities with new ov_ prefix
 2023-09-14 16:22:50 +04:00
Ilya Churaev
1d62f0141d Rename cmake ie_ macros and ie_parallel script (#19606) 
* Rename cmake ie_ macros and ie_parallel script

* Add warning messages
 2023-09-05 19:31:52 +02:00
Ilya Churaev
75b6a24787 Remove ICore legacy mock object (#19573) 2023-09-05 00:42:42 +04:00
Maciej Smyk
3677dda457 [DOCS] 23.0 to 23.1 link update for master (#19584) 
* 2023.1 link fix

* 2023.1 link fix

* 2023.1 link fix

* 2023.1 link fix

* 2023.1 link fix
 2023-09-04 15:40:02 +02:00
yanlan song
498731f8fd [AUTO] Fix static code scan issue (#19295) 
* fix scan issue

Signed-off-by: fishbell <bell.song@intel.com>

* clang

Signed-off-by: fishbell <bell.song@intel.com>

* clang

Signed-off-by: fishbell <bell.song@intel.com>

---------

Signed-off-by: fishbell <bell.song@intel.com>
Co-authored-by: Chen Peter <peter.chen@intel.com>
 2023-08-24 10:01:11 +00:00
Stefania Hergane
24f8c4105e [EISW-89824] [master] Rename VPUX to NPU (#19004) 
* Change `VPUX`/`VPU` occurrences to `NPU`

* Switch `HARDWARE_AWARE_IGNORED_PATTERNS` VPU to NPU

* Rename `MYRIAD plugin`

* Rename vpu_patterns to npu_patterns in tools/pot

* Rename vpu.json to npu.json in tools/pot

* Rename restrict_for_vpu to restrict_for_npu in tools/pot

* Change keembayOptimalBatchNum to npuOptimalBatchNum

---------

Co-authored-by: Dan <mircea-aurelian.dan@intel.com>
 2023-08-10 00:20:07 +04:00
Wang, Yang
5db7579bea [AUTO Plugin] Update document for testing AUTO plugin from benchmark app (#18809) 
* Update guide document to show the detailed steps of testing AUTO plugin from benchmark app
 2023-08-09 13:37:06 +08:00
yanlan song
2c3e17ef2a Respect secondary property of performance hint (#18728) 
* enable feature

Signed-off-by: fishbell <bell.song@intel.com>

* do not overwrite secondary property

Signed-off-by: fishbell <bell.song@intel.com>

* enable new tests

Signed-off-by: fishbell <bell.song@intel.com>

* revert changes

Signed-off-by: fishbell <bell.song@intel.com>

* update tests

Signed-off-by: fishbell <bell.song@intel.com>

* resolve merge conflict

Signed-off-by: fishbell <bell.song@intel.com>

* azure failure dbug

Signed-off-by: fishbell <bell.song@intel.com>

* debug azure failure

Signed-off-by: fishbell <bell.song@intel.com>

* fix missing dependency

Signed-off-by: fishbell <bell.song@intel.com>

* fix case fail by merge

Signed-off-by: fishbell <bell.song@intel.com>

cpplint

Signed-off-by: fishbell <bell.song@intel.com>

* fix build error on windows

Signed-off-by: fishbell <bell.song@intel.com>

* rewrite case to remove dependent on public API

Signed-off-by: fishbell <bell.song@intel.com>

* resolve master conflict

Signed-off-by: fishbell <bell.song@intel.com>

---------

Signed-off-by: fishbell <bell.song@intel.com>
 2023-08-04 12:37:04 +08:00
Oleg Pipikin
ff0b51f3ca Rename CommonTestUtils namespace (#18590) 
* Rename CommonTestUtils namespace 1

* Rename CommonTestUtils namespace 2

* Rename CommonTestUtils namespace 3

* Rename CommonTestUtils namespace 4

* Fix1

* Fix2

* Fix3

* Apply comments

* Fix4

* Fix5
 2023-07-26 21:06:50 +02:00
yanlan song
ff3399a87a enable auto handle GPU.invalid_index case (#18658) 
* let auto handle GPU.valid_index case

Signed-off-by: fishbell <bell.song@intel.com>

* resolve merge conflict

Signed-off-by: fishbell <bell.song@intel.com>

* add suppress macro

Signed-off-by: fishbell <bell.song@intel.com>

* revert changes

Signed-off-by: fishbell <bell.song@intel.com>

* update case

Signed-off-by: fishbell <bell.song@intel.com>

---------

Signed-off-by: fishbell <bell.song@intel.com>
 2023-07-25 15:31:53 +08:00
Wang, Yang
1be4b21905 [AUTO] Set property optimal_number_of_infer_requests to hw device with default value (#17848) 
* Query the property optimal_number_of_infer_requests from plugin first if plugin supported.

Signed-off-by: Wang, Yang <yang4.wang@intel.com>

* Query the property ov::optimal_number_of_infer_request of actual device first and use it as the result of AutoExecutableNetwork property.

* Updated.

* Updated.

* Update.

* Update.

---------

Signed-off-by: Wang, Yang <yang4.wang@intel.com>
Co-authored-by: Chen Peter <peter.chen@intel.com>
 2023-07-25 10:05:18 +08:00
Wang, Yang
85f514788e [AUTO] Clean up the logic of AUTO device priorities (#18557) 
* Update selection logic for 3rd part devices within AUTO plugin.

* Remove MYRAID from AUTO test case.

* Update.

* Update.

* Update.

---------

Signed-off-by: Wang, Yang <yang4.wang@intel.com>
Co-authored-by: Chen Peter <peter.chen@intel.com>
 2023-07-25 10:03:14 +08:00
Wang, Yang
68c0711758 [AUTO] Update Auto unit test cases (#18634) 
* 1. Setting property ov::compilation_num_threads for actual device (not CPU) selected by AUTO.
2. Add the test case.

Signed-off-by: Wang, Yang <yang4.wang@intel.com>

* check if the selected device supports this property before enabling this property.

* Update.

Signed-off-by: Wang, Yang <yang4.wang@intel.com>

* Updated.

* Updated.

* Using the ov::device::properties, instead of the device name, to check if secondary property is set for hardware device.

* Update.

* Update.

* Update.

* Update the  property handling logic to support the ov::device::properties setting.

* Update.

* Update.

* Update the case to check if the secondary propery has high priority.

---------

Signed-off-by: Wang, Yang <yang4.wang@intel.com>
 2023-07-24 11:54:16 +08:00
yanlan song
a51d9494fa support context in auto and re-enable tests (#18554) 
wrap hardware remote context to compiled model

Signed-off-by: fishbell <bell.song@intel.com>
 2023-07-20 06:53:07 +00:00
Mircea-Aurelian Dan
5397e299fd [EISW-81712] Rename VPUX to VPU in openvino codebase (#17949) 
* Change `VPUX` occurrences to `VPU`

* Switch `VPU` library name

* Change remaining references to `VPUX`
 2023-07-19 15:55:24 +04:00
Oleg Pipikin
cdef86c366 Move unit and func test utils (#18423) 
* Move unit and func test utils. Rename targets

* Fix1
 2023-07-18 16:23:58 +02:00
Ilya Churaev
93e30468b1 Change plugin api (#18441) 
* Remove vector of so objects from Tensor, Any, VariableState and
RemoteContext

* Change IRemoteContext

* Fixed build without Proxy

* Moved API to ITensor

* Remove friends from Tensor class

* Changed query_state API

* Remote SoPtr for some returned values

* Fixed auto plugin

* Add so to converted objects

* Fixed build all on macOS

* Check that tensor pointers != nullptr

* Add SO to converter

* Added new constructors for SO ptrs

* Changed IVariableState API

* Remove proxy friend

* Remove friends and nullptrs from auto

* Fixed build

* Fixed HETERO plugin

* Fixed code style
 2023-07-14 10:47:53 +04:00
yanlan song
77f065e4b1 refactor code (#18475) 
Signed-off-by: fishbell <bell.song@intel.com>
 2023-07-13 13:58:44 +04:00
Wang, Yang
7b9f6c47b1 [AUTO] AUTO can't fall back if target device throws the exception before compiling model via AUTO (#18311) 
* 1. Update AUTO candidate device filtering logic.
2. Add AUTO handling the exception logic when generating the target device infomation.

Signed-off-by: Wang, Yang <yang4.wang@intel.com>

* Update.

* Update.

* Update.

* Update.

---------

Signed-off-by: Wang, Yang <yang4.wang@intel.com>
Co-authored-by: Chen Peter <peter.chen@intel.com>
 2023-07-13 09:09:25 +08:00
Nadezhda Ageeva
3330cd69a7 [GPU] Introduce ov::config_device_id internal property to the new API (#17820) 
* [GPU] Introduce ov::config_device_id internal property to the new API. Fix setting property for specific device

* Introduce ov::internal::supported_properties

* Fix caching tests

* Fix win tests

* Fix Proxy tests

* Replace CONFIG_KEY_INTERNAL(CONFIG_DEVICE_ID) by ov::internal::config_device_id in PROXY plugin

* Review comments
 2023-07-12 10:03:35 +00:00
Pavel Durandin
d864d89806 [GPU] Fix misprint in auto plugin (#18402) 2023-07-06 17:39:59 +04:00
yanlan song
1f7176031d Bell/fix static scan issues (#18285) 
* change default value

Signed-off-by: fishbell <bell.song@intel.com>

* fix case failure

Signed-off-by: fishbell <bell.song@intel.com>

* fix post commit failure

Signed-off-by: fishbell <bell.song@intel.com>

* fix sdl issues

Signed-off-by: fishbell <bell.song@intel.com>

---------

Signed-off-by: fishbell <bell.song@intel.com>
 2023-06-30 11:41:48 +04:00
yanlan song
05e8bd375e Bell/auto api 2.0 (#17805) 
* 2.0 innitial

Signed-off-by: fishbell <bell.song@intel.com>

* enable all tests

Signed-off-by: fishbell <bell.song@intel.com>

* remove unecessary files

Signed-off-by: fishbell <bell.song@intel.com>

* move container header to auto foler, remove uncessary macro define

Signed-off-by: fishbell <bell.song@intel.com>

* enable caching

Signed-off-by: fishbell <bell.song@intel.com>

* enable query_model

Signed-off-by: fishbell <bell.song@intel.com>

* support loaded_from_cache property

Signed-off-by: fishbell <bell.song@intel.com>

* fix some build warning

Signed-off-by: fishbell <bell.song@intel.com>

fake inputs/outputs if needed

Signed-off-by: fishbell <bell.song@intel.com>

* resolve conflict

Signed-off-by: fishbell <bell.song@intel.com>

* skip unsupported test

Signed-off-by: fishbell <bell.song@intel.com>

* use mock icore from common foler

Signed-off-by: fishbell <bell.song@intel.com>

* fix failure for remote tensors

Signed-off-by: fishbell <bell.song@intel.com>

* apply ppp related fix in auto

Signed-off-by: fishbell <bell.song@intel.com>

* fix build warning on windows

Signed-off-by: fishbell <bell.song@intel.com>

* fix ppp output layout issue

Signed-off-by: fishbell <bell.song@intel.com>

* fix ppp output layout issue

Signed-off-by: fishbell <bell.song@intel.com>

* clean up headers

Signed-off-by: fishbell <bell.song@intel.com>

* log formatting

Signed-off-by: fishbell <bell.song@intel.com>

* enable fps logging for binder mode

Signed-off-by: fishbell <bell.song@intel.com>

* apply review comments

apply review comments

Signed-off-by: fishbell <bell.song@intel.com>

* remove all legacy namings, exenetwork/network/metric/IE etc

Signed-off-by: fishbell <bell.song@intel.com>

* update readme

Signed-off-by: fishbell <bell.song@intel.com>

* fix build lto issue

Signed-off-by: fishbell <bell.song@intel.com>

* minor wording

Signed-off-by: fishbell <bell.song@intel.com>

* case fix

Signed-off-by: fishbell <bell.song@intel.com>

---------

Signed-off-by: fishbell <bell.song@intel.com>
Co-authored-by: Chen Peter <peter.chen@intel.com>
 2023-06-21 00:10:59 +08:00
Ilya Churaev
0743e9bfb5 Removed legacy methods SetBatch and SetBlob (#17984) 
* Removed legacy methods SetBatch and SetBlob

* Fixed GPU plugin build

* Remove DYN_BATCH_LIMIT from tests

* Revert some changes in GPU plugin
 2023-06-12 18:54:23 +00:00
Wang Wangwang
84bd391369 [AUTO] Support setting log_level from config (#17569) 
* [AUTO] Support setting log_level from config

* Add test cases

---------

Co-authored-by: Chen Peter <peter.chen@intel.com>
 2023-06-07 10:31:27 +08:00
Chen Peter
031f2cc7d1 Requirements for the HW plugin to integrate with AUTO (#17053) 
* Requirements for the HW plugin to integrate with AUTO

Signed-off-by: Peter Chen <peter.chen@intel.com>

* Update property requirements and wording

1. Added purpose for each reqired property
2. Removed autobatching properties
3. Updated wording

Signed-off-by: Peter Chen <peter.chen@intel.com>

* Add one BA test and update purpose for model_name

Signed-off-by: Peter Chen <peter.chen@intel.com>

* Add request to ov::compilation_num_threads

Signed-off-by: Peter Chen <peter.chen@intel.com>

* Add link to intgration with AUTO

Signed-off-by: Peter Chen <peter.chen@intel.com>

* Wording with API 2.0

Co-authored-by: Ilya Churaev <ilyachur@gmail.com>

* Try to fix the link

* Remove ":doc:"

* Add postfix "__" for external link

* Apply suggestions from code review

Co-authored-by: Tatiana Savina <tatiana.savina@intel.com>

* bash command and multiple devices description update

Signed-off-by: Peter Chen <peter.chen@intel.com>

---------

Signed-off-by: Peter Chen <peter.chen@intel.com>
Co-authored-by: Ilya Churaev <ilyachur@gmail.com>
Co-authored-by: Tatiana Savina <tatiana.savina@intel.com>
 2023-06-02 15:04:33 +08:00
Maciej Smyk
dc36ec11b5 [DOCS] Link adjustment for dev docs + fix to build.md CPU link for master (#17744) 
* link-update-1

* link update

* Update build.md

* dl workbench

* Update README.md
 2023-05-31 13:27:20 +04:00
Ilya Lavrenov
84db7d0ee6 Build using conanfile.txt (#17580) 
* Build using conanfile.txt

* Update .ci/azure/linux_arm64.yml

* Several improvements

* Removed conanfile.py

* Try to use activate / deactivate

* Fixed clang-format code style

* Supported TBB version from Conan

* Added more NOMINMAX

* Fixed static build

* More improvements for static build

* Add usage of static snappy in case of static build

* More fixes

* Small fixes

* Final fixes
 2023-05-19 14:01:39 +04:00
Ilya Lavrenov
04171416f4 Put mingw on gcc code path (#16101) 
* Supported mingw-w64

* Supported mingw-w64

* Supported mingw-w64
 2023-05-17 00:47:55 +04:00
yanlan song
3a0fa86ef9 add doc update (#17223) 
Signed-off-by: fishbell <bell.song@intel.com>
 2023-05-04 12:49:24 +08:00
Wang Wangwang
962df2cdcb [AUTO] Exclude other vendor's GPU device in default candidate list (#17063) 
* [AUTO] Plugin takes only Intel dGPU as 1st priority

* Update test case

* Simplify the code

* Support more test cases in GetDeviceList API

* Add notIntelGPU to _deviceBlocklist in AUTO plugin

* Restore some code formats

* Update test cases

* Add some logs to GetValidDevice API

* Simplify the code

---------

Co-authored-by: Wanglei Shen <wanglei.shen@intel.com>
 2023-04-26 14:42:53 +01:00
yanlan song
64b5a4595a Bell/use cpu for dynamic models (#17149) 
* clean up multi code path

Signed-off-by: fishbell <bell.song@intel.com>

* clang

Signed-off-by: fishbell <bell.song@intel.com>

* potential locking issue

Signed-off-by: fishbell <bell.song@intel.com>

* remove unecessary variable

Signed-off-by: fishbell <bell.song@intel.com>

* clear redundunt return syntax

Signed-off-by: fishbell <bell.song@intel.com>

* still use cpu for dynamic models

Signed-off-by: fishbell <bell.song@intel.com>

* merge master

Signed-off-by: fishbell <bell.song@intel.com>

---------

Signed-off-by: fishbell <bell.song@intel.com>
 2023-04-25 01:01:11 +04:00
Wanglei Shen
10c56708fd update auto architecture document in GitHub for 2023.0 release (#17141) 
* update auto architecture doc

* update auto architecture doc

* Apply suggestions from code review

Co-authored-by: Karol Blaszczak <karol.blaszczak@intel.com>

* update for comments

---------

Co-authored-by: Karol Blaszczak <karol.blaszczak@intel.com>
 2023-04-24 15:44:34 +00:00
Ilya Lavrenov
a34ef680f2 Made plugins.hpp generation to be CONFIG dependent (#17139) 2023-04-24 14:48:45 +04:00
yanlan song
fed06fcb91 resubmit PR#17006 (#17137) 
* clean up multi code path

Signed-off-by: fishbell <bell.song@intel.com>

* clang

Signed-off-by: fishbell <bell.song@intel.com>

* potential locking issue

Signed-off-by: fishbell <bell.song@intel.com>

* remove unecessary variable

Signed-off-by: fishbell <bell.song@intel.com>

* clear redundunt return syntax

Signed-off-by: fishbell <bell.song@intel.com>

* WR build issue on buntu 2004

Signed-off-by: fishbell <bell.song@intel.com>

---------

Signed-off-by: fishbell <bell.song@intel.com>
 2023-04-23 11:56:07 +00:00
yanlan song
304991f88b Revert "Clean up unused code (#17006)" (#17110) 
This reverts commit 359b444558.
 2023-04-21 15:26:01 +04:00
yanlan song
359b444558 Clean up unused code (#17006) 
* clean up multi code path

Signed-off-by: fishbell <bell.song@intel.com>

* clang

Signed-off-by: fishbell <bell.song@intel.com>

* potential locking issue

Signed-off-by: fishbell <bell.song@intel.com>

* remove unecessary variable

Signed-off-by: fishbell <bell.song@intel.com>

* clear redundunt return syntax

Signed-off-by: fishbell <bell.song@intel.com>

---------

Signed-off-by: fishbell <bell.song@intel.com>
 2023-04-21 04:23:55 +00:00
Wang Wangwang
589bd6d076 Add the implementation to GetExecGraphInfo API in AUTO plugin (#16979) 2023-04-17 17:24:07 +08:00
Ilya Churaev
aa1f26a2b7 Enable more tests for Template plugin (#16874) 
* Enable more tests for Template plugin

* Removed deprecated API

* Fixed typo

* Added internal properties

* Removed incorrect tests

* Fixed code style

* Enabled some tests
 2023-04-17 07:07:09 +00:00
Wang Wangwang
1037f24c46 [AUTO] Remove exclusive_asyc_requests property from AUTO plugin (#16840) 
* Remove exclusive_asyc_requests property from AUTO plugin

* Update test case

* Add test case to test incorrect config

* Remove the test case related to exclusive_asyc_requests property of AUTO plugin
 2023-04-13 06:35:42 +00:00
Wang Wangwang
c2c2143f45 clean AB property from virtual plugin and core global config (#16877) 
* Benchmark_app set ov::hint::allow_auto_batching through compile_model

* Remove the process about allow_auto_batching in set_property of core

* Remove allow_auto_batching and auto_batch_timeout property from AUTO plugin

* Reserve the info logs and add API to check auto_batching

* Update test case, rm AB property test from core config tests

* Update some API in AUTO plugin config
 2023-04-12 17:37:57 +04:00