IntenseWebs/openvino
3
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
11,391 Commits 38 Branches 54 Tags
b4e608cf47a838cd20ec6f07341defba7de63884
Commit Graph

53 Commits

Author SHA1 Message Date
Ilya Churaev
0743e9bfb5 Removed legacy methods SetBatch and SetBlob (#17984) 
* Removed legacy methods SetBatch and SetBlob

* Fixed GPU plugin build

* Remove DYN_BATCH_LIMIT from tests

* Revert some changes in GPU plugin
 2023-06-12 18:54:23 +00:00
Nadezhda Ageeva
65caa9d745 [HETERO]: Avoid duplicated results (#17725) 
* [HETERO]: Avoid duplicated results

* Code style
 2023-05-31 15:13:01 +04:00
Ilya Lavrenov
a34ef680f2 Made plugins.hpp generation to be CONFIG dependent (#17139) 2023-04-24 14:48:45 +04:00
Oleg Pipikin
7ce40996e5 Fix copy constructor and assignment for ov::Any (#16757) 
* Fix copy constructor and assignment for ov::Any

* Fix1

* Apply comments

* Add test

* Fix code style

* Fix2

* Fix3
 2023-04-14 22:12:18 +04:00
Ilya Churaev
4a43753e02 Enable some tests for Template plugin (#16832) 
* Remove the skip of template plugin tests

* Enable some skipped tests for template plugin

* Added cancel callback, collect per-layer statistic, fixed tests

* Fixed template tests

* Rename internal API terminate to cancel

* Fixed windows tests

* Fixed logic with performance counters
 2023-04-12 01:02:28 +04:00
Nadezhda Ageeva
5e2f424fd0 [HETERO] Enable smoke_Hetero_CachingSupportCase tests (#16711) 2023-04-06 21:19:37 +04:00
Ilya Lavrenov
e66b837104 Properties improvements: part 2 (#16489) 
* Properties improvements: part 2

* Accurate configs handling in HETERO / BATCH

* Align plugins in caching properties

* Fixed caching mock tests

* Added new TestNoCachingProperties test

* Fixed test

* Added ov::caching_properties to API 1.0 metrics as well

* Fixes for HETERO plugin

* Fixed tests

* Even more refactoring in HETERO plugin config management
 2023-03-25 19:28:05 +04:00
Ilya Lavrenov
580b99c99b Align plugins in caching properties (#16528) 
* Align plugins in caching properties

* Fixed caching mock tests

* Added new TestNoCachingProperties test

* Fixed test

* Added ov::caching_properties to API 1.0 metrics as well
 2023-03-25 00:26:18 +04:00
Nadezhda Ageeva
65e5ed7dd7 [HETERO]: support caching properties (#16451) 
* Fixed build

* [HETERO]: support caching properties

* Fix caching test

* Code style

* Change result type from map to vector

* Review comments

---------

Co-authored-by: Ilya Churaev <ilya.churaev@intel.com>
 2023-03-24 12:25:55 +04:00
Sebastian Golebiewski
cbb25e9483 [DOCS] Proofreading developer documentation moved from wiki. (#15886) 
Minor stylistic and grammar corrections. Fixing links

* Apply suggestions from code review

Co-authored-by: Tatiana Savina <tatiana.savina@intel.com>
 2023-03-22 09:08:31 +01:00
Ilya Churaev
ec0a1e58d1 Fixed some leftovers for 2.0 dev api (#16421) 
* Fixed some leftovers for 2.0 dev api

* Fixed build issue
 2023-03-21 09:34:37 +00:00
Ilya Lavrenov
0c99135d44 Improved properties handling between Core and plugins (#16296) 
* [HETERO]: adopt setting device properties in benchmark_app/speech_sample for HETERO

Fix IEClassHeteroExecutableNetworkGetMetricTest_SUPPORTED_METRICS test

Fix NumStreamsAndDefaultPerfHintToHWTest/PerHintAndDefaultPerfHintToHWTest tests

[HETERO][MULTI][AUTO] Make ov::device::properties regular property

[PYTHON] Update python BA with device properties

Update after rebase

Update src/plugins/auto/auto_executable_network.cpp

Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>

Update src/plugins/auto/multi_executable_network.cpp

Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>

Fix merge conflicts, apply some review comments

* Multiple improvements

* [HETERO]: adopt setting device properties in benchmark_app/speech_sample for HETERO

Fix IEClassHeteroExecutableNetworkGetMetricTest_SUPPORTED_METRICS test

Fix NumStreamsAndDefaultPerfHintToHWTest/PerHintAndDefaultPerfHintToHWTest tests

[HETERO][MULTI][AUTO] Make ov::device::properties regular property

[PYTHON] Update python BA with device properties

Update after rebase

Update src/plugins/auto/auto_executable_network.cpp

Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>

Update src/plugins/auto/multi_executable_network.cpp

Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>

Fix merge conflicts, apply some review comments

* Code style, bugfix after merging improvement

* More improvements

* Even more improvements

* Commit changes in core_impl.cpp

* Added parsing of any maps

* Fixed code-style

* Fixed AB mock tests build

* Fixed comparison

* Added new AB config key

* Improvements and fixes (#147)

* Fix BA, fix GetSupportedConfig call for virtual plugins (#148)

* Fix GPU tests (#149)

* Fix BA, fix GetSupportedConfig call for virtual plugins

* Fix GPU tests

* Code style

* Improvements 10

* Fixed incorrect tests

* Revert removal cache_dir

* Revert removal cache_dir

* Fixed clean

* Supported device ID in CPU

* More fixed tests

* clang-format

* Fix legacy GPU tests (#150)

* Removed clone_map

* clang-format

* Added clone_map back

---------

Co-authored-by: Nadezhda Ageeva <nadezhda.ageeva@intel.com>
Co-authored-by: Nadezhda Ageeva <nkogteva@gmail.com>
 2023-03-20 12:42:40 +00:00
Ilya Lavrenov
f080a0d9cf Added NCC style for frontends sources (#16200) 
* Ability to provide several source dirs for ncc-style checks

* Fixed include headers; added NCC to TF common

* Fixed NCC for frontends

* Fixed NCC for frontends

* Extra fixes

* Fixest push --f

* Clang-format

* Apply comments

* Add an option to specify required clang-format version

* Update src/frontends/tensorflow/src/decoder_proto.cpp

* Update src/frontends/tensorflow/src/decoder_proto.cpp
 2023-03-13 14:54:00 +00:00
Ilya Lavrenov
c3b22af3f7 CoreImpl small refactoring (#16145) 
* Small CoreImpl refactoring

* Removed cache_dirhandling from CPU plugin

* clang-format

* Fixed python tests

* Fix

* Fixed bugs in HETERO case

* Fixed clang-format and warnings in auto plugin

* Added import_export as capability for TEMPLATE plugin

* Commented throw exception from loaded_from_cache

* Fixed clang-formatof ro template plugin
 2023-03-08 19:19:52 +04:00
Ilya Lavrenov
6d7b94b8cd Improved API validator logic (#15942) 2023-02-25 01:11:50 +04:00
Xuejun Zhai
91df0a8aa9 [API remove] remove variantImpl & variantwrapper related class/interfaces (#15580) 
* [API remove] remove variantImpl & variantwrapper related class/interfaces

Signed-off-by: xuejun <xuejun.zhai@intel.com>

* [Remove APIs] fix code format issue

Signed-off-by: xuejun <Xuejun.Zhai@intel.com>

* [Remove api] fix python compiler issue caused by deprecated varient

Signed-off-by: xuejun <Xuejun.Zhai@intel.com>

* [Remove APIs] fix code format issue

Signed-off-by: xuejun <xuejun.zhai@intel.com>

---------

Signed-off-by: xuejun <xuejun.zhai@intel.com>
Signed-off-by: xuejun <Xuejun.Zhai@intel.com>
 2023-02-17 16:31:26 +04:00
Nadezhda Ageeva
0efa17f95c HETERO move dumping dot files to separate file (#15758) 2023-02-16 18:10:41 +00:00
Maciej Smyk
70cb829992 [DOCS] Move of developer documentation from wiki to md documents - master (#15372) 
* CPU Plugin README creation

* debug capabilities

* Update debug_capabilities.md

* performance_analysis_ITT_counters

* cpu-emulation

* runtime_parameters_cache

* Update README.md

* internal_cpu_plugin_optimization

* See Also update for CPU Plugin

* See Also update for CPU Plugin 2

* intel_gpu

* Update README.md

* source code structure & See Also update for CPU plugin

* Update README.md

* See also update

* basic_data_structure

* memory_allocation_gpu_plugin

* Update memory_allocation_gpu_plugin.md

* simplified workflow

* graph optimization passes

* execution_of_inference

* GPU Plugin

* GPU Plugin fix

* Snippets

* Update README.md

* Update README.md

* fixes

* Snippets fix

* Update README.md

* component description

* Key Contacts

* Apply suggestions from code review

Co-authored-by: Ilya Churaev <ilyachur@gmail.com>

* Update src/plugins/intel_gpu/README.md

* Update src/plugins/intel_cpu/docs/internal_cpu_plugin_optimization.md

* Update src/plugins/intel_cpu/docs/internal_cpu_plugin_optimization.md

* Update src/plugins/intel_cpu/docs/internal_cpu_plugin_optimization.md

* Apply suggestions from code review

* Apply suggestions from code review

* Apply suggestions from code review

Text graphs to mermaid

* Update src/plugins/intel_gpu/docs/simplified_workflow.md

* Delete ov_intel_gpu_plugin_diagram.png

Removal of ov_intel_gpu_plugin_diagram.png file as the mermaid version is replacing it.

* Apply suggestions from code review

* Update src/common/snippets/README.md

---------

Co-authored-by: Sebastian Golebiewski <sebastianx.golebiewski@intel.com>
Co-authored-by: Ilya Churaev <ilyachur@gmail.com>
 2023-02-16 11:03:11 +04:00
Haiqi Pan
3f06d871bf Remove catch(...) code style (#14433) 
* remove ... in /src/bindings/c and resolve format

* remove ... in auto and resolve format

* remove ... in auto batch and resolve format

* remove ... in hetero and resolve format

* IE exception

* IE exception

* const

* const

* resolve format and ov::Exception

* ov::Exception

* reset IE::Exception

* remove ov::Exception

* InferenceEngine->IE in auto_schedule.cpp

* fix coredump while runing test case smoke_AutoMultiMock_NumStreamsAndDefaultPerfHintToHWTest

* fix coredump issue of running LoadNetworkWithSecondaryConfigsMockTest

* fix commpile fail in CI

* resolve core dump of running exec_network_get_metrics.cpp and disable some test cases for KEEMBAY and MYRIAD in exec_network_get_metrics.cpp

* remove test cases of MYRIAD and resolve core dump of running KEEMBAYin exec_network_get_metrics.cpp

* resolve conflic of common.h

* resolve conflic of common.h

* resolve common.h complie fail

---------

Co-authored-by: guozhong <guozhong.wang@intel.com>
Co-authored-by: Ilya Churaev <ilya.churaev@intel.com>
 2023-02-16 11:44:24 +08:00
Nadezhda Ageeva
421d791f58 [HETERO] Return only own properties for compiled model (#15547) 2023-02-07 23:54:08 +04:00
Tomasz Jankowski
988847f559 Transformation component transition to OV namespace (phase 4) (#13558) 
* Use openvino pass graph_rewrite

* Replace use of ngraph::pass to ov::pass

* Remove ngraph::pass aliases

* Update after rebase

* Fix post merge conflicts

* Apply code style

* Apply code style

* Remove bypassing inclusion

* Apply code style
 2023-01-25 01:02:35 +03:00
Ilya Churaev
0c9abf43a9 Updated copyright headers (#15124) 
* Updated copyright headers

* Revert "Fixed linker warnings in docs snippets on Windows (#15119)"

This reverts commit 372699ec49.
 2023-01-16 11:02:17 +04:00
Nadezhda Ageeva
a8a59f3cb4 [HETERO] Remove WA for Parameters, Results and Constants. (#15020) 
* [HETERO] Remove WA for Parameters, Results and Constants.

* Update HeteroSyntheticTest
 2023-01-11 17:45:56 +04:00
yanlan song
80a07375bf Bell/hetero execution devices (#13924) 
* initial commit

Signed-off-by: fishbell <bell.song@intel.com>

* add cases

Signed-off-by: fishbell <bell.song@intel.com>

* apply review comments

Signed-off-by: fishbell <bell.song@intel.com>

* enable app

Signed-off-by: fishbell <bell.song@intel.com>

* clang

Signed-off-by: fishbell <bell.song@intel.com>

* apply review comments

Signed-off-by: fishbell <bell.song@intel.com>

* enable cpu conditionally

Signed-off-by: fishbell <bell.song@intel.com>

* enable cpu tests

Signed-off-by: fishbell <bell.song@intel.com>

Signed-off-by: fishbell <bell.song@intel.com>
 2022-11-15 09:53:18 +00:00
Ilya Churaev
8a9c19e3eb Warning as error for Windows (#13291) 
* parent 6e7016ccda
author Ilya Churaev <ilya.churaev@intel.com> 1664281499 +0400
committer Ilya Churaev <ilya.churaev@intel.com> 1664510018 +0400

Fixed warnings on local machine

* Added CMAKE_COMPILE_WARNING_AS_ERROR usage

* Fixed style

* Fixed merge conflicts

* Fixed typo

* Fixed myriad build for macOS

* Fixed warning

* Fixed tests

* Disabled incorrect test

* Try to fix linux tests

* Revert "Try to fix linux tests"

This reverts commit 29224c93ff.

* Fixed tests

* Revert logic with incorrect cast

* Fixed log softmax

* Disable warning as error for cuda

* Try to fix inference_engine_s

* Fixed cmake

* Revert "Fixed cmake"

This reverts commit 87e9e4e674.

* Revert "Try to fix inference_engine_s"

This reverts commit a1adca8b05.

* WA for static symbols in inference_engine_s test library

* Fixed code style

* Fixed static definition for master

* Revert "Fixed static definition for master"

This reverts commit 20d00d215a.

* Revert "Fixed code style"

This reverts commit 0eb2362543.

* Revert "WA for static symbols in inference_engine_s test library"

This reverts commit 75ef86a79d.

* Fixed linker issue for Windows

* Disable WaE by default

* Disable warning as error in the developer package

* Try to fix dev package

* Try to fix Windows Jenkins

* Revert old behavior for tread_warn_as_err variable
 2022-10-06 13:44:21 +04:00
Ilya Churaev
9e7c821477 Enabled plugins auto registration (#12573) 
* Enabled plugins auto registration

* Fixed comments

* Skip CMakeLists.txt
 2022-08-16 23:19:10 +04:00
Ilya Lavrenov
8b9aea9fad Fixed missed pugixml in case of system libs + wheel package (#12464) 
* Fixed missed pugixml in case of system libs + wheel package

* Fixes

* Removed useless rpath
 2022-08-12 11:35:56 +04:00
Ilya Lavrenov
101e1ea5ad simple Windows installer POC (#12308) 
* Fixes for cases when TBB_DIR env var is set

* Don't use make in build_samples.sh script

* First version of Windows installer

* WIndows NSIS installer
 2022-07-27 14:04:22 +04:00
Ilya Churaev
811a483acb Fixed newAPI for case if core was removed (#12207) 
* Fixed newAPI for case if core was removed

* Fixed code style

* Fixed typo

* Use new API by default

* Create core with template plugin

* Added doxygen comment
 2022-07-22 16:46:08 +03:00
yanlan song
e718e51a85 Bell/fix lifecycle coredump (#11934) 
* enable binder schedule

Signed-off-by: fishbell <bell.song@intel.com>

* add cases

Signed-off-by: fishbell <bell.song@intel.com>

* refine

Signed-off-by: fishbell <bell.song@intel.com>

* fix build failure

Signed-off-by: fishbell <bell.song@intel.com>

* fix coredump

Signed-off-by: fishbell <bell.song@intel.com>

* do not return hw requests directly, potential issues

Signed-off-by: fishbell <bell.song@intel.com>

* fix bug

Signed-off-by: fishbell <bell.song@intel.com>

typo

Signed-off-by: fishbell <bell.song@intel.com>

* optimize memory

Signed-off-by: fishbell <bell.song@intel.com>

* hold the hw plugin

Signed-off-by: fishbell <bell.song@intel.com>

* Revert "hold the hw plugin"

This reverts commit 5b537f5b6f.

* apply the fix

Signed-off-by: fishbell <bell.song@intel.com>

apply the fix

Signed-off-by: fishbell <bell.song@intel.com>

* hold the plugin library for destructing tensor

Signed-off-by: fishbell <bell.song@intel.com>

* solve the virtuual plugin Getblob life cycle issue

Signed-off-by: fishbell <bell.song@intel.com>

* remove log

Signed-off-by: fishbell <bell.song@intel.com>

* refine interface

Signed-off-by: fishbell <bell.song@intel.com>

* fix build failure

Signed-off-by: fishbell <bell.song@intel.com>

* fix for hetero plugin

Signed-off-by: fishbell <bell.song@intel.com>

* replace with vector

* enable life time tests for virtual plugins

Signed-off-by: fishbell <bell.song@intel.com>

rework cases due to vpux build issue

Signed-off-by: fishbell <bell.song@intel.com>

disable context test for now

Signed-off-by: fishbell <bell.song@intel.com>

Co-authored-by: Chen Peter <peter.chen@intel.com>
 2022-07-06 05:21:17 +00:00
yanlan song
912f40e74d stateful inferface impl for AUTO/HETERO (#11590) 
* CPU for stateful model

Signed-off-by: fishbell <bell.song@intel.com>

* log

Signed-off-by: fishbell <bell.song@intel.com>

* hetero impl

Signed-off-by: fishbell <bell.song@intel.com>

* enable tests

Signed-off-by: fishbell <bell.song@intel.com>
 2022-05-06 12:43:56 +08:00
Ilya Churaev
8ab5dbade0 Revert "Add constant folding to hetero to avoid dynamism on GPU (#10572)" (#11370) 
This reverts commit 5b18677f1b.
 2022-04-01 10:16:14 +03:00
Oleg Pipikin
5b18677f1b Add constant folding to hetero to avoid dynamism on GPU (#10572) 
* Add constant folding to hetero to avoid dynamism on GPU

* Aplly comments

* Apply comments 2

* Fix1
 2022-03-25 07:10:23 +03:00
Anton Pankratov
a7b28953e2 Added Import export device capability into hetero plugin (#10455) 2022-02-17 12:15:45 +03:00
Anton Pankratov
be8e15c180 fix HETERO with branching without splits (#10325) 
* Default value of streams in ba is AUTO

* Fixed hetero cases with branches

* Fixed format
 2022-02-14 10:36:41 +03:00
Ilya Lavrenov
f2f281e60b Renamed ov_runtime => openvino, ov_ => openvino_ prefix (#10069) 
* Renamed ov_runtime => openvino, ov_ => openvino_ prefix

* Coverage fix

* More fixes

* Fixed MO tests with custom FE
 2022-02-03 20:03:41 +03:00
Anton Pankratov
8993c4c18a Deprecated ov::Any implicit cast to any types (#9409) 
* Depricated Any implicit cast

* Fixed test

* fixed gna build

* Fixed warnings in benchmark_app

* Fixed test build

* ncc exception for PrintTo

* Error mesage in test

* Error mesage in test

* fixed build
 2022-02-03 19:10:52 +03:00
Ilya Churaev
03c38ca3fd Changed code which check newAPI flag from Core (#10080) 
* Changed code which check newAPI flag from Core

* Fixed typo
 2022-02-03 10:36:23 +03:00
Anton Pankratov
29d103087a Aggregating plugins use single config value to pass device list (#9379) 
* Aggregating plugins use single config value to pass device list

* format fix

* fixed build

* Fixed tests

* Fixed test

* fied build
 2022-01-31 15:43:32 +03:00
Anton Pankratov
f45991bd64 OV 2.0 c++ configuration API (#9870) 
* New configuration API

* Review fix

* review coments

* fixed device name map

* fixed header

* code stile

* fixed optimization capabilities

* flatten properties

* dox fix

* doc

* merge conflicts

* fixed merge conflicts

* Fixed subobject linkage warning

* foramt fix

* Fixed unity test build

* Merge conflict fixes

* Fixed variadic
 2022-01-25 12:43:56 +03:00
Alexander Zhogov
6c2d1e923c Revert "OV2.0 c++ configuration API (#9829)" (#9860) 
This reverts commit 50da8c4aed.
 2022-01-24 11:29:09 +03:00
Anton Pankratov
50da8c4aed OV2.0 c++ configuration API (#9829) 
* New configuration API

* Review fix

* review coments

* fixed device name map

* fixed header

* code stile

* fixed optimization capabilities

* flatten properties

* dox fix

* doc

* merge conflicts

* fixed merge conflicts

* Fixed subobject linkage warning

* foramt fix
 2022-01-21 18:44:41 +03:00
Alexander Zhogov
79ff926b6d Revert "OpenVINO runtime Configuration API (#7750)" (#9828) 
This reverts commit 400e9ad916.
 2022-01-21 13:30:39 +03:00
Anton Pankratov
400e9ad916 OpenVINO runtime Configuration API (#7750) 
* New configuration API

* Review fix

* review coments

* fixed device name map

* fixed header

* code stile

* fixed optimization capabilities

* flatten properties

* dox fix

* doc

* merge conflicts

* fixed merge conflicts
 2022-01-21 10:32:57 +03:00
Alexey Suhov
a79830cb55 Update year to 2022 in copyright notice (#9755) 2022-01-19 01:07:49 +03:00
Anton Pankratov
790f02c0b1 Hetero creates single result node (#9572) 2022-01-14 12:26:39 +03:00
Ilya Churaev
f74b9caabb Removed old dynamism API from infer request (#9557) 
* Removed old dynamism API from infer request

* Fixed segfault

* Fixed some tests

* Added method to set inputs, outputs

* Fix python tests

* Try to fix window build
 2022-01-13 14:54:14 +03:00
Ilya Churaev
42350a705e Remove legacy targets (#9333) 
* Remove some legacy targets

* Replace some targets

* Removed inference_engine_plugin_api dependency

* Minor comment for developer config

* Fixed include paths

* Small fixes for static build

* Try to fix build pyopenvino

* Fixed comments

* Try to fix build

* Include OpenVINODeveloperPackage inside InferenceEngineDeveloperPackageConfig

* Try to fix GAPI tests
 2021-12-23 08:16:23 +03:00
Wang, Yang
8c746fd52c Align AUTO/MULTI/HETERO wording (#8884) 
* Align AUTO's behavior to parent Epic.

Signed-off-by: Wang, Yang <yang4.wang@intel.com>

* update wording.

Signed-off-by: Wang, Yang <yang4.wang@intel.com>

* Update.

Signed-off-by: Wang, Yang <yang4.wang@intel.com>

* Update wprding in hetero plugin.

Signed-off-by: Wang, Yang <yang4.wang@intel.com>

* Update.

Signed-off-by: Wang, Yang <yang4.wang@intel.com>

* Change "metric" to  "metric key".

Signed-off-by: Wang, Yang <yang4.wang@intel.com>
 2021-12-22 12:21:08 +03:00
Anton Pankratov
114d37b28c Fixed release oreder (#9218) 2021-12-20 12:11:32 +03:00