Commit Graph

428 Commits

Author SHA1 Message Date
Wanglei Shen
0541a12730 update numactl support and add test cases (#17879)
* update numactl support and add test cases

* fix typo

* remove debug info

* update for comments

* update for comments

* move test case into separated file

* update for comments

* update code style
2023-06-13 23:37:08 +08:00
Ilya Churaev
6043bcb5c0 Fixed Core import model call (Ported from proxy) (#18020) 2023-06-13 08:16:25 +00:00
Ilya Churaev
c8f3ed814b Finalize deprecation of public IE API (#17962)
* Remove NV12 and I420 blobs and deprecate some legacy API

* Fixed some errors

* Remove NV12 blobs

* Remote NV12 conversion

* Fixed other warnings

* Suppress version

* Fix some warnings

* Fixed version

* Try to fix some warnings

* Suppress warnings in C header

* Suppress warnings in C

* Fixed Windows exceptions

* Try to fix warnings

* Try to fix C bindings build

* Suppress InferRequest

* Fixed some build issues

* Fixed some errors

* Fixed build all for macOS

* Suppress some warnings

* Fixed merge conflict
2023-06-13 07:12:17 +04:00
Ilya Churaev
0743e9bfb5 Removed legacy methods SetBatch and SetBlob (#17984)
* Removed legacy methods SetBatch and SetBlob

* Fixed GPU plugin build

* Remove DYN_BATCH_LIMIT from tests

* Revert some changes in GPU plugin
2023-06-12 18:54:23 +00:00
Ilya Churaev
df44f92a97 Remove NV12 and I420 blobs and deprecate some legacy API (#17919)
* Remove NV12 and I420 blobs and deprecate some legacy API

* Fixed some errors

* Remove NV12 blobs

* Remote NV12 conversion

* Fixed other warnings

* Suppress version

* Fix some warnings

* Fixed version

* Try to fix some warnings

* Suppress warnings in C header

* Suppress warnings in C

* Fixed Windows exceptions

* Try to fix warnings

* Try to fix C bindings build

* Suppress InferRequest

* Fixed some build issues

* Fixed some errors
2023-06-12 21:15:02 +04:00
Ilya Lavrenov
50c85f01ab ARM static build (#17970) 2023-06-10 23:40:39 +04:00
Ilya Churaev
a0e8d9a630 Deprecate main IE developer API classes (#17983)
* Deprecate main IE develiper API classes

* Remove legacy snippet

* Fixed warning for VariableState
2023-06-10 19:25:54 +04:00
Ivan Tikhonov
74100670ac Delete the deprecated LowLatency (version1) transformation (#17965)
* Delete the deprecated LowLatency (version1) transformation

* detele LowLatency refs from the docs
2023-06-10 12:24:43 +04:00
Ilya Churaev
724eb94a1d Deprecate plugins config keys (#17974) 2023-06-09 17:55:14 +00:00
Ilya Churaev
c8e331003f Port some changes from proxy branch (#17961)
* Port some changes from proxy branch

* Port test changes

* Rewrite approach for compile model and tensor

* Fixed review
2023-06-09 16:08:53 +02:00
Sun Xiaoxia
9e8d64bf70 Xiaoxia/update cpu mapping (#17451)
* generate cpu mapping table pre tbb

* change function name

* fix proc_type_table is wrong in RPL

* add getCpuMapFromCores test, fix comments

* modify test case

* fix comments

* fix code style

* add throw an exception

* fix numa_nodes=0 on ARM

* modify numa_nodes

* fix ExportOptimalNumStreams failed on ARM

* fix comments

* add discription of get_cpu_mapping_from_cores

* update for numactl support

* fix cores is wrong

---------

Co-authored-by: Wanglei Shen <wanglei.shen@intel.com>
2023-06-08 22:28:35 +08:00
Wanglei Shen
a0c8fdbd86 enable CPU map and multiple streams for ARM Linux (#17450)
* enable CPU map for ARM Linux based on freqency information

* fix code style issue

* fix code style issue

* remove 'streams = 1' WA for ARM linux

* update for typo and comments

* update for comments

* keep  WA

* keep WA of streams = 1 for ARM Linux

* update num_streams WA for ARM Linux in test case

* update for comments

* update for comments

* update for comments

* update for comments

* update for merge conflict

* update and add test case for MTL
2023-06-03 17:07:02 +08:00
Marcus van Houdt
c3a54b0a6e Add missing != operator, fixing compilation issue with Visual Studio 17.6 together with /std:c++latest (#17860) 2023-06-02 22:05:57 +04:00
Ilya Churaev
18d6ece4e4 Deprecate ExecutableNetwork and InferRequest API (#17801)
* Deprecate ExecutableNetwork and InferRequest API

* Fixed some warnings

* Fixed some warnings

* Try to fix documentation

* Try to skip documentation warnings
2023-06-01 12:50:56 +04:00
Ilya Churaev
d53339ff67 Deprecate legacy precisions and layouts (#17803)
* Deprecate legacy precisions and layouts

* Suppress some warnings

* Fixed some warnings
2023-06-01 12:47:55 +04:00
Ilya Churaev
ea04f8217d Mark as deprecated nGraph API (#17647)
* Mark as deprecated nGraph API

* Fixed code style

* Added IN_OV_LIBRARY define

* Suppress warnings for log

* Suppress warning

* Updated nGraph headers

* Fixed build for macOS

* Fixed lpt and snippets

* Fixed build all on macOS

* Suppress some warnings

* Fixed some new warnings

* Fixed new warnings

* Try to fix some warnings

* More warnings

* Soome change

* Suppress more warnings

* Suppress warnings for transformations

* Suppress warnings for LPT

* One more fix

* Suppress more warnings

* Try to fix opset error

* Remove opset constructor

* Cannot fix opset warning

* Suppress warnings for offline transfromations

* Fixed some warnings for Windows

* Fixed code style

* Suppress some warnings for onnx FE

* Revert "Suppress some warnings for onnx FE"

This reverts commit 75d23b64fc.

* Revert "Fixed code style"

This reverts commit c6eba63116.

* Revert "Fixed some warnings for Windows"

This reverts commit 23d7ed88b6.

* Revert "Suppress warnings for offline transfromations"

This reverts commit 0b9f6317bf.

* Revert "Cannot fix opset warning"

This reverts commit 19ea658639.

* Revert "Remove opset constructor"

This reverts commit 06afb1bc20.

* Revert "Suppress warnings for LPT"

This reverts commit 58b1c0f5a0.

* Revert "Suppress warnings for transformations"

This reverts commit f8bb9814a1.

* Revert "Suppress more warnings"

This reverts commit f9f0da9acb.

* Revert "Soome change"

This reverts commit e545d4984e.

* Remove deprecation for ngraph::OpSet and FactoryRegistry
2023-06-01 12:44:28 +04:00
Maciej Smyk
dc36ec11b5 [DOCS] Link adjustment for dev docs + fix to build.md CPU link for master (#17744)
* link-update-1

* link update

* Update build.md

* dl workbench

* Update README.md
2023-05-31 13:27:20 +04:00
Wanglei Shen
047d2d1d7f support numactl on Linux in multi-threading 2.0 (#17209)
* support numactl on Linux in multi-threading 2.0

* update cache file reader

* fix warning

* keep change for numactl support only

* keep change for numactl support only

* keep change for numactl support only

* keep change for numactl support only

* keep change for numactl support only

* fix typo

* update for comments

* fix code style issue

* update is_cpu_map_available()

* update for comments

* update for comments

* update for comments
2023-05-31 09:44:19 +08:00
Fang Xu
25865201ef enable cpu map for mac (#17499)
* enable cpu map for mac

enable nstreams and nthreads setting for mac

* keep streams=1 for M1

* add explicit type conversion

* remove definition of static cpu

* Update with master

* separate branches for __APPLE__ and __EMSCRIPTEN__

* modify the implementation of is_cpu_map_available function

---------

Co-authored-by: Wanglei Shen <wanglei.shen@intel.com>
2023-05-30 15:53:23 +08:00
Ilya Lavrenov
bd0117d648 Vcpkg conan fixes (#17765)
* Small fixes for openvino::pugixml creation for Dev packages

* Flexiable components installation

* Fixed compilation for x86

* Added extra checks for ENABLE_NCC_STYLE

* Fixed typo in RPM
2023-05-29 15:40:51 +04:00
Pawel Raasz
57e23ffc0a Calculate TensorView strides on demand not in ctor (#17729)
* Optimize strides calculation using one loop

* Calculate strides on get_strides or set_shape
instead in ctor in TensorView

* Call once update strides on get
2023-05-29 08:20:27 +04:00
Evgenya Stepyreva
b0b540aeaf Auto-Batch: fix data race (#17752)
* Auto-Batch clone model which is being changed

* Comments adressed

* Style

* The fix

* Final change
2023-05-26 18:09:35 +00:00
Ilya Churaev
dd0060a582 Deprecate legacy Core and Allocator (#17646)
* Deprecate legacy Core and Allocator

* Suppress blob warnings

* Suppress some warnings

* Suppress more warnings

* Suppress blob allocator

* Suppress more warnings

* Suppress more warnings

* Fixed compilation issues for Template plugin

* Fixed some warnings

* Fixed tests

* Add WA for benchmark_app

* Suppress #warning for developer package

* Rename define

* Disable warnings for compile_tool and benchmark_app

* Suppress Windows warnings

* Suppress more warnings for Windows

* Fixed compile_tool install

* Added message for VS

* Fixed snippets and throw only first error
2023-05-26 07:06:03 +04:00
Ilya Lavrenov
b69e94c297 Fixed macOS compilation (#17656) 2023-05-22 14:49:33 +04:00
Wanglei Shen
2302e10d3e enable proc_type_table on MacOS for both ARM and x86 (#17427)
* enable proc_type_table on MacOS for both ARM and x86

* fix code style issue

* update for comments
2023-05-22 16:29:05 +08:00
Ilya Lavrenov
84db7d0ee6 Build using conanfile.txt (#17580)
* Build using conanfile.txt

* Update .ci/azure/linux_arm64.yml

* Several improvements

* Removed conanfile.py

* Try to use activate / deactivate

* Fixed clang-format code style

* Supported TBB version from Conan

* Added more NOMINMAX

* Fixed static build

* More improvements for static build

* Add usage of static snappy in case of static build

* More fixes

* Small fixes

* Final fixes
2023-05-19 14:01:39 +04:00
Ilya Churaev
4eebd3a976 Register new plugin extensions (#17614)
* Register new plugin extensions

* Fixed build
2023-05-19 09:44:11 +00:00
Nadezhda Ageeva
fba272a298 Api2.0 fixes (#17475)
* Fix exception for BLOCKED layout

* Add set_task_executor/set_callback_executor methods for compiled model

* Fix inccorrect version

* Add SCALAR

* Clear extension in FrontEnd destructor
2023-05-18 18:20:35 +02:00
Sun Xiaoxia
ae1beb296e remove definition of static CPU (#17393)
* remove definition of static CPU

* revert old format

* definition of cpu_info covers macOS

* add lock in is_cpu_map_available
2023-05-17 12:08:38 +04:00
Ilya Churaev
3cbc5581ab Mark some legacy API as deprecated (#17469)
* Mark some legacy API as deprecated

* Try to fix some issues

* Fixed some warnings

* Disable deprecation warnings for GNA

* Fixed some warnings

* Disable deprecation errors for all plugins

* Suppress some warnings

* Suppress some warnings

* Suppress deprecated for tests

* Mark all contend as suppressed

* Try to fix extensions

* Suppress more warnings

* Suppress warnings for transformations

* Global suppress of deprecation warnings

* FIxed some warnings

* Fixed comments

* Create macro for deprecation API

* Fixed data tests
2023-05-17 11:31:01 +04:00
Ilya Churaev
92a0108f0d Fixed mock_engine for proxy tests (#17431)
* Fixed mock_engine for proxy tests

* Fixed some caching tests

* FIxed build

* Fixed CoreThreading tests

* Try to fix crash in functional tests

* Fixed typo

* Fixed typo

* Small change

* Remove shared pointer from MockPluginWrapper

* Small fixes

* Do not throw an exception from device_supports_cache_dir
2023-05-17 11:15:28 +04:00
Ilya Lavrenov
04171416f4 Put mingw on gcc code path (#16101)
* Supported mingw-w64

* Supported mingw-w64

* Supported mingw-w64
2023-05-17 00:47:55 +04:00
Wanglei Shen
a4314faf29 disable set_cpu_used in master branch (#17459) 2023-05-12 14:16:52 +08:00
Sun Xiaoxia
8e675c71c8 fix binding wrong core with latency mode on i9-13900 (#17362) 2023-05-06 17:17:18 +08:00
Evgenya Stepyreva
9291e5ecd2 NMS-5 calculate upper-bound (#17313)
* NMS-5 calculate upper-bound

* Test
2023-05-03 11:42:20 +00:00
Ilya Lavrenov
4d7947efc8 Increment minor OV version (#17299) 2023-05-02 22:32:18 +02:00
Ilya Lavrenov
7743e175b7 Warn if OpenVINO symbols require new CXX ABI (#16080)
* Warn if OpenVINO symbols require new CXX ABI

* Fixed warnings / errors on Windows
2023-04-29 01:17:52 +01:00
Sun Xiaoxia
893b29eab4 HOT FIX: Xiaoxia/fix read wrong data in muti threading (#17240)
* fix threading test sporadic failure

* fix read wrong data in muti threading

* fix read and write sync

* add lock before cpu._cpu_mapping_table[i][CPU_MAP_USED_FLAG],because CPU_MAP_USED_FLAG may be modified by set_cpu_used
2023-04-27 22:44:44 +08:00
Sun Xiaoxia
7fc65ae3c5 fix threading test sporadic failure (#17230)
Co-authored-by: Wanglei Shen <wanglei.shen@intel.com>
2023-04-26 20:27:49 +04:00
Vitaliy Urusovskij
11a2b75161 Fix TSAN issue No2 in GNA plugin (#17185)
* Fix TSAN issue No2 in GNA plugin

* Misprint
2023-04-25 16:32:06 +04:00
Ilya Lavrenov
22aee08958 Revert "[CPU] Fix data race in concurrent compile_model calls (#17164)" (#17184)
This reverts commit 8879ef53a7.
2023-04-25 12:01:02 +04:00
Sun Xiaoxia
6663367183 Xiaoxia/fix performance regression (#17036)
* add _streams_info_table in Executor config

* change useHyperThreading init value

* restore cmake

* fix comments

* add calling enableCpuPinning property

* fix judgment about number of sockets in init_stream

* fix test case compile issue

* fix ci test case fail issue

* modify GetPerformanceStreams calling position

* add affinity in get_cpu_pinning

* modify ecore judgement

* add no binding core on ADL

* fix ci issue, add get_num_numa_nodes()

* fix code style

* fix StreamsHasHigherPriority issue

* fix according to comments

* fix performance degression

* fix code style

* code style

* fix warning

* fix ci test failed

* fix ImportNetwork issue

* fix ci test case issue

* fix smoke_CachingSupportCase_CPU issue

* add ExportOptimalNumStreamsTest test

* modify test name

* modify ExportOptimalNumStreams test

---------

Co-authored-by: Chen Peter <peter.chen@intel.com>
2023-04-25 04:35:47 +00:00
Egor Duplenskii
8879ef53a7 [CPU] Fix data race in concurrent compile_model calls (#17164) 2023-04-25 00:01:03 +00:00
Ilya Lavrenov
a34ef680f2 Made plugins.hpp generation to be CONFIG dependent (#17139) 2023-04-24 14:48:45 +04:00
Sun Xiaoxia
c186ffdf0d Xiaoxia/stream process refactor (#16692)
* add _streams_info_table in Executor config

* change useHyperThreading init value

* restore cmake

* fix comments

* add calling enableCpuPinning property

* fix judgment about number of sockets in init_stream

* fix test case compile issue

* fix ci test case fail issue

* modify GetPerformanceStreams calling position

* add affinity in get_cpu_pinning

* modify ecore judgement

* add no binding core on ADL

* fix ci issue, add get_num_numa_nodes()

* fix code style

* fix StreamsHasHigherPriority issue

* fix according to comments

* merge master

* fix build issue

* fix template plugin test case failed issue

* fix build issue

* fix cpu test failed

* Update plugin.cpp

---------

Co-authored-by: Wanglei Shen <wanglei.shen@intel.com>
2023-04-21 01:38:32 +00:00
Mikhail Ryzhov
0f7e6de346 [GNA] WA to fix config parsing of scale factor map (#17060)
* WA to fix config parsing

* clang fix

* excluded json
2023-04-20 10:51:23 +01:00
Ilya Churaev
71880aadd3 Deprecate set batch method (#17057)
* Deprecate set batch method

* Fixed some errors

* Suppress warning in tests

* Fixed warning in GPU

* Deprecate python
2023-04-19 20:21:18 +00:00
Shen, Wanglei
626caf7f2a update file location for 2023.0 release (#17034) 2023-04-19 10:38:23 +04:00
Ilya Churaev
566ef01a3f Remove constructors for ov Exceptions (#16938)
* Remove constructors for ov Exceptions

* Fixed linux build

* Fixed ONNX Frontend

* Fixed paddle

* Fixed exceptions in tests

* Deprecate constructors for ov::Exception

* Suppress some warnings

* Merge several exceptions

* Some small changes

* Suppress more warnings

* More warnings

* mode warnings

* Suppress more warnings

* More warnings
2023-04-18 21:02:26 +04:00
Shen, Wanglei
3f9cc0112a Hot Fix: using all small core as Ecore (#16978)
* using all small core as Ecore

* add test case
2023-04-18 00:06:36 +04:00