Commit Graph

396 Commits

Author SHA1 Message Date
Wanglei Shen
a4314faf29 disable set_cpu_used in master branch (#17459) 2023-05-12 14:16:52 +08:00
Sun Xiaoxia
8e675c71c8 fix binding wrong core with latency mode on i9-13900 (#17362) 2023-05-06 17:17:18 +08:00
Evgenya Stepyreva
9291e5ecd2 NMS-5 calculate upper-bound (#17313)
* NMS-5 calculate upper-bound

* Test
2023-05-03 11:42:20 +00:00
Ilya Lavrenov
4d7947efc8 Increment minor OV version (#17299) 2023-05-02 22:32:18 +02:00
Ilya Lavrenov
7743e175b7 Warn if OpenVINO symbols require new CXX ABI (#16080)
* Warn if OpenVINO symbols require new CXX ABI

* Fixed warnings / errors on Windows
2023-04-29 01:17:52 +01:00
Sun Xiaoxia
893b29eab4 HOT FIX: Xiaoxia/fix read wrong data in muti threading (#17240)
* fix threading test sporadic failure

* fix read wrong data in muti threading

* fix read and write sync

* add lock before cpu._cpu_mapping_table[i][CPU_MAP_USED_FLAG],because CPU_MAP_USED_FLAG may be modified by set_cpu_used
2023-04-27 22:44:44 +08:00
Sun Xiaoxia
7fc65ae3c5 fix threading test sporadic failure (#17230)
Co-authored-by: Wanglei Shen <wanglei.shen@intel.com>
2023-04-26 20:27:49 +04:00
Vitaliy Urusovskij
11a2b75161 Fix TSAN issue No2 in GNA plugin (#17185)
* Fix TSAN issue No2 in GNA plugin

* Misprint
2023-04-25 16:32:06 +04:00
Ilya Lavrenov
22aee08958 Revert "[CPU] Fix data race in concurrent compile_model calls (#17164)" (#17184)
This reverts commit 8879ef53a7.
2023-04-25 12:01:02 +04:00
Sun Xiaoxia
6663367183 Xiaoxia/fix performance regression (#17036)
* add _streams_info_table in Executor config

* change useHyperThreading init value

* restore cmake

* fix comments

* add calling enableCpuPinning property

* fix judgment about number of sockets in init_stream

* fix test case compile issue

* fix ci test case fail issue

* modify GetPerformanceStreams calling position

* add affinity in get_cpu_pinning

* modify ecore judgement

* add no binding core on ADL

* fix ci issue, add get_num_numa_nodes()

* fix code style

* fix StreamsHasHigherPriority issue

* fix according to comments

* fix performance degression

* fix code style

* code style

* fix warning

* fix ci test failed

* fix ImportNetwork issue

* fix ci test case issue

* fix smoke_CachingSupportCase_CPU issue

* add ExportOptimalNumStreamsTest test

* modify test name

* modify ExportOptimalNumStreams test

---------

Co-authored-by: Chen Peter <peter.chen@intel.com>
2023-04-25 04:35:47 +00:00
Egor Duplenskii
8879ef53a7 [CPU] Fix data race in concurrent compile_model calls (#17164) 2023-04-25 00:01:03 +00:00
Ilya Lavrenov
a34ef680f2 Made plugins.hpp generation to be CONFIG dependent (#17139) 2023-04-24 14:48:45 +04:00
Sun Xiaoxia
c186ffdf0d Xiaoxia/stream process refactor (#16692)
* add _streams_info_table in Executor config

* change useHyperThreading init value

* restore cmake

* fix comments

* add calling enableCpuPinning property

* fix judgment about number of sockets in init_stream

* fix test case compile issue

* fix ci test case fail issue

* modify GetPerformanceStreams calling position

* add affinity in get_cpu_pinning

* modify ecore judgement

* add no binding core on ADL

* fix ci issue, add get_num_numa_nodes()

* fix code style

* fix StreamsHasHigherPriority issue

* fix according to comments

* merge master

* fix build issue

* fix template plugin test case failed issue

* fix build issue

* fix cpu test failed

* Update plugin.cpp

---------

Co-authored-by: Wanglei Shen <wanglei.shen@intel.com>
2023-04-21 01:38:32 +00:00
Mikhail Ryzhov
0f7e6de346 [GNA] WA to fix config parsing of scale factor map (#17060)
* WA to fix config parsing

* clang fix

* excluded json
2023-04-20 10:51:23 +01:00
Ilya Churaev
71880aadd3 Deprecate set batch method (#17057)
* Deprecate set batch method

* Fixed some errors

* Suppress warning in tests

* Fixed warning in GPU

* Deprecate python
2023-04-19 20:21:18 +00:00
Shen, Wanglei
626caf7f2a update file location for 2023.0 release (#17034) 2023-04-19 10:38:23 +04:00
Ilya Churaev
566ef01a3f Remove constructors for ov Exceptions (#16938)
* Remove constructors for ov Exceptions

* Fixed linux build

* Fixed ONNX Frontend

* Fixed paddle

* Fixed exceptions in tests

* Deprecate constructors for ov::Exception

* Suppress some warnings

* Merge several exceptions

* Some small changes

* Suppress more warnings

* More warnings

* mode warnings

* Suppress more warnings

* More warnings
2023-04-18 21:02:26 +04:00
Shen, Wanglei
3f9cc0112a Hot Fix: using all small core as Ecore (#16978)
* using all small core as Ecore

* add test case
2023-04-18 00:06:36 +04:00
Ilya Lavrenov
adc733f1e9 Enabled several ARM CPU tests (#16995)
* Enabled several ARM CPU tests

* Removed not-valid tests

* Fixed several template plugin tests

* Removed non-working suppressions

* Disabled 2 tests on ARM CPU
2023-04-17 22:44:43 +04:00
Ilya Churaev
25826bfe7d Added deprecation of nv12 legacy API (#16982)
* Added deprecation of nv12 legacy API

* Added new files

* Change macros

* Suppress warnings for preprocessing

* Suppress warnings in tests

* Suppress warnings for Windows
2023-04-17 14:13:43 +00:00
Ilya Churaev
aa1f26a2b7 Enable more tests for Template plugin (#16874)
* Enable more tests for Template plugin

* Removed deprecated API

* Fixed typo

* Added internal properties

* Removed incorrect tests

* Fixed code style

* Enabled some tests
2023-04-17 07:07:09 +00:00
Ilya Lavrenov
31398bb3eb Fixed deprecated API warnings (#16949) 2023-04-17 07:19:53 +04:00
Oleg Pipikin
7ce40996e5 Fix copy constructor and assignment for ov::Any (#16757)
* Fix copy constructor and assignment for ov::Any

* Fix1

* Apply comments

* Add test

* Fix code style

* Fix2

* Fix3
2023-04-14 22:12:18 +04:00
Shen, Wanglei
3461064507 update benchmark_app to remove setting UNDEFINED with -hint none (#16695)
* Remove setting ov::hint::PerformanceMode::UNDEFINED from benchmark_app

* update benchmark_app

* update python code and description

* update python code

* fix code style issue

* update python code

* update c++ app
2023-04-13 14:29:13 +00:00
Wang Wangwang
c2c2143f45 clean AB property from virtual plugin and core global config (#16877)
* Benchmark_app set ov::hint::allow_auto_batching through compile_model

* Remove the process about allow_auto_batching in set_property of core

* Remove allow_auto_batching and auto_batch_timeout property from AUTO plugin

* Reserve the info logs and add API to check auto_batching

* Update test case, rm AB property test from core config tests

* Update some API in AUTO plugin config
2023-04-12 17:37:57 +04:00
Ian Hunter
209db8a29b Update ie_common.h (#16860) 2023-04-12 00:52:02 +04:00
yanlan song
527c2dad2a query capacity before popping (#16828)
* query capacity before popping

Signed-off-by: fishbell <bell.song@intel.com>

* refine

Signed-off-by: fishbell <bell.song@intel.com>

---------

Signed-off-by: fishbell <bell.song@intel.com>
2023-04-11 11:25:29 +04:00
Ilya Lavrenov
f1d6725477 Removed legacy src files from inference library (#16839) 2023-04-10 19:26:09 +04:00
Evgenya Stepyreva
bc7a121a20 Removes legacy transformations from CNNNetworkNGraphImpl::reshape (#15853)
* Removes legacy transformations from CNNNetworkNGraphImpl::reshape

* Removes legacy transformations from CNNNetworkNGraphImpl::reshape

* 6 more models propagate shape more precise

* Removes legacy includes

* Fix invalidation

* Test change

* win fix

* Ilyas suggestion

* Unary ops -- removed shape relying on the output of the op, used shapes from the input tensor instead

* Code clean up

* Equal: bounds evaluation

* Equal: bounds evaluation

* Restrict TypeRelaxed from partial_value propagation

* TypeRelaxed: propagate lower/upper bounds

* Remove debug prints

* fix build

* GPU shape inference problem fixed

* Generate Proposals: better dynamic shape propagation

* Style
2023-04-10 12:36:56 +02:00
Wang Wangwang
57684e28ff [AUTO] Remove cache_dir property from AUTO plugin (#16775)
* Remove cache_dir property from AUTO plugin

* Pass the secondary property to hardware plugin

* Update test case

* Update test case, meta plugin will pass the properties to device without checking
2023-04-10 11:42:24 +04:00
Daria Mityagina
8c40bfd9c7 detected vulnerability with shared_ptr (#16791) 2023-04-07 16:25:05 +04:00
Maxim Vafin
8b7e6878e8 [TF FE] Better support for named ports in tensorflow frontend (#16697)
* Fix in create_same_type_const_scalar; accurate updating type for parameter when inlining function call body

* Added Unique to the list of operations with named output ports (another MUSE fix)

* Draft: working version of extension with named ports in TF

* Merge fixes

* Refactor and productize POC

* Clean up

* Fix build

* Fix code style

* Fix lib so extension test

* Fix namespaces

* Remove usage of Any from CreatorFunction

* Fix build

* Fix arm build

* Apply review feedback

* Fix build after merge

* Apply suggestions from code review

---------

Co-authored-by: Sergey Lyalin <sergey.lyalin@intel.com>
2023-04-07 14:16:23 +04:00
Ilya Churaev
cafc7359c5 Set test case name for ReshapeMatMul tests (#16705)
Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>
2023-04-06 15:40:20 +04:00
Shen, Wanglei
9f0e557744 HOT FIX: update cpu map calculation for Windows to avoid incorrect total number of processors (#16763)
* update cpu map calculation for Windows

* update typo

* update typo

* update for hybrid CPU

* update for hybrid CPU

* update for typo
2023-04-06 15:08:42 +08:00
Ilya Churaev
70ef0b5316 Minimize rebuild for Makefiles generator (#16729)
* Add dependency from ov_plugins.hpp only for files which use it

* Remove rebuild files depends on CI_BUILD_NUMBER changes

* Try to fix static build

* Fixed comments

* Fixed build

* Merged some change

* Try to fix build

* Try to fix nvidia build

* Take LTO value from target property
2023-04-06 11:02:28 +04:00
Sun Xiaoxia
f95fd27c16 HOT FIX: CPU binding cannot follow numactl's control (#16736)
* fix numactl command issue

* fix comments
2023-04-06 13:47:34 +08:00
Oleg Pipikin
1c564226f3 Deprecate util functions in public api (#16716)
* Deprecate util functions in public api

* Add deprecation suppression for usage inside openvino

* Fix clang-format

* Fix1
2023-04-06 06:32:04 +04:00
Vitaliy Urusovskij
7442a17240 Add Core property to switch from mmap to read in IR Frontend (#16600)
* Add Core property to switch from `mmap` to `read`
in IR FrontEnd

* Add tests on `ov::enable_mmap` property

* Add `enable_mmap` in C & Py APIs

* ClangFormat
2023-04-05 18:22:11 +04:00
Shen, Wanglei
9f54504232 update cpu properties name to enable_hyper_threading and enable_hyper_threading (#16723) 2023-04-04 15:25:11 +04:00
Shen, Wanglei
86da15e621 enable new property ov::hint::use_cpu_pinning (#16383)
* enable ov::hint::use_cpu_pinning

* update test case for comments

* update header file

* update header file

* Delete cpu_streams_calculation.hpp

* Revert "Delete cpu_streams_calculation.hpp"

This reverts commit a1074ca843.

* update config name

* fix code styple issue

* update for merge conflict
2023-04-03 18:14:33 +08:00
Ilya Churaev
1b9bd61767 Added constructor from string for element Type (#16643)
* Added constructor from string for element Type

* Fixed code style

* Removed WA for tests
2023-03-31 07:24:32 +00:00
Ilya Lavrenov
ccf9c19f61 Deprecated UNDEFINED values for execution / performance hints (#16563)
* Deprecated UNDEFINED values for execution / performance hints

* Update src/tests/functional/plugin/gpu/shared_tests_instances/behavior/ov_plugin/properties_tests.cpp

* Fixes

* Fixes
2023-03-30 13:48:19 +04:00
Ilya Lavrenov
0250f62d11 Revert inference precision to be a hint (#16634) 2023-03-29 18:59:33 +04:00
Sun Xiaoxia
988a8dd6a9 Xiaoxia/Optimize the streams calculation process (#15777)
* add _big_core_logic_streams

* modify core binding with cpu mapping table

* get _cpu_ids with querying cpu_mapping_table

* fix mac build issue

* fix cpu func test issue

* fix clang-format issue

* remove getCoreOffset and getThreadStep

* motify return false from cpuMapAvailable on windows

* remove core binding in latency mode

* add bind core on windows

* add model prefer threads

* modify streams calculating schedule in ApplyPerformanceHints

* modify MakeDefaultMultiThreaded and Stream

* add unified cpu binding with cpu_mapping on linux and windows. add GPU core binding interface. modify streams calculation scheduling

* fix code style issue

* modify default streams to 1 to fix ci test issue

* add SetStreamtoConfig, modify getNumOfAvailableCPUCores to fix continuous call loadnetwork issue

* modify code according to comments

* fix build issue on macos

* fix macos error

* fix cputest issue

* fix build issue on macos

* move features about CPU to lin_system_config.cpp

* fix code style

* fix bebian_arm build failed issue

* fix macos build issue

* fix code style

* fix test issue on windows

* fix code style

* add latency in hybrid_aware condition

* add the condition used all cores in latency mode

* fix code style

* fix code style

* add init_cpu

* fix code style

* fix streams=2 issue

* fix multi gpu core bind issue

* modify interface

* fix debian arm build issue

* add bind core in different socket

* fix code style

* fix build issue on windows

* fix GPU set_executor_config sync issue

* fix latency issue

* fix bind_cores issue

* modify model prefer on tigerlake machine

* modify according to comments

* fix code style

* modify GPU reserve CPU interface, remove bind core on windows feater

* fix code style

* add 3rd type core in cpu_mapping_table

* fix build issue

* update test case

* modify core bind behavior in latency mode

* remove 3rd core type function

* update format

* add lock in get_task_flag

* not bind core in latency mode

* change model_prefer to 0 with latency mode on core machine. bind core with latency mode on core machine

* remove a void thread

* modify condition of create task_area

* modify comments

* fix according to comments

* fix spelling mistake

* fix according to comments

* fix code style

---------

Co-authored-by: Shen, Wanglei <wanglei.shen@intel.com>
2023-03-29 18:26:27 +08:00
Ilya Churaev
f3dcf93f96 Remove suppression Wno-delete-non-abstract-non-virtual-dtor (#16560)
* Remove suppression Wno-delete-non-abstract-non-virtual-dtor

* Fixed Allocator warning

* Suppress warning for GPU plugin

* Skip warning for GNA

* Fixed preprocessing

* Added virtual constructor for base plugin class

* Some fix for CPU

* Suppress for CPU

* Fixed any

* Fixed meta

* Disable warning for paddle

* Fixed Allocator tests

* Move suppress to paddle

* Fixed benchmark_app
2023-03-29 14:19:30 +04:00
Vitaliy Urusovskij
40cc006bae Enable MapAllocator in IR Frontend (#12673)
* Enable MapAllocator in IR Frontend

* Fix `ov_infer_request_ppp` test

With `mmap()`ing of IR, .bin can't be deleted until unmapping.
And it shows that there was a leak in test

* Add comment to Win `CreateFile()` regarding
FILE_SHARE_DELETE

* Unmap .bin file before IR files deletion

Wait ov::Model deletion to trigger .bin file unmapping
before IR files deletion

* ClangFormat

* Add `use_map_allocator` switch in FE

In case of direct use of FE (e.g. via MO), `mmap()` is OFF.
But in case of use FE via Core, `mmap()` is ON.
2023-03-28 23:24:13 +04:00
Shen, Wanglei
a726f0ae38 Enable new property ov::hint::scheduling_core_type (#16106)
* enable apply_processor_type()

* declare PROCESSOR_TYPE

* enable readProperties

* test case for get_property()

* enable set_property() and test cases

* reduce changes

* fix code style issue

* fix python test case issue

* remove python interface

* move processor type definition out of dev_api

* refine coding

* add dependency

* update header file

* update description

* merge intel_cpu header file

* add inline in-code documentation

* change 'UNDEFINED' to 'DEFAULT'

* remove ProcTypeConfig

* refine change

* refine change

* refine process_type to scheduling_core_type

* refine description

* fix code style issue

* change to ov::hint::scheduling_core_type

* fix code style issue

* fix code style issue

* fix python issue

* fix python issue

* fix python issue

* fix python issue

* change core_type_cfg to ov::hint::SchedulingCoreType

* update test case for comments

* update test case for comments

* add default for comments

* update code style

* update for comments

* update for comments

* fix typo

* move cpu_map_scheduling into threading folder

* update for merge conflict

* update for code style
2023-03-28 10:04:30 +04:00
Shen, Wanglei
815d4abc03 enable new property ov::hint::use_hyper_threading (#16176)
* enable apply_processor_type()

* declare PROCESSOR_TYPE

* enable readProperties

* test case for get_property()

* enable set_property() and test cases

* reduce changes

* fix code style issue

* fix python test case issue

* remove python interface

* move processor type definition out of dev_api

* refine coding

* add dependency

* update header file

* update description

* merge intel_cpu header file

* add inline in-code documentation

* change 'UNDEFINED' to 'DEFAULT'

* remove ProcTypeConfig

* refine change

* refine change

* enable new property use hyper threading

* update description

* resume legacy code

* change to ov::hint namespace

* update including header file

* update C API and Python API

* update description for comments

* update test case for comments

* update function location for comments

* fix typo

* fix typo

* fix code style issue and update test case

* move cpu_map_scheduling into threading folder
2023-03-28 00:39:26 +04:00
Ilya Lavrenov
e66b837104 Properties improvements: part 2 (#16489)
* Properties improvements: part 2

* Accurate configs handling in HETERO / BATCH

* Align plugins in caching properties

* Fixed caching mock tests

* Added new TestNoCachingProperties test

* Fixed test

* Added ov::caching_properties to API 1.0 metrics as well

* Fixes for HETERO plugin

* Fixed tests

* Even more refactoring in HETERO plugin config management
2023-03-25 19:28:05 +04:00
Ilya Lavrenov
580b99c99b Align plugins in caching properties (#16528)
* Align plugins in caching properties

* Fixed caching mock tests

* Added new TestNoCachingProperties test

* Fixed test

* Added ov::caching_properties to API 1.0 metrics as well
2023-03-25 00:26:18 +04:00