* set core_type = MAIN_CORE_PROC with latency mode and enable hyper threading in pecore machine
* add test case
* change pcore_only to ecore_used
---------
Co-authored-by: Wanglei Shen <wanglei.shen@intel.com>
* only use current thread when -nstreams=0 with TBB
* add comments
* fix building issue
* fix comments
* only use current thread when -nstreams=0 with TBB
* add comments
* fix building issue
* fix comments
* migrate threading related interface from API 1.0 to 2.0
* fix code style
* fix @ref issue in doc
* change <> to quotation marks
* restore threading related interface API 1.0
* restore the changes of legacy code
* add cpu pinning on windows
* remove pinning limitation on windows
* only support the machine with one numa node
* fix code style
* fix build error on macos
* set mask initial value
* fix test failure on window
* fix build failure on macos, add limitation on windows machine with two sockets
* fix test failure on windows
* fix test failure
* fix comments
* add streams_info_table init in the constructor of config
* add refresh _proc_type_table
* add get_org_proc_type_table
* add numa_node per stream in reserve_available_cpus()
* fix warning
* remove log
* fix code style
* fix gpu test build failed issue, modify debug info
* fix code style
* fix build failed on macos
* fix code style
* select socket in reserve cpu on 2 sockets platform
* fix build failed on macos
* modify numa node selecting in reserve_cpu_by_streams_info
* add test case
* fix code style
* modify test case
* fix core dump
* fix core dumped on pin=NUMA
* fix test failed on macos
* fix reserve cpu is wrong when streams_info_table=[1 1 36] proc_type_table=[36 18 0 18]
* add test case in LinuxCpuReserve
* modify test case
* add test case in cpu_reserve_test
* add cpu_stream_info_test
* modify enum
* fix test failed
* change int to size_t
* remove invalid code, fix running failed on macos
* modify LinuxCpuStreamType test case, move ie_cpu_streams_info.hpp to openvino/runtime/threading/
* fix code sytle
* modify enum name
* add comments in test case
* fix build issue
* change IE_ASSERT to OPENVINO_ASSERT
* fix test failed on macos and windows
* updated test cases due to the cpu mapping is changed
* enable numa_node_id and socket_id in streams_info_table
* fix code style issue
* fix document issue
* add get socket id interface
* fix segment fault on machine enabled socket_id=1 with numactl command
* fix numactl failed on four numa nodes machine
* remove compile warning
* fix numa_node_id=-1
* fix test case failed on macos
* fix test failed on macos
* fix numa_node_id=0 on macos
* Solve conflicts with master branch
* separate test cases for Linux and Mac/Windows
* update code style for windows compiler
* fix comments
* fix code style
* fix code style
* remove _plugin_mutex, fix comments
* fix code style
* fix code style
* add get_num_sockets
* fix cpu reserve issue in latency mode,ANY core on RPL machine
* add cpu reserve test case
---------
Co-authored-by: Wanglei Shen <wanglei.shen@intel.com>
* generate cpu mapping table pre tbb
* change function name
* fix proc_type_table is wrong in RPL
* add getCpuMapFromCores test, fix comments
* modify test case
* fix comments
* fix code style
* add throw an exception
* fix numa_nodes=0 on ARM
* modify numa_nodes
* fix ExportOptimalNumStreams failed on ARM
* fix comments
* add discription of get_cpu_mapping_from_cores
* update for numactl support
* fix cores is wrong
---------
Co-authored-by: Wanglei Shen <wanglei.shen@intel.com>
* fix threading test sporadic failure
* fix read wrong data in muti threading
* fix read and write sync
* add lock before cpu._cpu_mapping_table[i][CPU_MAP_USED_FLAG],because CPU_MAP_USED_FLAG may be modified by set_cpu_used
* add _streams_info_table in Executor config
* change useHyperThreading init value
* restore cmake
* fix comments
* add calling enableCpuPinning property
* fix judgment about number of sockets in init_stream
* fix test case compile issue
* fix ci test case fail issue
* modify GetPerformanceStreams calling position
* add affinity in get_cpu_pinning
* modify ecore judgement
* add no binding core on ADL
* fix ci issue, add get_num_numa_nodes()
* fix code style
* fix StreamsHasHigherPriority issue
* fix according to comments
* fix performance degression
* fix code style
* code style
* fix warning
* fix ci test failed
* fix ImportNetwork issue
* fix ci test case issue
* fix smoke_CachingSupportCase_CPU issue
* add ExportOptimalNumStreamsTest test
* modify test name
* modify ExportOptimalNumStreams test
---------
Co-authored-by: Chen Peter <peter.chen@intel.com>
* fix custom setting nstreams doesn't work due to the logic changed in ApplyPerformanceHints
* add same limitation for latency mode
* change bind core method to binding full physical core first, then logical core
* update custom setting streams and threads
* fix corner case when threads_per_stream is 1
* fix with comments
* add condition of big core stream is zero when binding core
Co-authored-by: Shen, Wanglei <wanglei.shen@intel.com>
Co-authored-by: Chen Peter <peter.chen@intel.com>
* add HybridAware stream setting and core binding
* fix clang format issue
* unified code style, add parameter check
* correct input affinity skip NUMA, modify function name
* remove unnecessary floor
* fix ci compile issue on Mac/windows platform
* modify smoke_SetConfigAffinity test
* modify ov_core_set_and_get_property_enum test, affinity HYBRID_AWARE is changed to NUMA
* remove affinity correcting on this pr
* revert ov_core_test.cpp
* merge function by comments
* fix code style issue
* add custom nstreams setting, remove mutable qualifier
* fix code style issue
* fix some issues according to comments
* modify UpdateHybridCustomThreads
* fix code style issue
* modify comments
* use logic core in phase 2
* modify steams threads setting method
* add custom setting nstreams nthreads
* modify comments
* fix code style issue
* fix threads_per_stream_big is wrong in the some ADL machine which has 6 pcore
* add one condition that custom set nthreads but not set nstreams
* remove the limit to nstreams
* remove the feature in branch p_e_core_phase2_logic
* add comments
* rename num_small_cores to num_small_cores_phys
* fix code style issue
* fix thread number is wrong in corner case on 6Pcore and 10Pcore condition
* fix some condition which nstreams<2
* add check for config._threads_per_stream_big
Co-authored-by: Shen, Wanglei <wanglei.shen@intel.com>
* fix unicode issue that ie.ReadNetwork fails if the exe's folder contains Chinese characters
* fix clang format issue
* fix clang format issue
* modify '/' to file_separator in get_directory
* fix ci issue
* fix test failure on windows
* fix test issue
Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>
Sun XiaoxiaandWanglei Shen
