Commit Graph
55 Commits
Author SHA1 Message Date
Wanglei Shen 5f2045909e [CPU] Change default latency mode of MTL to Pcore + Ecore (#20659) 2023-12-14 10:19:56 +04:00
Wanglei Shen 9e2bd77abb fix parse_freq_info_linux for wrong cpu frequency information (#21387) 2023-12-11 19:54:29 +08:00
Wanglei Shen 04c9a52b7f update parse_processor_info_macos for macOS ver 11 (#21517)
* update parse_processor_info_macos for wrong macos info

* update default setting

* update default setting

* update for comment

* fix typo

* update test data

* update init order
2023-12-09 14:10:28 +08:00
Wanglei Shen 0520216481 fix streams calculation issue for latency mode with big threads input (#21437)
* fix streams calculation issue for latency mode with big threads input

* update for typo

* update for typo

* add test cases

* update for comments
2023-12-06 11:53:58 +08:00
Wanglei Shen acecf31642 [CPU][ARM] Enable multi-stream execution (#21009) 2023-11-28 10:41:56 +04:00
Wanglei Shen 72cb4e4820 add additional checks for bad cache information in VM (#21059)
* add additional checks for bad cache information in VM

* update implementation
2023-11-27 07:51:44 +08:00
Wanglei Shen 78f11965d8 [CPU] Fix user setting num_streams=0 (#20469) 2023-10-31 09:23:58 +04:00
Wanglei Shen 60b82372d1 Support SRF in MT 2.0 on Linux (#20301)
* add test data for SRF on Linux

* update cpu map detection for Ecore only platform

* update test data for smoke test of streams generation

* update test data
2023-10-10 13:59:27 +08:00
Wanglei Shen 1786e366a2 Support new format for CPU information on Win7 (#19759) 2023-09-21 09:17:47 +04:00
Wanglei Shen 0651d57c33 Add smoke test for CPU map on MacOS (#18753) 2023-08-31 19:31:21 +04:00
Wanglei Shen 7c273dc2c5 fix SDL issue (CID 1518459) (#19287) 2023-08-21 20:24:59 +08:00
Wanglei Shen 61fcf3855a fix SDL issue (CID 1518457) (#19289)
* fix SDL issue (CID 1518457)

* update for comments
2023-08-21 17:43:09 +08:00
Wanglei Shen 0368474c8a fix manually setting Pcore+Ecore manually when model prefers Pcore only (#19160) 2023-08-12 18:19:02 +08:00
Wanglei Shen a957764362 block SOC Ecore to be used in multi-threading on Windows (#18910) 2023-08-11 15:23:29 +04:00
Wanglei Shen 2ed5e50bd1 [CPU] Update stream info for mixing MAIN_CORE_PROC and HYPER_THREADING_PROC (#18863) 2023-08-11 10:31:31 +04:00
Wanglei Shen c62ad1add8 Support Win7 in cpu information parser (#19109) 2023-08-11 09:54:13 +04:00
Wanglei Shen 2b1f8939cb [CPU][ARM] Fix unused variable issue for PR 18818 (#19062) 2023-08-08 17:19:23 +00:00
Wanglei Shen e733b0466c [CPU] Update streams calculation for latency mode on MacOS (#18818) 2023-08-08 10:53:48 +04:00
Wanglei Shen 0cad2f1324 [CPU] Move streams calculation before transformation pipeline (#18911) 2023-08-02 11:38:34 +00:00
Wanglei Shen 0974cb10bc add socket id initialization in MacOS (#18717) 2023-07-21 18:49:36 +00:00
Wanglei Shen 98026d420f update proc_type_table for MacOS (#18702) 2023-07-21 21:13:28 +08:00
Wanglei Shen d571ab3a12 enable numa_node_id and socket_id in streams_info_table (#18164)
* enable numa_node_id and socket_id in streams_info_table

* fix code style issue

* fix document issue

* update for comments

* update for comments

* update for comments
2023-07-07 12:33:23 +08:00
Wanglei Shen a9c4e4ab56 enable node support (#17943)
* enable node support on Linux

* fix code style issue

* enable node support on Windows

* fix merge conflict

* update for comments

* update for comments

* enable numa node id and socket id in proc_type_table and udpate inference unit test

* update get_streams_info_table() and smoke test cases in CPU unit test

* fix code style issue

* update numa node id and socket id in proc_type_table on windows

* update for comments

* update for comments

* update for comments
2023-06-20 10:04:42 +08:00
Wanglei Shen 277e759dcd rebase (#17212) 2023-06-14 21:19:39 +08:00
Wanglei Shen 0541a12730 update numactl support and add test cases (#17879)
* update numactl support and add test cases

* fix typo

* remove debug info

* update for comments

* update for comments

* move test case into separated file

* update for comments

* update code style
2023-06-13 23:37:08 +08:00
Wanglei Shen 4ca8d40e43 update scheduling core type value (#17771)
* update scheduling core type value

* update for comments

* update for comments

* fix code style issue
2023-06-06 22:14:40 +08:00
Wanglei Shen a0c8fdbd86 enable CPU map and multiple streams for ARM Linux (#17450)
* enable CPU map for ARM Linux based on freqency information

* fix code style issue

* fix code style issue

* remove 'streams = 1' WA for ARM linux

* update for typo and comments

* update for comments

* keep  WA

* keep WA of streams = 1 for ARM Linux

* update num_streams WA for ARM Linux in test case

* update for comments

* update for comments

* update for comments

* update for comments

* update for merge conflict

* update and add test case for MTL
2023-06-03 17:07:02 +08:00
Wanglei Shen d84face9ee [DOC] Add multi threading for 2023.0 release in CPU plugin document (#17638) 2023-05-31 11:31:56 +04:00
Wanglei Shen 047d2d1d7f support numactl on Linux in multi-threading 2.0 (#17209)
* support numactl on Linux in multi-threading 2.0

* update cache file reader

* fix warning

* keep change for numactl support only

* keep change for numactl support only

* keep change for numactl support only

* keep change for numactl support only

* keep change for numactl support only

* fix typo

* update for comments

* fix code style issue

* update is_cpu_map_available()

* update for comments

* update for comments

* update for comments
2023-05-31 09:44:19 +08:00
Wanglei Shen 29f1ba9f42 [CPU] HOT FIX: allow latency mode (streams = 1) to use hyper threading processors (#17592) 2023-05-25 11:12:56 +04:00
Wanglei Shen 2302e10d3e enable proc_type_table on MacOS for both ARM and x86 (#17427)
* enable proc_type_table on MacOS for both ARM and x86

* fix code style issue

* update for comments
2023-05-22 16:29:05 +08:00
Wanglei Shen a4314faf29 disable set_cpu_used in master branch (#17459) 2023-05-12 14:16:52 +08:00
Wanglei ShenandKarol Blaszczak 10c56708fd update auto architecture document in GitHub for 2023.0 release (#17141)
* update auto architecture doc

* update auto architecture doc

* Apply suggestions from code review

Co-authored-by: Karol Blaszczak <karol.blaszczak@intel.com>

* update for comments

---------

Co-authored-by: Karol Blaszczak <karol.blaszczak@intel.com>
2023-04-24 15:44:34 +00:00
Wanglei Shen 14d4fcf827 enable smoke_SetConfigAffinity for ARM (#17092) 2023-04-20 20:25:35 +01:00
Wanglei Shen 70e0eed075 update default affinity for macOS (#17080) 2023-04-20 11:50:04 +00:00
Shen, Wanglei 626caf7f2a update file location for 2023.0 release (#17034) 2023-04-19 10:38:23 +04:00
Shen, Wanglei 3f9cc0112a Hot Fix: using all small core as Ecore (#16978)
* using all small core as Ecore

* add test case
2023-04-18 00:06:36 +04:00
Shen, Wanglei 98393c0da1 update number of threads per stream on Ecore to 2 for aggressive model on hybrid platform (#16857)
* update number of threads per stream on Ecore to 2 when  aggressive model run on hybrid platform

* update for corner case and add test case
2023-04-17 18:42:55 +08:00
Shen, Wanglei 3461064507 update benchmark_app to remove setting UNDEFINED with -hint none (#16695)
* Remove setting ov::hint::PerformanceMode::UNDEFINED from benchmark_app

* update benchmark_app

* update python code and description

* update python code

* fix code style issue

* update python code

* update c++ app
2023-04-13 14:29:13 +00:00
Shen, Wanglei 9f0e557744 HOT FIX: update cpu map calculation for Windows to avoid incorrect total number of processors (#16763)
* update cpu map calculation for Windows

* update typo

* update typo

* update for hybrid CPU

* update for hybrid CPU

* update for typo
2023-04-06 15:08:42 +08:00
Shen, Wanglei 9f54504232 update cpu properties name to enable_hyper_threading and enable_hyper_threading (#16723) 2023-04-04 15:25:11 +04:00
Shen, Wanglei f6c7213ae4 support Ecore only in streams calculation (#16552)
* support Ecore only in streams calculation

* fix merge conflict
2023-04-03 23:33:18 +08:00
Shen, Wanglei 86da15e621 enable new property ov::hint::use_cpu_pinning (#16383)
* enable ov::hint::use_cpu_pinning

* update test case for comments

* update header file

* update header file

* Delete cpu_streams_calculation.hpp

* Revert "Delete cpu_streams_calculation.hpp"

This reverts commit a1074ca843.

* update config name

* fix code styple issue

* update for merge conflict
2023-04-03 18:14:33 +08:00
Shen, Wanglei a726f0ae38 Enable new property ov::hint::scheduling_core_type (#16106)
* enable apply_processor_type()

* declare PROCESSOR_TYPE

* enable readProperties

* test case for get_property()

* enable set_property() and test cases

* reduce changes

* fix code style issue

* fix python test case issue

* remove python interface

* move processor type definition out of dev_api

* refine coding

* add dependency

* update header file

* update description

* merge intel_cpu header file

* add inline in-code documentation

* change 'UNDEFINED' to 'DEFAULT'

* remove ProcTypeConfig

* refine change

* refine change

* refine process_type to scheduling_core_type

* refine description

* fix code style issue

* change to ov::hint::scheduling_core_type

* fix code style issue

* fix code style issue

* fix python issue

* fix python issue

* fix python issue

* fix python issue

* change core_type_cfg to ov::hint::SchedulingCoreType

* update test case for comments

* update test case for comments

* add default for comments

* update code style

* update for comments

* update for comments

* fix typo

* move cpu_map_scheduling into threading folder

* update for merge conflict

* update for code style
2023-03-28 10:04:30 +04:00
Shen, Wanglei 815d4abc03 enable new property ov::hint::use_hyper_threading (#16176)
* enable apply_processor_type()

* declare PROCESSOR_TYPE

* enable readProperties

* test case for get_property()

* enable set_property() and test cases

* reduce changes

* fix code style issue

* fix python test case issue

* remove python interface

* move processor type definition out of dev_api

* refine coding

* add dependency

* update header file

* update description

* merge intel_cpu header file

* add inline in-code documentation

* change 'UNDEFINED' to 'DEFAULT'

* remove ProcTypeConfig

* refine change

* refine change

* enable new property use hyper threading

* update description

* resume legacy code

* change to ov::hint namespace

* update including header file

* update C API and Python API

* update description for comments

* update test case for comments

* update function location for comments

* fix typo

* fix typo

* fix code style issue and update test case

* move cpu_map_scheduling into threading folder
2023-03-28 00:39:26 +04:00
Shen, Wanglei 613b66ba35 include nireq during streams calculation (#16378)
* include nireq during streams calculation

* update description for comments

* update description
2023-03-24 15:27:13 +08:00
Shen, Wanglei e605a4c344 Create streams info table based on processor type table (#15571)
* enable streams info table based on CPU mapping

* add detail processor info for mix stream

* fix code style issue

* fix typo

* fix code style issue for Android build

* update description of streams info table

* move streams info related function to new file

* remove duplicated definition

* add description for parameters of get_streams_info_table()

* update test case file

* fix windows build issue

* fix windows build issue

* fix windows build issue

* fix typo

* update latency mode for hybrid platform

* update limit threads for latency

* update latency mode for 2 sockets platform
2023-03-06 14:06:41 +08:00
Shen, Wanglei c0fa45a1b9 remove invalid KEY_EXCLUSIVE_ASYNC_REQUESTS (#15776) 2023-02-17 11:02:20 +04:00
Shen, Wanglei 115014d3ad Enable test cases for windows parser for CPU mapping table (#15589)
* update test cases for windows cpu mapping parser

* fix code style issue

* fix code style issue

* fix code style issue

* update test data for Linux parser to align with Windows test case

* ufix code style issue

* update test data for Android build

* update linux CPU map parser fix

* fix code style issue

* fix test data issue

* fix size_t warning

* fix size_t warning
2023-02-13 15:55:39 +08:00
Shen, Wanglei 8b1b4de21d fix clang issue of parser test cases for Android build (#15626)
* fix clang issue for Android build

* update test data for parser

* update Linux CPU map parser
2023-02-10 21:37:17 +08:00
Shen, Wanglei d72deb955d move CPU mapping parser API from dev_api header file to specific header file (#15558)
* move CPU mapping parser API to specific header file

* keep all enum defination in ie_system_conf.h

* move hpp file to inference/src

* fix code style issue
2023-02-08 18:27:14 +04:00
Shen, Wanglei 79cad1032b enable new method to generate CPU information and CPU map on Windows (#14710)
* enable new method to generate CPU information and CPU map

* fix code style issue

* fix initialization issue of variable-sized object

* fix dependency issue

* add sample of CPU map

* add description and sample for CPU map

* fix code style issue

* fix code style issue

* add comments on using second processor as physical core

* enable new method to generate CPU information and CPU map on windows

* remove debug output

* add description for CPU map table

* remove changes for linux

* update description for better understanding

* update CPU mapping table on Windows

* fix precision issue of log2()

* fix memory leak

* use shared_ptr to manage  memory life cycle

* Wrap parser for Windows into a separate function for mock testing later

* Revert "Wrap parser for Windows into a separate function for mock testing later"

This reverts commit 614ad718c2.

* add core type table for each socket on windows

* separate CPU map parser on Windows for validation

* fix core type table definition

* fix DWORD issue in header file

* update parser interface for validation

* fix socket count

* update processor count for XEON

* add discrption and example for processor type table

* remove conflicts

* fix merge conflicts

* fix document issue
2023-02-07 20:28:49 +08:00
Shen, Wanglei 63b2c072c0 update Linux CPU map parser and add unit test (#15113)
* update linux CPU map parser and add unit test

* add one more test data

* fix clang issue

* update test case by using TEST_P

* fix code style issue

* add one more test data with hyper threading off

* remove duplicated test data

* fix issue for Windows build

* fix issue for Windows build

* add description for test data

* add core type table for each socket

* fix code style issue

* fix code style issue

* remove redundant content

* remove parse_processor_info_linux() from INFERENCE_ENGINE_API_CPP

* fix code style issue

* update example of core type table

* fix code style issue
2023-02-07 13:54:40 +08:00
Shen, Wanglei 413a461be4 Create README.md for AUTO plugin (#14861)
* Create README.md for AUTO plugin

* link to contribuation guidance

* Update README.md according to developer documentation guidance

* Update for comments

* Update components for review comments

* Update folder for review comments

* update for wording

* update for comments
2023-01-12 23:03:45 +08:00
Shen, Wanglei 367058b89e enable new method to generate CPU information and CPU map on Linux (#14456)
* enable new method to generate CPU information and CPU map

* fix code style issue

* fix initialization issue of variable-sized object

* fix dependency issue

* add sample of CPU map

* add description and sample for CPU map

* fix code style issue

* fix code style issue

* add comments on using second processor as physical core

* update _cpu_mapping to align with Windows implementation

* update description for better understanding

* update cpu mapping table for scaling.

* add check if system folder is accessible

* merge new CPU resource based on CPU mapping table with previous CPU resource based on calculation

* fix typo in note

* add description for GROUP_ID
2023-01-03 21:56:21 +08:00