Commit Graph
23 Commits
Author SHA1 Message Date
Wanglei ShenandKarol Blaszczak 10c56708fd update auto architecture document in GitHub for 2023.0 release (#17141)
* update auto architecture doc

* update auto architecture doc

* Apply suggestions from code review

Co-authored-by: Karol Blaszczak <karol.blaszczak@intel.com>

* update for comments

---------

Co-authored-by: Karol Blaszczak <karol.blaszczak@intel.com>
2023-04-24 15:44:34 +00:00
Wanglei Shen 14d4fcf827 enable smoke_SetConfigAffinity for ARM (#17092) 2023-04-20 20:25:35 +01:00
Wanglei Shen 70e0eed075 update default affinity for macOS (#17080) 2023-04-20 11:50:04 +00:00
Shen, Wanglei 626caf7f2a update file location for 2023.0 release (#17034) 2023-04-19 10:38:23 +04:00
Shen, Wanglei 3f9cc0112a Hot Fix: using all small core as Ecore (#16978)
* using all small core as Ecore

* add test case
2023-04-18 00:06:36 +04:00
Shen, Wanglei 98393c0da1 update number of threads per stream on Ecore to 2 for aggressive model on hybrid platform (#16857)
* update number of threads per stream on Ecore to 2 when  aggressive model run on hybrid platform

* update for corner case and add test case
2023-04-17 18:42:55 +08:00
Shen, Wanglei 3461064507 update benchmark_app to remove setting UNDEFINED with -hint none (#16695)
* Remove setting ov::hint::PerformanceMode::UNDEFINED from benchmark_app

* update benchmark_app

* update python code and description

* update python code

* fix code style issue

* update python code

* update c++ app
2023-04-13 14:29:13 +00:00
Shen, Wanglei 9f0e557744 HOT FIX: update cpu map calculation for Windows to avoid incorrect total number of processors (#16763)
* update cpu map calculation for Windows

* update typo

* update typo

* update for hybrid CPU

* update for hybrid CPU

* update for typo
2023-04-06 15:08:42 +08:00
Shen, Wanglei 9f54504232 update cpu properties name to enable_hyper_threading and enable_hyper_threading (#16723) 2023-04-04 15:25:11 +04:00
Shen, Wanglei f6c7213ae4 support Ecore only in streams calculation (#16552)
* support Ecore only in streams calculation

* fix merge conflict
2023-04-03 23:33:18 +08:00
Shen, Wanglei 86da15e621 enable new property ov::hint::use_cpu_pinning (#16383)
* enable ov::hint::use_cpu_pinning

* update test case for comments

* update header file

* update header file

* Delete cpu_streams_calculation.hpp

* Revert "Delete cpu_streams_calculation.hpp"

This reverts commit a1074ca843.

* update config name

* fix code styple issue

* update for merge conflict
2023-04-03 18:14:33 +08:00
Shen, Wanglei a726f0ae38 Enable new property ov::hint::scheduling_core_type (#16106)
* enable apply_processor_type()

* declare PROCESSOR_TYPE

* enable readProperties

* test case for get_property()

* enable set_property() and test cases

* reduce changes

* fix code style issue

* fix python test case issue

* remove python interface

* move processor type definition out of dev_api

* refine coding

* add dependency

* update header file

* update description

* merge intel_cpu header file

* add inline in-code documentation

* change 'UNDEFINED' to 'DEFAULT'

* remove ProcTypeConfig

* refine change

* refine change

* refine process_type to scheduling_core_type

* refine description

* fix code style issue

* change to ov::hint::scheduling_core_type

* fix code style issue

* fix code style issue

* fix python issue

* fix python issue

* fix python issue

* fix python issue

* change core_type_cfg to ov::hint::SchedulingCoreType

* update test case for comments

* update test case for comments

* add default for comments

* update code style

* update for comments

* update for comments

* fix typo

* move cpu_map_scheduling into threading folder

* update for merge conflict

* update for code style
2023-03-28 10:04:30 +04:00
Shen, Wanglei 815d4abc03 enable new property ov::hint::use_hyper_threading (#16176)
* enable apply_processor_type()

* declare PROCESSOR_TYPE

* enable readProperties

* test case for get_property()

* enable set_property() and test cases

* reduce changes

* fix code style issue

* fix python test case issue

* remove python interface

* move processor type definition out of dev_api

* refine coding

* add dependency

* update header file

* update description

* merge intel_cpu header file

* add inline in-code documentation

* change 'UNDEFINED' to 'DEFAULT'

* remove ProcTypeConfig

* refine change

* refine change

* enable new property use hyper threading

* update description

* resume legacy code

* change to ov::hint namespace

* update including header file

* update C API and Python API

* update description for comments

* update test case for comments

* update function location for comments

* fix typo

* fix typo

* fix code style issue and update test case

* move cpu_map_scheduling into threading folder
2023-03-28 00:39:26 +04:00
Shen, Wanglei 613b66ba35 include nireq during streams calculation (#16378)
* include nireq during streams calculation

* update description for comments

* update description
2023-03-24 15:27:13 +08:00
Shen, Wanglei e605a4c344 Create streams info table based on processor type table (#15571)
* enable streams info table based on CPU mapping

* add detail processor info for mix stream

* fix code style issue

* fix typo

* fix code style issue for Android build

* update description of streams info table

* move streams info related function to new file

* remove duplicated definition

* add description for parameters of get_streams_info_table()

* update test case file

* fix windows build issue

* fix windows build issue

* fix windows build issue

* fix typo

* update latency mode for hybrid platform

* update limit threads for latency

* update latency mode for 2 sockets platform
2023-03-06 14:06:41 +08:00
Shen, Wanglei c0fa45a1b9 remove invalid KEY_EXCLUSIVE_ASYNC_REQUESTS (#15776) 2023-02-17 11:02:20 +04:00
Shen, Wanglei 115014d3ad Enable test cases for windows parser for CPU mapping table (#15589)
* update test cases for windows cpu mapping parser

* fix code style issue

* fix code style issue

* fix code style issue

* update test data for Linux parser to align with Windows test case

* ufix code style issue

* update test data for Android build

* update linux CPU map parser fix

* fix code style issue

* fix test data issue

* fix size_t warning

* fix size_t warning
2023-02-13 15:55:39 +08:00
Shen, Wanglei 8b1b4de21d fix clang issue of parser test cases for Android build (#15626)
* fix clang issue for Android build

* update test data for parser

* update Linux CPU map parser
2023-02-10 21:37:17 +08:00
Shen, Wanglei d72deb955d move CPU mapping parser API from dev_api header file to specific header file (#15558)
* move CPU mapping parser API to specific header file

* keep all enum defination in ie_system_conf.h

* move hpp file to inference/src

* fix code style issue
2023-02-08 18:27:14 +04:00
Shen, Wanglei 79cad1032b enable new method to generate CPU information and CPU map on Windows (#14710)
* enable new method to generate CPU information and CPU map

* fix code style issue

* fix initialization issue of variable-sized object

* fix dependency issue

* add sample of CPU map

* add description and sample for CPU map

* fix code style issue

* fix code style issue

* add comments on using second processor as physical core

* enable new method to generate CPU information and CPU map on windows

* remove debug output

* add description for CPU map table

* remove changes for linux

* update description for better understanding

* update CPU mapping table on Windows

* fix precision issue of log2()

* fix memory leak

* use shared_ptr to manage  memory life cycle

* Wrap parser for Windows into a separate function for mock testing later

* Revert "Wrap parser for Windows into a separate function for mock testing later"

This reverts commit 614ad718c2.

* add core type table for each socket on windows

* separate CPU map parser on Windows for validation

* fix core type table definition

* fix DWORD issue in header file

* update parser interface for validation

* fix socket count

* update processor count for XEON

* add discrption and example for processor type table

* remove conflicts

* fix merge conflicts

* fix document issue
2023-02-07 20:28:49 +08:00
Shen, Wanglei 63b2c072c0 update Linux CPU map parser and add unit test (#15113)
* update linux CPU map parser and add unit test

* add one more test data

* fix clang issue

* update test case by using TEST_P

* fix code style issue

* add one more test data with hyper threading off

* remove duplicated test data

* fix issue for Windows build

* fix issue for Windows build

* add description for test data

* add core type table for each socket

* fix code style issue

* fix code style issue

* remove redundant content

* remove parse_processor_info_linux() from INFERENCE_ENGINE_API_CPP

* fix code style issue

* update example of core type table

* fix code style issue
2023-02-07 13:54:40 +08:00
Shen, Wanglei 413a461be4 Create README.md for AUTO plugin (#14861)
* Create README.md for AUTO plugin

* link to contribuation guidance

* Update README.md according to developer documentation guidance

* Update for comments

* Update components for review comments

* Update folder for review comments

* update for wording

* update for comments
2023-01-12 23:03:45 +08:00
Shen, Wanglei 367058b89e enable new method to generate CPU information and CPU map on Linux (#14456)
* enable new method to generate CPU information and CPU map

* fix code style issue

* fix initialization issue of variable-sized object

* fix dependency issue

* add sample of CPU map

* add description and sample for CPU map

* fix code style issue

* fix code style issue

* add comments on using second processor as physical core

* update _cpu_mapping to align with Windows implementation

* update description for better understanding

* update cpu mapping table for scaling.

* add check if system folder is accessible

* merge new CPU resource based on CPU mapping table with previous CPU resource based on calculation

* fix typo in note

* add description for GROUP_ID
2023-01-03 21:56:21 +08:00