2dfb537bcb
* add streams_info_table init in the constructor of config * add refresh _proc_type_table * add get_org_proc_type_table * add numa_node per stream in reserve_available_cpus() * fix warning * remove log * fix code style * fix gpu test build failed issue, modify debug info * fix code style * fix build failed on macos * fix code style * select socket in reserve cpu on 2 sockets platform * fix build failed on macos * modify numa node selecting in reserve_cpu_by_streams_info * add test case * fix code style * modify test case * fix core dump * fix core dumped on pin=NUMA * fix test failed on macos * fix reserve cpu is wrong when streams_info_table=[1 1 36] proc_type_table=[36 18 0 18] * add test case in LinuxCpuReserve * modify test case * add test case in cpu_reserve_test * add cpu_stream_info_test * modify enum * fix test failed * change int to size_t * remove invalid code, fix running failed on macos * modify LinuxCpuStreamType test case, move ie_cpu_streams_info.hpp to openvino/runtime/threading/ * fix code sytle * modify enum name * add comments in test case * fix build issue * change IE_ASSERT to OPENVINO_ASSERT * fix test failed on macos and windows * updated test cases due to the cpu mapping is changed * enable numa_node_id and socket_id in streams_info_table * fix code style issue * fix document issue * add get socket id interface * fix segment fault on machine enabled socket_id=1 with numactl command * fix numactl failed on four numa nodes machine * remove compile warning * fix numa_node_id=-1 * fix test case failed on macos * fix test failed on macos * fix numa_node_id=0 on macos * Solve conflicts with master branch * separate test cases for Linux and Mac/Windows * update code style for windows compiler * fix comments * fix code style * fix code style * remove _plugin_mutex, fix comments * fix code style * fix code style * add get_num_sockets * fix cpu reserve issue in latency mode,ANY core on RPL machine * add cpu reserve test case --------- Co-authored-by: Wanglei Shen <wanglei.shen@intel.com>
OpenVINO™ Inference
OpenVINO Inference is a part of the OpenVINO Runtime library. The component is responsible for model inference on hardware devices and provides API for OpenVINO Plugin development.
OpenVINO Inference uses the common coding style rules.
Key contacts
People from the openvino-ie-maintainers group have the rights to approve and merge PRs to the inference component. They can assist with any questions about the component.
Components
OpenVINO Inference has the following structure:
- dev_api contains developer API required to develop OpenVINO Plugins. To use this API, link your component against
openvino::runtime::dev. - include contains public API. Find more information in the OpenVINO Inference API document.
- src contains sources of the component.
OpenVINO Inference has unit and functional tests. Unit tests are located in src/tests/unit/inference_engine, functional tests are located in src/tests/functional/inference_engine.