Files
openvino/src/inference
Xuejun Zhai daba3713c0 [Wrapper] Avoid creating new threads when converting legacy inference request to API 2.0 (#19376)
* Fix error in CVS-115961, caused by wrapper covert 1.0 req to 2.0 req create 2 more threads

Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>

* Eable the test of compareAutoBatchingToSingleBatch with batch size 4 & num req 64, after fix issue 115961

Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>

---------

Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>
2023-08-24 11:46:02 +04:00
..
2023-07-07 13:45:20 +04:00

OpenVINO™ Inference

OpenVINO Inference is a part of the OpenVINO Runtime library. The component is responsible for model inference on hardware devices and provides API for OpenVINO Plugin development.

OpenVINO Inference uses the common coding style rules.

Key contacts

People from the openvino-ie-maintainers group have the rights to approve and merge PRs to the inference component. They can assist with any questions about the component.

Components

OpenVINO Inference has the following structure:

  • dev_api contains developer API required to develop OpenVINO Plugins. To use this API, link your component against openvino::runtime::dev.
  • include contains public API. Find more information in the OpenVINO Inference API document.
  • src contains sources of the component.

OpenVINO Inference has unit and functional tests. Unit tests are located in src/tests/unit/inference_engine, functional tests are located in src/tests/functional/inference_engine.

See also