Wang Wangwang
c2c2143f45
* Benchmark_app set ov::hint::allow_auto_batching through compile_model * Remove the process about allow_auto_batching in set_property of core * Remove allow_auto_batching and auto_batch_timeout property from AUTO plugin * Reserve the info logs and add API to check auto_batching * Update test case, rm AB property test from core config tests * Update some API in AUTO plugin config
OpenVINO™ Inference
OpenVINO Inference is a part of the OpenVINO Runtime library. The component is responsible for model inference on hardware devices and provides API for OpenVINO Plugin development.
OpenVINO Inference uses the common coding style rules.
Key contacts
People from the openvino-ie-maintainers group have the rights to approve and merge PRs to the inference component. They can assist with any questions about the component.
Components
OpenVINO Inference has the following structure:
- dev_api contains developer API required to develop OpenVINO Plugins. To use this API, link your component against
openvino::runtime::dev. - include contains public API. Find more information in the OpenVINO Inference API document.
- src contains sources of the component.
OpenVINO Inference has unit and functional tests. Unit tests are located in src/tests/unit/inference_engine, functional tests are located in src/tests/functional/inference_engine.