Files
openvino/src/inference
Fang Xu 82f191b0e7 choose Pcore to compile model for GPU plugin (#20472)
* choose Pcore to compile model for GPU plugin

* provide function to update executor config

* set callback executor to nullptr for GPU plugin

* fix code style

* fix warning

* optimize duplicate code

* set callback executor to nullptr for another gpu compile_model

* add description for new function

* add smoke test

* fix code style

* modify function definition

---------

Co-authored-by: Wanglei Shen <wanglei.shen@intel.com>
2023-10-30 16:24:36 +08:00
..

OpenVINO™ Inference

OpenVINO Inference is a part of the OpenVINO Runtime library. The component is responsible for model inference on hardware devices and provides API for OpenVINO Plugin development.

OpenVINO Inference uses the common coding style rules.

Key contacts

People from the openvino-ie-maintainers group have the rights to approve and merge PRs to the inference component. They can assist with any questions about the component.

Components

OpenVINO Inference has the following structure:

  • dev_api contains developer API required to develop OpenVINO Plugins. To use this API, link your component against openvino::runtime::dev.
  • include contains public API. Find more information in the OpenVINO Inference API document.
  • src contains sources of the component.

OpenVINO Inference has unit and functional tests. Unit tests are located in src/tests/unit/inference_engine, functional tests are located in src/tests/functional/inference_engine.

See also