Small fixes for template plugin developer documentation (#16521)
This commit is contained in:
parent
025115f695
commit
fbdd158615
@ -24,6 +24,8 @@ The example class has several fields:
|
|||||||
- `m_backend_input_tensors` - input backend tensors.
|
- `m_backend_input_tensors` - input backend tensors.
|
||||||
- `m_backend_output_tensors` - output backend tensors.
|
- `m_backend_output_tensors` - output backend tensors.
|
||||||
- `m_executable` - an executable object / backend computational graph.
|
- `m_executable` - an executable object / backend computational graph.
|
||||||
|
- `m_eval_context` - an evaluation context to save backend states after the inference.
|
||||||
|
- `m_variable_states` - a vector of variable states.
|
||||||
|
|
||||||
### InferRequest Constructor
|
### InferRequest Constructor
|
||||||
|
|
||||||
@ -69,7 +71,13 @@ Executes a pipeline synchronously using `m_executable` object:
|
|||||||
|
|
||||||
@snippet src/sync_infer_request.cpp infer_request:start_pipeline
|
@snippet src/sync_infer_request.cpp infer_request:start_pipeline
|
||||||
|
|
||||||
#### 3. infer_postprocess()
|
#### 3. wait_pipeline()
|
||||||
|
|
||||||
|
Waits a pipeline in case of plugin asynchronous execution:
|
||||||
|
|
||||||
|
@snippet src/sync_infer_request.cpp infer_request:wait_pipeline
|
||||||
|
|
||||||
|
#### 4. infer_postprocess()
|
||||||
|
|
||||||
Converts backend specific tensors to tensors passed by user:
|
Converts backend specific tensors to tensors passed by user:
|
||||||
|
|
||||||
|
@ -53,9 +53,7 @@ OpenVINO plugin dynamic library consists of several main components:
|
|||||||
7. [Remote Tensor](@ref openvino_docs_ov_plugin_dg_remote_tensor)
|
7. [Remote Tensor](@ref openvino_docs_ov_plugin_dg_remote_tensor)
|
||||||
- Provides the device specific remote tensor API and implementation.
|
- Provides the device specific remote tensor API and implementation.
|
||||||
|
|
||||||
> **NOTE**: This documentation is written based on the `Template` plugin, which demonstrates plugin
|
> **NOTE**: This documentation is written based on the `Template` plugin, which demonstrates plugin development details. Find the complete code of the `Template`, which is fully compilable and up-to-date,
|
||||||
|
|
||||||
development details. Find the complete code of the `Template`, which is fully compilable and up-to-date,
|
|
||||||
at `<openvino source dir>/src/plugins/template`.
|
at `<openvino source dir>/src/plugins/template`.
|
||||||
|
|
||||||
|
|
||||||
|
@ -212,6 +212,7 @@ void ov::template_plugin::InferRequest::start_pipeline() {
|
|||||||
}
|
}
|
||||||
// ! [infer_request:start_pipeline]
|
// ! [infer_request:start_pipeline]
|
||||||
|
|
||||||
|
// ! [infer_request:wait_pipeline]
|
||||||
void ov::template_plugin::InferRequest::wait_pipeline() {
|
void ov::template_plugin::InferRequest::wait_pipeline() {
|
||||||
OV_ITT_SCOPED_TASK(itt::domains::TemplatePlugin, m_profiling_task[WaitPipeline])
|
OV_ITT_SCOPED_TASK(itt::domains::TemplatePlugin, m_profiling_task[WaitPipeline])
|
||||||
auto start = Time::now();
|
auto start = Time::now();
|
||||||
@ -219,6 +220,7 @@ void ov::template_plugin::InferRequest::wait_pipeline() {
|
|||||||
// NOTE: not used in current implementation since `startPipeline` executes pipiline synchronously
|
// NOTE: not used in current implementation since `startPipeline` executes pipiline synchronously
|
||||||
m_durations[WaitPipeline] = Time::now() - start;
|
m_durations[WaitPipeline] = Time::now() - start;
|
||||||
}
|
}
|
||||||
|
// ! [infer_request:wait_pipeline]
|
||||||
|
|
||||||
// ! [infer_request:infer_postprocess]
|
// ! [infer_request:infer_postprocess]
|
||||||
void ov::template_plugin::InferRequest::infer_postprocess() {
|
void ov::template_plugin::InferRequest::infer_postprocess() {
|
||||||
|
Loading…
Reference in New Issue
Block a user