Small fixes for template plugin developer documentation (#16521)
This commit is contained in:
parent
025115f695
commit
fbdd158615
@ -23,7 +23,9 @@ The example class has several fields:
|
||||
- backend specific fields:
|
||||
- `m_backend_input_tensors` - input backend tensors.
|
||||
- `m_backend_output_tensors` - output backend tensors.
|
||||
- `m_executable` - an executable object / backend computational graph.
|
||||
- `m_executable` - an executable object / backend computational graph.
|
||||
- `m_eval_context` - an evaluation context to save backend states after the inference.
|
||||
- `m_variable_states` - a vector of variable states.
|
||||
|
||||
### InferRequest Constructor
|
||||
|
||||
@ -69,7 +71,13 @@ Executes a pipeline synchronously using `m_executable` object:
|
||||
|
||||
@snippet src/sync_infer_request.cpp infer_request:start_pipeline
|
||||
|
||||
#### 3. infer_postprocess()
|
||||
#### 3. wait_pipeline()
|
||||
|
||||
Waits a pipeline in case of plugin asynchronous execution:
|
||||
|
||||
@snippet src/sync_infer_request.cpp infer_request:wait_pipeline
|
||||
|
||||
#### 4. infer_postprocess()
|
||||
|
||||
Converts backend specific tensors to tensors passed by user:
|
||||
|
||||
|
@ -53,9 +53,7 @@ OpenVINO plugin dynamic library consists of several main components:
|
||||
7. [Remote Tensor](@ref openvino_docs_ov_plugin_dg_remote_tensor)
|
||||
- Provides the device specific remote tensor API and implementation.
|
||||
|
||||
> **NOTE**: This documentation is written based on the `Template` plugin, which demonstrates plugin
|
||||
|
||||
development details. Find the complete code of the `Template`, which is fully compilable and up-to-date,
|
||||
> **NOTE**: This documentation is written based on the `Template` plugin, which demonstrates plugin development details. Find the complete code of the `Template`, which is fully compilable and up-to-date,
|
||||
at `<openvino source dir>/src/plugins/template`.
|
||||
|
||||
|
||||
|
@ -212,6 +212,7 @@ void ov::template_plugin::InferRequest::start_pipeline() {
|
||||
}
|
||||
// ! [infer_request:start_pipeline]
|
||||
|
||||
// ! [infer_request:wait_pipeline]
|
||||
void ov::template_plugin::InferRequest::wait_pipeline() {
|
||||
OV_ITT_SCOPED_TASK(itt::domains::TemplatePlugin, m_profiling_task[WaitPipeline])
|
||||
auto start = Time::now();
|
||||
@ -219,6 +220,7 @@ void ov::template_plugin::InferRequest::wait_pipeline() {
|
||||
// NOTE: not used in current implementation since `startPipeline` executes pipiline synchronously
|
||||
m_durations[WaitPipeline] = Time::now() - start;
|
||||
}
|
||||
// ! [infer_request:wait_pipeline]
|
||||
|
||||
// ! [infer_request:infer_postprocess]
|
||||
void ov::template_plugin::InferRequest::infer_postprocess() {
|
||||
|
Loading…
Reference in New Issue
Block a user