Enable some tests for Template plugin (#16832)
* Remove the skip of template plugin tests * Enable some skipped tests for template plugin * Added cancel callback, collect per-layer statistic, fixed tests * Fixed template tests * Rename internal API terminate to cancel * Fixed windows tests * Fixed logic with performance counters
This commit is contained in:
1 parent
209db8a29b
commit
4a43753e02
20 files changed
+273
-107
No files matched your search
@@ -16,6 +16,7 @@ OpenVINO Runtime Plugin API provides the base ov::IAsyncInferRequest class for a
|
||||
|
||||
### Class Fields
|
||||
|
||||
- `m_cancel_callback` - a callback which allows to interrupt the execution
|
||||
- `m_wait_executor` - a task executor that waits for a response from a device about device tasks completion
|
||||
|
||||
> **NOTE**: If a plugin can work with several instances of a device, `m_wait_executor` must be device-specific. Otherwise, having a single task executor for several devices does not allow them to work in parallel.
|
||||
@@ -43,3 +44,9 @@ The stages are distributed among two task executors in the following way:
|
||||
In the asynchronous request destructor, it is necessary to wait for a pipeline to finish. It can be done using the ov::IAsyncInferRequest::stop_and_wait method of the base class.
|
||||
|
||||
@snippet src/async_infer_request.cpp async_infer_request:dtor
|
||||
|
||||
### cancel()
|
||||
|
||||
The method allows to cancel the infer request execution:
|
||||
|
||||
@snippet src/async_infer_request.cpp async_infer_request:cancel
|
||||
@@ -89,4 +89,10 @@ The method returns the profiling info which was measured during pipeline stages
|
||||
|
||||
@snippet src/sync_infer_request.cpp infer_request:get_profiling_info
|
||||
|
||||
### cancel()
|
||||
|
||||
The plugin specific method allows to interrupt the synchronous execution from the AsyncInferRequest:
|
||||
|
||||
@snippet src/sync_infer_request.cpp infer_request:cancel
|
||||
|
||||
The next step in the plugin library implementation is the [Asynchronous Inference Request](@ref openvino_docs_ov_plugin_dg_async_infer_request) class.
|
||||
Reference in new issue
Block a user