Enable some tests for Template plugin (#16832)

* Remove the skip of template plugin tests

* Enable some skipped tests for template plugin

* Added cancel callback, collect per-layer statistic, fixed tests

* Fixed template tests

* Rename internal API terminate to cancel

* Fixed windows tests

* Fixed logic with performance counters
This commit is contained in:
Ilya Churaev authored and GitHub committed 2023-04-12 01:02:28 +04:00
1 parent 209db8a29b
commit 4a43753e02
20 files changed
+273 -107

No files matched your search

+7
View File
@@ -16,6 +16,7 @@ OpenVINO Runtime Plugin API provides the base ov::IAsyncInferRequest class for a
### Class Fields
- `m_cancel_callback` - a callback which allows to interrupt the execution
- `m_wait_executor` - a task executor that waits for a response from a device about device tasks completion
> **NOTE**: If a plugin can work with several instances of a device, `m_wait_executor` must be device-specific. Otherwise, having a single task executor for several devices does not allow them to work in parallel.
@@ -43,3 +44,9 @@ The stages are distributed among two task executors in the following way:
In the asynchronous request destructor, it is necessary to wait for a pipeline to finish. It can be done using the ov::IAsyncInferRequest::stop_and_wait method of the base class.
@snippet src/async_infer_request.cpp async_infer_request:dtor
### cancel()
The method allows to cancel the infer request execution:
@snippet src/async_infer_request.cpp async_infer_request:cancel
+6
View File
@@ -89,4 +89,10 @@ The method returns the profiling info which was measured during pipeline stages
@snippet src/sync_infer_request.cpp infer_request:get_profiling_info
### cancel()
The plugin specific method allows to interrupt the synchronous execution from the AsyncInferRequest:
@snippet src/sync_infer_request.cpp infer_request:cancel
The next step in the plugin library implementation is the [Asynchronous Inference Request](@ref openvino_docs_ov_plugin_dg_async_infer_request) class.