* enable binder schedule
Signed-off-by: fishbell <bell.song@intel.com>
* add cases
Signed-off-by: fishbell <bell.song@intel.com>
* refine
Signed-off-by: fishbell <bell.song@intel.com>
* fix build failure
Signed-off-by: fishbell <bell.song@intel.com>
* fix coredump
Signed-off-by: fishbell <bell.song@intel.com>
* do not return hw requests directly, potential issues
Signed-off-by: fishbell <bell.song@intel.com>
* fix bug
Signed-off-by: fishbell <bell.song@intel.com>
typo
Signed-off-by: fishbell <bell.song@intel.com>
* optimize memory
Signed-off-by: fishbell <bell.song@intel.com>
* hold the hw plugin
Signed-off-by: fishbell <bell.song@intel.com>
* Revert "hold the hw plugin"
This reverts commit 5b537f5b6f.
* apply the fix
Signed-off-by: fishbell <bell.song@intel.com>
apply the fix
Signed-off-by: fishbell <bell.song@intel.com>
* hold the plugin library for destructing tensor
Signed-off-by: fishbell <bell.song@intel.com>
* solve the virtuual plugin Getblob life cycle issue
Signed-off-by: fishbell <bell.song@intel.com>
* remove log
Signed-off-by: fishbell <bell.song@intel.com>
* refine interface
Signed-off-by: fishbell <bell.song@intel.com>
* fix build failure
Signed-off-by: fishbell <bell.song@intel.com>
* fix for hetero plugin
Signed-off-by: fishbell <bell.song@intel.com>
* replace with vector
* enable life time tests for virtual plugins
Signed-off-by: fishbell <bell.song@intel.com>
rework cases due to vpux build issue
Signed-off-by: fishbell <bell.song@intel.com>
disable context test for now
Signed-off-by: fishbell <bell.song@intel.com>
Co-authored-by: Chen Peter <peter.chen@intel.com>
30 lines
964 B
C++
30 lines
964 B
C++
// Copyright (C) 2018-2022 Intel Corporation
|
|
// SPDX-License-Identifier: Apache-2.0
|
|
//
|
|
|
|
#pragma once
|
|
|
|
#include <memory>
|
|
#include <vector>
|
|
|
|
#include "cpp_interfaces/impl/ie_infer_async_request_thread_safe_default.hpp"
|
|
#include "infer_request.hpp"
|
|
|
|
namespace HeteroPlugin {
|
|
|
|
class HeteroAsyncInferRequest : public InferenceEngine::AsyncInferRequestThreadSafeDefault {
|
|
public:
|
|
using Ptr = std::shared_ptr<HeteroAsyncInferRequest>;
|
|
HeteroAsyncInferRequest(const InferenceEngine::IInferRequestInternal::Ptr& request,
|
|
const InferenceEngine::ITaskExecutor::Ptr& taskExecutor,
|
|
const InferenceEngine::ITaskExecutor::Ptr& callbackExecutor);
|
|
~HeteroAsyncInferRequest();
|
|
InferenceEngine::StatusCode Wait(int64_t millis_timeout) override;
|
|
InferenceEngine::Blob::Ptr GetBlob(const std::string& name) override;
|
|
|
|
private:
|
|
HeteroInferRequest::Ptr _heteroInferRequest;
|
|
};
|
|
|
|
} // namespace HeteroPlugin
|