[AUTOPLUGIN] update multi plugin document for ov2.0 (#10688)
* update multi document
Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>
* update
Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>
* update snippets ov::enableProfile
Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>
* fix build issue
Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>
* use Anymap in snippets
Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>
* fix format and set property
Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>
* update python
Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>
* try fo fix test document issue
Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>
* removed NEW IE-CENTRIC API and upated set_property
Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>
* update ov::optimal_number_of_infer_requests
Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>
2022-03-18 16:31:36 +08:00
|
|
|
#include <openvino/openvino.hpp>
|
2020-09-22 18:01:48 +03:00
|
|
|
|
2023-01-16 11:02:17 +04:00
|
|
|
int main() {
|
2023-03-08 14:29:08 +01:00
|
|
|
ov::AnyMap cpu_config, gpu_config;
|
2020-09-22 18:01:48 +03:00
|
|
|
//! [part4]
|
[AUTOPLUGIN] update multi plugin document for ov2.0 (#10688)
* update multi document
Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>
* update
Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>
* update snippets ov::enableProfile
Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>
* fix build issue
Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>
* use Anymap in snippets
Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>
* fix format and set property
Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>
* update python
Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>
* try fo fix test document issue
Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>
* removed NEW IE-CENTRIC API and upated set_property
Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>
* update ov::optimal_number_of_infer_requests
Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>
2022-03-18 16:31:36 +08:00
|
|
|
ov::Core core;
|
2022-06-08 16:56:37 +02:00
|
|
|
|
|
|
|
|
// Read a network in IR, PaddlePaddle, or ONNX format:
|
[AUTOPLUGIN] update multi plugin document for ov2.0 (#10688)
* update multi document
Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>
* update
Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>
* update snippets ov::enableProfile
Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>
* fix build issue
Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>
* use Anymap in snippets
Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>
* fix format and set property
Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>
* update python
Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>
* try fo fix test document issue
Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>
* removed NEW IE-CENTRIC API and upated set_property
Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>
* update ov::optimal_number_of_infer_requests
Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>
2022-03-18 16:31:36 +08:00
|
|
|
std::shared_ptr<ov::Model> model = core.read_model("sample.xml");
|
2022-06-08 16:56:37 +02:00
|
|
|
|
2023-03-08 14:29:08 +01:00
|
|
|
// When compiling the model on MULTI, configure GPU and CPU
|
2022-06-08 16:56:37 +02:00
|
|
|
// (devices, priorities, and device configurations):
|
[AUTOPLUGIN] update multi plugin document for ov2.0 (#10688)
* update multi document
Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>
* update
Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>
* update snippets ov::enableProfile
Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>
* fix build issue
Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>
* use Anymap in snippets
Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>
* fix format and set property
Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>
* update python
Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>
* try fo fix test document issue
Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>
* removed NEW IE-CENTRIC API and upated set_property
Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>
* update ov::optimal_number_of_infer_requests
Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>
2022-03-18 16:31:36 +08:00
|
|
|
ov::CompiledModel compileModel = core.compile_model(model, "MULTI",
|
2023-03-08 14:29:08 +01:00
|
|
|
ov::device::priorities("GPU", "CPU"),
|
2022-06-08 16:56:37 +02:00
|
|
|
ov::device::properties("GPU", gpu_config),
|
2023-03-08 14:29:08 +01:00
|
|
|
ov::device::properties("CPU", cpu_config));
|
[AUTOPLUGIN] update multi plugin document for ov2.0 (#10688)
* update multi document
Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>
* update
Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>
* update snippets ov::enableProfile
Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>
* fix build issue
Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>
* use Anymap in snippets
Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>
* fix format and set property
Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>
* update python
Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>
* try fo fix test document issue
Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>
* removed NEW IE-CENTRIC API and upated set_property
Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>
* update ov::optimal_number_of_infer_requests
Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>
2022-03-18 16:31:36 +08:00
|
|
|
|
2022-06-08 16:56:37 +02:00
|
|
|
// Optionally, query the optimal number of requests:
|
[AUTOPLUGIN] update multi plugin document for ov2.0 (#10688)
* update multi document
Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>
* update
Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>
* update snippets ov::enableProfile
Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>
* fix build issue
Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>
* use Anymap in snippets
Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>
* fix format and set property
Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>
* update python
Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>
* try fo fix test document issue
Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>
* removed NEW IE-CENTRIC API and upated set_property
Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>
* update ov::optimal_number_of_infer_requests
Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>
2022-03-18 16:31:36 +08:00
|
|
|
uint32_t nireq = compileModel.get_property(ov::optimal_number_of_infer_requests);
|
2020-09-22 18:01:48 +03:00
|
|
|
//! [part4]
|
|
|
|
|
return 0;
|
|
|
|
|
}
|