Device | Plugin | Library | Short Description |
---|---|---|---|
CPU | Intel CPU | openvino_intel_cpu_plugin | Intel Xeon with Intel® Advanced Vector Extensions 2 (Intel® AVX2), Intel® Advanced Vector Extensions 512 (Intel® AVX-512), and AVX512_BF16, Intel Core Processors with Intel AVX2, Intel Atom Processors with Intel® Streaming SIMD Extensions (Intel® SSE), Intel® Advanced Matrix Extensions (Intel® AMX) |
ARM CPU | openvino_arm_cpu_plugin | Raspberry Pi™ 4 Model B, Apple® Mac mini with Apple silicon | |
GPU | Intel GPU | openvino_intel_gpu_plugin | Intel Processor Graphics, including Intel HD Graphics and Intel Iris Graphics |
Plugin | Library | Short Description |
---|---|---|
Auto | openvino_auto_plugin | Auto plugin enables selecting Intel device for inference automatically |
Auto Batch | openvino_auto_batch_plugin | Auto batch plugin performs on-the-fly automatic batching (i.e. grouping inference requests together) to improve device utilization, with no programming effort from the user |
Hetero | openvino_hetero_plugin | Heterogeneous execution enables automatic inference splitting between several devices |
Multi | openvino_auto_plugin | Multi plugin enables simultaneous inference of the same model on several devices in parallel |