05e8bd375e
* 2.0 innitial Signed-off-by: fishbell <bell.song@intel.com> * enable all tests Signed-off-by: fishbell <bell.song@intel.com> * remove unecessary files Signed-off-by: fishbell <bell.song@intel.com> * move container header to auto foler, remove uncessary macro define Signed-off-by: fishbell <bell.song@intel.com> * enable caching Signed-off-by: fishbell <bell.song@intel.com> * enable query_model Signed-off-by: fishbell <bell.song@intel.com> * support loaded_from_cache property Signed-off-by: fishbell <bell.song@intel.com> * fix some build warning Signed-off-by: fishbell <bell.song@intel.com> fake inputs/outputs if needed Signed-off-by: fishbell <bell.song@intel.com> * resolve conflict Signed-off-by: fishbell <bell.song@intel.com> * skip unsupported test Signed-off-by: fishbell <bell.song@intel.com> * use mock icore from common foler Signed-off-by: fishbell <bell.song@intel.com> * fix failure for remote tensors Signed-off-by: fishbell <bell.song@intel.com> * apply ppp related fix in auto Signed-off-by: fishbell <bell.song@intel.com> * fix build warning on windows Signed-off-by: fishbell <bell.song@intel.com> * fix ppp output layout issue Signed-off-by: fishbell <bell.song@intel.com> * fix ppp output layout issue Signed-off-by: fishbell <bell.song@intel.com> * clean up headers Signed-off-by: fishbell <bell.song@intel.com> * log formatting Signed-off-by: fishbell <bell.song@intel.com> * enable fps logging for binder mode Signed-off-by: fishbell <bell.song@intel.com> * apply review comments apply review comments Signed-off-by: fishbell <bell.song@intel.com> * remove all legacy namings, exenetwork/network/metric/IE etc Signed-off-by: fishbell <bell.song@intel.com> * update readme Signed-off-by: fishbell <bell.song@intel.com> * fix build lto issue Signed-off-by: fishbell <bell.song@intel.com> * minor wording Signed-off-by: fishbell <bell.song@intel.com> * case fix Signed-off-by: fishbell <bell.song@intel.com> --------- Signed-off-by: fishbell <bell.song@intel.com> Co-authored-by: Chen Peter <peter.chen@intel.com>
OpenVINO Intel GPU Plugin
GPU plugin in OpenVINO toolkit supports inference on Intel® GPUs starting from Gen8 architecture.
Key Contacts
For assistance regarding GPU, contact a member of openvino-ie-gpu-maintainers group.
Components
GPU Plugin contains the following components:
- docs - developer documentation pages for the component.
- include - public API.
- src - sources of the component.
- tests - tests for OpenVINO Plugin component.
- thirdparty - third-party modules.
Tutorials
- Simplified workflow
- Source code structure
- Memory formats
- Kernels and kernel selectors
- GPU plugin operations enabling flow
- Debug utils
- OpenCL Runtime issues troubleshooting
- GPU plugin unit test
Attached licenses
GPU plugin uses 3rd-party components licensed under following licenses:
- googletest under Google License
- *OpenCL™ ICD and C++ Wrapper under Khronos™ License
- RapidJSON under Tencent License
Support
To report issues and make suggestions, see GitHub issues.
How to Contribute
Community contributions to GPU plugin are highly welcome. If you have a suggestion on how to improve the library:
- Share your proposal via GitHub issues
- Ensure you can build the product and run all the tests with your patch
- In case of a larger feature, create a test
- Submit a pull request
We will review your contribution and, if any additional fixes or modifications are necessary, we may provide feedback to guide you. Once your pull request has been approved, it will be merged into our GitHub repository.
System Requirements
GPU plugin supports Intel® HD Graphics, Intel® Iris® Graphics and Intel® Arc™ Graphics and is optimized for Gen9-Gen12LP, Gen12HP architectures
GPU plugin currently uses OpenCL™ with multiple Intel OpenCL™ extensions and requires Intel® Graphics Driver to run.
GPU plugin requires CPU with Intel® SSE/Intel® AVX support.
The software dependencies are:
- CMake 3.5 or later
- C++ compiler with C++11 standard support compatible with:
- GNU Compiler Collection 4.8 or later
- clang 3.5 or later
- Intel® C++ Compiler 17.0 or later
- Visual C++ 2015 (MSVC++ 19.0) or later
- python™ 3.7 or later.
Trademark Information
Intel, the Intel logo, Intel Atom, Intel Core, Intel Xeon Phi, Iris, OpenVINO, the OpenVINO logo, Pentium, VTune, and Xeon are trademarks of Intel Corporation or its subsidiaries.
* Other names and brands may be claimed as the property of others.
Microsoft, Windows, and the Windows logo are trademarks, or registered trademarks of Microsoft Corporation in the United States and/or other countries.
OpenCL and the OpenCL logo are trademarks of Apple Inc. used by permission by Khronos.
Copyright © 2023, Intel Corporation