Taylor Yeonbok Lee 746e55a330 [GPU] Fix bfyx conv degradation for gen9 (#8911)
* Fix for bfyx conv performance issue.
PR 6399 was for wide palne + shallow featuremap cases.
If the plane is too small so that the increased computation due toe the alignment for block_size is relatively large, performance drops.

* Fix for bfyx conv performance issue. Use subgroup size 16 when output feature size is >= 8 instead of > 8

* Set bfyx convolution subgroup size to be 16 when output_feature size is 8 and the dtype is fp16
2021-12-07 13:10:52 +03:00
2021-11-27 11:28:25 +03:00
2021-11-27 11:28:25 +03:00
2021-05-31 15:24:56 +03:00
2018-10-16 13:45:03 +03:00
2020-11-17 16:44:44 +03:00

OpenVINO™ Toolkit

Stable release Apache License Version 2.0 GitHub branch checks state Azure DevOps builds (branch) PyPI Downloads

This toolkit allows developers to deploy pre-trained deep learning models through a high-level C++ Inference Engine API integrated with application logic.

This open source version includes several components: namely Model Optimizer, nGraph and Inference Engine, as well as CPU, GPU, MYRIAD, multi device and heterogeneous plugins to accelerate deep learning inferencing on Intel® CPUs and Intel® Processor Graphics. It supports pre-trained models from the Open Model Zoo, along with 100+ open source and public models in popular formats such as Caffe*, TensorFlow*, MXNet* and ONNX*.

Repository components:

License

Deep Learning Deployment Toolkit is licensed under Apache License Version 2.0. By contributing to the project, you agree to the license and copyright terms therein and release your contribution under these terms.

Resources:

Support

Please report questions, issues and suggestions using:


* Other names and brands may be claimed as the property of others.

Languages
C++ 80.5%
Python 15.5%
C 2.8%
CMake 0.9%
Cython 0.1%