Files
openvino/inference-engine
Taylor Yeonbok Lee 30ddd06159 [GPU] Allocate internal buffer to usm_device (#7109)
* Allocate internal buffer to usm_device when one of the input tensor is from usm_device.
Allocate output tensors if there is no user which is cpu impl.

* Move intermediate buffer allocation to primitive_inst

* Allocate to usm_host when the internal buffer is allocated close to limitation of device memory

* Remove internal_buffer_info and replace it with vector of layout.
Updated conditions to use alloc_type w.r.t the availability.

* Allocate internal buffer within primitive_inst construction

* Fixed device_mem allocation condition aligned with driver team
- Single allocation should be less than CL_DEVICE_MAX_MEM_ALLOC_SIZE
- Total allocation for a kernel should be less than CL_DEVICE_GLOBAL_MEM_SIZE

* Apply review comment
2021-09-18 07:50:36 +03:00
..
2021-06-15 16:29:26 +03:00