Skip to content

Memory allocation in GPU plugin

Taylor Yeonbok Lee edited this page Mar 6, 2022 · 30 revisions

Available memories in GPU plugin

GPU plugin supports 4 types of memory allocation as follows. Here "usm_" types refer to the allocation type using the Intel Unified Shared Memor (USM) extension for OpenCL. For more detailed explanation about the USM extension, refer to this page.

  • cl_mem : Standard OpenCL cl_mem allocation
  • usm_host : Accessible by host and device. Not migratable.
  • usm_shared : Accessible by host and device. Migratable.
  • usm_device : Accessible only by device. Not migratable.

Memory allocation in GPU plugin

Memory reuse in GPU plugin