OpenCL-Benchmark

A small OpenCL benchmark program to measure peak GPU/CPU performance.

Works with any GPU in Windows, Linux, macOS and Android.

Measurements

• compute performance (FP64 (scalar), FP32 (scalar), FP16 (half2), INT64 (scalar), INT32 (scalar), INT16 (short2), INT8 (dp4a))
  • closest possible fraction/multiplicator of measured compute performance divided by reported theoretical FP32 performance is shown in (round brackets)
    • for example when OpenCL reports 19.492 TFLOPs/s theoretical FP32, and the benchmark measures 9.512 TFLOPs/s for FP64, the ratio of (measured FP64)/(theoretical FP32) = 9.512/19.492 = 1/2.05 is rounded to the next possible value of 1/2 and reported as such
    • these ratios for any GPU/CPU architecture can only be either 1/64, 1/32, 1/24, 1/16, 1/12, 1/8, 1/4, 1/3, 1/2, 2/3, 1x, 2x, 4x, 8x, 16x, 32x, 64x, and nothing in between
• memory bandwidth (coalesced/misaligned read/write)
• PCIe bandwidth (send/receive/bidirectional)
  • PCIe Gen is estimated based on measured PCIe bandwidth and assumed x16 link width

How to use?

Windows

• Download and install Visual Studio Community. In Visual Studio Installer, add:
  • Desktop development with C++
  • MSVC v142
  • Windows 10 SDK
• Open OpenCL-Benchmark.sln in Visual Studio Community.
• Compile and run by clicking the ► Local Windows Debugger button.
• To run outside of Visual Studio Community, open Windows CMD in the OpenCL-Benchmark folder (type cmd in File Explorer in the directory field and press Enter), then run

  OpenCL-Benchmark.exe
  

Linux / macOS / Android

• Download, compile and run:

  git clone https://github.com/ProjectPhysX/OpenCL-Benchmark.git
  cd OpenCL-Benchmark
  chmod +x make.sh
  ./make.sh
  

• Run

  bin/OpenCL-Benchmark
  

Run only for a specified list of devices

• call bin\OpenCL-Benchmark.exe 0 2 5 (Windows) or bin/OpenCL-Benchmark 0 2 5 (Linux/macOS) with the number(s) being the device IDs to be benchmarked

Examples

|----------------.------------------------------------------------------------|
| Device ID      | 0                                                          |
| Device Name    | NVIDIA H100 80GB HBM3                                      |
| Device Vendor  | NVIDIA Corporation                                         |
| Device Driver  | 565.57.01 (Linux)                                          |
| OpenCL Version | OpenCL C 1.2                                               |
| Compute Units  | 132 at 1980 MHz (16896 cores, 66.908 TFLOPs/s)             |
| Memory, Cache  | 81105 MB VRAM, 4224 KB global / 48 KB local                |
| Buffer Limits  | 20276 MB global, 64 KB constant                            |
|----------------'------------------------------------------------------------|
| Info: OpenCL C code successfully compiled.                                  |
| FP64  compute                                        31.184 TFLOPs/s (1/2 ) |
| FP32  compute                                        62.908 TFLOPs/s ( 1x ) |
| FP16  compute                                       123.749 TFLOPs/s ( 2x ) |
| INT64 compute                                         3.227  TIOPs/s (1/24) |
| INT32 compute                                        32.946  TIOPs/s (1/2 ) |
| INT16 compute                                        30.901  TIOPs/s (1/2 ) |
| INT8  compute                                       103.204  TIOPs/s ( 2x ) |
| Memory Bandwidth ( coalesced read      )                       3025.53 GB/s |
| Memory Bandwidth ( coalesced      write)                       3055.98 GB/s |
| Memory Bandwidth (misaligned read      )                       2102.44 GB/s |
| Memory Bandwidth (misaligned      write)                        314.25 GB/s |
| PCIe   Bandwidth (send                 )                         10.53 GB/s |
| PCIe   Bandwidth (   receive           )                         11.47 GB/s |
| PCIe   Bandwidth (        bidirectional)            (Gen4 x16)   10.91 GB/s |
|-----------------------------------------------------------------------------|

|----------------.------------------------------------------------------------|
| Device ID      | 2                                                          |
| Device Name    | AMD Instinct MI210                                         |
| Device Vendor  | Advanced Micro Devices, Inc.                               |
| Device Driver  | 3625.0 (HSA1.1,LC) (Linux)                                 |
| OpenCL Version | OpenCL C 2.0                                               |
| Compute Units  | 104 at 1700 MHz (6656 cores, 22.630 TFLOPs/s)              |
| Memory, Cache  | 65520 MB VRAM, 16 KB global / 64 KB local                  |
| Buffer Limits  | 65520 MB global, 67092480 KB constant                      |
|----------------'------------------------------------------------------------|
| Info: OpenCL C code successfully compiled.                                  |
| FP64  compute                                        17.681 TFLOPs/s (2/3 ) |
| FP32  compute                                        20.007 TFLOPs/s ( 1x ) |
| FP16  compute                                        39.594 TFLOPs/s ( 2x ) |
| INT64 compute                                         1.515  TIOPs/s (1/16) |
| INT32 compute                                         9.877  TIOPs/s (1/2 ) |
| INT16 compute                                        19.532  TIOPs/s ( 1x ) |
| INT8  compute                                        36.307  TIOPs/s ( 2x ) |
| Memory Bandwidth ( coalesced read      )                        993.82 GB/s |
| Memory Bandwidth ( coalesced      write)                        999.76 GB/s |
| Memory Bandwidth (misaligned read      )                       1325.91 GB/s |
| Memory Bandwidth (misaligned      write)                        635.20 GB/s |
| PCIe   Bandwidth (send                 )                         28.72 GB/s |
| PCIe   Bandwidth (   receive           )                         28.51 GB/s |
| PCIe   Bandwidth (        bidirectional)            (Gen4 x16)   28.61 GB/s |
|-----------------------------------------------------------------------------|

|----------------.------------------------------------------------------------|
| Device ID      | 0                                                          |
| Device Name    | Intel(R) Arc(TM) B580 Graphics                             |
| Device Vendor  | Intel(R) Corporation                                       |
| Device Driver  | 32.0.101.6559 (Windows)                                    |
| OpenCL Version | OpenCL C 3.0                                               |
| Compute Units  | 160 at 2850 MHz (2560 cores, 14.592 TFLOPs/s)              |
| Memory, Cache  | 12187 MB VRAM, 18432 KB global / 128 KB local              |
| Buffer Limits  | 11944 MB global, 12230900 KB constant                      |
|----------------'------------------------------------------------------------|
| Info: OpenCL C code successfully compiled.                                  |
| FP64  compute                                         0.896 TFLOPs/s (1/16) |
| FP32  compute                                        14.249 TFLOPs/s ( 1x ) |
| FP16  compute                                        26.547 TFLOPs/s ( 2x ) |
| INT64 compute                                         0.636  TIOPs/s (1/24) |
| INT32 compute                                         4.556  TIOPs/s (1/3 ) |
| INT16 compute                                        37.082  TIOPs/s ( 2x ) |
| INT8  compute                                        48.668  TIOPs/s ( 4x ) |
| Memory Bandwidth ( coalesced read      )                        574.09 GB/s |
| Memory Bandwidth ( coalesced      write)                        468.07 GB/s |
| Memory Bandwidth (misaligned read      )                        796.23 GB/s |
| Memory Bandwidth (misaligned      write)                        383.15 GB/s |
| PCIe   Bandwidth (send                 )                          4.99 GB/s |
| PCIe   Bandwidth (   receive           )                          4.87 GB/s |
| PCIe   Bandwidth (        bidirectional)            (Gen3 x16)    5.11 GB/s |
|-----------------------------------------------------------------------------|
|----------------.------------------------------------------------------------|

|----------------.------------------------------------------------------------|
| Device ID      | 0                                                          |
| Device Name    | AMD EPYC 9554 64-Core Processor                            |
| Device Vendor  | Intel(R) Corporation                                       |
| Device Driver  | 2024.18.10.0.08_160000 (Linux)                             |
| OpenCL Version | OpenCL C 3.0                                               |
| Compute Units  | 128 at 0 MHz (64 cores, 0.000 TFLOPs/s)                    |
| Memory, Cache  | 386363 MB RAM, 1024 KB global / 256 KB local               |
| Buffer Limits  | 386363 MB global, 128 KB constant                          |
|----------------'------------------------------------------------------------|
| Info: OpenCL C code successfully compiled.                                  |
| FP64  compute                                         3.739 TFLOPs/s (1/64) |
| FP32  compute                                         3.842 TFLOPs/s (1/64) |
| FP16  compute                                         0.863 TFLOPs/s (1/64) |
| INT64 compute                                         1.506  TIOPs/s (1/64) |
| INT32 compute                                         4.240  TIOPs/s (1/64) |
| INT16 compute                                         8.592  TIOPs/s (1/64) |
| INT8  compute                                         2.774  TIOPs/s (1/64) |
| Memory Bandwidth ( coalesced read      )                        391.09 GB/s |
| Memory Bandwidth ( coalesced      write)                        167.26 GB/s |
| Memory Bandwidth (misaligned read      )                        248.65 GB/s |
| Memory Bandwidth (misaligned      write)                        156.18 GB/s |
|-----------------------------------------------------------------------------|

|----------------.------------------------------------------------------------|
| Device ID      | 1                                                          |
| Device Name    | Intel(R) UHD Graphics 630                                  |
| Device Vendor  | Intel(R) Corporation                                       |
| Device Driver  | 31.0.101.2130 (Windows)                                    |
| OpenCL Version | OpenCL C 3.0                                               |
| Compute Units  | 24 at 1200 MHz (192 cores, 0.461 TFLOPs/s)                 |
| Memory, Cache  | 6500 MB RAM, 768 KB global / 64 KB local                   |
| Buffer Limits  | 3250 MB global, 3328048 KB constant                        |
|----------------'------------------------------------------------------------|
| Info: OpenCL C code successfully compiled.                                  |
| FP64  compute                                         0.112 TFLOPs/s (1/4 ) |
| FP32  compute                                         0.437 TFLOPs/s ( 1x ) |
| FP16  compute                                         0.801 TFLOPs/s ( 2x ) |
| INT64 compute                                         0.016  TIOPs/s (1/32) |
| INT32 compute                                         0.149  TIOPs/s (1/3 ) |
| INT16 compute                                         0.863  TIOPs/s ( 2x ) |
| INT8  compute                                         0.213  TIOPs/s (1/2 ) |
| Memory Bandwidth ( coalesced read      )                         20.98 GB/s |
| Memory Bandwidth ( coalesced      write)                         25.18 GB/s |
| Memory Bandwidth (misaligned read      )                         35.16 GB/s |
| Memory Bandwidth (misaligned      write)                         16.18 GB/s |
|-----------------------------------------------------------------------------|

|----------------.------------------------------------------------------------|
| Device ID      | 2                                                          |
| Device Name    | Intel(R) Core(TM) i7-8700K CPU @ 3.70GHz                   |
| Device Vendor  | Intel(R) Corporation                                       |
| Device Driver  | 2024.17.3.0.08_160000 (Windows)                            |
| OpenCL Version | OpenCL C 3.0                                               |
| Compute Units  | 12 at 3700 MHz (6 cores, 0.710 TFLOPs/s)                   |
| Memory, Cache  | 16250 MB RAM, 256 KB global / 32 KB local                  |
| Buffer Limits  | 16250 MB global, 128 KB constant                           |
|----------------'------------------------------------------------------------|
| Info: OpenCL C code successfully compiled.                                  |
| FP64  compute                                         0.151 TFLOPs/s (1/4 ) |
| FP32  compute                                         0.158 TFLOPs/s (1/4 ) |
| FP16  compute                                          not supported        |
| INT64 compute                                         0.042  TIOPs/s (1/16) |
| INT32 compute                                         0.063  TIOPs/s (1/12) |
| INT16 compute                                         0.224  TIOPs/s (1/3 ) |
| INT8  compute                                         0.059  TIOPs/s (1/12) |
| Memory Bandwidth ( coalesced read      )                         16.92 GB/s |
| Memory Bandwidth ( coalesced      write)                          8.08 GB/s |
| Memory Bandwidth (misaligned read      )                         40.02 GB/s |
| Memory Bandwidth (misaligned      write)                         13.69 GB/s |
|-----------------------------------------------------------------------------|