Graph-safe support for ROCm libraries

Graph-safe support for ROCm libraries#

2024-12-20

4 min read time

Applies to Linux and Windows

HIP graph-safe libraries operate safely in HIP execution graphs. hip:how_to_HIP_graph are an alternative way of executing tasks on a GPU that can provide performance benefits over launching kernels using the standard method via streams.

Functions and routines from graph-safe libraries shouldn’t result in issues like race conditions, deadlocks, or unintended dependencies.

The following table shows whether a ROCm library is graph-safe.

ROCm library

Graph safe support

Composable Kernel

hipBLAS

hipBLASLt

⚠️

hipCUB

hipFFT

✅ (see details)

hipRAND

hipSOLVER

⚠️ (experimental)

hipSPARSE

hipSPARSELt

⚠️ (experimental)

hipTensor

MIOpen

RCCL

rocAL

rocALUTION

rocBLAS

✅ (see details)

rocDecode

rocFFT

✅ (see details)

rocHPCG

rocJPEG

rocPRIM

rocRAND

rocSOLVER

⚠️ (experimental)

rocSPARSE

⚠️ (experimental)

rocThrust

❌ (see details)

rocWMMA

RPP

⚠️

Tensile

✅: full support

⚠️: partial support

❌: not supported