ATOM

ATOM#

ATOM (Accelerated Training and Optimization for Models) is AMD’s high-performance LLM serving framework optimized for ROCm platforms. Find the source code at ROCm/ATOM.

Features#

  • High Performance: Optimized kernels for AMD Instinct GPUs

  • Model Support: Wide range of LLM architectures (Llama, GPT, etc.)

  • Distributed Serving: Multi-GPU and multi-node deployment

  • Compilation: CUDAGraph and ROCm optimizations

  • Benchmarking: Built-in performance measurement tools

Supported GPUs#

GPU

Architecture

Memory

Status

AMD Instinct MI355X

CDNA 4 (gfx950)

288 GB HBM3e

✅ Fully Supported (primary CI target)

AMD Instinct MI300X

CDNA 3 (gfx942)

192 GB HBM3

✅ Fully Supported

AMD Instinct MI250X

CDNA 2 (gfx90a)

128 GB HBM2e

✅ Fully Supported
Contents