AMD LLM Extension compatibility matrix

AMD LLM Extension compatibility matrix#

2026-10-08

1 min read time

Applies to Linux

Use the following matrix to view the AMD LLM Extension compatibility and system requirements across releases:

AMD LLM Extension version

Component

AMD Instinct GPU

ROCm version

Ubuntu

PyTorch

Python

Docker

26.09

verl 0.9.0

MI300X, MI325X, MI350X, MI355X

10.0.0

24.04

2.12.0

3.12

Dockerfile

Ray 2.58.0

MI300X, MI325X, MI350X, MI355X

10.0.0

24.04

2.12.0

3.14

Dockerfile

26.06

verl 0.7.1

MI300X, MI325X, MI355X

7.0.2

22.04

2.9.1

3.12

rocm/verl

Ray 2.55.1

MI300X, MI325X, MI355X

7.2.1

22.04

2.10.0

3.12

rocm/ray

26.04

ROCm-RAG 1.0.0

MI300X

6.4.1

22.04

N/A

N/A

rocm/rocm-rag

26.03

FlashInfer 0.5.3

MI355X, MI325X, MI300X

7.2.0, 7.0.2

24.04

2.9.1

3.12

rocm/flashinfer

Triton Inference Server 25.12

MI355X, MI300X

7.2.0

24.04

N/A

3.12

rocm/tritoninferenceserver

26.02

FlashInfer 0.2.5

MI325X, MI300X

7.1.1

24.04

2.8.0

3.12

rocm/flashinfer

Ray 2.51.1

MI300X

7.0.0

22.04

2.9.0a0+git1c57644

3.12

rocm/ray

verl 0.6.0

MI300X

7.0.0

22.04

2.9.0

3.12

rocm/verl

25.09

FlashInfer 0.2.5

MI300X

6.4.1

24.04

2.7.1

3.12

rocm/flashinfer

25.08

Ray 2.48.0.post0

MI300X, MI210

6.4.1

24.04

2.6.0+git684f6f2

3.12

rocm/ray

verl 0.3.0.post0

MI300X

6.2.0

20.04

2.5.0

3.9

rocm/verl