AMD LLM Extension compatibility matrix

AMD LLM Extension compatibility matrix#

2026-11-06

2 min read time

Applies to Linux

Use the following matrix to view the AMD LLM Extension compatibility and system requirements across releases:

AMD LLM Extension version

Component

AMD Instinct GPU

ROCm version

Ubuntu

PyTorch

Python

Docker

26.10

FlashInfer 0.6.18

MI355X, MI350X, MI325X, MI300X

10.1.0

24.04

2.12.0

3.12

Ray 2.59.0

MI355X, MI350X, MI325X, MI300X

10.1.0

24.04

2.13.0

3.14

26.09

verl 0.9.0

MI355X, MI350X, MI325X, MI300X

10.0.0

24.04

2.12.0

3.12

Ray 2.58.0

MI355X, MI350X, MI325X, MI300X

10.0.0

24.04

2.12.0

3.14

26.06

verl 0.7.1

MI355X, MI325X, MI300X

7.0.2

22.04

2.9.1

3.12

Ray 2.55.1

MI355X, MI325X, MI300X

7.2.1

22.04

2.10.0

3.12

26.04

ROCm-RAG 1.0.0

MI300X

6.4.1

22.04

N/A

N/A

26.03

FlashInfer 0.5.3

MI355X, MI325X, MI300X

7.2.0, 7.0.2

24.04

2.9.1

3.12

Triton Inference Server 25.12

MI355X, MI300X

7.2.0

24.04

N/A

3.12

26.02

FlashInfer 0.2.5

MI325X, MI300X

7.1.1

24.04

2.8.0

3.12

Ray 2.51.1

MI300X

7.0.0

22.04

2.9.0a0+git1c57644

3.12

verl 0.6.0

MI300X

7.0.0

22.04

2.9.0

3.12

25.09

FlashInfer 0.2.5

MI300X

6.4.1

24.04

2.7.1

3.12

25.08

Ray 2.48.0.post0

MI300X, MI210

6.4.1

24.04

2.6.0+git684f6f2

3.12

verl 0.3.0.post0

MI300X

6.2.0

20.04

2.5.0

3.9