ROCm-LLMExt compatibility matrix

2026-03-09

2 min read time

Applies to Linux

Use the following matrix to view the ROCm-LLMExt compatibility and system requirements across releases:

ROCm-LLMExt version	Component	AMD Instinct GPU	ROCm version	Ubuntu	PyTorch	Python	Docker Hub
26.02	FlashInfer 0.2.5	MI325X, MI300X	7.1.1	24.04	2.8.0	3.12.9	rocm/flashinfer
	Ray 2.51.1	MI300X	7.0.0	22.04	2.9.0a0+git1c57644	3.12.12	rocm/ray
	verl 0.6.0	MI300X	7.0.0	22.04	2.9.0	3.12.11	rocm/verl
	llama.cpp b6652	MI325X, MI300X, MI210	7.0.0	24.04, 22.04	N/A	N/A	rocm/llama.cpp
25.09	FlashInfer 0.2.5	MI300X	6.4.1	24.04	2.7.1	3.12.9	rocm/flashinfer
	llama.cpp b6356	MI325X, MI300X, MI210	7.0.0, 6.4.3, 6.4.2, 6.4.1	24.04, 22.04	N/A	N/A	rocm/llama.cpp
25.08	Ray 2.48.0.post0	MI300X, MI210	6.4.1	24.04	2.6.0+git684f6f2	3.12.10	rocm/ray
	llama.cpp b5997	MI300X, MI210	6.4.0	24.04	N/A	N/A	rocm/llama.cpp
	Megablocks 0.7.0	MI300X	6.3.0	24.04	2.4.0	3.12.9	rocm/megablocks
	Stanford Megatron-LM 85f95ae	MI300X	6.3.0	24.04	2.4.0	3.12.9	rocm/stanford- megatron-lm
	verl 0.3.0.post0	MI300X	6.2.0	20.04	2.5.0	3.9.19	rocm/verl