Skip to main content

Ctrl+K

ROCm™ AI Ecosystem

Core SDK
AI Ecosystem
GPU Systems and Infrastructure
Toolkits

Blogs
Developer Hub

ROCm AI Ecosystem

Infera 0.1

Getting started

Overview
Quick start
Installation and setup
Glossary

Components

Server and router
Engines
Operator
KV cache daemon

Features

Feature matrix
Compatibility matrix
Prefill-decode disaggregation
KV cache offload
KV-aware routing
Routing and transport
Scaling a fleet
Graceful shutdown

Serving

Deployment
Kubernetes

Recipes

Recipes — by model

Examples

Kubernetes recipe — Kimi-K3 (vLLM, mixed)
Kubernetes recipe — PD 1P1D (SGLang, Mooncake)
Kubernetes recipe — GLM-5.2 (SGLang, DSA)
SGLang 1P2D — Kimi-K2.6
SGLang mixed — DeepSeek-V4-Pro
SGLang 1P1D — DeepSeek-V4-Pro

Reference

CLI reference
Environment variables
Benchmarking
Preflight
Troubleshooting

Repository
Open issue

Search

Ctrl+K

Terms and Conditions
ROCm Licenses and Disclaimers
Privacy
Trademarks
Supply Chain Transparency
Fair and Open Competition
UK Tax Strategy
Cookie Policy
Cookie Settings

© 2026 Advanced Micro Devices, Inc