Feature matrix

Contents

Feature matrix#

One-pager

At a glance, this table shows which Infera features are available on each engine. Legend: ✅ supported · 🚧 work in progress · blank = not supported.

Overview#

Feature

vLLM

SGLang

ATOM

Source

Disaggregated Serving (PD)

PD Disaggregation

KV-Aware Routing

KV-Aware Routing

KV-Aware Routing + DP-Attention

KV-Aware Routing

Tiered KV Cache Offload (kvd)

🚧

🚧

KV Cache Offload

Multimodal (image / audio / video)

KV-cache offload (kvd), including AIC GPU-Direct, is vLLM-only today.