Inference tutorials

Explore tutorials for deploying models and building inference workflows on AMD GPUs.

• ChatQnA vLLM deployment and performance evaluation

• Text-to-video generation with ComfyUI

• Running ComfyUI generative workflows from Python on AMD Instinct GPUs

• DeepSeek Janus Pro on CPU or GPU

• DeepSeek-R1 with vLLM V1

• AI agent with MCPs using vLLM and PydanticAI

• Hugging Face Transformers

• Deploying with vLLM

• From chatbot to rap bot with vLLM

• RAG with LlamaIndex and Ollama

• OCR with vision-language models with vLLM

• Building AI pipelines for voice assistants

• Speculative decoding with vLLM

• DeepSeek-R1 with SGLang

• PD disaggregation with SGLang

• Accelerating DeepSeek-V3 inference using multi-token prediction in SGLang

• Multi-agents with Google ADK and A2A protocol

• Deploy OpenClaw with Qwen3.5 and vLLM

• Multi-agent incident triage with OpenClaw

• Profiling and optimizing an AI agent on AMD Instinct GPUs