Skills catalog#
This page lists the skills currently available in the AMD Skills repository, organized by focus area.
The initial catalog is organized into three focus areas, spanning the full stack from client to cloud. This catalog is expected to grow significantly as more skills land.
Client-native#
Run and optimize on Ryzen AI.
Skill |
What it does |
Source |
|---|---|---|
Route image generation, text-to-speech, and speech-to-text through a local AI server to reduce token cost. |
||
Integrate local AI into cloud LLM apps for offline support, better privacy, and lower API costs. |
Cross-stack#
Cross-stack skills, from client to cloud.
Skill |
What it does |
Source |
|---|---|---|
Diagnose and fix common ROCm, HIP, PyTorch, and llama.cpp failures and misconfigurations on AMD GPUs. |
||
Set up a Lemonade model router that handles requests based on content, sensitivity, or required capabilities. |
||
Install or verify AMD Quark with an accelerator-matched PyTorch, from PyPI, a native-wheel index, a local wheel, or source, then verify imports, kernels, and |
||
Quantize PyTorch / Hugging Face LLMs with AMD Quark post-training quantization: inspect the model, pick a scheme (FP8, INT4, and more), and produce a verified quantized model. |
Server-native#
Run and optimize on AMD Instinct.
Skill |
What it does |
Source |
|---|---|---|
Deploy LLM inference on AMD Instinct GPUs end-to-end: detect hardware (or onboard via AMD Developer Cloud), validate model fit, apply the right vLLM recipe, and launch a benchmarked endpoint. SGLang and engine or backend selection in later phases. |
in-repo |
|
Serve LLMs on AMD EPYC CPUs with vLLM and zentorch, in a container (Docker or Podman) or conda. Handles CPU detection, runtime and env validation, vLLM model-support and RAM-fit checks, hardware-sized threads and KV, launch, and health verification. Single instance; reports and stops on failure. |
||
Set up Hyperloom and autonomously optimize end-to-end LLM inference throughput on AMD Instinct GPUs, reporting a validated gain. |
||
Evaluate GPU kernel correctness and performance, compare kernel implementations, and benchmark vLLM or SGLang inference with profiling, TraceLens, and torch-trace gap analysis. |
||
Orchestrate modular PyTorch profiler trace analysis with TraceLens: generate perf reports, run system-level and compute-kernel subagents in parallel, and write a prioritized stakeholder report. |
||
Profile a GPU application with rocprofv3 program counter (PC) sampling, then analyze the samples to surface hotspots and stall reasons. |
||
Pick the right rocprofiler-systems profiling preset for a workload and goal (GPU kernels, MPI, OpenMP, AI/ML training, and more), and return a ready-to-run command. |
||
Discover rocprofiler-systems settings, hardware counters, ROCm API tracing domains, and GPU metrics, and how to configure them. |
||
Instrument programs and libraries with |
||
Write, review, and understand FlyDSL GPU kernels for AMD GPUs: layout algebra, tiled copy and MMA, LDS allocation, and autotuning. |
||
Collect rocprofv3 instruction-level traces and counters for a GPU kernel, map the top stall hotspots back to source lines, and produce an optimization plan. |