Optimizing Triton kernels

2024-11-07

3 min read time

Applies to Linux

This section introduces the general steps for Triton kernel optimization. Broadly, Triton kernel optimization is similar to HIP and CUDA kernel optimization.

Refer to the Triton kernel performance optimization section of the AMD Instinct MI300X workload optimization guide for detailed information.

Triton kernel performance optimization includes the following topics.

• Auto-tunable kernel configurations

• MLIR analysis

• ISA assembly analysis

• PyTorch inductor max-autotune tuning knobs

• Compute the occupancy of a kernel