Optimizing Triton kernels

Applies to Linux

2024-07-22

3 min read time

This section introduces the general steps for Triton kernel optimization. Broadly, Triton kernel optimization is similar to HIP and CUDA kernel optimization.

Refer to the Triton kernel performance optimization section of the AMD Instinct MI300X workload optimization guide for detailed information.

Triton kernel performance optimization includes the following topics.

• Auto-tunable kernel configurations and environment variables

• MLIR analysis

• ISA assembly analysis

• PyTorch inductor Triton tuning knobs

• Compute the occupancy of a kernel