AMD Life Science 26.10 release notes#

3 min read time

Applies to Linux

AMD Life Science 26.10 adds geometric-nn-ops 1.0.0. The release adds fused triangle attention, the triangle multiplicative update, attention with pair bias, and a hipequivariance-ops-torch compatibility package for protein structure prediction models such as OpenFold3.

Note

hipCIM, MONAI on ROCm, MONAI Model Zoo, and MONAILabel are available in the AMD Life Science 26.08 release.

AMD Life Science release highlights#

The following are notable new features and improvements in AMD Life Science 26.10 since the release of 26.08. For detailed changes to individual components, see detailed component changes.

  • geometric-nn-ops 1.0.0: This is the first release of geometric-nn-ops. geometric-nn-ops is a library of Triton GPU kernels for protein structure prediction models such as OpenFold3. The same kernel source runs on AMD GPUs with ROCm. The release adds fused triangle attention, the triangle multiplicative update, attention with pair bias, fp32 precision control, and a hipequivariance-ops-torch compatibility package.

AMD Life Science components#

The following table lists the versions of AMD Life Science components for AMD Life Science 26.10. Click the GitHub icon to go to the component’s source code.

Category Component name Version Source code
AI/ML geometric-nn-ops 1.0.0

Note

hipCIM, MONAI on ROCm, MONAI Model Zoo, and MONAILabel are available in the AMD Life Science 26.08 release.

Detailed component changes#

The following sections describe changes to the AMD Life Science components.

geometric-nn-ops (1.0.0)#

This release is the first release of geometric-nn-ops and includes the following enhancements:

Added#

  • Fused triangle attention: triangle_attention has native Triton forward and backward passes. It supports an optional pair bias and a boolean key mask. It runs bf16, fp16, and fp32. dynamic=True avoids recompiling for each sequence length. use_exp2=True selects a base-2 exponential softmax.

  • Triangle multiplicative update: triangle_multiplicative_update has a fused Triton forward pass and a cuequivariance-compatible signature. When gradients are needed, it switches to a differentiable PyTorch implementation.

  • Attention with pair bias: attention_pair_bias implements Algorithm 24 from the AlphaFold 3 paper in PyTorch. The interface matches cuequivariance 0.9, and it can cache the projected pair bias.

  • fp32 precision control: The Triton kernels follow torch.backends.cuda.matmul.fp32_precision. With "tf32", they use a matmul that is at least TF32-accurate, for example XF32 MFMA on AMD CDNA3.

  • Removed bias arguments: attention_pair_bias no longer accepts ln_z_bias or proj_z_bias. The softmax cancels these parameters, so they can’t affect the output.

  • Drop-in replacement for cuequivariance_ops_torch: The hipequivariance-ops-torch package lets unmodified cuequivariance_torch 0.9.1 code run on AMD GPUs. The shim translates tensor layouts and output ranks to match cuequivariance.

  • Installation guards: Importing the shim raises an error if cuequivariance-ops-torch wheels are also installed. It warns if the installed cuequivariance-torch version isn’t 0.9.1.

Resolved issues#

These changes are in the triangle attention kernel originally contributed to OpenFold3.

  • Fixed NaN output in fp16 when a whole tile of keys was masked.

  • Fixed incorrect gradients for fully masked rows in the backward pass.