MONAI Model Zoo on ROCm documentation

MONAI Model Zoo on ROCm documentation#

2026-09-29

1 min read time

Applies to Linux

The MONAI Model Zoo is a collection of medical imaging models in the MONAI Bundle format maintained by Medical Open Network for Artificial Intelligence (MONAI). Each bundle packages a model’s weights, configuration, and inference scripts for download and inference.

MONAI Model Zoo on ROCm provides a MONAI Model Zoo port for inference on AMD GPUs. The MONAI Bundle override mechanism layers each overlay on the upstream bundle configuration without changing model weights.

The overlays configure these inference behaviors.

  • Channels-last 3D memory format, which reorders the tensor memory layout on AMD CDNA architectures.

  • BF16 automatic mixed precision for inference.

  • torch.compile() graph compilation on the ROCm HIP backend.

  • Device-aware checkpoint loading for bundles that don’t already place weights on-device.

The code is open and hosted at AMD-Ecosystem/monai-model-zoo.

To contribute to MONAI Model Zoo on ROCm, see Contributing to monai-model-zoo.

Licensing information is on the Licensing page.