Prerequisites to use ROCm™ on Radeon™ desktop GPUs for machine learning development

Prerequisites to use ROCm™ on Radeon™ desktop GPUs for machine learning development#

Before you start with the installation, it’s essential to ensure that your system meets the necessary requirements such as supported hardware, a compatible operating system, and the recommended system configuration to ensure optimal performance and functionality.

See Compatibility matrices for more information.

Supported hardware#

Supported graphics processing units#

To successfully install ROCm for machine learning development, ensure that your system is operating on one of the following Radeon Desktop GPUs:

Radeon RX 7900 XTX
Radeon RX 7900 XT
Radeon PRO W7900

Recommended memory#

These specifications are required for complex AI/ML workloads:

64GB Main Memory
24GB GPU Video Memory

Minimum recommendations#

Note that low system memory may cause issues running inference models on CPU.

16GB Main Memory
8GB GPU Video Memory

Supported operating systems#

To successfully install ROCm™ for machine learning development, ensure that your operating system is up-to-date.

Supported operating systems include:

Ubuntu® 22.04.3 Desktop Version with hardware enablement kernel (HWE)

Update Ubuntu® operating system#

Use the following commands to bring your OS up-to-date:

sudo apt-get update
sudo apt-get dist-upgrade

Recommended system configuration#

This section guides users on how to optimize system configuration for ROCm™ usage, ensuring smooth and performant ROCm operation.

Disable iGPU#

The iGPU is non-essential for AI and ML workloads and not officially supported. Disable iGPU in SBIOS before proceeding to avoid unknown issues.

Alternatively, use environment variables to select the target GPU.

Here are examples to disable iGPU on some AMD motherboards:

Gigabyte™ X670 AORUS ELITE AX#

Enter BIOS

Path: Advanced → AMD CBS → NBIO Common Options → GFX Configuration → iGPU Configuration
Set iGPU to Disabled

ASUS Prime X670-P WIFI#

Enter BIOS

Path: Advanced → NB Configuration → Integrated Graphics
Set to Disabled

NOTE: This step only applies to AMD motherboards, no action is required for non-AMD motherboards.

There are no minimum motherboard hardware requirements.

Alternative option: Use environment variables to select target GPU#

An alternative option to disabling the iGPU is to use environment variable to select the GPU.

See GPU Isolation Techniques to specify the device indices you would like to expose to your application.