NVIDIA drivers - Amazon Linux 2023
About the NVIDIA repositoryEnabling the NVIDIA repositoryInstalling NVIDIA driversInstalling CUDA ToolkitRemoving the NVIDIA repository
Services or capabilities described in AWS documentation might vary by Region. To see the differences applicable to the AWS European Sovereign Cloud Region, see the AWS European Sovereign Cloud User Guide.

NVIDIA drivers

Amazon Linux 2023 provides NVIDIA GPU drivers and CUDA Toolkit packages through a dedicated repository. AWS maintains this repository and provides security advisories through the Amazon Linux Security Center (ALAS).

About the NVIDIA repository

The AL2023 NVIDIA repository mirrors packages from the official NVIDIA CUDA repository for AL2023. AWS qualifies this NVIDIA software with AL2023 release candidates before redistributing, and provides security advisories for the packages in this repository.

AWS mirrors NVIDIA Production Branch and Long Term Support Branch drivers to this repository. New Feature Branch (NFB) drivers are not mirrored, because they do not receive long-term security support. For more information about NVIDIA driver branches, see NVIDIA driver lifecycle.

The repository is available in all AWS Commercial Regions, as well as the AWS GovCloud (US) Regions and AWS China Regions.

The repository provides NVIDIA Tesla (data center compute) and graphics drivers for x86_64 architectures. GRID drivers, used for virtual display and remote workstation capabilities, are not included. For GRID driver installation, see NVIDIA drivers for your Amazon EC2 instance in the Amazon EC2 User Guide.

Enabling the NVIDIA repository

To enable the NVIDIA repository on your AL2023 instance, install the nvidia-release package. This adds the repository configuration and GPG keys to your system. 

[ec2-user ~]$ sudo dnf install nvidia-release -y

Verify the repository was added:

[ec2-user ~]$ dnf repolist

You should see the amazonlinux-nvidia repository in the list.

repo id                    repo name                                                status
amazonlinux                Amazon Linux 2023 repository                             enabled
amazonlinux-nvidia         Amazon Linux 2023 NVIDIA repository                      enabled

Installing NVIDIA drivers

After enabling the repository, you can install NVIDIA driver packages using dnf.

  1. Install the kernel headers and development packages for your running kernel:

    [ec2-user ~]$ sudo dnf install kernel-devel-$(uname -r) kernel-headers-$(uname -r) -y

  2. Install the NVIDIA driver:

    [ec2-user ~]$ sudo dnf install nvidia-driver-cuda -y

  3. Reboot the instance:

    [ec2-user ~]$ sudo reboot

  4. After rebooting, verify the driver is loaded:

    [ec2-user ~]$ nvidia-smi
Note

For GPU instances that require NVIDIA Fabric Manager (such as P4d, P5, and P6 instance types), install and enable the additional packages: 

[ec2-user ~]$ DRV_BRANCH="$(modinfo nvidia | grep "^version:" | tr -s ' ' | cut -d ' ' -f 2)"
[ec2-user ~]$ sudo dnf install nvidia-fabricmanager-${DRV_BRANCH} -y
[ec2-user ~]$ sudo systemctl enable --now nvidia-fabricmanager
[ec2-user ~]$ sudo systemctl enable --now nvidia-persistenced

Verify that Fabric Manager is running and the GPUs are connected through NVSwitch:

[ec2-user ~]$ sudo systemctl status nvidia-fabricmanager
[ec2-user ~]$ nvidia-smi topo -m

In the topology matrix, connections between GPUs should show NV links, indicating active NVSwitch connectivity.

Installing CUDA Toolkit

After installing the NVIDIA driver, you can install CUDA Toolkit: 

[ec2-user ~]$ sudo dnf install cuda-toolkit -y

Removing the NVIDIA repository

To remove the NVIDIA repository configuration from your system: 

[ec2-user ~]$ sudo dnf remove nvidia-release -y
Important

Removing the repository configuration does not remove any NVIDIA packages already installed on the system.