Ubuntu with NVIDIA GPU driver

Instance families

• gn7e, gn7s, gn7i, gn6v, gn6i, gn6e, gn5, and gn5i

• ebmgn7e, ebmgn7i, ebmgn6v, ebmgn6i, and ebmgn6e

• ebmgn7ix and ebmgn7ex

• gn8is, ebmgn8is, gn8v, and ebmgn8v

Environment variables

• /etc/profile.d/nccl.sh

  export NCCL_HOME=/usr/local/nccl
  export LD_LIBRARY_PATH=${NCCL_HOME}/lib:$LD_LIBRARY_PATH

• /etc/profile.d/openmpi.sh

  export MPI_HOME=/usr/local/openmpi
  export LD_LIBRARY_PATH=${MPI_HOME}/lib:$LD_LIBRARY_PATH
  export PATH=${MPI_HOME}/bin:$PATH

• /etc/profile.d/cuda.sh

  export PATH=/usr/local/cuda/bin:$PATH
  export CUDA_HOME=/usr/local/cuda
  export LD_LIBRARY_PATH=/usr/local/cuda/lib64:$LD_LIBRARY_PATH

Instance families

• gn7e, gn7s, gn7i, gn6v, gn6i, gn6e, gn5, and gn5i

• ebmgn7e, ebmgn7i, ebmgn6v, ebmgn6i, and ebmgn6e

• ebmgn7ix and ebmgn7ex

• gn8is, ebmgn8is, gn8v, and ebmgn8v

Environment variables

• /etc/profile.d/nccl.sh

  export NCCL_HOME=/usr/local/nccl
  export LD_LIBRARY_PATH=${NCCL_HOME}/lib:$LD_LIBRARY_PATH

• /etc/profile.d/openmpi.sh

  export MPI_HOME=/usr/local/openmpi
  export LD_LIBRARY_PATH=${MPI_HOME}/lib:$LD_LIBRARY_PATH
  export PATH=${MPI_HOME}/bin:$PATH

• /etc/profile.d/cuda.sh

  export PATH=/usr/local/cuda/bin:$PATH
  export CUDA_HOME=/usr/local/cuda
  export LD_LIBRARY_PATH=/usr/local/cuda/lib64:$LD_LIBRARY_PATH

Instance families

• gn9t and ebmgn9t

• gn8t, gn8te, ebmgn8t, ebmgn8te, ebmgn8ts, and gn8ep

Instance families

• ebmgn9g, ebmgn9gc, ebmgn9ge, ebmgn9t, gn9g, gn9t, and gn9ge

• gn8t, gn8te, ebmgn8t, ebmgn8te, ebmgn8ts, and gn8ep

How do I enable the Keentune tuning tool for an Ubuntu image with a pre-installed NVIDIA GPU driver?

Enable the tool by running the following commands. The changes take effect after a restart.

systemctl stop tuned
systemctl disable tuned
systemctl start keentune-target
systemctl enable keentune-target
systemctl enable keentuned
systemctl start keentuned
keentune profile set cpu_ubuntu_common.profile

To disable Keentune, run keentune profile rollback and restart the operating system.

What should I note when using an Ubuntu image with a pre-installed NVIDIA GPU driver in an ACK cluster?

See Create a custom image from an ECS instance and use the image to create a node and Usage notes and high-risk operations.

Switch CUDA versions

Check the current CUDA version:

nvcc --version

These images use update-alternatives to manage multiple CUDA versions. To switch from CUDA 13.0 to 12.8, use one of the following methods:

• Run update-alternatives --config cuda to interactively switch the CUDA version.

  update-alternatives --config cuda
  There are 2 choices for the alternative cuda (providing /usr/local/cuda).
  
    Selection    Path                  Priority   Status
  ------------------------------------------------------------
    0            /usr/local/cuda-13.0   20        auto mode
    1            /usr/local/cuda-12.8   10        manual mode
  * 2            /usr/local/cuda-13.0   20        manual mode
  
  Press <enter> to keep the current choice[*], or type selection number: 1  --> Select the number for your desired version
  update-alternatives: using /usr/local/cuda-12.8 to provide /usr/local/cuda (cuda) in manual mode

• Run --set to non-interactively set the CUDA version.

  update-alternatives --set cuda /usr/local/cuda-12.8