Wiki

This page is read only. You can view the source, but not change it. Ask your administrator if you think this is wrong.
====== Docker - GPU - Use NVIDIA CUDA Toolkit within a Docker container ======

====== Installation of NVIDIA Drivers ======

Ensure that the NVIDIA drivers are correctly installed on the host system.

  * These drivers act as the bridge between the operating system and the NVIDIA GPU hardware, ensuring optimal communication and performance.

See: [[Ubuntu:GPU:NVIDIA GPU:Setup|Setup]].

----

====== Install the NVIDIA Container Toolkit ======

This toolkit extends Docker to leverage NVIDIA GPUs fully, ensuring that the GPU capabilities can be used within containers without any hitches.

===== Download the NVIDIA GPG key =====

<code bash>
curl -fsSL https://nvidia.github.io/libnvidia-container/gpgkey -o /tmp/nvidia-gpgkey
</code>

----

===== Dearmor the GPG key and save it =====

<code bash>
gpg --dearmor -o /usr/share/keyrings/nvidia-container-toolkit-keyring.gpg /tmp/nvidia-gpgkey
</code>

----

===== Download the NVIDIA container toolkit list file =====

<code bash>
curl -s -L https://nvidia.github.io/libnvidia-container/stable/deb/nvidia-container-toolkit.list -o /tmp/nvidia-list
</code>

----

===== Modify the list file to include the signature =====

<code bash>
sed 's#deb https://#deb [signed-by=/usr/share/keyrings/nvidia-container-toolkit-keyring.gpg] https://#g' /tmp/nvidia-list > /etc/apt/sources.list.d/nvidia-container-toolkit.list
</code>

----

===== Update the package database =====

<code bash>
apt update
</code>

----

====== Configuring Docker for NVIDIA Support ======

Having the **NVIDIA Container Toolkit** in place, the next essential task is configuring Docker to recognize and utilize NVIDIA GPUs.

Configure the Docker runtime to use NVIDIA Container Toolkit by using the **nvidia-container-cli** command.

  * The Docker configuration file will be modified to use the NVIDIA runtime

<code bash>
nvidia-container-cli configure --runtime=docker
</code>

<WRAP info>
**NOTE:**  Behind the scenes, this command makes alterations to the **/etc/docker/daemon.json** file.

  * As a result, Docker becomes aware of the NVIDIA runtime and can access GPU features.

</WRAP>


====== Restart the Docker daemon ======

<code bash>
systemctl restart docker
</code>

----

====== Running the NVIDIA CUDA Docker Image ======

With all the required setups in place, the exciting part begins: running a Docker container with NVIDIA GPU support. 

NVIDIA maintains a series of CUDA images on Docker Hub.

Pull the specific NVIDIA CUDA image:

<code bash>
docker pull nvidia/cuda:12.2.0-base-ubuntu22.04
</code>

<WRAP info>
**NOTE:** Always check for the latest tags at [[https://hub.docker.com/r/nvidia/cuda/tags?page=1&name=base-ubuntu|NVIDIA CUDA Docker Hub]] to stay updated.

  * Use that instead of the 12.2.0-base-ubuntu22.04 tag shown here.

</WRAP>

----

====== Run the Docker container with GPU support ======

<code bash>
docker run --gpus all -it nvidia/cuda:12.2.0-base-ubuntu22.04 bash
</code>

<WRAP info>
**NOTE:**  This command runs the Docker container with full GPU access (**--gpus all**) and provides an interactive shell inside the container.

  * Once inside, use NVIDIA utilities like **nvidia-smi** to confirm GPU access.
</WRAP>

----