Wiki

User Tools

Site Tools

Trace:
proxmox:gpu_passthrough

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revisionPrevious revision
Next revision		Previous revision
proxmox:gpu_passthrough [2021/06/07 10:25] – peterproxmox:gpu_passthrough [2023/06/18 18:02] (current) – peter
Line 9: Line 9:
 ---- ----
  
-===== Update Grub =====+There are multiple steps needed. Do these in the following order. 
  
-SSH directly into the Proxmox server. +  * [[Proxmox:GPU Passthrough:Configure Proxmox|Configure Proxmox]] 
- +  * [[Proxmox:GPU Passthrough:Configure VM|Configure VM]]
-Edit /etc/default/grub file. +
- +
-Change the line: +
- +
-<file bash /etc/default/grub> +
-GRUB_CMDLINE_LINUX_DEFAULT="quiet" +
-</file> +
- +
-==== For an Intel CPU ==== +
- +
-<file bash /etc/default/grub> +
-GRUB_CMDLINE_LINUX_DEFAULT="quiet intel_iommu=on" +
-</file> +
- +
-==== For an AMD CPU ==== +
- +
- +
-<file bash /etc/default/grub> +
-GRUB_CMDLINE_LINUX_DEFAULT="quiet amd_iommu=on" +
-</file> +
- +
-<WRAP info> +
-**NOTE:**  Additional commands may be needed as well in this line, if the passthrough ends up failing. +
- +
-For example: +
- +
-<code> +
-GRUB_CMDLINE_LINUX_DEFAULT="quiet intel_iommu=on iommu=pt pcie_acs_override=downstream,multifunction nofb nomodeset video=vesafb:off,efifb:off" +
-</code> +
- +
-  * Disabling the Framebuffer: **[[https://passthroughpo.st/explaining-csm-efifboff-setting-boot-gpu-manually/|video=vesafb:off,efifb:off]]**. +
-  * ACS Override for IOMMU groups:  **[[http://vfio.blogspot.com/2014/08/vfiovga-faq.html|pcie_acs_override=downstream,multifunction]]**. +
-</WRAP>+
  
 ---- ----
  
-When editing is finished run this command:+===== References =====
  
-<code bash> +https://pve.proxmox.com/wiki/PCI(e)_Passthrough
-update-grub +
-</code> +
- +
----- +
- +
-===== VFIO Modules ===== +
- +
-Add a few VFIO (Virtual Function I/O) modules to your Proxmox system. +
- +
-Add the following to the /etc/modules file: +
- +
-<file bash /etc/modules> +
-vfio +
-vfio_iommu_type1 +
-vfio_pci +
-vfio_virqfd +
-</file> +
- +
-Save and exit. +
- +
----- +
- +
-===== IOMMU interrupt remapping ===== +
- +
-Run the following commands: +
- +
-<code bash> +
-echo "options vfio_iommu_type1 allow_unsafe_interrupts=1" > /etc/modprobe.d/iommu_unsafe_interrupts.conf +
-echo "options kvm ignore_msrs=1" > /etc/modprobe.d/kvm.conf +
-</code> +
- +
----- +
- +
-===== Blacklist Drivers ===== +
- +
-To prevent the Proxmox host system utilizing the GPU(s), some drivers need to be blacklisted. +
- +
-<code bash> +
-echo "blacklist radeon" >> /etc/modprobe.d/blacklist.conf +
-echo "blacklist nouveau" >> /etc/modprobe.d/blacklist.conf +
-echo "blacklist nvidia" >> /etc/modprobe.d/blacklist.conf +
-</code> +
- +
----- +
- +
-===== Adding GPU to VFIO ===== +
- +
-==== Determine the GPU ==== +
- +
-<code bash> +
-lspci -v +
-</code> +
- +
-returns: +
- +
-<code bash> +
-01:00.0 VGA compatible controller: NVIDIA Corporation GP104 [GeForce GTX 1070] (rev a1) (prog-if 00 [VGA controller]) +
-01:00.1 Audio device: NVIDIA Corporation GP104 High Definition Audio Controller (rev a1) +
-</code> +
- +
- +
-<WRAP info> +
-**NOTE:**  Look for the line(s) that show the video card. +
- +
-Make note of the first set of numbers (e.g. 01:00.0 and 01:00.1). +
- +
-</WRAP> +
- +
----- +
- +
-==== Determine the GPU Vendor IDs ==== +
- +
-Run the command below. +
- +
-<WRAP info> +
-**NOTE:**  Replace 01:00 with whatever number was next to your GPU when you ran the previous command: +
-</WRAP> +
- +
- +
-<code bash> +
-lspci -n -s 01:00 +
-</code> +
- +
-returns: +
- +
-<code bash> +
-01:00.0 0000: 10de:1b81 (rev a1) +
-01:00.1 0000: 10de:10f0 (rev a1) +
-</code> +
- +
-<WRAP info> +
-**NOTE:**  This should output the GPU Vendor IDs, usually one ID for the GPU and one ID for the Audio bus. +
- +
-Make a note of the vendor id codes: 10de:1b81 and 10de:10f0. +
- +
-</WRAP> +
- +
----- +
-     +
-==== Add the GPU Vendor IDs to the VFIO ==== +
- +
-<code bash> +
-echo "options vfio-pci ids=10de:1b81,10de:10f0 disable_vga=1"> /etc/modprobe.d/vfio.conf +
- +
----- +
- +
-Update  +
- +
-<code bash> +
-update-initramfs -u +
-</code> +
- +
----- +
- +
-==== Restart ==== +
- +
-<code bash> +
-sudo reboot +
-</code> +
- +
-<WRAP info> +
-**NOTE:**  The Proxmox host should be ready to passthrough GPUs! +
-</WRAP> +
- +
----- +
- +
-===== Configuring the VM ===== +
- +
-==== Edit the VM Config File ==== +
- +
-Edit **/etc/pve/qemu-server/<vmid>.conf**, where <vmid> is the VM ID Number you used during the VM creation (General Tab). +
- +
-Add these lines. +
- +
-<file bash> +
-machine: q35 +
-cpu: host,hidden=1,flags=+pcid +
-args: -cpu 'host,+kvm_pv_unhalt,+kvm_pv_eoi,hv_vendor_id=NV43FIX,kvm=off' +
-</file> +
- +
----- +
- +
-==== Add PCI Devices (Your GPU) to VM ==== +
- +
-Select the VM. +
- +
-Under the Hardware Tab, click on the **Add** button towards the top. +
- +
-Then under the drop-down menu, click **PCI Device**. +
- +
-Look for the GPU in the list, and select it. +
- +
-On the PCI options screen, you should only need to configure it like so: +
- +
-  * All Functions: **Checked**. +
-  * Rom-Bar: **Checked**. +
-  * Primary GPU: **Not Checked**. +
-  * PCI-Express:  **Checked**.  This requires **machine: q35** in the VM config file. +
- +
----- +
- +
-===== References =====+
  
 https://passthroughpo.st/explaining-csm-efifboff-setting-boot-gpu-manually/ https://passthroughpo.st/explaining-csm-efifboff-setting-boot-gpu-manually/
  
 https://www.reddit.com/r/VFIO/ https://www.reddit.com/r/VFIO/
 +
  
proxmox/gpu_passthrough.1623061555.txt.gz · Last modified: 2021/06/07 10:25 by peter
Donate Powered by PHP Valid HTML5 Valid CSS Driven by DokuWiki