Setup Ubuntu Cuda for Obaabooga
Go to this link and download the cuda toolkit:
This is my target platform config:
You will see these lines below the platfor configs:
wget https://developer.download.nvidia.com/compute/cuda/repos/ubuntu2204/x86_64/cuda-ubuntu2204.pinsudo mv cuda-ubuntu2204.pin/etc/apt/preferences.d/cuda-repository-pin-600
sudo dpkg -i cuda-repo-ubuntu2204-11-8-local_11.8.0-520.61.05-1_amd64.deb
sudo cp /var/cuda-repo-ubuntu2204-11-8-local/cuda-*-keyring.gpg /usr/share/keyrings/
sudo apt-get update
don’t run the last line instead run this:sudo apt-get cuda-toolkit-11-8
This link is helpful in getting things fixed:
https://docs.heavy.ai/v/v6.1.1/installation-and-configuration/installation/installing-on-ubuntu/centos-yum-gpu-os