Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

GPUs not connecting to VM smoothly #324

Closed
sreyan-ghosh opened this issue Jul 10, 2024 · 2 comments
Closed

GPUs not connecting to VM smoothly #324

sreyan-ghosh opened this issue Jul 10, 2024 · 2 comments

Comments

@sreyan-ghosh
Copy link

Describe the bug
GPUs not connecting to VM. The NVIDIA RTX A-Series in the Flemingburg zone is not connecting to the VMs smoothly. The other GPUs namely NVIDIA Quadro K420 and NVIDIA GRID K1 are recognised by the UNIX system as PCI devices, but nvidia-smi does not recognise them due to a signing-key mismatch.

To Reproduce
Steps to reproduce the behaviour:

  1. Create a Ubuntu VM in the Flemingsburg zone in the Gold tier.
  2. Attach any of the available GPUs (except NVIDIA Quadro RTX 5000 this was not available during my testing, so its behaviour is inconclusive)
  3. After installing the latest production drivers, run the nvidia-smi command to see a failed output.
  4. Check the lspci | grep -i vga command and the lspci | grep -i nvidia command to obtain connected GPUs in the K420 and K1 cases and empty outputs in the A-Series' cases.
  5. Check the dmesg | grep -i nvidia command to see the errors occurring with the exact details.
  6. Check dpkg -l | grep -i nvidia to see that the modules are installed but running the lsmod | grep -i nvidia gives a blank output signalling that they are not loaded. Manual loading of the modules also fails.

Expected behavior
Essentially on leasing a GPU through the web interface and installing the drivers and rebooting the system should flawlessly attach the GPUs. But I understand there is a scope of access for each GPU and if there is something of that sort, then it should be made clear in the web interface or in the documentation as to which tier has access to which GPUs.

System Configurations:

  • OS: Ubuntu 24.04 LTS (noble)
  • Kernel-Version: 6.8.0-36-generic
@pierrelefevre
Copy link
Member

Hi! This sounds like a go-deploy issue https://github.com/kthcloud/go-deploy and not directly related to the console (web UI)

@sreyan-ghosh
Copy link
Author

I see. I have raised the issue in go-deploy and am closing it here.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants