general

How can I resolve the issue with running Podman and accessing GPU device?

Kévin Le Diouron

Asked on Dec 18, 2023

To resolve the issue with running Podman and accessing the GPU device, you can try running the command podman run -it --gpus all --entrypoint /bin/bash tabbyml/tabby and then executing nvidia-smi to check if the GPU device is exposed to the container. If nvidia-smi is not found, it could be an issue with the container toolkit. You can also try using the manylinux cuda binary if you have cuda11 installed in the host environment. You can find more information and the binary at this link: https://github.com/TabbyML/tabby/releases/tag/v0.7.0.

Dec 19, 2023Edited by