general
How can I resolve the issue with running Podman and accessing GPU device?
Ké
Kévin Le Diouron
Asked on Dec 18, 2023
To resolve the issue with running Podman and accessing the GPU device, you can try running the command podman run -it --gpus all --entrypoint /bin/bash tabbyml/tabby
and then executing nvidia-smi
to check if the GPU device is exposed to the container. If nvidia-smi
is not found, it could be an issue with the container toolkit. You can also try using the manylinux cuda binary if you have cuda11 installed in the host environment. You can find more information and the binary at this link: https://github.com/TabbyML/tabby/releases/tag/v0.7.0.
Dec 19, 2023Edited by