general

How can I fix the 'libcuda.so.1: cannot open shared object file' error when running TabbyML with Docker?

I updated TabbyML to the latest version and tried running it with Docker using the command docker run -it -p 8080:8080 -v $HOME/.tabby:/data tabbyml/tabby serve --model TabbyML/StarCoder-1B. However, I encountered the following error: /opt/tabby/bin/tabby: error while loading shared libraries: libcuda.so.1: cannot open shared object file: No such file or directory. I'm using an Intel Mac and I haven't installed the Nvidia Docker Toolkit. Is there something I forgot to configure?

mo

moqi

Asked on Feb 03, 2024

The error libcuda.so.1: cannot open shared object file indicates that the CUDA library is missing. Since you're using an Intel Mac and don't have the Nvidia Docker Toolkit installed, you can try running TabbyML with the --device cpu flag to use the CPU build.

Feb 04, 2024Edited by