I updated TabbyML to the latest version and tried running it with Docker using the command docker run -it -p 8080:8080 -v $HOME/.tabby:/data tabbyml/tabby serve --model TabbyML/StarCoder-1B. However, I encountered the following error: /opt/tabby/bin/tabby: error while loading shared libraries: libcuda.so.1: cannot open shared object file: No such file or directory. I'm using an Intel Mac and I haven't installed the Nvidia Docker Toolkit. Is there something I forgot to configure?
moqi
Asked on Feb 03, 2024
The error libcuda.so.1: cannot open shared object file indicates that the CUDA library is missing. Since you're using an Intel Mac and don't have the Nvidia Docker Toolkit installed, you can try running TabbyML with the --device cpu flag to use the CPU build.
