I'm facing an issue where my docker container stops downloading the model.bin file. I've tried manually downloading and moving the model.bin file, but it still tries to download and gets stuck.
permbann (Lali)
Asked on Nov 04, 2023
Yes, it is possible to start a tabby container without triggering the model download. One way to achieve this is by skipping the --model argument when starting the container. However, please note that this approach has been tested and it fails. Another option is to use the TABBY_DOWNLOAD_HOST option and serve the model from localhost. Additionally, you can try upgrading your docker image to the latest version (0.5.0) and running tabby download before the first serve run. As long as the download succeeds, the serve command should use the local file. If you are unable to find the tabby command, you can try looking for it at /opt/tabby/bin/tabby. It's also worth mentioning that the user was able to get it running after copying the model into the container, although the reason for this success is unknown.
