general

Why is my TabbyML Docker container not running?

I am trying to run TabbyML Docker container in CPU only mode, but the container closes out without starting the server. I have checked the logs and there are no errors. What could be the issue?

Lu

Luigi Castro

Asked on Jan 10, 2024

The issue could be that the container is still downloading the model weights, which can take some time, especially if the weights are large. You can check the progress of the download in the logs. Another possible issue could be that your processor does not support AVX2, which is required for running TabbyML. You can try using a different model or check the list of recommended models/sizes on the TabbyML documentation.

Jan 10, 2024Edited by