I'm trying to deploy Tabby image from DockerHub in Azure Container Apps and each time I get errors like CrashLoopBackOff or ContainerBackOff (container is created, but can't start and tries to restart several times). The port and memory parameters are OK. What could be the reason for this?
Ksenia Yerameyevich
Asked on Oct 16, 2023
The reason for the errors could be that you are not specifying the serving related flags. You need to specify the --command option in the initial command with the value "serve --model TabbyML/StarCoder-1B". Additionally, you can refer to the Azure Container Instances documentation for more information on how to specify the start command.