Pieter Vincken is facing an issue where the TabbyML container fails to start when connected to the host or bridge network on an AWS EC2 instance. The container starts fine on the default network. Pieter has tried with different versions of TabbyML and confirmed that AVX2 is supported on the EC2 instance. Meng Zhang suggested checking for port conflicts, but Pieter confirmed that the port is not occupied. Pieter also mentioned that running a simple NGINX server on the same port works without issues. Pieter shared the command used to start the TabbyML container: docker run -d -p 8080:8080 $image serve --model StarCoder-1B
where $image
is the built image including the downloaded model.
Pieter Vincken
Asked on Apr 26, 2024
Check for network configuration issues:
Verify container logs:
Debug port binding:
docker run
command does not conflict with any other processes or services on the host machine.Review Docker networking documentation:
Test with a minimal configuration: