The smallest model available for deployment with Tabby that will actually work is the SantaCoder-1B model. However, if you are looking for a smaller model for better latency, you may need to explore other options.