help-cloud-hosting
What is the smallest model available for me to try to deploy with Tabby that will actually work?
Be
Ben Singer
Asked on Sep 07, 2023
The smallest model available for deployment with Tabby that will actually work is the SantaCoder-1B
model. However, if you are looking for a smaller model for better latency, you may need to explore other options.
Sep 08, 2023Edited by