general

Is it possible to launch only the chat-model in Tabby?

I saw an error message when trying to launch Tabby with the tabby serve command. Can I launch only the chat-model without the code generation model?

cl

clement-igonet

Asked on Nov 22, 2023

Yes, it is possible to launch only the chat-model in Tabby. Starting from version 0.6, you will be able to launch the chat-model separately. This feature is expected to be released sometime this week.

Nov 22, 2023Edited by