general

Is it possible to get Tabby to work with larger models?

I'm having trouble with completions when using TabbyML/DeepseekCoder-6.7B model. I know that the suggestion is to use TabbyML/DeepseekCoder-1.3B instead, but that doesn't provide as good completions. Is it possible to get Tabby to work with larger models anyway?

Gr

Greg

Asked on Dec 07, 2023

Yes, it is possible to get Tabby to work with larger models. You can adjust the default timeout and switch to manual triggering mode in the extension settings to improve performance. Additionally, you can try running the larger model on a more powerful machine for better performance.

Dec 07, 2023Edited by