general

Can Tabby use custom models?

I've shrink a model to Q4 quantization to fit my GPU's memory, but don't know how to use my customized model in Tabby.

Si

Siwen Yu

Asked on Jan 11, 2024

Yes, Tabby can use custom models. You can follow the instructions in this https://slack.tabbyml.com/Gd5zV1P69JN to learn how to use your customized model in Tabby.

Jan 13, 2024Edited by