general
Can Tabby use custom models?
I've shrink a model to Q4 quantization to fit my GPU's memory, but don't know how to use my customized model in Tabby.
Si
Siwen Yu
Asked on Jan 11, 2024
Yes, Tabby can use custom models. You can follow the instructions in this https://slack.tabbyml.com/Gd5zV1P69JN to learn how to use your customized model in Tabby.
Jan 13, 2024Edited by