general

Can Candle be used as the inference engine in Tabby?

zu

zuston

Asked on Nov 10, 2023

Yes, integrating Candle as the inference engine in Tabby is not very challenging. The interface to the underlying inference engine is straightforward to implement.

Nov 10, 2023Edited by