general
Is there a way to plug in openai style API with tabby?
I'd like to know the steps to integrate the Mistral-7B-Instruct-v0.1 model with Tabby engine / tabby-client.
cl
clement-igonet
Asked on Nov 22, 2023
Nope - tabby heavilly customized decoding steps, thus not suitable to rely on a openai like api. See discussion at https://github.com/TabbyML/tabby/issues/795
Dec 02, 2023Edited by