I'd like to know the steps to integrate the Mistral-7B-Instruct-v0.1 model with Tabby engine / tabby-client.
clement-igonet
Asked on Nov 22, 2023
Nope - tabby heavilly customized decoding steps, thus not suitable to rely on a openai like api. See discussion at https://github.com/TabbyML/tabby/issues/795