I'm wondering if the Mistral-7B model is supported on Mac M1 for Tabby. Fred Chia asked about enabling chat in Tabby and mentioned Mistral-7B, so I'm curious about its compatibility with Mac M1.
fred chia
Asked on Mar 11, 2024
Yes, Mac M1 is supported for the Mistral-7B model in Tabby.
You can add the --chat-model TabbyML/Mistral-7B
option when running Tabby on Mac M1 to enable the Mistral-7B model.