Tabby Community - Is Mac M1 supported for Mistral-7B model in Tabby?

Tabby Community

tabbyml.slack.com

general

Is Mac M1 supported for Mistral-7B model in Tabby?

I'm wondering if the Mistral-7B model is supported on Mac M1 for Tabby. Fred Chia asked about enabling chat in Tabby and mentioned Mistral-7B, so I'm curious about its compatibility with Mac M1.

fred chia

Asked on Mar 11, 2024

Yes, Mac M1 is supported for the Mistral-7B model in Tabby.
You can add the --chat-model TabbyML/Mistral-7B option when running Tabby on Mac M1 to enable the Mistral-7B model.

Mar 12, 2024Edited by