Snowshoe logo
general

How can I add my own gguf model in TabbyML?

I want to add a custom model 'deepseek' in a q5 version to TabbyML on Windows using the .exe file.

Ga

GaboCore

Asked on Apr 29, 2024

To add your own gguf model in TabbyML, follow the steps below:

  1. Check the MODEL_SPEC.md file on the TabbyML GitHub repository for guidelines.
  2. Ensure your custom model 'deepseek' is compatible with the q5 version.
  3. Use the .exe file for Windows to add the custom model to TabbyML.
  4. Follow any specific instructions or requirements mentioned in the MODEL_SPEC.md file for adding custom models.
Apr 30, 2024Edited by