You can follow the 'how can I convert my own model for use with Tabby' guide in the Tabby documentation to create your own registry.

This will allow you to load the 4 bit quantization model instead of the default 8 bit quantization model. Here is the link to the guide: how can I convert my own model for use with Tabby.