To add support for Mistral, it requires at least 60G VRAM for an int8 quantization mode. Most consumer hardware may not meet this requirement at the moment.