general
What are the hardware requirements for adding support for Mistral?
So
Sonique
Asked on Dec 13, 2023
To add support for Mistral, it requires at least 60G VRAM for an int8 quantization mode. Most consumer hardware may not meet this requirement at the moment.
Dec 13, 2023Edited by