Tabby Community - What are the supported GPU types, configurations, and model sizes for TabbyML?

Tabby Community

tabbyml.slack.com

powered by

Snowshoe.DEV

general

What are the supported GPU types, configurations, and model sizes for TabbyML?

I am looking for a list of supported GPU types, configurations, and model sizes for TabbyML to ensure I purchase appropriate computing resources.

yuhui pang

Asked on Apr 10, 2024

Supported GPU types: 30/40 series RTX cards, T4, A10G, A100, H100 server cards
Configuration: Refer to the documentation for specific configuration details
Model sizes: Refer to the documentation for supported model sizes

Apr 10, 2024Edited by