general

What are the supported GPU types, configurations, and model sizes for TabbyML?

I am looking for a list of supported GPU types, configurations, and model sizes for TabbyML to ensure I purchase appropriate computing resources.

yu

yuhui pang

Asked on Apr 10, 2024

  • Supported GPU types: 30/40 series RTX cards, T4, A10G, A100, H100 server cards
  • Configuration: Refer to the documentation for specific configuration details
  • Model sizes: Refer to the documentation for supported model sizes
Apr 10, 2024Edited by