general
What is the architecture of Tabby?
I'm trying to understand the architecture of Tabby. Can someone provide an overview?
Jo
John G
Asked on Feb 04, 2024
The architecture of Tabby consists of several crates:
- The
crates/tabby
crate handles core functionalities and the HTTP API. - The
crates/tabby-download
crate fetches models from the internet. - The
crates/tabby-inference
crate contains traits and utilities for LLM inference. - The
crates/tabby-scheduler
crate performs async jobs. - The
ee/tabby-ui
crate provides the web UI, while theee/tabby-webserver
crate integrates the UI and provides team management and authentication.
Feb 04, 2024Edited by