help-self-hosting

What is the intention with the HTTP API bindings and FastChat engine?

It looks like I should be able to spin up a local FastChat endpoint and point Tabby at it.

IT

IT Lackey

Asked on Oct 28, 2023

The HTTP API bindings and FastChat engine are experimental features contributed by a community member. The intention is to provide a way to spin up a local FastChat endpoint and point Tabby at it. However, the HTTP backend itself is experimental and may be removed in the future. It would be a useful feature as long as the latency isn't too high.

Oct 28, 2023Edited by