It looks like I should be able to spin up a local FastChat endpoint and point Tabby at it.
IT Lackey
Asked on Oct 28, 2023
The HTTP API bindings and FastChat engine are experimental features contributed by a community member. The intention is to provide a way to spin up a local FastChat endpoint and point Tabby at it. However, the HTTP backend itself is experimental and may be removed in the future. It would be a useful feature as long as the latency isn't too high.