I am considering using a single board computer to host tabby, but I'm not sure if it would work. Would something like this https://www.amazon.com/gp/product/B0CQL5K7NT/ref=ox_sc_act_title_2?smid=AIJ7WJJN4HG6E&th=1 be able to host tabby?
Luigi Castro
Asked on Jan 11, 2024
No, a single board computer like the one you mentioned would not be able to host tabby. Tabby requires a Nvidia GPU, AMD GPU, or Apple M series GPU, none of which are available on that single board computer.
You can also check out the /r/LocalLlama subreddit for more resources on local AI.
