Tabby Community - Is it normal that the GPU is detected as a Vulkan device in the terminal but shown as CPU in the cluster page?

Tabby Community

tabbyml.slack.com

general

Is it normal that the GPU is detected as a Vulkan device in the terminal but shown as CPU in the cluster page?

RiQuY is experiencing an issue where the GPU is detected as a Vulkan device in the terminal but displayed as a CPU in the cluster page. Meng Zhang suggests filing an issue for improvement in the next release.

RiQuY

Asked on Apr 11, 2024

The current display in the cluster page only shows cuda devices properly.
RiQuY is encouraged to file an issue with a screenshot for potential improvement in the next release.

Apr 12, 2024Edited by