Tabby Community - Is there a ROCM version for 0.9.1 or can one just use rocm with manylinux now?

general

Is there a ROCM version for 0.9.1 or can one just use rocm with manylinux now?

Andar1an is inquiring about the availability of a ROCM version for 0.9.1 or if it is possible to use ROCM with manylinux. The discussion also includes suggestions on using Docker images for ROCM and building locally if needed.

An

Andar1an

Asked on Mar 21, 2024

It is suggested to use a Docker image for ROCM, such as tabbyml/tabby-rocm.
If you prefer not to use Docker, you can build locally by following the instructions provided in the contributing guidelines: Local Setup.
The manylinux binary for ROCM may not have been built properly, so building locally could be a viable option if you encounter issues with the binary.

Mar 22, 2024Edited by