Tabby Community - Should Tabby add a DEBUG_LLAMA_APP parameter on the server side for llama.cpp debugging?

general

Should Tabby add a DEBUG_LLAMA_APP parameter on the server side for llama.cpp debugging?

I'm considering whether Tabby should add a DEBUG_LLAMA_APP parameter on the server side. When this parameter is enabled, it would remove the --log-disable option from the llama-server command, allowing users to gather more context when they suspect that llama.cpp is behaving abnormally. What do you think?

mo

moqi

Asked on Jun 26, 2024

Yes, you can add a DEBUG_LLAMA_APP parameter on the server side for llama.cpp debugging.
Follow the naming practice LLAMA_CPP_... when submitting a PR.
Enabling this parameter would remove the --log-disable option from the llama-server command, providing users with more context for debugging llama.cpp issues.

Jun 26, 2024Edited by