general
Should Tabby add a DEBUG_LLAMA_APP parameter on the server side for llama.cpp debugging?
I'm considering whether Tabby should add a DEBUG_LLAMA_APP parameter on the server side. When this parameter is enabled, it would remove the --log-disable option from the llama-server command, allowing users to gather more context when they suspect that llama.cpp is behaving abnormally. What do you think?
mo
moqi
Asked on Jun 26, 2024
- Yes, you can add a
DEBUG_LLAMA_APPparameter on the server side for llama.cpp debugging. - Follow the naming practice
LLAMA_CPP_...when submitting a PR. - Enabling this parameter would remove the
--log-disableoption from the llama-server command, providing users with more context for debugging llama.cpp issues.
Jun 26, 2024Edited by