Tabby Community - Can the accuracy threshold be set to skip suggestions below it?

general

Can the accuracy threshold be set to skip suggestions below it?

Ignacy is inquiring about the possibility of setting an accuracy threshold to skip suggestions below it. Zhiming Ma is seeking clarification on how accuracy is determined for LLM-generated suggestions and asking for suggestions on how to approach this. Ignacy mentions that when asking LLM about suggestions, it does not return any information about the accuracy of its answers.

Ig

Ignacy

Asked on Mar 25, 2024

Setting an accuracy threshold to skip suggestions below it can be challenging when dealing with LLM-generated content.
Determining the accuracy of LLM-generated suggestions may not be straightforward due to the nature of language models.
One approach could be to evaluate the relevance or coherence of the suggestions based on specific criteria.
LLM may not provide explicit information about the accuracy of its answers, so alternative methods for assessing suggestion quality may be needed.

Mar 27, 2024Edited by