I have TabbyML/StarCoder-1B model and my computer has NVIDIA RTX A1000, Intel i7-12700H and 32 GB RAM. Should I optimize anything?
Kévin Le Diouron
Asked on Dec 12, 2023
Since you're running it for yourself, there isn’t too much need to be tuned. However, you might want to try out DeepSpeedCoder-1.6B for superior quality of next line prediction. It's recommended to switch to a bigger model if you want better accuracy of suggestions.