general

Do I need to optimize my model for my current setup?

I have TabbyML/StarCoder-1B model and my computer has NVIDIA RTX A1000, Intel i7-12700H and 32 GB RAM. Should I optimize anything?

Kévin Le Diouron

Asked on Dec 12, 2023

Since you're running it for yourself, there isn’t too much need to be tuned. However, you might want to try out DeepSpeedCoder-1.6B for superior quality of next line prediction. It's recommended to switch to a bigger model if you want better accuracy of suggestions.

Dec 12, 2023Edited by