general

How is `N_CTX = 4096` being calculated?

I think 4096 is too much when we don't use chat model

Er

Erfan Safari

Asked on Nov 17, 2023

Nov 17, 2023Edited by