← Back to inboxDrafted
GroenTuin B.V.
Sanne Willems · Web form · 10 Sept 2026, 17:58
Original message
Invoices are being tagged to the wrong project
The automation that reads incoming invoices and files them per project has started putting some of them under the wrong project since last week. Roughly 1 in 5 is wrong. It was perfect before. We did not change anything on our side that I know of. This is making our month-end reconciliation painful.
Triage agent
92% confidenceInvoice auto-tagging misclassifying ~20% of documents to wrong projects since last week.
P2Bugnegative
Suggested next step
Escalate to engineering to review invoice classification model changes and audit recent deployments.
Each click runs the agent live and writes the result plus a run log to Postgres.
Drafted reply
Hi Sanne,
Thanks for flagging this. A 1-in-5 error rate on invoice filing is definitely not what we expect, especially since it was working reliably before. I want to get to the bottom of what changed.
I'll pull your automation logs from last week to see if there's a pattern or if something shifted on our end. Can you also confirm whether your invoice format, naming, or project structure has changed at all, even slightly?
I'll have initial findings for you by end of day tomorrow and we'll take it from there.
A human approves and sends. The agent proposes, it never sends on its own.
What the agent did on this request
Every run is logged: model, tokens, latency and the decision.
| When | Action | Model | Tokens | Latency | Result |
|---|---|---|---|---|---|
| 11 Sept 2026, 13:23 | draft | claude-haiku-4.5 | 248→123 | 2265 ms | {"chars":516} |
| 11 Sept 2026, 13:23 | triage | claude-haiku-4.5 | 353→97 | 1764 ms | {"summary":"Invoice auto-tagging misclassifying ~20% of documents to wrong projects since last week.","category":"Bug","priority":"P2","sentiment":"negative","confidence":0.92,"suggested_action":"Escalate to engineering to review invoice classification model changes and audit recent deployments."} |
| 11 Sept 2026, 13:20 | triage | claude-haiku-4.5 | 353→97 | 1759 ms | {"summary":"Invoice auto-tagging misclassifying ~20% of documents to wrong projects since last week.","category":"Bug","priority":"P2","sentiment":"negative","confidence":0.92,"suggested_action":"Escalate to engineering to review invoice classification model changes and audit recent deployments."} |