All posts
Automation4 min read

The Hidden Reliability Tax of Agentic Workflows 

Traditional automation breaks loudly and cheaply. Agentic workflows can fail quietly and expensively, and that changes what it actually costs to keep one running.

The Hidden Reliability Tax of Agentic Workflows

Traditional automation breaks loudly: a node fails, you get an error, someone fixes it. Agentic workflows break quietly, the process reports success, the output looks plausible, and nobody notices anything is wrong until the mistake has already gone out the door.

Why don't these failures look like failures?

The scariest part of agentic automation isn't when it stops working, it's when it doesn't stop. A traditional workflow that hits something unexpected throws an error and waits for a human. An agent is built to keep going: it reasons around the obstacle, picks an alternative path, and delivers an answer regardless. Dan Klein, the researcher behind Scaled Cognition, has argued the real enterprise risk isn't the AI answer that's obviously wrong, it's the one that's off by a single digit and looks completely plausible. A chatbot that returns the wrong bank balance by one digit doesn't read as an error. It reads as an answer.

Is that a bad model, or something else?

The evidence increasingly points somewhere less dramatic than "the AI is broken." A recurring observation from people building enterprise agents is that most agent failures aren't model failures at all, they're context failures: a stale document, two systems that quietly disagree, a definition nobody updated. The model reasons correctly from wrong or conflicting inputs and produces a confidently wrong output. That's harder to catch than a crashed node, because nothing in the system is technically malfunctioning.

There's a second layer worth naming plainly: agents are non-deterministic systems built to accomplish a goal by whatever means gets there, which can include working around policies or safeguards nobody explicitly told them to respect. One survey of teams building on the Model Context Protocol found 51% had already seen ambiguous tool definitions cause an agent to call the wrong tool entirely, not a crash, just the wrong action, taken with full confidence.

What does catching this actually cost?

This is where the reliability tax shows up as a recurring bill rather than a one-time build cost. One industry survey found 72% of engineering teams had already had a production incident traced back to AI-generated code, even as the same teams shipped faster than ever. Even the vendors racing to fix this admit the tooling is barely keeping up: Databricks' CEO summed up the current landscape of competing, incompatible agent platforms as "a complete mess," and the wider observation from people watching enterprise rollouts is that most agents still aren't creating enough value to justify what they cost to run and supervise.

So what actually closes the gap?

The organizations getting this right don't seem to be reaching for smarter models first, they're reaching for memory, context, and oversight infrastructure. Anthropic has reported that Rakuten cut first-pass errors by 97% on its long-running agents after giving them persistent memory instead of re-explaining context every session. That's the pattern worth noting: not a bigger brain, but a better-kept record, plus a human still checking the highest-stakes decisions before they ship. Agent oversight is turning into its own competitive advantage rather than something bolted on after the first embarrassing mistake.

Traditional automationAgentic workflow
How it failsLoudly, throws an errorQuietly, completes, looks fine
Who catches itWhoever's watching the error logWhoever happens to check the output
What it costsOne fix, onceOngoing monitoring, indefinitely

Does this mean agentic workflows aren't worth using? Not at all, it means the cost model is different, not that the idea is bad. You're trading manual maintenance for ongoing monitoring, and that trade can still be worth it.

Can more testing just solve this? Testing catches the failure modes you already thought to test for. The harder problem is the ones nobody anticipated, which is why persistent context and a human checkpoint matter more than a bigger test suite alone.

Worth asking before the next agent goes live: who's actually checking its work, and how would you know if it quietly got something wrong?

More on Automation

Want a system like this in your business?

We build the automation behind everything you just read.