MTTR - Why Time-to-Recover Matters More Than Time-to-Fail
MTTR - Why Time-to-Recover Matters More Than Time-to-Fail
In complex systems, the real question isn’t whether a failure will happen - it’s what happens after.
Failure is a natural part of a living system: load spikes, hardware issues, misconfigurations, broken assumptions. What separates a system that keeps serving users from one that’s paralyzed is recovery time.
Not how long it took to break, but how fast it got back to work.
MTTR: The Metric That Actually Matters
MTTR - Mean Time To Recovery - measures the time from the moment a system enters a failure state until the moment it returns to normal operation.
This is a metric that faces reality, not an ideal.
A system can:
- Fail frequently
- Run into expected and unexpected problems
- Live in an unstable environment
And still be considered good - if it knows how to recover fast.
On the other hand, a system that “almost never goes down” but stays down for a long time when it does - is far more dangerous.
Systems That Fail Fast - But Recover Fast
Some systems are designed so that failure is detected immediately:
- Short timeouts
- Aggressive health checks
- Quick disconnection of a problematic component
They might “fail” more often on paper, but in practice - the damage is small.
The failure is short, contained, and isolated.
A system like this doesn’t try to hold on at all costs. It prefers to fail clearly - and come back fast.
An Analogy
Imagine a road with sensors.
One road:
- Doesn’t detect cracks
- Keeps operating “as usual”
- Until suddenly everything shuts down for an entire day
Another road:
- Detects the problem early
- Blocks a single lane
- Fixes it and restores traffic quickly
The second road might “fail” more times - but it almost never shuts down the whole city.
The Bottom Line
Time-to-Fail is a metric of hope. Time-to-Recover is a metric of reality.
Failure is inevitable. Recovery is a design choice.
And properly designed systems don’t promise they won’t fall - they promise they won’t stay down.