Don’t Load a Cold System

Warming up is the stage where a system transitions from cold to warm.

At this stage:

• The cache is empty
• Connections haven’t been opened yet
• Paths aren’t “hot” yet
• Queues haven’t stabilized yet

Every request triggers more work than it would under normal conditions.

In other words: the system is at its most vulnerable state.

So Why Limit Load During This Time

Because if you give the system full load while it’s still cold, you’re asking it to do the heaviest work exactly when it’s weakest.

This creates a problematic chain:

• Requests come in fast
• Every request is more expensive to process
• Response times stretch out
• Timeouts and retries kick in
• The load grows even more

Before the system has had a chance to “warm up,” it’s already under pressure.

What “Limiting Load” Actually Means in Practice

This isn’t a theoretical concept. It’s a very concrete decision.

In practice, it means, for example:

• Not accepting the full request rate immediately
• Letting the system ramp up gradually
• Pausing non-critical requests
• Prioritizing some work over other work
• Not allowing aggressive retries early on

The goal isn’t to be fast - it’s to be stable enough to warm up.

Why This Matters Even If the System Is “Powerful”

Even a system with plenty of resources isn’t immune to a cold start.

Because the problem isn’t just capacity - it’s the nature of the work:

• Opening connections is expensive
• Filling the cache is expensive
• Building internal structures is expensive
• And all of it happens at once, with no absorption

If all of this happens under full load, you get concentrated load instead of gradual load.

The Simplest Analogy

Imagine an industrial kitchen in the morning.

Before serving customers, you need to:

• Heat the ovens
• Prepare the stations
• Open up the raw ingredients

If a full wave of customers arrives before the kitchen is ready - it doesn’t matter how skilled the cooks are.

Summary

You limit load during warm-up not to “be slow” - but to let the system reach a state where it can actually work.

Warm is a working state. Cold is a transition stage.

Systems that fail at startup don’t fail because of a lack of power - they fail because of a lack of patience.