Back of the Envelope Estimation

Back-of-the-envelope calculations are rough, quick estimates used to gauge how much infrastructure, bandwidth, or storage your system might need before doing detailed planning.

Think of it as engineering intuition: you don't need precise numbers, just enough to make decisions and sanity-check feasibility.

Why It's Important

When scaling systems to millions of users:

• You need to know how many servers you might need.
• You need to know how much bandwidth or storage to provision.
• You need to know if your architecture can handle peak loads.

BoE estimations allow you to answer these questions quickly, without waiting for detailed load testing or simulations.

Power of Two

In computer systems, most resources – memory, storage, network buffers – are organized in powers of two:

1, 2, 4, 8, 16, 32, 64, 128,…

This is because binary systems in computers naturally allocate memory and storage blocks of 2^n.

Why Powers of Two Are Useful in BoE

1. Rough estimation is easier
   1. Instead of calculating exact numbers, rounding to the nearest power of two gives a good approximation.
   2. Example: If you need 3,000 users per DB shard, estimate 4,096 users per shard -> simplifies planning.
2. Memory alignment
   1. Most RAM and disk blocks are sized in powers of two (e.g., 4 KB pages).
   2. Estimating in powers of two avoids underestimating resource needs.
3. Network and bandwidth calculations
   1. Buffers, packet sizes, and throughput often scale in powers of two.
4. Server and cluster scaling
   1. Horizontal scaling often doubles capacity (2, 4, 8, 16 servers) -> fits naturally with powers of two.

Example:

Suppose your back-of-the-envelope calculation shows you need 7 web servers.

• Using powers of two, you round up to 8 servers.
• This makes load balancing and partitioning simpler, and keeps a spare for failover.

Quick Reference of Powers of Two

Queries Per Second (QPS)

The number of queries (read or write) a system (usually a database) received per second.

It's one of the most important metrics in capacity planning because it tells you how much load your database or API needs to handle.

Read queries: Select

Write queries: Insert, Update, and Delete

Storage Units

When building systems that scale to millions of user, you need to estimate how much storage your data will occupy. To do that, it's essential to understand storage units and how they scale.

Common Storage Units