Scalability

A system's ability to maintain performance as workload increases.

Why it matters

What works for 10 users needs to work for 10,000. Costs should scale linearly, not exponentially.

In practice

At 100 users: $0.35/day LLM cost. At 10,000 users: ~$35/day cost vs ~$49,000 revenue = 99.7% margins.

Related terms

Back to glossary