ORIGINAL SYSTEM DESIGN QUESTION
Versioned API gateway routing
Route requests to services with per-route authentication, timeouts and canary versions.
Original exercise · foundation. Editorial role relevance does not imply a company has asked this question.
Requirements and constraints
- 30,000 peak requests/second; 200 backend services.
- Retries must not duplicate non-idempotent mutations.
- State assumptions and justify security, cost, operational ownership and data retention.
Pressure round
A canary fails while old routes remain healthy.
Build and explain the design
Requirements & scope
Who uses it? What must it do? What is explicitly out of scope? State latency, durability and privacy goals.
Self-review guidance
Define the actors, required operations and out-of-scope behavior. Explicit requirement: Retries must not duplicate non-idempotent mutations.
Capacity estimates
State assumptions, peak requests/second, data volume and retention. Show your arithmetic and units.
Self-review guidance
Use this workload: 30,000 peak requests/second; 200 backend services. Convert rates and payload sizes into peak compute/storage assumptions; show units, headroom and what remains unmeasured.
APIs & data model
Describe endpoints/events, entity keys, indexes, authorization, and idempotency.
Self-review guidance
Define route versions, retry eligibility, identity forwarding and timeout budgets.
Architecture & data flow
Describe components and request/event paths. Use plain text arrows to sketch your design; explain each responsibility.
Self-review guidance
Use atomic config distribution and bounded upstream connection pools.
Failures & observability
What happens on overload, duplicate events, partial failures or lost dependencies? Discuss monitoring and recovery.
Self-review guidance
Pressure-test: A canary fails while old routes remain healthy. Describe bounded recovery, deduplication, observability and a user-visible failure state.
Tradeoffs & alternatives
Compare two plausible approaches. State the costs, consistency model and what would make you change the design.
Self-review guidance
Compare gateway retries with client retries and request-budget propagation.
Design guidance describes assumptions and tradeoffs; no architecture has been simulated or benchmarked.
Practice this question
Save your work privately, explain decisions and return to your revision queue.
Open practice workspaceBrowse the question library →