GFS

Big Table

MapReduce

Spark

Design Twitter, Instgram (News Feed, Timeline, Social Graph)

Google Doc

Typeahead

Web Crawler

Design User System

Tiny URL

Rate Limiter

WhatsApp

ds

• hot spot
• fault tolerance, replica
• load balance
• partition, consistent hashing
• single point failure, master fail
• cache

projects:

why column storage

why noql

how to partition

Guidelines

Scenario

• Features / QPS / DAU / interfaces

Service

• Split into Applications / Modules / Micro-services

Storage

• Schema / SQL / NoSQL / File System

Scale

• Sharding / Partition / Optimize / Special Cases