Transcript
Experiences in web scalability
Thursday, September 17, 2009
Conversational GraphBuildi
ng
Thursday, September 17, 2009
Social Graph
Professional Social Graph
Message Graph
Thursday, September 17, 2009
Thursday, September 17, 2009
Thursday, September 17, 2009
Thursday, September 17, 2009
Database of threaded, platform independent conversations that you can find and track in real time.
Thursday, September 17, 2009
Database of threaded, platform independent conversations that you can find and track in real time.
Aweso
me
Thursday, September 17, 2009
Phase 1The prototype
Thursday, September 17, 2009
Tracking on demandFew friends as users
Thursday, September 17, 2009
2 serversPHP + MySQL
Nothing special
Thursday, September 17, 2009
Problems:•No easy way of distributing the shit on many machines•Crapy database•PHP sucked at things like parallel processes
Thursday, September 17, 2009
Phase 2Beta phase
Thursday, September 17, 2009
Tracking on demand1000 beta users
still
Thursday, September 17, 2009
Amazon serversPython baby
Simple DB
SQS
Thursday, September 17, 2009
Queue (SQS)
Server
Module
Server
Module
Server
Module
…
Database (Simple DB)
Thursday, September 17, 2009
Problems:•The database was slow and expensive•Bad web-app workflow
Thursday, September 17, 2009
Phase 3The API
Thursday, September 17, 2009
stillRestful APIMillions calls/h
Thursday, September 17, 2009
Tokyo Cabinet
Mashery
Thursday, September 17, 2009
Problems:No problems yet
Thursday, September 17, 2009
Phase 4Search
Thursday, September 17, 2009
Tracking the webIndexing millions items/day
Thursday, September 17, 2009
Customized Search engine
Load balancers
Large Amazon servers
Thursday, September 17, 2009
Problems:•Speed -> we need huge machines
Thursday, September 17, 2009
Thursday, September 17, 2009
top related