Lzo. Scaling Twitter: Making Twitter 10000 Percent Faster. Update 6: Some interesting changes from Twitter's Evan Weaver: everything in RAM now, database is a backup; peaks at 300 tweets/second; every tweet followed by average 126 people; vector cache of tweet IDs; row cache; fragment cache; page cache; keep separate caches; GC makes Ruby optimization resistant so went with Scala; Thrift and HTTP are used internally; 100s internal requests for every external request; rewrote MQ but kept interface the same; 3 queues are used to load balance requests; extensive A/B testing for backwards capability; switched to C memcached client for speed; optimize critical path; faster to get the cached results from the network memory than recompute them locally.Update 5: Twitter on Scala.
A Conversation with Steve Jenson, Alex Payne, and Robey Pointer by Bill Venners. Twitter started as a side project and blew up fast, going from 0 to millions of page views within a few terrifying months. Twitter scaling. My QCon presentation is available. Improving Running Components at Twitter Some choice Tweets: philwills: Evan Weaver on scaling twitter at #qcon was full of interesting stuff and good questions from audience. markhneedham: fascinating reading these stats about #twitter from Evan Weaver’s talk #qcon jurgenonland: sitting at a presentation from Evan Weaver @ #qcon, wow he must be verry unhappy at his work szegedi: Listening to Evan Weaver talking about Twitter system architecture & tuning.
Learning or not learning Scala/Lift? - Lift.