Get flash to fully experience Pearltrees
I went to the Hadoop World conference last week and one thing I took away was how Facebook and other companies handle the problem of scalable logging within their infrastructure. The solution found by Facebook was to write their own logging server software called Scribe (more details on the FB blog ). Scribe is mentioned in one of the best presentations I attended at the conference -- ' Hadoop and Hive Development at Facebook ' by Dhruba Borthakur and Zheng Shao.
Compiling, installing and test-running Scribe
[Thrift] Handling failover and high availability with thriftserv
Hi guys, First of all, we're thrilled to hear you saying that some of this stuff doesn't belong in Thrift. We totally agree. Keeping the core Thrift library super lightweight is one of the main goals, while also designing to make it easy to extend, build support libraries for, or add wrappers/tools for more complicated tasks. To give a little insight into how we do some load-balancing and availability things here: 1/ The PHP TSocketPool is really useful for this. This solves the majority of our availability issues.
Recently, we were fortunate to host Jeff Rothschild, the Vice President of Technology at Facebook, for a visit for the CNS lecture series . Jeff’s talk, “High Performance at Massive Scale: Lessons Learned at Facebook” was highly detailed, providing real insights into the Facebook architecture. Jeff spoke to a packed house of faculty, staff, and students interested in the technology and research challenges associated with running and Internet service at scale.
Presentation Summary “High Performance at Massive Scale: Lessons
Earlier today (or should I say yesterday) I attended Facebook’s Seattle Engineering Road Show which was a part technical talk and part recruiting event where Mike Shroepfer and a number of other Facebook engineers gave a fairly deep technical talk about the technologies used by Facebook. Below are my notes on the presentation and ensuing Q&A session. One thing I found interesting about the talk was how similar their architecture for the platform that powers the Facebook news feed is to what my team has built for powering the Windows Live What's New feed .
facebook engineering interview
scaling Chat Engineering @ Facebook's Notes | Facebook
Almost ten months ago we launched Facebook Chat to 70 million users. We ventured into a lot of new territories with this product: not only were there tricky web design and product issues, we needed to develop and launch a trio of new backend services to support all of Chat's functionality. Eugene wrote a great post detailing the inner workings of Chat, and recently we gave a talk (video: 1 2 3 4 ) about the product from front to back. Since the product's launch last April Facebook has grown to over 175 million active users, and more than two-thirds of them have used Chat.
Ivan Sutherland elaborates on the idea of a “prison” defined by sequential computers that work with sequential character strings making communication expensive and obstructing concurrency. Ross Cooney presents a case study of how Smith Electric Vehicles uses StormMQ in production. StormMQ is a cloud-based provider of secure AMQP services. Dennis Stevens discusses the theory of Agile, providing references for using Agile in the enterprise along with a competency model, and overviewing an enterprise Agile transformation. Ryan Slobojan discusses how to perform issue tracking, code review, commits and builds in an automated manner by integrating Git, Gerrit, Hudson and Mylyn. Dave McCrory explains how Cloud Foundry works, demoing setting up and running an application on it and Micro Cloud Foundry, and using the services available in VMware’s cloud.
Scale at Facebook
Facebook: Moving Fast at Scale
Basic best practices for Grails projects gathered from mailing list, Stack Overflow, blogs, podcasts and internal discussions at IntelliGrape, categorized under controller, service, domain, views... We interviewed Steven Renders, author of Microsoft Dynamics NAV 2009: Professional Reporting, about this popular Enterprise Resource Planning platform. Ivan Sutherland elaborates on the idea of a “prison” defined by sequential computers that work with sequential character strings making communication expensive and obstructing concurrency.
