background preloader

Distributed Storing & Compute Platforms

Facebook Twitter

Towards a Distributed Internet. In preparation for the Contact conference that I am helping to organize this October in NYC, I’ve been in discussion with many different communities about the types of initiatives they would like to bring to the table.

Towards a Distributed Internet

The purpose of the event is to ‘realize the true potential of social media,’ and determine what infrastructures need to be in place to enable peer-to-peer commerce, culture, and governance. My goal is to help facilitate these conversations now, so that come October, there is already a higher level of awareness and understanding of these issues, and more connections between groups working on similar objectives.

To that end, one of the conversation threads that has begun, with the help of Paul B. Hartzog, Richard C. Adler, and Sam Rose of the Future Forward Institute, is: Cloud Computing Patterns. I have attended a presentation by Simon Guest from Microsoft on their cloud computing architecture.

Cloud Computing Patterns

Although there was no new concept or idea introduced, Simon has provided an excellent summary on the major patterns of doing cloud computing. I have to admit that I am not familiar with Azure and this is my first time hearing a Microsoft cloud computing presentation. I felt Microsoft has explained their Azure platform in a very comprehensible way. I am quite impressed. The Hadoop Distributed File System. Introduction to Hadoop Dell. The Hadoop Distributed Filesystem: Balancing Portability and Performance. Nobody ever got fired for using Hadoop on a cluster. Storm: Distributed and Fault-tolerant Real-time Computation.

Storm Distributed and fault-tolerant realtime computation. S4 Distributed Stream Computing Platform. Dynamo Amazon's Highly Available Key-value Store. Bigtable: A Distributed Storage System for Structured Data. VoltDB NewSQL (vs NoSQL or OldSQL) An Inside Look at Google BigQuery. Spanner Google's Globally Distributed Database. H-Store: A High-Performance, Distributed Main Memory TPS. Scalable SQL and NoSQL DataStores.