background preloader

Distributed Storing & Compute Platforms

Facebook Twitter

Towards a Distributed Internet. In preparation for the Contact conference that I am helping to organize this October in NYC, I’ve been in discussion with many different communities about the types of initiatives they would like to bring to the table. The purpose of the event is to ‘realize the true potential of social media,’ and determine what infrastructures need to be in place to enable peer-to-peer commerce, culture, and governance. My goal is to help facilitate these conversations now, so that come October, there is already a higher level of awareness and understanding of these issues, and more connections between groups working on similar objectives.

To that end, one of the conversation threads that has begun, with the help of Paul B. Hartzog, Richard C. Adler, and Sam Rose of the Future Forward Institute, is: What are the fundamental requirements and building blocks of a distributed internet? Is a ‘distributed internet’ one thing or many things (one internet or many internets?) And so on.

Like this: Like Loading... Cloud Computing Patterns. I have attended a presentation by Simon Guest from Microsoft on their cloud computing architecture. Although there was no new concept or idea introduced, Simon has provided an excellent summary on the major patterns of doing cloud computing. I have to admit that I am not familiar with Azure and this is my first time hearing a Microsoft cloud computing presentation. I felt Microsoft has explained their Azure platform in a very comprehensible way. I am quite impressed. Simon talked about 5 patterns of Cloud computing. Let me summarize it (and mix-in a lot of my own thoughts) ... 1. Passive listener model uses a synchronous communication pattern where the client pushes request to the server and synchronously wait for the processing result.

In the passive listener model, machine instances are typically sit behind a load balancer. 2. UI brandingBusiness rules for decision criteriaData schema The approach is to provide sufficient "customization" capability for their customer. 3. 4. 5. The Hadoop Distributed File System. Introduction to Hadoop Dell. The Hadoop Distributed Filesystem: Balancing Portability and Performance. Nobody ever got fired for using Hadoop on a cluster. Storm: Distributed and Fault-tolerant Real-time Computation. Storm Distributed and fault-tolerant realtime computation. S4 Distributed Stream Computing Platform. Dynamo Amazon's Highly Available Key-value Store. Bigtable: A Distributed Storage System for Structured Data. VoltDB NewSQL (vs NoSQL or OldSQL) An Inside Look at Google BigQuery.

Spanner Google's Globally Distributed Database. H-Store: A High-Performance, Distributed Main Memory TPS. Scalable SQL and NoSQL DataStores.