background preloader

Distributed systems

Facebook Twitter

Microservices

Api gateway. Key value stores. Sharding. "Building Scalable Stateful Services" by Caitie McCaffrey. Storm, distributed and fault-tolerant realtime computation. Interactive Analytics at Scale. Apache Spark™ - Lightning-Fast Cluster Computing. Elastic · Revealing Insights from Data (Formerly Elasticsearch) Apache Kafka. Fallacies.pdf. A plain English introduction to CAP theorem « Kaushik Sathupadi. You’ll often hear about the CAP theorem which specifies some kind of an upper limit when designing distributed systems.

A plain English introduction to CAP theorem « Kaushik Sathupadi

As with most of my other introduction tutorials, lets try understanding CAP by comparing it with a real world situation. Chapter 1: “Remembrance Inc” Your new venture : Last night when your spouse appreciated you on remembering her birthday and bringing her a gift, a strange Idea strikes you. People are so bad in remembering things. And you’re sooo good at it. The Modulith. Much has been written about all the myriad ways to go wrong when writing software.

The Modulith

Poor management; scope creep; too little structure, not modular enough, and it’s a “big ball of mud”. Too much (or too rigid) and it’s a “software crystal”, impossible to alter. And so on. Suppose you get all that right, and actually ship a useful system to users, it solves their problems well enough, and the code is reasonably clean, has a sound design and a modular structure with interface that, while not perfect, work okay.

Disorderly programming for the cloud and other distributed systems. Cidr11-bloom.pdf.