background preloader

High Traffic / Availability

Facebook Twitter

Bitly/nsq. 5 Common Server Setups For Your Web Application. Introduction When deciding which server architecture to use for your environment, there are many factors to consider, such as performance, scalability, availability, reliability, cost, and ease of management.

5 Common Server Setups For Your Web Application

Here is a list of commonly used server setups, with a short description of each, including pros and cons. Keep in mind that all of the concepts covered here can be used in various combinations with one another, and that every environment has different requirements, so there is no single, correct configuration. 1. Everything On One Server The entire environment resides on a single server. Use Case: Good for setting up an application quickly, as it is the simplest setup possible, but it offers little in the way of scalability and component isolation. Pros: Simple Cons: Related Tutorials: How To Install LAMP On Ubuntu 14.04 2. Use Case: Good for setting up an application quickly, but keeps application and database from fighting over the same system resources. Rhavyn/norbert. Www.datastax.com/wp-content/uploads/2013/02/WP-Benchmarking-Top-NoSQL-Databases.pdf. Postrank-labs/goliath.

Benchmarking Cassandra Scalability on AWS - Over a million writes per second. By Adrian Cockcroft and Denis Sheahan Netflix has been rolling out the Apache Cassandra NoSQL data store for production use over the last six months.

Benchmarking Cassandra Scalability on AWS - Over a million writes per second

As part of our benchmarking we recently decided to run a test designed to validate our tooling and automation scalability as well as the performance characteristics of Cassandra. Adrian presented these results at the High Performance Transaction Systems workshop last week. We picked a write oriented benchmark using the standard Cassandra "stress" tool that is part of the product, and Denis ran and analyzed the tests on Amazon EC2 instances. Writes stress a data store all the way to the disks, while read benchmarks may only exercise the in-memory cache. To measure scalability, the same test was run with 48, 96, 144 and 288 instances, with 10, 20, 30 and 60 clients respectively. EC2 Configuration All instances are created using the EC2 auto-scaler feature. Using HAProxy to Build a More Featureful Elastic Load Balancer - Sharing the Tech. Though Shareaholic is hosted in the AWS cloud, we avoid depending on Amazon’s virtualized cloud services whenever possible.

Using HAProxy to Build a More Featureful Elastic Load Balancer - Sharing the Tech

If we ever hit a bottleneck in AWS, I want to be able to switch providers without needing to rebuild a core piece of our architecture. I also don’t want our tech team to have to make product and infrastructure sacrifices just so that we conform to AWS standard practices. Load balancing with HAProxy was the first example of a service that Amazon provides, that we felt was better to manage ourselves. Here’s how we did it. Why HAProxy? I’ve used HAProxy nonstop since 2009, and to date it has never been the culprit of a single problem I’ve experienced. It provides both HTTP and TCP load balancing, and a powerful feature set not found in Amazon’s ELB.

Monitoring HAProxy provides a dashboard with global stats, server stats, and aggregate stats for each frontend and backend. (Mouseover the image for the spoiler). Configurability. Tutorial: MySQL Load Balancing with HAProxy. 1.

Tutorial: MySQL Load Balancing with HAProxy

Introduction Applications would typically connect to a database cluster by opening connections on one of the nodes in order to run transactions. If the database node fails, the client would need to reconnect to another database node before it can continue to serve requests. There are different ways to provide connectivity to one or more database servers. One way is to use a database driver that supports connection pooling, e.g. JDBC driver: PHP driver: However, in Galera Cluster for MySQL, the JDBC and PHP drivers are not aware of internal Galera state information. HAProxy - The Reliable, High Performance TCP/HTTP Load Balancer. Netflix (Netflix, Inc.) Benchmarking Cassandra Scalability on AWS - Over a million writes per second. By Adrian Cockcroft and Denis Sheahan Netflix has been rolling out the Apache Cassandra NoSQL data store for production use over the last six months.

Benchmarking Cassandra Scalability on AWS - Over a million writes per second

As part of our benchmarking we recently decided to run a test designed to validate our tooling and automation scalability as well as the performance characteristics of Cassandra. Adrian presented these results at the High Performance Transaction Systems workshop last week. We picked a write oriented benchmark using the standard Cassandra "stress" tool that is part of the product, and Denis ran and analyzed the tests on Amazon EC2 instances. Writes stress a data store all the way to the disks, while read benchmarks may only exercise the in-memory cache. To measure scalability, the same test was run with 48, 96, 144 and 288 instances, with 10, 20, 30 and 60 clients respectively.

EC2 Configuration All instances are created using the EC2 auto-scaler feature. Protobuf - Protocol Buffers - Google's data interchange format. What is it?

protobuf - Protocol Buffers - Google's data interchange format

Protocol Buffers are a way of encoding structured data in an efficient yet extensible format. Google uses Protocol Buffers for almost all of its internal RPC protocols and file formats. Latest Updates Documentation Read the documentation. Discussion Visit the discussion group. Quick Example. Netty: Home. Apache ZooKeeper - Home. Rhavyn/norbert. Rhavyn/norbert.