Cluster

TwitterFacebook
Get flash to fully experience Pearltrees

Several Solutions for Queue & Worker Systems

Almost every dating site we’ve built has a job queue of some kind. We enqueue email sends, statistic updates, logging, fraud detection and more. Anything that doesn’t immediately impact the response we’re preparing for the user can be run in the background. http://architects.dzone.com/articles/several-solutions-queue-worker

Gone Fishin': Building Super Scalable Systems: Blade Runner Meets Autonomic Computing In The Ambient Cloud

All in all this is still my favorite post and I still think it's an accurate vision of a future. Not everyone agrees, but I guess we'll see... http://highscalability.com/blog/2012/11/5/gone-fishin-building-super-scalable-systems-blade-runner-mee.html
Galaxy is a high-performance in-memory data-grid (IMDG) that can serve as a basis for building distributed applications that require fine-tuned control over data placement and/or custom distributed data-structures. http://puniverse.github.com/galaxy/

Home | Galaxy

The Perils of Asynchrony

Every time you come across anything more than a rudimentary system that has some moderately serious performance needs, someone somewhere on the team considers using asynchronous processing to help reduce (perceived) response time. That person needs to be identified and quickly locked in a padded room . . . . http://java.dzone.com/articles/perils-asynchrony

In Memory Data Grid Technologies

http://highscalability.com/blog/2011/12/21/in-memory-data-grid-technologies.html After winning a CSC Leading Edge Forum (LEF) research grant, I (Paul Colmer) wanted to publish some of the highlights of my research to share with the wider technology community.
For most Architects, "Scale" is the most illusive aspect of software architectures. Not surprisingly, it is also one of the most sort-out goals of todays software design. http://srinathsview.blogspot.com/2011/10/list-of-known-scalable-architecture.html

Srinath's Blog :My views of the World: List of Known Scalable Architecture Templates

We've asked What The Heck Are You Actually Using NoSQL For? . http://highscalability.com/blog/2011/6/20/35-use-cases-for-choosing-your-next-nosql-database.html

35+ Use Cases for Choosing Your Next NoSQL Database

Hazelcast

No SQL ?

Over the last couple years, we see an emerging data storage mechanism for storing large scale of data.

NOSQL Patterns

http://cloud.dzone.com/news/nosql-patterns
Filesystem

Brewer's CAP Theorem

http://www.julianbrowne.com/article/viewer/brewers-cap-theorem On Friday 4th June 1976, in a small upstairs room away from the main concert auditorium, the Sex Pistols kicked off their first gig at Manchester's Lesser Free Trade Hall . There's some confusion as to who exactly was there in the audience that night, partly because there was another concert just six weeks later, but mostly because it's considered to be a gig that changed western music culture forever. So iconic and important has that appearance become that David Nolan wrote a book, I Swear I Was There: The Gig That Changed the World , investigating just whose claim to have been present was justified.

Clustering with the Shoal Framework

http://today.java.net/article/2007/12/07/clustering-shoal-framework Shoal is an open source, Java-based generic clustering framework. It can be used in

TIBCO Silver™

Cloud computing brings both performance and cost benefits to the enterprise: self-service capabilities, task automation, resource pooling, demand aggregation, and application elasticity.
As a mature and proven distributed computing technology, Ice provides a host of solutions for accelerating the development and deployment of large-scale distributed applications, including a secure router and bidirectional protocol for firewall traversal, and a data distribution service. IceGrid is a service that expedites the creation of a new class of applications. Grid computing has become increasingly more important to mainstream information technology endeavors as large SMP servers are replaced by many networked commodity servers.

IceGrid

Running Hadoop On Ubuntu Linux (Single-Node Cluster) @ Michael G. Noll

In this tutorial I will describe the required steps for setting up a pseudo-distributed, single-node Hadoop cluster backed by the Hadoop Distributed File System, running on Ubuntu Linux.

Shoal Java Clustering Framework Overview — Project Kenai

Shoal – A Generic Clustering Framework About Shoal Framework

Java Fast Sockets: Enabling high-speed Java communications on high performance clusters

If you've ever tried to write a high-performance Java program that does network communication you know that it's hard to do this in an efficient manner.

Hadoop Study Reveals Usage Stats, Benefits, and Challenges

What does everyone think of this article?

I have a question:
In a datacenter for a big website company like Google, do they depend completely on clustering to build their computer infrastructure. Also anybody has any idea about their clustering software that they use. I know they use Hadoop, but they run than on top of already clustered machines running lunix. Hadoop works on clustered machines, but doesn't perform clustering. Any thoughts about that? by khalaf Feb 4

Distributed caching

Scalability

You would have to research more material on Google's infrastructure. My understanding is that the are using their own "Big table", and that hadoop is an opensource implementation based on the same research papers. I don't think they are clustering at the linux level. by alexis Feb 4

What does everyone think of this article?

I have a question:
In a datacenter for a big website company like Google, do they depend completely on clustering to build their computer infrastructure. Also anybody has any idea about their clustering software that they use. I know they use Hadoop, but they run than on top of already clustered machines running lunix. Hadoop works on clustered machines, but doesn't perform clustering. Any thoughts about that? by khalaf Feb 4

Tiens tiens tiens, mais ca bouge dans ce pearltree :) by nicolas Jan 6