compute farms-master-slave pattern

TwitterFacebook
Get flash to fully experience Pearltrees

Globus Toolkit

The Globus Toolkit , currently at version 5, is an open source toolkit for building computing grids developed and provided by the Globus Alliance . http://en.wikipedia.org/wiki/Globus_Toolkit
http://en.wikipedia.org/wiki/Simple_Linux_Utility_for_Resource_Management Simple Linux Utility for Resource Management ( SLURM ) is an open source job scheduler used by many of the world's supercomputers and computer clusters . It provides three key functions.

Simple Linux Utility for Resource Management

Load Sharing Facility (or simply LSF ) is a commercial computer software, job scheduler sold by Platform Computing .

Platform LSF

http://en.wikipedia.org/wiki/Platform_LSF
The European Grid Infrastructure (EGI) is a series of efforts to provide access to high-throughput computing resources across Europe using grid computing techniques. [ 1 ] The EGI links centres in different European countries to support international research in many scientific disciplines. Following a series of research projects such as DataGrid and Enabling Grids for E-sciencE , the EGI.eu organization was formed in 2010 to sustain the services of the EGI. [ 2 ]

Enabling Grids for E-sciencE

http://en.wikipedia.org/wiki/European_Grid_Infrastructure

Xgrid

http://en.wikipedia.org/wiki/Xgrid Xgrid is a proprietary program and distributed computing protocol developed by the Advanced Computation Group subdivision of Apple Inc that allows networked computers to contribute to a single task. It provides network administrators a method of creating a computing cluster , which allows them to exploit previously unused computational power for calculations that can be divided easily into smaller operations, such as Mandelbrot maps .
GridWay [ 1 ] is an open source meta-scheduling technology that enables large-scale, secure, reliable and efficient sharing of computing resources (clusters, computing farms, servers, supercomputers...), managed by different Distributed Resource Management Systems (DRMS), such as SGE , Condor , PBS or LSF , within a single organization (enterprise grid) or scattered across several administrative domains (partner or supply-chain grid). To this end, GridWay supports several Grid middlewares. http://en.wikipedia.org/wiki/GridWay

GridWay

http://en.wikipedia.org/wiki/Portable_Batch_System

Portable Batch System

Portable Batch System (or simply PBS ) is the name of computer software that performs job scheduling .
http://en.wikipedia.org/wiki/DRMAA DRMAA or Distributed Resource Management Application API is a high-level Open Grid Forum API specification for the submission and control of jobs to a Distributed Resource Management (DRM) system, such as a Cluster or Grid computing infrastructure.

DRMAA

Octave - General - running octave in a distributed/compute farm environment

http://octave.1599824.n4.nabble.com/running-octave-in-a-distributed-compute-farm-environment-td1629145.html There is DRMAA which could be used to integrate software products to batch systems and compute farms: http://en.wikipedia.org/wiki/DRMAA
Oracle acquired Sun in 2010, and since that time Oracle's hardware and software engineers have worked side-by-side to build fully integrated systems and optimized solutions designed to achieve performance levels that are unmatched in the industry.

Technical Compute Farm Whitepaper - Improving the Business of Technical Computing

Building a Compute Farm

Posted by daniel on April 21, 2005 at 10:50 AM PDT

Compute Farm Management | SPK and Associates

Most companies take advantage of shared compute power, and Engineering organizations are key users of this resource.