compute farms-master-slave pattern

TwitterFacebook
Get flash to fully experience Pearltrees

Globus Toolkit - Wikipedia, the free encyclopedia

The Globus Toolkit , currently at version 5, is an open source toolkit for building computing grids developed and provided by the Globus Alliance . http://en.wikipedia.org/wiki/Globus_Toolkit
http://en.wikipedia.org/wiki/Simple_Linux_Utility_for_Resource_Management Simple Linux Utility for Resource Management (or simply SLURM ) is an open-source job scheduler used by many of the world's supercomputers and computer clusters. It provides three key functions.

Simple Linux Utility for Resource Management - Wikipedia, the free encyclopedia

LoadLeveler is a job scheduler written by IBM , to control scheduling of batch jobs . LoadLeveler matches the job requirements with the best available computer resource for execution. It was primarily available only for AIX operating system , however it is now also available for IBM POWER and X86 architecture Linux systems.

IBM Tivoli Workload Scheduler LoadLeveler - Wikipedia, the free encyclopedia

http://en.wikipedia.org/wiki/IBM_Tivoli_Workload_Scheduler_LoadLeveler
Load Sharing Facility (or simply LSF ) is a commercial computer software, job scheduler sold by Platform Computing .

Platform LSF - Wikipedia, the free encyclopedia

http://en.wikipedia.org/wiki/Platform_LSF
The European Grid Infrastructure (EGI) refers to a series of efforts to provide access to high-throughput computing resources across Europe using grid computing techniques. [ 1 ] The EGI links centres in different European countries to support international research in many scientific disciplines. Following a series of research projects such as DataGrid and Enabling Grids for E-sciencE , the EGI.eu organization was formed in 2010 to sustain the services of the EGI. [ 2 ]

Enabling Grids for E-sciencE - Wikipedia, the free encyclopedia

http://en.wikipedia.org/wiki/European_Grid_Infrastructure

Xgrid - Wikipedia, the free encyclopedia

http://en.wikipedia.org/wiki/Xgrid Xgrid is a proprietary program and distributed computing protocol developed by the Advanced Computation Group subdivision of Apple Inc that allows networked computers to contribute to a single task. It provides network administrators a method of creating a computing cluster , which allows them to exploit previously unused computational power for calculations that can be divided easily into smaller operations, such as Mandelbrot maps .
GridWay [ 1 ] is an open source meta-scheduling technology that enables large-scale, secure, reliable and efficient sharing of computing resources (clusters, computing farms, servers, supercomputers...), managed by different Distributed Resource Management (DRM) systems, such as Sun Grid Engine , Condor , PBS , Load Sharing Facility ..., within a single organization (enterprise grid) or scattered across several administrative domains (partner or supply-chain grid). To this end, GridWay supports several Grid middlewares. http://en.wikipedia.org/wiki/GridWay

GridWay - Wikipedia, the free encyclopedia

http://en.wikipedia.org/wiki/Portable_Batch_System

Portable Batch System - Wikipedia, the free encyclopedia

Portable Batch System (or simply PBS ) is the name of computer software that performs job scheduling .

Condor High-Throughput Computing System - Wikipedia, the free encyclopedia

http://en.wikipedia.org/wiki/Condor_High-Throughput_Computing_System Condor is an open source high-throughput computing software framework for coarse-grained distributed parallelization of computationally intensive tasks. [ 1 ] It can be used to manage workload on a dedicated cluster of computers , and/or to farm out work to idle desktop computers — so-called cycle scavenging .
http://en.wikipedia.org/wiki/DRMAA DRMAA or Distributed Resource Management Application API is a high-level Open Grid Forum API specification for the submission and control of jobs to a Distributed Resource Management (DRM) system, such as a Cluster or Grid computing infrastructure.

DRMAA - Wikipedia, the free encyclopedia

Octave - General - running octave in a distributed/compute farm environment

> > Chi Chan wrote: > > Hello, > > > > I am wondering if octave is integrated with compute farm systems like SGE? > > http://gridengine.sunsource.net/ > > > > What I am looking for is something like the 'MATLAB Distributed > > Computing Engine', but I would like to use open source solutions, > > proprietary and legacy systems like LSF are out of the question for my > > need :( > > > > --Chi > > > > I think its a might be really interesting project, and maybe you should > inspire someone to start working in that direction. > > I think Octave has some MPI-bindings, and multicore package in octave-forge. > > > -Muthu > >
Oracle acquired Sun in 2010, and since that time Oracle's hardware and software engineers have worked side-by-side to build fully integrated systems and optimized solutions designed to achieve performance levels that are unmatched in the industry.

Technical Compute Farm Whitepaper - Improving the Business of Technical Computing

Building a Compute Farm | Java.net

The idea of a distributed "job jar" is very attractive.

Compute Farm Management | SPK and Associates

Most companies take advantage of shared compute power, and Engineering organizations are key users of this resource.
ANAHEIM, Calif. — Because of the large nature that EDA represents, EDA vendors are some of the pioneers of using compute-farms. This raises a question on the probability that these help make progress in the general parallel programming problem.

eetimes