TWiki> LCG Web>WLCGGDBDocs>BatchSystemComparison (revision 31)EditAttachPDF

Batch Systems Comparison

Work in progress, under construction Work in progress, feedback welcome.

FunctionalitySorted ascending Torque/Maui SLURM HTCondor USGE/SoGE LSF
APEL support Cream   ARC-CE yes yes
ARC-CE integration full full full full full
Cgroup support no full support cpu & memory waiting for a patch full
Command line tools HELP custom commands custom commands, pbs like wrappers custom commands custom commands custom commands
Community Support yes for torque yes through slurm-dev list yes through the HTCondor-users list no/? no
Comunity puppet module yes no yes no wrote our own
Configuration easiness   yes with puppet yes yes yes
Cream integration partial partial partial full full
Dcumentation Good Good Good less than satisfying/? Good
Developer Support maui not supported yes yes yes yes
Distribution format source, rpm source source, rpm, tarball tarball tarball
Efficient Backfilling tunable tunable not out-of-the-box, but similar behaviour can probably be configured yes yes
Fairshares yes yes yes yes yes
Getting arguments from CE ARC-CE/Cream if site writes blah script ARC-CE ARC-CE ARC-CE/Cream if site writes blah script ARC-CE/Cream if site writes blah script
Hierarchical Fairshares   yes yes yes yes
High Availability no head node failover central manager & job queue failover head node failover head node failover
Info System support HELP Cream Cream no Cream Cream
Installation easiness yes without DB yes yes yes yes
IPv6 support no no yes, with limitations no yes
Licenses/Costs free free free Univa/free IBM
Limits configurable standard + custom fully configurable fully configurable fully configurable
Min Num config files 3 on head, 1 on WN 1 shared (+DB for fairshares) 2 default can be split in /etc/condor/config.d DB or a bunch of filesmanaged with GE tools 10 on master, 1 on WN
Min Num daemons 2 Master / 1 WNs 1 Master / 1 WNs (without DB for fairshares) 4 Master / 2 WNs 1...3 Master / 1 WNs 10 master / 5 WNs
Multicluster no yes yes (flocking, job router) yes yes
Number of sites HELP 90 11 15 16 7
Partitioning reservations yes, can overlap fully configurable fully configurable fully configurable
Priorities configurable based on fairshare job, user & group priorities yes user, group, queue priorities
Queues yes no can use accounting groups to produce similar functionailty yes yes
Requires DB no yes for advanced features no optional no
Requires shared FS no yes according to the manual no yes according to the manual but files can also be distributed across the cluster no
Scalability no Debated. Probably depending on the hardware type (HPC vs HTC) as much as the configuration of the DB and plug-ins. yes yes 6500 nodes
Stability low high high high high
Wholenode/multicore yes yes yes yes yes

HELP Number of sites: is an approximate number extracted from BDII summing T1 and T2 no distinction between varieties (SGE*, PBS*). Last updated on the 19/6/2015.
HELP Info system support: IS responsibility Matrix
HELP Command line tools: different batch systems commands comparison (HTcondor missing).

Other comparison documents

CESGA Torque/MAUI,SGE,SLURM comparison document

-- AlessandraForti - 13 Mar 2014

Edit | Attach | Watch | Print version | History: r37 | r33 < r32 < r31 < r30 | Backlinks | Raw View | Raw edit | More topic actions...
Topic revision: r31 - 2015-07-02 - AlessandraForti
    • Cern Search Icon Cern Search
    • TWiki Search Icon TWiki Search
    • Google Search Icon Google Search

    LCG All webs login

This site is powered by the TWiki collaboration platform Powered by PerlCopyright & 2008-2022 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
or Ideas, requests, problems regarding TWiki? use Discourse or Send feedback