Status of Batch System support on CREAM

Warning: this page is outdated

This page tracks the status of batch system support on the CREAM CE.

Acceptance criteria

The SA1 strategy for the transition from LCG-CE to CREAM CE lists a number of acceptance criteria that will have to be met before the transition can be started. Some of these criteria relate to batch system support. These are:

See also This table by Nick Thackray.

Summarily, the current state could be described as follows:

  • the integration of batch systems for CREAM seems to be well underway
  • there are no conclusive performance figures available yet.

Batch system integration

(Main page: BatchSystems).

Integration of a batch system with CREAM involves mainly the BLAH scripts (for submit, cancel, status, hold, resume of jobs). According to the Installation and Configuration guide, the production version of CREAM/BLAH only supports Torque, LSF and Condor.

The blah CVS has incorporated the BLAH scripts for Torque, LSF, Condor and SGE, so a future release will likely have support for all of these systems.

Documentation for integrating other batch systems

This documentation is currently in the works, part of task #8921, to appear in this Wiki as CreamLRMSCookBook. There is a (postponed) task #8494 assigned to INFN for general support; the BLAH guide proves to be very useful.

Certification

Torque

Condor

Condor integration is done by PIC, and certification by Nikhef. Condor_utils is in no longer in PreProduction ... There should be a new task ASAP.

-- DVanDok - 23 Apr 2009

SGE

Integration work for SGE is underway, by CESGA. See savannah task #9126. Planned to be done in about a month. Who is doing certification?

Performance testing

  • Russian partners in SA3 have a test infrastructure to do performance tests.
  • There is a postponed task for benchmarking CREAM assigned to GRNET. task #8302

There is no task assigned to this at the moment.

Some preliminary findings indicate that CREAM is using a lot of CPU power under load. https://savannah.cern.ch/patch/?2669#comment28

See also https://twiki.cern.ch/twiki//bin/view/EGEE/CEStressTesting.

-- DVanDok - 05 Feb 2009

Edit | Attach | Watch | Print version | History: r8 < r7 < r6 < r5 < r4 | Backlinks | Raw View | WYSIWYG | More topic actions
Topic revision: r8 - 2010-02-11 - Dennisvd
 
    • Cern Search Icon Cern Search
    • TWiki Search Icon TWiki Search
    • Google Search Icon Google Search

    EGEE All webs login

This site is powered by the TWiki collaboration platform Powered by Perl This site is powered by the TWiki collaboration platformCopyright & by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding TWiki? Ask a support question or Send feedback