KIT Configuration

Monitoring

  • monitoring of running mcore jobs: http://web-kit.gridka.de/monitoring/mcore.php
    • efficiency plots show the CPU time over the reserved usage time, i.e., job wall time scaled by the number of assigned cores; for efficient job the ratio is near 1.
  • SGE v###

jdl to SGE

  • number of cores is evaluated from parameter CpuNumber = NOCORES;

  • created parallel environment (PE) with dynamic cores
    • PE configuration
      Executable = "/path/to/my/workload.sh";
      StdOutput = "myjob.out";
      StdError = "myjob.err";
      OutputSandbox = {"myjob.out", "myjob.err"};
      OutputSandboxBaseDestURI = "gsiftp://localhost";
      CpuNumber = 4;
      CERequirements = "other.GlueCEPolicyMaxWallClockTime > 31";
      

  • translation to GridEngine handled by {/usr/libexec/}sge_local_submit_attributes.sh
  • times in jdl are minutes (GlueScheme ###) and are converted to seconds for Grid

  • reservations (draining nodes for multi core jobs) need to be enabled in addition
    • '-R y' flag enabling reservations is not added by 'sge_submit.sh'
    • current workaround is running 'qalter -R y $list_of_mc_jobs' by a cron

CREAM

  • jdl parameters for wall/clock times are evaluated
    • CERequirements = "other.GlueCEPolicyMaxWallClockTime > MAXWALLTIME"
    • CERequirements = "other.GlueCEPolicyMaxCPUTime > MAXCPUTIME"
      • C-like syntax for combining requirements CERequirements = "other.GlueCEPolicyMaxWallClockTime > MAXWALLTIME && other.GlueCEPolicyMaxCPUTime > MAXCPUTIME"
    • ">" interpreted as upper limit

Questions

  • parameter "Requirement" singular, "CERequirements" is plural (no idea, if "Requirement" is actually used at some point. According to some documentation online it should be "Requirements"; what is the difference between Requirement(s) and CERequirements, what is used? From experiences: CERequirements. What schema version was/is "Requirement(s)"??)

Links

Edit | Attach | Watch | Print version | History: r2 < r1 | Backlinks | Raw View | WYSIWYG | More topic actions
Topic revision: r2 - 2014-11-07 - ThomasHartmann
 
    • Cern Search Icon Cern Search
    • TWiki Search Icon TWiki Search
    • Google Search Icon Google Search

    LCG All webs login

This site is powered by the TWiki collaboration platform Powered by PerlCopyright & 2008-2019 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding TWiki? Send feedback