KIT Configuration


  • monitoring of running mcore jobs:
    • efficiency plots show the CPU time over the reserved usage time, i.e., job wall time scaled by the number of assigned cores; for efficient job the ratio is near 1.
  • SGE v###

jdl to SGE

  • number of cores is evaluated from parameter CpuNumber = NOCORES;

  • created parallel environment (PE) with dynamic cores
    • PE configuration
      Executable = "/path/to/my/";
      StdOutput = "myjob.out";
      StdError = "myjob.err";
      OutputSandbox = {"myjob.out", "myjob.err"};
      OutputSandboxBaseDestURI = "gsiftp://localhost";
      CpuNumber = 4;
      CERequirements = "other.GlueCEPolicyMaxWallClockTime > 31";

  • translation to GridEngine handled by {/usr/libexec/}
  • times in jdl are minutes (GlueScheme ###) and are converted to seconds for Grid

  • reservations (draining nodes for multi core jobs) need to be enabled in addition
    • '-R y' flag enabling reservations is not added by ''
    • current workaround is running 'qalter -R y $list_of_mc_jobs' by a cron


  • jdl parameters for wall/clock times are evaluated
    • CERequirements = "other.GlueCEPolicyMaxWallClockTime > MAXWALLTIME"
    • CERequirements = "other.GlueCEPolicyMaxCPUTime > MAXCPUTIME"
      • C-like syntax for combining requirements CERequirements = "other.GlueCEPolicyMaxWallClockTime > MAXWALLTIME && other.GlueCEPolicyMaxCPUTime > MAXCPUTIME"
    • ">" interpreted as upper limit


  • parameter "Requirement" singular, "CERequirements" is plural (no idea, if "Requirement" is actually used at some point. According to some documentation online it should be "Requirements"; what is the difference between Requirement(s) and CERequirements, what is used? From experiences: CERequirements. What schema version was/is "Requirement(s)"??)


Edit | Attach | Watch | Print version | History: r2 < r1 | Backlinks | Raw View | WYSIWYG | More topic actions
Topic revision: r2 - 2014-11-07 - ThomasHartmann
    • Cern Search Icon Cern Search
    • TWiki Search Icon TWiki Search
    • Google Search Icon Google Search

    LCG All webs login

This site is powered by the TWiki collaboration platform Powered by PerlCopyright & 2008-2023 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
or Ideas, requests, problems regarding TWiki? use Discourse or Send feedback