SGE Docs

Documentation

• Kit SGE Configuration
• QMUL SGE Configuration

CERequirements Handling

based on scripts from BLAH commit 1c80be00b6a7, the bath job submission scripts on CREAMs to SGE is generated by sge_submit.sh; which calls sge_local_submit_attributes.sh to parse CERequirement parameters. The following attributes are translated by sge_local_submit_attributes.sh

GlueCEPolicyMaxWallClockTime 
GlueCEPolicyMaxCPUTime
GlueHostMainMemoryVirtualSiz
GlueHostMainMemoryRAMSize

into submission parameters

s_rss
s_vmem
s_rt
s_cpu

The requirements are of type 'other' and the value assignment to the CERequirements has to be '>' and other operators as '=' or '<' are ignored/skipped. Only one CERequirement assignment is interpreted and multiple requirements have to be linked into one assignment with '&&' operators. Times are assumed to be minutes in the jdl and calculated as seconds for the batch submission

E.g., a job with jdl parameters

...
CpuNumber = 3;
CERequirements = "other.GlueCEPolicyMaxCPUTime > 39 && other.GlueCEPolicyMaxWallClockTime > 25 && other.GlueHostMainMemoryVirtualSize > 5037 && other.GlueHostMainMemoryRAMSize > 5041";
...

is submitted into the batch system with parameters

...
#$ -l s_rss=5041M
#$ -l s_vmem=5037M
#$ -l s_rt=1500
#$ -l s_cpu=2340
...
#$ -pe * 3
...

Presentations

• KIT TF metting 4th February 2014
• KIT TF meeting 18th February 2014
• KIT TF meeting 4th March 2014