ComputeAccountingUnicore < EMI

EMI Web>ComputeAccounting>ComputeAccountingUnicore (2011-03-15, unknown) (raw view)
---+Accounting record format used in UNICORE

OGF UR format is used as a base. The following list specifies which fields are used with some additional notes. RMS - Resource Management System (Torque, SGE, ...). If no comment is provided then it means that we use the field in a fully natural and obvious way. 

---+++++ Base properties
   1. *Record identity* generated, unused 
   1. *GlobalJobId* Unicore !ActionUUID
   1. *LocalJobId* RMS job id
   1. *ProcessId* unused
   1. *LocalUserId* unix login
   1. *GlobalUsername* user DN
   1. *JobName* Unicore submitted job name
   1. *Charge* unused
   1. *Status* RMS job status. In case of Torque: D->aborted; E->completed; Q-> queued; S -> started. Other statuses are unused.
   1. *WallDuration*
   1. *CpuDuration*
   1. *EndTime* RMS job end
   1. *StartTime* RMS job start
   1. *MachineName* RMS server hostname
   1. *Host* RMS exec hosts. The description denotes number of CPUs used and lists which slots were used if this information is available. E.g. =description="CPUS=2;SLOTS=0,4"= This field may be used multiple times.
   1. *SubmitHost* unused
   1. *Queue*
   1. *Project Name* used to carry information about computing grants if available.

---+++++ Differentiated Properties

   1. *Network, Disk* unused
   1. *Memory* used two times to report vmem & mem from RMS
   1. *Swap* unused
   1. *Nodecount, Processors* unused, but we can easily add this (one can extract this info from !Host fields)
   1. *TimeDuration* unused
   1. *TimeInstant* from RMS: qtime, ctime, etime (in case of Torque)
   1. *ServiceLevel* unused
   1. *Extensions*
      1. =Resource (desc = exit_status)= Job exit status.
      1. =Resource (desc = VO)= Virtual organisation name.
      1. =Resource (desc = attributes)= user's SAML attributes 
      1. =Resource (desc = group)= Local user  unix group. 
      1. =Resource (desc = infrastructure)= what grid middleware or other infrastructure produced the record. Currently we use two values 'unicore' or 'UNKNOWN'.

---+++ Comments

   1. Exit status, VO, group - should be added to the base spec. 
   1. In case of VO in UNICORE there may easily happen that the system is only aware of the fact the the user is a member of some VOs. In such a case there are multiple values of the VO element.
   1. Attributes are rather out of scope - this is used mostly for internal purposes, is not anyhow presented.
   1. We don't use !SubmitHost, and we would like to. However it is not perfectly clear what to put there: in grid environment this might be client's submission machine or grid job execution service or even grid intermediary service like workflow service/broker or machine from where the job was submitted to the RMS. Therefore we would like to have a clear description of this element (probably saying that this is the RMS submission machine, what is of little interest to us) and another element for specifying grid service(s) that submitted the job.
   1. General note: !GridInfrastructure (ARC, gLite, UNICORE, Globus) is another field that we think would be useful. Currently we use extension for this purpose.
   1. UR doesn't specify how to provide the info on CPUs used per host, we believe it should.


---+++ Example
<verbatim>
<ur:Usage xmlns:ur="http://www.gridforum.org/2003/ur-wg"> 
  <ur:RecordIdentity ur:createTime="2011-02-21T10:09:17.027+01:00" ur:recordId="ef4ff33f-7053-484d-8fd3-0d8cc019a4ea"/> 
  <ur:JobIdentity> 
    <ur:GlobalJobId>073c26d8-2a30-4ef8-af1b-2a63c06cc344</ur:GlobalJobId> 
    <ur:LocalJobId>18780</ur:LocalJobId> 
  </ur:JobIdentity> 
  <ur:UserIdentity> 
    <ur:LocalUserId>monitor</ur:LocalUserId> 
    <ur:GlobalUserName>CN=Monitoring AGENT, OU=PL-Grid Internal, O=ICM, C=PL</ur:GlobalUserName> 
  </ur:UserIdentity> 
  <ur:JobName>UNICORE_Job</ur:JobName> 
  <ur:Status>completed</ur:Status> 
  <ur:TimeInstant ur:type="etime">2011-02-21T10:09:17+01:00</ur:TimeInstant> 
  <ur:TimeInstant ur:type="qtime">2011-02-21T10:09:17+01:00</ur:TimeInstant> 
  <ur:TimeInstant ur:type="ctime">2011-02-21T10:09:17+01:00</ur:TimeInstant> 
  <ur:Memory ur:storageUnit="KB" ur:type="shared">0</ur:Memory> 
  <ur:Memory ur:storageUnit="KB" ur:type="physical">0</ur:Memory> 
  <ur:Resource ur:description="attributes">d24:urn:SAML:voprofile:groupl25:/vo.plgrid.pl/ICM_testbed32:/vo.plgrid.pl/ICM_testbed/agentsee</ur:Resource> 
  <ur:Resource ur:description="group">users</ur:Resource> 
  <ur:Resource ur:description="exit_status">0</ur:Resource> 
  <ur:Resource ur:description="infrastructure">unicore</ur:Resource>
  <ur:Resource ur:description="vo">vo.plgrid.pl</ur:Resource> 
  <ur:MachineName>plgrid-113.icm.edu.pl</ur:MachineName> 
  <ur:Host ur:description="CPUS=1;SLOTS=0">wn1080</ur:Host>
  <ur:Queue>batch</ur:Queue> 
  <ur:StartTime>2011-02-21T10:09:17+01:00</ur:StartTime> 
  <ur:EndTime>2011-02-21T10:09:17+01:00</ur:EndTime> 
  <ur:WallDuration>PT0S</ur:WallDuration> 
  <ur:CpuDuration>PT0S</ur:CpuDuration> 
</ur:Usage>
</verbatim>


-- Main.KrzysztofBenedyczak - 21-Feb-2011
Topic revision: r2 - 2011-03-15 - unknown
Public webs
- Cern Search
- TWiki Search
- Google Search
EMI All webs
Copyright &© 2008-2022 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
or Ideas, requests, problems regarding TWiki? use Discourse or Send feedback