FFF Metafile Formats

Identified metafile formats so far:

BU

Metafile for each raw file

• Name format: ls<LS#>_<part#>.jsn
• Example name: ls000001_1.jsn
• File type: JSON
• Data fields
  • number of events

Example data:

{
   "Data" : [ "1022"],
   "Definition" : "/path/to/def.jsd",
   "Source" : "bu-1"
}

Example definition:

{
   "legend" : [
      {
         "name" : "NEvents",
         "operation" : "sum"
      }  
   ],
   "file" : "/path/to/def.jsd"
}

End-of-Lumi metafile

• Name format: EoLS_<LS#>.jsn
• Example name: EoLS_000004.jsn
• File type: JSON
• Data fields
  • number of events

Example data:

{
   "Data" : [ "1022"],
   "Definition" : "/path/to/def.jsd",
   "Source" : "bu-1"
}

Example definition:

{
   "legend" : [
      {
         "name" : "NEvents",
         "operation" : "sum"
      }  
   ],
   "file" : "/path/to/def.jsd"
}

End-of-Run

FU

Microstate service: Fast Monitoring

• Name format: states_<PID#>.fast
• Example name: states_1234.fast
• File type: CSV
• Data fields
  • processed events
  • Macrostate histogram
  • Ministate histogram
  • Microstate histogram

Example data:

/path/to/microstatedef.jsd
3,1,1,99

Example definition:

{
   "legend" : [
      {
         "name" : "Macrostate",
         "operation" : "MHisto"
      },
      {
         "name" : "Ministate",
         "operation" : "mHisto"
      },
      {
         "name" : "Microstate",
         "operation" : "uHisto"
      },
      {
         "name" : "Processed",
         "operation" : "sum"
      }
   ],
   "file" : "/path/to/microstatedef.jsd"
}

Microstate service: Slow (per-LS) Monitoring

• Name format: lumi_<PID#>_<LS#>.jsh
• Example name: lumi_1234_1.jsh
• File type: CSV
• Data fields
  • processed events
  • Macrostate histogram
  • Ministate histogram
  • Microstate histogram

Example data:

{
   "Data" : [ "MHisto", "mHisto", "uHisto", "167" ],
   "Definition" : "/path/to/microstatedef.jsd",
   "MHisto" : [ 0, 0, 0, 6, 0, 0, 0, 0, 0, 0, 0, 0 ],
   "Source" : "host_11843",
   "mHisto" : [ 2, 4 ],
   "uHisto" : [
      2,
      0,
      0,
      0,
      0,
      0,
      0,
      0,
      0,
      0,
      0,
      0,
      0,
      0,
      0,
      0,
      0,
      0,
      0,
      0,
      0,
      0,
      0,
      0,
      0,
      0,
      0,
      0,
      0,
      0,
      0,
      0,
      0,
      4
   ]
}

Example definition:

{
   "legend" : [
      {
         "name" : "Macrostate",
         "operation" : "MHisto"
      },
      {
         "name" : "Ministate",
         "operation" : "mHisto"
      },
      {
         "name" : "Microstate",
         "operation" : "uHisto"
      },
      {
         "name" : "Processed",
         "operation" : "sum"
      }
   ],
   "file" : "/path/to/microstatedef.jsd"
}

HLT Paths / Streams