DQM Wrappers

This page provides a guide to use the DQM bash wrappers located on https://github.com/andresfelquintero/wrappers or /afs/cern.ch/user/c/cmst0/public/wrappersTier0Config that can be accessed from any lxplus machine.

These wrappers provides configuration files as outcomes of Express processing, Reco processing or Harvesting and should be run by using bash command on an lxplus machine. (i. e. bash expressWrapper.sh)

Here is a list of the different wrappers:

Express processing wrapper

This wrapper provides, as its name states, a replica of the express configuration used for a specific run and one of its streams. You can check the express configuration of any run on https://cmsweb.cern.ch/t0wmadatasvc/prod/express_config?run=runnumber . If you only have the run number, the wrapper will provide the streamers available for that specific run. If there are none available then the wrapper won't work. You will also need to provide a valid LFN to be able to run the final step of the processing.

As an example, this wrapper was run with the following configuration: Run number 323940, Stream: Express, LFN: /store/data/Run2018D/ZeroBias/RAW/v1/000/323/940/00000/8F6027B6-0B11-5C41-B790-7523DFB612CE.root as shown in the following image:

Screen_Shot_2019-08-07_at_12.16.56_PM.png

After this the code will run for some time by creating the requested area. Then the wrapper will ask if your CMSSW version is superior to 11_0_0_pre1, because that will decide if the code will take a nThreads value as input for the configuration or not. For this example the answer is N, as shown in the following image: Screen_Shot_2019-08-07_at_12.25.56_PM.png

Finally you will obtain a message similar to this one depending on where you run the wrapper: Screen_Shot_2019-08-07_at_12.33.17_PM.png

So now the configuration files RunExpressProcessingCfg.pkl and RunExpressProcessingCfg.py are available at the folder shown on screen. If you want to run the configuration then you will have to go to that folder and then run cmsenv on the prompt command line.

Afterwards you can run cmsRun -e RunExpressProcessingCfg.py and obtain the result as shown in the image for our example. Screen_Shot_2019-08-07_at_12.44.01_PM.png

Reco Processing wrapper

This wrapper provides, as its name states, a replica of the reco configuration used for a specific run and one of its datasets. You can check the reco configuration of any run on https://cmsweb.cern.ch/t0wmadatasvc/prod/reco_config?run=runnumber&primary_dataset=nameofdataset . If there are none available then the wrapper won't work. You will also need to provide a valid LFN to be able to run the final step of the processing.

As an example the wrapper was tested with the following configuration: Run number 323940, Dataset: ZeroBias, LFN: /store/data/Run2018D/ZeroBias/RAW/v1/000/323/940/00000/8F6027B6-0B11-5C41-B790-7523DFB612CE.root as shown in the following image:

Screen_Shot_2019-08-21_at_9.18.32_AM.png

After this the code will run for some time by creating the requested area. Then the wrapper will ask if your CMSSW version is superior to 11_0_0_pre1, because that will decide if the code will take a nThreads value as input for the configuration or not. For this example the answer is N, as shown in the following image: Screen_Shot_2019-08-07_at_12.25.56_PM.png

Finally you will obtain a message similar to this one depending on where you run the wrapper: Screen_Shot_2019-08-07_at_4.04.37_PM.png

So now the configuration files RunPromptRecoCfg.pkl and RunPromptRecoCfg.py are available at the folder shown on screen. If you want to run the configuration then you will have to go to that folder and then run cmsenv on the prompt command line.

Afterwards you can run cmsRun -e RunPromptRecoCfg.py and obtain the result as shown in the image for our example. Screen_Shot_2019-08-07_at_4.35.46_PM.png

Harvesting wrapper

This wrapper provides, as its name states, a replica of the harvesting configuration used for a specific run and a dataset. It takes three inputs: Run number, a full dataset name (i.e. /ZeroBias/Run2018D-PromptReco-v2/DQMIO) and a location for the root file that is going to be used as an input. Unlike the other wrappers, this one does not accept a LFN, so a full path needs to be provided like file:PFN . ROOT file location can be obtained by getting the file using xrootd and copying it to the local machine.

An example was run using the following configuration: run number: 323940, full dataset name: /ZeroBias/Run2018D-PromptReco-v2/DQMIO, LFN: file:/afs/cern.ch/user/f/fiori/public/Andres/9F411A2F-9C94-D54F-894B-83D60BF55C41.root . You can see its configuration on the following image:

Screen_Shot_2019-08-21_at_9.28.53_AM.png

After the wrapper finishes its process you will obtain a message similar to this one depending on your location:

Screen_Shot_2019-08-21_at_9.34.26_AM.png

So now the configuration files RunDQMHarvestingCfg.pkl and RunDQMHarvestingCfg.py are available at the folder shown on screen. If you want to run the configuration then you will have to go to that folder and then run cmsenv on the prompt command line.

Afterwards you can use cmsRun -j FrameworkJobReport.xml RunDQMHarvestingCfg.py to do the harvesting and obtain a result similar to the one shown in the following image: Screen_Shot_2019-08-07_at_5.41.58_PM.png

Topic attachments
I Attachment History Action Size Date Who Comment
PNGpng Screen_Shot_2019-08-07_at_11.25.25_AM.png r1 manage 35.2 K 2019-08-07 - 18:37 AndresFelipeQuinteroParra screenshot of wrapper initiation.
PNGpng Screen_Shot_2019-08-07_at_12.16.56_PM.png r1 manage 35.0 K 2019-08-07 - 19:19 AndresFelipeQuinteroParra  
PNGpng Screen_Shot_2019-08-07_at_12.25.56_PM.png r1 manage 11.3 K 2019-08-07 - 19:29 AndresFelipeQuinteroParra  
PNGpng Screen_Shot_2019-08-07_at_12.33.17_PM.png r1 manage 22.9 K 2019-08-07 - 19:34 AndresFelipeQuinteroParra  
PNGpng Screen_Shot_2019-08-07_at_12.44.01_PM.png r1 manage 95.0 K 2019-08-07 - 19:45 AndresFelipeQuinteroParra  
PNGpng Screen_Shot_2019-08-07_at_3.25.28_PM.png r1 manage 52.1 K 2019-08-07 - 22:26 AndresFelipeQuinteroParra  
PNGpng Screen_Shot_2019-08-07_at_4.04.37_PM.png r1 manage 19.9 K 2019-08-07 - 23:26 AndresFelipeQuinteroParra  
PNGpng Screen_Shot_2019-08-07_at_4.35.46_PM.png r1 manage 102.4 K 2019-08-07 - 23:36 AndresFelipeQuinteroParra  
PNGpng Screen_Shot_2019-08-07_at_4.55.40_PM.png r1 manage 74.5 K 2019-08-08 - 00:01 AndresFelipeQuinteroParra  
PNGpng Screen_Shot_2019-08-07_at_5.41.58_PM.png r1 manage 118.7 K 2019-08-08 - 00:43 AndresFelipeQuinteroParra  
PNGpng Screen_Shot_2019-08-21_at_9.18.32_AM.png r1 manage 32.4 K 2019-08-21 - 16:23 AndresFelipeQuinteroParra recowrapper config
PNGpng Screen_Shot_2019-08-21_at_9.28.53_AM.png r1 manage 51.8 K 2019-08-21 - 16:29 AndresFelipeQuinteroParra harvestwrapperconfig
PNGpng Screen_Shot_2019-08-21_at_9.34.26_AM.png r1 manage 30.5 K 2019-08-21 - 16:36 AndresFelipeQuinteroParra harvestoutput1
Edit | Attach | Watch | Print version | History: r10 < r9 < r8 < r7 < r6 | Backlinks | Raw View | WYSIWYG | More topic actions
Topic revision: r10 - 2019-08-21 - AndresFelipeQuinteroParra
 
    • Cern Search Icon Cern Search
    • TWiki Search Icon TWiki Search
    • Google Search Icon Google Search

    CMSPublic All webs login

This site is powered by the TWiki collaboration platform Powered by PerlCopyright & 2008-2019 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding TWiki? Send feedback