Tier0 Configuration Wrappers

This page provides a guide to use the DQM bash wrappers located on https://github.com/andresfelquintero/wrappers or /afs/cern.ch/user/c/cmst0/public/wrappersTier0Config that can be accessed from any lxplus machine.

These wrappers provides configuration files as outcomes of Express processing, Reco processing or Harvesting and should be run by using bash command on an lxplus machine. (i. e. bash expressWrapper.sh)

Here is a list of the different wrappers:

Express processing wrapper

This wrapper provides, as its name states, a replica of the express configuration used for a specific run and one of its streams. You can check the express configuration of any run on https://cmsweb.cern.ch/t0wmadatasvc/prod/express_config?run=runnumber . If you only have the run number, the wrapper will provide the streamers available for that specific run. If there are none available then the wrapper won't work. You will also need to provide a valid LFN to be able to run the final step of the processing.

As an example, this wrapper was run with the following configuration: Run number 323940, Stream: Express, LFN: /store/data/Run2018D/ZeroBias/RAW/v1/000/323/940/00000/8F6027B6-0B11-5C41-B790-7523DFB612CE.root . You will write this line

$ bash expressWrapper.sh

Then some messages will pop up and you will continue to fill them with the information that you provided.

Please provide the run number i.e. 326607

Please provide the stream name i.e. Calibration

Please provide the LFN i.e. /store/whatever

After this section the code will run for some time by creating the requested area. Then the wrapper will ask if your CMSSW version is superior to 11_0_0_pre1, because that will decide if the code will take a nThreads value as input for the configuration or not. For this example the answer is N.

Is CMSSW_10_2_5_patch1 a CMSSW version superior to 11_0_0_pre1? Answer Y or N

And finally you will obtain a message telling you what to do next.

Now do:

cmsRun -e RunExpressProcessingCfg.py

If you want to do cmsRun -e RunExpressProcessingCfg.py then you should move to the following folder

/afs/cern.ch/user/c/cmst0/public/wrappersTier0Config/CMSSW_10_2_5_patch1/src

So now the configuration files RunExpressProcessingCfg.pkl and RunExpressProcessingCfg.py are available at the folder shown on screen. If you want to run the configuration then you will have to go to that folder and then run cmsenv on the prompt command line.

Afterwards you can run cmsRun -e RunExpressProcessingCfg.py and obtain your desired result

Reco Processing wrapper

This wrapper provides, as its name states, a replica of the reco configuration used for a specific run and one of its datasets. You can check the reco configuration of any run on https://cmsweb.cern.ch/t0wmadatasvc/prod/reco_config?run=runnumber&primary_dataset=nameofdataset . If there are none available then the wrapper won't work. You will also need to provide a valid LFN to be able to run the final step of the processing.

As an example the wrapper was tested with the following configuration: Run number 323940, Dataset: ZeroBias, LFN: /store/data/Run2018D/ZeroBias/RAW/v1/000/323/940/00000/8F6027B6-0B11-5C41-B790-7523DFB612CE.root You will write this line

$ bash recoWrapper.sh

Then some messages will pop up and you will continue to fill them with the information that you provided.

Please provide the run number i.e. 323940

Please provide the stream name i.e. ZeroBias

Please provide the LFN i.e. /store/whatever

After this the code will run for some time by creating the requested area. Then the wrapper will ask if your CMSSW version is superior to 11_0_0_pre1, because that will decide if the code will take a nThreads value as input for the configuration or not. For this example the answer is N.

Is CMSSW_10_2_5_patch1 a CMSSW version superior to 11_0_0_pre1? Answer Y or N

Finally you will obtain a message telling you what to do next.

Now do:

cmsRun -e RunPromptRecoCfg.py

If you want to use cmsRun -e RunPromptRecoCfg.py then you should move to the following folder

/afs/cern.ch/user/c/cmst0/public/wrappersTier0Config/CMSSW_10_2_5_patch1/src

So now the configuration files RunPromptRecoCfg.pkl and RunPromptRecoCfg.py are available at the folder shown on screen. If you want to run the configuration then you will have to go to that folder and then run cmsenv on the prompt command line.

Afterwards you can run cmsRun -e RunPromptRecoCfg.py and obtain your desired result

Harvesting wrapper

This wrapper provides, as its name states, a replica of the harvesting configuration used for a specific run and a dataset. It takes three inputs: Run number, a full dataset name (i.e. /ZeroBias/Run2018D-PromptReco-v2/DQMIO) and a location for the root file that is going to be used as an input. Unlike the other wrappers, this one does not accept a LFN, so a full path needs to be provided like file:PFN . ROOT file location can be obtained by getting the file using xrootd and copying it to the local machine.

An example was run using the following configuration: run number: 323940, full dataset name: /ZeroBias/Run2018D-PromptReco-v2/DQMIO, LFN: file:/afs/cern.ch/user/f/fiori/public/Andres/9F411A2F-9C94-D54F-894B-83D60BF55C41.root . You will run this line

$ bash harvestWrapper.sh

Then some messages will appear and you will complete the information as required

This HARVEST wrapper works by creating a new project area, so it should be used on a local lxplus area. If you already have a project area on the folder then this wrapper will not work. If you want to obtain run number and dataset from an LFN, please use DAS.

Please provide the run number i.e. 321295

Please provide the full dataset name i.e. /ZeroBias/Run2018D-PromptReco-v2/DQMIO

Please provide the LFN i.e. /store/whatever. For this wrapper you will need to provide an lfn of a file located at CERN, or you will need to get the file on your local machine by using xrootd or by requesting the transfer from tape. If you have the file in your local area then write the input as follows: file:PFN i.e. file:/afs/cern.ch/user/f/fiori/public/Andres/9F411A2F-9C94-D54F-894B-83D60BF55C41.root

After the wrapper finishes its process you will obtain a message indicating your next suggested step

Now do:

cmsRun -j FrameworkJobReport.xml RunDQMHarvestingCfg.py

If you want to use cmsRun -j FrameworkJobReport.xml RunDQMHarvestingCfg.py then you should move to the following folder and make sure that the file is actually present in the local storage. Otherwise cmsRun will fail.

/afs/cern.ch/user/c/cmst0/public/wrappersTier0Config/CMSSW_10_2_5_patch1/src

So now the configuration files RunDQMHarvestingCfg.pkl and RunDQMHarvestingCfg.py are available at the folder shown on screen. If you want to run the configuration then you will have to go to that folder and then run cmsenv on the prompt command line.

Afterwards you can use cmsRun -j FrameworkJobReport.xml RunDQMHarvestingCfg.py to do the harvesting and obtain a result

Edit | Attach | Watch | Print version | History: r6 < r5 < r4 < r3 < r2 | Backlinks | Raw View | WYSIWYG | More topic actions
Topic revision: r6 - 2019-11-08 - AndresFelipeQuinteroParra
 
    • Cern Search Icon Cern Search
    • TWiki Search Icon TWiki Search
    • Google Search Icon Google Search

    CMSPublic All webs login

This site is powered by the TWiki collaboration platform Powered by PerlCopyright & 2008-2020 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
or Ideas, requests, problems regarding TWiki? use Discourse or Send feedback