USC Charm Analysis

Panda Job Monitoring

Athena setup: svn

There's a Savannah ticket about this: https://savannah.cern.ch/bugs/?func=detailitem&item_id=72585

The solution stated there: "The usual recommendation: Don't use Athena and grid (DQ2) in the same window unless you want to waste time with weird issues."

Obtaining a Grid Certificate

Matt Chapman summarized his trial and error here.

First Time Login Setup

$ mkdir $HOME/cmthome
$ cp ~wpark/cmthome/SOURCEME $HOME/cmthome
$ mkdir YourWorkingDirectory
$ cd YourWorkingDirectory
$ source $HOME/cmthome/SOURCEME 15.8.0 2
$ kinit yourCernUserID@CERN.CH   
$ cmt co $SVNGRP/Institutes/USC/CharmAnalysis  
$ cd CharmAnalysis/cmt
$ gmake
$ cd ..

Subsequent Login Setup

$ ssub  // alias ssub will show what this means
$ kinit yourCernUserID@CERN.CH  
$ svn update

// if there is any update in src/  like
[su usy:~/gridJob/15.8.0.2/CharmAnalysis] svn update
U    src/DmesonAnalysis.h
U    src/DmesonAnalysis.cxx
U    ChangeLog
Updated to revision 41539.

Then, do the following:
$ cd cmt
$ gmake
$ cd ..

If you are asked your password even with kinit, then check this information at SoftwareDevelopmentWorkBookSVN#Access_to_the_SVN_repositories

Recover crashed job

(1) Crash due to unstable maintenance : run pbook and retry(jobId).

(2) Crash due to be killed

Downloading Files (Completed Jobs) and Validation

Once your job is done without any failure, you want to download files as below:
Login...
Note: Do data download in separate terminal/tab from job submissions...otherwise clash occurs between ssub and dget!
$ grid
Enter GRID pass phrase:

$ cd /susyraid1/YourNameHere
$//If you haven't already make the following directories
$ mkdir AtlasData
$ mkdir MuonswBeam
$//Next use 'dget' alias followed by 'Out' name of successfully completed job. For example...
$//Also be sure as above to write the results of the download to an 'outfile' with '>&outfile.log&'
$
$dget user.rbain.data10_7TeV.periodA.physics_MuonswBeam.PhysCont.AOD.repro04_v01.Oct042010/  >& periodA.log &

Once download is done, check the number of root files as:
$ ls user.rbain.data10_7TeV.periodA.physics_MuonswBeam.PhysCont.AOD.repro04_v01.Oct042010*/*root* | wc
and check if the number of files are consistent to what panda monitor says.

Setup grid environment

setenv PATHENA_GRID_SETUP_SH /afs/cern.ch/project/gd/LCG-share/current/etc/profile.d/grid_env.sh
source /susyraid1/atlas-release/panda/etc/panda/panda_setup.csh 

Submit a job: Submission of job for DATA/MC is one line difference in share/DmesonAnalysisJobOptions.py. For L1Calo stream, replace MinBias with L1Caro in dataset name.

//Check if the following line is commented out or not before data submission...
# GlobalFlags.DataSource.set_data() ## Needed for REAL DATA, not MC

pathena share/DmesonAnalysisJobOptions.py --inDS DATASETinTABLE --outDS user.YOURNICKNAME.DATASET.VERSIONinTABLE --nFilesPerJob 1 --extOutFile DmesonAnalysisTest.root --supStream GLOBAL

Grid Submission Process

To get an instruction to submit, please do under CharmAnalysis/

$ bin/gsub

CharmAnalysis Ntuple Production (v002 starting 7/30/2010)

PandaAthena WP MVP

  • Please, make sure you run the ./test job in run/ directory.
  • Setup panda.
  • submission command is
pathena share/DmesonAnalysisJobOptions.py -c "Period='periodA'" --inDS data10_7TeV.periodA.physics_MinBias.PhysCont.AOD.repro04_v01/  --outDS user.woochun.data10_7TeV.periodA.physics_MinBias.PhysCont.AOD.repro04_v01.v002 --nFilesPerJob 1 --extOutFile DmesonAnalysisTest.root --supStream GLOBAL --excludedSite=ANALY_NIKHEF-ELPROD

List of excludedSite::
--excludedSite=ANALY_NIKHEF-ELPROD,ANALY_JINR,ANALY_SARA-MATRIX,ANALY_ITEP,ANALY_TR-10-ULAKBIM,ANALY_WEIZMANN,ANALY_RU-MOSCOW-MEPHI,ANALY_RU-MOSCOW-FIAN,ANALY_TECHNION-HEP,ANALY_IL-TAU-HEP,ANALY_CSTCDIE,ANALY_RRC-KI,ANALY_RU-PNPI,ANALY_RU-PROTVINO-IHEP,AALY_RU-MOSCOW-SINP,ANALY_GRIF-IRFU,ANALY_GRIF-LPNHE,ANALY_QMUL,ANALY_CAM,ANALY_MPPMU

List of inDS we need to proceed:

data10_7TeV.periodA.physics_CosmicCalo.PhysCont.AOD.repro04_v01/
data10_7TeV.periodA.physics_MuonswBeam.PhysCont.AOD.repro04_v01/
data10_7TeV.periodA.physics_MinBias.PhysCont.AOD.repro04_v01/
data10_7TeV.periodA.physics_L1Calo.PhysCont.AOD.repro04_v01/
data10_7TeV.periodA.physics_L1CaloEM.PhysCont.AOD.repro04_v01/
data10_7TeV.periodA.physics_RNDM.PhysCont.AOD.repro04_v01/
data10_7TeV.periodA.physics_CosmicCaloEM.PhysCont.AOD.repro04_v01/
data10_7TeV.periodB.physics_CosmicCalo.PhysCont.AOD.repro04_v01/

data10_7TeV.periodB.physics_MinBias.PhysCont.AOD.repro04_v01/
data10_7TeV.periodB.physics_RNDM.PhysCont.AOD.repro04_v01/
data10_7TeV.periodB.physics_CosmicCaloEM.PhysCont.AOD.repro04_v01/
data10_7TeV.periodB.physics_L1Calo.PhysCont.AOD.repro04_v01/
data10_7TeV.periodB.physics_MuonswBeam.PhysCont.AOD.repro04_v01/
data10_7TeV.periodB.physics_L1CaloEM.PhysCont.AOD.repro04_v01/



data10_7TeV.periodC1.physics_RNDM.PhysCont.AOD.t0pro04_v01/
data10_7TeV.periodC2.physics_MinBias.PhysCont.AOD.t0pro04_v01/
data10_7TeV.periodC1.physics_L1Calo.PhysCont.AOD.t0pro04_v01/
data10_7TeV.periodC.physics_RNDM.PhysCont.AOD.t0pro04_v01/
data10_7TeV.periodC2.physics_CosmicCalo.PhysCont.AOD.t0pro04_v01/
data10_7TeV.periodC2.physics_RNDM.PhysCont.AOD.t0pro04_v01/
data10_7TeV.periodC1.physics_MuonswBeam.PhysCont.AOD.t0pro04_v01/
data10_7TeV.periodC1.physics_CosmicCalo.PhysCont.AOD.t0pro04_v01/
data10_7TeV.periodC.physics_CosmicCalo.PhysCont.AOD.t0pro04_v01/
data10_7TeV.periodC.physics_MuonswBeam.PhysCont.AOD.t0pro04_v01/
data10_7TeV.periodC.physics_L1Calo.PhysCont.AOD.t0pro04_v01/
data10_7TeV.periodC1.physics_CosmicCaloEM.PhysCont.AOD.t0pro04_v01/
data10_7TeV.periodC2.physics_L1Calo.PhysCont.AOD.t0pro04_v01/
data10_7TeV.periodC1.physics_ZeroBias.PhysCont.AOD.t0pro04_v01/
data10_7TeV.periodC2.physics_MuonswBeam.PhysCont.AOD.t0pro04_v01/
data10_7TeV.periodC.physics_MinBias.PhysCont.AOD.t0pro04_v01/
data10_7TeV.periodC1.physics_MinBias.PhysCont.AOD.t0pro04_v01/

data10_7TeV.periodD4.physics_MuonswBeam.PhysCont.AOD.t0pro04_v01/
data10_7TeV.periodD6.physics_MuonswBeam.PhysCont.AOD.t0pro04_v01/
data10_7TeV.periodD1.physics_MinBias.PhysCont.AOD.t0pro04_v01/
data10_7TeV.periodD3.physics_MuonswBeam.PhysCont.AOD.t0pro04_v01/
data10_7TeV.periodD4.physics_ZeroBias.PhysCont.AOD.t0pro04_v01/
data10_7TeV.periodD.physics_MuonswBeam.PhysCont.AOD.t0pro04_v01/
data10_7TeV.periodD6.physics_L1Calo.PhysCont.AOD.t0pro04_v01/
data10_7TeV.periodD.physics_L1Calo.PhysCont.AOD.t0pro04_v01/
data10_7TeV.periodD.physics_ZeroBias.PhysCont.AOD.t0pro04_v01/
data10_7TeV.periodD3.physics_ZeroBias.PhysCont.AOD.t0pro04_v01/
data10_7TeV.periodD5.physics_ZeroBias.PhysCont.AOD.t0pro04_v01/
data10_7TeV.periodD5.physics_RNDM.PhysCont.AOD.t0pro04_v01/
data10_7TeV.periodD.physics_CosmicCalo.PhysCont.AOD.t0pro04_v01/
data10_7TeV.periodD4.physics_L1Calo.PhysCont.AOD.t0pro04_v01/
data10_7TeV.periodD3.physics_CosmicCalo.PhysCont.AOD.t0pro04_v01/
data10_7TeV.periodD2.physics_MuonswBeam.PhysCont.AOD.t0pro04_v01/
data10_7TeV.periodD2.physics_L1Calo.PhysCont.AOD.t0pro04_v01/
data10_7TeV.periodD1.physics_MuonswBeam.PhysCont.AOD.t0pro04_v01/
data10_7TeV.periodD6.physics_ZeroBias.PhysCont.AOD.t0pro04_v01/
data10_7TeV.periodD1.physics_CosmicCalo.PhysCont.AOD.t0pro04_v01/
data10_7TeV.periodD1.physics_ZeroBias.PhysCont.AOD.t0pro04_v01/
data10_7TeV.periodD1.physics_RNDM.PhysCont.AOD.t0pro04_v01/
data10_7TeV.periodD.physics_MinBias.PhysCont.AOD.t0pro04_v01/
data10_7TeV.periodD3.physics_MinBias.PhysCont.AOD.t0pro04_v01/
data10_7TeV.periodD2.physics_ZeroBias.PhysCont.AOD.t0pro04_v01/
data10_7TeV.periodD2.physics_MinBias.PhysCont.AOD.t0pro04_v01/
data10_7TeV.periodD6.physics_RNDM.PhysCont.AOD.t0pro04_v01/
data10_7TeV.periodD6.physics_MinBias.PhysCont.AOD.t0pro04_v01/
data10_7TeV.periodD5.physics_MuonswBeam.PhysCont.AOD.t0pro04_v01/
data10_7TeV.periodD5.physics_CosmicCalo.PhysCont.AOD.t0pro04_v01/
data10_7TeV.periodD5.physics_MinBias.PhysCont.AOD.t0pro04_v01/
data10_7TeV.periodD2.physics_CosmicCalo.PhysCont.AOD.t0pro04_v01/
data10_7TeV.periodD6.physics_CosmicCalo.PhysCont.AOD.t0pro04_v01/
data10_7TeV.periodD2.physics_RNDM.PhysCont.AOD.t0pro04_v01/
data10_7TeV.periodD5.physics_L1Calo.PhysCont.AOD.t0pro04_v01/
data10_7TeV.periodD1.physics_L1Calo.PhysCont.AOD.t0pro04_v01/
data10_7TeV.periodD4.physics_MinBias.PhysCont.AOD.t0pro04_v01/
data10_7TeV.periodD.physics_RNDM.PhysCont.AOD.t0pro04_v01/
data10_7TeV.periodD3.physics_L1Calo.PhysCont.AOD.t0pro04_v01/
data10_7TeV.periodD4.physics_RNDM.PhysCont.AOD.t0pro04_v01/
data10_7TeV.periodD4.physics_CosmicCalo.PhysCont.AOD.t0pro04_v01/
data10_7TeV.periodD3.physics_RNDM.PhysCont.AOD.t0pro04_v01/

data10_7TeV.periodE3.physics_MinBias.PhysCont.AOD.t0pro04_v01/
data10_7TeV.periodE.physics_CosmicMuons.PhysCont.AOD.t0pro04_v01/
data10_7TeV.periodE7.physics_ZeroBias.PhysCont.AOD.t0pro04_v01/
data10_7TeV.periodE.physics_ZeroBias.PhysCont.AOD.t0pro04_v01/
data10_7TeV.periodE1.physics_ZeroBias.PhysCont.AOD.t0pro04_v01/
data10_7TeV.periodE1.physics_MinBias.PhysCont.AOD.t0pro04_v01/
data10_7TeV.periodE5.physics_MinBias.PhysCont.AOD.t0pro04_v01/
data10_7TeV.periodE3.physics_ZeroBias.PhysCont.AOD.t0pro04_v01/
data10_7TeV.periodE.physics_MinBias.PhysCont.AOD.t0pro04_v01/
data10_7TeV.periodE7.physics_CosmicMuons.PhysCont.AOD.t0pro04_v01/
data10_7TeV.periodE4.physics_ZeroBias.PhysCont.AOD.t0pro04_v01/
data10_7TeV.periodE2.physics_Muons.PhysCont.AOD.t0pro04_v01/
data10_7TeV.periodE4.physics_MinBias.PhysCont.AOD.t0pro04_v01/
data10_7TeV.periodE.physics_CosmicCalo.PhysCont.AOD.t0pro04_v01/
data10_7TeV.periodE4.physics_CosmicCalo.PhysCont.AOD.t0pro04_v01/
data10_7TeV.periodE7.physics_MinBias.PhysCont.AOD.t0pro04_v01/
data10_7TeV.periodE3.physics_JetTauEtmiss.PhysCont.AOD.t0pro04_v01/
data10_7TeV.periodE1.physics_JetTauEtmiss.PhysCont.AOD.t0pro04_v01/
data10_7TeV.periodE3.physics_Egamma.PhysCont.AOD.t0pro04_v01/
data10_7TeV.periodE2.physics_Egamma.PhysCont.AOD.t0pro04_v01/
data10_7TeV.periodE.physics_JetTauEtmiss.PhysCont.AOD.t0pro04_v01/
data10_7TeV.periodE5.physics_Egamma.PhysCont.AOD.t0pro04_v01/
data10_7TeV.periodE7.physics_Muons.PhysCont.AOD.t0pro04_v01/
data10_7TeV.periodE.physics_Egamma.PhysCont.AOD.t0pro04_v01/
data10_7TeV.periodE6.physics_Egamma.PhysCont.AOD.t0pro04_v01/
data10_7TeV.periodE6.physics_CosmicCalo.PhysCont.AOD.t0pro04_v01/
data10_7TeV.periodE3.physics_CosmicCalo.PhysCont.AOD.t0pro04_v01/
data10_7TeV.periodE5.physics_CosmicCalo.PhysCont.AOD.t0pro04_v01/
data10_7TeV.periodE6.physics_JetTauEtmiss.PhysCont.AOD.t0pro04_v01/
data10_7TeV.periodE5.physics_Muons.PhysCont.AOD.t0pro04_v01/
data10_7TeV.periodE6.physics_MinBias.PhysCont.AOD.t0pro04_v01/
data10_7TeV.periodE1.physics_Egamma.PhysCont.AOD.t0pro04_v01/
data10_7TeV.periodE5.physics_JetTauEtmiss.PhysCont.AOD.t0pro04_v01/
data10_7TeV.periodE7.physics_JetTauEtmiss.PhysCont.AOD.t0pro04_v01/
data10_7TeV.periodE2.physics_ZeroBias.PhysCont.AOD.t0pro04_v01/
data10_7TeV.periodE7.physics_CosmicCalo.PhysCont.AOD.t0pro04_v01/
data10_7TeV.periodE6.physics_CosmicMuons.PhysCont.AOD.t0pro04_v01/
data10_7TeV.periodE6.physics_Muons.PhysCont.AOD.t0pro04_v01/
data10_7TeV.periodE4.physics_Egamma.PhysCont.AOD.t0pro04_v01/
data10_7TeV.periodE5.physics_ZeroBias.PhysCont.AOD.t0pro04_v01/
data10_7TeV.periodE4.physics_JetTauEtmiss.PhysCont.AOD.t0pro04_v01/
data10_7TeV.periodE2.physics_MinBias.PhysCont.AOD.t0pro04_v01/
data10_7TeV.periodE4.physics_Muons.PhysCont.AOD.t0pro04_v01/
data10_7TeV.periodE7.physics_Egamma.PhysCont.AOD.t0pro04_v01/
data10_7TeV.periodE1.physics_CosmicCalo.PhysCont.AOD.t0pro04_v01/
data10_7TeV.periodE3.physics_Muons.PhysCont.AOD.t0pro04_v01/
data10_7TeV.periodE6.physics_ZeroBias.PhysCont.AOD.t0pro04_v01/
data10_7TeV.periodE.physics_Muons.PhysCont.AOD.t0pro04_v01/
data10_7TeV.periodE1.physics_Muons.PhysCont.AOD.t0pro04_v01/
data10_7TeV.periodE2.physics_CosmicCalo.PhysCont.AOD.t0pro04_v01/
data10_7TeV.periodE2.physics_JetTauEtmiss.PhysCont.AOD.t0pro04_v01/

data10_7TeV.periodF.physics_Muons.PhysCont.AOD.t0pro04_v01/
data10_7TeV.periodF1.physics_Egamma.PhysCont.AOD.t0pro04_v01/
data10_7TeV.periodF1.physics_ZeroBias.PhysCont.AOD.t0pro04_v01/
data10_7TeV.periodF1.physics_Muons.PhysCont.AOD.t0pro04_v01/
data10_7TeV.periodF.physics_JetTauEtmiss.PhysCont.AOD.t0pro04_v01/
data10_7TeV.periodF.physics_ZeroBias.PhysCont.AOD.t0pro04_v01/
data10_7TeV.periodF.physics_Egamma.PhysCont.AOD.t0pro04_v01/
data10_7TeV.periodF1.physics_JetTauEtmiss.PhysCont.AOD.t0pro04_v01/
data10_7TeV.periodF2.physics_CosmicMuons.PhysCont.AOD.t0pro04_v01/
data10_7TeV.periodF2.physics_ZeroBias.PhysCont.AOD.t0pro04_v01/
data10_7TeV.periodF2.physics_JetTauEtmiss.PhysCont.AOD.t0pro04_v01/
data10_7TeV.periodF1.physics_CosmicMuons.PhysCont.AOD.t0pro04_v01/
data10_7TeV.periodF.physics_CosmicMuons.PhysCont.AOD.t0pro04_v01/
data10_7TeV.periodF.physics_CosmicCalo.PhysCont.AOD.t0pro04_v01/
data10_7TeV.periodF2.physics_MinBias.PhysCont.AOD.t0pro04_v01/
data10_7TeV.periodF2.physics_Egamma.PhysCont.AOD.t0pro04_v01/
data10_7TeV.periodF2.physics_CosmicCalo.PhysCont.AOD.t0pro04_v01/
data10_7TeV.periodF2.physics_Muons.PhysCont.AOD.t0pro04_v01/
data10_7TeV.periodF.physics_MinBias.PhysCont.AOD.t0pro04_v01/
data10_7TeV.periodF1.physics_MinBias.PhysCont.AOD.t0pro04_v01/
data10_7TeV.periodF1.physics_CosmicCalo.PhysCont.AOD.t0pro04_v01/


  • User is responsible for providing up-to-date fNNN tag for MinBias and L1Calo stream.
  • Please, use the command 'dq2-ls -L ROAMING data10_7TeV.00152166.physics_MinBias.merge.AOD.f\*_m\*' to find the most recent dataset.
  • If the most recent dataset is different from what is in table, please update it for the future submission.
  • Once your job is complete, check the panda monitoring. Every job should be successful.
  • If some jobs are failed, re-submit job with v002.1 (or v002.x) and --excludedSite=SITE1,SITE2,.... (list of sites will be updated)
  • Once job becomes successful, then dq2-get with log file saved into /susyraid1/AtlasData/CharmAnalysis region.
  • Check the log file carefully to find error such as
user.Milind.mc09_7TeV.105001.pythia_minbias.merge.AOD.e517_s764_s767_r1250_r1260.v003/user.Milind.mc09_7TeV.105001.pythia_minbias.merge.AOD.e517_s764_s767_r1250_r1260.v003.EXT0._00189.DmesonAnalysisTest.root: external failed:
  • Try to dq2-get again at the same directory (skipping existing file) in several hours later.
  • With all the sanitary check above, please update the table with mark.

GoodRunNumber and Trigger

GoodRunListSummer2010 Leonid's 6/11/2010 talk

-- WooChunPark - 30-Jul-2010

Edit | Attach | Watch | Print version | History: r32 < r31 < r30 < r29 < r28 | Backlinks | Raw View | WYSIWYG | More topic actions
Topic revision: r32 - 2010-11-04 - WooChunPark
 
    • Cern Search Icon Cern Search
    • TWiki Search Icon TWiki Search
    • Google Search Icon Google Search

    Main All webs login

This site is powered by the TWiki collaboration platform Powered by PerlCopyright & 2008-2019 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding TWiki? Send feedback