Difference: HltRates230715 (1 vs. 3)

Revision 32015-07-23 - MikaVesterinen

Line: 1 to 1
 
META TOPICPARENT name="Hlt2Rates"

Results

Changed:
<
<
At this location http://mvesteri.web.cern.ch/mvesteri/HLT2015/test_230715/MooreOnline_HEAD_v2/
>
>
At this location http://mvesteri.web.cern.ch/mvesteri/HLT2015/test_230715/MooreOnline_HEAD_v1/
 

How these results were produced

Note that these instructions will quickly become obsolete during this busy commissioning phase. Since this requires the HltDecReportsTuple which lives in Hlt/IndependenceTests,
Line: 15 to 15
 SetupProject --nightly lhcb-gaudi-head TUE MooreOnline HEAD --build-env getpack Hlt/HltSettings head getpack Hlt/Hlt2Lines head
Changed:
<
<
getpack Hlt/Hlt2Conf head
>
>
getpack Hlt/HltConf head
 getpack Hlt/Hlt2CommissioningScripts head cmt br make -j 8 cd $User_release_area/MooreOnline_HEAD/Hlt/Hlt2CommissioningScripts SetupMooreOnline HEAD --nightly lhcb-gaudi-head TUE
Changed:
<
<
gaudirun.py scripts/HltRateTests/MooreRatesLocalRealData.py | tee stdout
>
>
gaudirun.py scripts/HltRateTests/MooreRatesLocalRealData.py scripts/HltRateTests/Moore10000Events.py | tee stdout
  ### some paths
Changed:
<
<
export outdir=/afs/cern.ch/work/m/mvesteri/TMP/HLT2015OUTPUT/test230715_v2/ export DATAPATH=/afs/cern.ch/work/m/mvesteri/TMP/HLT2015OUTPUT/test230715_v2/ export WEBDIR=/afs/cern.ch/user/m/mvesteri/www/HLT2015/test_230715/MooreOnline_HEAD_v2/
>
>
export outdir=/afs/cern.ch/work/m/mvesteri/TMP/HLT2015OUTPUT/test230715_v1/ export DATAPATH=/afs/cern.ch/work/m/mvesteri/TMP/HLT2015OUTPUT/test230715_v1/ export WEBDIR=/afs/cern.ch/user/m/mvesteri/www/HLT2015/test_230715/MooreOnline_HEAD_v1/
  ### copy the output into the right place cd $User_release_area/MooreOnline_HEAD/Hlt/Hlt2CommissioningScripts
Line: 37 to 37
 ### make all the tables cd $User_release_area/MooreOnline_HEAD/Hlt/Hlt2CommissioningScripts source scripts/HltRateTests/MakeAllTables.sh ${DATAPATH} ${WEBDIR}
Added:
>
>
echo "DONE!" echo "point your browser at:" echo "http://mvesteri.web.cern.ch/mvesteri/HLT2015/test_230715/MooreOnline_HEAD_v1"
 %ENDCODE%
Changed:
<
<
And the output appears here http://mvesteri.web.cern.ch/mvesteri/HLT2015/test_230715/MooreOnline_HEAD_v2/
>
>
And the output appears here http://mvesteri.web.cern.ch/mvesteri/HLT2015/test_230715/MooreOnline_HEAD_v1/
  -- MikaVesterinen - 2015-07-23

Revision 22015-07-23 - MikaVesterinen

Line: 1 to 1
 
META TOPICPARENT name="Hlt2Rates"
Changed:
<
<
Step1: Produce the HltSettings file with all lines included
TODO: This step requires that you add a line to HltLine.py in Hlt/HltLine Add to the Hlt2Line class init function this print statement
<!-- SyntaxHighlightingPlugin -->
print "HLT2_LINE: Hlt2%s" %name
<!-- end SyntaxHighlightingPlugin -->
Then run Moore to print out the list of line names, and then convert them into a python list that we can dump straight in the settings.
<!-- SyntaxHighlightingPlugin -->
gaudirun.py scripts/HltRateTests/RunMoore_GetLineNames.py | tee RunMoore_GetLineNames.log
grep "HLT2_LINE" RunMoore_GetLineNames.log > lines.list
python scripts/HltRateTests/get_line_array.py lines.list > Lines.py
<!-- end SyntaxHighlightingPlugin -->
Now you need to copy the array in Lines.py into the Hlt2Settings file, python/HltSettings/Commissioning_AllHlt2Lines_2015.py. And rebuild with cmt or CMake.
>
>

Results

At this location http://mvesteri.web.cern.ch/mvesteri/HLT2015/test_230715/MooreOnline_HEAD_v2/

How these results were produced

Note that these instructions will quickly become obsolete during this busy commissioning phase. Since this requires the HltDecReportsTuple which lives in Hlt/IndependenceTests, which now lives only in MooreOnline, we need to use that instead of "offline" Moore. Full setup, start to finish %CODE{ lang="bash"}% ### Moore HEAD setup (TUE 21st July nightlies) cd $User_release_area SetupMooreOnline HEAD --build-env --nightly lhcb-gaudi-head TUE SetupProject --nightly lhcb-gaudi-head TUE MooreOnline HEAD --build-env getpack Hlt/HltSettings head getpack Hlt/Hlt2Lines head getpack Hlt/Hlt2Conf head getpack Hlt/Hlt2CommissioningScripts head cmt br make -j 8 cd $User_release_area/MooreOnline_HEAD/Hlt/Hlt2CommissioningScripts SetupMooreOnline HEAD --nightly lhcb-gaudi-head TUE gaudirun.py scripts/HltRateTests/MooreRatesLocalRealData.py | tee stdout
 
Changed:
<
<
Step 2: Run Moore with these settings
Optionally, you an check that Moore runs OK
<!-- SyntaxHighlightingPlugin -->
gaudirun.py scripts/HltRateTests/MooreRatesLocalRealData.py 
<!-- end SyntaxHighlightingPlugin -->
Then run the following, sending the output to some directory on afs.
<!-- SyntaxHighlightingPlugin -->
outdir=/afs/cern.ch/work/m/mvesteri/TMP/HLT2015OUTPUT/test140715_v2/
mkdir -p ${outdir}
outdir=${outdir}/0/output/
mkdir -p ${outdir}
gaudirun.py scripts/HltRateTests/MooreRatesLocalRealData.py | tee ${outdir}/stdout
cp tuples.root ${outdir}
cp hists.root ${outdir}
<!-- end SyntaxHighlightingPlugin -->
Note that this is supposed to create a ganga output like directory structure.
>
>
### some paths export outdir=/afs/cern.ch/work/m/mvesteri/TMP/HLT2015OUTPUT/test230715_v2/ export DATAPATH=/afs/cern.ch/work/m/mvesteri/TMP/HLT2015OUTPUT/test230715_v2/ export WEBDIR=/afs/cern.ch/user/m/mvesteri/www/HLT2015/test_230715/MooreOnline_HEAD_v2/
 
Changed:
<
<
Step3: Run over the tuples and produce some tables.
scripts/HltRateTests/MakeAllTables.sh you need to have some web accessible area on /afs/..., which you can request from the CERN computing pages.
<!-- SyntaxHighlightingPlugin -->
export WEBDIR=/afs/cern.ch/user/m/mvesteri/www/HLT2015/test_150715/Moore_v23r7p5_v1/
mkdir -p ${WEBDIR}
<!-- end SyntaxHighlightingPlugin -->
Then merge the root files
<!-- SyntaxHighlightingPlugin -->
export DATAPATH=/afs/cern.ch/work/m/mvesteri/TMP/HLT2015OUTPUT/test140715_v2/
export MERGEDROOTFILE=merged.root
files=`ls ${DATAPATH}/*/output/tuples.root`
hadd -f ${MERGEDROOTFILE} ${files}
<!-- end SyntaxHighlightingPlugin -->
Then run this script to analyse the HltDecReportTuples
<!-- SyntaxHighlightingPlugin -->
./scripts/HltRateTests/StudyHLT2Tuple.py ${MERGEDROOTFILE} AllStreams | tee AllStreams.log
<!-- end SyntaxHighlightingPlugin -->
And then this one to publish the results as a .html table
<!-- SyntaxHighlightingPlugin -->
mkdir -p ${WEBDIR}/Rates
python scripts/HltRateTests/MakeHTML_RatesByStream.py ${WEBDIR}/Rates
<!-- end SyntaxHighlightingPlugin -->
Which should look something like this http://mvesteri.web.cern.ch/mvesteri/HLT2015/test_150715/Moore_v23r7p5_v1/Rates/AllStreams/
>
>
### copy the output into the right place cd $User_release_area/MooreOnline_HEAD/Hlt/Hlt2CommissioningScripts mkdir -p ${outdir}/0/output/ cp stdout ${outdir}/0/output/ cp tuples.root ${outdir}/0/output/ cp hists.root ${outdir}/0/output/
 
Added:
>
>
### make all the tables cd $User_release_area/MooreOnline_HEAD/Hlt/Hlt2CommissioningScripts source scripts/HltRateTests/MakeAllTables.sh ${DATAPATH} ${WEBDIR} %ENDCODE% And the output appears here http://mvesteri.web.cern.ch/mvesteri/HLT2015/test_230715/MooreOnline_HEAD_v2/
  -- MikaVesterinen - 2015-07-23 \ No newline at end of file

Revision 12015-07-23 - MikaVesterinen

Line: 1 to 1
Added:
>
>
META TOPICPARENT name="Hlt2Rates"
Step1: Produce the HltSettings file with all lines included
TODO: This step requires that you add a line to HltLine.py in Hlt/HltLine Add to the Hlt2Line class init function this print statement
<!-- SyntaxHighlightingPlugin -->
print "HLT2_LINE: Hlt2%s" %name
<!-- end SyntaxHighlightingPlugin -->
Then run Moore to print out the list of line names, and then convert them into a python list that we can dump straight in the settings.
<!-- SyntaxHighlightingPlugin -->
gaudirun.py scripts/HltRateTests/RunMoore_GetLineNames.py | tee RunMoore_GetLineNames.log
grep "HLT2_LINE" RunMoore_GetLineNames.log > lines.list
python scripts/HltRateTests/get_line_array.py lines.list > Lines.py
<!-- end SyntaxHighlightingPlugin -->
Now you need to copy the array in Lines.py into the Hlt2Settings file, python/HltSettings/Commissioning_AllHlt2Lines_2015.py. And rebuild with cmt or CMake.

Step 2: Run Moore with these settings
Optionally, you an check that Moore runs OK
<!-- SyntaxHighlightingPlugin -->
gaudirun.py scripts/HltRateTests/MooreRatesLocalRealData.py 
<!-- end SyntaxHighlightingPlugin -->
Then run the following, sending the output to some directory on afs.
<!-- SyntaxHighlightingPlugin -->
outdir=/afs/cern.ch/work/m/mvesteri/TMP/HLT2015OUTPUT/test140715_v2/
mkdir -p ${outdir}
outdir=${outdir}/0/output/
mkdir -p ${outdir}
gaudirun.py scripts/HltRateTests/MooreRatesLocalRealData.py | tee ${outdir}/stdout
cp tuples.root ${outdir}
cp hists.root ${outdir}
<!-- end SyntaxHighlightingPlugin -->
Note that this is supposed to create a ganga output like directory structure.

Step3: Run over the tuples and produce some tables.
scripts/HltRateTests/MakeAllTables.sh you need to have some web accessible area on /afs/..., which you can request from the CERN computing pages.
<!-- SyntaxHighlightingPlugin -->
export WEBDIR=/afs/cern.ch/user/m/mvesteri/www/HLT2015/test_150715/Moore_v23r7p5_v1/
mkdir -p ${WEBDIR}
<!-- end SyntaxHighlightingPlugin -->
Then merge the root files
<!-- SyntaxHighlightingPlugin -->
export DATAPATH=/afs/cern.ch/work/m/mvesteri/TMP/HLT2015OUTPUT/test140715_v2/
export MERGEDROOTFILE=merged.root
files=`ls ${DATAPATH}/*/output/tuples.root`
hadd -f ${MERGEDROOTFILE} ${files}
<!-- end SyntaxHighlightingPlugin -->
Then run this script to analyse the HltDecReportTuples
<!-- SyntaxHighlightingPlugin -->
./scripts/HltRateTests/StudyHLT2Tuple.py ${MERGEDROOTFILE} AllStreams | tee AllStreams.log
<!-- end SyntaxHighlightingPlugin -->
And then this one to publish the results as a .html table
<!-- SyntaxHighlightingPlugin -->
mkdir -p ${WEBDIR}/Rates
python scripts/HltRateTests/MakeHTML_RatesByStream.py ${WEBDIR}/Rates
<!-- end SyntaxHighlightingPlugin -->
Which should look something like this http://mvesteri.web.cern.ch/mvesteri/HLT2015/test_150715/Moore_v23r7p5_v1/Rates/AllStreams/

-- MikaVesterinen - 2015-07-23

 
This site is powered by the TWiki collaboration platform Powered by PerlCopyright & 2008-2019 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding TWiki? Send feedback