TRTCalibConstsUploadDB < Sandbox

<!-- This is the default ATLAS template. 
Please modify it in the sections indicated to create your topic! In particular, notice that at the bottom there are some sections that must be filled for publicly accessible pages.
If you have any comments/complaints about this template, then please email : Patrick Jussel (patrick dot jussel at cern dot ch) and/or Maria Smizanska (maria dot smizanska at cern dot ch)
--> 

<!-- By default the title is the WikiWord used to create this topic -->
<!-- if you want to modify it to something more meaningful, just replace %TOPIC% below with i.e "My Topic"-->
<!---------------------------------------------------------  snip snip ----------------------------------------------------------------->

---+!!<nop> TRT Offline Calibration Constants Upload in the DataBase
%TOC%     <!--optional-->
%STARTINCLUDE%

---+Introduction
<!-- Add an introduction here, describing the purpose of this topic. --> 
Each data run need the optimal calibration constants in the DB.
You have to be sure of the goodness of the calibration constants, before to do the upload!!!

---+Step 0
comments about Permissions


---+Step 1

---+ 
---+ Find calibout_0x.txt
Find the location of the text file that contains the t0 and Rt calibration constants to upload.
Example: =/afs/cern.ch/user/i/idcalib/w0/TRT_Calibration/shifterCollisions2010_30march/run_165591/batch/input/calibout_03.txt=
(describe constants here or link to another twiki page)

---+ The procedure

there are two ways to proceed, they are equivalent.

1) create three times pool and cool files
2) create pool and cool once, then make a copy of the tags

---+Before
Go to the folder =/afs/cern.ch/user/i/idcalib/w0/TRT_Calibration/uploadedDB=
and then move to right kind of constants you are going to uploads
(=MCCollisions=, =MCCosmics=, =Collisions=, =Cosmics=)

Create a folder inside with the tag name and some other info (See other folders as example) 
For each set of contants to be upload, create a README. Use as example:
=/afs/cern.ch/user/i/idcalib/w0/TRT_Calibration/uploadedDB/Cosmics/TrtCalibT0-HLT-UPD1-Field-01_For_Xe_Run_135146_2/README=


---+Create Pool and Cool
<!--Add the main topic here. i.e. create some new headings as follows: -->





Go to the [[https://trtofflinecalibration.web.cern.ch/TRTOfflineCalibration/control/default.cgi][Calibration Display]].
Check that the calibrated run (that provides the constants) has been added to the calibration display list.
If not, see [[https://twiki.cern.ch/twiki/bin/view/Atlas/TRTOfflineCalibrationShifterGuide#6_Include_the_calibration_in_the][Shifter's Guide]].
The Calibration Display tool allows to easily create *pool* and *cool* files.

Select the calibration number (for example n.1145) and click on the button "Pool & Cool".

The list of the txt files with the calibration constants from all the iterations run should be visible.

Select both rt and t0 for the txt file constants you want to use, and keep the tags as they are: 
they should be *TrtCalibRt-Physics-UPD1-FieldOn-00-00* and *TrtCalibT0-Physics-UPD1-FieldOn-00-00*
for example www/archive/calib01145/batch/input/calibout_03.txt 

Now click *Go!* and be patient, it can take up to 2 minutes!

In the empty box will appear this information:

Rt file:        /afs/cern.ch/user/i/idcalib/w0/TRT_Calibration/www/archive/calib01145/batch/input/calibout_03.txt
T0 file:        /afs/cern.ch/user/i/idcalib/w0/TRT_Calibration/www/archive/calib01145/batch/input/calibout_03.txt
Upload dir:        /afs/cern.ch/user/a/attrtcal/upload/upload_e20bdd1e855288973e929b224fac9d9a
Added tags:        TrtCalibT0-Physics-UPD1-FieldOn-00-00, TrtCalibRt-Physics-UPD1-FieldOn-00-00
Logfiles:        txt2db.log

Now change the tags to * ES1-UPD1 * and * * for Rt and t0

Click *Go!* again!

Then do the same for * BLK-UPD4* and * * 
REP-159041 ... BUT for the last one also select "verify"

Summary: we have done *UPD1*, *ES1-UPD1*, *BLK-UPD4* and *REP-175652*

Tags added in:        /afs/cern.ch/user/a/attrtcal/upload/upload_e20bdd1e855288973e929b224fac9d9a/mycool.db
Added tags:        TrtCalibT0-Physics-REP-159041-00, TrtCalibRt-Physics-REP-159041-00
Logfiles:        txt2db.log
T0 difference:        max diff between original txt file and DB constants = 0.100000 ns (average diff = 0.100000 ns)
Tags Found:        TrtCalibRt-Physics-BLK-UPD4-FieldOn-00-00
TrtCalibRt-Physics-ES1-UPD1-FieldOn-00-00
TrtCalibRt-Physics-REP-159041-00
TrtCalibRt-Physics-UPD1-FieldOn-00-00
TrtCalibT0-Physics-BLK-UPD4-FieldOn-00-00
TrtCalibT0-Physics-ES1-UPD1-FieldOn-00-00
TrtCalibT0-Physics-REP-159041-00
TrtCalibT0-Physics-UPD1-FieldOn-00-00
Logfiles:        db2txt.log comp.log

use the python script to compare

go to  /afs/cern.ch/user/a/attrtcal/upload/upload_e20bdd1e855288973e929b224fac9d9a/

you will see the files

calib.txt is the same as calibout_start_-0.4ns.txt
and caliboutput.txt is what will end up in the DB

CompareT0s.py
[9:51:17 PM] S.: /afs/cern.ch/user/i/idcalib/w0/TRT_Calibration/uploadedDB/testScripts/CompareT0s.py
[9:51:38 PM] S.: the txt files are the same, the only difference is
[9:51:44 PM] Johan Lundquist: and you added 0.6 .. which will be rounded to 0.5
[9:51:46 PM] S.: the line -3 -1 -1 -1 -1 : 11.100000 0.000000

END
-3 -1 -1 -1 -1 : 11 0

 copy this whole directory to the uploadDB/Collisions/ area

now we have to do pool and cool upload!

copy this whole directory to /afs/cern.ch/user/i/idcalib/w0/TRT_Calibration/uploadedDB/Collisions/multiple_tags

rename folder upload_e20bdd1e855288973e929b224fac9d9a/ in bla bla

so lets first do the pool upload

better log in from start on lxplus in a clean shell as yourself 

cd to the directory

source /afs/cern.ch/user/i/idcalib/w0/TRT_Calibration/uploadedDB/Jul09FastReprocessing/testarea/cmthome/setup.sh -tag=15.6.7,32,runtime

bocchett@lxplus202:~/TRT_Calibration/uploadedDB/Collisions/multiple_tags/Tue_Jul_13_21:58:00_2010$ /afs/cern.ch/user/a/atlcond/utils/registerFiles2 --wait cond10_data.gen.COND pooloutputfile.root
Registering files into dataset cond10_data.gen.COND
pooloutputfile.root assigned request ID 56ed9f2d-3e7b-4dbd-8bc9-ae1903a20d26
Waiting for 1 requests to be completed at Tue Jul 13 22:06:30 2010
Waiting for 1 requests to be completed at Tue Jul 13 22:06:50 2010
Waiting for 1 requests to be completed at Tue Jul 13 22:07:10 2010


Processed POOL file registration request 56ed9f2d-3e7b-4dbd-8bc9-ae1903a20d26 with return code 0

[Tue Jul 13 22:06:55 2010] Attempting to extract POOL GUID from file
[Tue Jul 13 22:07:06 2010] File GUID determined to be 3A353E69-B58E-DF11-ABE9-0030487CCB62
[Tue Jul 13 22:07:06 2010] Pre-checks completed successfully
[Tue Jul 13 22:07:06 2010] Executing dq2-put --client-id=cond -a -C
--local-site=CERN-PROD_SPECIALDISK --guid=3A353E69-B58E-DF11-ABE9-0030487CCB62
--source=/afs/cern.ch/atlas/conditions/poolcond/buffer/pending/cond10_data.gen.COND
--files=p0oloutputfile.root.56ed9f2d-3e7b-4dbd-8bc9-ae1903a20d26 cond10_data.000012.gen.COND
[Tue Jul 13 22:07:06 2010] Please wait ...
[Tue Jul 13 22:07:19 2010] cond10_data.000012.gen.COND is open, you are adding files to the current
version
Gathering list of files... done
p0oloutputfile.root.56ed9f2d-3e7b-4dbd-8bc9-ae1903a20d26: pre-checking file

Checking for GUID clashes

cond10_data.000012.gen.COND -- confirm adding files to dataset (1 file):
 (3A353E69-B58E-DF11-ABE9-0030487CCB62 ad:6988c66b 256804)
cond10_data.000012.gen.COND._0002.pool.root
Confirm (y/n)?
Automatic confirm
Confirmed
lcg-cp -v --vo atlas -b -D srmv2 -S ATLASSPECIALDISK
file:///afs/cern.ch/atlas/conditions/poolcond/buffer/pending/cond10_data.gen.COND/p0oloutputfile.ro
ot.56ed9f2d-3e7b-4dbd-8bc9-ae1903a20d26
srm://srm-atlas.cern.ch:8443/srm/managerv2?SFN=/castor/cern.ch/grid/atlas/atlasspecialdisk/cond10_d
[10:10:43 PM] S.: (you will not see output until the command is finished)
lcg-cp -v --vo atlas -b -D srmv2 -S ATLASSPECIALDISK
file:///afs/cern.ch/atlas/conditions/poolcond/buffer/pending/cond10_data.gen.COND/p0oloutputfile.ro
ot.56ed9f2d-3e7b-4dbd-8bc9-ae1903a20d26
srm://srm-atlas.cern.ch:8443/srm/managerv2?SFN=/castor/cern.ch/grid/atlas/atlasspecialdisk/cond10_d
ata/000012/gen/cond10_data.000012.gen.COND/cond10_data.000012.gen.COND._0002.pool.root: done
cond10_data.000012.gen.COND._0002.pool.root: verifying
cond10_data.000012.gen.COND._0002.pool.root: OK (3A353E69-B58E-DF11-ABE9-0030487CCB62)
Dataset cond10_data.000012.gen.COND updated Dataset cond10_data.000012.gen.COND registered at
location CERN-PROD_SPECIALDISK with status OPEN
Finished
[Tue Jul 13 22:07:19 2010] Castor/LFC/DQ2 Registration completed successfully

now the cool upload

Copying finished after 8 AtlCoolCopy runs and 0 failures


COPY in LOGFILE and add in the README

take note of the files
 so first run for UPD4 is 158996 and for UPD1 is 159086

1) README
2) verify
3) mail
 

<!--***********************************************************-->
<!--Do NOT remove the remaining lines, but add requested info as appropriate-->
<!--***********************************************************-->

-----
<!--For significant updates to the topic, consider adding your 'signature' (beneath this editing box)-->

<!--Person responsible for the page: 
Either leave as is - the creator's name will be inserted; 
Or replace the complete REVINFO tag (including percentages symbols) with a name in the form Main.TwikiUsersName-->

<!--Once this page has been reviewed, please add the name and the date e.g. Main.StephenHaywood - 31 Oct 2006 -->

%STOPINCLUDE%


-- Main.SimonaBocchetta - 24-Sep-2010
Topic revision: r4 - 2011-02-21 - SimonaBocchetta
Account
- Log In
- Cern Search
- TWiki Search
- Google Search
Sandbox All webs
Edit
Attach
Copyright &© 2008-2021 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
or Ideas, requests, problems regarding TWiki? use Discourse or Send feedback