My Notes

People and their vacations

LIP Vacations Table

Software

Reyes' presentations in Indico, Pasquale's presentations in Indico, Pedro's Wiki ECAL Meetings

Installing XDAQ and TriDAS ECAL CVS

Show... Hide

XDAQ files at Sourceforge and detailed Installation instructions

tar -zxf coretools_G_17559_V3_5_2.tgz

tar --exclude ./TriDAS/config -zxf powerpack_G_28175_V1_4_3.tgz

tar --exclude ./TriDAS/daq/Makefile -zxf worksuite_G_28176_V1_5_1.tgz

export XDAQ_ROOT=`pwd`/TriDAS

make -C $XDAQ_ROOT/daq Set=extern

make -C $XDAQ_ROOT/daq Set=coretools

make -C $XDAQ_ROOT/java Set=xdaq3

make -C $XDAQ_ROOT/daq Set=powerpack

make -C $XDAQ_ROOT/daq Set=worksuite

# CAEN driver "instructions" here

wget -P /tmp http://cmsdoc.cern.ch/~cschwick/software/distribution/CAEN/CAENVME_v2-4_CMS-02.tgz

cd /tmp && tar -xzvf /tmp/CAENVME_v2-4_CMS-02.tgz

cd /tmp/CAENVME

su root

./installCAEN.pl

(say yes to questions)

cd /usr/local/CAEN/CAENVME-Rev2.4/Linux/driver/v2718/

chmod +x a2818_load.`uname -r | cut -b-3` && ./a2818_load.`uname -r | cut -b-3`

(add to /etc/rc.d/rc.local)

# SBS driver "instructions" here

wget -P /tmp http://cmsdoc.cern.ch/~cschwick/software/distribution/SBS/SBS_v2p3p0_CMS-01.tgz

cd /tmp && tar -xzvf /tmp/SBS_v2p3p0_CMS-01.tgz

cd /tmp/SBS

su root

ln -sf /usr/src/linux-2.4 /usr/src/linux && rm -rf /usr/local/SBS

./installSBS

(say yes to questions)

/usr/local/SBS/1003/v2p3p0/sys/mkbtp

(add to /etc/rc.d/rc.local)

#HAL (9000?)

cd $XDAQ_ROOT/daq/hal

./configure.pl && make

#Fedkit

make -C $XDAQ_ROOT/daq/itools/

#PHeaps

make -C $XDAQ_ROOT/daq/pheaps/

make -C $XDAQ_ROOT/daq/pheaps/drv/bigphys/

su

make -C $XDAQ_ROOT/daq/pheaps/drv/bigphys/ load

(add to /etc/rc.d/rc.local and add bigphysarea=131072 in /etc/grub.conf)

cd $XDAQ_ROOT

cvs -d ":kserver:isscvs.cern.ch:/local/reps/tridas" co ecal

#project TriDAS && cvs co ecal

cd $XDAQ_ROOT/ecal/config

./makenv.sh

source env.sh

make -C $XDAQ_ROOT/ecal/gconfig install

for package in ecalBase ecalCommonTools ecalRootTools ecalDB ecalDataDecoder; do make -C $XDAQ_ROOT/ecal/$package; done

for package in ecalCrateScanner ecalDCC ecalSLB ecalDCCTester ; do make -C $XDAQ_ROOT/ecal/$package all; done

Configuration tips

• Edit $XDAQ_ROOT/daq/xdaq/etc/profile.xml and in the Executive replace DEBUG with INFO or run xdaq with log level INFO, DEBUG, WARN or ERROR by appending the -l LOGLEVEL option
• (not working with new CVS server) RSS feed of the CMS CVS server at http://cmsdoc.cern.ch/swdev/cvsserver/rss/TriDAS@ecal.rss (repository@moduleNOSPAMPLEASE.rss)
• If using bash and an afs CERN account in the zh group, include source /afs/cern.ch/cms/sw/cmsset_default.sh to your ~/.bashrc

Databases

• After source /etc/hepix/oracle_env.sh or source /afs/cern.ch/project/oracle/script/setoraenv.sh -s 10102gcc323 and export NLS_LANG= one can use sqlplus test04|cond01|read04/ora@ecalh4db
• The TNS to hostname translation is at /afs/cern.ch/project/oracle/admin/tnsnames.ora
• From ROOT one can use s = TSQLServer::Connect("oracle://pccmsecdb.cern.ch/ecalh4db","test04","ora")
• how to store TH1S in a BLOB ?!

DAQ links

CMS Wiki, TriDAS, XDAQ, XDAQ Coretools API, HAL Documentation, HAL API, Quick Reference for CVS (from xdaqwiki), CMS CVS Repository, TriDAS CVS, Ecal CVS, RU builder, RU Builder Manual, DAQKit, RCMS - Run Control CMSSW

How to use XDAQ path expansion and remote files

Hardware

People:

• Ze Carlos and Michal

Programming of the boards without a cable

Show... Hide

Crucial for a running experiment, since there are 12*3*( 1 DCC + 1 CCS + 1 TCC68 )+6*3*( 1 DCC + 1 CCS + 4 TCC48 ) = 216 boards, out of which 54 DCCs.

MTM

Nuno Cardoso started working on a board to do that using the MTM part of the VME64 bus. This guarantees compatibility with all boards in the ECAL but it requires a lot of work and the production of the corresponding boards.

VME bridge + software

Software for programming FPGAs

• Altera: Jamplayer - port to linux exists: jamplayer_linux.tar.gz
• Xilinx: xapp058 - port to linux exists: xapp058_v5.01bfad0.4.tgz

Jam vs. SVF

To have an idea of what Jam and SVF look like for the same thing (from the Altera site):

TRST ABSENT;
ENDDR IDLE;
ENDIR IDLE;
STATE IDLE;
SIR 10 TDI (00D);
SDR 13646 TDI (...);
STATE RESET;
STATE IDLE;

The first line denotes that the TRST pin is unused. The two subsequent lines prompt the SVF parser to bring the JTAG state machine back to IDLE state after every instruction and data. The I/O reconfiguration process starts in IDLE state and proceed to execute the CONFIG_IO instruction (with code 00D). This is followed by the long IOCSR data being shifted in (shown by “…”). Since there is no more JTAG instruction follows, a cycle through the RESET state and back to IDLE state is executed.

The algorithm is very straight forward and simple. The user can copy and embed this routine into any existing SVF-based test routines to perform I/O reconfiguration.

NOTE MAX_FREQ "10000000";
ACTION CONFIG_IO = EXECUTE;
PROCEDURE EXECUTE;
BOOLEAN X = 0;
DRSTOP IDLE;
IRSTOP IDLE;
STATE IDLE;
IRSCAN 10, $00D;
DRSCAN 13646,
$...;
STATE RESET;
STATE IDLE;
EXIT 0;
ENDPROC;

The first line denotes that the recommended maximum frequency for TCK is 10MHz. The action name for I/O reconfiguration procedure is “CONFIG_IO”. The rest is the same as stated in “Using SVF Output File” section.

Again, the user can copy and embed this procedure into any existing JAM-based test routines to perform I/O reconfiguration. To use it with Altera’s JAM Player, type: jam –aCONFIG_IO .jam

Hardware

The JTAG scan bridge used is the SCANSTA111. It provides 3 chains:

• Chain 0 goes to Boundary scan of all other components + the VME bridge Altera FPGA
• Chain 1 goes to the Alteras
• Chain 2 goes to the Xilinxs
• The S0-4 pins are connected to the MTM ID (active low: board 1 has ID 0x1e); S5-6 are grounded

Geographical addressing (based on ANSI/VITA 1.1-1997)

The VME bridge FPGA is connected to the scan bridge in the DCC. That is not the case in the TCC48s.

The JTAG chain B (backplane) of the scan bridge can be accessed via the VME board address, offset 0x000744, where the 32-bit register maps to:

• TRST - Maps to the TRST input of the scan bridge. Writing a one keeps the TRST high for XX microseconds.
• TCKMask - 8 bit mask defining which of the bits in the TMS and TDI are valid. The state machine will shift from the LSB and stop as soon as it sees a 0 in this mask, therefore subsequent one are ignored.
• TMS and TDI - 8 bit fields with the JTAG information to be shifted
• TDO - After a write operation (with Enable=1), a read operation puts the TDO bits such that the MSB is the first bit shifted out.

Operations available on 0x000744:

• To shift 8 bits into the JTAG chain write 0x00.ff.xx.yy, where xx ( yy) are 8 TMS (TDI) bits. Reading the register after this will return 0x80.ff.xx.zz, where zz are the 8 TDO bits from the chain.
• To write fewer than 8 bits, define a mask using the TCKMask field (e.g. 0x01, 0x03, 0x07, 0x0f, 0x1f, etc)
• To reset the scan bridge to its default state (and possibly address a different chain) TRST needs to be asserted. This can be done by writing 0x01.00.00.00

Steps

1. Define register in VME bridge and protocol
2. Route register bits to JTAG lines and cycle TCK only on write access (JCS)
3. Route EvBuilder LED to activity in JTAG register (JCS)
4. Test access to register with HAL (AD)
5. Check correct activity on JTAG lines
6. Connect LEDs to Y0 (pin 30) and Y1 (pin 41)
7. Test selection of individual ports with HAL (AD)
8. Develop interface to existing programming software (AD)
9. Define bitfile format for programming of the chains (JCS)
10. Test programming FPGAs through individual ports with HAL (AD)
11. Extend to Xilinx
12. Solve the Altera Eprom programming problem
13. Interface with ECAL Supervisor and CMS databases (AD)
14. Test parallel programming of boards in the same crate (AD)

USC55

Links: Level 1, Crates and racks, ECAL Elog

DCC, TCC and SRP codes

From ECAL raw data format v1.5:

Overview

Old Machines Hide

| Name | Short | Crate | FED | FEDs | Con | Geo | Partition | Note | Caen PCI fw | LHC crate | Model | Note |

EE-
vmepcS2F19-01	ecalod-01	ecalod-S2D04l	ecalfed-601	609 601 602	D3 D3 D3	-06 -07* -08*	ecalod-EEm1			7185 0022	SC1425
vmepcS2F19-02	ecalod-02	ecalod-S2D03l	ecalfed-603	603 604 605	D3 D4 D4	-09 -01 -02*	ecalod-EEm2			7185 0021	SC1425
vmepcS2F19-03	ecalod-03	ecalod-S2D08l	ecalfed-606	606 607 608	D4 D4 D4/3	-03* -04 -05	ecalod-EEm3			7185 0008	SC1425
EB-
vmepcS2F19-04	ecalod-04	ecalod-S2D04d	ecalfed-610	610 611 612	24 22 13	-01 -02 -03	ecalod-EBm1		A2818:0.8	7185 0014	SC1425
vmepcS2F19-05	ecalod-05	ecalod-S2D02d	ecalfed-613	613 614 615	31 26 16	-04 -05 -06	ecalod-EBm2		A2818:0.8	7185 0018	SC1425
vmepcS2F19-06	ecalod-06	ecalod-S2D03d	ecalfed-616	616 617 618	02 11 05	-07 -08 -09	ecalod-EBm3		A2818:0.8	7185 0012	SC1425
vmepcS2F19-07	ecalod-07	ecalod-S2D07d	ecalfed-619	619 620 621	00 29 28	-10 -11 -12	ecalod-EBm4		A2818:0.8	7185 0007	SC1425
vmepcS2F19-08	ecalod-08	ecalod-S2D08d	ecalfed-622	622 623 624	14 33 32	-13 -14 -15	ecalod-EBm5		A2818:0.8	7185 0019	SC1425
vmepcS2F19-09	ecalod-09	ecalod-S2D06d	ecalfed-625	625 626 627	03 07 19	-16 -17 -18	ecalod-EBm6		A2818:0.8	7185 0017	SC1425
EB+
vmepcS2F19-10	ecalod-10	ecalod-S2D04h	ecalfed-628	628 629 630	12 17 10	+01 +02 +03	ecalod-EBp1		A2818:0.8	7185 0005	SC1425
vmepcS2F19-11	ecalod-11	ecalod-S2D02h	ecalfed-631	631 632 633	01 08 04	+04 +05 +06	ecalod-EBp2		A2818:0.8	7185 0020	SC1425
vmepcS2F19-12	ecalod-12	ecalod-S2D03h	ecalfed-634	634 635 636	27 20 23	+07 +08 +09	ecalod-EBp3		A2818:0.8	7185 0010	SC1425
vmepcS2F19-13	ecalod-13	ecalod-S2D07h	ecalfed-637	637 638 639	25 06 34	+10 +11 +12	ecalod-EBp4		A2818:0.8	7185 0009	SC1425
vmepcS2F19-14	ecalod-14	ecalod-S2D08h	ecalfed-640	640 641 642	35 15 18	+13 +14 +15	ecalod-EBp5		A2818:0.8	7185 0016	SC1425
vmepcS2F19-15	ecalod-15	ecalod-S2D06h	ecalfed-643	643 644 645	30 21 09	+16 +17 +18	ecalod-EBp6		A2818:0.8	7185 0013	SC1425
EE+
vmepcS2F19-16	ecalod-16	ecalod-S2D06l	ecalfed-646	654 646 647	D2 D2 D2	+06 +07* +08*	ecalod-EEp1			7185 0003	SC1425
vmepcS2F19-17	ecalod-17	ecalod-S2D02l	ecalfed-648	648 649 650	D2 D1 D1	+09 +01 +02*	ecalod-EEp2			7185 0004	SC1425	DCCs with 8MB spy memory
vmepcS2F19-18	ecalod-18	ecalod-S2D07l	ecalfed-651	651 652 653	D1 D1 D1/2	+03* +04 +05	ecalod-EEp3			7185 0001	SC1425
SRP and Test
vmepcS2F19-19	ecalod-19	ecalod-S2D05h	ecalfed-661	661 662 663 664			ecalod-srp			SRP	SC1425
vmepcS2F19-20	ecalod-20	ecalod-S2D05e					ecalod-test and ecalod-TTCf		A2818:0.8	TTCf Crate	SC1425
2U Units
vmepcS2F19-21	ecalod-21						ecalod-spare	Hot spare VME	A2818:0.8		2850
vmepcS2F19-22	ecalod-22						ecalod-daq01	Local DAQ 1 and Trigger Supervisor Cell			2850	4x0.5GB
vmepcS2F19-23	ecalod-23						ecalod-daq02 ecalod-evb01	Local DAQ 2 - Event builder ch4			2850	4x2GB
vmepcS2F19-24	ecalod-24						ecalod-daq03 ecalod-evb02	Local DAQ 3 - Event builder ch5			2850	2x2GB+4x0.5GB
vmepcS2F19-25	ecalod-25							old NFS RAID5 1.1TB			2850	(4x0.5GB)
TTC
vmepcS2B16-04	ecalod-26						ecalod-ttc also ttc-ecal	TTCci and LTC control
RCMS
srv-c2d06-06	ecalod-27						ecalod-rc cmsrc-ecal	ECAL RCMS FM
Laser
ecal-laser-room-01	ecalod-28
ecal-laser-room-02	ecalod-29						ecalod-laser-ctrl	ECAL Laser Controller
ecal-laser-room-03
ecal-laser-room-04		- 1xHDD 150GB for OS - ((5-1)HDD x 150GB) RAID5 for /localdata					ecalod-laser-xdaq	ECAL Laser Supervisor
ecal-laser-room-07
ecal-laser-room-08
ecal-laser-room-09
Dual quad cores
srv-s2f19-26	ecalod-30						ecalod-dqm01	DQM node 1			1950	8x2GB
srv-s2f19-27	ecalod-31						ecalod-dqm02	DQM node 2			1950	8x2GB
srv-s2f19-28	ecalod-32						ecalod-xmas	Non-event Data Monitoring and compile node			1950	8x2GB
LED
vmepcs2f18-25	ecalod-33						ecalod-led-ctrl cmseeled	ECAL LED Controller			2950	No CAEN.
Storage Unit
srv-s2f19-29	ecalod-34						ecalod-disk01 also ecalod-web01	ECAL Storage Unit and Local DQM GUI			R410	4x1GB

Crates

In USC55 (links to 904 test results)

Fibre	S2D08	S2D07	S2D06	S2D05	S2D04	S2D03	S2D02
l
h	7185 0016	7185 0009	7185 0013		7185 0005	7185 0010	7185 0020
d	7185 0019	7185 0007	7185 0017	Test Crate	7185 0014	7185 0012	7185 0018

By Location

TTC information

S1E03j crate module	ECAL TTC partition	Obs.
1	LTC
12	EB+
14	EB-
15	EE+	CTC input
17	EE-
19	ES+
21	ES-

LTC FMM inputs

TTCf slot assignment in crate S2D05j