How to turn on DAQ equipment after a long shutdown or power cut

From the start of the recovery operation, do regularly post on slack what your intentions are and don't hesitate to ask for help! Post an elog at the start and at the end of the recovery, indicating what difficulties you encountered.

Preliminaries

Go to the NP04 control room and check on the DCS that the cooling circuit for the racks is operational (see CheckWaterCooling attachment below). If the DAQ room temperature is >24 C or the inlet water pressure is < 6 Bar it is NOT safe to turn on equipment. Call the NP04DCS on call number.

If all is OK, go to the DAQ barrack at EHN1 with a laptop. Verify that the network switches in racks 5 and 6 are on. Verify that the disk bays in rack 4 are powered on.

Turning on things

Turn on np04-srv-007 and np04-srv-008, These are the two NFS file servers. When those are up, turn on np04-srv-023: this machine also serves an nfs area to the storage servers. Then you can start bringing up other nodes. Do them in groups of four and take the time to check:
  • availability of file systems (the df command should show the mount points for nfs and the storage volumes for np04-srv-001..4)
  • correct functioning of supervisord (service supervisord status; if needed you can start the service with sudo service supervisord start )

Turn on np04-srv-023. This is the online monitoring computer.

  • np04_srv_001 to np04_srv_004 mount the OMoutput disk from np04-srv-023.

Once all hosts are on, from np04-srv-001 to np04-srv-026, you have to do the following:

  • login to np04-srv-010 and make sure that the WinCCOA project is stopped (see here).
  • login to np04-srv-024 and make sure that the WinCCOA project is running (see here).

Now it's time to turn on specific DAQ hardware:

  • Turn on np04-onl-01 (in rack 6). This server allows you to re-program the CTB and timing units if needed.
  • Turn on the CTB, the timing system units and the NIM crates in rack 8.
  • Re-program the timing systems following instructions here.
  • Check the status of the CTB following instructions here.
  • Go to the CRT rack close to the yellow fenced area, turn on the PC (np04-crt-001). Once it is up you can program also the CRT timing (PDTS_PRIMARY).
  • Connect the power cords of the ATCA shelf, if needed.

DAQ test

Now it's time to turn on our DAQ:
  • Ask the run coordinator or DCS expert to turn on low voltage for the TPC CE (WIBs) and the PD (SSPs).
  • Manually fix COB 8 as described here.
  • Take partition 0, include all components, configure the system with the latest configuration advertised here and see how far you get!

-- GiovannaLehmannMiotto - 2018-12-14

Edit | Attach | Watch | Print version | History: r7 < r6 < r5 < r4 < r3 | Backlinks | Raw View | Raw edit | More topic actions...
Topic revision: r4 - 2018-12-14 - GiovannaLehmannMiotto
 
    • Cern Search Icon Cern Search
    • TWiki Search Icon TWiki Search
    • Google Search Icon Google Search

    CENF All webs login

This site is powered by the TWiki collaboration platform Powered by PerlCopyright & 2008-2021 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
or Ideas, requests, problems regarding TWiki? use Discourse or Send feedback