Tile modules power cycles in 2016

The purpose of this twiki is to keep track of the modules which have been power cycled during data taking (starting from 2016), the reason and the actions required to fix the problem (if fixed). This would allow to identify problematic modules for further investigation.

The Tile Run Coordinator is responsible to keep this list up-to-date.

KNOWN PROBLEMATIC MODULES for which power cycle has been disabled: LBA52, EBC06, LBC32

Modules which have been power cycled since 30/05

Here is a list of the modules which have been power cycled since 30/05, when data taking with 2040 colliding bunches started.

Module Date - Run Reason Power cycle Fixed? No more action until
LBA48 30/05 Digital errors (6%) Yes, from DAQ Yes 19/07
LBA52 31/05 - 300600 Digital errors (72%) Yes, from DCS No, still discarding 1% 15/06 and 29/06
LBC05 01/06 - 300655 Digital errors Yes, automatic Yes now
LBC19 02/06 - 300655 Digital errors Yes, automatic Yes 19/07
LBA37 03/06 - interfill No response to CIS Yes, long from DCS Yes 20/06
LBC15 05/06 - 300863 Digital errors (>50%) Yes, automatic Yes 25/07
LBA24 05/06 - 300908 Digital errors (~5%) Yes, from DAQ Yes now
LBC27 05/06 - 300908 Digital errors (~13%) Yes, from DAQ Yes now
LBA05 07/06 - interfill Digital errors Yes, long from DCS Yes now
EBA63 08/06 - interfill Drifting pedestals Yes, long from DCS No (different problem) 18/10
LBA01 10/06 - interfill Digital errors (12%) Yes, long from DCS No -- known module 19/07
EBA04 12/06 - 301932 Digital errors (75%) Yes, from DAQ No, then fixed by automatic reconfiguration now
EBC55 12/06 - 301967 Busy tests Yes, from DAQ No (different problem) 24/08
EBC56 12/06 - 301967 Busy tests Yes, from DAQ No (different problem) 24/08
LBA53 12/06 - 301967 Digital errors (<10% persisting) Yes, from DAQ Yes now
EBA18 13/06 - 301967 Digital errors (<10% persisting) Yes, from DAQ Yes 16/07
EBC61 14/06 - 302033 Digital errors (~20% persisting) Yes, from DAQ Yes now
LBA52 15/06 - 302137 Digital errors (>90%) Yes, from DCS No 29/06
EBC41 15/06 - 302137 Digital errors Yes, automatic Yes 06/07
LBA60 19/06 - 302391 Digital errors (~6%) Yes, from DCS Yes 30/07
EBC15 19/06 - 302391 Digital errors (~6%) Yes, from DAQ Yes now
LBC46 20/06 - 302393 Digital errors (~3%) Yes, from DCS Yes now
LBA37 20/06 - 302393 Digital errors (~100%) Yes, from DAQ Yes now
LBA36 21/06 - 302393 Digital errors (~11%) Yes, from DAQ Yes now
LBA13 21/06 - 302393 Digital errors (~11%) Yes, from DAQ Yes now
LBC45 25/06 - 302829 Discarding events (~45%) Yes, from DAQ Yes now
LBA07 26/06 - 302872 Digital errors (~6%) Yes, from DAQ Yes 01/10
LBC33 26/06 - 302872 Digital errors (~6%) Yes, from DAQ Yes now
LBA52 29/06 - intefill Discarding events (large fraction) Yes, from DCS, for VME crate No now
EBA26 01/07 - 303127 (non-physics) Digital errors (~6%) Yes, from DAQ Yes 06/07
LBA18 02/07 Run 303208 Digital errors (10%) Yes, from DAQ Yes (it worked) now
LBC52 02/07 Run 303208 Digital errors (8%) Yes, from DAQ Yes now
EBA10 03/07 Run 303208 Digital errors Yes, from DAQ and automatic Yes now
EBA58 03/07 Run 303208 Digital errors Yes, from DAQ Yes 29/08
LBA44 03/07 Run 303266 Digital errors Yes, from DAQ Yes now
LBC16 03/07 Run 303266 Digital errors Yes, twice! (mistake of shifter) Yes now
EBC35 04/07 Run 303266 Digital errors Yes Yes now
EBA29 04/07 Run 303291 Digital errors Yes Yes now
EBA33 04/07 Run 303291 Digital errors Yes Yes 04/09
EBC36 04/07 Run 303291 Digital errors Yes Yes now
EBC27 05/07 Run 303304 Digital errors Yes Yes now
EBA26 06/07 Run 303338 Digital errors (25%) Yes Yes now
EBC41 06/07 Run 303338 Digital errors (7%) Yes Yes now
LBA22 07/07 Run 303421 Digital errors (5%) Yes Yes now
EBC49 07/07 Run 303421 Digital errors (6%) Yes Yes now
LBC17 07/07 Run 303421 Digital errors (6%) Yes Yes 21/08
LBC31 08/07 Run 303421 Digital errors (6%) Yes Yes now
LBA17 08/07 Run 303499 Digital errors (100%) Yes Yes 21/07
LBA21 09/07 Run 303499 Digital errors (12%) Yes Yes now
EBC64 09/07 Run 303499 Digital errors (50%) Yes Yes 19/07
EBA37 09/07 Run 303499 Digital errors Yes Yes now
EBC01 09/07 Run 303499 Digital errors (12%) Yes Yes now
LBA28 10/07 Run 303638 Digital errors (6%) Yes Yes 29/08
EBC06 12/07 Run 303726 Digital errors (27%) Yes No -- known module now
LBC51 13/07 Run 303811 Digital errors Yes Yes now
LBA09 13/07 Run 303819 Digital errors Yes Yes 06/10
LBA10 15/07 Run 303846 No response to CIS Yes Yes now
LBA62 15/07 Run 303846 No response to CIS Yes Yes 10/10
LBC13 15/07 Run 303846 No response to CIS Yes Yes 04/09
LBC47 16/07 Run 303892 No response to CIS Yes Yes 04/08
LBA02 16/07 Run 303943 Digital errors Yes Yes 19/07
LBC44 16/07 Run 303943 Digital errors (6%) Yes Yes 14/08
EBA18 16/07 Run 303943 Digital errors (75%) Yes Yes now
LBC49 17/07 Run 303943 Digital errors (28%) Yes Yes now
EBC34 18/07 Run 304008 Digital errors (18%) Yes Yes 14/08
EBA17 18/07 Run 304008 Digital errors (5%) Yes Yes now
LBA01 19/07 Run 304030 Digital errors Yes No -- known module 19/07
EBC21 19/07 Run 304107 Digital errors (6%) Yes Yes now
LBA01 19/07 Run 304128 PWR cycle by mistake while doing tests Yes Yes now
LBA02 19/07 Run 304128 PWR cycle by mistake while doing tests Yes Yes 09/09
LBA45 19/07 Run 304128 PWR cycle by mistake while doing tests Yes Yes now
LBA46 19/07 Run 304128 PWR cycle by mistake while doing tests Yes Yes now
LBA48 19/07 Run 304128 PWR cycle by mistake while doing tests Yes Yes 14/11
LBA47 19/07 Run 304128 PWR cycle by mistake while doing tests Yes Yes 11/09
LBA51 19/07 Run 304128 PWR cycle by mistake while doing tests Yes Yes 25/07
LBC19 19/07 Run 304128 PWR cycle by mistake while doing tests Yes Yes now
LBC20 19/07 Run 304128 PWR cycle by mistake while doing tests Yes Yes now
EBC37 19/07 Run 304128 PWR cycle by mistake while doing tests Yes Yes now
EBC38 19/07 Run 304128 PWR cycle by mistake while doing tests Yes Yes now
EBC63 19/07 Run 304128 PWR cycle by mistake while doing tests Yes Yes now
EBC64 19/07 Run 304128 PWR cycle by mistake while doing tests Yes Yes 21/07
EBC08 19/07 Run 304128 PWR cycle by mistake while doing tests Yes Yes now
EBC07 19/07 Run 304128 PWR cycle by mistake while doing tests Yes Yes now
EBA45 19/07 Run 304128 PWR cycle by mistake while doing tests Yes Yes now
EBA46 19/07 Run 304128 PWR cycle by mistake while doing tests Yes Yes now
EBA48 19/07 Run 304128 PWR cycle by mistake while doing tests Yes Yes now
EBA47 19/07 Run 304128 PWR cycle by mistake while doing tests Yes Yes now
EBC43 19/07 Run 304128 Digital errors (6%) Yes Yes now
LBA54 20/07 Run 304128 Digital errors Yes Yes now
EBA20 20/07 Run 304128 Digital errors Yes Yes now
LBC28 20/07 Run 304128 Digital errors (7%) Yes Yes now
EBC64 21/07 Run 304178 Digital errors (75%) Yes Yes now
LBA17 21/07 Run 304178 Digital errors (50%) Yes Yes now
EBC09 21/07 Run 304178 Digital errors (12%) Yes Yes now
LBA16 21/07 Run 304178 Digital errors (100%) Yes Yes now
LBC34 22/07 Run 304211 Digital errors Yes Yes now
EBC62 22/07 Run 304243 Digital errors (6%) Yes Yes now
LBC61 23/07 Run 304243 Digital errors Yes from DAQ and then long from DCS Yes 07/08
LBC15 25/07 Run 304431 Digital errors (7%) Yes Yes now
LBA51 25/07 Run 304484 Digital errors Yes Yes 08/08
LBC23 27/07 Run 304749 Digital errors Yes Yes 05/08
All LBC EVEN modules 28/07 Run 304851 PWR cycle by mistake while doing tests Yes Yes now
LBC53 30/07 Run 305186 Digital errors Yes Yes now
LBA60 30/07 Run 305186 Digital errors Yes Yes now
LBC47 04/08 Run 305543 Digital errors Yes Yes 15/10
LBA39 04/08 Run 305611 No response to CIS Yes Yes now
LBA30 05/08 Run 305618 Digital errors Yes Yes now
LBC23 05/08 Run 305618 Digital errors Yes Yes 30/08
EBC12 06/08 Run 305675 Digital errors (100%) Yes, from DAQ and then from DCS Yes now
EBA54 06/08 Run 305723 Digital errors (22%) Yes Yes now
LBC61 07/08 Run 305727 Digital errors (100%) Yes, from DAQ and then from DCS Yes 14/10
EBC46 07/08 Run 305777 Digital errors (18%) Yes Yes now
EBA06 08/08 Run 305777 Digital errors Yes Yes now
LBA51 08/08 Run 305777 No L1Calo rates Yes Yes now
LBC29 08/08 Run 305777 Digital errors Yes Yes now
LBC12 08/08 Run 305811 Digital errors Yes Yes now
LBA23 10/08 Run 305920 Digital errors Yes Yes now
LBC08 12/08 Run 306246 No L1Calo rates Yes Yes now
LBA27 13/08 Run 306269 Digital errors (6%) Yes Yes now
LBC44 14/08 Run 306278 Digital errors (6%) Yes Yes now
EBC33 14/08 Run 306310 Debugging ROS-ROD link problem Yes, from DCS No (other problem) now
EBC34 14/08 Run 306310 Debugging ROS-ROD link problem Yes, from DCS No (other problem) now
EBA12 15/08 Run 306310 Digital errors (50%) Yes Yes now
LBA33 19/08 Run 306655 Discarded events Yes Yes now
LBC01 21/08 Run 306741 Discarded events Yes Yes now
LBC17 21/08 Run 306741 Digital errors (~7%) Yes Yes now
EBC55 24/08 Run 306976 By mistake, while doing tests - - now
EBC56 24/08 Run 306976 By mistake, while doing tests - - now
LBC22 26/08 Run 307201 No response to CIS - - now
LBC32 26/08 Run 307201 No response to CIS - - now
EBA21 28/08 Run 307358 Digital errors Yes Yes now
LBA28 29/08 Run 307394 Digital errors Yes Yes 19/10
EBA58 29/08 Run 307394 Digital errors Yes Yes now
EBA49 30/08 Run 307454 Digital errors Yes Yes now
LBC23 30/08 Run 307454 Digital errors Yes Yes now
LBA35 01/09 Run 307601 Digital errors Yes Yes now
LBA14 03/09 Run 307716 Digital errors (~30%) Yes Yes now
EBA33 04/09 Run 307732 Digital errors (~20%) Yes Yes now
LBC13 04/09 Run 307732 Digital errors (~7%) Yes Yes now
LBC03 04/09 Run 307732 Digital errors Yes Yes now
LBA59 04/09 Run 307732 Digital errors Yes Yes 28/09
EBC17 06/09 Run 307935 Digital errors Yes Yes now
EBA01 09/09 Run 308084 Digital errors Yes Yes now
LBA02 09/09 Run 308084 Digital errors Yes Yes now
LBA47 11/09 Run 308175 Digital errors Yes Yes 12/09
LBA47 12/09 Run 308175 Digital errors Yes (should have been power-cycled from DCS before) Yes now
LBA12 13/09 Run 308300 Digital errors Yes No 13/09
LBA12 13/09 Run 308306 Digital errors Yes No 13/09
LBA12 13/09 Run 308306 Digital errors Yes (from DCS) No 14/09
LBC48 13/09 Run 308306 Digital errors Yes Yes 13/09
LBC48 13/09 Run 308306 Digital errors Yes (from DCS) No 14/09
LBA12 14/09 Run 308306 Digital errors Yes No 15/09
LBC48 14/09 Run 308306 Digital errors Yes No 14/09
LBC48 14/09 Run 308472 Digital errors Yes No 14/09
LBC48 14/09 Run 308473 Digital errors Yes No 15/09
LBA12 14/09 Run 308473 Digital errors Yes No 15/09
LBC48 15/09 Run 308473 Digital errors Yes No (fixed by switching it off and on) now
LBA12 15/09 Run 308473 Digital errors Yes No 15/09
LBA12 15/09 Run 308699 Digital errors Yes No (excluded from list of modules that can be power-cycled) now
LBA59 28/09 Run 309516 Digital errors Yes Yes now
LBC39 28/09 Run 309516 Digital errors Yes Yes now
LBA07 01/10 Run 309674 Digital errors Yes Yes now
LBA64 01/10 Run 309674 Digital errors Yes Yes now
LBA09 06/10 Run 310015 Digital errors Yes Yes now
EBA39 06/10 No Run ongoing Digital errors Yes (from DCS) Yes now
EBA57 06/10 No Run ongoing Digital errors Yes (from DCS) Yes now
LBC59 06/10 No Run ongoing Digital errors Yes (from DCS) Yes now
EBC25 06/10 No Run ongoing Digital errors Yes (from DCS) Yes 16/10
LBA62 10/10 Run 310249 Digital errors Yes Yes now
EBC22 10/10 Run 310341 Digital errors Yes Yes now
EBA14 13/10 Run 310473 Digital errors Yes Yes now
LBC61 14/10 Run 310634 Digital errors Yes Yes now
LBC47 15/10 Run 310634 Digital errors Yes Yes now
EBC11 16/10 Run 310691 Digital errors Yes Yes now
EBC25 16/10 Run 310691 Digital errors Yes Yes now
LBC63 17/10 Run 310738 Digital errors Yes Yes 26/10
LBA46 18/10 Run 310809 Digital errors Yes Yes now
EBA63 18/10 Run 310809 Digital errors Yes No 18/10
EBA63 18/10 Run 310809 Digital errors Yes (from DCS) Yes now
LBA28 19/10 Run 310872 Digital errors Yes Yes now
LBA53 22/10 Run 311170 Digital errors Yes Yes now
EBA34 23/10 Run 311287 Trip Yes Yes now
LBA34 25/10 Run 311365 Digital errors Yes Yes now
LBA10 26/10 Run 311473 Digital errors Yes Yes now
LBC63 26/10 Run 311473 Digital errors Yes Yes now
LBC32 02/11 Run 311983 Digital errors Yes No 03/11
LBC32 03/11 Run 312003 Digital errors Yes No 03/11
LBC32 03/11 Run 312003 Digital errors Yes No 03/11
LBC32 03/11 Run 312020 Digital errors Yes No 03/11
LBC32 03/11 Run 312098 Digital errors Yes No 03/11
LBC32 03/11 Run 312107 Digital errors Yes No 04/11
LBC32 03/11 Run 312121 Digital errors Yes No 04/11
LBC32 03/11 Run 312121 Digital errors Yes No 04/11
LBA33 06/11 Run 312407 Digital errors Yes Yes now
LBA48 14/11 Run 312837 Digital errors Yes Yes now
LBC62 21/11 Run 313242 Trip on LBC Yes Yes now
LBC63 21/11 Run 313242 Trip on LBC Yes Yes now
LBC03 21/11 Run 313242 Trip on LBC Yes Yes now
LBC64 21/11 Run 313242 Trip on LBC Yes Yes now
LBC06 21/11 Run 313242 Trip on LBC Yes Yes now
LBC09 21/11 Run 313242 Trip on LBC Yes Yes now
LBC08 21/11 Run 313242 Trip on LBC Yes Yes now
LBC07 21/11 Run 313242 Trip on LBC Yes Yes now
LBC14 21/11 Run 313242 Trip on LBC Yes Yes now
LBC13 21/11 Run 313242 Trip on LBC Yes Yes now
LBC12 21/11 Run 313242 Trip on LBC Yes Yes now
LBC11 21/11 Run 313242 Trip on LBC Yes Yes now
LBC10 21/11 Run 313242 Trip on LBC Yes Yes now
LBC23 21/11 Run 313242 Trip on LBC Yes Yes now
LBC22 21/11 Run 313242 Trip on LBC Yes Yes now
LBC21 21/11 Run 313242 Trip on LBC Yes Yes now
LBC16 21/11 Run 313242 Trip on LBC Yes Yes now
LBC15 21/11 Run 313242 Trip on LBC Yes Yes now
LBC34 21/11 Run 313242 Trip on LBC Yes Yes now
LBC33 21/11 Run 313242 Trip on LBC Yes Yes now
LBC29 21/11 Run 313242 Trip on LBC Yes Yes now
LBC30 21/11 Run 313242 Trip on LBC Yes Yes now
LBC28 21/11 Run 313242 Trip on LBC Yes Yes now
LBC27 21/11 Run 313242 Trip on LBC Yes Yes now
LBC24 21/11 Run 313242 Trip on LBC Yes Yes now
LBC45 21/11 Run 313242 Trip on LBC Yes Yes now
LBC44 21/11 Run 313242 Trip on LBC Yes Yes now
LBC43 21/11 Run 313242 Trip on LBC Yes Yes now
LBC42 21/11 Run 313242 Trip on LBC Yes Yes now
LBC41 21/11 Run 313242 Trip on LBC Yes Yes now
LBC40 21/11 Run 313242 Trip on LBC Yes Yes now
LBC39 21/11 Run 313242 Trip on LBC Yes Yes now
LBC38 21/11 Run 313242 Trip on LBC Yes Yes now
LBC37 21/11 Run 313242 Trip on LBC Yes Yes now
LBC36 21/11 Run 313242 Trip on LBC Yes Yes now
LBC35 21/11 Run 313242 Trip on LBC Yes Yes now
LBC60 21/11 Run 313242 Trip on LBC Yes Yes now
LBC59 21/11 Run 313242 Trip on LBC Yes Yes now
LBC58 21/11 Run 313242 Trip on LBC Yes Yes now
LBC57 21/11 Run 313242 Trip on LBC Yes Yes now
LBC56 21/11 Run 313242 Trip on LBC Yes Yes now
LBC55 21/11 Run 313242 Trip on LBC Yes Yes now
LBC54 21/11 Run 313242 Trip on LBC Yes Yes now
LBC53 21/11 Run 313242 Trip on LBC Yes Yes now
LBC52 21/11 Run 313242 Trip on LBC Yes Yes now
LBC51 21/11 Run 313242 Trip on LBC Yes Yes now
LBC50 21/11 Run 313242 Trip on LBC Yes Yes now
LBC49 21/11 Run 313242 Trip on LBC Yes Yes now
LBC48 21/11 Run 313242 Trip on LBC Yes Yes now
LBC47 21/11 Run 313242 Trip on LBC Yes Yes now
LBC46 21/11 Run 313242 Trip on LBC Yes Yes now
LBC48 22/11 Run 313259 Trip on LBC Yes Yes now
EBC29 28/11 Run 313630 Digital errors Yes Yes now

-- Main.LeonorCerdaAlberich - 2016-09-05

Edit | Attach | Watch | Print version | History: r44 < r43 < r42 < r41 < r40 | Backlinks | Raw View | WYSIWYG | More topic actions
Topic revision: r44 - 2016-12-08 - LeonorCerdaAlberich
 
    • Cern Search Icon Cern Search
    • TWiki Search Icon TWiki Search
    • Google Search Icon Google Search

    Sandbox All webs login

This site is powered by the TWiki collaboration platform Powered by PerlCopyright & 2008-2020 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
or Ideas, requests, problems regarding TWiki? use Discourse or Send feedback