Displaying report 1-1 of 1.
Reports until 12:43, Tuesday 04 November 2014
H1 SEI (CDS, SYS)
jeffrey.kissel@LIGO.ORG - posted 12:43, Tuesday 04 November 2014 - last comment - 11:24, Tuesday 25 November 2014(14835)
Troubles with Managing SEI
J. Kissel, J. Warner, E. Merilh, H. Radkins

While taking down and bringing up the HAM2, HAM5, BS, and TM ISI + HPIs this morning to upgrade suspension front-end code (see LHO aLOG 14830), we had the following troubles with platforms:

(1) The Rogue Excitation Monitor for HAM5 ISI could not be naively reset, and was caught in a trip-loop.
     - First of all, it's frustrating that there in no MEDM screen indication that the MASTERSWITCH must be ON in order to reset the rogue excitation monitor, so myself / Jim / Ed spent a few minutes clicking all the watchdog reset buttons hoping that there was some special order, until Hugh informed (reminded?) us that the master switch needed to be on
     - Second, I'm not 100% confident why, but after enacting the "correct order" of reset by turning on MASTERSWITCH, reset Rogue WD, reset all to untrip the DACKILL, the MASTERSWITCH would turn itself OFF again before the three-second counter/delay of the rogue excitation was finished, therefore re-tripping thinking the MASTERSWITCH never was turned ON. I'm 90% confident this happened because the MASTERSWITCH would "turn itself off" because the SEI manager demanded that the MASTERSWITCH be OFF because it was still in the OFFLINE state.
     Why do we have the SEI Manager controlling the MASTERSWITCH, but the ISI module controlling everything else?

(2) There are no monitor signals on the MEDM overview screen to indicate what is currently causing the Rogue Excitation Watchdog to fire. This proved solving the above problem initially difficult -- I had to open the model to find out the logic (especially the hard-coded "100 [ct]" threshold), the three-second delay, open the CDMON channels in dataviewer, find they were low, and then go for figuring out the MASTERSWITCH trick. We should (a) added epics monitors on the three *inputs* rogue excitation monitor, and (b) create a sub-screen for the rogue excitation that reveals the details of this monitor.

(3) The BSC-ISI overview screens have the SEI Manager guardians on the overview screen. The BSC-HPI overview has the HPI module guardian. The HAM-ISIs and HAM-HPIs have their individual module guardians on the overview screen. This resulted confusion when trying to quickly bring the platforms back from offline -- I'd gone to the HAM-ISI overview after just finishing the BSCs, and out-of-habit assumed the guardian drop-down menu was the manager and was surprised why it wasn't doing anything for me. Arnaud informs me that this is because the overview screen mods were first made at LLO, where they're not using HEPI and therefore don't need a manager. Since not-using-HEPI is a deviation from aLIGO baseline, I argue that we should fix this by creating the SEI manager for the HAMs, and just temporarily create a managed configuration that doesn't use HEPI -- instead of having the confusing user interface for the HAMs.

(4) The SEI manager for ITMY seems to *not* automatically turn on the MASTERSWITCH. Is this automatic operation consistent between chambers? Between HAM managers and BSC managers?

(5) HAM3-HPI's L4C saturation counter in watchdog wouldn't reset with a RESET ALL or RESET above the current trigger but, but RESET WD ONLY worked. We can confirm that every other chamber behaves as expected, i.e. any of the three methods reset the counter. What's different about HAM3? Is this reset a python script that is uniquely defined per chamber or something?
Comments related to this report
brian.lantz@LIGO.ORG - 11:24, Tuesday 25 November 2014 (15286)SUS
(1) "there in no MEDM screen indication that the MASTERSWITCH must be ON in order to reset the rogue excitation monitor,"
currently, the reset will only work if the signal coming in is not in the alarm state, e.g. if you are still alarming, you can't reset it.

1a)  This can be changed to allow to monitor to be reset even though the bad condition persists. probably fine since there is a human there, but it will likely just trip again.

1b) Why was the alarm condition still true? it should not have been. This requires some follow up. most likely the threshold is set to close to zero.

- The masterswitch is not for a particular stage - so it does not go into the stage manager. It belongs to the chamber = whole-thing manager.

- the ISI manager does not control 'everything else'. There are 2 ISI stage managers, and a HEPI manager, and soon a blend manager.

- we need to adjust the chamber manager so it is not too annoying.

The 100 cnt limit is set by looking at the levels on the coil drive monitors

see:
https://alog.ligo-wa.caltech.edu/aLOG/index.php?callRep=2729  and
https://alog.ligo-la.caltech.edu/SEI/index.php?callRep=339

Since this is a watchdog thing, it is hardcoded so that folks don't just set it to 1000000000000 and forget it.
If 100 is too small, we can certainly make it bigger - we should check how big it was at this time.


(2) yes

(3, 4) interesting.

(5) we need to check this. 





Displaying report 1-1 of 1.