This is an interesting lockloss, which could use more investigation: 1229244374
This was a lock in which we had much more stable build ups than we have been seeing at 20W, thanks to TCS work today. We had been sitting in the CHARD BLEND state for more than an hour, when the refl centering loops (as well as SRCL, DHARD and to a smaller extent PRC2 Y) have an exponentially growing oscillation at 28.6 Hz. The verbal alarms indicate that an HTTS was saturating, but the lockloss website says that there were no saturations until ETMX saturated at the time of the lockloss.
Looking at the master outs for the RMs, they look like they should not have been saturating (second attachment, this is a 16 bit DAC so it should saturate when the request is +/-32768 counts). It would be good to compare what verbal checks for saturations against the master outs that are used by the lockloss tool to see if we are missing some saturations.
In any case, this lockloss is very similar to the ones we saw a couple of weeks ago trying to power up 45668
Verbal just looks for increases in the model overflows ({IFO}:FEC-{#}_ACCUM_OVERFLOW). On the h1sushtts model, there are only the RM's, I believe, so it wasn't any of the other HTTS's. Just for reference, here is the Verbal log when the saturations started to lock loss:
H_T_T_S (Dec 19 08:45:31 UTC)
H_T_T_S (Dec 19 08:45:33 UTC)
H_T_T_S (Dec 19 08:45:35 UTC)
H_T_T_S (Dec 19 08:45:36 UTC)
H_T_T_S (Dec 19 08:45:39 UTC)
H_T_T_S (Dec 19 08:45:41 UTC)
H_T_T_S (Dec 19 08:45:42 UTC)
H_T_T_S (Dec 19 08:45:45 UTC)
H_T_T_S (Dec 19 08:45:47 UTC)
H_T_T_S (Dec 19 08:45:48 UTC)
H_T_T_S (Dec 19 08:45:50 UTC)
DCPD (Dec 19 08:45:52 UTC)
H_T_T_S (Dec 19 08:45:53 UTC)
DCPD (Dec 19 08:45:55 UTC)
DRMI Unlocked (Dec 19 08:45:57 UTC)
ISC_LOCK state: DOWN (Dec 19 08:45:58 UTC)
Re-looking at Sheila's middle plot, RM2 is saturating, so verbal was telling us the correct thing.