Erik, Oli
Got a call from IFO_NOTIFY - there was ground motion that caused the HAM2 ISI (11:56:26 UTC), SEI SW (11:56:28 UTC), and Hepi (11:56:31 UTC) watchdogs to trip. Along with/causing this (or by coincidence?) is an error with H1IOPSUSH2A, and the GDS screen was showing 'LTDS' in red. The front end needs to be either power-cycled, or possibly a card replaced, so Erik will be heading into site in a bit to see about fixing the errors. I manualed ISC_LOCK into IDLE, and either me or the DAY operator will get the ifo back up once the CDS issue is resolved.
[Erik, Richard]
The third 18-bit DAC (DAC 2) on h1sush2a failed. It no longer appeared on the PCI Bus.
Richard replaced the DAC and we restarted the front end.
I originally misdiagnosed the problem as a bad timing card, since the DAC failure caused cascading timing errors on other cards, so we also replaced the timing card with serial number S2101122
Serial number of the failed DAC is:
101208-06
The ground motion plotted here is very unlikely to have caused a seismic watchdog trip. The ham2 trip was almost certainly caused by the sush2a failure.