at 16:58 PDT all user models on h1susey stopped running. It looks like the IOP model developed a DAC error, and stopped running all the DAC cards (and also powered down the SUS-AI chassis). The IOP model continued to run (user models had stopped with ADC TIMEOUT errors in dmsg), so we could determine the SWWD RMS readbacks were well below trip levels. Hugh got seismic driving again by overriding the broken SUS IPC.

At 17:09 PDT I restarted all the models on h1susey (iop, etmy, tmsy and etmypi).