Tony, Dave:
At 18:24PDT we had a corner station Dolphin glitch which stopped the DACs on h1sus[b123, h2a, h34 and h56], see attached.
To recover, the IOP models (which means all the models) on these front ends were restarted.
Although the SUS DACs had been DACKILL'ed, the IPC continued to run and so the SWWD did not trip any SEI system.
Following the restarts I untripped the SUS SWWDs and handed the IFO over to Tony to complete the recovery.
Wed10May2023
LOC TIME HOSTNAME MODEL/REBOOT
13:12:55 h1seih45 ***REBOOT*** <<< Failed ADC2 on h1seih45
13:14:30 h1seih45 h1iopseih45
13:14:43 h1seih45 h1hpiham4
13:14:56 h1seih45 h1hpiham5
13:15:09 h1seih45 h1isiham4
13:15:22 h1seih45 h1isiham5
13:46:16 h1seih45 ***REBOOT***
13:47:50 h1seih45 h1iopseih45
13:48:03 h1seih45 h1hpiham4
13:48:16 h1seih45 h1hpiham5
13:48:29 h1seih45 h1isiham4
13:48:42 h1seih45 h1isiham5
18:39:12 h1susb123 h1iopsusb123 <<< Dolphin Crash Recovery
18:39:26 h1susb123 h1susitmy
18:39:40 h1susb123 h1susbs
18:39:54 h1susb123 h1susitmx
18:40:08 h1susb123 h1susitmpi
18:41:43 h1sush2a h1iopsush2a
18:41:57 h1sush2a h1susmc1
18:42:11 h1sush2a h1susmc3
18:42:25 h1sush2a h1susprm
18:42:39 h1sush2a h1suspr3
18:43:58 h1sush34 h1iopsush34
18:44:12 h1sush34 h1susmc2
18:44:26 h1sush34 h1suspr2
18:44:40 h1sush34 h1sussr2
18:45:50 h1sush56 h1iopsush56
18:46:04 h1sush56 h1sussrm
18:46:18 h1sush56 h1sussr3
18:46:32 h1sush56 h1susifoout
18:46:45 h1sush56 h1sussqzout