david.barker@LIGO.ORG - posted 08:47, Tuesday 05 March 2024 - last comment - 10:06, Tuesday 05 March 2024(76111)
DAQ DC0 crash 06:21 this morning
h1daqdc0 crashed at 06:21 this morning. It did not respond to pings, its console was stuck at the login prompt and there were no log entries at this time. DAQ was running with 1-leg only while DC0 was down.
Erik rebooted DC0 which caused the 0-leg to retstart. TW0 started too quickly, had -3 seconds delta start time. I restarted TW0.
First reboots, which were opslogin0 and operator workstations were ordered at 6:23.
Package update of opslogin0 was ordered at 6:19, so likely opslogin0 was nearing the end of package updates at 6:21. The exact time it finished updates is hard to pin down, and it's also hard to draw a connection between updates and a lock up of h1daqdc0.