david.barker@LIGO.ORG - posted 09:36, Sunday 31 May 2026 - last comment - 10:03, Monday 01 June 2026(90403)
State of CDS following recovery from second power outage
Thankfully no more power outages following the second (14:27) outage Sat 30may2026. Here are the systems we left offline which will be restarted tomorrow, Mon 01jun2026.
PSL Diode Room Beckhoff Controls
Long range dolphin end station Adnaco expansion chassis (h1cdsrfm)
NCAL EX
BRS EX, EY
HWS EX, EY
MAINSMON EX
CHILLERMON EX, EY
Here are all the MSR UPS Emails we received on Saturday. The UPS clock appears to be incorrect and about 14mins fast. No GC UPS emails were received on Saturday.
Sat Morning Outage 09:39
Date: 05/30/2026
Time: 10:12:59
Code: 0x0002
Critical - System: Warmstart. (2 copies received)
Date: 05/30/2026
Time: 10:13:06
Code: 0x0101
Informational - UPS: Restored the local network management interface-to-UPS communication.
Sat Afternoon Outage 14:27
Date: 05/30/2026
Time: 14:45:38
Code: 0x020F
Critical - UPS: An input voltage or frequency problem prevents switching to bypass mode. (4 copies received)
Date: 05/30/2026
Time: 14:45:40
Code: 0x0109
Warning - UPS: On battery power in response to an input power problem. (2 copies received)
Date: 05/30/2026
Time: 14:45:45
Code: 0x010A
Informational - UPS: No longer on battery power. (2 copies received)
Date: 05/30/2026
Time: 14:45:57
Code: 0x0210
Informational - UPS: An input voltage or frequency problem no longer prevents switching to bypass mode. (2 copies received)
h1hwsex and h1hwsey are running in a tmux session. To get to the process, ssh as controls to the server and run "tmux a".