From UPS emails it appears the site has had mutiple power issues starting 18:06 PDT extending to 18:20
Richard is on his way to the site. Erik and I remotely brought h1susauxb123 (edc) back online, which got the DAQ to restart itself so we are trending vacuum channels again. Data gap for VE data is 18:05 - 18:40.
Current CDS issues:
h1seih23 ipmi not working, computer is still down.
IX Dolphin switch at EX is not working correctly. h1susex, h1seiex, h1iscex are down. Erik is trying a workaround.
h1psl0 is down, it didn't actually power off, we are not sure we should get that going again.
MSR UPS messages:
Name : ups-msr-0
Location : LHO MSR
Contact : CDS Administrators
http://ups-msr-0.cds.ligo-wa.caltech.edu
http://10.99.3.10
Serial # : ZA0522010987
Device Ser #: PD0615240264
Date: 04/06/2025
Time: 18:20:42
Code: 0x0002
Critical - System: Warmstart.
Name : ups-msr-0
Location : LHO MSR
Contact : CDS Administrators
http://ups-msr-0.cds.ligo-wa.caltech.edu
http://10.99.3.10
Serial # : ZA0522010987
Device Ser #: PD0615240264
Date: 04/06/2025
Time: 18:20:50
Code: 0x0101
Informational - UPS: Restored the local network management interface-to-UPS communication.
GC OSB UPS messages (times out by one hour)
Name : lho-gc-osb-ups
Location : LHO OSB Mechanical Room (rm 160)
Contact : lho-gc-root@ligo-wa....
Serial Number : 5A1315T04169
Device Serial Number : PS1316131451
Date : 04/06/2025
Time : 17:06:10
Code : 0x0235
Critical - UPS: A site wiring fault exists.
Date : 04/06/2025
Time : 17:06:10
Code : 0x020F
Critical - UPS: An input voltage or frequency problem prevents switching to bypass mode.
Date : 04/06/2025
Time : 17:06:26
Code : 0x010A
Informational - UPS: No longer on battery power.
Date : 04/06/2025
Time : 17:06:44
Code : 0x0236
Informational - UPS: A site wiring fault no longer exists.
Date : 04/06/2025
Time : 17:06:44
Code : 0x0210
Informational - UPS: An input voltage or frequency problem no longer prevents switching to bypass mode.
GC LSB (one hour out)
Time : 17:18:14
Code : 0x0109
Warning - UPS: On battery power in response to an input power outage.
Critical - UPS: An out of tolerance input voltage or frequency , prevents switching to bypass mode.
Time : 17:18:33
Code : 0x0210
Informational - UPS: An out of tolerance input voltage or frequency no longer prevents switching to bypass mode
Date : 04/06/2025
Time : 17:18:36
Code : 0x010A
Informational - UPS: No longer on battery power.