james.batch@LIGO.ORG - posted 10:07, Thursday 11 April 2013 - last comment - 11:15, Thursday 11 April 2013(6028)
Restart cdsfs0 and cdsfs1
Found BOTH cds file servers in read-only bad states this morning. Powered off and disconnected power from cdsfs0 and cdsfs1, then powered back up. This is the only way we've found to reliably reset the RAID controller on these computers.
Comments related to this report
david.barker@LIGO.ORG - 11:15, Thursday 11 April 2013 (6029)
Here are the crash times:
It appears that cdsfs1 crashed while rsync'ing cdsfs0 (cron job runs at midnight), and that cdsfs0's crash was coincidental.