Wednesday night at 8pm local time approx, cdsfs0 went into "read only" mode whereby the NFS fie system looked available, but had detected an error and switch to its safe state. Vincent rebooted the machine via phone support from Dave.

Today we power cycled cdsfs0 at 3pm to activate its IPMI management port. Now it will be possible for CDS sysadmin to remotely power this machine.

As part of the h2fw0 crashing every 3 hours problem, I switch which QFS file system the H2 frame writers write to