At 10:45 last night (local) the DAC outputs of h1seih23 went to zero (and latched there) and the WD error bit was set on the IOP STATE_WORD. We worked with Rolf to diagnose the problem. For this error to have occurred there must have been a DAC FIFO error. He looked at the /proc/h1iopseih23/status file and it is showing no current FIFO errors. He has not seen a DAC FIFO error come and go before. With no futher online diagnostics needed, I restarted all the models and handed the system back to Hugo for HAM2 commissioning at 10:54 this morning.

A trend of the IOP STATE_WORD shows the WD bit being set at 10:45 Wed evening, which was latched on until this morning's restart. At two occasions overnight the DAC bit was also briefly set for less than a minute each time.

Rolf is looking into the code to see if additional diagnostics can be applied in future releases of the RCG.