ETMX:
System continues to be protected by the Hardware Watchdog. h1susex models are not functioning, DAC outputs for SUS-ETMX and SUS-TMSX presumably frozen at last value. Because the IPC to h1seiex is frozen, the Software Watchdog on h1seiex has tripped and all DAC drives are zero for ISI-ETMX and HPI-ETMX.
Possible Sunday recovery is to reset h1susex, which may dolphin glitch h1seiex and h1iscex. This is not an issue since h1seiex has SWWD tripped and is therefore not driving.
ITMX:
System continues to be protected by the Hardware Watchdog. h1seib2 models are not functioning, DAC outputs for ISI-ITMX and HPI-ITMX presumably frozen at last value.
Possible Sunday recovery: there are no IPC errors in the corner station resulting from the loss of h1seib2. One minimal-impact recovery would be to power off h1seib3 and remove its Dolphin cable before powering it back on with a modified h1iopseib3 model which temporarily disables the SWWD. This would restore SEI-ITMX function and not precipitate a restart of most of the corner station models.
Monday Recovery: reset frozen systems, restart any subsequently glitched models, rebooting all computers with uptime exceeding 208.5 days. A slower recovery will be to upgrade RCG to 3.4.2 (restart all models).