Here is an update on the ongoing CDS investigations:
DAQ framewriter instability (FRS3379)
started around 14th July. We are testing reducing the disk loading of h1fw0 by only writing science frames (i.e. not also writing the larger commissioning frames). Four hours into this with no frame writer restart.
End Station SUS IOP glitching (FRS3375)
started when the end station sus computers were upgraded to the faster model (14th July). Its impact on ISI has been reduced with the installation of new ISI BSC models this week which do not watchdog trip on individual IPC errors. We will check on the BIOS settings of the SUS computers next Tuesday with LLO (requires LLO end station SUS power down). If there are any differences, LHO will be made the same as LLO. Reverting to the slower computers is an option.
Front End IOC freeze ups (FRS3279)
Not sure when this started as logging was not available, word-of-mouth suggests it became clearly noticable early in July. Monitoring of the problem has been installed. Investigation is continuing, its main impact is on Guardian nodes.