Displaying report 1-1 of 1.
Reports until 13:59, Tuesday 19 September 2023
H1 CDS
david.barker@LIGO.ORG - posted 13:59, Tuesday 19 September 2023 - last comment - 15:46, Tuesday 19 September 2023(72976)
CDS Maintenance Summary: Tuesday 19th September 2023

WP11424 New Workstation Conda Environment

Erik:

Erik installed a new python3.10 conda env on all the workstations. Please see Erik's alog for details.

WP11431 Upgrade of Picket Fence EPICS IOC

Erik, Dave:

Erik installed a new version of the picket fance IOC which adds meta channels for the picket fence service and status channels for the IOC itself.

I upgraded generate_picket_fence_medm.py to add these new channels to the MEDM, and added code to generate the H1EPICS_PICKET_FENCE.ini DAQ ini file.

The INI file lists all the non-string PVs in alphabetical order. A DAQ+EDC restart was required.

The new MEDM (attached) has the extended SERVER section and a new IOC section in the lower right. The IOC is color coded blue to distinguish it from the Seismic data.

WP11433 Add CDS EPICS LOAD MON to FOM Nuc machines

Jonathan, Erik, Dave:

Jonathan started the EPICS_LOAD_MON IOC on all of the FOM Nuc machines in the control room. Erik installed these via puppet.

I modified generate_host_stats_medm.py to add these new machines to the MEDM (attached) and the H1EPICS_CDSMON.ini DAQ file. DAQ+EDC restart was required.

DAQ Restart

Dave, Jonathan, Erik:

This was a messy DAQ restart.

We restarted the 0-leg first and waited to see if FW0 would spontaneously restart it self after running for a few minutes, and indeed it did so.

The EDC was then restarted on h1susauxb123.

After FW0 had come back, we then restarted the 1-leg. GDS1 required a second restart to resync the channels lists.

After a few minutes of running FW1 also spontaneously restarted itself, and then after a few minutes more did a second spontaneous restart.

 

 

Images attached to this report
Comments related to this report
david.barker@LIGO.ORG - 15:44, Tuesday 19 September 2023 (72983)

DAQ Frame Writers' Missing Frames Due To Restarts:

FW0 Missing Frames [1379185408, 1379185472, 1379185664, 1379185728]
FW1 Missing Frames [1379185984, 1379186048, 1379186240, 1379186304, 1379186496, 1379186560, 1379186624]
 

david.barker@LIGO.ORG - 15:46, Tuesday 19 September 2023 (72984)

Tue19Sep2023
LOC TIME HOSTNAME     MODEL/REBOOT
12:03:52 h1daqdc0     [DAQ] <<< 0-leg restart
12:04:03 h1daqfw0     [DAQ]
12:04:04 h1daqnds0    [DAQ]
12:04:04 h1daqtw0     [DAQ]
12:04:12 h1daqgds0    [DAQ]

12:05:22 h1susauxb123 h1edc[DAQ] <<< EDC restart for CDSMON and PICKET_FENCE channels

12:08:50 h1daqfw0     [DAQ] <<< FW0 crash and restart

12:13:27 h1daqdc1     [DAQ] <<< 1-leg restart
12:13:38 h1daqfw1     [DAQ]
12:13:39 h1daqtw1     [DAQ]
12:13:40 h1daqnds1    [DAQ]
12:13:48 h1daqgds1    [DAQ]

12:14:17 h1daqgds1    [DAQ] <<< GDS1 needed a second restart

12:18:15 h1daqfw1     [DAQ] <<< FW1 crash and restart
12:22:53 h1daqfw1     [DAQ] <<< FW1 crash and restart
 

Displaying report 1-1 of 1.