Reports until 12:03, Tuesday 15 August 2023
H1 CDS
david.barker@LIGO.ORG - posted 12:03, Tuesday 15 August 2023 - last comment - 12:12, Tuesday 15 August 2023(72232)
CDS Maintenance Summary: Tuesday 15th August 2023

WP11361 TW1 raw minute trend files offload

Dave:

I have started the file copy from h1daqtw1's SSD-RAID (93% full) over to h1ldasgw1 SATABOY HDD storage.

The first step was to get TW1 to write trends to a new empty directory, freeing up the full directory for file copy. This required a temporary change to h1daqnds1's daqdrc file and a daqd restart. The restart was incorporated into the main DAQ restart of h1hpiham1 model change.

The file copy was started at 11:50 and is expected to take about 2 days.

WP11364 Signal reordering in h1oaf model

Jenne, Dave:

Jenne created a new h1oaf.mdl which was installed this morning. No DAQ restart was needed.

WP11369 Temporary addition of 1kHz DQ channels to DAQ for h1hpiham1

Jim, Dave:

A new h1hpiham1 model was installed, which adds seven 1kHz DQ channels to the DAQ. DAQ restart was needed

DAQ Restart

Dave, Jonathan, EJ:

The DAQ was restarted for the h1hpiham1 model change and the new NDS1 daqdrc configuration.

This was a messy restart. On the plus side, neither GDS0 nor GDS1 needed a second restart.

When the h1oaf model was restarted, FW0 took about 21 seconds longer to write the full frame it was in the process of writing. FW1 did not show this behaviour.

I started the 1-leg first, waited for about 5 minutes and then started the 0-leg. As was seen two weeks ago, while FW0 was coming back, FW1 spontaneously restarted itself, resulting in two frame files not written by either frame writer.

Comments related to this report
david.barker@LIGO.ORG - 12:05, Tuesday 15 August 2023 (72233)

Missing Full Frame Files:

scanning directory 13761
FW0 Missing Frames [1376149248, 1376149312]
FW1 Missing Frames [1376148928, 1376148992, 1376149248, 1376149312]
ERROR: no frame written for GPS 1376149248!!!
ERROR: no frame written for GPS 1376149312!!!

 

david.barker@LIGO.ORG - 12:12, Tuesday 15 August 2023 (72234)

Tue15Aug2023
LOC TIME HOSTNAME     MODEL/REBOOT
08:32:27 h1seih16     h1hpiham1   <<< Add DQ channels to DAQ


08:33:21 h1oaf0       h1oaf       <<< reorder inputs to C-code blocks


08:36:02 h1daqdc1     [DAQ] <<< 1-leg restart
08:36:11 h1daqfw1     [DAQ]
08:36:12 h1daqtw1     [DAQ]
08:36:13 h1daqnds1    [DAQ] <<< temporary daqdrc for TW1 offload
08:36:21 h1daqgds1    [DAQ]


08:41:10 h1daqdc0     [DAQ] <<< 0-leg restart
08:41:22 h1daqfw0     [DAQ]
08:41:23 h1daqnds0    [DAQ]
08:41:23 h1daqtw0     [DAQ]
08:41:31 h1daqgds0    [DAQ]


08:41:34 h1daqfw1     [DAQ] <<< Spontaneous FW1 restart!