WP11361 TW1 raw minute trend files offload
Dave:
I have started the file copy from h1daqtw1's SSD-RAID (93% full) over to h1ldasgw1 SATABOY HDD storage.
The first step was to get TW1 to write trends to a new empty directory, freeing up the full directory for file copy. This required a temporary change to h1daqnds1's daqdrc file and a daqd restart. The restart was incorporated into the main DAQ restart of h1hpiham1 model change.
The file copy was started at 11:50 and is expected to take about 2 days.
WP11364 Signal reordering in h1oaf model
Jenne, Dave:
Jenne created a new h1oaf.mdl which was installed this morning. No DAQ restart was needed.
WP11369 Temporary addition of 1kHz DQ channels to DAQ for h1hpiham1
Jim, Dave:
A new h1hpiham1 model was installed, which adds seven 1kHz DQ channels to the DAQ. DAQ restart was needed
DAQ Restart
Dave, Jonathan, EJ:
The DAQ was restarted for the h1hpiham1 model change and the new NDS1 daqdrc configuration.
This was a messy restart. On the plus side, neither GDS0 nor GDS1 needed a second restart.
When the h1oaf model was restarted, FW0 took about 21 seconds longer to write the full frame it was in the process of writing. FW1 did not show this behaviour.
I started the 1-leg first, waited for about 5 minutes and then started the 0-leg. As was seen two weeks ago, while FW0 was coming back, FW1 spontaneously restarted itself, resulting in two frame files not written by either frame writer.
Missing Full Frame Files:
scanning directory 13761
FW0 Missing Frames [1376149248, 1376149312]
FW1 Missing Frames [1376148928, 1376148992, 1376149248, 1376149312]
ERROR: no frame written for GPS 1376149248!!!
ERROR: no frame written for GPS 1376149312!!!
Tue15Aug2023
LOC TIME HOSTNAME MODEL/REBOOT
08:32:27 h1seih16 h1hpiham1 <<< Add DQ channels to DAQ
08:33:21 h1oaf0 h1oaf <<< reorder inputs to C-code blocks
08:36:02 h1daqdc1 [DAQ] <<< 1-leg restart
08:36:11 h1daqfw1 [DAQ]
08:36:12 h1daqtw1 [DAQ]
08:36:13 h1daqnds1 [DAQ] <<< temporary daqdrc for TW1 offload
08:36:21 h1daqgds1 [DAQ]
08:41:10 h1daqdc0 [DAQ] <<< 0-leg restart
08:41:22 h1daqfw0 [DAQ]
08:41:23 h1daqnds0 [DAQ]
08:41:23 h1daqtw0 [DAQ]
08:41:31 h1daqgds0 [DAQ]
08:41:34 h1daqfw1 [DAQ] <<< Spontaneous FW1 restart!