Reports until 14:20, Tuesday 25 April 2023
H1 CDS (GRD)
david.barker@LIGO.ORG - posted 14:20, Tuesday 25 April 2023 - last comment - 15:57, Tuesday 25 April 2023(69003)
CDS Maintenance Summary: Tuesday 25th April 2023

WP11151 Guardian new CAL_AW_LINES and THERMALIZATION nodes

Jeff, Dave:

A new H1EPICS_GRD.ini file was generated with the new nodes added. DAQ+EDC restart was needed.

WP11138 latest CAL and PCAL code

Jeff, Erik, Dave:

We built the latest h1calcs, h1calex and h1caley models. It was found that the end station models were removing two slow channels from the DAQ frame, which would require an ECR. Jeff undid that particular change so these models are only adding channels to the DAQ.

model num slow added num slow removed num fast added num fast removed
h1calcs 1,220 0 0 0
h1calex 3 0 0 0
h1caley 3 0 0 0

WP11128 Reduce EY-MY fiber usage, add ADMIN-LAN access to MY

Jonathan, Erik, Fil:

EY to MY fiber usage was reduced by replacing fiber pairs to a single fibre using bi-directional SFPs. The network connections for H1FE and H1DAQ were upgraded to bi-dirs, while the timing was kept as a fiber pair. This freed up two fibers, one of which was used to send the H1ADMIN network to MY using ethernet-fiber media converters at each end.

We now have IPMI control of h1pemmy-mgmt. In a future TM the H1ADMIN lan connection to MX will also be done.

WP11121 Pulizzi PEM Coil power controls

Fil, Erik, Dave:

Fil installed three more Pulizzi ethernet AC-power controllers in the corner station: CER, SQZ and VERTEX. I reconfigued the sw-lvea-aux Cisco switch ports 2, 43, 46 to VLAN105 to connect to these units. I created three new EPICS IOCs on cdsioc0 to run these boxes. The CER unit as intermittent errors, and does not report outlet status except when a SCAN command is explicitly given.

Fil looked at the end station VEA units which had been installed some time ago. We found that they have incorrect IP addresses and are on the wrong VLAN (in H1VID, not H1SLOW). Also, exrpc does not respond to pings, even though its ethernet link lights are on.

WP11142 ISI BSC upgrades, long-range_dolphin end-station to seiproc

Jim, Dave:

We installed Jims latest ISI BSC model changes, including adding an End-Station to h1seiproc long-range Dolphin channel from each end station.

Models upgraded: h1isiitmx, h1isibs, h1isiitmy, h1isietmx, h1isietmy, h1isiham8, h1seiproc.

DAQ changes are summarized below

model slow channels added slow channels removed fast channels added fast channels removed
h1isiitmx 2,904 876 6 0
h1isibs 3,012 876 6 0
h1isiitmy 2,904 876 6 0
h1isietmx 2,905 (+1 RFM0 chan) 876 6 0
h1isietmy 2,905 (+1 RFM1 chan) 876 6 0
h1isiham8 32 0 0 0
h1seiproc 8 0 0 0

add/remove channel names are available in attached tar file.

A new cdsrfm long-range dolphin MEDM was generated to show the additional EX->CS and EY->CS IPC channels.

GDS Broadcaster Additional Channels

Jonathan:

9 new slow channels were added to GDS0 and GDS1 broadcast channel lists. The additional channels are listed below. I've "shown my work" in how to get this list using the new channel-lists archiving system, finding the diffs between the 2am and 2pm files.

david.barker@opslogin0: cd /ligo/www/www/exports/daq/chan_archive/2023/04/25
david.barker@opslogin0: diff h1_gds0_channels_2023_04_25_02_00.txt h1_gds0_channels_2023_04_25_14_00.txt|grep ">"
> H1:CAL-CS_LINE_1_OSC_CLKGAIN
> H1:CAL-CS_LINE_2_OSC_CLKGAIN
> H1:CAL-CS_LINE_3_OSC_CLKGAIN
> H1:SUS-ETMX_L1_CAL_LINE_CLKGAIN
> H1:SUS-ETMX_L2_CAL_LINE_CLKGAIN
> H1:SUS-ETMX_L3_CAL_LINE_CLKGAIN
> H1:SUS-ETMY_L1_CAL_LINE_CLKGAIN
> H1:SUS-ETMY_L2_CAL_LINE_CLKGAIN
> H1:SUS-ETMY_L3_CAL_LINE_CLKGAIN
 

DAQ Restart

Dave, Jonathan:

The DAQ and EDC were restarted to support the model changes, the EDC changes and the GDS broadcast list changes.

GDS0 needed a second restart to resync its channel lists, but not GDS1.

FW0 spontaneously crashed after running for about 10 minutes. FW1 was not fully operational at this time and we may have lost a full frame.

Reboot/Restart Report

Tue25Apr2023
LOC TIME HOSTNAME     MODEL/REBOOT
09:22:42 h1oaf0       h1calcs     
09:23:22 h1iscex      h1calex     
09:23:52 h1iscey      h1caley     
09:32:05 h1seiex      h1isietmx   
09:32:34 h1seiey      h1isietmy   
09:33:14 h1seib1      h1isiitmy   
09:33:40 h1seib2      h1isibs     
09:34:09 h1seib3      h1isiitmx   
09:34:39 h1cdsh8      h1isiham8   
09:35:13 h1oaf0       h1seiproc   
09:42:01 h1daqdc0     [DAQ]
09:42:11 h1daqfw0     [DAQ]
09:42:12 h1daqnds0    [DAQ]
09:42:12 h1daqtw0     [DAQ]
09:42:19 h1daqgds0    [DAQ]
09:42:38 h1susauxb123 h1edc[DAQ]
09:43:15 h1daqgds0    [DAQ]  <<< 2nd GDS0 restart
09:45:11 h1daqdc1     [DAQ]
09:45:21 h1daqfw1     [DAQ]
09:45:21 h1daqtw1     [DAQ]
09:45:24 h1daqnds1    [DAQ]
09:45:31 h1daqgds1    [DAQ]
09:47:21 h1daqfw0     [DAQ]  <<< FW0 crash
12:28:54 h1pemmy      ***REBOOT***
12:29:51 h1pemmy      h1ioppemmy  
12:30:04 h1pemmy      h1pemmy     
 

Comments related to this report
david.barker@LIGO.ORG - 15:11, Tuesday 25 April 2023 (69006)

Maintenance Detailed Files (tar file)

Non-image files attached to this comment
david.barker@LIGO.ORG - 15:57, Tuesday 25 April 2023 (69011)

DAQ Full Frame Channel Changes

In the directory /ligo/www/www/exports/daq/chan_archive/2023/04/25:

Old total num DAQ channels:

wc -l h1_daq0_channels_2023_04_25_02_00.txt
312647 h1_daq0_channels_2023_04_25_02_00.txt
 

New total num DAQ channels:

wc -l h1_daq0_channels_2023_04_25_14_00.txt
324239 h1_daq0_channels_2023_04_25_14_00.txt
 

Net change +11592

Using the comm command to  show statistics (you can ignore the sort order warnings).

Channels Added to DAQ:

comm -1 -3 h1_daq0_channels_2023_04_25_02_00.txt h1_daq0_channels_2023_04_25_14_00.txt|wc -l
15972

Channels Removed from DAQ:

comm -2 -3 h1_daq0_channels_2023_04_25_02_00.txt h1_daq0_channels_2023_04_25_14_00.txt|wc -l
4380

Which gives a delta of 15,972 - 4,380 = +11,592 (W5 which was what we wanted)

To hone in on fast channels only

Fast channels added (datarate != 16Hz) Qty=30

comm -1 -3 h1_daq0_channels_2023_04_25_02_00.txt h1_daq0_channels_2023_04_25_14_00.txt|grep -v " 16$"

H1:ISI-BS_ST2_SUSPOINT_DRIVE_L_EXC_DQ 4 2048
H1:ISI-BS_ST2_SUSPOINT_DRIVE_P_EXC_DQ 4 2048
H1:ISI-BS_ST2_SUSPOINT_DRIVE_R_EXC_DQ 4 2048
H1:ISI-BS_ST2_SUSPOINT_DRIVE_T_EXC_DQ 4 2048
H1:ISI-BS_ST2_SUSPOINT_DRIVE_V_EXC_DQ 4 2048
H1:ISI-BS_ST2_SUSPOINT_DRIVE_Y_EXC_DQ 4 2048
H1:ISI-ETMX_ST2_SUSPOINT_DRIVE_L_EXC_DQ 4 2048
H1:ISI-ETMX_ST2_SUSPOINT_DRIVE_P_EXC_DQ 4 2048
H1:ISI-ETMX_ST2_SUSPOINT_DRIVE_R_EXC_DQ 4 2048
H1:ISI-ETMX_ST2_SUSPOINT_DRIVE_T_EXC_DQ 4 2048
H1:ISI-ETMX_ST2_SUSPOINT_DRIVE_V_EXC_DQ 4 2048
H1:ISI-ETMX_ST2_SUSPOINT_DRIVE_Y_EXC_DQ 4 2048
H1:ISI-ETMY_ST2_SUSPOINT_DRIVE_L_EXC_DQ 4 2048
H1:ISI-ETMY_ST2_SUSPOINT_DRIVE_P_EXC_DQ 4 2048
H1:ISI-ETMY_ST2_SUSPOINT_DRIVE_R_EXC_DQ 4 2048
H1:ISI-ETMY_ST2_SUSPOINT_DRIVE_T_EXC_DQ 4 2048
H1:ISI-ETMY_ST2_SUSPOINT_DRIVE_V_EXC_DQ 4 2048
H1:ISI-ETMY_ST2_SUSPOINT_DRIVE_Y_EXC_DQ 4 2048
H1:ISI-ITMX_ST2_SUSPOINT_DRIVE_L_EXC_DQ 4 2048
H1:ISI-ITMX_ST2_SUSPOINT_DRIVE_P_EXC_DQ 4 2048
H1:ISI-ITMX_ST2_SUSPOINT_DRIVE_R_EXC_DQ 4 2048
H1:ISI-ITMX_ST2_SUSPOINT_DRIVE_T_EXC_DQ 4 2048
H1:ISI-ITMX_ST2_SUSPOINT_DRIVE_V_EXC_DQ 4 2048
H1:ISI-ITMX_ST2_SUSPOINT_DRIVE_Y_EXC_DQ 4 2048
H1:ISI-ITMY_ST2_SUSPOINT_DRIVE_L_EXC_DQ 4 2048
H1:ISI-ITMY_ST2_SUSPOINT_DRIVE_P_EXC_DQ 4 2048
H1:ISI-ITMY_ST2_SUSPOINT_DRIVE_R_EXC_DQ 4 2048
H1:ISI-ITMY_ST2_SUSPOINT_DRIVE_T_EXC_DQ 4 2048
H1:ISI-ITMY_ST2_SUSPOINT_DRIVE_V_EXC_DQ 4 2048
H1:ISI-ITMY_ST2_SUSPOINT_DRIVE_Y_EXC_DQ 4 2048