Estimation of Change in Actuation Coefficient

Summary:  Less than +/-10% Change in DARM Actuation Coefficient from June 28 to present.

On July 14th, we reported in LHO alog #19163 that the DARM actuation after the vent had not changed by more than 10% from its ER7 value. Responding to a request from LeoP, we made a similar plot for the period from June 28 until now.  

The attached plot has 60s-long FFT data plotted in blue and 30-point running averages of the blue data plotted in red. The data includes all times when the Guardian State Vector value was more than 501 (DC Readout).  

The data were generated using the low frequency calibration lines (~ 35 Hz) which had low SNR before July 22nd. We increases the SNR of our calibration lines to about 100, informed by an  ER7 calibration line study, and reported in alog #19792 and the attached comments. Here we have also accounted for the fact that the response function of DARM, C/(1+G), is frequency dependent (calibration lines being few Hz apart) using the DARM refrence model for ER7.

More added to SYS_DIAG

Added a few tests today and removed ITMX/Y L2 OLDAMP Off notification.

Tests added are:

• ESD railed - if the absolute value of the average after 5 seconds stays within +/- 600 of 16200, then it will notify.
• TCS power - if the power is < 50W, notify.
• TCS Flow and IR alarms - if in alarm, notify.
• Beckhoff down - if the elasped time is not greater than the last time the test ran, then it will notify (trending showed that this channel will stop counting when Beckhoff is crashed)

As always, please be aware of these notifications and always investigate when one pops up.

h1susey, so far so good

Carlos, Jim, Dave:

after the re-install of the original h1susey front end computer we have not seen any IOP TIM and/or ADC errors, though it is too early to declare success. To show these errors if they were to appear I am no longer performing a periodic (every minute) DIAG_RESET of EY. However I am still doing this for EX since that system still gliches.

Messy DAQ restart

Dave, Jim:

at 16:20 PDT we restarted the DAQ for a new EDCU ini file. This was not a clean restart, resulting in a confusing overvew screen with some front ends not registering any DAQ status channels. After a clean shutdown and startup of monit on h1dc0 and a manual start of h1nds0 and h1nds1 we got back to a stable system. We have noticed that in the past week monit sometimes has not cleanly restarted the data concentrator daqd process. Looking at today's log files and configuration file cache it appears monit and/or start-stop-daemon got into a race condition which resulted in daqd  being restarted before the complete set of configuration files was ready. We will have to think more about how we got into this condition.

We checked that the current DAQ has the correct INI and PAR files and the frame sizes are correct.

Camera masks set for test mass IR cameras

I have set the masks (and reloaded the config files) for the ITMX spool, ITMY spool, ETMX and ETMY cameras.  Note that these are not the cameras that are used during initial alignment. 

The idea is that with an appropriately set mask to exclude extraneous light on the cameras, we can use the centroid tracking to monitor the spot positions on the test masses over long periods.  These cameras are saturating over the whole central region when the arms are on resonance, so the centering calculation won't be perfect, but hopefully it'll still give us an idea of what is going on. 

None of these had previously had a mask defined. Finding snapshots to help set the mask center and radius was what set off the confusion and investigation earlier.  Elli's script was immensely useful in plotting the images for setting the mask.

Plots below are snapshots from 28 July 2015, around 10:00utc when the IFO was locked.  Overlaid are circles (even though they look like ovals because of the non-square grid) that are equivalent to the masks that I've chosen.  We will see images from inside the circle, and exclude the portions of the image outside the circle.

The centroid values are already trended as slow channels, so we can start looking at the history tonight, particularly if we re-do some thermal tuning tests.

Ops Summary

Patrick, Cheryl, Nutsinee

Most of the logs were hand-written by Patrick. If things don't make sense that means I didn't decode his handwriting correctly.

 

- All time in UTC (PDT) -

14:58 (7:58) Peter getting something out of H2 PSL enclosure

15:02 (8:02) Jeff to LVEA colect CC Data

15:05 (8:05) Shiva and Sudarshan to EX

15:08 (8:08) Filiberto cabling started

15:18 (8:18) Joe check eye wash in LVEA

15:19 (8:19) Peter done

15:20 (8:20) Jeff done

15:34 (8:34) Ed to EY to start TCS

15:35 (8:35) Christina, Karen to EY (cleaning)

15:50 (8:50) Hannah, Elli install TCSY temp. sensor

15:58 (8:58) EX, FIl and Gerado start regen process

16:07 (9:07) Jason to optics lab

16:19 (9:19) Robert starting PEM

16:21 (9:21) Karen, Christina to EX

16:22 (9:22) Thomas, Shiva, ?

16:23 (9:23) Ed temp. back looking for drillbit

16:26 (9:26) Elli, Hannah back

16:27 (9:27) Filiberto and Andrea done, not out

16:30 (9:30) Jason start PMC transfer function

16:31 (9:31) Ed to EY

16:35 (9:35) Jim and Carlos to EY to replace H1scsey fornt end computer

16:37 (9:37) John, Elli, Hanna to LVEA

16:39 (9:39) DAQ restart

16:52 (9:52) Guardian restart full machine

16:54 (9:54) Karen, Christina leaving EX

16:59 (9:59) Robert into PSL

17:00 (10:00) Elli, Hanna to TCS ITMY

17:01 (10:01) DAC PEM CS model restart

17:09 (10:09) Cheryl to PSL

17:10 (10:10) Ed leaving EY and going to EX

17:15 (10:15) Leo about to start charge measurement at EY

17:20 (10:20) ASC-IMC, OMC, CSC model restart (Kiwamu, Keita)

17:35 (10:35) Kiwamu restart H1LSC model

17:36 (10:36) H1 ASC IMC restart (Kiwamu)

17:45 (10:45) Kyle to EY to shut off calibration gas

17:45 (10:45) Nutsinee to help Elli in the LVEA

17:51 (10:51) DAC restart digital video computers

17:53 (10:53) Karen and Christina cleaning in LVEA

17:55 (10:55) DAQ restart

18:00 (11:00) Fil to EX, fix UIM(?) drive

18:13 (11:13) DAQ restart

18:21 (11:21) Robert in PSL

18:24 (11:24) Parada water delivery

18:25 (11:25) Joe done

18:27 (11:27) Robert to LVEA to continues setting up PEM (?)

18:38 (11:38) Gerado and Kyle vack to LVEA

18:39 (11:39) measure power on photodiode

18:45 (11:45) Dave restarting camera servers

18:46 (11:46) Ed done at EX, going to LVEA

18:50 (11:50) Hugh HAM5, testing SDF

19:10 (12:10) Robert done

19:12 (12:12) Ed done

19:12 (12:12) Cheryl done

19:19 (12:19) Fil done

19:28 (12:28) Jim, Hugh, filter bugs in HEPI

19:29 (12:29) Pcal done

19:45 (12:45) Rick back to EX for laptop

19:59 (12:59) TJ, Betsy derail(?) ETMX high voltage driver

20:11 (13:11) Kyle back to EX

20:18 (13:18) Ops computer restart

20:26 (13:26) TJ, Betsy done

20:36 (13:36) Gerado to work with Elli

20:41 (13:41) EX inf. con. gage off

21:00 (14:00) ALS COMM, DIFF, XARM, and YARM nominal state is now SHUTTERED (Sheila)

21:38 (14:38) Fil to EX - try to fix ESD drive

22:13 (15:13) ESD working - Fil going to Mid Y

22:27 (15:27) Jeff to EX to restart high voltage

22:40 (15:40) Jeff coming back

0:53 (17:53) Patrick and Stefan still recovering the ifo.

 

Happy Maintenance Tuesday....

defunct LSC_CONFIGS guardian node accidentally resurected, swiftly destroyed

The old LSC_CONFIGS guardian node, which was defunct but hadn't been properly destoryed, was briefly resurected after the h1guardian0 machine reboot.  It then tried to managed some nodes, which caused a bit of confusion.

I "destroyed" the node so it won't bother us anymore:

guardctrl destroy LSC_CONFIGS

EX UIM Coil Driver - Power Switch Replaced

Replaced the power switch in the UIM coil driver S0900303 at EX. Unit was reported to be found in off position several times in the past few days. We will monitor unit to see if it switches off again.

IO on the PSL - status of the ECR, and measuring power on PDs

Per IO ECR E1300432:

 

Components to be changed in the IO path on the PSL:

1. IO_AB_M15 is changed to IO_AB_W1
2. IO_AB_PD1 is positioned on the reflected beam from the wedge
3. IO_AB_PD3 is added on the transmitted beam from the wedge, and is a large area PD, 100mm^2

Status:  not complete

1. IO_AB_M15 has been changed to IO_AB_W1 - DONE
2. IO_AB_PD1 is positioned on the reflected beam from the wedge - located there but cables are not connected
3. IO_AB_PD3 is added on the transmitted beam from the wedge, and is PDA100A, a large area PD, 100mm^2 - added but a PDA55 with only ~13mm^2 sensing area

Other information collected:

 

PD Channels:

H1:PSL-EOM_A_DC_POWER - thorlabs behind IO_AB_W1

H1:IMC-PWR_EOM_OUTPUT - thorlabs behind IO_AB_W1

PD,measured power:

IO_AB_PD3, thorlabs PDA55, 3.33mW

Incident on BS:

before the splitter, IO_AB_W1, 3.51mW

PD,measured power:

IO_AB_PD1, Newport 1811 RFPD, about 50uW - two beams, fast measurement, needs more time to set up

 

PD Channels:

H1:PSL-PERISCOPE_A_DC_POWER - bottom periscope trans

H1:IMC-PWR_IN_OUTPUT - bottom periscope trans

PD,measured power:

IO_AB_PD2, thorlabs PDA55, 83uW

Incident on steering mirror:

before steering mirror IO_AB_M9, 85uW

Incident on BS:

power in non-PD path, coming off of IO_AB_M10, 85uW

EX Beckhoff dies

After getting the ETMx ESD driver unrailed, we found the Driver state "OFF" via the red/green ESD Active indicator light.  Nice timing all day - the ESD keeps dying just ahead of us trying to use it!

So, after we returned from the railing saga, we resumed running a realignment.  A few mins in we discovered the red light indicating the driver was off.  We toggled some switches to no avail and Fil headed to EndX again.  He found the power supply tripped.  He tried to reset it and it tripped again.  After hunting around for another 20mins, it occured to us to check the Beckhoff - yep, it had crashed.  (The pressure guage that the ESD looks at lost connection and therefore shut down the power supply of the ESD for safety.)  Patrick restarted the Beckhoff, Fil then reset the ESD power supply, and the ESD finally looks healthy again.  For now.

TJ is adding these failure modes into the SYS (alarm) guardian.

Added PSL ISS ref signal to SDF

Added H1:PSL-ISS_REFSIGNAL to the set of monitored channels in SDF. Accepted value of -2.06.

Ring Heater Chassis Fan Filter Module Mod

This morning's maintenance included the addition of Filter modules to he cooling fan circuits in the Ring Heater chassis. Mods were made to Chassis S1201851(End-Y), S1201852(End-X), S1201847(CS) and S1201848(CS). Filter Module # D0902458

IR sensor installed onto CO2Y viewport

Hannah, Nutsinee, John, Elli

We moved the IR sensor for the CO2Y laser from the electronics rack to the viewport on BSC1,  which is where it is meant to be located.  The IR sensor checks whether the CO2 laser is heating the viewport(!).  We took a side panel off of the CO2Y table to install the temperature sensor onto the viewport.  The IR sensor cable runs out of the tube connecting the viewport to the table, up to a small "TCS IR controller box" which is taped to the top of the CO2Y table.  The IR sensor has been tested and is working.  As this procedure was relatively straightforward, we should move the CO2X sensor next Tuesday, time permitting.

science frame updated on LSC, OMC and ASCIMC models

Keita, Kiwamu,

We updated the lists of the sceice frame channels on the LSC, OMC and ASCIMC models. This means that we edited the following master blocks:

• asc/common/models/ASCIMC_MASTER.adl
• lsc/common/models/lsc.mdl
• lsc/common/models/lscimc.mdl
• omc/common/models/omc.mdl
• omc/common/models/omclsc.mdl

Then we recompiled, reinstalled and restarted the three models. Additionally, burtrestored them back to 10:10 PT of this morning. After we double-checked the ini files to make sure that the right channels were selected, we checked in the above common blocks to the SV

Additionally, we added commissioning frame for the EOM driver signals such as LSC-MOD_RF9_AM_ERR and etc

The followings are lists of the science frame channels after the update. Note that we did not edit ALSEX or ALSEY but they are listed for completeness:

kiwamu.izumi@opsws5:/opt/rtcds/lho/h1/chans/daq$ grep -B 1 "^acquire=3" H1LSC.ini | grep DQ
[H1:IMC-F_OUT_DQ]
[H1:IMC-I_OUT_DQ]
[H1:IMC-L_OUT_DQ]
[H1:IMC-REFL_DC_OUT_DQ]
[H1:IMC-TRANS_OUT_DQ]
[H1:LSC-ASAIR_B_RF90_I_ERR_DQ]
[H1:LSC-MCL_IN1_DQ]
[H1:LSC-MCL_OUT_DQ]
[H1:LSC-MICH_IN1_DQ]
[H1:LSC-MICH_OUT_DQ]
[H1:LSC-ODC_CHANNEL_OUT_DQ]
[H1:LSC-POPAIR_B_RF18_I_ERR_DQ]
[H1:LSC-POPAIR_B_RF90_I_ERR_DQ]
[H1:LSC-POP_A_LF_OUT_DQ]
[H1:LSC-POP_A_RF45_I_ERR_DQ]
[H1:LSC-POP_A_RF45_Q_ERR_DQ]
[H1:LSC-POP_A_RF9_I_ERR_DQ]
[H1:LSC-POP_A_RF9_Q_ERR_DQ]
[H1:LSC-PRCL_IN1_DQ]
[H1:LSC-PRCL_OUT_DQ]
[H1:LSC-REFL_A_LF_OUT_DQ]
[H1:LSC-REFL_A_RF45_I_ERR_DQ]
[H1:LSC-REFL_A_RF45_Q_ERR_DQ]
[H1:LSC-REFL_A_RF9_I_ERR_DQ]
[H1:LSC-REFL_A_RF9_Q_ERR_DQ]
[H1:LSC-REFL_SERVO_ERR_OUT_DQ]
[H1:LSC-REFL_SERVO_SLOW_OUT_DQ]
[H1:LSC-SRCL_IN1_DQ]
[H1:LSC-SRCL_OUT_DQ]
 

kiwamu.izumi@opsws5:/opt/rtcds/lho/h1/chans/daq$ grep -B 1 "^acquire=3" H1OMC.ini | grep DQ
[H1:LSC-DARM_IN1_DQ]
[H1:LSC-DARM_OUT_DQ]
[H1:LSC-REFL_SERVO_CTRL_OUT_DQ]
[H1:OMC-ASC_ANG_X_OUT_DQ]
[H1:OMC-ASC_ANG_Y_OUT_DQ]
[H1:OMC-ASC_P1_I_OUT_DQ]
[H1:OMC-ASC_P2_I_OUT_DQ]
[H1:OMC-ASC_POS_X_OUT_DQ]
[H1:OMC-ASC_POS_Y_OUT_DQ]
[H1:OMC-ASC_Y1_I_OUT_DQ]
[H1:OMC-ASC_Y2_I_OUT_DQ]
[H1:OMC-DCPD_A_OUT_DQ]
[H1:OMC-DCPD_B_OUT_DQ]
[H1:OMC-DCPD_NULL_OUT_DQ]
[H1:OMC-DCPD_SUM_OUT_DQ]
[H1:OMC-LSC_DITHER_OUT_DQ]
[H1:OMC-LSC_I_OUT_DQ]
[H1:OMC-LSC_SERVO_OUT_DQ]
[H1:OMC-ODC_CHANNEL_OUT_DQ]
[H1:OMC-PZT1_MON_AC_OUT_DQ]
[H1:OMC-PZT1_MON_DC_OUT_DQ]
[H1:OMC-PZT2_MON_AC_OUT_DQ]
[H1:OMC-PZT2_MON_DC_OUT_DQ]
 

kiwamu.izumi@opsws5:/opt/rtcds/lho/h1/chans/daq$ grep -B 1 "^acquire=3" H1ASCIMC.ini | grep DQ
[H1:IMC-DOF_1_P_IN1_DQ]
[H1:IMC-DOF_1_Y_IN1_DQ]
[H1:IMC-DOF_2_P_IN1_DQ]
[H1:IMC-DOF_2_Y_IN1_DQ]
[H1:IMC-DOF_3_P_IN1_DQ]
[H1:IMC-DOF_3_Y_IN1_DQ]
[H1:IMC-DOF_4_P_IN1_DQ]
[H1:IMC-DOF_4_Y_IN1_DQ]
[H1:IMC-DOF_5_P_IN1_DQ]
[H1:IMC-DOF_5_Y_IN1_DQ]
[H1:IMC-IM4_TRANS_PIT_OUT_DQ]
[H1:IMC-IM4_TRANS_SUM_OUT_DQ]
[H1:IMC-IM4_TRANS_YAW_OUT_DQ]
[H1:IMC-ISS_QPD_PIT_OUT_DQ]
[H1:IMC-ISS_QPD_SUM_IN1_DQ]
[H1:IMC-ISS_QPD_SUM_OUT_DQ]
[H1:IMC-ISS_QPD_YAW_OUT_DQ]
[H1:IMC-MC1_PIT_OUT_DQ]
[H1:IMC-MC1_YAW_OUT_DQ]
[H1:IMC-MC2_PIT_OUT_DQ]
[H1:IMC-MC2_TRANS_PIT_OUT_DQ]
[H1:IMC-MC2_TRANS_SUM_OUT_DQ]
[H1:IMC-MC2_TRANS_YAW_OUT_DQ]
[H1:IMC-MC2_YAW_OUT_DQ]
[H1:IMC-MC3_PIT_OUT_DQ]
[H1:IMC-MC3_YAW_OUT_DQ]
[H1:IMC-ODC_CHANNEL_OUT_DQ]
[H1:IMC-PWR_IN_OUT_DQ]
[H1:IMC-PZT_PIT_OUT_DQ]
[H1:IMC-PZT_YAW_OUT_DQ]
[H1:IMC-WFS_A_DC_PIT_OUT_DQ]
[H1:IMC-WFS_A_DC_SUM_OUT_DQ]
[H1:IMC-WFS_A_DC_YAW_OUT_DQ]
[H1:IMC-WFS_A_I_PIT_OUT_DQ]
[H1:IMC-WFS_A_I_YAW_OUT_DQ]
[H1:IMC-WFS_A_Q_PIT_OUT_DQ]
[H1:IMC-WFS_A_Q_YAW_OUT_DQ]
[H1:IMC-WFS_B_DC_PIT_OUT_DQ]
[H1:IMC-WFS_B_DC_SUM_OUT_DQ]
[H1:IMC-WFS_B_DC_YAW_OUT_DQ]
[H1:IMC-WFS_B_I_PIT_OUT_DQ]
[H1:IMC-WFS_B_I_YAW_OUT_DQ]
[H1:IMC-WFS_B_Q_PIT_OUT_DQ]
[H1:IMC-WFS_B_Q_YAW_OUT_DQ]
 

kiwamu.izumi@opsws5:/opt/rtcds/lho/h1/chans/daq$ grep -B 1 "^acquire=3" H1ALSEX.ini | grep DQ
[H1:ALS-X_ODC_CHANNEL_OUT_DQ]
[H1:LSC-X_ARM_OUT_DQ]
[H1:LSC-X_TIDAL_OUT_DQ]
 

kiwamu.izumi@opsws5:/opt/rtcds/lho/h1/chans/daq$ grep -B 1 "^acquire=3" H1ALSEY.ini | grep DQ
[H1:ALS-Y_ODC_CHANNEL_OUT_DQ]
[H1:LSC-Y_ARM_OUT_DQ]
[H1:LSC-Y_TIDAL_OUT_DQ]
 

All LHO HEPI Foton Files run through foton -c

JimW, HughR

We took all the SEIs down with guardian.  Ran foton -c foton hepifile and then loaded the modified file.  Re-isolated all platforms.

OPLEV Charge measurements

Leo, Jeff
Some charge measurements was done on both ETMs.
We found ETMX ESD driver non functional, Betsy fixed it (see 20203)
Measurements results are in attachments. For most quadrants we have the same trend as discussed in 20067

Guardian/cdsutils upgrade

The guardian core and cdsutils packages were upgraded today:

• guardian: r1485
• cdsutils: r494

After a couple of small issues were ironed out, the guardian machine was rebooted and all nodes are up and running with the new versions:

Notable fixes/features in the new version:

guardian:

• fix handling of jumps in MANUAL mode: jumps are ignored and treated as if the state had returned True (does not leave state)
• managers: add STATUS and STALLED node channels; Node.done property returns True if state is "DONE"
• import mechanism was fixed so that all code imports are properly registered and committed to the archive
• removed MANAGED button from main overview screen (was determined that it wasn't used and was more confusing than not.  It's still available from the STATES screen.)
• "guardlog -x" will open a standard guardlog xterm window
• NOMINAL states are no longer required to be requestable
• better exception handling for connection errors: NDS connection errors should produce CERROR, which should clear up on their own after the server comes back.

cdsutils:

• ezca, nds, better connection exception handling
• gpstime: add "parse" classmethod that can parse arbitrary time/date specifications
• added gpstime cli that can return local, UTC, and GPS times for arbitrary time/date specification

digital video broken snapshot tracked to configuration file

FRS3410. Jenne, Jim, Carlos, Dave

Jenne found that certain digital cameras were not snapshotting correctly. After power cycling the digital video servers and the ITMX spool camera, we tracked the problem down to the "Frame Type" setting in the digital video configuration file. The cameras which fail their tiff snapshotting have this setting set to "Mono12", those which work have "Mono8"

In fact the majority of cameras are set to "Mono8", listing is below.

Question to the digital video experts, what does this setting mean and what have we broken by reverting back to "Mono8"?

 

Using the corner station HWS

There have been some questions about how to run the HWS code.

The HWS code runs on one of three HWS computers, we have one at each end station and one at the corner station.  I have set up a tmux session to run the HWS code constantly at the corner station.  If the code is running, the heartbeat will flash on the TCS HWS ITMX/Y medm screens, and the seidel aberrations will update once a second on the HWS ITMX/Y CODE screen.  To take a measurement using the HWS, in addition to having thr HWS code running, you also need to turn on the RCX link framegrabber power, the Dalsa 1M60 Camera power, and the Superluminescent diode (SLED) power switched on the HWS medm screen.  To increase the lifetime of the SLED and to avoid injecting 1Hz noise into the PEM channels (we are working on filters on the camera power supply to fix this one), we are leaving the HWS hardware off if we are not using it.

 

If you want to stop or restart the corner station code for some reason, you can ssh into the cornerstation hws computer:

>>    ssh -X controls@h1hwsmsr

and attach to the tmux session

>>    tmux attach

This webpage (http://www.dayid.org/os/notes/tm.html) has a list of tmux commands.  We are running two sessions, one for ITMX and one for ITMY.  Go to the relevant session, go to the folder ~/temp, and run the HWS code with the command

>>    Run_HWS_H1ITMX  (or ITMY....)