Rolf, Richard, Jeff, Betsy, Travis, Filiburto, Carlos, Jonathan, Greg, Sudarshan, Dave

Front Ends

All IOCs and front end computers were power cycled. Recovery of Dolphin systems was delayed due to fault in h1seiex, which needed a second reboot to clear. (Jeff requests the split of the single Dolphin master into three be bumped up in priority).

Some IOP models went into "negative" IRIG range for a few minutes. Some corner station systems went into the high positive range and took several hours to come down to operational range. At time of this report, only SEIH45 has an IRIG error.

Yesterday I checked that there were no partial filter module loads or modified files, so the restart should not have loaded any new filters.

Hartman Wavefront Sensors

Elli restarted the HWS code at both EX and EY. The EDCU alerted us that this was not running, EDCU is now GREEN.

DAQ

The DAQ rode through the outage and recovery with no problems. I have cleared the accumulated CRC errors between the FECS and the DAQ concentrator due to the restarts.

DMT

Greg reports all DMT systems are fully recovered.

PCAL camera

Sudarshan and Carlos brought the PCAL camera systems back online.

SDF

All systems are now using their OBSERVE.snap files for their SDF reference.

Restart log

The full restart log is attached. The filtermodule DAQ restart strings shows the last start times for each model alphabetically

• BNS range 75-80 Mpc throughout. Winds up to 20 mph affect the range.
• Lots of long locks, including a 28 hour one.
• Oct 15: Robert turns off HVAC, BNS range increases by 5 Mpc, due mostly to improvement in 50-75 Hz region.  alog 22532
• Oct 15: Commissioning work from 15:00 - 23:00 UTC, switching bias on ETMY ESD, bracketed by suites of DARM OLTF, Pcal to DARM, measurements. The ESD actuation strength has decreased by 7-8%; model comparison looks very good. alog 22561
• Oct 17: Chris B turns on and off CW injection out of observing mode from 16:58 - 17:01 UTC . alog 22602
• Oct 17: Locked for almost the whole day, except for EQ. "No news is good news"!
• Large excitations at 10-20 Hz come and go...
  • eg, here, here.  
  • They are associated with excess non-stationary noise in 100-300 Hz band noted by Sheila on Oct 12 alog 22527 .
  • They are particularly bad on Oct 16 and Oct 19.  
  • The loudest Omicron glich is associated with one of the above-noted excitations: ldvw spectrogram, strain spectrogram
  • What is the origin of these dramatic events?
• FSCAN: Strong wandering lines at (~633Hz and ~1270Hz) come and go - present on 16th, absent on the 17th,  back after relock on 18th,  continuing through 19th.  Fscan data not available on 15th.
  • What is the origin of these wandering lines that are either present or absent in different lock stretches?
• Glitches
  • RF45 glitches still present in Hveto
  • SUS ETMY (60 Hz magnetic) glitches still present in Hveto 
  • BBH and BNS triggers rather peaceful. Loudest triggers show very little in the spectrograms.

More details in the Data Quality shift report, Oct 15-18, 2015

After getting the PSL back, Keita mentioned to me that the alignment into the IMC was off and that he would like
me to bring the pre-modecleaner body temperature back to where it was before the power outage, namely 304.5 K
(as indicated on the MEDM pre-modecleaner screen).  It was sitting at 304 K when Keita ask me.  To do this I
disabled the temperature loop and increased the heater offset.  I had increased the heater offset as high as
0.96.  Then the temperature reached 304.5 K, I locked the pre-modecleaner, reduced the heater offset back to
its previous value of 0.72 and re-engaged the temperature loop.

On a different matter, it might be that the reference level at the ~middle left hand side of the MEDM screen
may need some adjustment/tweaking.  For a long time, this was set to 1.35 (on the slider).  However at times
the pre-modecleaner had difficulty locking and that was because the value between the two less than signs was
larger than the upper limit.  So the front end model thinks the pre-modecleaner is locked even though it's
obviously not.  Reducing the reference level down to 1.2 or 1.1 solves the locking problem, however Jason and
I were informed that the pre-modecleaner locked on a non-TEM00 mode when it was set to 1.10.

Because there have been some indications the now missing HAM3 .6hz line was electronic, I checked that it was still gone after this morning's power outage. It is, so far. Attached spectra are the GS-13s.

The front-end projection matrix elements for propagating HAM2 table motion to the IMs' suspension points had apparently never been installed.

However, the projections have already been computed in userapps/isc/common/projections/ISI2SUS_projection_file.mat, and the displacement vectors used in the computation agree with the systems diagrams (D120062[3456]). So I propagated these projection matrix values to the front-end.

It would also be nice to make and install the projection matrices for the OMs as well, since these have not been computed yet.

J. Kissel

I've updated the CAL-CS and CAL-EX front end models for the bug fix to the INJ ODC, as described in LLO aLOG 21804. As expected, no DAQ restart was required. I suspect that all ODC records reed to be re-filled out, I'll inform Duncan.

Recovery from the power outage is still ongoing.  All planned maintenance day activities have been postponed until recovery is complete.  Currently Keita and Peter are tweaking temps in the PMC.

All running now.

Corner--Pushed Level trip reset button and Green button on the controllers and restart was normal.  Except, PS #1 (south unit) was outputting less pressure than the other three.  We've seen this before after a restart and sure enough the pump was noisy gurgling like.  I changed the ACC & DEC parameters on the VFD and spun down the pump slowly.  I set these parameters to 600 seconds but it was still a little fast for the super low ugf of the controller s I doubled the PID gain to help it out.  A little glitch as the pump stopped and started going backwards before we got the valve closed.  After hitting the VFD reset it started back up and again a pressure glitch as the pump starts and the output valve was reopened.  Pretty sure no one cared at that point.  VFD and PID parameters returned to nominal.

Ends--The VFDs were registering a Low Voltage error, (not sure why this was not the case with the corner station--maybe because they have no power to them until the level trip is reset.)  This requires an EE approved panel intrusion to hit the reset and the normal restart follows.

At EndX the PV di not seem to be holding as it should after it looked like it was doing fine so I expected some kinda issue.  I made a trip to the EndX but it seemed fine at that point.  I spun it down anyway and restarted again and it again and since seems fine.

Travis, the operator, used the wiki instructions and managed okay with them.

This morning after Betsy and Jenne recovered the CS SUS, I tried turning the seismc platforms back on. The HAMs were unusually difficult, the chamber manager was stalling and insisting that the ISI and HPI nodes were stalled. A few things I tried mostly on HAM2, a few on the others:

1. Init-ing every body.

2. Engaging master switches. Occasionally, the chamber manager would go around behind me and turn them back off.

3. Stopping and restarting guardian nodes. On HAM2 I tried just the chamber manager, then all HAM2 nodes.

4. Stopping and Execing all nodes.

5. Reloading all the code on all 3 nodes.

Finally, the only way I could recover the HAM chambers was to go and engage the masterswitch on ISI and HPI, put ISI in Damped, HPI in Isolated, then when HPI was up, I put ISI in High_isolated. When that was done the chamber manager was happy, after hitting INIT on the manager. I've checked HAM4 and HAM6 after and those chamber managers work. The BSC guardians have also been behaving all morning, from what I've seen.

Currently all seismic platforms are up and running.

  Nutsinee, Peter, Jason, Jeff B.

   Checked the TCS-Y chiller system for leaks. Found no active leak in (1) the chiller unit, (2) the external plumbing, or (3) on the TCS-Y table. There were signs of older leaks on both ends of the RF amp. These were dry stains and I could find no current drips around these fittings. I checked in the table (very limited view) and found no evidence of water pooling inside the table. 

   A check of the plumbing under the beam tube, last week, (from the mechanical building to the vertex) was also negative. 

   We had a quick look at the TCS-X table, and found no apparent problems. 

   Both chillers are up and running. I topped off both chillers so they are at the same levels. Will continue to monitor the system.   

RF Oscillator is set at 40.68 MHz.

DC power supplies set at 29.99V and 28A. Output reads 30.00V and 0.75A for TCSX, 30.00V and 0.78A for TCSY.

The rotation stage has been reset for both TCSX and Y (searched for home, then go-to power). TCSX output is now 0.229W.

TCSY laser is currently turned off. It's been off for over a month. I checked with Evan and he said it should be left off for now since no one will play with it anytime soon. To turn it on just hit "ON" button on the CO2Y medm screen. The controller box is ready to go.

The trigger reference level for the pre-modecleaner was changed from 1.35 to 1.10.  This change was accepted in SDF.  The reason for the change is

that with the previous value, the sequencer for the pre-modecleaner thought it was locked when clearly it wasn't.  The lower value was more consistent

with observation.

Having trouble restarting end Y.

'OpsInfo' and 'Lockloss' tags have been added to the LHO and LLO aLOGs. CDS Bugzilla 941 for reference.

J. Kissel, K. Izumi, D. Tuyenbayev

As expected from preliminary analysis of the actuation strength change (see LHO aLOG 22558), DARM Open Loop Gain TFs and PCAL to CAL-CS transfer functions reveal minimal change in the calibration of the instrument. For these measurements, all we have changed in the CAL-CS model is switching the two signs in the ESD stage, which in turn cancel each other. As such, the only change should be the change in discrepancy between the canonical model and the actual current strength of the TS / L3 / ESD stage. Again, this change was small (sub ~10%, 5 [deg]), and has been well-tracked by calibration lines, so we will continue forward with focusing our efforts on determining how to apply the time-dependent corrections.

Attached are screenshots of the raw results. Darkhan's working on the more formal results. Stay tuned!

The after-bias-flip results live here:
/ligo/svncommon/CalSVN/aligocalibration/trunk/Runs/O1/H1/Measurements/DARMOLGTFs/
2015-10-15_H1_DARM_OLGTF_7to1200Hz_AfterBiasFlip.xml

/ligo/svncommon/CalSVN/aligocalibration/trunk/Runs/O1/H1/Measurements/PCAL/
2015-10-15_PCALY2DARMTF_7to1200Hz_AfterBiasFlip.xml

J. Kissel, K. Izumi (with relocking team help from J. Warner, J. Driggers, and S. Dwyer)

We've (finally) completed the couple of ETMY iStage actuator to DARM sweeps + PCAL to DARM sweeps with the IFO locked on ETMX. This took several attempts because (a) the transition from locking the DARM on ETMY to ETMX failed, (b) we accidentally rapidly flipped the ETMY bias while locked on ETMX which glitched the mass, and (c) in efforts to lock, we've rearranged when ASC gets turned on, and in doing so, during the last attempt we forgot to turn on a few of the loops. However, rubbin's racin'.

More details to come once we've processed the measurements carefully, but the preliminary message is that the ESD actuation strength has decreased by 7-8% -- going from ~5-6% stronger than the model, as expected from the continuous estimate of the actuation strength from calibration lines to ~1-2% weaker than the model. Both the UIM and PUM have not changed strength at all, also as expected. As such, because the changes have been accurately tracked by the calibration lines, and the change in TST stage actuation has brought the model systematic from +5 to 6% to -2 to -1%, we will *not* be updating the front-end CAL-CS calibration (and that *includes* the EPICs record to compute the time-dependent parameters). We should also expect to see this change perfectly in the estimation of the actuation strength in the next few hours of this lock stretch.

We're currently retaking DARMOLGTFs and a PCAL2DARM TF to get a similar before vs. after result comparing against this morning's result (LHO aLOG 22546), but we expect to be up and running within the hour, with as good a calibration accuracy as we've had before.

More details, plots, and quantitative results to come!

The data have been committed to 
/ligo/svncommon/CalSVN/aligocalibration/trunk/Runs/O1/H1/Measurements/FullIFOActuatorTFs/2015-10-15
2015-10-15_H1SUSETMY_L1toDARM_FullLock.xml
2015-10-15_H1SUSETMY_L2toDARM_FullLock.xml
2015-10-15_H1SUSETMY_L3toDARM_LVLN_LPON_FullLock_negativebias.xml
2015-10-15_H1SUSETMY_L3toDARM_LVLN_LPON_FullLock_positivebias.xml
2015-10-15_H1SUSETMY_PCALYtoDARM_FullLock.xml

and exported to
/ligo/svncommon/CalSVN/aligocalibration/trunk/Runs/O1/H1/Measurements/FullIFOActuatorTFs/2015-10-15/
2015-10-15_H1DARM_ETMY_L1_State1_Drive_coh.txt
2015-10-15_H1DARM_ETMY_L1_State1_Drive_tf.txt
2015-10-15_H1DARM_ETMY_L2_State3_Drive_coh.txt
2015-10-15_H1DARM_ETMY_L2_State3_Drive_tf.txt
2015-10-15_H1SUSETMY_L3toDARM_LVLN_LPON_FullLock_negativebias_coh.txt
2015-10-15_H1SUSETMY_L3toDARM_LVLN_LPON_FullLock_negativebias_tf.txt
2015-10-15_H1SUSETMY_L3toDARM_LVLN_LPON_FullLock_positivebias_coh.txt
2015-10-15_H1SUSETMY_L3toDARM_LVLN_LPON_FullLock_positivebias_tf.txt
2015-10-15_H1SUSETMY_PCALYtoDARM_FullLock_coh.txt
2015-10-15_H1SUSETMY_PCALYtoDARM_FullLock_tf.txt

J. Kissel

We're taking the IFO out of observation intent and beginning measurement prep for flipping the H1 ETMY bias sign. Stay tuned for detail aLOGs.