The IMC hasn't locked since the lockloss.  While following the troubleshooting Wiki instructions, I attempted to use Dataviewer to look at trends of various IMC related channels to no avail (see screenshot of error) no matter which data rate setting I chose.  With no data to point me to what is wrong, I cleared the IMC WFS as a hail mary.  This didn't help.  I'm not sure what to do next here.

Didn't notice anything out of the ordinary on the FOMs, other than the range dropping since the beginning of the lock stretch.

Changing the gain of PI mode 9 kicked us out of Observe.

With microseism above the 90th percentile, I had to wait for the EQ to ring down entirely before make much progress locking (~2 hours).

5.4M Guisa, Cuba

Was it reported by Terramon, USGS, SEISMON? Yes, Yes, No

Magnitude (according to Terramon, USGS, SEISMON): 5.4, 5.4, NA

Location: 43km S of Guisa, Cuba; LAT: 19.9, LON: -76.6

Starting time of event (ie. when BLRMS started to increase on DMT on the wall): 9:15 UTC

Lock status?  Locking at the time, became unable to proceed with locking.

EQ reported by Terramon BEFORE it actually arrived? No, I noticed it on the BLRMS before the USGS even reported it.

TITLE: 1/17 Owl Shift: 08:00-16:00 UTC (00:00-08:00 PST), all times posted in UTC
STATE of H1: Initial Alignment
OUTGOING OPERATOR: Jeff B

QUICK SUMMARY: After the PSL crash at the end of Jeff's shift, the alignment doesn't look so good, so I'm running through IA.

Shift Summary:Lost lock due to PSL Head Flow sensor error. Jason recovered the PSL. Reset the Noise Eater and the X-Arm Fiber Polarization. Tried relocking and could not get either arm to lock green. Ran Green Arm Initial Alignment and restarted locking. Locking appeared to be working and was at DRMI-1F when Travis came in.

Activity Log: Time - UTC (PT)

  PSL tripped at 06:15 (22:15) with a Head 1-4 Flow Sensor error. Jason recovered PSL. I reset the Noise Eater.

IFO is locked at NOMINAL_LOW_NOISE. The power is 28.6W and the range is up to 59 Mpc.  The intent bit was set to Observing during the first half of the shift, except for a couple of short periods at the beginning of the shift when I dropped it out while working on the PI Modes.   

The PI modes have settled down. Mode-9 is a little higher than I would like. However, it is not responding to tweaks and seems to be happy around 1.0. I am going to leave it where it is, for now.  The violin mode are behaving reasonably well after Patrick suppressed them at the end of the Day shift.

The environmental conditions are good and improving. The wind is Light Breeze (1-3 MPH). Primary and secondary microseism are elevated but no longer rising. 

After Patrick finished damping the ETMY Mode-10 violin mode, I acceptrd accepted the SDF difference (screen shot attached) so we could go into Observing.

Ops Shift Transition:01/16/2017, Evening Shift 00:00 – 08:00 (16:00 - 00:00) - UTC (PT)

Incoming operator: Jeff B.

Microseism has gone over the 90 percentile.

SUMMARY:

Sheila, Jenne, Keita, Kiwamu, Robert, Evan G., Heather (new fellow) and Jeff K. were all here today. They helped find and fix two problems. The first is that the dither align scripts that I ran yesterday changed the offsets for the misalignment of ITMY. This became apparent when we saw fringes on the AS AIR camera during input align. When Keita moved ITMY, the fringes changed and then disappeared. I used Conlog to see if the misalignment offsets had changed. They had during my shift yesterday. I hypothesised that perhaps the dither alignment scripts I ran might have changed them. Jenne looked at the scripts and confirmed that they would. She has modified them so that they will not do this in the future. The second problem was that after losing lock from INCREASE_POWER (when Jenne engaged a filter?) and then again while waiting for DRMI to lock on 1f, I noticed that the alignment of ITMY jumped. Keita hypothesised that this could be a result of rubbing, and Sheila looked at the spectrum of the quad suspensions when set to SAFE (free swinging). From these it was apparent that ITMY was different. This seems to have been fixed by changing the vertical offset of the ITMY suspension relative to the ISI. After this I ran another initial alignment and was able to make it to NLN, so perhaps this also fixed the lock losses from LOWNOISE_ASC.

Once at NLN Jenne helped me set up to damp the 4735 Hz ETMY violin mode. We increased the gain for the ETMY mode 10 from .02 to .1 and then to .2. The output later began to ring up and we set it back down to .1. I accepted the SDF differences for this and earlier changes and went to observing. Almost immediately PI mode 28 rang up. I was able to damp it by changing the phase and both the sign and magnitude of the gain. When this mode was damped, PI mode 27 started ringing up. For a long period I could only bring it back down to around 1. In the process of doing so I dropped out of observing to change the PLL set frequency (H1:SUS-PI_PROC_COMPUTE_MODE27_PLL_SET_FREQ) to match the frequency count (H1:SUS-PI_PROC_COMPUTE_MODE27_PLL_FREQ_COUNT_OUTPUT). It was 238.5 and I changed it to 240.2. Eventually it came down further on its own. I then accepted this change in SDF and went back to observing. Then I noticed that the ETMY mode 10 damping output was ringing up again. I dropped out of observing again to drop the gain from .1 back to the original .02. I left it out of observing and handed the IFO over to Jeff B.

LOG:

17:06 UTC Power in arms is too low to lock ALS. Starting initial alignment.
17:14 UTC Restarted video2. CDS overview frozen.
17:31 UTC Stopping at INPUT_ALIGN_OFFLOADED to investigate fringes on AS AIR camera.
19:00 UTC Jeff K., Heather and Casey to LVEA for tour.
19:37 UTC Granted Gerardo remote access to address CP3 filling.
19:46 UTC Initial alignment done
19:47 UTC Jeff K., Heather and Casey out of LVEA
20:33 UTC Lock loss from INCREASE_POWER after Jenne engaged filter. ITMY came back very misaligned.
20:56 UTC Lock loss while waiting for DRMI to lock on 1f. ITMY moved alot again.
22:17 UTC Starting initial alignment
23:15 UTC Sheila and Evan to roof
23:49 UTC Observing
00:21 UTC Observing

23:49 UTC Accepted SDF differences from corrective maintenance (sdf_diff.png) and went to observing. We increased the gain on ETMY mode 10 to damp the 4735 Hz violin mode. PI mode 28 almost immediately rang up after going to observing. I was able to damp it by changing the phase and gain. PI mode 27 rung up soon after. I had much more trouble damping this one, but it seems to have come back down now. I dropped out of observing upon changing its PLL set frequency (H1:SUS-PI_PROC_COMPUTE_MODE27_PLL_SET_FREQ) to match its frequency count (H1:SUS-PI_PROC_COMPUTE_MODE27_PLL_FREQ_COUNT_OUTPUT).

00:21 UTC Accepted SDF difference for change in PI mode 27 PLL set frequency  (sdf_diff_pi.png) and went back to observing.

The range started around 60 MPc and is steadily decreasing.

Control room crew including Keita Patrick Sheila Jenne Robert

As Betsy pointed out last night, the top mass osems in the corner station show that things have been sagging recently. The first screenshot attached is a 300 day trend of the same top mass osems that Betsy plotted.  

Patrick noticed that twice this morning when we lost lock, ITMY had a large alignment shift, although none of the control signals going to the suspension changed. (PDF attached) This probably explains why operators had to keep repeating initial alingment yesterday. 

Keita suggested that we look at the top mass osem spectra with no damping on, and indeed the spectra of ITMY are different from the other quads, which can be seen in the third attachment. We then added an offset to the top mass vertical osem, which moved it up by about 20 um (so that the top mass osem is back near 50um where it was in December).  The after the move the undamped spectra are much more similar to the other quads (third attachment shows the comparison to ETMY of ITMY with and without the offset, for V only, 4th png shows all DOFs)

We are now proceeding with inital alingment one more time, and will attempt to lock.  

The times are: all 4 quads undamped at 21:24:04 UTC Jan 16th 2017 to 21:43:00.  Offset added to ITMY vertical at 21:47:15 UTC.  

I don't think this is a serious problem at this time, but the 3rd knob (the one closest to the fibers) on the ALS fiber polarization controller box in the MSR, or the motor associated with it, seems to be a little loose, at least when controlling the Xarm. 

I didn't check with the Yarm since it's polarization didn't need adjusting, but when spinning the 3rd knob, the degrees read back on the front panel weren't changing as expected.  I was monotonically turning the knob in one direction, but the readback degrees were bouncing between 2 or 3 values.  When I pulled gently on the knob while turning to give it some more friction, the readback degrees seemed more likely to change as expected - at least I was able to change them at all, rather than just bouncing between 2 values. 

Anyhow, I'm not sure that action is required at this time, but did want to document that this is happening, so that if others see it or it gets worse, we know that it's been happening.  If we have a spare, we may consider swapping it out, but it is not currently an urgent problem.

Starting CP3 fill. LLCV enabled. LLCV set to manual control. LLCV set to 50% open. Fill completed in 420 seconds. LLCV set back to 14.0% open.
Starting CP4 fill. LLCV enabled. LLCV set to manual control. LLCV set to 70% open. Fill completed in 60 seconds. TC A did not register fill. LLCV set back to 34.0% open.