Ops Owl Beginning Shift Summary

TITLE: 12/09 [OWL Shift]: 08:00-16:00 UTC (00:00-08:00 PDT), all times posted in UTC

STATE Of H1: Observing @ ~ 79 MPc
OUTGOING OPERATOR: Cheryl
QUICK SUMMARY: 
From the cameras:
The lights are off in the LVEA.
The lights are off in the PSL enclosure.
The lights are off at end X.
The lights are off at end Y.
I can not tell if the lights are on or off at mid X and mid Y.

The 0.03 - 0.1 Hz (earthquake) seismic band is between ~ 0.01 and 0.1 um/s.
The 0.1 - 0.3 Hz (microseism) seismic band is trending slightly up and is now between ~ 0.2 and 0.9 um/s.

The winds are between ~ 0 and 15 mph.

See screenshot for ISI blends.

From pinging:
CDS WAP is off at the LVEA.
CDS WAP is off at end X.
CDS WAP is off at end Y.
CDS WAP is on at mid X.
CDS WAP is on at mid Y.

Ops Eve Summary: H1 now in Observe

Ops Eve Summary:  00:01-08:00UTC (16:00-23:59PT)

State of H1: locked in Observe for 2+ hours

Help: Jenne, Sheila, Evan H

Shift Summary:

• H1 trying to lock, alignment is good
• Loses lock DRMI a few times
• Evan H suggests changing blend filters
• Control signals sent to optic quiet down
• Evan H, changes to bounce/violin mode damping

Timeline:

• 05:27:34UTC, H1 locked in Low Noise
• 06:20-07:03UTC Kyle driving down Y arm.
• 06:23:17UTC, GRB alert

 

Kyle driving down Y arm - GRB alert - travel times and GRB times recorded here:

Kyle was here and needed to drive down the Y arm:

• 6:20-6:26UTC - CS to Y am travel
• 6:53-7:03UTC - Y arm to CS travel

Timeline including GRB:

1. 6:20UTC - Kyle at the CS
2. 6:23UTC - GRB alert
3. 6:26UTC - Kyle arrives
4. 6:53UTC - Kyle called to say he was driving back
5. 7:03UTC - Kyle and his car were visible on the outside camera in the parking lot

~2215 - 2250 hrs.local -> Kyle on site to refuel generator running at Y2-8

ETMY ISI blend filters changed - big improvement in motion in Y and RX

Evan Hall suggested changing ETMY ISI blend filters after a couple lock losses between DRMI and ENGAGE_ASC.

The change from all Quiet_90s to Quiet_90 in X direction, and 45mHz in Y direction was easilly seen on ST1_ISO_RX and ST2_ISO_Y, and the ASC control signal in pitch being sent to the optic, ASC-ETMY_PIT_OUTPUT.

Plot attached shows those channels before and after the blend filter change, and ETMX ASC control signal, to compare.

Current blend filter config. medm is also attached.

Violin mode damping turned off

I have edited the ISC_LOCK guardian so that it now turns violin mode damping off before the interferometer reaches nominal low noise. This will hopefully allow us to collect ringdown data on the violin mode fundamentals.

Violin mode damping is still turned on as usual in BOUNCE_VIOLIN_MODE_DAMPING, but it now is turned off in the COIL_DRIVERS state. Thus the modes will still receive a few minutes of damping before DARM is switched to dc readout.

If this behavior needs to be reverted, there is a flag in the main() function of COIL_DRIVERS called self.turnOffViolinDamping which can be set to False.

Violin mode damping in full lock will be re-enabled once sufficient data have been collected.

Evidence that mystery ~650Hz noise caused by COMM VCO

The mystery ~650Hz noise reported here and here also shows up in the PEM rf antenna (in both 9MHz and 45MHz located in CER and LVEA). Further investigation revealed that this peak shows up in the PEM antenna during lock aquisition at the start of the DC Readout Transition step (if it appears at all; it's not present in every lock--more on this later). At the start of this step the ALS COMM VCO is parked at some value.

To determine whether this VCO could be responsible for the ~650Hz noise, the frequency readback of the VCO was compared to the frequency of the mystery peak in the PEM antenna. Attached (figure 1) is a plot of H1:ALS-C-COMM_VCO_FREQUENCY timeseries on top and spectrogram of the PEM 45MHz LVEA antenna on the bottom. The frequency of the peak seems to track with the VCO frequency if you take into account the fact that the VCO frequency readback is digitized into steps of 8Hz (does anyone know why / can we fix this?).

Also, there appears to be 2 different values where the VCO can be parked. Figure 2 has similar plots to figure 1, over a 28hr stretch which contained multiple locks where the peak was sometimes present. In locks where the peak was present, the VCO was set to ~78.7873MHz. For locks where the peak is not there the VCO was set to ~78.7944MHz. These values correspond with two different values of H1:ALS-C_COMM_VCO_TUNEOFS : ~-1.39 and ~1.25, respectively.

To test this, we tried moving the COMM VCO TUNE OFS slider with the IFO locked (before continuing to NLN / Observing). While initially it looked like the peak in the PEM rf channel moved as the slider was moved, the lock broke before we could conclusively tell. The lockloss occurred right as Sheila was moving the slider. We don't know why this should cause a lockloss, so this is a subject for further investigations (it was windy and ground motion-y at the time so it could have been a coincidence).

Also included (figure 3) is a plot of the VCO frequency (again, 8Hz digitization) and the CER Rack temperature. More data is needed, but it looks like the freqency trends down after the temperature rises.

Finally, there is still the question as to why this is showing up in the 9MHz and 45MHz channels (and, ultimately, DARM). As a first check, I compared 9.100230 MHz and harmonics to 78.7873 MHz and harmonics to see if a beat would show up within 600 Hz. Out to 10 harmonics of the VCO frequency the closest they came to each other was 200 kHz--still a mystery.

 

Jordan, Robert, Sheila

Channels are double-precision in the front end, but stored as single-precision in the frames. Maybe Jordan was getting this data from the frames/NDS2, rather than live, so that's why there's this quantization error?

Ops Eve Shift Incoming Report: 2:23UTC, H1 in Observe

Ops Eve Shift: 00:01-08:00UTC (16:00-23:59PT)

State of H1: locked in Observe

Help: Jenne, Sheila, Evan

Details:

• locking DRMI when I arrived, but hadn't made it beyond
• DRMI locked and Sheila and Evan ushered H1 into Low Noise
• I accepted a bunch of Damp Mode diffs in SDF, with Evan's input, plot showing what I accepted attached
• H1 entered Observe at 02:21:50UTC

Site:

• useism is 0.4um/s or below
• winds are between 5mph and 18mph across the site

shortened ramps in early CARM offset reduction steps

We've been having difficulty locking this afternoon (microseism around 0.6 um/sec rms, winds consistently gusting up to 35-40mph at times up to 50mph), the locklosses seem fairly typical of the type that plauge us with high ground motion when we are locked on TR_CARM and ALS_DIFF, see alog 22211

These locklosses seem to be caused by some kind of glitch that happens only while ALS is on DIFF.  I had a look at the LLO guardian and talked to Adam, who doesn't think that LLO has this problem.  There seem to be three differences in the way that we do this step compared to LLO: they ramp the CARM offset much faster (3 seconds for the whole thing vs 25 seconds here), they don't run a servo to ALS diff from AS45Q durring this step, and I believe that they go to a lower CARM offset before they switch DARM from ALS to AS45Q if I'm interpreting the normalizations correctly.  

For now I just sped up the ramp times a good deal, reducing both the 15 second ramp in reduce CARM offset and the 10 second ramp in SWITCH_TO_QPDs with 3 second ramps.  This seems to be a bit better, I think that it has worked  3 out of 5 times that we have tried it in the last few hours, which was better than earlier in the day.  For now I will leave this in. 

closed open testpoints, cleared partial fm load on susetmx

There were some testpoints left open on h1sustmsx,y and h1pemey, I have cleared these.

In the past hour a partial fm load of susetmx was done (ETMX_L3_OPLEV_YAW). The filter file for etmx was last modified 29th Oct, so no new filters were in fact loaded. No one in the control room knew why this had happened, so I did a full load to remove the partial load string. I checked that no filter archive file was generated since the source file was not modified.

~1200 hrs. local -> Started 72 hr. bake-out of Y2-8 BT ion pump

Rotating pumps and diesel generator will be running continuously until Friday -> I'll be out to refuel the generator tonight.

Shift Summary -Day

TITLE:    Dec 8 DAY Shift 16:00-00:00UTC (08:00-16:00 PDT), all times posted in UTC

STATE Of H1: Commissioning

SUPPORT: Sheila, Hugh, TJ, Evan, Jenne

LOCK DURATION:

INCOMING OPERATOR: Cheryl

SHIFT SUMMARY: After maintenance day, winds picked up, sometimes in excess of 45 mph. Locking has been tedious and not gotten past ASC part_3.

ACTIVITY LOG:

15:55 Tv crew is on site

16:00 Christina and crew will start at End-Y

16:03  Jeff B out to LVEA. pulling vacuum plumbing for dust monitors along input arm. Mitch will be joining him when he arrives

16:04  Bubba is going to LVEA to inspect the supports on the crane/snorkel lift

16:10  Richard testing phones at out buildings. Will be calling ops to confirm numbers.

16:12 Schofield and Jordan out to CER.

16:21 Jodie 3IFO Storage monitoring

16:21  Gerardo out to LVEA to replace annulus ion pump on Y manifold.

16:25 took IMC down for Hugh to do some Guardian/ISI work HAM2/3 WP5640

16:28  Betsy into LVEA

16:41 Karen called from End-Y to report water on floor under pump in the mechanical room. John is going to investigate.

16:44  Fill out to LVEA to survey for a future cable run

16:45  Cleaning crew donw at Y heading to X

16:46 Richard is done with phones.

16:56 Jodi is done in LVEA

17:00  Joe returning a hose into the LVEA.

17:03 Travis out to LVEA to join Betsy.

17:04 Port-o-let service on site

17:05 GW/EM Test alarm received

17:11  Betsy called from LVEA. HWFS team can begin.

17:11 Richard out to join Fil in LVEA

17:15  Karen called from End-X. Lights not turning on.

17:23 HFD on site.

17:25  Kyle headed to Y-2-8 to start generator

17:35 Fil and Pete pulling a cable or two on the input arm and also around HAM4. WP5644

17:43 John and Bubba to EX and then EY. Water damage will have the  lights down at EX until further notice.

17:46  Betsy into LVEA to check on maintenance work progress.

17:56  Hugh headed out to Ends to do weekly HEPI fluid checks.

18:14  re-locked IMC

18:15 Chris out to join crew at End-X

18:15 Alistair arrived on site

18:20  Jason reset the PSL WD

18:28  Hugh back from HEPI checks at End Stations

18:45  Hugh finished doing HEPI fluid checks.

18:52  Hugh into LVEA looking for 3IFO parts

18:56 Gerardo finished with annulus pump. Aux cart will stay on until noon.

18:58  CDS WP5637 executed.

19:04  Coca-Cola on site.

19:05  Hugh back from LVEA

19:24  Bartlett to End-Y to take pictures.

19:40 Cleared L4C saturation accumullators.

19:42  Jodi heading into LVEA to check equipment (scope) for auditor.

20:00  Jeff B doing LVEA sweep.

20:10  Begin Initial Alignment

20:20 Gerardo exits LVEA and turns out lights. Richard headed out for a minute before I move on.

20:23  Begin full Locking sequence.

20:35  Kyle heading back down from Y-2-8 arm.

21:43  switching to 90mHz blends in corner after many failed attempts w/high winds.

21:51 Kyle driving out to Y-2-8 again.

22:02 Switched corner back to 45mHz blends and changed ETMX to 45 on axis and 90 off axis. ETMY has been configured this way the whole time. Wind speeds seem to have decreased slightly at EX.

23:00 after many failed attempts, this has been put in the commissioner’s hands.

Removed and Replaced YBM Annulus Ion Pump

Removed and replaced the ion pump for YBM (HVE-LY:75IPBM_II186), this pump had the old style connector which we do not use anymore, so the cable was replaced too.

Aux cart was running until 20:00 utc, started around 17:00 utc to pump out annulus system.

WHAM3 (and 2) GS13 Switching by guardian

As I posted yesterday (LHO alog 24028) HAM2 and HAM3 were consistently tripping when the Guardian switched the GS13s to High Gain after the completion of the Isolation process.  I speculated (like I always do) alot about why this was happening and it was not a problem on the other three HAMs; well actually we aren't switching HAM6 so maybe I need to rethink my space.  Anyway, this morning TJ and I investigated what guardian was doing and I have the following observations.

When the switch GS13 gain was disabled (ISOLATION_CONSTANTS['SWITCH_GS13_GAIN'] = False,) the ISI would isolate just fine.  The gains could then be switched manually, with the old ISI scripts, or the guardian.

I did not try the manual method of just clicking the filters.  Executing the GS13 !HI button on the ISI COMMANDS medm successfully switched the GS13s without tripping the ISI, as it did yesterday.  And now here is the really interesting thing:

I had assumed the switching problem was caused by the timing of the switching, just after completing the isolation and the platform is driving to the Target Locations.  By disabling the Guardian switching I could switch after it was done and not be a problem; this was the case using the COMMAND HI button.

After getting the ISI isolated with the GS13S still in Low Gain, I changed the GS13 Gain Switch to true and when I loaded this, the Guardian switched the blends and the platform tripped.  Looking at the log, it would appear the guardian is not doing anything else other than switching the gain filters.  So, at least for HAMs2 & 3, the way the guardian is switching the gain is the problem and not necessarily the timing of the switching.

Maybe if we could get the GS13 switching to do the same as the COMMAND script we would not be searching for why HAM2 & 3 behave differently than HAMs 4 & 5.

GS13 Gain Switch & FF On/Off w/ Guardian--How it works, how we really want it to work

BS oplev glitch causes DRMI difficulty

From time to time we see some big glitches when DRMI is locking, and it seems likely that some of the time these things cause locklossess.  We sometimes wonder if this is a problem with a glitchy osem, especially when we are having difficulty locking.  

Here is an example of this happening, DRMI survives.  In this case at least it was the BS oplev glitching, as you can see the sum drops at the same time that there are drops in the DRMI build ups.  

Weekly ETM charge measurements

Attached are this week's charge measurements - as usal, they are plotted on the long trend of many months worth of data.  Trends look as expected - very slow trend away from zero - no major surprises.

DQ Shift 30 November - 2 December 2015

- Duty Cycle 83.9% (that includes downtime for Tuesday maintenance)

- Range at 75-80Mpc

- only 1 lock loss (aside from maintenance), caused by 4.5 earthquake in Oklahoma

- For around 6 hours before maintenance started, noise in 10-50Hz region rung up in DARM, also found in PSL ISS and ISI channels

- Also around this time, lots of glitches in 10-20 Hz region, caught by Hveto, but these end while the above noise continued.  Cause of both of these phenomena are unknown.

- On Wednesday, a tractor was used to plow snow, for some of the time it showed up in CS seismometer 10-30 Hz BLRMS, and dropped range by ~5Mpc.

- No BBH/BNS searches run for any of these 3 days

- link to full DQ shift