Title: 11/11 Owl Shift 7:00-15:00 UTC (0:00-8:00 PST).  All times in UTC.

State of H1: Lock acquisition

Shift Summary:  Wind dropped like a rock at ~15:00 UTC.  I began an initial alignment since it had been down for 4 hours and had been through a windstorm.  Microseism is trending up but still at a manageable level. 

Incoming operator: TJ

Activity log:

8:33 GRB alert, LLO was down

12:03 Adjusted X and Y arm ALS fiber polarization

15:42 Chris to X arm for beam tube sealing

Still down after the lockloss earlier due to high winds.  Winds are in the 30s with gusts to over 40 mph, and the forecast predicts it won't get better for the rest of the day.  But who believes the weathermen anyways?? (According to the NWS, they are off by a factor of 2 in their prediction at the moment, however in the wrong direction for GW science.  It is supposed to be 15 mph with gusts to 20.)

I had to call Keita at 4am PST to walk me through an ALS fiber polarization adjustment since I had never done one and could not find a procedure to do so (it is on my list to add to the OPS Wiki).  The wind did its typical thing where it calms just enough to lull you into the sense that you should begin locking again before it picks back up.  Sorry Keita, you should sleep in this morning or get a nice breakfast or something.

Lockloss, most likely due to winds which are gusting to over 50 mph.

Activity Log: All Times in UTC (PT)

00:00 (16:00) Take over from TJ
02:40 (18:40) First of four large (mag 6.9 to 4.9) EQs in Chile. All four arrived within 30 minutes.
05:00 (21:00) Start initial alignment
06:19 (22:19) IFO locked at NOMINAL_LOW_NOISE, 22.1w, 78Mpc
06:24 (22:24) Cleared SDF and set intent bit to Observing
06:56 (22:56) Lockloss – mag 5.2 EQ on Mid-Pacific Ridge
07:30 (23:30) Relocked at NOMINAL_LOW_NOISE, 22.2w, 78mpc
	      No SDF differences flagged – Set Intent bit to Observing
08:00 (00:00) Hand off to Travis


End of Shift Summary:

Title: 11/10/2015, Evening Shift 00:00 – 08:00 (16:00 – 00:00) All times in UTC (PT)

Support: Keita, Betsy, Hugh, Vern, Marissa 

Incoming Operator: Travis

Shift Summary: Had problems locking the ALS green, mostly in X. Keita found the BSC-9 ISI had a large swing on the X platform location. (See #23293). The motion slowed down, and I was able to realign the ALS green for both arms. Tried relocking. Made it to DARM_1F before 4 large EQs hit Chile. Seismic motion is very high right now (See #23296). Waiting for things to settle and will try relocking. 

After seismic activities settled down to below 0.1 um/s and microseism dropped to 0.3 – 0.2 um/s, ran initial alignment. The IFO was locked at NOMINAL_LOW_NOISE. Cleared up several SDF issues, and set the intent bit Observing. Wind at the CS is a moderate breeze (13 – 18 mph) and light to gentle (4 – 12) at the ends and mids. 

Lockloss due to Mid-Pacific Ridge Earthquake. Seismic activity has rung up a bit, but is quickly coming down. Microseism did not change from 0.3 um/s. Wind is up to a fresh breeze (19 – 24 mph) in the CS. The wind at the ends and mids is still light to gentle breeze (4 – 12 mph). Will attempt to relock without doing an initial alignment.

IFO relocked easily without the need for a realignment. Back to Observing
   

 

   IFO is not locked. 

   Between the maintenance activities, problems with a swinging BSC-9 ISI (#23293), and a nine large EQs in Chile, locking has been unsuccessful. 

   After the motion of BSC-9 settled down, I did an ALS realignment, and was able to get the IFO to DRMI_1F, before the first two Chilean EQs (mag 6.9 & mag 6.6) arrived. Low frequency seismic activity jumped up to over 10 um/s, microseism was over 1 um/s. 

   There were at least nine large earthquakes in Chile (mag 6.9 to mag 4.8) within a one hour period. Things are starting to calm down. Will give it a bit more time to settle down and them will redo initial alignment. 

   At least the wind is just a light breeze (4 -7 mph).            

  While relocking at ~ 02:10 (18:10) the seismic plot jumped up to plus 3.0 um/s and microseism went to plus 1.0 um/s. They started to come down when they again both rung up. Seismic plot is at 11.0 um/s and microseism went from 0.7 um/s to back over 1.0 um/s. 

  There was a 6.6 mag EQ and a 6.9 mag EQ in Chile (R-Wave arrival ~ 02:40 (18:40)), a 4.9 EQ mag in Chile (R-Wave arrival ~ 03:04 (19:04)) and a 5.1 mag EQ in Chile (R-Wave arrival ~ 03:09 (19:09)). 

   Not much chance for relocking until the seismic activity calms down.    

People were having problem with relocking after the maintenance.

IMC VCO tune offset was railing at +-5V whenever COMM PLL was trying to enable slow feedback to IMC. TJ manually disabled it, not sure why this was turned on, it seems like the guardian does not touch this.

When both X and Y were unlocked, it was clear that X arm fringe velocity was much much larger than Y arm just by looking at the camera.

It seems like the EX ISI has been going crazy for the past 2 hours or so (first attachment left). I haven't checked if this is due to ground motion, It seems like the FOM for 0.03-0.1Hz band shows us that there's something going on (but EY looks noisier) (second attachment).

The dominant frequency of the noise is about 1/24 Hz, so the frequency is about right (first attachment right).

As I was talking to Jeff, however, ETMX ISI slowed down. We'll see.

(Update: As we were waiting, we are hit by another quake at around 2:10 or so UTC.)

Title:  11/10/2015, Evening Shift 00:00 – 08:00 (16:00 – 00:00) All times in UTC (PT)
	
State of H1: 00:00 (16:00), The IFO is unlocked. Recovering from maintenance window  

Outgoing Operator: TJ

Quick Summary:  Working on relocking after the Tuesday maintenance window.

• TITLE: 11/10 DAY Shift: 16:00-00:00UTC (08:00-16:00 PDT), all times posted in UTC"

• STATE Of H1: Unlocked

• SUPPORT: Keita, Betsy, Cheryl, Patrick

• SHIFT SUMMARY: Maintenance went well, and relocking seemed like it was going to go well, but after losing lock a few steps away from Nominal, I was having trouble keeping green locked. At first the ALSX would lock and seem to be stable, and then the power would dip periodically. The PLL was having issues staying locked, so I thought that this may have been the issue, but then it seemed to have fixed itself and locking wasn't any better.

• I have gone through 2 Initial alignments, maximized the comm beatnote, zeroed the dark offsets, made sure everything seems to be as aligned as I can get it. Keita pointed out to me that the IMC VCO is railed positive and negative, but not sure why. We will keep working and investigating.

• INCOMING OPERATOR: Jeff B

• ACTIVITY LOG:

• 16:00 Christina, Karen - Open receiving bay roll up door
• 16:01 Bubba - Starting well pump
• 16:02 Joe - To LVEA to test eyewash stations and charge lifts
• 16:16 Jordan, Vinny - To EY to set up megnetometers'
• 16:16 Ryan - reboot alog
• 16:17 Jodi - To LVEA to check on 3IFO items
• 16:19 Gerardo - To H2 enclosure to get parts
• 16:23 Bubba - To LVEA on the snorkel lift to check crane shims
• 16:30 Fil, Peter - To LVEA for cable measurements
• 16:38 Jodi  - out
• 16:40 Christina, Karen - Leaving EY to EX
• 16:41 Hugh - To Ends to check HEPI fluid levels
• 16:49 Betsy - Starting EX charge measurement
• 17:04 Jason - To PSL Diode Room to reset PSL WD
• 17:06 Norco - N2 delivery, two trucks
• 17:09 Robert - To LVEA to move a shaker
• 17:17 Jason - done
• 17:19 Jordan, Vinny - back
• 17:26 Fil, Peter - back from LVEA, heading down the Xarm to X2-8, then down the yarm
• 17:25 ISI ITMX ST1/2 WD trip
• 17:30 Water delivery
• 17:30 Hugh - back
• 17:35 Hugh, Mitchell - To LVEA to check HAM6 CPS fitting, and then rotating HAM2 STS-2 seismometer.
• 17:40 - Robert - out
• 17:46 US Linens Delivery
• 17:50 Robert, Jordan, Vinny - To EY for Mag. investigation
• 18:00 Jodi - To MX
• 18:05 Hugh, Mitchell back
• 18:18 Kingsoft water into gate for water sample
• 18:30 Christina, Karen - To LVEA
• 18:33 Bubba - Done in the LVEA, heading to EX to lay tape
• 18:34 Coca-Cola Delivery
• 18:42 Jodi - back
• 18:47 Fil, Peter - back
• 18:49 Joe - To LVEA
• 19:25 Christina, Karen - out
• 19:27 Bubba - back
• 19:34 Joe - out
• 19:34 TJ - To LVEA to start sweep
• 19:50 TJ - out
• 19:54 TJ - To LVEA to unplug snorkel lift
• 20:00 TJ - out
• 20:43 Gerardo, Kyle - back from X2-8
• 21:03 Lockloss @ DARM_WFS
• 21:33 Lockloss @ NOISE_TUNINGS
• 21:43 PRMI to DRMI transition failed
• 22:00 Gerardo, Kyle, Fil to X2-8
• 23:11 Fil back
• 23:26 Gerardo, Kyle back

Tuesday Maintenance was not too invasive today, however we are having troubles recovering locking.  Keita is assisting - we're having ALS locking issues.  To be continued...

On Maintenance, we executed the following taks list in this order:

Betsy ran charge measurements on ETMX then ETMY.

PEM crew did stuff at EY.

People made checks around site (see TJ's report for these details/).

Dave made the channel model change on SUSAUXEX and SUSAUXEY.

DAQ reboot.

Dave cleared numerous open TPs.

Kyle, Gerardo 

Today we closed the 10" gate valve at BT port X2-8, vented the port-side, removed the existing hardware and coupled the new ion pump and hardware to it.  We then pumped out the new volume with the leak detector and helium leak tested the new joints.  This unit is part of the overall ETM charge mitigation efforts taking place at both sites.  A similar unit was installed at BT port Y2-8 a few months ago.  Both of these units still need to be baked-out and tested before being available for use.  We plan on doing so over the next few weeks.  

Likely a coincidental, but sometime around the IFO re-alignments over Sunday morning, the SR2 M3 stage shows a large PIT step (see attached).  Ironically (?) the RF45 glitching started really humming about an hour before that according to the latest-n-greatest RF45 glitch monitor H1:LSC-MOD_RF45_AM_CTRL_OUT_DQ.  Unfortunately the alogs for Sun morning are a bit sparse because microseism and a flurry of EQs passed through and relocking was apparently difficult.  Robert reports in alog 23214 from that morning that he put shakers on HAM5 and 6, but not HAM4, so this cannot account for why SR2 would have had some pretty big re-alignment.

Generator had been running since 2330 hrs. local last night.

Turns out the answer is 'very easily'. I tested by opening testpoints with dataviewer and dtt (aka diaggui). The have different behaviour, with dataviewer generally doing the right thing and dtt doing the wrong thing.

The tests are

1: open the application, open the testpoint, logout of the computer, log back in.

2: open the application, open the testpoint, power down the computer using the power button, power the computer back up, log back in

Dataviewer:

Test 1, once the user loged out, the testpoint was cleared. PASS

Test 2, after the machine was powered down, the test point was stuck on. FAIL. When the computer was powered back on and before the user logged back in, the test point was cleared. PASS?

DTT:

Test 1, after logout the testpoint was stuck on, had to manually clear it. FAIL

Test 2. after power down testpoint was stuck on (even though h1nds1's log showed an "about the clear' message). FAIL. After computer restarted test point still stuck on. FAIL.

So DTT users can easily leave stuck test points if they dont cleanly exit their dtt sessions before logging out or powering down.

We have been running tinj so that it injects transient hardware injections into CAL-INJ_TRANSIENT_EXC.

I updated tinj to use CAL-PINJX_TRANSIENT_EXC, this is the hardware injection excitation channel that uses PCAL.

The procedure was:
  (1) Edit tinj.m to use CAL-PINJX_TRANSIENT_EXC
  (2) Stop tinj using the monit web interface
  (3) Compile run_tinj using the command (note I did not source anything into my env): mcc -R -nojvm -R -nodisplay -R -singleCompThread -m run_tinj
  (4) Commit changes to SVN
  (5) Restart tinj using the monit web interface

I tailed tinj.log and it was updating as expected. And checked that the run_tinj process was running with both monit and top.

I couldn't open up any new medm windows. Everything else seemed to be working fine though. I killed the sitemap process and restarted it, but this did not fix the issue. After the reboot it all worked well.

It seems like this work station in particular has been having issues lately...