https://ldas-jobs.ligo-wa.caltech.edu/~lockloss/index.cgi?event=1382036394

Sun Oct 22 10:11:26 2023 INFO: Fill completed in 11min 22secs

TITLE: 10/22 Day Shift: 15:00-23:00 UTC (08:00-16:00 PST), all times posted in UTC
STATE of H1: Observing at 164Mpc
OUTGOING OPERATOR: Camilla (OWL)
CURRENT ENVIRONMENT:
    SEI_ENV state: CALM
    Wind: 5mph Gusts, 3mph 5min avg
    Primary useism: 0.02 μm/s
    Secondary useism: 0.23 μm/s
QUICK SUMMARY:

• We've been locked for 16:11, in Observing since 23:03UTC on 10/21
• All systems are looking good, range above 160!
• I had to restart both cdsws13 & 12 as neither of them were responding when I got in

TITLE: 10/21 Eve Shift: 23:00-07:00 UTC (16:00-00:00 PST), all times posted in UTC
STATE of H1: Observing at 146Mpc
INCOMING OPERATOR: Camilla (OWL)
SHIFT SUMMARY:

Locked entire shift with Lock Clock at just over 8hrs.  There was one M4.9EQ from Mexico which H1 rode through.
LOG:

• 2301 H1 to OBSERVING
• 0225 SRM saturations, picket fence, and seisblrms see 4.9 Mexico EQ
  • 0227-0247 EQ Mode (but this is about 4min after the R-wave passed)

All looks well for the last week for all site HVAC fans (see attached).

H1's been locked for more than half the shift thus far & has even rode through another Mexico EQ.  The range has been increasing the entire shift and it looks like are finally touching 160Mpc.  Violin mode (~500Hz) is now below 10^-17.

TITLE: 10/21 Eve Shift: 23:00-07:00 UTC (16:00-00:00 PST), all times posted in UTC
STATE of H1: Observing at 144Mpc
OUTGOING OPERATOR: Ryan C
CURRENT ENVIRONMENT:
    SEI_ENV state: CALM
    Wind: 3mph Gusts, 1mph 5min avg
    Primary useism: 0.02 μm/s
    Secondary useism: 0.34 μm/s
QUICK SUMMARY:

Literally just took H1 to Observing (at2303utc, after Camera Servo completed at 2301utc) after chatting with Ryan.  (Looks like I totally lucked out with RyanC getting H1 to NLN after all the work he did along with Camilla & Dave during the Owl shift due to last night's dolphin crash!).

Violins look a little elevated since last remember (currently just under 10^-16.

For this current lock, Ryan mentioned needing to possibly be mindful of PR3 drifting (because of PRMI not looking good during acquisition).  Mainly want to watch H1 to get past an hr and get back to a longer lock!

TITLE: 10/21 Day Shift: 15:00-23:00 UTC (08:00-16:00 PST), all times posted in UTC
STATE of H1: Lock Acquisition
INCOMING OPERATOR: Corey
SHIFT SUMMARY: Spent most of the shift continuing to try and recover alignments from the dolphin glitch at 8:05UTC. Currently waiting for ADS to converge to go into observing.

I had lots of issues to start in the morning, ALS_X would lose lock for no apparent reason or its WFS would oscilate too hard and kill its lock, then Diff_IR kept being "not really found" then PRMI buildups were very unstable and we couldn't get good enough flashes to get DRMI. I tried an IA, and then moving SR3 and PR3 based on their OPLEVS to where they were before the dolphin glitch, adjusting SR3 made PRMI better and PR3 made it worse.

I ended up trying to a full slider restore to a time when we were locking for the lock that was killed by the computer crashes (10/19 18:09UTC), still no luck getting PRMI or DRMI. I was considering doing another IA or restoring the sliders to after Camilla's IA this morning, after calling and talking with Jenne I did an initial alignment and not another restore. After this IA we went back up to NLN without any interventions, I stepped slowly through the states just in case. The violins had rung up a bit, but they damped down pretty quickly and weren't much of a hinderance.

Once I got to NLN, the SQZ manager had the notification "SQZ ASC AS42 not on?" So I went to RESET_SQZ_ASC then back to FREQ_DEP_SQZ following Vickys instructions in alog71083. While waiting for the ADS to converge I went through the large amout of SDF diffs for BOS and OAF from 8:50UTC which looked to be when Dave restarted their models, I reverted almost all of them after talking to Jenne (they were all COEFF) except for 1 in BOS. Naoki also hopped on to optimize the squeezing before we went back into observing, I optimized the OPO temperature when he was done and accepted it in SDF then went into observing at 20:49UTC.

Lockloss at 21:22UTC

Lost lock during PRMI_ASC from Yarm losing lock. PRMI keeps locking then losing it seconds later, flashes were super low. Tried CHECK_MICH after a few PRMIs. I trended PRM, PR3, SR3, and the BS to see if anything had moved since the LL, I ended up adjusting PR3 in yaw by .2 (155.5 ->155.3) since it looked like it drifted a little bit and then the flashes looked much better. Not sure why it moved? I also had to tap PRM a little but in pitch (2 microradians, -1502.4 -> -1504.4) and it caught PRMI then DRMI. Guardian brought us up the rest of the way no problem.

LOG:

No log

No obvious cause, https://ldas-jobs.ligo-wa.caltech.edu/~lockloss/index.cgi?event=1381958566

Kept losing lock from green arms, the ALS error signals didn't look great, so I started an Initial alignment at 15:12UTC which finished at 15:33UTC. I kept losing it at ALS from XARM_WFS_DOF1_P so I turned it off (I had to do this every lock attempt) and then DIFF_IR kept reported "IR not actually found" so I had to move it around by hand. During PRMI I misaligned PRM to check on the BS and it looked great on AS_AIR, guardian took us to CHECK_MICH while I was in the middle of checking the BS.

Defiantly something is misaligned, I couldn't get PRMI for a while and finally I tried to adjust SR3 in yaw to match its OPLEV from before the glitch and that got PRMI to finally lock, but it was unstable and lost it soon after, so something else is still badly aligned, the PIT signal looked good for SR3 based on the OPLEVS. PR3 OPLEV looks a little different as well so I adjusted it back to where it was.

I have to slowly step up in states to not lose lock going through ALS and IR, even with the DOF dance Xarm just loses it for seemingly no reason. I tried requesting LOCK_SLOW_NO_WFS let it settle in LOCKING_GREEN_ARMS then requested LOCKING_ALS and I did not have to turn off any WFS for Xarm. In CHECK_IR DIFF IR was not really found as it hasn't been every attempt. As I was trying to find DIFF_IR we went to EQ mode and lost lock from the quick ground motion increase (5.0 from Mexico?). I going to go make a cup of coffee while the ground motion calms down.

Sat Oct 21 10:10:54 2023 INFO: Fill completed in 10min 50secs

TITLE: 10/21 Day Shift: 15:00-23:00 UTC (08:00-16:00 PST), all times posted in UTC
STATE of H1: Lock Acquisition
OUTGOING OPERATOR: Camilla (OWL)
CURRENT ENVIRONMENT:
    SEI_ENV state: CALM
    Wind: 5mph Gusts, 3mph 5min avg
    Primary useism: 0.02 μm/s
    Secondary useism: 0.33 μm/s
QUICK SUMMARY:

• Relocking following a dolphin crash
• IFO has lock lock at higher states several times in a row, DRMI_TO_POP, ENGAGE_ASC
• SEI/SUS/VAC/Dust looks good

Investigating a dolphin crash of several corner station front ends.