Lockloss page
No warning or notice of an Earthquake was given it was a sudden small spike in ground motion.
It was Observed in Picket fence.

USGS didn't post this right away, but it was a M 4.2 - 210 km W of Bandon, Oregon right off the coast.

I took ISC_lock to Initial Alignment after a lockloss at check miche fringes.
Relocking now.



 

Naoki called the control room pretty early and suspected that the Locklosses from last night were from some PI ring ups as seen in Ryans alog 79860 .
So I told him I'd check it out and document it.

Last night during the spooky  & completely automated OWL shift, when no one was around to see it. There were 5 episodes of lock aquisition and locklosses that strangely all happened around the time when the Lock Clock approached the 2 hour mark. 
Turns out, Naoki's gut instinct was right, they were PI ring ups !

Not only was he correct that the Locklosses were caused by PI ring ups but they were Dreaded Double PI Ring up! Some Say that the Double PI ring up is just a myth or an old operator's legend. Its supposedly a rare event when 2 different Parametric Instabilities modes ring up at the same time!
But here is a list of the Dreaded Double PI ring up sitings from just last night! 

2024-09-02_05:34:01Z ISC_LOCK NOMINAL_LOW_NOISE -> LOCKLOSS  Cause: The Dreaded Double PI 28 And 29!!!  The SUS-PI guardian did not change the phase of compute mode 28 at all. Lockloss page

2024-09-02_08:06:14Z ISC_LOCK NOMINAL_LOW_NOISE -> LOCKLOSS Cause: Another Deaded Double PI 28 & 29! Compute mode 28 phase was not moved again this time. Lockloss page

2024-09-02_10:37:06Z ISC_LOCK NOMINAL_LOW_NOISE -> LOCKLOSS Cause: Dreaded Double PI ring up But this time the Phase for 28 changed, But by then it was too late for everyone involved! ( No one was invloved, cause this was completetly automated.)
Lockloss page

3: 2024-09-02_12:38:45Z  ISC_LOCK  NOMINAL_LOW_NOISE -> LOCKLOSS Ok I'll admit that this one is not a Dreaded Double PI ring up... but it certainly is a PI 24 ring up!
Lockloss page  After getting some second Eyes on this i am now Convinced that this is a Wind Gust Lockloss.

Maybe it is just the SUS-PI Guardian is having trouble damping PI28  and instead is trying to damp PI29 but that must be ringing up PI mode 29.

If it happens again, Naoki has asked me to simply take the SUS-PI Guardian to IDLE and take the  damping gains for 28 & 29 to 0.
Wish me luck.
 

Mon Sep 02 08:11:20 2024 INFO: Fill completed in 11min 16secs

TITLE: 09/02 Day Shift: 1430-2330 UTC (0730-1630 PST), all times posted in UTC
STATE of H1: Observing at 145Mpc
OUTGOING OPERATOR: Oli
CURRENT ENVIRONMENT:
    SEI_ENV state: CALM
    Wind: 15mph Gusts, 10mph 5min avg
    Primary useism: 0.04 μm/s
    Secondary useism: 0.10 μm/s
QUICK SUMMARY:
14:33 UTC Superevent candidate S240902bq

H1 Is Locked and Observing for 1 hour

NUC 33 stopped working at 23:40-Local time laste night. Hard Shutdown and reboot

A number of Locks and locklosses happened last night, I will start my morning off with investigating those.

TITLE: 09/02 Eve Shift: 2300-0500 UTC (1600-2200 PST), all times posted in UTC
STATE of H1: Observing at 146Mpc
INCOMING OPERATOR: Oli
SHIFT SUMMARY:

• 23:00 - Relocking after EQ; up to CHECK_AS_SHUTTERS
• 23:30 - Reached NLN, starting to troubleshoot SQZ issue - alog79859
• 00:18 - Started observing
• 01:35 - Lockloss from PI 28/29 ringup - alog79860
• 03:46 - Reached NLN and started observing
  • Was relocking up to ENGAGE_ASC before losing lock
  • Ran initial alignment
  • Changed nominal max power from 61W to 60W to hopefully avoid the 80kHx PIs that caused the last lockloss
  • Waited in OMC_WHITENING for 30 minutes to damp violins

LOG:

No log for this shift.

Lockloss @ 01:35 UTC - link to lockloss tool

PI mode 28 suddenly rang up about 5 minutes before the lockloss (almost exactly 2 hours since reaching NLN), callouts for mode 29 started also soon after. It appears that Guardian was trying to damp mode 29 instead of 28; I recall these modes being faily close together, but I wonder if this is the best way to damp this mode as Guardian was unsuccessful. I, unfortunately, was not quick enough to intervene.

While the PIs were rung up shortly before the lockloss, I noticed the OMC TRANS camera start shaking like it has before (most recently in alog79748), and I don't recall seeing it do that so far this weekend.

Once H1 relocked to NLN this evening, I noticed it didn't look like FDS was being injected, and then I saw a notification on the SQZ_OPO_LR Guardian node saying, "too much pump light into fiber? Adjust the half wave plate." Tony pointed me to alog78696 where he needed to make a similar adjustment. I attempted to follow that procedure to lower the green SHG launch power below 35 (threshold in Guardian) from where it was around 36.6 using the half-wave plate, but I was unsuccessful. Moving the 'SQZ SHG FIBR HWP/QWP' picomotor (motor 3) made the launch power signal shake as the wave plate moved, but the level did not change. I called Naoki for assistance and he corrected me, saying that I should have been moving the half-wave plate before the launch and rejected PDs instead of the one after them; making the correct motor be 'SQZ Laser FIBR HWP/SHG GR power' (motor 2). He made the adjustments necessary to bring the launch power down and rejected power up, then used Guardian to inject squeezing without issue.

H1 started observing at 00:18 UTC.

TITLE: 09/01 Day Shift: 1430-2330 UTC (0730-1630 PST), all times posted in UTC
STATE of H1: Earthquake
INCOMING OPERATOR: Ryan S
SHIFT SUMMARY:

11 Hour Lock was lost due to a 6.4 Mag Earthquake in the Soloman Islands.

Initial alignment started when ground motion as seen by PeakMon was consistently below 800 for 5 mins. @ 21:42 UTC
I.A. Completed and the Gorund Motion was still above 200. 
Locking started at 22:09 UTC

22:40 UTC Lockloss from LOWNOISE_COIL_DRIVER when a rogue increase in ground motion struck.
Nominal_Low_Noise reached at 23:30 UTC
 

LOG:
No log

TITLE: 09/01 Eve Shift: 2300-0500 UTC (1600-2200 PST), all times posted in UTC
STATE of H1: Lock Acquisition
OUTGOING OPERATOR: Tony
CURRENT ENVIRONMENT:
    SEI_ENV state: EARTHQUAKE
    Wind: 8mph Gusts, 5mph 5min avg
    Primary useism: 0.15 μm/s
    Secondary useism: 0.08 μm/s
QUICK SUMMARY: H1 is relocking following a large EQ and possible aftershock. Tony ran an initial alignment and H1 just locked DRMI.

• EQ band still elevated but on its way down; otherwise environment is quiet
• All other systems nominal

TITLE: 09/01 Day Shift: 1430-2330 UTC (0730-1630 PST), all times posted in UTC
STATE of H1: Observing at 145Mpc
CURRENT ENVIRONMENT:
    SEI_ENV state: CALM
    Wind: 10mph Gusts, 7mph 5min avg
    Primary useism: 0.01 μm/s
    Secondary useism: 0.09 μm/s
QUICK SUMMARY:
Just chilling out max on this sunny Sunday!
Neil and his parents stopped by the control room for a quick chat about what we do here and a quick stroll to the overpass.
It's been great over her for exactly 11 Hours.

~!--.--!~
There is an incoming 6.6 Magnitude earthquake coming from the Soloman Islands......

 

VACSTAT reported a glitch in BSC3, H0:VAC-LX_Y8_PT132_MOD2_PRESS_TORR at 02:21:57 Sun 01 Sep 2024 PDT.

This looks like a sensor glitch, it is only 6 seconds wide and has no characteristic pump-down curve. Nothing was seen in the neighbourhood BSC2 at this time.

Attachment shows VACSTAT MEDM and ndscope of PT132 covering about 40 mins.

Sun Sep 01 08:11:50 2024 INFO: Fill completed in 11min 46secs

TITLE: 09/01 Day Shift: 1430-2330 UTC (0730-1630 PST), all times posted in UTC
STATE of H1: Observing at 147Mpc
OUTGOING OPERATOR: Oli
CURRENT ENVIRONMENT:
    SEI_ENV state: CALM
    Wind: 2mph Gusts, 0mph 5min avg
    Primary useism: 0.01 μm/s
    Secondary useism: 0.08 μm/s
QUICK SUMMARY:

When I walked in this morning the IFO had been locked and observing for 5 hours.
IFO_Notify has not contacted anyone over the OWL shift.
The IFO did lock it's self over the night it just took some time and had multiple locklosses before doing an Initial alignment which helped it get get to NLN @ 9:28 UTC.


NUC 33 survived the night!

 

TITLE: 09/01 Eve Shift: 2300-0800 UTC (1600-0100 PST), all times posted in UTC
STATE of H1: Lock Acquisition
INCOMING OPERATOR: Oli
SHIFT SUMMARY: Two locklosses this evening, but relocking was straightforward and so far fully automated each time. H1 is currently relocking, currently locking green arms.

• 23:00 - Finishing up calibration sweeps and gain setting
• 23:07 - Started observing
• 23:14 - Lockloss - alog79844
• 00:14 - Observing
• 05:45 - Lockloss - alog79849

LOG:

No log for this shift.

Lockloss @ 05:45 UTC - link to lockloss tool

No obvious cause, but it looks like LSC-MICH started seeing something wobble about 2 seconds before the lockloss.

Lockloss @ 23:14 UTC - link to lockloss tool

No obvious cause; maybe some small motion by ETMX immediately before lockloss like we've seen before, but it's much smaller than usual.