Lockloss tool:
https://ldas-jobs.ligo-wa.caltech.edu/~lockloss/index.cgi?event=1380243270

This is an interesting Earthquake Lockloss!
SEI went into Earthquake mode at 00:53:02 UTC
We lost lock a minute after that.
Sensors are picking up Big ground motion but Seismon only shows earthquakes from yesterday. And Still has not updated.
Picket Fence clearly picked up the Earthquake in all the traces.
Even USGS didn't tell me where the Earthquake was for over 10 minutes later.
Turns out It was a 4.7 off the coast of Oregon!!

Tagging SEI.
 

Since yesterday we have been struggling to damp ITMY mode 05/06. The nominal settings (with reduced gains) works for some time (as it worked yesterday) and then it turns around and starts getting worse. Hence, I tweaked the settings and found a new one which seems to be working for now (the drive and both the modes have been decreasing for the last few hours),

New settings: FM6+FM8+FM10 Gain -0.02 (phase +30)

I unsuccessfully tried the following two settings which made IY05 worse (while it was working fine for IY06),

FM6+FM10 Gain -0.02 - did not work for IY05, works for IY06 (no phase)
FM6+FM7+FM10 Gain -0.02 - did not work for IY05, works for IY06 (phase -30)

For now I have set the gains to zero on lscparams and would like to test the new settings manually for few locks before committing it in guardian.

I will keep watching the progress for the next few hours.

TITLE: 10/01 Eve Shift: 23:00-07:00 UTC (16:00-00:00 PST), all times posted in UTC
STATE of H1: Observing at 151Mpc
OUTGOING OPERATOR: Corey
CURRENT ENVIRONMENT:
    SEI_ENV state: CALM
    Wind: 13mph Gusts, 9mph 5min avg
    Primary useism: 0.04 μm/s
    Secondary useism: 0.13 μm/s
QUICK SUMMARY:

Locked and Observing for 5 and a half hours.
ITMY Mode 5 is still high, but Rahul has found a new setting that has it going back down.

TITLE: 10/01 Day Shift: 15:00-23:00 UTC (08:00-16:00 PST), all times posted in UTC
STATE of H1: Observing at 153Mpc
INCOMING OPERATOR: Tony
SHIFT SUMMARY:

One lockloss today, and also addressing violins (see Rahul's alog)---the latter looks better. 
LOG:

• 1635 Lockloss
  • Green Arms and DRMI alignment looked good for locking.
  • Locklosses at LOCKING ALS, SHUTTER ALS
  • Needed to help FIND IR on 3rd locking attempt
  • Took ITMy Mode-5 gain to -0.02 (from nominal of -0.04) to help with damping down violins.
  • 1745 back to Observing
• 1821 Rebooted the camera/access system computer (it had frozen)
• 1955 I lowered itmy mode 5 gain & contacted Rahul
• 2009 Rahul starts working on ITMy
  • 2038 Gain changes were not helping ITMy, so this is when Rahul made a phase change (Rahul thought a phase change would bump us out of Observing, but it did not.)

Had a lockloss this morning.  Once h1 was back up to NLN, took this opportunity to lower the gain of ITMy Mode5 from -0.04 (nominal) to -0.02. Attaching another trend of the ITMy 5+6 modes for the last 3.5 days.  (The cursor on the top plot is when Tony worked on Mode5 & the cursor on the plot below it is when Rahul made changes to address rung up Mode 6.

The camera/access system computer froze up.  Access system came back fine, but the camera app can not connect to the server.  Richard had me reboot the Bosch box in the Server Room, but still can't connect.

H1 had a lockloss after about 3hrs (no notable reason).  NOTE:  ITMy Mode5 was taken to it's nominal gain of -0.04 by the VIOLIN DAMPING guardian when it was locking early this morning during the OWL shift. 

Looking at ITMy's Mode 5 for the last lock, it looked like the slope for mode 5's ringing up was slightly higher/steeper with the -0.04 gain, so I am taking it back down to the non-nominal -0.02 gain Rahul & Tony had been using for the 500Hz violin mode recovery/ring down. 

H1 went down at 1635utc & was back to Observing at 1745utc.

Sun Oct 01 10:14:01 2023 INFO: Fill completed in 13min 57secs

Granted we are still not nominal and actively damping/monitoring ITMy modes 5 & 6. 

With that said, with H1's 500Hz violin peak continuing to drop as ITMy overall rings down, ITMy Violin Mode 5 is slowly ringing up [attachment #1 is this current lock], similar to what Tony noted Fri night (73178).  MODE5 has been slowly ringing up since early Friday morning (4am local / 11utc) over several locks [attachment #2].

And looking at both Mode 5 & 6 over the last 3-days, Mode 6 has followed Mode5 with this slow ring up since early Fri morning, but it's magnitude is lower and currently it is ringing down in contrast to Mode 5's ring up [attachment #3 shows Mode 5 + 6 over the last 3 days]. 

At any rate just a look at the bigger picture, while we are currently focused on damping down ITMy.

TITLE: 10/01 Day Shift: 15:00-23:00 UTC (08:00-16:00 PST), all times posted in UTC
STATE of H1: Observing at 151Mpc
OUTGOING OPERATOR: Oli
CURRENT ENVIRONMENT:
    SEI_ENV state: CALM
    Wind: 9mph Gusts, 7mph 5min avg
    Primary useism: 0.02 μm/s
    Secondary useism: 0.13 μm/s
QUICK SUMMARY:

H1 lost lock last night after ~31hrs (went down at about 5am local / 1200utc).  All eyes were on ITMy's violins, but it looks like they were not rung up and continue their ring down from yesterday morning.  H1 also relocked on its first attempted needing a Check Mich Fringes and so forth.  Other than that all is frosty in the Control Room this morning.

TITLE: 10/01 Eve Shift: 23:00-07:00 UTC (16:00-00:00 PST), all times posted in UTC
STATE of H1: Observing at 152Mpc
INCOMING OPERATOR: Oli
SHIFT SUMMARY:

06:55UTC ITMY Mode 5 & 6 update!: Setting the Gain of ITMY mode 5 to -0.04 was great at damping ITMY Mode 6. Unfortunately it was once again bad for ITMY mode 5 which it started to ring up. But Since it was ringing up fairly slowly I kept it at -0.04 to damp ITMY Mode 6 because of how effective it was.
Over all I think this was a slight trade off of maximum Damping IY Mode 6 and slightly Sacraficing IY Mode 5.

Current status:
H1:SUS-ITMY_L2_DAMP_MODE5_GAIN =-0.02
H1:SUS-ITMY_L2_DAMP_MODE5_RMSLP_LOG10_OUTMON = 3.73
H1:SUS-ITMY_L2_DAMP_MODE6_RMSLP_LOG10_OUTMON = 4.50

I will be leaving the Gain at -0.02 for the OWL Shift as that seemed to be the setting that damped IY6 ( slowly) and it seemed to be a decent setting for IY5 and doesnt ring it up as fast.

LOG:
no log

Continued from alog 73180.

IY mode 05/06 has been decreasing, although very slowly (after damping it for more than 12hrs with 50% of nominal gain value. i.e. -0.02).

Tony will ramp up the gain to nominal (-0.04) and watch over it for the next few hours. If it goes fine then the mode should be damped by tomorrow, else we will continue with reduced gain. I will check again in the morning.

I will switch ON damping gains for IY mode 04, 05, 07 and 08 tomorrow morning, once IY06 is under control.

03:48 UTC Changed the Gain on ITMY Mode 5 to -0.04 from -0.02, which is nomial. the goal is to determine if the nomial setting needs to change.
I'll continue to keep an Eye on ITMY mode 5 and 6 thoughout the night and if they start to trend back up I'll take the gain back to -0.02.

H1:SUS-ITMY_L2_DAMP_MODE5_RMSLP_LOG10_OUTMON = 3.32
H1:SUS-ITMY_L2_DAMP_MODE6_RMSLP_LOG10_OUTMON = 4.94

Rahul has advised me that until ITMY Mode 5&6 are under control ITMY Modes 3,4,7 and 8 should all be undamped aswell.

Famis 26254

Checking Fan Vibrometers

H0:VAC-MY_FAN2_270_1_ACC_INCHSEC which has a dip and then rises back up to 0.3.
H0:VAC-MX_FAN1_370_2_ACC_INCHSEC has a suble increase in it's trace.
But both are below the 0.7 threshhold.

 

TITLE: 09/30 Eve Shift: 23:00-07:00 UTC (16:00-00:00 PST), all times posted in UTC
STATE of H1: Observing at 154Mpc
OUTGOING OPERATOR: Corey
CURRENT ENVIRONMENT:
    SEI_ENV state: CALM
    Wind: 11mph Gusts, 7mph 5min avg
    Primary useism: 0.04 μm/s
    Secondary useism: 0.12 μm/s
QUICK SUMMARY:
ITMY Mode6 Rung up far more than I thought it would have. Rahul and Corey Have been damping it all day and it has come down by only 0.5. I will continue to keep an eye on ITMY mode 6 for the rest of the shift. 
But we are still locked and Observing for 22+ hours!

TITLE: 09/30 Day Shift: 15:00-23:00 UTC (08:00-16:00 PST), all times posted in UTC
STATE of H1: Observing at 151Mpc
INCOMING OPERATOR: Tony
SHIFT SUMMARY:

Arrived to 14hr-locked H1, but eventually noticed a slowly-ringing-up violin mode via OMC_DCPD ndscope & DARM FOM (this brought range down about 5Mpc over 12-ish hours).  Contacted Rahul and he found the culprit (the usual, ITMy Mode 5&6) and worked on restoring.  alarm1 computer had no apps running, so I needed to bring those back.  DARM FOM was glitching madly (christmas tree mode?) at the beginning of the shift.  It was huge for all live channels and occurred every few seconds rendering it useless.  Was not a CDS issue after Dave checked.  Did our rung out violins do this?  I don't remember that feature.)

ITMy violins continue to be monitored w/ no/low gain to allow them to continue to ring down (Can finally see the 500Hz violin peak below the legend on DARM FOM---it was hidden behind it all day!)

Access System says the OSB main & kitchen doors have issues, but they are both locked.
LOG:

• 1526 Verbal says incoming earthquake from Canada, but  I don't see that.  On USGS and other sites around that time there is a 4.7 in northern california at 1526...maybe this one?  At any rate we went to EARTHQUAKE mode and back to CALM while h1 rode it out.
  • 1717 Received another Verbal EQ from Canada, but it's the same one from Ferndale, CA.  

Violin modes continue their slow ring down (attached is the OMC DCPD ndscope for this 19hr lock showing the ring up & down thus far.) & H1 recovered last night's range drop after Rahul's violin mode work.  DARM FOM appears to have calmed down a little. Had a couple small Calif earthquakes (listed as Canada by Verbal/Seismon).

Sat Sep 30 10:15:28 2023 INFO: Fill completed in 15min 24secs