Had a lockloss this morning.  Once h1 was back up to NLN, took this opportunity to lower the gain of ITMy Mode5 from -0.04 (nominal) to -0.02. Attaching another trend of the ITMy 5+6 modes for the last 3.5 days.  (The cursor on the top plot is when Tony worked on Mode5 & the cursor on the plot below it is when Rahul made changes to address rung up Mode 6.

The camera/access system computer froze up.  Access system came back fine, but the camera app can not connect to the server.  Richard had me reboot the Bosch box in the Server Room, but still can't connect.

H1 had a lockloss after about 3hrs (no notable reason).  NOTE:  ITMy Mode5 was taken to it's nominal gain of -0.04 by the VIOLIN DAMPING guardian when it was locking early this morning during the OWL shift. 

Looking at ITMy's Mode 5 for the last lock, it looked like the slope for mode 5's ringing up was slightly higher/steeper with the -0.04 gain, so I am taking it back down to the non-nominal -0.02 gain Rahul & Tony had been using for the 500Hz violin mode recovery/ring down. 

H1 went down at 1635utc & was back to Observing at 1745utc.

Sun Oct 01 10:14:01 2023 INFO: Fill completed in 13min 57secs

Granted we are still not nominal and actively damping/monitoring ITMy modes 5 & 6. 

With that said, with H1's 500Hz violin peak continuing to drop as ITMy overall rings down, ITMy Violin Mode 5 is slowly ringing up [attachment #1 is this current lock], similar to what Tony noted Fri night (73178).  MODE5 has been slowly ringing up since early Friday morning (4am local / 11utc) over several locks [attachment #2].

And looking at both Mode 5 & 6 over the last 3-days, Mode 6 has followed Mode5 with this slow ring up since early Fri morning, but it's magnitude is lower and currently it is ringing down in contrast to Mode 5's ring up [attachment #3 shows Mode 5 + 6 over the last 3 days]. 

At any rate just a look at the bigger picture, while we are currently focused on damping down ITMy.

TITLE: 10/01 Day Shift: 15:00-23:00 UTC (08:00-16:00 PST), all times posted in UTC
STATE of H1: Observing at 151Mpc
OUTGOING OPERATOR: Oli
CURRENT ENVIRONMENT:
    SEI_ENV state: CALM
    Wind: 9mph Gusts, 7mph 5min avg
    Primary useism: 0.02 μm/s
    Secondary useism: 0.13 μm/s
QUICK SUMMARY:

H1 lost lock last night after ~31hrs (went down at about 5am local / 1200utc).  All eyes were on ITMy's violins, but it looks like they were not rung up and continue their ring down from yesterday morning.  H1 also relocked on its first attempted needing a Check Mich Fringes and so forth.  Other than that all is frosty in the Control Room this morning.

TITLE: 10/01 Eve Shift: 23:00-07:00 UTC (16:00-00:00 PST), all times posted in UTC
STATE of H1: Observing at 152Mpc
INCOMING OPERATOR: Oli
SHIFT SUMMARY:

06:55UTC ITMY Mode 5 & 6 update!: Setting the Gain of ITMY mode 5 to -0.04 was great at damping ITMY Mode 6. Unfortunately it was once again bad for ITMY mode 5 which it started to ring up. But Since it was ringing up fairly slowly I kept it at -0.04 to damp ITMY Mode 6 because of how effective it was.
Over all I think this was a slight trade off of maximum Damping IY Mode 6 and slightly Sacraficing IY Mode 5.

Current status:
H1:SUS-ITMY_L2_DAMP_MODE5_GAIN =-0.02
H1:SUS-ITMY_L2_DAMP_MODE5_RMSLP_LOG10_OUTMON = 3.73
H1:SUS-ITMY_L2_DAMP_MODE6_RMSLP_LOG10_OUTMON = 4.50

I will be leaving the Gain at -0.02 for the OWL Shift as that seemed to be the setting that damped IY6 ( slowly) and it seemed to be a decent setting for IY5 and doesnt ring it up as fast.

LOG:
no log

Continued from alog 73180.

IY mode 05/06 has been decreasing, although very slowly (after damping it for more than 12hrs with 50% of nominal gain value. i.e. -0.02).

Tony will ramp up the gain to nominal (-0.04) and watch over it for the next few hours. If it goes fine then the mode should be damped by tomorrow, else we will continue with reduced gain. I will check again in the morning.

I will switch ON damping gains for IY mode 04, 05, 07 and 08 tomorrow morning, once IY06 is under control.

03:48 UTC Changed the Gain on ITMY Mode 5 to -0.04 from -0.02, which is nomial. the goal is to determine if the nomial setting needs to change.
I'll continue to keep an Eye on ITMY mode 5 and 6 thoughout the night and if they start to trend back up I'll take the gain back to -0.02.

H1:SUS-ITMY_L2_DAMP_MODE5_RMSLP_LOG10_OUTMON = 3.32
H1:SUS-ITMY_L2_DAMP_MODE6_RMSLP_LOG10_OUTMON = 4.94

Rahul has advised me that until ITMY Mode 5&6 are under control ITMY Modes 3,4,7 and 8 should all be undamped aswell.

Famis 26254

Checking Fan Vibrometers

H0:VAC-MY_FAN2_270_1_ACC_INCHSEC which has a dip and then rises back up to 0.3.
H0:VAC-MX_FAN1_370_2_ACC_INCHSEC has a suble increase in it's trace.
But both are below the 0.7 threshhold.

 

TITLE: 09/30 Eve Shift: 23:00-07:00 UTC (16:00-00:00 PST), all times posted in UTC
STATE of H1: Observing at 154Mpc
OUTGOING OPERATOR: Corey
CURRENT ENVIRONMENT:
    SEI_ENV state: CALM
    Wind: 11mph Gusts, 7mph 5min avg
    Primary useism: 0.04 μm/s
    Secondary useism: 0.12 μm/s
QUICK SUMMARY:
ITMY Mode6 Rung up far more than I thought it would have. Rahul and Corey Have been damping it all day and it has come down by only 0.5. I will continue to keep an eye on ITMY mode 6 for the rest of the shift. 
But we are still locked and Observing for 22+ hours!

TITLE: 09/30 Day Shift: 15:00-23:00 UTC (08:00-16:00 PST), all times posted in UTC
STATE of H1: Observing at 151Mpc
INCOMING OPERATOR: Tony
SHIFT SUMMARY:

Arrived to 14hr-locked H1, but eventually noticed a slowly-ringing-up violin mode via OMC_DCPD ndscope & DARM FOM (this brought range down about 5Mpc over 12-ish hours).  Contacted Rahul and he found the culprit (the usual, ITMy Mode 5&6) and worked on restoring.  alarm1 computer had no apps running, so I needed to bring those back.  DARM FOM was glitching madly (christmas tree mode?) at the beginning of the shift.  It was huge for all live channels and occurred every few seconds rendering it useless.  Was not a CDS issue after Dave checked.  Did our rung out violins do this?  I don't remember that feature.)

ITMy violins continue to be monitored w/ no/low gain to allow them to continue to ring down (Can finally see the 500Hz violin peak below the legend on DARM FOM---it was hidden behind it all day!)

Access System says the OSB main & kitchen doors have issues, but they are both locked.
LOG:

• 1526 Verbal says incoming earthquake from Canada, but  I don't see that.  On USGS and other sites around that time there is a 4.7 in northern california at 1526...maybe this one?  At any rate we went to EARTHQUAKE mode and back to CALM while h1 rode it out.
  • 1717 Received another Verbal EQ from Canada, but it's the same one from Ferndale, CA.  

Violin modes continue their slow ring down (attached is the OMC DCPD ndscope for this 19hr lock showing the ring up & down thus far.) & H1 recovered last night's range drop after Rahul's violin mode work.  DARM FOM appears to have calmed down a little. Had a couple small Calif earthquakes (listed as Canada by Verbal/Seismon).

Sat Sep 30 10:15:28 2023 INFO: Fill completed in 15min 24secs

Attached is a look at the OMCs for this lock and the ring up starts about 8hrs ago.

Have sent a text to Rahul regarding violins.

TITLE: 09/30 Day Shift: 15:00-23:00 UTC (08:00-16:00 PST), all times posted in UTC
STATE of H1: Observing at 151Mpc
OUTGOING OPERATOR: Oli
CURRENT ENVIRONMENT:
    SEI_ENV state: CALM
    Wind: 12mph Gusts, 8mph 5min avg
    Primary useism: 0.02 μm/s
    Secondary useism: 0.11 μm/s
QUICK SUMMARY:

At first glance:  H1's been locked 14hrs w/ slow drift down of ~4Mpc over last 8-ish hrs (but turning around in last hour).  Otherwise fairly quite other than slight breezes of 10mph around the site. 

• Operator alarm1 computer has no apps running on it (i.e. verbal alarms, alarm handlers, teamspeak).  The speaker was also unmuted and at low volume---will need to start that back up.

At 2nd glance: 

• nuc30:  DARM FOM appears to have the issue where all the live channels get a big glitch about every minute. (attached #1)
• nuc31:  OMC dcpds (which we would use to gauge violins) is getting bigger (attached #2).  This led me to look back at DARM and yes, the violin fundamental mode is BIG (peak is behind the legend) [attached #3].

TITLE: 09/30 Eve Shift: 23:00-07:00 UTC (16:00-00:00 PST), all times posted in UTC
STATE of H1: Observing at 153Mpc
INCOMING OPERATOR: Oli
SHIFT SUMMARY:

Uknown Lockloss: 00:05 UTC
relocking started at 00:06 UTC

Nominal_LOW_NOISE reached and PI Mode 31 Spiked to 150! at 00:58 UTC

ITMY Mode 5 is increasing steadily since the beggining of the lock 3:08 UTC I changed the Damping setting from -0.04 to 0 to +0.04 to see If I could damp it. Channel name : H1:SUS-ITMY_L2_DAMP_MODE5_GAIN
3:31 UTC +0.04 gain is taking ITMY mode 5 back down.
The issue is that ITMY Mode 5 is coupled with ITMY mode 6 and while I have changed the gain setting for Mode5 and now mode 5 is slowly going down. Unfortunately Mode 6 is still ringing up and has been for the last 3 locks.
Next shift should keep an eye on those Violin modes. Plots for the mode 5 & mode 6  over the last 2 days attached.
Tagging SUS.
 

LOG:
no log