LOCKLOSS @ 3:43, this one might be from the EQ. Interestingly enough, SEI_CONF went to CALM (it went to the EQ state, but there was no indicator on Verbal that it ever transitioned in the first place?), and we lost lock shortly after. Notice right after the lockloss the MC_TRANS camera was moving quite significantly in pitch, more evidence that this was potentially motion related.

However, the peakmon ndscope was showing very little movement (~100 counts at the time of the lockloss - scope attached), also the BLRMS for the EQ band was at or right below 0.1 um/s. This is pretty contradictiory, I'm wondering if this was just a coincidence and not EQ related at all? Tagging SEI

EDIT: The lockloss tool did not tag any ground motion related tags, and the lockloss select tool is not showing any ASC/LSC ringups from my eye, conclusion: inconclusive.

LOCKLOSS @ 23:53, looking at the lockloss select, potentially movement in CSOFT P, also noticing some instability in the LSC loops as well - scope attached - Tagging ISC

TITLE: 06/10 Day Shift: 15:00-23:00 UTC (08:00-16:00 PST), all times posted in UTC
STATE of H1: Observing at 137Mpc
CURRENT ENVIRONMENT:
    SEI_ENV state: CALM
    Wind: 7mph Gusts, 5mph 5min avg
    Primary useism: 0.02 μm/s
    Secondary useism: 0.09 μm/s
QUICK SUMMARY:

17:21 UTC a tour group came through the control room.
Confirmed a slow Climb in IMY Mode5. Gain H1:SUS-ITMY_L2_DAMP_MODE5_GAIN was set at -0.04 and I changed it to 0.
Looking at alog 70057 https://alog.ligo-wa.caltech.edu/aLOG/index.php?callRep=70057  I will try a gain of +0.01

Lockloss 19:50 UTC of unknown cause.   

Locking Summary:
No Initial alignment was done before trying to lock again.
DRMI 1f didn't lock but i let it go to Aquire PRMI which then locked and we went on up.
NOMINAL_LOW_NOISE Reached at 21:04 UTC
Intention bit set to Observing 21:09 UTC.

Violin Modes:
ITMY mode 8 is increasing again. I will take the gain to 0 then then up to +0.04 as described in the following alog.  
https://alog.ligo-wa.caltech.edu/aLOG/index.php?callRep=70057
That singular change of gain did not make any difference, but taking the gain back to 0 then turning on FM7 which is a -30 deg phase change then bringing the gain back up to 0.04 did start bringing ITMY Mode 5 down. Tagging SUS

IFO Current Status: NOMINAL_LOW_NOISE & Observing

TITLE: 06/10 Eve Shift: 23:00-07:00 UTC (16:00-00:00 PST), all times posted in UTC
STATE of H1: Observing at 135Mpc
CURRENT ENVIRONMENT:
    SEI_ENV state: CALM
    Wind: 8mph Gusts, 4mph 5min avg
    Primary useism: 0.03 μm/s
    Secondary useism: 0.08 μm/s 
QUICK SUMMARY:

- SEI/DM/CDS ok

- H1 is locked and in observing as of 21:04 UTC

The first attachment shows the distribution of data during O3, ordered by how long into a high-power lock stretch the data were taken. High-power lock segments were identified by either H1:GRD-LASER_PWR_OK:1 or L1:GRD-PSL_OK:1. Solid lines show the data during observing mode only ([HL]1:DMT-ANALYSIS_READY:1); dashed lines show all data accumulated during high-power operation.

Half of observing-mode data were accumulated within the first 9 hours of lock, a third of data were accumulated within the first 6 hours of lock, and a fifth of data were accumulated within the first 3 hours of lock. The distributions are remarkably similar between H1 and L1, and so far, L1's distribution for the first few weeks of O4 seems similar to the distributions for O3.

The second attachment shows the distribution of data during O3, ordered just by total lock length (i.e., without regard to how far into a particular lock stretch the data were taken). Half of observing-mode data were accumulated during locks of more than 20 hours.

Lockloss occured at 19:50 UTC:
Lockloss select URL : https://ldas-jobs.ligo-wa.caltech.edu/~lockloss/index.cgi?event=1370461864
 

Cause currently unknown, awaiting analysis.

CURRENT ENVIRONMENT:
    SEI_ENV state: CALM
    Wind: 4mph Gusts, 2mph 5min avg
    Primary useism: 0.01 μm/s
    Secondary useism: 0.08 μm/s

Sat Jun 10 10:11:44 2023 INFO: Fill completed in 11min 43secs

TITLE: 06/10 Day Shift: 15:00-23:00 UTC (08:00-16:00 PST), all times posted in UTC
STATE of H1: Observing at 138Mpc
CURRENT ENVIRONMENT:
    SEI_ENV state: CALM
    Wind: 5mph Gusts, 4mph 5min avg
    Primary useism: 0.01 μm/s
    Secondary useism: 0.10 μm/s
QUICK SUMMARY:
Current IFO Status: NOMINIAL_LOW_NOISE and OBSERVING for 6+ hours.

TITLE: 06/10 Owl Shift: 07:00-15:00 UTC (00:00-08:00 PST), all times posted in UTC
STATE of H1: Observing at 140Mpc
SHIFT SUMMARY: Mostly quiet shift after relocking and riding out earthquakes.

• Lockloss @ 06:53, immediately prior to shift start
• Touched up ETMY alignment by hand
• Remainder of lock acquisition was automated (needed to CHECK_MICH_FRINGES and lock PRMI); NLN @ 08:28 and Observing @ 08:37
• Reverted one SDF diff (see earlier alog)
• Successfully moved to EARTHQUAKE seismic configuration and rode out 5.8 and 4.7 earthquakes from Fiji and Taiwan, respectively, at 09:51

Handing off to Tony for the day.

LOG:

No log for this shift.

H1 has relocked and is Observing as of 08:37 UTC. There was one SDF diff on the CALEX model when we reached NLN regarding a PCal X OSC time ramp that appears to have been changed at the time of last lockloss. Since this is just a time ramp, it seemed harmless enough to revert it, which I did (tagging CAL, screenshot attached).

TITLE: 06/09 Eve Shift: 23:00-07:00 UTC (16:00-00:00 PST), all times posted in UTC
STATE of H1: Observing at 136Mpc
SHIFT SUMMARY:

- IFO was stable and locked up until the end of my shift, passing H1 to Ryan with the IFO relocking

- Lock #1:

• Acquired NLN @ 21:55, observing @ 22:07
• DCPD AND EX saturation @ 1:11 - looks like a potential CHARD P ringup
• EX saturation @ 1:24/2:20
• LOCKLOSS @ 6:53

LOG:

No log for this shift.

TITLE: 06/10 Owl Shift: 07:00-15:00 UTC (00:00-08:00 PST), all times posted in UTC
STATE of H1: Lock Acquisition
CURRENT ENVIRONMENT:
    SEI_ENV state: CALM
    Wind: 10mph Gusts, 8mph 5min avg
    Primary useism: 0.01 μm/s
    Secondary useism: 0.10 μm/s
QUICK SUMMARY: Taking over from Austin. H1 lost lock @ 06:53 just before handoff; looks like an ASC ringup at 0.45Hz. Currently relocking ALS.

• All systems look good
• Dust monitors all working and levels okay

LOCKLOSS @ 6:53, looking at the lockloss select, potentially movement in CSOFT P, potentially INP1 P/Y and DHARD Y - scope attached - Tagging ISC

H1 has been locked for just over 5 hours. There has been a couple of DCPD and EX saturations alongside what looks to be CHARD P ringups, but the IFO looks to have stabilized.

Picket Fence was updated to replace the seismometer used on the channel 1 stream, which had not been working for some time.

Following up on EJ's alog, I have extended the code to check if the unresponsive filter is under local control by the model. I ran it this afternoon while H1 was in observe, running in 'nice' mode so as to not hammer the frontends with CA requests (delays between requests).

If we disregard locally controlled filters, the number of unresponsive filters is reduced to 3 (see attached). The top one runs on h1lsc, the other two on h1lscaux.

Here is the full list, with locally controlled filters marked with *

Total numer of filtermodules = 13367
num unresponsive 14

h1lsc {'LSC-EXTRA_AI_2': 'FM2  '}

h1lscaux {'LSC-LOCKIN_1_DEMOD_9_I': 'FM1  ',
          'LSC-LOCKIN_1_DEMOD_9_Q': 'FM1  '}

h1sqz {'SQZ-RLF_VCXO_SERVO': 'FM2* '}

h1alsex {'LSC-X_ARM_DRIVE': 'FM3* FM5* '}

h1alsey {'LSC-Y_ARM_DRIVE': 'FM3* FM5* '}

h1sussqzin {'SUS-ZM1_M2_COILOUTF_LL': 'FM1* FM6* ',
            'SUS-ZM1_M2_COILOUTF_LR': 'FM1* FM6* ',
            'SUS-ZM1_M2_COILOUTF_UL': 'FM1* FM6* ',
            'SUS-ZM1_M2_COILOUTF_UR': 'FM1* FM6* ',
            'SUS-ZM3_M2_COILOUTF_LL': 'FM1* FM6* ',
            'SUS-ZM3_M2_COILOUTF_LR': 'FM1* FM6* ',
            'SUS-ZM3_M2_COILOUTF_UL': 'FM1* FM6* ',
            'SUS-ZM3_M2_COILOUTF_UR': 'FM1* FM6* '}
 

TITLE: 06/09 Day Shift: 15:00-23:00 UTC (08:00-16:00 PST), all times posted in UTC
STATE of H1: Observing at 137Mpc
CURRENT ENVIRONMENT:
    SEI_ENV state: CALM
    Wind: 7mph Gusts, 5mph 5min avg
    Primary useism: 0.04 μm/s
    Secondary useism: 0.10 μm/s
QUICK SUMMARY:

At 20:10 UTC the SQZ_MANAGER went from FREQ_DEP_SQZ to SQZ_READY_IFO for some reason

20:15 UTC lockloss.
 
Relocking Notes: I had to Touch up X-ARM ALS Flashes.

Doors to Air handlers 1 & 2  were open from 1:35-138 local so if there is som etrending of the Air handlers during that time the plots may look diiffent than expected during those time.

Took ISC_LOCK to Initial Alignment 20:46 UTC
Started the Next Locking attempt 21:07
21:55 UTC Nominal Low Noise was reached.

Saved some SDF Changes to H1:ASC-ADS_PIT3_DEMOD_I_TRAMP  for PIT 3-5 and Yaw 3-5 after speaking to Naoki about some changes.

Current IFO Status: Nominal Low Noise And Observing for 1 Hour.

TITLE: 06/09 Eve Shift: 23:00-07:00 UTC (16:00-00:00 PST), all times posted in UTC
STATE of H1: Observing at 137Mpc
CURRENT ENVIRONMENT:
    SEI_ENV state: CALM
    Wind: 5mph Gusts, 2mph 5min avg
    Primary useism: 0.05 μm/s
    Secondary useism: 0.09 μm/s
QUICK SUMMARY:

- IFO locked and in observing for ~1 hr

- CDS/DMs ok

- Seismic motion a bit elevated from recent EQ, will monitor

TITLE: 06/06 Owl Shift: 07:00-15:00 UTC (00:00-08:00 PST), all times posted in UTC
STATE of H1: Observing at 133Mpc
SHIFT SUMMARY: About to start maintenance day.
LOG:

H1 glitches nuc27 FOM isn't updating for Omicrom. I posted this in the LHO DetChar chat.ligo group.

I've had to restart the DARM FOM on nuc30 3 times and Ryan noted he did ~4 times during the evening. Tagging CDS.

I expected PEM magnetic injections to start at 7:25am, it was 14:30UTC to 14:48UTC. SUS_CHARGE started at 14:45UTC with lines at 11-14Hz when PEM_MAG_INJ was stilll at EY_EBAY_HIGH_INJ. So they overlapped by 2-3 minutes.  Tagging PEM and Tagging SUS  In-lock charge measurements caused a lockloss again at 15:00UTC 70062.