OPS Eve Shift Summary

TITLE: 11/11 Eve Shift: 0030-0600 UTC (1630-2200 PST), all times posted in UTC
STATE of H1: Aligning
INCOMING OPERATOR: Ryan C
SHIFT SUMMARY:

IFO is LOCKING at CHECK_AS_SHUTTERS

Overall a smooth shift where we were locked for two thirds of the shift until the PSL glitch most likely took us down. Since then, the glitch has been happening without much gap for relocking. We've had gaps of 20 or so mins without glitching but that's been the maximum so far since LL. Lockloss alog 81181.

Other than that, we dropped out of OBSERVING very briefly due to a TCSY CO2 Laser SDF diff that fixed itself.

LOG:

None

H1 ISI CPS Sensor Noise Spectra Check - Weekly FAMIS 26016

Closes FAMIS 26016. Last checked in alog 80912. 

Changes from last check:

• HAM8 CPS slightly noisier
• IY ST1 CPSINF2 channel noisy
• BS ST2 CPSINF H1 has a new bump 1-3Hz
• EY ST1 less noisy

Lockloss 03:42 UTC

Lockloss seemingly PSL caused judging from IMC and ASC-A signals losing lock within 10ms (attached). About a 700ms after the glitching started, we lost lock. Interestingly, IMC is not glitching for minutes post-LL as it usually does, with IMC locking and staying locked in the new acquisition.

Sunday Ops Day Shift End

TITLE: 11/11 Day Shift: 1530-0030 UTC (0730-1630 PST), all times posted in UTC
STATE of H1: Observing at 157Mpc
INCOMING OPERATOR: Ibrahim
SHIFT SUMMARY:
The morning was a little shakey, but we persevered through the problematic IMC glitches to get to a lock by 22:35 UTC

LOG:                                                                                                                                                                                                                                                                                               

Start Time	System	Name	Location	Lazer_Haz	Task	Time End
21:41	SAF	Laser	LVEA	YES	LVEA is laser HAZARD	08:21
18:30	PEM	Robert	LVEA	Yes	Getting more spools of cable	18:39
18:48	PEM	Robert	CER	No	Checking cables	20:10
21:29	BBSS	Ibrahim	Staging Building	N	BBSS inventory	00:29

OPS Eve Shift Start

TITLE: 11/11 Eve Shift: 0030-0600 UTC (1630-2200 PST), all times posted in UTC
STATE of H1: Observing at 157Mpc
OUTGOING OPERATOR: Tony
CURRENT ENVIRONMENT:
    SEI_ENV state: CALM
    Wind: 7mph Gusts, 4mph 3min avg
    Primary useism: 0.03 μm/s
    Secondary useism: 0.37 μm/s
QUICK SUMMARY:

IFO is in NLN and OBSERVING as of 22:35 UTC

Recovered from a massive 6.8 EQ. Nothing else of note.

Mid day report

TITLE: 11/10 Day Shift: 1530-0030 UTC (0730-1630 PST), all times posted in UTC
STATE of H1: Earthquake
CURRENT ENVIRONMENT:
    SEI_ENV state: CALM
    Wind: 8mph Gusts, 4mph 3min avg
    Primary useism: 0.03 μm/s
    Secondary useism: 0.40 μm/s
QUICK SUMMARY:

After the 6.8M Earthquake passed I started relocking
Unfortunately:
IMC PSL-FSS _FAST MON Issues present while trying to relock.

Currently Relocking , ISC_LOCK @ Power_25W
 

weekly Checking HVAC Fan Vibrometers

Famis 26336

6 days ago there was an increase in H0:VAC-EX_FAN1_570_2_ACC_INCHSEC
Both H0:VAC-MR_FAN1_170_1 & 2 ACC_INCHSEC saw an increase in noise in the last 3 days.
 

Sun CP1 Fill

Sun Nov 10 10:11:37 2024 INFO: Fill completed in 11min 33secs

 

H1 Holding in idle for 6.8M Earthquake from Cuba

https://earthquake.usgs.gov/earthquakes/eventpage/us7000nr0v/

ISI Watchdog trips:
BS: Stage 1 & 2
ITMX 1 & 2
ITMY 1 & 2
ETMX 1 & 2
ETMY 1 & 2
HAM 8
HAM 7

Sunday Ops Morning shift Start

TITLE: 11/10 Day Shift: 1530-0030 UTC (0730-1630 PST), all times posted in UTC
STATE of H1: Observing at 158Mpc
OUTGOING OPERATOR: Ryan C
CURRENT ENVIRONMENT:
    SEI_ENV state: CALM
    Wind: 4mph Gusts, 2mph 3min avg
    Primary useism: 0.03 μm/s
    Secondary useism: 0.33 μm/s
QUICK SUMMARY:

H1 was still locked when I walked into the control room, due to Ryan C waking up with the IFO.
Incoming 5.9M EQ from Cuba:  https://earthquake.usgs.gov/earthquakes/eventpage/us7000nr0n/

Lockloss 2024-11-10 16:08:52 https://ldas-jobs.ligo-wa.caltech.edu/~lockloss/index.cgi?event=1415290150
Earthquake lockloss. Screenshots: Log , ASC , SUS , PSL & IMC  , LSC , SEI

OWL Locklosses: 
2024-11-10 10:18:11  https://ldas-jobs.ligo-wa.caltech.edu/~lockloss/index.cgi?event=1415269109
This Lockloss was tagged as an ETM Glitch. Screenshots: Log , ASC , SUS , PSL & IMC  , LSC , SEI

2024-11-10 09:08:40  https://ldas-jobs.ligo-wa.caltech.edu/~lockloss/index.cgi?event=1415264939
This Lockloss was tagged as IMC, screenshots: Log , ASC , SUS , PSL & IMC  , LSC , SEI

 

H1 OPS OWL assistance

H1 called for help after the NLN timer expiring at 08:15 UTC, we were at MOVE_SPOTS. We reached NLN at 08:28 UTC, in observing at 08:31 UTC.

OPS Eve Shift Summary

TITLE: 11/10 Eve Shift: 0030-0600 UTC (1630-2200 PST), all times posted in UTC
STATE of H1: Lock Acquisition
INCOMING OPERATOR: Ryan C
SHIFT SUMMARY:

IFO is LOCKING in LOCKING_ARMS_GREEN

Shift has been very smooth with a behaving IFO. I was locked the entire time up until now, where an IMC glitch took us down most likely (alog 81170)

Also took a thermalized IFO calibration sweep with the temp/new ini file. Alog 81169.

LOG:

None

 

Lockloss 03:19 UTC

Lockloss seemingly PSL/FSS related. Glitching in FSS started around 1s Lockloss. It's still glitching right now.

Friday Ops Day shift End

TITLE: 11/10 Day Shift: 1530-0030 UTC (0730-1630 PST), all times posted in UTC
STATE of H1: Calibration
INCOMING OPERATOR: Ibrahim
SHIFT SUMMARY:
The morning was plagued with IMC Fault issues alog . 

After simply holding ISC_LOCK in  DOWN and holding IMC in LOCKED [ Specifically  to Not be in "ISS_ON " ] to wait for the IMC to be calm before starting to relock. Then wait again for a 5.8M EQ from Panama, I was able to get a lock all the way to Observing.

I was able to pass a locked IFO to Ibrahim.


LOG:                                                                                                                                                                                                                                                                                               

Start Time	System	Name	Location	Lazer_Haz	Task	Time End
21:41	SAF	Laser	LVEA	YES	LVEA is laser HAZARD	08:21
15:58	PEM	Robert	CS Mech room  -> Chiller Yard	N	Cable crossing road to End X from Mech room to Chiller yard	23:58
17:27	PEM	Robert	LVEA	Yes	Setting up chiller pad & turning off the lights.	22:06
20:30	Tours	Mike, Fred & co	Control Room	N	Saturday tours	23:58

 

Calibration Sweep 11/09

Calibration Sweep done with new ini file Louis asked us to use for Simulines: /ligo/groups/cal/H1/simulines_settings/newDARM_20231221/settings_h1_20241005_lowerPcal_higherPUM.ini

Broadband Start Time: 1415232600

Broadband End Time: 1415204090

Simulines Start Time: 1415233192

Simulines End Time: 1415234617

Files Saved:

2024-11-10 00:42:42,493 | INFO | Commencing data processing.
2024-11-10 00:42:42,493 | INFO | Ending lockloss monitor. This is either due to having completed the measurement, and this functionality being terminated; or because the whole process was aborted.
2024-11-10 00:43:19,012 | INFO | File written out to: /ligo/groups/cal/H1/measurements/DARMOLG_SS/DARMOLG_SS_20241110T001937Z.hdf5
2024-11-10 00:43:19,020 | INFO | File written out to: /ligo/groups/cal/H1/measurements/PCALY2DARM_SS/PCALY2DARM_SS_20241110T001937Z.hdf5
2024-11-10 00:43:19,025 | INFO | File written out to: /ligo/groups/cal/H1/measurements/SUSETMX_L1_SS/SUSETMX_L1_SS_20241110T001937Z.hdf5
2024-11-10 00:43:19,030 | INFO | File written out to: /ligo/groups/cal/H1/measurements/SUSETMX_L2_SS/SUSETMX_L2_SS_20241110T001937Z.hdf5
2024-11-10 00:43:19,034 | INFO | File written out to: /ligo/groups/cal/H1/measurements/SUSETMX_L3_SS/SUSETMX_L3_SS_20241110T001937Z.hdf5
ICE default IO error handler doing an exit(), pid = 3252963, errno = 32

OPS Day Shift Start

TITLE: 11/10 Eve Shift: 0030-0600 UTC (1630-2200 PST), all times posted in UTC
STATE of H1: Observing at 122Mpc
OUTGOING OPERATOR: Tony
CURRENT ENVIRONMENT:
    SEI_ENV state: CALM
    Wind: 2mph Gusts, 0mph 3min avg
    Primary useism: 0.03 μm/s
    Secondary useism: 0.43 μm/s
QUICK SUMMARY:

IFO is in NLN and OBSERVING as of 21:24 UTC

Since we are thermalized, I am about to go into CALIBRATION for our calibration sweep of the day.

Mid Shift report.

TITLE: 11/09 Day Shift: 1530-0030 UTC (0730-1630 PST), all times posted in UTC
STATE of H1: Observing at 152Mpc
CURRENT ENVIRONMENT:
    SEI_ENV state: CALM
    Wind: 5mph Gusts, 2mph 3min avg
    Primary useism: 0.04 μm/s
    Secondary useism: 0.44 μm/s
QUICK SUMMARY:

I set ISC_LOCK into Idle while waiting for the 5.8M Earthquake to stop shaking us for a few minutes.

I've been tryign to get this IFO to lock since I walked in this morning.
The IMC is unlocking and going into Fault at random times in the Locking process and In the Initial Alignment process.
15:47UTC
15:56:31 UTC
And multiple other times, including when I had taken ISC_LOCK to IDLE.
I called Elenna to try an confirm where this glitch was coming from and was the reason that I was losing all my locks.



Observing reached at 21:24 UTC
 

Mid Y Chiller Supply Water Temperature Increase

Note to FMCS, MY chilled supply water temp increase which started around 9am Fri 08nov2024 PST.

Saturday Ops Day Shift Start

TITLE: 11/09 Day Shift: 1530-0030 UTC (0730-1630 PST), all times posted in UTC
STATE of H1: Lock Acquisition
OUTGOING OPERATOR: Ryan C
CURRENT ENVIRONMENT:
    SEI_ENV state: USEISM
    Wind: 4mph Gusts, 3mph 3min avg
    Primary useism: 0.03 μm/s
    Secondary useism: 0.40 μm/s
QUICK SUMMARY:
Walking in I was greeted with ISC_LOCK in Engage Soft Loops.
Unfortunately we lost lock at Transition_From_ ETMX  and again at DRMI
Starting an Initial_Alignment

Notes on OWL:
IFO called Ryan early in the morning https://alog.ligo-wa.caltech.edu/aLOG/index.php?callRep=81160.
Over the Owl Shift there were a number of locks and locklosses, I'll follow up with a comment to this alog with more information about each lockloss.