Tony had a lockloss that the lockloss tool tagged with a DCPD saturation (our 11 most recent NLN locklosses have been too) 1372544545.
Waited ISC_LOCK waited 20 minutes in OMC_WHITENING for lots of violins to damp. The VOILIN_DAMPING guardian had turned down the gain on EY08 as it was rung up but the damping OUTMON reduced quickly <100 so I increased the gain back to it's nominal for faster damping. Lots of voilins are still rung up and slowly damping, see attached.
SQZ_MANAGER had message "SQZ ASC AS24 not on??" so I took SQZ_MANAGER to NO_SQUEEZING, gracefully cleared the A42 history (sitemap > SQZ > SQZ Overview > IFO ASC > ! graceful clear history) and then SQZ_MANAGER to FREQ_DEP_SQZ. This has happened a couple of times recently 70890 but Vicky and Naoki plan to look into this or automate this week. Tagging SQZ.
It seems the OMC_DCPD tag has only been on the last locklosses since the violins have been rung up (2023/06/29 70945, 70943), see attached. The OMC overflows H1:FEC-8_ADC_OVERFLOW_0_{12,13} haven't dropped back down to zero and the lockloss tool just looks for these channels being non-zero before the lockloss.
This 22:22UTC lockloss has an unknown-for-now cause. Nothing in ASC, LSC, no violin saturations or PIs, not the IMC.
TITLE: 07/04 Eve Shift: 23:00-07:00 UTC (16:00-00:00 PST), all times posted in UTC
STATE of H1: Lock Acquisition
CURRENT ENVIRONMENT:
SEI_ENV state: CALM
Wind: 6mph Gusts, 4mph 5min avg
Primary useism: 0.04 μm/s
Secondary useism: 0.08 μm/s
QUICK SUMMARY: Tony has relocked us so far up to POWER_25W, so far with no issues but violins are still high so we expect to wait at OMC_WHITENING later.
VAC, SUS, SEI, CDS, Dust monitors okay.
TITLE: 07/04 Day Shift: 15:00-23:00 UTC (08:00-16:00 PST), all times posted in UTC
STATE of H1: Lock Acquisition
CURRENT ENVIRONMENT:
SEI_ENV state: CALM
Wind: 13mph Gusts, 9mph 5min avg
Primary useism: 0.02 μm/s
Secondary useism: 0.08 μm/s
QUICK SUMMARY:
16:00 Acknowledge Test T415139 SNEWS.
17:31 H1:CAL-INJ_MASTER_SW was changed somehow, and took us into commissioning. A moment later it was undone and I took H1 back to observing.
17:54 Lockloss
https://ldas-jobs.ligo-wa.caltech.edu/~lockloss/index.cgi?event=1372528500
Relocking without Initial Alignment.
18:45 OMC WHITENING
20:23 NOMINAL_LOW_NOISE & Observing
22:22 Lockloss
https://ldas-jobs.ligo-wa.caltech.edu/~lockloss/index.cgi?event=1372544545
Current IFO Status: Relocking.
17:54 Lockloss
https://ldas-jobs.ligo-wa.caltech.edu/~lockloss/index.cgi?event=1372528500
Lockloss tool isn't working. No Obvious cause determined yet.
Tue Jul 04 10:04:06 2023 INFO: Fill completed in 4min 6secs
Test T415139 SNEWS alarm went off with a request to acknowledge and I am not familar with how to acknowledge the Test.
TITLE: 07/04 Day Shift: 15:00-23:00 UTC (08:00-16:00 PST), all times posted in UTC
STATE of H1: Observing at 145Mpc
CURRENT ENVIRONMENT:
SEI_ENV state: CALM
Wind: 6mph Gusts, 4mph 5min avg
Primary useism: 0.01 μm/s
Secondary useism: 0.10 μm/s
QUICK SUMMARY:
Inherited an IFO that has been Locked for 4 hours and is in Observing.
Violins look pretty decent and are on their way down.
TITLE: 07/04 Owl Shift: 07:00-15:00 UTC (00:00-08:00 PST), all times posted in UTC
STATE of H1: Observing at 146Mpc
SHIFT SUMMARY:
Lock #1:
Lock #2:
Handing off to Tony for the day.
LOG:
No log for this shift.
Since there won't be a maintenance window due to the holiday today, I've disabled the automatic start for both the magnetic injections and in-lock charge measurements so we can continue observing. I did this by taking both the PEM_MAG_INJ and SUS_CHARGE guardian nodes to DOWN.
Both sets of injections/measurements are set to run automatically again at their appropriate times on Tuesday mornings. I did this by requesting INJECTIONS_COMPLETE in both guardian nodes (they correctly stopped in WAITING).
State of H1: Observing at 145Mpc
Relocking was straightforward following the earlier lockloss save for waiting 90 minutes in OMC_WHITENING for violins to damp (seems to be the norm these days). Now back observing for the past 15 minutes.
FAMIS 19983
Lockloss @ 08:11 UTC - no obvious cause that I can determine. Lockloss tool analysis failed for this lockloss.
TITLE: 07/04 Owl Shift: 07:00-15:00 UTC (00:00-08:00 PST), all times posted in UTC
STATE of H1: Observing at 143Mpc
CURRENT ENVIRONMENT:
SEI_ENV state: CALM
Wind: 7mph Gusts, 5mph 5min avg
Primary useism: 0.01 μm/s
Secondary useism: 0.10 μm/s
QUICK SUMMARY: Taking over from Ryan C. H1 has just been relocked and has been Observing for the past 20 minutes at 143 Mpc.
TITLE: 07/04 Eve Shift: 23:00-07:00 UTC (16:00-00:00 PST), all times posted in UTC
STATE of H1: Observing at 145Mpc
SHIFT SUMMARY:
Lock#1:
Superevent at 02:12
EX saturation at 03:58
Lockloss at 04:02UTC
Lock#2:
Same ISC_LOCK code error as as happened in my past two locks, this time it happened twice in a row
After over an hour of damping violins in OMC_WHITENING, I recovered Observing at 06:37UTC
LOG:
No log for this shift
No obvious cause for the lockloss
The fire appears to be out, I can't see anymore smoke. We've been locked for 2:47, in Observing since 00:20 UTC. Everything seems stable.
TITLE: 07/03 Day Shift: 15:00-23:00 UTC (08:00-16:00 PST), all times posted in UTC
STATE of H1: Observing at 145Mpc
SHIFT SUMMARY:
Shift for the most part was nice & quiet but then fires (photo attached) & earthquakes! (but H1's on its way back).
Mentioned to Ryan that if there is any catastrophic/unsafe incidents (i.e. fire) which are a cause for concern/safety---he should think of his safety first and leave when comfortable. Also mentioned it's probably to keep H1 in a DOWN state. Then notify Mike/Richard/Keita (in place of Jenne this weekend). And give a status update on the alog. (hope this all sounds right!) Also: we have binoculars in the Control Room---in the back corner on top of file cabinet near the white board.)
LOG:
The smoke clouds have vastly reduced, it seems like they've almost gotten it out.
TITLE: 07/03 Eve Shift: 23:00-07:00 UTC (16:00-00:00 PST), all times posted in UTC
STATE of H1: Earthquake
CURRENT ENVIRONMENT:
SEI_ENV state: CALM
Wind: 16mph Gusts, 12mph 5min avg
Primary useism: 0.05 μm/s
Secondary useism: 0.10 μm/s
QUICK SUMMARY:
H1 back into Observing at 00:20 UTC