09/03 1:28UTC Another Lockloss from NLN just 54 minutes after having reached NLN :(

Lockloss @ 23:48UTC

TITLE: 09/02 Eve Shift: 23:00-07:00 UTC (16:00-00:00 PST), all times posted in UTC
STATE of H1: Observing at 147Mpc
OUTGOING OPERATOR: Tony
CURRENT ENVIRONMENT:
    SEI_ENV state: CALM
    Wind: 5mph Gusts, 4mph 5min avg
    Primary useism: 0.03 μm/s
    Secondary useism: 0.19 μm/s
QUICK SUMMARY:

Taking over from Tony, we've been Locked for just over an hour and are currently Observing. Winds are low.

TITLE: 09/02 Day Shift: 15:00-23:00 UTC (08:00-16:00 PST), all times posted in UTC
STATE of H1: Observing at 143Mpc
INCOMING OPERATOR: Oli
SHIFT SUMMARY:
LOG:

Stand Down request went away.
16:00-Ish UTC  PI 24 was ringing up again, and it had rung its self up 3 times. on the 4th time
I changed H1:SUS-PI_PROC_COMPUTE_MODE24_PLL_PHASE to a value that would work WITHOUT changing the state of the PI Guardian which allowed me to stay in OBSERVING the entire time.

PI Guardian Needs to be reloaded After Naoki's Changes.
Lockloss 20:45 UTC
PI Guardian was reloaded.
Initial Alignment Not run before locking. But this lock did go through Check Mich fringes.
Observing Reached @ 22:09

LOG:                                                                                                          

Lockloss https://ldas-jobs.ligo-wa.caltech.edu/~lockloss/index.cgi?event=1377722766
Ground Motion, wind, and PI's can be ruled out. But otherwise unknown Lockloss.
 

Famis 26481

Check_T240_Centering.py:
ITMX T240 2 DOF X/U = 0.11 [V]
ITMX T240 2 DOF Y/V = 0.197 [V]
ITMX T240 2 DOF Z/W = 0.196 [V]
ITMX T240 3 DOF Y/V = 0.115 [V]
ITMX T240 3 DOF Z/W = 0.137 [V]
ITMY T240 1 DOF X/U = 0.048 [V]
ITMY T240 1 DOF Y/V = 0.011 [V]
ITMY T240 1 DOF Z/W = -0.129 [V]
ITMY T240 2 DOF X/U = 0.082 [V]
ITMY T240 2 DOF Y/V = 0.134 [V]
ITMY T240 2 DOF Z/W = -0.019 [V]
ITMY T240 3 DOF Y/V = 0.009 [V]
BS T240 1 DOF X/U = -0.221 [V]
BS T240 1 DOF Z/W = 0.013 [V]
BS T240 2 DOF X/U = -0.163 [V]
BS T240 2 DOF Y/V = -0.063 [V]
BS T240 2 DOF Z/W = -0.218 [V]
BS T240 3 DOF X/U = -0.272 [V]
HAM8 1 DOF X/U = -0.198 [V]
HAM8 1 DOF Y/V = -0.19 [V]

Assessment complete.


check_sts_centering.py:

STS EY DOF Z/W = 2.596 [V]

All other proof masses are within range ( < 2.0 [V] ):
STS A DOF X/U = -0.572 [V]
STS A DOF Y/V = -0.811 [V]
STS A DOF Z/W = -0.548 [V]
STS B DOF X/U = 0.527 [V]
STS B DOF Y/V = 0.91 [V]
STS B DOF Z/W = -0.591 [V]
STS C DOF X/U = -0.366 [V]
STS C DOF Y/V = 0.826 [V]
STS C DOF Z/W = 0.206 [V]
STS EX DOF X/U = -0.187 [V]
STS EX DOF Y/V = 0.055 [V]
STS EX DOF Z/W = 0.066 [V]
STS EY DOF Y/V = 0.109 [V]
STS FC DOF X/U = 0.378 [V]
STS FC DOF Y/V = -0.786 [V]
STS FC DOF Z/W = 0.744 [V]

Assessment complete.

LockLoss :
https://ldas-jobs.ligo-wa.caltech.edu/~lockloss/index.cgi?event=1377686651

I just happend to see the PI's ring up this morning durning my shift and started to trend them back to see just how high PI 24 can go with out us losing lock. While just goofing off I discovered that just last night, literally the last lockloss, PI 24 had run up from 20 to 2213.5 and caused a lockloss in under 12 minutes. screenshot included. The cursor T1 cursor is set at the point were PI 24 reaches 20. T2 cursor is set to GPS Time 1377686651 which is the Lockloss timestamp. 

Sat Sep 02 10:07:32 2023 INFO: Fill completed in 7min 28secs

TITLE: 09/02 Day Shift: 15:00-23:00 UTC (08:00-16:00 PST), all times posted in UTC
STATE of H1: Observing at 148Mpc
OUTGOING OPERATOR: Austin
CURRENT ENVIRONMENT:
    SEI_ENV state: CALM
    Wind: 4mph Gusts, 3mph 5min avg
    Primary useism: 0.02 μm/s
    Secondary useism: 0.22 μm/s
QUICK SUMMARY:
Inheirited an Interferometer that has been locked and Observing for 3 hours.
GRB-Short E434553 Candidate had a Stand Down Request active when I walked in.

TITLE: 09/02 Eve Shift: 23:00-07:00 UTC (16:00-00:00 PST), all times posted in UTC
STATE of H1: Observing at 143Mpc
INCOMING OPERATOR: Austin
SHIFT SUMMARY: We are still Observing and have now been Locked for 10 hours. A few minutes ago we got a GRB-Short alert and a Stand Down (Fermi, labeled as NOT_GRB).

The top FOM on nuc26 disconnected from the port for ~30 seconds saying that nothing was connected, before turning back on by itself. Later on in the evening the top FOM of nuc5 also lost contact with its computer for a few seconds before coming back on its own.

23:00UTC In Observing and detector has been Locked for 2hrs 4mins

06:55 GRB-Short on Verbals and Stand Down on lock clock

LOG:

no log

Closes FAMIS#26248, last checked 72443

Corner Station Fans (attachment1)

All fans are looking good with no concerns, with MR_FAN5_2 being very variable in noise level (as it usually is), and MR_FAN5_1 being the loudest at just below 0.4.

Outbuilding Fans (attachment2)

All fans are looking good and are well below any noise level that would be of concern to us.

Notes:

- Monday night, 08/29 at 6:13UTC, EX_Fan1 turned off for a minute before a power glitch(coincidence??) turned it back on (attachment3).

- 09/01 16:39UTC, something similar happened with EY_FAN2 (attachment4), although this one is probably related to the work that Randy and Tyler were doing at EY around that time(72628)

We are still in Observing and have now been Locked for almost 7 hours.

J. Kissel, C. Compton

For historical documentation purposes, I was poking around TCS trends today looking for changes.

Camilla keeps excellent record of changes for all TCS settings, see LHO:70078 then LHO:70616 for all requested changes from April 2023's ER15 through May 2023's O4 start through June 2023's power down from 75W to 60W.

From these aLOGs, we know we want both TCS C02 lasers to deposit 1.7 W of annular power on the input test masses.

In confirming this, I was trending the TCS C02 Lasers and found that TCSX's laser power delivered to 
 - ITMX and ITMY took a 0.02 W step down on 2023-07-12 after 18:00 UTC failures of the site-wise laser interlock system (LHO:71276), 
 - ITMY was restored to 1.68 W after table incursion for HWS SLED replacement on 2023-07-18 (LHO:71476)
 - ITMX was also restored to 1.67 W after 2023-07-28 HWS SLED replacement on 2023-07-18 (LHO:71476) 
 - BUT ITMX C02 power delivered has trended slowly downward since 2023-07-18 from 1.67 to 1.57, a decrease of 0.1 W, to today, 2023-09-01.
     - There is a slight increase of ITMX power on 2023-08-13 09:18 UTC (02:18 PDT -- in the middle of the night on Sunday Morning), but
     - The loss of laser power resumes post CO2 laser chiller swap a few days later during maintenance day 2023-08-16 01:04 UTC (2023-08-15 18:04 PDT) (LHO:72220).

I attach a trend of the delivered power, as well as laser head power over the course of the run thus far.
The ITMX C02 laser head power is also trending downward, in slow discrete steps from 48.5 W to 44 W, a decrease of 3.5 W from 2023-07-18 to 2023-09-01.

I don't think the IFO cares about the loss of 0.1 W differential decay in delivered CO2 laser power, but the trend is perhaps concerning, and ITMX is decaying faster than ITMY.

TITLE: 09/01 Eve Shift: 23:00-07:00 UTC (16:00-00:00 PST), all times posted in UTC
STATE of H1: Observing at 142Mpc
OUTGOING OPERATOR: Tony
CURRENT ENVIRONMENT:
    SEI_ENV state: CALM
    Wind: 19mph Gusts, 12mph 5min avg
    Primary useism: 0.03 μm/s
    Secondary useism: 0.17 μm/s
QUICK SUMMARY: Detector has been Locked for 2hrs 20mins. Winds picking up a bit, but don't look too bad. Taking over for Tony.

TITLE: 09/01 Day Shift: 15:00-23:00 UTC (08:00-16:00 PST), all times posted in UTC
STATE of H1: Observing at 146Mpc
OUTGOING OPERATOR: Tony
INCOMING OPERATOR: Oli
CURRENT ENVIRONMENT:
    SEI_ENV state: CALM
    Wind: 16mph Gusts, 10mph 5min avg
    Primary useism: 0.04 μm/s
    Secondary useism: 0.18 μm/s 
QUICK SUMMARY:

15:56 UTC Dropped out of Observing because of a PI Ringing up.
Camilla manually interveined, see alog https://alog.ligo-wa.caltech.edu/aLOG/index.php?callRep=72619
back to Observing at 15:59 UTC

Lockloss:1377628699

Relocking started 18:38 UTC
Lockloss at 19:15 UTC while ISC_LOCK @ DHARD_WFS Likely due to poor alignment, justified by Guardian going through check MICH_FRINGES and AQUIRE_PRMI

took ISC_LOCK to Initial Alignment, which then got stuck in MITCH_BRIGHT. Changed BS Pitch to get better peaks and valleys

Locking started at 20:11 UTC
NOMINAL_LOW_NOISE reached @ 20:54UTC
incoming 6.1M earthquake from Russia 21:11 UTC

SFD Diffs accepted https://alog.ligo-wa.caltech.edu/aLOG/index.php?callRep=72626
Observing reached at  21:13 UTC                                                                                                                                                                                                                                                                                                                                                                                          

(Janos C., Gerardo M.)

Old ion pump body was removed and replaced with a refurbished model type (Galaxy).  The annulus system was pumped down while the replacement took place.
After the 4-1/2" flange was torqued, the ion pump volume was added to the rest of the annulus system.  The aux cart pumping down the annulus system worked for 3 hours to get the pressure down, after pressure reached 4.5x10^-05 Torr, the ion pump took over the pumping with no problem, then after 20 minutes the aux cart and "can" turbo were removed.  System back to normal.