TITLE: 09/04 Eve Shift: 23:00-07:00 UTC (16:00-00:00 PST), all times posted in UTC
STATE of H1: Observing at 149Mpc
INCOMING OPERATOR: Austin
SHIFT SUMMARY: Besides the one time that TCSX unlocking pushed us out of Observing(72653), we were Observing the entire time and have now been Locked for 20hrs 25mins, and it was a very quiet shift. The winds were sometimes getting up to over 30mph over the course of my shift, but have now lowered to just over 20mph.
23:00UTC Detector Observing and has been Locked for 12hrs 35mins
05:10 Superevent G435041
LOG:
no log
Between 09/04 00:48 and 00:50UTC the TCSX CO2 laser lost lock and pushed us out of Observing(attachment1). There were two SDF diffs for TCS-ITMX_CO2_CHILLER_SERVO_GAIN and TCS-ITMX_CO2_PZT_SERVO_GAIN(attachment2), both of which resolved themselves as the laser locked back up. Currently these unlocks are happening every ~2.8ish days. Jeff and Camilla noted(72627) that the ITMX TCS laser head power has been declining over the course of the past 1.5 months, and the drops in the power output line up with every time that the TCSX laser loses lock(attachment3).
08/15 22:00UTC - TCSX Chiller Swap to spare -> ..sn813 (72220)
08/16 08:30UTC TCSX unlock
08/18 13:30UTC ''
08/23 08:42UTC ''
08/26 09:46UTC ''
08/29 08:27UTC ''
09/01 01:44UTC ''
09/04 00:48UTC ''
TJ and I noticed that since the 72220 chiller swap, the CO2 laser temperature is 0.3degC hotter, see attached. The guardian increased the set point to relock the laser when the chiller swapped but maybe this is not a good temperature. On next IFO unlock we can try adjusting the CHILLER_SET_POINT lower. I did this with the old chiller in alog 71685 but it didn't help.
While the IFO was relocking, at 22:13UTC I reduced H1:TCS-ITMX_CO2_CHILLER_SET_POINT_OFFSET 0.3deg from 21.16 to 20.86 degC. This changed the laser tempurature 0.03degC.
TITLE: 09/03 Day Shift: 15:00-23:00 UTC (08:00-16:00 PST), all times posted in UTC
STATE of H1: Observing at 147Mpc
INCOMING OPERATOR: Oli
SHIFT SUMMARY:
PSL Dust mon 101 alarming again 16:03 UTC
17:23 UTC GRB-Short alert Candidate E434878 Stand Down : https://gracedb.ligo.org/events/E434878/view/
21:49 UTC Incoming 5.5M Earthquake from Miconesia
Seismic back to calm @ 22:30 UTC
It's been Fairly Windy but we have survived that all day.
LOG:
Start Time | System | Name | Location | Lazer_Haz | Task | Time End |
---|---|---|---|---|---|---|
17:10 | FAC | Tyler | Mech Room | N | Condesation Draining from the Airhandlerss. | 17:51 |
TITLE: 09/03 Eve Shift: 23:00-07:00 UTC (16:00-00:00 PST), all times posted in UTC
STATE of H1: Observing at 148Mpc
OUTGOING OPERATOR: Tony
CURRENT ENVIRONMENT:
SEI_ENV state: CALM
Wind: 19mph Gusts, 15mph 5min avg
Primary useism: 0.04 μm/s
Secondary useism: 0.19 μm/s
QUICK SUMMARY:
Detector in Observing and has been Locked for 12hrs 35mins.
Sun Sep 03 10:07:14 2023 INFO: Fill completed in 7min 10secs
TITLE: 09/03 Day Shift: 15:00-23:00 UTC (08:00-16:00 PST), all times posted in UTC
STATE of H1: Observing at 145Mpc
OUTGOING OPERATOR: Austin
CURRENT ENVIRONMENT:
SEI_ENV state: CALM
Wind: 20mph Gusts, 17mph 5min avg
Primary useism: 0.03 μm/s
Secondary useism: 0.22 μm/s
QUICK SUMMARY:
Wind Is elevated
PSL Dust mon 101 alarming when I walked in.
Inherited and Interferometer that has been locked for 4.5 hours.
TITLE: 09/03 Eve Shift: 23:00-07:00 UTC (16:00-00:00 PST), all times posted in UTC
STATE of H1: Observing at 145Mpc
INCOMING OPERATOR: Austin
SHIFT SUMMARY: We have now been Locked for 4hrs 50mins. There were two locklosses from NLN during my shift, but both times locking back up was fast and hands-off. I could not find a cause for either of them.
The code changes made earlier today(72636) for mode24 seem to be working well, and there was only one time (that I saw at least) where the phase was cycled through fully, and mode24 didn't get above ~15.
Just before posting this, I heard the building creak and the wind speed at all buildings jumped up really high!
23:00UTC Detector in Observing and Locked for 1 hour
23:48 Lockloss from NLN (72644)
23:50 Lockloss from LOCKING_ALS
00:17 GRB-Short alert E434681 - Fermi, NOT_GRB
00:34 Reached NOMINAL_LOW_NOISE
00:47 Into Observing
01:28 Lockloss (72646)
02:18 NOMINAL_LOW_NOISE
02:30 Observing
04:30 Optics lab dustmon jumped up from 0 to 4300 counts for 10mins, and then back down to 0. Lines up with a temporary increase in wind at the corner station.
LOG:
no log
09/03 1:28UTC Another Lockloss from NLN just 54 minutes after having reached NLN :(
02:30UTC Observing again!
00:47UTC Back to Observing
TITLE: 09/02 Eve Shift: 23:00-07:00 UTC (16:00-00:00 PST), all times posted in UTC
STATE of H1: Observing at 147Mpc
OUTGOING OPERATOR: Tony
CURRENT ENVIRONMENT:
SEI_ENV state: CALM
Wind: 5mph Gusts, 4mph 5min avg
Primary useism: 0.03 μm/s
Secondary useism: 0.19 μm/s
QUICK SUMMARY:
Taking over from Tony, we've been Locked for just over an hour and are currently Observing. Winds are low.
TITLE: 09/02 Day Shift: 15:00-23:00 UTC (08:00-16:00 PST), all times posted in UTC
STATE of H1: Observing at 143Mpc
INCOMING OPERATOR: Oli
SHIFT SUMMARY:
LOG:
Stand Down request went away.
16:00-Ish UTC PI 24 was ringing up again, and it had rung its self up 3 times. on the 4th time
I changed H1:SUS-PI_PROC_COMPUTE_MODE24_PLL_PHASE to a value that would work WITHOUT changing the state of the PI Guardian which allowed me to stay in OBSERVING the entire time.
PI Guardian Needs to be reloaded After Naoki's Changes.
Lockloss 20:45 UTC
PI Guardian was reloaded.
Initial Alignment Not run before locking. But this lock did go through Check Mich fringes.
Observing Reached @ 22:09
LOG:
Start Time | System | Name | Location | Lazer_Haz | Task | Time End |
---|---|---|---|---|---|---|
18:42 | FAC | Tyler | Mech Rm | N | Draining the Air Handler Condensation | 19:12 |
Lockloss https://ldas-jobs.ligo-wa.caltech.edu/~lockloss/index.cgi?event=1377722766
Ground Motion, wind, and PI's can be ruled out. But otherwise unknown Lockloss.
Famis 26481
Check_T240_Centering.py:
ITMX T240 2 DOF X/U = 0.11 [V]
ITMX T240 2 DOF Y/V = 0.197 [V]
ITMX T240 2 DOF Z/W = 0.196 [V]
ITMX T240 3 DOF Y/V = 0.115 [V]
ITMX T240 3 DOF Z/W = 0.137 [V]
ITMY T240 1 DOF X/U = 0.048 [V]
ITMY T240 1 DOF Y/V = 0.011 [V]
ITMY T240 1 DOF Z/W = -0.129 [V]
ITMY T240 2 DOF X/U = 0.082 [V]
ITMY T240 2 DOF Y/V = 0.134 [V]
ITMY T240 2 DOF Z/W = -0.019 [V]
ITMY T240 3 DOF Y/V = 0.009 [V]
BS T240 1 DOF X/U = -0.221 [V]
BS T240 1 DOF Z/W = 0.013 [V]
BS T240 2 DOF X/U = -0.163 [V]
BS T240 2 DOF Y/V = -0.063 [V]
BS T240 2 DOF Z/W = -0.218 [V]
BS T240 3 DOF X/U = -0.272 [V]
HAM8 1 DOF X/U = -0.198 [V]
HAM8 1 DOF Y/V = -0.19 [V]
Assessment complete.
check_sts_centering.py:
STS EY DOF Z/W = 2.596 [V]
All other proof masses are within range ( < 2.0 [V] ):
STS A DOF X/U = -0.572 [V]
STS A DOF Y/V = -0.811 [V]
STS A DOF Z/W = -0.548 [V]
STS B DOF X/U = 0.527 [V]
STS B DOF Y/V = 0.91 [V]
STS B DOF Z/W = -0.591 [V]
STS C DOF X/U = -0.366 [V]
STS C DOF Y/V = 0.826 [V]
STS C DOF Z/W = 0.206 [V]
STS EX DOF X/U = -0.187 [V]
STS EX DOF Y/V = 0.055 [V]
STS EX DOF Z/W = 0.066 [V]
STS EY DOF Y/V = 0.109 [V]
STS FC DOF X/U = 0.378 [V]
STS FC DOF Y/V = -0.786 [V]
STS FC DOF Z/W = 0.744 [V]
Assessment complete.
LockLoss :
https://ldas-jobs.ligo-wa.caltech.edu/~lockloss/index.cgi?event=1377686651
I just happend to see the PI's ring up this morning durning my shift and started to trend them back to see just how high PI 24 can go with out us losing lock. While just goofing off I discovered that just last night, literally the last lockloss, PI 24 had run up from 20 to 2213.5 and caused a lockloss in under 12 minutes. screenshot included. The cursor T1 cursor is set at the point were PI 24 reaches 20. T2 cursor is set to GPS Time 1377686651 which is the Lockloss timestamp.
PI FOM plots over the time LockLoss time. Top plot is log scaled.
We think that the PI guardian did not have enough time to evaluate the correct damping phase for mode 24 (10.431 kHz PI) so we updated the PI guardian as we did in alog69800. We increased the phase step from 30 to 60 deg, the average time to calculate the new rms from 1 to 5s, and the timer for each step from 5 to 10s. The PI guardian is not reloaded yet and we asked the operator to reload it when lockloss happens.
Sat Sep 02 10:07:32 2023 INFO: Fill completed in 7min 28secs
TITLE: 09/02 Day Shift: 15:00-23:00 UTC (08:00-16:00 PST), all times posted in UTC
STATE of H1: Observing at 148Mpc
OUTGOING OPERATOR: Austin
CURRENT ENVIRONMENT:
SEI_ENV state: CALM
Wind: 4mph Gusts, 3mph 5min avg
Primary useism: 0.02 μm/s
Secondary useism: 0.22 μm/s
QUICK SUMMARY:
Inheirited an Interferometer that has been locked and Observing for 3 hours.
GRB-Short E434553 Candidate had a Stand Down Request active when I walked in.