Ops Shift Transition: 04/29/2019, Day Shift 15:00 – 23:00 (08:00 -16:00) - UTC (PT)
State of H1: NLN
Intent Bit: Observing
Weather: 10-20 mph wind, sunny
Primary 0.03 – 0.1Hz: 0.1 um/s, rung up from 0.01 um/s by a 6.2 earthquake at Carlsberg Ridge
Secondary 0.1 – 0.3Hz: 0.15 um/s
Outgoing Operator: Travis
Quick Summary: Been locked for 11 hours at ~110 Mpc. There is a very slow oscillation in the ASC signals and we’re riding out an earthquake, but the lock seems stable.
Nothing out of the ordinary. Curious 1W PMC step in trans power. Also, noticing FSS TPD following humidity levels.
TITLE: 04/29 Owl Shift: 07:00-15:00 UTC (00:00-08:00 PST), all times posted in UTC
STATE of H1: Observing at 108Mpc
INCOMING OPERATOR: Niko
SHIFT SUMMARY: H1 in Observing for the entire shift. ASC oscillations continue.
LOG:
14:39 Took SEI Config to Earthquake for incoming 6.2 EQ in Yemen
TITLE: 04/29 Owl Shift: 07:00-15:00 UTC (00:00-08:00 PST), all times posted in UTC
STATE of H1: Observing at 110Mpc
OUTGOING OPERATOR: Patrick
CURRENT ENVIRONMENT:
Wind: 12mph Gusts, 11mph 5min avg
Primary useism: 0.02 μm/s
Secondary useism: 0.12 μm/s
QUICK SUMMARY: H1 has been locked for ~3 hours. There is an oscillation in the ASC signals, but does not appear to be affecting the lock.
TITLE: 04/28 Eve Shift: 23:00-07:00 UTC (16:00-00:00 PST), all times posted in UTC STATE of H1: Observing at 112Mpc INCOMING OPERATOR: Travis SHIFT SUMMARY: Was able to proceed with initial alignment of SRC after Sheila found that the outputs to the lock filter banks for the SRM were off and turned them on. After that was able to lock at NLN and go into observing with no real issue. There now seems to be an oscillation on the ASC yaw signals. It does not seem to be large enough to destabilize the lock and I have not attempted to fix it.
04:14:52 UTC Reverted and accepted SDF differences attached.
Currently on "Align SRC" in initial alignment sequence. No issues with previous steps. The ALIGN_IFO guardian had gotten to SRC_ALIGN and stayed locked there earlier, but ASC-SRC1_Y would not converge. Tried misaligning SRM and centering spot on AS-AS_C photodetector medm with SR2. Tried aligning SRM to make H1:ASC-AS_A_DC_NSUM_OUT16 flashes high. Tried trending back witness sensors. Now it has trouble getting to SRC_ALIGN.
Patrick, Sheila
It looks like this particular problem was that the outputs of th elock filter banks in the SRM were turned off. The suspension guardian turns off these output when the watchdogs trip (or in INIT) and they get turned back on as the guardian moves through the path to "ALIGNED".
Looking through the log, it seems that for some reason the guardian state was stck in RESET for about 20 minutes after the last watchdog trip filling the logs. (As an aside, it would be nice to rewrite that state so it doesn't fill up the log). I'm not sure why it would be stuck in RESET, possibly it was stalled after the trip. This situation is normally resolved by re-requesting "ALIGNED" or "MISALIGNED".
It looks like someone went to INIT, and then set the guardian into MANUAL mode (screen turns pink), and went to MASTERSWITCH on. Apparently this skips steps that would turn on the damping loops, which is why Keita and Niko had to turn those on manually, and also the outputs of the lock filters which is why Patrick ran into difficulties locking SRY.
This is one of the reasons to be careful about using MANUAL mode. It shouldn't be necessary in the normal locking sequence or to recover from a trip,
Sheila, Patrick The SRM M3 stage outputs were off. The SRM M2 stage ASC outputs were off.
TITLE: 04/28 Day Shift 15:00 – 23:00 (08:00 -16:00), all times posted in UTC
STATE of H1: Aligning
INCOMING OPERATOR: Patrick
SHIFT SUMMARY: Started out unable to get through ACQUIRE_PRX in initial alignment. With Keita’s help, I was able to adjust PRM to get H1:ASC-POP_A_NSUM_OUTPUT high enough to get to WFS_CENTERING_PRX. Then after more searching we reverted changes to the SUS HTTS SDF, which allowed us to get through initial alignment. Then misaligning SR2 at the beginning of the lock sequence was causing SUS_SRM to trip because the damping filters were all turned off. We turned those on, and then I was not able to get past FIND_IR because the COMM_OFFSET frequency had changed from -200 to -37,500 and the offset search was too far away to find it. I then lost lock from OFFLOAD_DRMI_ASC several times due to (I’m guessing) SRM being badly misaligned. Leaving it with Patrick, who is starting an initial alignment.
LOG:
15:00 (08:00) Start of shift
19:56 (12:56) Robert to LVEA -- take picture of chamber
20:00 (13:00) Robert back from LVEA
23:00 (16:00) End of shift
TITLE: 04/28 Eve Shift: 23:00-07:00 UTC (16:00-00:00 PST), all times posted in UTC
STATE of H1: Aligning
OUTGOING OPERATOR: Niko
CURRENT ENVIRONMENT:
Wind: 15mph Gusts, 9mph 5min avg
Primary useism: 0.02 μm/s
Secondary useism: 0.14 μm/s
QUICK SUMMARY:
Locking issues persist.
Ops Shift Transition: 04/28/2019, Day Shift 15:00 – 23:00 (08:00 -16:00) - UTC (PT)
State of H1: Initial Alignment
Intent Bit: Commissioning
Weather: 15 mph wind, light cloud cover
Primary 0.03 – 0.1Hz: 0.01 um/s in Z-axis, X and Y still rung up from wind
Secondary 0.1 – 0.3Hz: 0.1 um/s
Outgoing Operator: Jeff
Quick Summary: Been out of lock for ~21 hours, initially due to high wind but now there are issues with ASC signals not converging and not being able to reach PRC_ALIGN in initial alignment. This carries over to normal locking, where PRMI_LOCKED could not be achieved.
Trying to align and lock the IFO. Wind is mostly in the low to mid teens, with gusts 20mph Plus. Although coming down, the microseism is a bit elevated, (Y 0.9um/s, X 0.09um/s, Z 0.09um/s). Trying to run initial alignment. Can align and lock the ALS X & Y green easily, but it will not Offload. MSG: "GREEN_WFS_OFFLOAD.enter" and no further. The ALS_X_WFS_DOF_2 and ALS_Y_WFS_DOF_2, both in both pitch and yaw appear not to be settling down. After waiting 30 plus minutes for the Offload to complete, skipped to Align Input Laser Pointing to Xarm. This step completed without trouble. Could not get past PRX_LOCKED. Tried tuning PRM until I had what looked like a good AS_AIR spot. But still could not get to PRC_ALIGN. Restarted the initial alignment and still cannot get ALS to unload. Am continuing trying to get through initial alignment.
TITLE: 04/27 Eve Shift: 23:00-07:00 UTC (16:00-00:00 PST), all times posted in UTC STATE of H1: Lock Acquisition INCOMING OPERATOR: Jeff SHIFT SUMMARY: Spent entire shift trying to relock. Did not get past ENGAGE_SOFT_LOOPS. - Winds were high in the beginning of the shift. Tried initial alignment with WINDY_NO_BRSY, since the BRSY was damping for a long time. - SUS SRM watchdog tripped 3 times during the shift. - Could not get IR to lock on X arm in initial alignment. Tried twice, the second time after the wind came down. Skipped and continued with rest of initial alignment. - SRM was way off in yaw, according to witness sensors. Had to move it back to get SRC to converge in initial alignment. - Have gotten as far as ENGAGE_SOFT_LOOPS by setting H1:ASC-SRC1_Y_GAIN to 0 in ENGAGE_ASC_FOR_FULL_IFO before it lost lock. - Was able to improve signals by adjusting SRM with ASC SRC gain off in ENGAGE_SOFT_LOOPS, but not enough to keep it from driving off when setting the gain back. - Started adjusting PRM in ENGAGE_SOFT_LOOPS. Looked like I was making progress, but then lost lock.
DRMI has locked, but despite requests for further states, it is not moving on. I do not see any messages in the log or otherwise that seem to indicate why.
I set it to manual. Selected PREP_DRMI_ASC. Set back to auto. Then selected OFFLOAD_DRMI_ASC. Now it is not moving past ENGAGE_DRMI_ASC.
Hit INIT. Trying from scratch.
Now it is working. Wonder if it is because I hit LOAD at some point before going to INIT.
Lock losses from DARM_TO_RF and ENGAGE_ASC_FOR_FULL_IFO.
Another lock loss from ENGAGE_ASC_FOR_FULL_IFO.
Caught it this time by setting H1:ASC-SRC1_Y_GAIN to 0 in ENGAGE_ASC_FOR_FULL_IFO before it lost lock.
Tried bringing gain back to 4 after ENGAGE_SOFT_LOOPS finished, but it would drive the signals away.
Was able to improve traces with SRM, but turning the gain back to 4 still drives them off.
Lost lock adjusting PRM.
The ASC oscillation is due to the SR3 heater change that we made on Friday. This slow ASC yaw oscillation was seen when the SR3 stepping down tests were done a few weeks ago, but at that time they only started seeing it clearly when they took the SR3 heater down to 3.5 W (We're at 4 W now, from 5 W last week and before). I'm not yet totally sure why the SR3 heater being lowered makes this ASC change, but I'll start looking into it. As Niko and other operators have mentioned, the IFO is locked and stable otherwise, so I'll do some passive investigations but nothing active yet.