Because we moved the OPO crystal position yesterday, 8045, the crystal absorption will be changing for a few weeks, and we will need to adjust the temperature setting for the OPO until it settles, as Tony and I did last night. 80455. Here are two sets of instructions, one that can be used while in observing to adjust this, and one that can be done when we loose lock or are out of observing for some other reason.
For these first few days, please follow the out of observing instructions when relocking, if this hasn't been done in the last few hours, and please try to do it in the last few hours of the evening shift so that the temperature is close to well tuned at the start of the owl shift.
Out of observing instructions (to be done while recovering from a lockloss, can be done while ISC_LOCK is locking the IFO) (screenshot) :
In observing instructions:
Both the OPO temperature and the SQZ phase are ignored in SDF and can be adjusted while we are in observing, but it's important to log the times of any adjustments made.
Changes made to make this easier (Thanks Corey for beta testing the instructions):
Update to the In observing instructions:
Both the OPO temperature and the SQZ phase are ignored in SDF, but it's important go out of observing for the change and to log any adjustments made.
Corey has had a series of locklosses from DRMI/PRMI and ALS, I've looked into one of these: 1412094082
In this case it looks like there is a large glitch seen in all DRMI LSC signals (and ASC, but it seems to start in LSC), with a small glitch about 4 seconds before lockloss, which DRMI recovers from. Then there is a larger glitch that happened about 1 second before lockloss, where POP18 drops below the trigger threshold, and the DRMI guardian goes to DOWN, at the same time the ALS Y arm looses green lock, which then unlocks the ALS X arm.
This glitch doesn't seem to be cause by the DRMI ASC, although we were in the process of engaging that ASC when it happened. It also isn't due to the BS ISI isolation coming on, which hadn't happened yet.
Edit: I looked into a second lockloss, from PRMI: 1412095134, this one is different in that it happens very quickly and PRMI and ALS signals drop out at close to the same time. This happened while the DRMI guardian was waiting for the refl WFS centering to converge.
For FAMIS 26303:
Laser Status:
NPRO output power is 1.818W (nominal ~2W)
AMP1 output power is 64.55W (nominal ~70W)
AMP2 output power is 137.7W (nominal 135-140W)
NPRO watchdog is GREEN
AMP1 watchdog is GREEN
AMP2 watchdog is GREEN
PDWD watchdog is GREEN
PMC:
It has been locked 0 days, 22 hr 2 minutes
Reflected power = 22.1W
Transmitted power = 104.0W
PowerSum = 126.1W
FSS:
It has been locked for 0 days 0 hr and 7 min
TPD[V] = 0.8089V
ISS:
The diffracted power is around 2.4%
Last saturation event was 0 days 0 hours and 7 minutes ago
Possible Issues:
AMP1 power is low
PMC reflected power is high
Monthly FAMIS Check (#26494)
T240 Centering Script Output:
Averaging Mass Centering channels for 10 [sec] ...
2024-10-04 09:08:54.264102
There are 14 T240 proof masses out of range ( > 0.3 [V] )!
ETMX T240 2 DOF X/U = -0.745 [V]
ETMX T240 2 DOF Y/V = -0.637 [V]
ETMX T240 2 DOF Z/W = -0.529 [V]
ITMX T240 1 DOF X/U = -1.51 [V]
ITMX T240 1 DOF Y/V = 0.325 [V]
ITMX T240 1 DOF Z/W = 0.447 [V]
ITMX T240 3 DOF X/U = -1.563 [V]
ITMY T240 3 DOF X/U = -0.773 [V]
ITMY T240 3 DOF Z/W = -1.934 [V]
BS T240 1 DOF Y/V = -0.394 [V]
BS T240 3 DOF Y/V = -0.307 [V]
BS T240 3 DOF Z/W = -0.49 [V]
HAM8 1 DOF Y/V = -0.475 [V]
HAM8 1 DOF Z/W = -0.786 [V]
All other proof masses are within range ( < 0.3 [V] ):
ETMX T240 1 DOF X/U = -0.083 [V]
ETMX T240 1 DOF Y/V = -0.1 [V]
ETMX T240 1 DOF Z/W = -0.159 [V]
ETMX T240 3 DOF X/U = -0.106 [V]
ETMX T240 3 DOF Y/V = -0.165 [V]
ETMX T240 3 DOF Z/W = -0.093 [V]
ETMY T240 1 DOF X/U = 0.009 [V]
ETMY T240 1 DOF Y/V = 0.116 [V]
ETMY T240 1 DOF Z/W = 0.173 [V]
ETMY T240 2 DOF X/U = -0.083 [V]
ETMY T240 2 DOF Y/V = 0.171 [V]
ETMY T240 2 DOF Z/W = 0.03 [V]
ETMY T240 3 DOF X/U = 0.182 [V]
ETMY T240 3 DOF Y/V = 0.029 [V]
ETMY T240 3 DOF Z/W = 0.109 [V]
ITMX T240 2 DOF X/U = 0.127 [V]
ITMX T240 2 DOF Y/V = 0.258 [V]
ITMX T240 2 DOF Z/W = 0.22 [V]
ITMX T240 3 DOF Y/V = 0.117 [V]
ITMX T240 3 DOF Z/W = 0.104 [V]
ITMY T240 1 DOF X/U = 0.078 [V]
ITMY T240 1 DOF Y/V = 0.083 [V]
ITMY T240 1 DOF Z/W = -0.061 [V]
ITMY T240 2 DOF X/U = 0.054 [V]
ITMY T240 2 DOF Y/V = 0.185 [V]
ITMY T240 2 DOF Z/W = 0.092 [V]
ITMY T240 3 DOF Y/V = 0.066 [V]
BS T240 1 DOF X/U = -0.162 [V]
BS T240 1 DOF Z/W = 0.087 [V]
BS T240 2 DOF X/U = -0.09 [V]
BS T240 2 DOF Y/V = 0.007 [V]
BS T240 2 DOF Z/W = -0.113 [V]
BS T240 3 DOF X/U = -0.206 [V]
HAM8 1 DOF X/U = -0.28 [V]
Assessment complete.
STS Centering Script Output:
Averaging Mass Centering channels for 10 [sec] ...
2024-10-04 09:22:39.265893
There are 1 STS proof masses out of range ( > 2.0 [V] )!
STS EY DOF X/U = -2.389 [V]
All other proof masses are within range ( < 2.0 [V] ):
STS A DOF X/U = -0.514 [V]
STS A DOF Y/V = -0.927 [V]
STS A DOF Z/W = -0.438 [V]
STS B DOF X/U = 0.323 [V]
STS B DOF Y/V = 0.945 [V]
STS B DOF Z/W = -0.432 [V]
STS C DOF X/U = -0.723 [V]
STS C DOF Y/V = 0.743 [V]
STS C DOF Z/W = 0.539 [V]
STS EX DOF X/U = -0.224 [V]
STS EX DOF Y/V = -0.05 [V]
STS EX DOF Z/W = 0.084 [V]
STS EY DOF Y/V = 0.007 [V]
STS EY DOF Z/W = 1.209 [V]
STS FC DOF X/U = 0.24 [V]
STS FC DOF Y/V = -1.04 [V]
STS FC DOF Z/W = 0.636 [V]
Assessment complete.
Fri Oct 04 08:09:58 2024 INFO: Fill completed in 9min 55secs
TITLE: 10/04 Day Shift: 1430-2330 UTC (0730-1630 PST), all times posted in UTC
STATE of H1: Lock Acquisition
OUTGOING OPERATOR: Ryan S
CURRENT ENVIRONMENT:
SEI_ENV state: EARTHQUAKE
Wind: 6mph Gusts, 3mph 3min avg
Primary useism: 0.06 μm/s
Secondary useism: 0.22 μm/s
QUICK SUMMARY:
Walked in to see H1 at MAX POWER after a 59min lock. (There have been EQ spikes, in last few hours, but they do NOT line up with atleast the last 2 locklosses---for this current lock there was a M5.2 Iceland EQ which occured as H1 was stepping though ISC LOCK). This last 1340utc lockloss also does not have an FSS tag; 1139utc lockloss had a FAIL; 0845, 840, 837, utc locklosses all have an FSS Oscillation tag.
1445 Back to Observing.
TITLE: 10/04 Eve Shift: 2330-0500 UTC (1630-2200 PST), all times posted in UTC
STATE of H1: Observing at 142Mpc
INCOMING OPERATOR: Ryan S
SHIFT SUMMARY:
Was a great shift, Locked the whole time. Dropped from opserving very breifly to adjust the SQZ OPO temp.
LOG:
Start Time | System | Name | Location | Lazer_Haz | Task | Time End |
---|---|---|---|---|---|---|
21:58 | PEM | Robert, guests | Y-arm | n | CE equipment demonstration | 00:49 |
21:58 | PEM | Anamaria, guests | X-arm | n | CE equipment demonstration | 01:58 |
00:36 | Geoffrey | YARM | n | Picking up guests | 00:56 | |
00:51 | VAC | Gerardo | Mid Y | N | Getting parts. | 01:00 |
https://ligo-wa.accruent.net/LB_Request_UpdateElevate.asp?RequestID=28373
anthony.sanchez@cdsws25: ls -lt | head -n 6
total 507
-rw-r--r-- 1 test_user controls 160 Sep 24 07:58 ETMX_12_Hz_1411225133.txt
-rw-r--r-- 1 test_user controls 160 Sep 24 07:50 ETMY_12_Hz_1411224662.txt
-rw-r--r-- 1 test_user controls 160 Sep 24 07:50 ITMY_15_Hz_1411224644.txt
-rw-r--r-- 1 test_user controls 160 Sep 24 07:50 ITMX_13_Hz_1411224643.txt
-rw-r--r-- 1 test_user controls 160 Sep 17 07:58 ETMX_12_Hz_1410620340.txt
These files are from the Prior week : https://alog.ligo-wa.caltech.edu/aLOG/index.php?callRep=80324
Looks like the SUS Charge measurements didn't run this week. :(
Starting 3:46 UTC
I adjusted H1:SQZ-OPO_TEC_SETTEMP while Watching the H1:SQZ-CLF_REFL_RF6_ABS_OUTPUT ndscope ( OPO temo ndscope found on the SQZ scopes dropdown) to change the OPO Tec Temp.
ending at 3:50 UTC
Sheila and I discussed doing a SQZ Angle adjustment but it seemed fine at the time.
TITLE: 10/03 Eve Shift: 2330-0500 UTC (1630-2200 PST), all times posted in UTC
STATE of H1: Lock Acquisition
OUTGOING OPERATOR: Ryan Short
CURRENT ENVIRONMENT:
SEI_ENV state: CALM
Wind: 4mph Gusts, 2mph 3min avg
Primary useism: 0.02 μm/s
Secondary useism: 0.26 μm/s
QUICK SUMMARY:
H1 is currently in Nominal_LOW_NOISE[600] with little wind and decreasing secondary microseism.
Start Time | System | Name | Location | Lazer_Haz | Task | Time End |
---|---|---|---|---|---|---|
21:58 | PEM | Robert, guests | Y-arm | n | CE equipment demonstration | 01:58 |
21:58 | PEM | Anamaria, guests | X-arm | n | CE equipment demonstration | 01:58 |
TITLE: 10/03 Day Shift: 1430-2330 UTC (0730-1630 PST), all times posted in UTC
STATE of H1: Lock Acquisition
INCOMING OPERATOR: Tony
SHIFT SUMMARY: Busy today today, from multiple lock acquisitions to commissioning activities this morning. Unfortunately, not much observing time for H1 today, but's relocking now, currently up to MAX_POWER.
LOG:
Start Time | System | Name | Location | Lazer_Haz | Task | Time End |
---|---|---|---|---|---|---|
14:47 | FAC | Tyler, MM | All Buildings | n | Glycol samples | 17:57 |
15:07 | TCS | Camilla | LVEA | n | Getting parts | 15:24 |
15:10 | FAC | Karen | Opt/Vac Labs | n | Technical cleaning | 15:37 |
15:35 | ISC | Sheila | LVEA/Opt Lab | n | Gathering parts | 15:46 |
15:47 | SQZ | Sheila, Camilla | LVEA | Local | Moving OPO crystal | 19:03 |
17:24 | ISC | Elenna | Remote | n | Testing PRCL FF | 18:22 |
17:58 | FAC | Tyler, Richard, Trane | MY | n | Looking at chillers | 19:21 |
18:26 | CDS | Fil | CER | n | Taking pictures | 18:31 |
18:44 | CDS | Fil | FCES | n | Checking extension cords | 18:52 |
18:44 | VAC | Gerardo | LVEA | n | Replace pump supply on HAM1 | 19:05 |
20:07 | SQZ | Sheila | LVEA | Local | Checking PD on SQZT7 | 20:36 |
20:59 | SQZ | Sheila, Camilla | LVEA | Local | Fixing OPO alignment | 21:51 |
21:58 | PEM | Robert, guests | Y-arm | n | CE equipment demonstration | Ongoing |
21:58 | PEM | Anamaria, guests | X-arm | n | CE equipment demonstration | Ongoing |
Lockloss @ 22:19 UTC - link to lockloss tool
No obvious cause, but it looks like the IMC lost lock at the same time as the arms. However, I don't suspect the FSS in this case.
Sheila, Camilla. WP 12116, 12117. Last done in October 2023: 73524.
Followed instructions from 73524, 65684, with additional notes below.
Took SQZT7 area to local laser hazard and plugged straight into the OPO_IR_PD for our red signal and the OPO_TRANS PD for our green signal. Trying to take the signals from the outside of the table or the SQZ racks was confusing.
Setup:
What we did:
Today, 75uW OPO trans power corresponded to 0.945 on the OPO refl diode, last night that was 4.161mW on OPO refl diode. Meaning after this spot move we now need to inject a lot less power into the OPO to get the same output power.
Camilla and I ran SQZ_ALIGNMENT and SCAN_SQZ_ANG with the offset on PZT2 (we are using H1:SQZ-CLF_SERVO_SLOWOUTOFS) set to 0, while the nominal value is 10. We then went to no squeezing and set the offset back to it's nominal value, and saw reduced squeezing when we reinjected squeezing. We could recover the better squeezing level by slowly stepping this offset back to 0V. We think that this could be because the PZT setting changes the alignment of the OPO, and the squeezed beam coming out of it. (which also changes the squeezing angle).
A similar effect was seen with PZT1 in 80396 and 78529. It would be interesting another time to try changing this offset and seeing if we can recover squeezing by readjusting alignment and squeezing angle.
The picomotor to adjust the OPO pump power is not working, H1:SYS-MOTION_C_PICO_I_MOTOR_2. When someone commands the waveplate to turn from medm, there is a clicking sound on the table that seems to come from the rotation stage, but it doesn't move.
We need to adjust this by hand for now if the ISS runs out of range (or alternatively, we can change the ISS set point).
FRS: 32288
Lockloss @ 18:27 UTC - link to lockloss tool
Happened at the end of commissioning time while PRCL NB injection was being run, although I don't suspect that as the cause. There was also work happening near HAM7 and the SQZ tables. Only thing in the trends I notice is some motion in ETMX L3 and DARM as the first action; hard to tell which happens first. No other obvious cause, including the FSS.
The FSS was very unhappy when trying to relock the IMC after this lockloss. I needed to toggle the autolocker a couple of times before the glitching calmed down enough to allow the IMC to lock.
H1 back to observing at 21:49 UTC. Recovery took a bit longer than usual due to a lockloss at TRANSITION_FROM_ETMX from a small seismic event (see screenshot from Jim) and SQZ optimization (see incoming alog from Sheila/Camilla).
TITLE: 10/02 Eve Shift: 2330-0500 UTC (1630-2200 PST), all times posted in UTC
STATE of H1: Observing at 148Mpc
CURRENT ENVIRONMENT:
SEI_ENV state: USEISM
Wind: 21mph Gusts, 13mph 3min avg
Primary useism: 0.08 μm/s
Secondary useism: 0.45 μm/s
QUICK SUMMARY:
Sudden Lockloss @ 21:55 UTC very likley cause by a PSL FSS issue.
IMC Had a hard time relocking locking after the lockloss.
NLN Reached @ 22:54 UTC
Observing reached @ 22:56 UTC
Definitely looks like the FSS had a large glitch and lost lock before DARM saw the lockloss. This lockloss didn't have the FSS glitches happening before though.
Gerardo, Jordan, Travis, Janos Reacting to the issue in aLog https://alog.ligo-wa.caltech.edu/aLOG/index.php?callRep=80370, the HAM1 AIP was checked for controller and pump failures. After trying a couple of controllers, it was clear that the pump broke down. Shortly after the maintenance period, because of the high seismic activity, locking was impossible, so the vacuum team took the opportunity and swapped the pump (as normally it would have been impossible during the 4 hours of the maintenance period). The AIP was swapped with a noble diode pump - this was not exactly intentional, but turned out to be a happy accident, as it seemingly works much better than the Starcell or even the Galaxy pumps. However, as the noble diode pump has positive polarity, a positive polarity controller was needed: the only available piece is an Agilent IPC Mini (see it in the picture attached), which works well, but in the MEDM screen it appears to be faulty, due to its wiring differences. All in all, the HAM1/HAM2 twin-annulus system was pumped with the 2 AIPs and an Aux cart - Turbo pump bundle. The noble diode pump stabilized very nicely (at 5-7E-7 Torr, which is unusually low), so eventually the Aux cart Turbo pump bundle was switched off - at 6:55 pm PT. Since then, the 2 AIPs continue to decrease the annulus pressure, which is indeed very nice, so practically we are back to normal. In the meantime, Gerardo quickly modified an appropriate Varian controller to have positive polarity, so at the next opportunity the vacuum team will swap it with the Agilent controller, so the MEDM screen will also be normal. Note that the Aux cart - Turbo bundle remain there until this swap happens.
While the ion pump was replaced we managed to trip the cold cathode giving us the signal for the vacuum pressure internal to HAM1, PT100B, found the CC off last night, but since the IFO was collecting data decided to wait until we were out lock, I turned the CC back on this morning. See trend data attached.
Diode pumps are typically faster than triode pumps including Starcell cathode types. Nice work!
Removed the Agilent IPC Mini controller that was temporarily installed on Tuesday, and replaced it with a positive (+) MiniVac controller. Attached is a trend of current load for both controllers, HAM1 and HAM2.
Note for the vacuum team, we still have the aux cart connected to HAM2 annulus ion pump isolation valve.
Yesterday afternoon until 2 am, we had low range because the squeezing angle was not well tuned. As Naoki has noted 78529 this can happen when the OPO PZT is at a lower voltage than we normally operate at. This probably could have been improved by running SCAN_SQZANG.
I've edited the OPO_PZT_OK checker, so that it requires the OPO PZT to be between 70 and 110 V (it used to be 50 to 110V). This might mean that sometimes the OPO has difficulty locking, (ie, 76642), which will cause the IFO to call for help, but that will avoid running with low range when it needs to run SCAN_SQZANG.
Reverted OPO checker back to 50-110V as we moved the OPO crystal spot.