Because we moved the OPO crystal position yesterday, 8045, the crystal absorption will be changing for a few weeks, and we will need to adjust the temperature setting for the OPO until it settles, as Tony and I did last night. 80455.  Here are two sets of instructions, one that can be used while in observing to adjust this, and one that can be done when we loose lock or are out of observing for some other reason. 

For these first few days, please follow the out of observing instructions when relocking, if this hasn't been done in the last few hours, and please try to do it in the last few hours of the evening shift so that the temperature is close to well tuned at the start of the owl shift.

Out of observing instructions (to be done while recovering from a lockloss, can be done while ISC_LOCK is locking the IFO) (screenshot) :

• Make sure that ISC_LOCK will not set SQZ_MANAGER request to INJECT_SQZ, by setting the request to ADS_TO_CAMERAs or any lower state.
• From sitemap, SQZ_OVERVIEW, set SQZ MANGER request to LOCKED_SEED_NLG.
• from the purple !SQZ scopes button, open the NLG scope
• Once the SQZ manger is in LOCKED_SEED_NLG, you should see that the red OPO_IR_TRANS trace on the scope is oscillating.  Adjust the OPO temperature using the slider which is right under the purple SQZ scopes button, to maximize the peak of the oscillations. 
• SET_SQZ MANGER request back to FDS_READY_IFO, and once that's ready you can set the ISC_LOCK request to nominal low noise.
• Before going to observing, you can adjust the squeezing angle by requesting SQZ_MANAGER to SCAN_SQZANG.  It is best practice to do this after the IFO has thermalized, but it can be done early in the lock.  If lock stretches are long and this has been done only early in the lock, it may need adjusting for a thermalized IFO.  Right now the squeezing angle has a strong frequency dependence early in the lock stretch, so let's not adjust it until the IFO has been locked for at least an hour.

In observing instructions:

Both the OPO temperature and the SQZ phase are ignored in SDF and can be adjusted while we are in observing, but it's important to log the times of any adjustments made. 

• To adjust the temperature in full lock, go to the purple SQZ_SCOPE button and choose the OPO temp scope, adjust the OPO temperature to maximize CLF_REFL_RF6_ABS (the green trace). 
• After doing this it might be necessary to adjust the SQZ PHASE, which can be adjusted in steps of 5 degrees or so.  Set this to maximize the squeezing level, which you can do by watching the DARM FDS dtt template.  It is available from the SQZ DTT purple button, or on NUC33.  It is easiest to adjust this for high frequency squeezing (around 1kHz), this should get you close to good squeezing at 100 Hz.

Changes made to make this easier (Thanks Corey for beta testing the instructions):

•  I've commented out the request to SQZ_MANGER that ISC_LOCK makes in low noise length control, because that took control of the squeezer from Corey when he was giving these instructions a trial.
• The OPO temp is not monitored in SDF
• I removed the goto= True from the LOCK_FSS state.  This will force SQZ_MANAGER to go through down after the NLG measurement (and turn off the seed PZT ramp).

Corey has had a series of locklosses from DRMI/PRMI and ALS, I've looked into one of these: 1412094082

In this case it looks like there is a large glitch seen in all DRMI LSC signals (and ASC, but it seems to start in LSC), with a small glitch about 4 seconds before lockloss, which DRMI recovers from.  Then there is a larger glitch that happened about 1 second before lockloss, where POP18 drops below the trigger threshold, and the DRMI guardian goes to DOWN, at the same time the ALS Y arm looses green lock, which then unlocks the ALS X arm. 

This glitch doesn't seem to be cause by the DRMI ASC, although we were in the process of engaging that ASC when it happened.  It also isn't due to the BS ISI isolation coming on, which hadn't happened yet. 

Edit:  I looked into a second lockloss, from PRMI: 1412095134, this one is different in that it happens very quickly and PRMI and ALS signals drop out at close to the same time.  This happened while the DRMI guardian was waiting for the refl WFS centering to converge.

For FAMIS 26303:
Laser Status:
    NPRO output power is 1.818W (nominal ~2W)
    AMP1 output power is 64.55W (nominal ~70W)
    AMP2 output power is 137.7W (nominal 135-140W)
    NPRO watchdog is GREEN
    AMP1 watchdog is GREEN
    AMP2 watchdog is GREEN
    PDWD watchdog is GREEN

PMC:
    It has been locked 0 days, 22 hr 2 minutes
    Reflected power = 22.1W
    Transmitted power = 104.0W
    PowerSum = 126.1W

FSS:
    It has been locked for 0 days 0 hr and 7 min
    TPD[V] = 0.8089V

ISS:
    The diffracted power is around 2.4%
    Last saturation event was 0 days 0 hours and 7 minutes ago

Possible Issues:
    AMP1 power is low
    PMC reflected power is high

Monthly FAMIS Check (#26494)

T240 Centering Script Output:

Averaging Mass Centering channels for 10 [sec] ...
2024-10-04 09:08:54.264102
There are 14 T240 proof masses out of range ( > 0.3 [V] )!
ETMX T240 2 DOF X/U = -0.745 [V]
ETMX T240 2 DOF Y/V = -0.637 [V]
ETMX T240 2 DOF Z/W = -0.529 [V]
ITMX T240 1 DOF X/U = -1.51 [V]
ITMX T240 1 DOF Y/V = 0.325 [V]
ITMX T240 1 DOF Z/W = 0.447 [V]
ITMX T240 3 DOF X/U = -1.563 [V]
ITMY T240 3 DOF X/U = -0.773 [V]
ITMY T240 3 DOF Z/W = -1.934 [V]
BS T240 1 DOF Y/V = -0.394 [V]
BS T240 3 DOF Y/V = -0.307 [V]
BS T240 3 DOF Z/W = -0.49 [V]
HAM8 1 DOF Y/V = -0.475 [V]
HAM8 1 DOF Z/W = -0.786 [V]
All other proof masses are within range ( < 0.3 [V] ):
ETMX T240 1 DOF X/U = -0.083 [V]
ETMX T240 1 DOF Y/V = -0.1 [V]
ETMX T240 1 DOF Z/W = -0.159 [V]
ETMX T240 3 DOF X/U = -0.106 [V]
ETMX T240 3 DOF Y/V = -0.165 [V]
ETMX T240 3 DOF Z/W = -0.093 [V]
ETMY T240 1 DOF X/U = 0.009 [V]
ETMY T240 1 DOF Y/V = 0.116 [V]
ETMY T240 1 DOF Z/W = 0.173 [V]
ETMY T240 2 DOF X/U = -0.083 [V]
ETMY T240 2 DOF Y/V = 0.171 [V]
ETMY T240 2 DOF Z/W = 0.03 [V]
ETMY T240 3 DOF X/U = 0.182 [V]
ETMY T240 3 DOF Y/V = 0.029 [V]
ETMY T240 3 DOF Z/W = 0.109 [V]
ITMX T240 2 DOF X/U = 0.127 [V]
ITMX T240 2 DOF Y/V = 0.258 [V]
ITMX T240 2 DOF Z/W = 0.22 [V]
ITMX T240 3 DOF Y/V = 0.117 [V]
ITMX T240 3 DOF Z/W = 0.104 [V]
ITMY T240 1 DOF X/U = 0.078 [V]
ITMY T240 1 DOF Y/V = 0.083 [V]
ITMY T240 1 DOF Z/W = -0.061 [V]
ITMY T240 2 DOF X/U = 0.054 [V]
ITMY T240 2 DOF Y/V = 0.185 [V]
ITMY T240 2 DOF Z/W = 0.092 [V]
ITMY T240 3 DOF Y/V = 0.066 [V]
BS T240 1 DOF X/U = -0.162 [V]
BS T240 1 DOF Z/W = 0.087 [V]
BS T240 2 DOF X/U = -0.09 [V]
BS T240 2 DOF Y/V = 0.007 [V]
BS T240 2 DOF Z/W = -0.113 [V]
BS T240 3 DOF X/U = -0.206 [V]
HAM8 1 DOF X/U = -0.28 [V]

Assessment complete.

STS Centering Script Output:

Averaging Mass Centering channels for 10 [sec] ...
2024-10-04 09:22:39.265893
There are 1 STS proof masses out of range ( > 2.0 [V] )!
STS EY DOF X/U = -2.389 [V]
All other proof masses are within range ( < 2.0 [V] ):
STS A DOF X/U = -0.514 [V]
STS A DOF Y/V = -0.927 [V]
STS A DOF Z/W = -0.438 [V]
STS B DOF X/U = 0.323 [V]
STS B DOF Y/V = 0.945 [V]
STS B DOF Z/W = -0.432 [V]
STS C DOF X/U = -0.723 [V]
STS C DOF Y/V = 0.743 [V]
STS C DOF Z/W = 0.539 [V]
STS EX DOF X/U = -0.224 [V]
STS EX DOF Y/V = -0.05 [V]
STS EX DOF Z/W = 0.084 [V]
STS EY DOF Y/V = 0.007 [V]
STS EY DOF Z/W = 1.209 [V]
STS FC DOF X/U = 0.24 [V]
STS FC DOF Y/V = -1.04 [V]
STS FC DOF Z/W = 0.636 [V]

Assessment complete.

Fri Oct 04 08:09:58 2024 INFO: Fill completed in 9min 55secs

TITLE: 10/04 Day Shift: 1430-2330 UTC (0730-1630 PST), all times posted in UTC
STATE of H1: Lock Acquisition
OUTGOING OPERATOR: Ryan S
CURRENT ENVIRONMENT:
    SEI_ENV state: EARTHQUAKE
    Wind: 6mph Gusts, 3mph 3min avg
    Primary useism: 0.06 μm/s
    Secondary useism: 0.22 μm/s
QUICK SUMMARY:

Walked in to see H1 at MAX POWER after a 59min lock.  (There have been EQ spikes, in last few hours, but they do NOT line up with atleast the last 2 locklosses---for this current lock there was a M5.2 Iceland EQ which occured as H1 was stepping though ISC LOCK).  This last 1340utc lockloss also does not have an FSS tag; 1139utc lockloss had a FAIL; 0845, 840, 837, utc locklosses all have an FSS Oscillation tag.

1445 Back to Observing.

TITLE: 10/04 Eve Shift: 2330-0500 UTC (1630-2200 PST), all times posted in UTC
STATE of H1: Observing at 142Mpc
INCOMING OPERATOR: Ryan S
SHIFT SUMMARY:
Was a great shift, Locked the whole time. Dropped from opserving very breifly to adjust the SQZ OPO temp.


LOG:

https://ligo-wa.accruent.net/LB_Request_UpdateElevate.asp?RequestID=28373

anthony.sanchez@cdsws25: ls -lt | head -n 6
total 507
-rw-r--r-- 1 test_user          controls   160 Sep 24 07:58 ETMX_12_Hz_1411225133.txt
-rw-r--r-- 1 test_user          controls   160 Sep 24 07:50 ETMY_12_Hz_1411224662.txt
-rw-r--r-- 1 test_user          controls   160 Sep 24 07:50 ITMY_15_Hz_1411224644.txt
-rw-r--r-- 1 test_user          controls   160 Sep 24 07:50 ITMX_13_Hz_1411224643.txt
-rw-r--r-- 1 test_user          controls   160 Sep 17 07:58 ETMX_12_Hz_1410620340.txt

These files are from the Prior week : https://alog.ligo-wa.caltech.edu/aLOG/index.php?callRep=80324

Looks like the SUS Charge measurements didn't run this week. :(

Starting 3:46 UTC

I adjusted H1:SQZ-OPO_TEC_SETTEMP while Watching the H1:SQZ-CLF_REFL_RF6_ABS_OUTPUT ndscope ( OPO temo ndscope found on the SQZ scopes dropdown)  to change the OPO Tec Temp.
ending at 3:50 UTC

Sheila and I discussed doing a SQZ Angle adjustment but it seemed fine at the time.

TITLE: 10/03 Eve Shift: 2330-0500 UTC (1630-2200 PST), all times posted in UTC
STATE of H1: Lock Acquisition
OUTGOING OPERATOR: Ryan Short
CURRENT ENVIRONMENT:
    SEI_ENV state: CALM
    Wind: 4mph Gusts, 2mph 3min avg
    Primary useism: 0.02 μm/s
    Secondary useism: 0.26 μm/s
QUICK SUMMARY:

H1 is currently in Nominal_LOW_NOISE[600] with little wind and decreasing secondary microseism.
 

TITLE: 10/03 Day Shift: 1430-2330 UTC (0730-1630 PST), all times posted in UTC
STATE of H1: Lock Acquisition
INCOMING OPERATOR: Tony
SHIFT SUMMARY: Busy today today, from multiple lock acquisitions to commissioning activities this morning. Unfortunately, not much observing time for H1 today, but's relocking now, currently up to MAX_POWER.

• 14:30 - H1 relocking
  • 15:05 to 15:28 - Ran initial alignment
• 16:38 - Reached NLN (fully automatic relock), starting planned commissioning activities
  • 17:57 - ISI HAM7 WD trip from activity near chamber
  • 18:27 - Lockloss - alog80443
  • 18:46 - HEPI HAM1 WD trip from activity on chamber
• 20:46 - Reached NLN, but SQZ needs work so waiting start observing
• 21:49 - Observing
• 22:19 - Lockloss - alog80453

LOG:

Lockloss @ 22:19 UTC - link to lockloss tool

No obvious cause, but it looks like the IMC lost lock at the same time as the arms. However, I don't suspect the FSS in this case.

Sheila, Camilla. WP 12116, 12117. Last done in October 2023: 73524.

Followed instructions from 73524, 65684, with additional notes below. 

Took SQZT7 area to local laser hazard and plugged straight into the OPO_IR_PD for our red signal and the OPO_TRANS PD for our green signal. Trying to take the signals from the outside of the table or the SQZ racks was confusing. 

Setup:

• Old style function generator, offset 4.5V for a 1-9V scan at 10Hz.
• Oscilloscope and long BNCs/adapters: plug into function generator, OPO_IR_PD and the OPO_TRANS photodetectors inside SQZT7. 
• PZT driver MDT694 which has 0-150V output for 0-10V input, connected this to the PZT1 connector in the back of the chassis, using the adapter for PZT2 (note this means that the PZT2 offset we had been keeping at +10V was 0V for this measurements, controlled by CLF SLOWOUTOFS 65535). 
• Wincam dell laptop and gray E-870 PI shift driver box (stored in LVEA SQZ cabinet) and the OPO crystal cable remains attached +X HAM7 flange.

What we did:

• After set up once we could see both mode scans on the oscilloscope, we injected the seed beam and reduced green power from 30mW to 6mW to avoid pumping too much. Pico wasn't working: 80449.
• Adjusted temperature to get red and green co-resonance. Plot attached of before spot move. 
• In alog 73524 we used the OPO spot 2nd from the left. We moved (32 x 50 steps to right, then 2 x 10 steps to right) to the next spot with a red-green co-resonance, 3rd from the left. Plot attached.
• Increased the green power back to 25mW, then 30mW and then things got confusing: we were seeing rapidly changing strange signals and negatives on OPO_TRANS channel. Beckhoff version of the channels looked better. We eventually found that the whitening filters must have been saturating and giving us strange signals. We increased SHG ISS drivepoint to 10V, allowing us to use a lower green pump, this showed that the high green pump was our issues. Then reduced the SHG power to 14mW while the SHG ISS drivepoint was in the middle of the range at 5V. When the ISS was engaged, it could keep the opo_grTrans_setpiont_uW to 80uW with the controlmon around 6 and SHG_LAUNCH ~11.5mW. This is much less than the 30mW we needed this morning so this new crystal spot is much less lossy. 
• OPO started to oscillate when we locked it so we reduced the OPO gain from -4 to -8 and accepted in sdf.
• Sheila set the opo_grTrans_setpiont_uW to 80uW in sqzparams.py and we measured the NLG to be 11 (Amplified / Un-amplified = 0.098/0.0089 see 76542).
• Ran SCAN_SQZ_ALGNMENT and SCAN_SQZ_ANG. This gave us >4dB of squeezing at high frequency.  
• We left PZT2 (CLF SLOWOUTOFS) at 0V, see 80450.

Today, 75uW OPO trans power corresponded to 0.945 on the OPO refl diode, last night that was 4.161mW on OPO refl diode. Meaning after this spot move we now need to inject a lot less power into the OPO to get the same output power.

Camilla and I ran SQZ_ALIGNMENT and SCAN_SQZ_ANG with the offset on PZT2 (we are using H1:SQZ-CLF_SERVO_SLOWOUTOFS) set to 0, while the nominal value is 10.  We then went to no squeezing and set the offset back to it's nominal value, and saw reduced squeezing when we reinjected squeezing.  We could recover the better squeezing level by slowly stepping this offset back to 0V.  We think that this could be because the PZT setting changes the alignment of the OPO, and the squeezed beam coming out of it.  (which also changes the squeezing angle). 

A similar effect was seen with PZT1 in 80396 and 78529.  It would be interesting another time to try changing this offset and seeing if we can recover squeezing by readjusting alignment and squeezing angle.

The picomotor to adjust the OPO pump power is not working, H1:SYS-MOTION_C_PICO_I_MOTOR_2.  When someone commands the waveplate to turn from medm, there is a clicking sound on the table that seems to come from the rotation stage, but it doesn't move. 

We need to adjust this by hand for now if the ISS runs out of range (or alternatively, we can change the ISS set point).

FRS: 32288

Lockloss @ 18:27 UTC - link to lockloss tool

Happened at the end of commissioning time while PRCL NB injection was being run, although I don't suspect that as the cause. There was also work happening near HAM7 and the SQZ tables. Only thing in the trends I notice is some motion in ETMX L3 and DARM as the first action; hard to tell which happens first. No other obvious cause, including the FSS.

The FSS was very unhappy when trying to relock the IMC after this lockloss. I needed to toggle the autolocker a couple of times before the glitching calmed down enough to allow the IMC to lock.

TITLE: 10/02 Eve Shift: 2330-0500 UTC (1630-2200 PST), all times posted in UTC
STATE of H1: Observing at 148Mpc
CURRENT ENVIRONMENT:
    SEI_ENV state: USEISM
    Wind: 21mph Gusts, 13mph 3min avg
    Primary useism: 0.08 μm/s
    Secondary useism: 0.45 μm/s
QUICK SUMMARY:

Sudden Lockloss @ 21:55 UTC very likley cause by a PSL FSS issue.

IMC Had a hard time relocking locking after the lockloss.

NLN Reached @ 22:54 UTC
Observing reached @ 22:56 UTC

Gerardo, Jordan, Travis, Janos

Reacting to the issue in aLog https://alog.ligo-wa.caltech.edu/aLOG/index.php?callRep=80370, the HAM1 AIP was checked for controller and pump failures. After trying a couple of controllers, it was clear that the pump broke down.
Shortly after the maintenance period, because of the high seismic activity, locking was impossible, so the vacuum team took the opportunity and swapped the pump (as normally it would have been impossible during the 4 hours of the maintenance period).
The AIP was swapped with a noble diode pump - this was not exactly intentional, but turned out to be a happy accident, as it seemingly works much better than the Starcell or even the Galaxy pumps. However, as the noble diode pump has positive polarity, a positive polarity controller was needed: the only available piece is an Agilent IPC Mini (see it in the picture attached), which works well, but in the MEDM screen it appears to be faulty, due to its wiring differences.
All in all, the HAM1/HAM2 twin-annulus system was pumped with the 2 AIPs and an Aux cart - Turbo pump bundle. The noble diode pump stabilized very nicely (at 5-7E-7 Torr, which is unusually low), so eventually the Aux cart Turbo pump bundle was switched off - at 6:55 pm PT.
Since then, the 2 AIPs continue to decrease the annulus pressure, which is indeed very nice, so practically we are back to normal.
In the meantime, Gerardo quickly modified an appropriate Varian controller to have positive polarity, so at the next opportunity the vacuum team will swap it with the Agilent controller, so the MEDM screen will also be normal. Note that the Aux cart - Turbo bundle remain there until this swap happens.

Yesterday afternoon until 2 am, we had low range because the squeezing angle was not well tuned.  As Naoki has noted 78529 this can happen when the OPO PZT is at a lower voltage than we normally operate at. This probably could have been improved by running SCAN_SQZANG. 

I've edited the OPO_PZT_OK checker, so that it requires the OPO PZT to be between 70 and 110 V (it used to be 50 to 110V).  This might mean that sometimes the OPO has difficulty locking, (ie, 76642), which will cause the IFO to call for help, but that will avoid running with low range when it needs to run SCAN_SQZANG.