Adjusted OPO temperature to maximize RF6 with SQZ_MANAGER paused and the guardian SQZ_ANG_ADJUST in "DOWN".

Then turn back on SQZ_ANG_ADJUST = "ADJUST_SQZ_ANG_SDF", and adjusted the squeeze angle servo setpoint (the ADF demod phase, H1:SQZ-ADF_OMC_TRANS_PHASE from -133 to -124, see accepted SDF) to maximize squeezing (increased ~ 1 dB squeezing at kHz) and range (trends, increased like 5-10 Mpc?).

As reported in 79897, a bump has been apparent in the H1 spectrum in the vicinity of the Crab pulsar for much of O4b.

So far, it looks like:

• This problem is distinct from the 60 Hz broadening due to issues with line subtraction (this noise feature shows up in DELTAL_EXTERNAL).
• CS microphone and accelerometer channels look suspicious, particularly H1:PEM-CS_MIC_LVEA_BS_DQ, but the noise shows up earlier there than in DARM. If it is the same noise, something must have changed with the coupling during the break.

The attached plots are all generated from Fscan weekly and monthly averaged data. The feature can be seen most clearly in these long-duration spectra.

• Fig 1: Comparison of October monthly spectra, STRAIN_CLEAN vs DELTAL_EXTERNAL. The location of interest is marked with a vertical pink line (this marker is actually too narrow, just showing general location). The 60 Hz broadening, described in 80624, mostly hides the bump in STRAIN_CLEAN, but it's still evident in DELTAL_EXTERNAL.
• Fig 2: Comparison of spectrograms made from weekly averages, STRAIN_CLEAN vs DELTAL_EXTERNAL. The region of interest is circled in red. This seems consistent with the timeline Keith reported in 79897. (Note: The colorbars here are not equivalent and have been adjusted for visibility. Some small data gaps are due to broken Fscan production jobs, which may differ by channel.)
• Fig 3: Same as Fig 2, but zoomed in and with slightly different color bar adjustment.
• Fig 4: The DELTAL_EXTERNAL zoom from Fig 3, compared with data from H1:PEM-CS_MIC_LVEA_BS_DQ . The tracks appear similar, but the noise in H1:PEM-CS_MIC_LVEA_BS_DQ predates its appearance in DARM. It doesn't show up in coherence between the two channels.

There is a git issue tracking the problem here, with some additional discussion history and more plots: https://git.ligo.org/detchar/detchar-requests/-/issues/273

We've been seeing the SQZ_ANG_ADJUST servo run away at the start of a lock (maybe especially if the IFO is cold) e.g. attached today before Vicky reset it and over the weekend 81030.

We added a notification to SQZ_MANAGER FREQ_DEP_SQZ to return  False (kick us out of observing as range will be terrible) and notify 'SQZ angle is out of range, request RESET_SQZ_ANG_FDS and then FREQ_DEP_SQZ' if the angle H1:SQZ-CLF_REFL_RF6_PHASE_PHASEDEG is outside of 100 to 250deg.

To solve this, request RESET_SQZ_ANG_FDS and then FREQ_DEP_SQZ. This should turn off the SQZ_ADJUST_ANG servo, reset it to a normal value, wait ~60 seconds for the ASC to move and then return True so you cn go back to FREQ_DEP_SQZ.

Lockloss @ 11/07 19:31UTC, possibly due to commissioning activities. Doesn't look like anything in PSL/IMC land(ndscope1). We had some glitches in DARM the second before the lockloss, and actuation to the top mass of PRM had just been started a few seconds before, so it's possible that that was the reason(ndscope2).

Thu Nov 07 10:03:03 2024 INFO: Fill completed in 3min 1secs

Travis confirmed a good fill curbside.

TITLE: 11/07 Day Shift: 1530-0030 UTC (0730-1630 PST), all times posted in UTC
STATE of H1: Aligning
OUTGOING OPERATOR: Ibrahim
CURRENT ENVIRONMENT:
    SEI_ENV state: CALM
    Wind: 5mph Gusts, 3mph 3min avg
    Primary useism: 0.02 μm/s
    Secondary useism: 0.21 μm/s
QUICK SUMMARY:

H1's not made it back to NLN over 24 hrs (with a low duty cycle overall this week[s]).  A quick glance shows ALSy is not stable as seen yesterday afternoon.  Just chatted with Sheila and she suggested checking stability of the PMC overnight after the PSL NPRO Freq temperature change from yesterday.

Microseism did increase a bit in the last 24hrs, but has also come back down to where it was about 18hrs ago; very low winds.

The Ops Work Station (cdsws29) had a bad "left" monitor (started flickering yesterday)---Jonathan is replacing it now.

Attached is a roughly 19 hour trend, going back to relocking the PMC/ISS/FSS after yesterday's NPRO crystal temperature tuning.  As can be seen, there were no excursions in PMC Refl above 18 W, and no sudden drops in the ISS diffracted power % or sudden ISS unlocks, a clear change from the last several days.  We will continue to monitor this, but so far it looks like the new NPRO is much happier with this new crystal temperature.

Tony texted me at 10PM and warned me of an unstable ALSY lock. After resding the alogs and enacting the changes that him and Keita made to manage to lock Y, I was still having issues.

For context, the ALSY laser had maintenance early today and since then has been having either multimode locking issues or more general laser performance issues according to Daniel. To tackle this, Keita and Tony lowered the ALSY locking thresholds in order to make it past ALS and while this worked once, was not repeatable. Their alogs: alog 81116, alog 81114. After some flailing, I decided to call for help.

Daniel came online and began to dianose the ALSY issues. The first guess was that it was a multimode issue, to which he began to change the ALS frequency to test it out. The final conclusion is that it's some tuning error where ALSY doesn't operate stably in its current frequency since being adjusted to PSL freq. Daniel's Alog 81117. Final recommendation is that corrective maintenance needs to be done on-site at EY. Since this is not possible now, with Daniel's recommendation, IFO will remain in LOCKING_ARMS_GREEN until tomorrow's DAY shift.

The laser in EY looks unstable. It may be multimode.

The first attached plot shows the ALSY locking attampts over the past day. The laser was adjjusted to the new PSL frequency about 10 hours ago. Afterwards there is a distinct variation in the green output accompanied by a smaller inverse change of the red power. In the past 6 hours good ALS locks (red trace near +1.0) are correlated with the lower green power states. At higher green p[owers we seem to be locking a intermediate transmitted powers indicating the possibility of a multimode laser.

The second attached plot shows how changing the frequency of the laser changes the green and red powers. The green power varies much between -600 and +400MHz and seems to be stable outside this region.

We need to try adjusting the pump diode current and crystal temperature and see if we can resolve it this way.

TITLE: 11/07 Eve Shift: 0030-0600 UTC (1630-2200 PST), all times posted in UTC
STATE of H1: Corrective Maintenance
INCOMING OPERATOR: Ibrahim
SHIFT SUMMARY:
ALS-Y is not correct and is very time consuming to trick into working correctly.
Please see alog https://alog.ligo-wa.caltech.edu/aLOG/index.php?callRep=81114

Once locking , I took ISC_LOCK to Green arms manual, Keita lowered the Threshold even further:  H1:ALS-Y_REFL_LOCK_TRANSPDNORMTHRESH -> 0.40 which is even lower than initial alignmnet. We did this because the Diff beatnote that we were seeing was -41 dbm
We also increased the gain H1:ALS-Y_REFL_LOCK_LOCKEDGAIN from 6 to 12.

Line 921 in ALS_ARM.py was changed:
if ezca['ALS-C_TR%s_A_LF_OUT16'%self.arm] < 0.5: # WAS Changed From 0.5 to 0.3
We then just waited and eventually it went to LOCKING_ALS !
I then reverted all my changes in ALS_ARM.py and save and reloaded ALS-Yarm as soon as we made it past Locking ALS.

Got all the way up to LOW_NOISE_ETMX[558] before some oscillation seen on ASC Chard P inmon unlocked it again.

The IFO is still very difficult to lock beyond ALS-Y, See the attachment for help finding these channles.

LOG:
Keita went out on the floor to work on the Lockloss Monitor.

Right after the ALSY laser was adjusted earlier today, IR power went down (right column, 2nd from the top) while the green power went up significantly (left column 2nd from the top) and started drifting significantly. There are times when green Y transmission cannot go more than 0.45 or so even when the arm was free swinging despite the higher green power. It doesn't seem as if the problem is not alignment.

Interestingly, last two times when Y arm locking was good (i.e. green transmission divided by the green laser power was reasonable) were when IR output of the laser peaked and the green output went down to the previous power level.

TITLE: 11/07 Eve Shift: 0030-0600 UTC (1630-2200 PST), all times posted in UTC
STATE of H1: Corrective Maintenance
OUTGOING OPERATOR: Corey
CURRENT ENVIRONMENT:
    SEI_ENV state: CALM
    Wind: 5mph Gusts, 4mph 3min avg
    Primary useism: 0.09 μm/s
    Secondary useism: 0.23 μm/s
QUICK SUMMARY:

Earthquake may have interupted the Initial alignment that was done just before my shift.

Reverted the Y arm to the OSEM values we had before our lockloss.

Reverting All but SQZ  to last second of the last good Initial Alignment: 1414909471

Before: SUS-IM1_M1_OPTICALIGN_P_OFFSET: 427.4,
After: SUS-IM1_M1_OPTICALIGN_P_OFFSET: 427.4,
Before: SUS-IM1_M1_OPTICALIGN_Y_OFFSET: -384.8,
After: SUS-IM1_M1_OPTICALIGN_Y_OFFSET: -384.8,
Before: SUS-IM2_M1_OPTICALIGN_P_OFFSET: 706.7,
After: SUS-IM2_M1_OPTICALIGN_P_OFFSET: 706.7,
Before: SUS-IM2_M1_OPTICALIGN_Y_OFFSET: -178.3,
After: SUS-IM2_M1_OPTICALIGN_Y_OFFSET: -178.3,
Before: SUS-IM3_M1_OPTICALIGN_P_OFFSET: -232.8,
After: SUS-IM3_M1_OPTICALIGN_P_OFFSET: -232.8,
Before: SUS-IM3_M1_OPTICALIGN_Y_OFFSET: 333.5,
After: SUS-IM3_M1_OPTICALIGN_Y_OFFSET: 333.5,
Before: SUS-IM4_M1_OPTICALIGN_P_OFFSET: -85.2,
After: SUS-IM4_M1_OPTICALIGN_P_OFFSET: -87.0,
Before: SUS-IM4_M1_OPTICALIGN_Y_OFFSET: 392.2,
After: SUS-IM4_M1_OPTICALIGN_Y_OFFSET: 391.5,
Before: SUS-RM1_M1_OPTICALIGN_P_OFFSET: -729.8,
After: SUS-RM1_M1_OPTICALIGN_P_OFFSET: -723.6,
Before: SUS-RM1_M1_OPTICALIGN_Y_OFFSET: 180.9,
After: SUS-RM1_M1_OPTICALIGN_Y_OFFSET: 181.2,
Before: SUS-RM2_M1_OPTICALIGN_P_OFFSET: -48.0,
After: SUS-RM2_M1_OPTICALIGN_P_OFFSET: -32.6,
Before: SUS-RM2_M1_OPTICALIGN_Y_OFFSET: 318.3,
After: SUS-RM2_M1_OPTICALIGN_Y_OFFSET: 303.7,
Before: SUS-MC1_M1_OPTICALIGN_P_OFFSET: 833.3,
After: SUS-MC1_M1_OPTICALIGN_P_OFFSET: 833.3,
Before: SUS-MC1_M1_OPTICALIGN_Y_OFFSET: -2230.6,
After: SUS-MC1_M1_OPTICALIGN_Y_OFFSET: -2230.6,
Before: SUS-MC2_M1_OPTICALIGN_P_OFFSET: 591.5,
After: SUS-MC2_M1_OPTICALIGN_P_OFFSET: 591.5,
Before: SUS-MC2_M1_OPTICALIGN_Y_OFFSET: -580.4,
After: SUS-MC2_M1_OPTICALIGN_Y_OFFSET: -580.4,
Before: SUS-MC3_M1_OPTICALIGN_P_OFFSET: -20.3,
After: SUS-MC3_M1_OPTICALIGN_P_OFFSET: -20.3,
Before: SUS-MC3_M1_OPTICALIGN_Y_OFFSET: -2431.1,
After: SUS-MC3_M1_OPTICALIGN_Y_OFFSET: -2431.1,
Before: SUS-PRM_M1_OPTICALIGN_P_OFFSET: -1627.6,
After: SUS-PRM_M1_OPTICALIGN_P_OFFSET: -1636.9,
Before: SUS-PRM_M1_OPTICALIGN_Y_OFFSET: 622.9,
After: SUS-PRM_M1_OPTICALIGN_Y_OFFSET: 616.7,
Before: SUS-PR2_M1_OPTICALIGN_P_OFFSET: 1553.5,
After: SUS-PR2_M1_OPTICALIGN_P_OFFSET: 1549.5,
Before: SUS-PR2_M1_OPTICALIGN_Y_OFFSET: 2812.8,
After: SUS-PR2_M1_OPTICALIGN_Y_OFFSET: 2808.5,
Before: SUS-SRM_M1_OPTICALIGN_P_OFFSET: 2509.1,
After: SUS-SRM_M1_OPTICALIGN_P_OFFSET: 2519.6,
Before: SUS-SRM_M1_OPTICALIGN_Y_OFFSET: -3801.7,
After: SUS-SRM_M1_OPTICALIGN_Y_OFFSET: -3810.4,
Before: SUS-OM1_M1_OPTICALIGN_P_OFFSET: -73.9,
After: SUS-OM1_M1_OPTICALIGN_P_OFFSET: -74.7,
Before: SUS-OM1_M1_OPTICALIGN_Y_OFFSET: 686.7,
After: SUS-OM1_M1_OPTICALIGN_Y_OFFSET: 686.1,
Before: SUS-OM2_M1_OPTICALIGN_P_OFFSET: -1460.3,
After: SUS-OM2_M1_OPTICALIGN_P_OFFSET: -1448.3,
Before: SUS-OM2_M1_OPTICALIGN_Y_OFFSET: -254.3,
After: SUS-OM2_M1_OPTICALIGN_Y_OFFSET: -307.4,
Before: SUS-OM3_M1_OPTICALIGN_P_OFFSET: -1095.0,
After: SUS-OM3_M1_OPTICALIGN_P_OFFSET: -1095.0,
Before: SUS-OM3_M1_OPTICALIGN_Y_OFFSET: -212.0,
After: SUS-OM3_M1_OPTICALIGN_Y_OFFSET: -212.0,
Before: SUS-OMC_M1_OPTICALIGN_P_OFFSET: 36.9,
After: SUS-OMC_M1_OPTICALIGN_P_OFFSET: 36.9,
Before: SUS-OMC_M1_OPTICALIGN_Y_OFFSET: 0.0,
After: SUS-OMC_M1_OPTICALIGN_Y_OFFSET: 0.0,
Before: SUS-ITMX_M0_OPTICALIGN_P_OFFSET: -104.4,
After: SUS-ITMX_M0_OPTICALIGN_P_OFFSET: -101.1,
Before: SUS-ITMX_M0_OPTICALIGN_Y_OFFSET: 109.2,
After: SUS-ITMX_M0_OPTICALIGN_Y_OFFSET: 109.3,
Before: SUS-BS_M1_OPTICALIGN_P_OFFSET: 97.4,
After: SUS-BS_M1_OPTICALIGN_P_OFFSET: 97.6,
Before: SUS-BS_M1_OPTICALIGN_Y_OFFSET: -396.5,
After: SUS-BS_M1_OPTICALIGN_Y_OFFSET: -396.3,
Before: SUS-ITMY_M0_OPTICALIGN_P_OFFSET: -1.5,
After: SUS-ITMY_M0_OPTICALIGN_P_OFFSET: -4.5,
Before: SUS-ITMY_M0_OPTICALIGN_Y_OFFSET: -20.1,
After: SUS-ITMY_M0_OPTICALIGN_Y_OFFSET: -19.1,
Before: SUS-ETMX_M0_OPTICALIGN_P_OFFSET: -35.8,
After: SUS-ETMX_M0_OPTICALIGN_P_OFFSET: -37.1,
Before: SUS-ETMX_M0_OPTICALIGN_Y_OFFSET: -146.7,
After: SUS-ETMX_M0_OPTICALIGN_Y_OFFSET: -146.6,
Before: SUS-ETMY_M0_OPTICALIGN_P_OFFSET: 159.2,
After: SUS-ETMY_M0_OPTICALIGN_P_OFFSET: 157.5,
Before: SUS-ETMY_M0_OPTICALIGN_Y_OFFSET: -165.7,
After: SUS-ETMY_M0_OPTICALIGN_Y_OFFSET: -165.1,
Before: SUS-TMSX_M1_OPTICALIGN_P_OFFSET: -93.1,
After: SUS-TMSX_M1_OPTICALIGN_P_OFFSET: -96.7,
Before: SUS-TMSX_M1_OPTICALIGN_Y_OFFSET: -96.4,
After: SUS-TMSX_M1_OPTICALIGN_Y_OFFSET: -98.7,
Before: SUS-TMSY_M1_OPTICALIGN_P_OFFSET: 75.5,
After: SUS-TMSY_M1_OPTICALIGN_P_OFFSET: 73.8,
Before: SUS-TMSY_M1_OPTICALIGN_Y_OFFSET: -265.9,
After: SUS-TMSY_M1_OPTICALIGN_Y_OFFSET: -267.7,

ALS X looks worse and ALS Y doesnt seem to change much at all.
Ground motion is falling.

Reverted back to a better time: 1414970755

TITLE: 11/06 Day Shift: 1530-0030 UTC (0730-1630 PST), all times posted in UTC
STATE of H1: Aligning
INCOMING OPERATOR: Tony
SHIFT SUMMARY:

Since there were issues with locking last night/this morning, the main activity of the day was tuning the PSL NPRO crystal temperature again (this was done yesterday during maintnenance).  

Attempted locking toward the end of the shift, but had some issues with ALSy---trans power has only been about 0.8 (earlier in the day we were at 0.9).  It also goes into stretches of troubles during locking.  Tony touched up the alignment and it was able to offload its alignment, but then there was a note about "waiting for PLL DIFF".  Currently trying another alignment.
LOG:

• 1508 lockloss Earthquake 
  • 1533 Initial Alignment started automatically
  • PMC mode hopping  made IMC locking tough.  Took H1 to DOWN/IDLE
  • 1746 Lockloss while holding at 10W
  • 1809 H1 taken to IDLE for PSL rack work (jason, vicky)
• 1602-1640 Quick job shadow tour for Michael (senior from Boardman area) (neil)
• 1645-1005 Camilla covering my tour while I took job shadow to fiber lab
• 1600-1707 Mitch back from FAMIS
• 1620-1647 Optics lab clean (karen)
  • Also MY, woodshop
• 1714-1725 CER checks (Robert)
• 1810-2040 PSL racks (jason, vicky)
• 1818-1822 LVEA (travis)
• 2059-2239 ground injection set-up (robert)
• 2150-2240 Tuning ALS/SQZ lasers after today's new PSL freq change (Vicky, Daniel)
• 2220-2229 Peak inside ISCT1 (corey)
• 2245 Initial Alignment started.
• 2310 Incoming EQ from Mariana Islands
• After alignment went for locking but there was also the EQ.  ALSy had troubles with locking.  Eventually felt the issue of aligning during the EQ could have caused some grief.  Right now Tony is running a new Initial Alignment to see if this helps out ALSy.

Closes FAMIS#28454, last checked 80607

CO2 trends looking good (ndscope1)

HWS trends looking good (ndscope2)

You can see in the trends when the ITMY laser was swapped about 15-16 days ago.

I've roughly copied the LLO configuration for the AS power monitor (that won't saturate after lock losses) and installed an additional photodiode in the AS_AIR camera enclosure. PD output goes to H1:PEM-CS_ADC_5_19_2K_OUT_DQ for now.

GiGE used to receive ~40ppm of the power coming into HAM6. I replaced the steering mirror in front of GigE with 90:10, the camera now receives ~36ppm and the beam going to the photodiode is ~4ppm. But I installed ND1.0 in front of the PD, so the actual power on PD is ~0.4ppm.

See the attached cartoon (1st attachment) and the picture (2nd attachment).

Details:

1. Replaced the HR mirror with 90:10 splitter (BS1-1064-90-1025-45P), roughly kept the beam position on the camera, and installed a Thorlabs PDA520 (Si detector, ~0.3AW) with OD1.0 absorptive ND filter in the transmission. I set the gain of PDA520 to 0dB (transimpedance=10kOhm).
2. Reflection of the GigE was hitting the mirror holder of 90:10, so I inserted a beam dump there. The beam dump is not blocking the forward-going beam at all (3rd attachment).
3. Reflection of the ND filter hits the black side panel of the enclosure. I thought of using a magnetic base, but the enclosure material is non-magnetic. Angling the PD to steer the reflection into the beam dump for GigE reflection is possible but takes time (the PD is in a inconvenient location to see the beam spot).
4. Fil made a custom cable to route power and signal through the unused DB9 feedthrough on the enclosure.  Pin 1 = Signal, Pin 6 = Signal GND, Pin 4 = +12V, Pin 5 = -12V, Pin 9 = power GND. (However, the power GND and signal GND are connected inside the PD.) All pins are isolated from the chamber/enclosure as the 1/2" metal post is isolated from the PD via a very short (~1/4"?) plastic adapter.
5. Calibration of this channel (using ASC-AS_C_NSUM) seems to be about 48mW/Ct.