MX, EX, MY all received approximately 130 gallons of glycol between the 3. Line pressures were set to their desired levels.

T. Guidry E. Otterman C. Soike

Sheila, Tony, Jenne, Camilla. Details in 78828.

At 14:44 UTC h1sush2b suffered a timing error and had to be restarted. 

The timing error happened when work was being done in the same rack in the CER, see https://alog.ligo-wa.caltech.edu/aLOG/index.php?callRep=78823.

The timing error was a "long cycle" of 50 milliseconds.

Started well pump to top off fire water tank. Pump will run for 4 hrs and auto off.

TITLE: 07/03 Day Shift: 1430-2330 UTC (0730-1630 PST), all times posted in UTC
STATE of H1: Corrective Maintenance
OUTGOING OPERATOR: Oli
CURRENT ENVIRONMENT:
    SEI_ENV state: CALM
    Wind: 16mph Gusts, 12mph 5min avg
    Primary useism: 0.04 μm/s
    Secondary useism: 0.08 μm/s
QUICK SUMMARY:
DIAG_MAIN says : CONNECTION ERRORS, See SPM DIFFS for dead channels.
CDS_OVERVIEW shows:
H1OPSUSHA is clearly having a hardtime as described in Oli's alog: 78823 . Erik is saying that this is a bad 18 bit DAC.C

Erik, Oli

Got a call from IFO_NOTIFY - there was ground motion that caused the HAM2 ISI (11:56:26 UTC), SEI SW (11:56:28 UTC), and Hepi (11:56:31 UTC) watchdogs to trip. Along with/causing this (or by coincidence?) is an error with H1IOPSUSH2A, and the GDS screen was showing 'LTDS' in red. The front end needs to be either power-cycled, or possibly a card replaced, so Erik will be heading into site in a bit to see about fixing the errors. I manualed ISC_LOCK into IDLE, and either me or the DAY operator will get the ifo back up once the CDS issue is resolved.

TITLE: 07/03 Eve Shift: 2300-0800 UTC (1600-0100 PST), all times posted in UTC
STATE of H1: Lock Acquisition
INCOMING OPERATOR: Oli
SHIFT SUMMARY: Spent most of the shift down from the high winds. Currently relocking at DHARD_WFS

Lock 1: Alignments and PRC1 bypass

• 00:46 UTC NORCO came through the gates
• After the IA finished I held us in down and ran the PSL rotation stage calibration following RyanS instructions/alog. Relocking afterwords we did 1 round of PRMI after we initially couldn't get DRMI but we lost lock at the same point in the code (ISC_DRMI) 3 times in a row right after PRC1 went on. Jenne got us past this by taking the loop out alog78818
• 01:46 UTC back to NLN, where I had to accept some SDF diffs, PSL diffs
• 01:50 UTC Observing
• 02:53 UTC lockloss

Lock2: Windy, 42mph Gusts, 33mph 5min avg

• Spent a while in Environment (Wind) ops mode
• 06:40 I noticed the wind looked to be dropping (20mph gusts, ~10mph 5min avg) so I started trying again, ALS is doing better now but not much luck on DRMI/PRMI
• 07:25 started an IA after 2 rounds of CHECK_MICH didn't give anything on PRMI, finished at 07:46 UTC

General:

• MC2, PR2, PRM cameras are blue from Roberts viewport work
• DIAG_MAIN messages
  • EXT-ALERT: stand down query failure, it seems related to the leap second issue alog78724, it's run on cdsioc0 (Tagging CDS). I tried restarting the process which didn't fix it
    • "RuntimeError: Error loading leap file: https://www.ietf.org/timezone>"
  • PSL_FSS_TPD refcav transmission is low (PSL)
  • ISCTEX fiber beam shutter is open, since around 07/02/24 22:30 UTC

LOG:                                                                                                                                  

I did some trending of the some LSC and ASC signals during the 3 DRMI locklosses from earlier. Here we have the 1st, 2nd, and 3rd lockloss and an example of a good lock from the last long lock before maintenance. I can see that the LSC INMON signals looked maybe twice as strong now compared to before. ASC_PRC1_YAW looks especially different than it did last night, ASC_PRC1_PIT_OUTMON seems to have changed sign to negative from positive. The PRM OSEMS don't look particularly different, a good lock from yesterday, DRMI LL from today.

https://ldas-jobs.ligo-wa.caltech.edu/~lockloss/index.cgi?event=1404010437

The wind has picked up a decent amount since the last lock aquisition so ALS will most likely have trouble staying locked. Gust are  >= 40 mph

[Jenne, Sheila, Tony]

The PMC swap work earlier today (alog 78813) resulted in a slight shift of the alignment of the beams coming out of the PMC. 

After Ryan and Jason finished getting the ref cav aligned and locked, the IMC alignment looked poor.  I was able to mostly get it back by hand-moving the sliders for the PZT at the PSL periscope.  I touched MC2 a tiny bit, and then the IMC was able to lock.  I lowered the IMC WFS thresholds (eg  H1:IMC-IMC_TRIGGER_THRESH_ON and _OFF) so that it would take over alignment.  Once the alignment was pretty nearly finished, I used the IMC_LOCK guardian to offload the IMC WFS.  I saved in the safe.snap file for IMCASC the PZT offsets that had been offloaded.

In parallel, Sheila worked on the ALS system.  The initial goal was to check and adjust the PSL pickoff portion of the COMM beatnote, however Sheila noted that the ALS Xarm couldn't lock, since the end station PLLs weren't getting enough light from the PSL.  Sheila lowered the threshold of H1:ALS-C_FIBR_INTERNAL_DC_LOW from 0.05mW to 0.02mW, and also lowered H1:ALS-X_FIBR_LOCK_FIBER_LAUNCHLIM from 0.3 to 0.2 .  After this, the ALS Xarm was able to lock, and Sheila went out to ISCT1 and got the COMM beatnote up to about -1 dBm.  We then convinced ALS Yarm to lock after lowering H1:ALS-Y_FIBR_LOCK_FIBER_LAUNCHLIM from 0.3 to 0.2.  Sheila also changed H1:SQZ-FIBR_TRANS_DC_LOW from 0.2 to 0.05 mW and H1:SQZ-FIBR_LOCK_FIBER_LAUNCHLIM from 0.3 to 0.15, after which she was able to get the squeezer all locked up, so it seems like the squeezer should work fine when we get to that point this evening. 

Attached is the SDF screenshot that Sheila took for the squeezer thresholds.  The other ALS thresholds were also accepted in their safe.snap files.  All of these will need to be accepted in the Observe.snap SDFs in order for us to get to Observing. 

I helped the initial alignment a bit, by moving IM4 and PR2 a bit for the Input_align, and then moving PRM for PRC_align.  After that, initial alignment seemed to finish on its own. 

Particularly since we have been having ALS beatnote issues lately (see alog 78806 for some notes), we will almost certainly want to go into the PSL tomorrow to tweak the alignment of the optic that directs the beam to the fiber for the fiber distribution box, so that we can undo all these threshold changes.  Jason makes the good point that the longest part of doing that tweak will be garbing up for going into the PSL, so it should be quite easy.

After we finished up IA I ran the Rotation stage calibration following alog76890 and ran the python script to generate PSL_rotStageCalib_02July2024.txt (attached) and I accepted the new calibration values in SDF.

TITLE: 07/02 Day Shift: 1430-2330 UTC (0730-1630 PST), all times posted in UTC
STATE of H1: Preventive Maintenance
INCOMING OPERATOR: Ryan C
SHIFT SUMMARY:

Nitrogen truck came at 15:40 UTC
15:50 UTC  Internet connection to outside networks went down.
16:04 UTC Internet was restored.

Water truck arrived.

PSL team Installed PMC in the PSL enclosure.

Concrete truck left at 19:45 UTC

Ryan S. and Jason come out of the PSL ~ 22:40 UTC.
IMC , PMC and the Rotation Stage Calibration  and alignments must be.
Jenne and Sheila took care of the IMC & PMC and took the IFO to Locking Green arms to do so.
While they were working on X arm I requested Y arm to Increase Flashes to save some time.

To Do before Locking:
We have since started an Initial Alignment and we must wait for that to finish before the Rotation stage Calibration can be done because the IMC needs to be unlocked to make that happen.
To do the Rotation Stage Calibration follow the Bullet points found here:
https://alog.ligo-wa.caltech.edu/aLOG/index.php?callRep=76890

LOG:

J. Oberling, R. Short, J. Driggers

Summary

I'll get a more detailed alog in tomorrow, right now I am exhausted so a summary it is.

We swaped our in-service PMC, SN 007, with our spare, SN 004, to correct what appeared to be a very slow build up of loss in the PMC (time scale of several months).  The swap itself went well with no issues (some very slight yaw alignment required to lock the new PMC), but we ran into a problem upon PMC recovery.  The new PMC was presenting the exact same issue as the old PMC, in that we were measuring a high visibility but a markedly lower power throughput.  We could find no cause for this: control loop looked fine, PMC optics were clean (had 1 optic that had to be cleaned pre-install, but all looked great afterwards), our locked voltage on the locking PD was well above the PD's dark voltage.  After much investigation and deliberation, we decided to continue recovering the new PMC so we could get the IFO back up and running.  We carefully upped the power incident on the PMC in stages until we had reached full power (measured with our water cooled power meter at 128.1 W).  At this point we were measuring a visibility of 89.6% and a power throughput of only 82% (105.1 W transmitted with the ISS OFF).  Our locking PD locked voltage is roughly -0.061 V and its unlocked voltage is roughly -0.453 V; the dark voltage on this PD is -0.015 V.  The UGF is ~1.1 kHz with a phase margin of ~53.9 deg.

We then found we could not lock the FSS RefCav, and upon inspecting that path found the alignment to be off.  So the PMC's mounting scheme did not exactly maintain the post-PMC alignment.  Already being almost 3 hours past the end of maintenance we did a quick recovery of the FSS while Jenne and Sheila worked to recover the IMC and the beam alignment on ISCT1 (since the post-PMC alignment shifted slightly this changed the beam alignment into the IMC and on ISCT1, which are both many meters downstream of the PMC).  The FSS will have to be tuned up next week, as we were only able to get a RefCav TPD of just over 0.7 V.  We forgot to check the ALS/SQZ pickoff before leaving the enclosure, but found it was reading too low once we were out; as a quick fix Sheila lowered the thresholds for locking both ALS and SQZ, and I will go back into the enclosure in the morning to correct the beam alignment into the pickoff.

There is still optimization to do on this new PMC, but it's up and running for now.  We will watch the PMC Refl signal over the next week to see if it exhibits the same behavior; if it does then the problem likely lies elsewhere, we'll see what happens over the next week.  Regardless, we will have to go into the enclosure next week to do some PMC optimization, re-tune the FSS path, and see if we can figure out what the root issue here is.  More to come (including a more detailed alog of today's work).

TITLE: 07/02 Eve Shift: 2300-0800 UTC (1600-0100 PST), all times posted in UTC
STATE of H1: Preventive Maintenance
OUTGOING OPERATOR: Tony
CURRENT ENVIRONMENT:
    SEI_ENV state: MAINTENANCE
    Wind: 9mph Gusts, 5mph 5min avg
    Primary useism: 0.01 μm/s
    Secondary useism: 0.06 μm/s
QUICK SUMMARY:

• We're still relocking following maintenance
  • Running an initial alignment currently