The helicopter can be clearly heard in the LVEA on H1:PEM-CS_MIC_LVEA_BS_DQ

This data has been posted to the DCC here: T2400394.

Attached updated plot. It seems that these commissioning changes made the range better 10-30Hz, maybe look 50-90Hz. No SQZ is slightly better right at 20Hz.

Also attache is range BLRMs, showing main change is 20-29Hz region.

Running the range comparison script comparing the time of the best range early this morning (11:30UTC) to a time a few hours later (16:15 UTC) and currently (20:30 UTC) using 15 minutes of data. It looks like SQZer differences and violins, since its seen in broadband high and low frequency, and I can see the ~500Hz line rising from ETMY 1 and ITMY 5/6 for the first time span. That line is reduced in the following check, after new damping settings are put in. A line at 300Hz also looks to have grown slightly.

The blue traces are the reference good range time from the beginning of the lock.

Tagging OpsInfo

So once Rahul is happy with the new Violin Mode settings for ETMy 01 & ITMy 05/06, Operators will need to enter his NEW settings by hand (this can be done any time after the DAMP_VIOLINS_FULL_POWER [566] state.  For clarity, also attaching screenshots with the filter banks in question circled in light blue:

• ETMy 01 = ETMy MODE1
• ITMy 05/06 = ITMy MODE5

Promised details from the final day of the NPRO swap.

Summary

• Measured mode matching lens positions to update PSL table as-built drawing
• Recovered both amplifiers without issue, final total output power of ~140.2 W
• Locked PMC, adjusted alignment, returned amplifier pump diode currents to previous operating levels; Amp1 out now ~68 W, Amp2 out now ~139 W, PMC Trans ~104 W, PMC Refl ~24 W
  • Have some PMC mode matching work to do, will do in future maintenance periods
• Locked ISS, had weird issue with PD values in MEDM (see details below), found it was due to NPRO noise eater needing a reset
• Locked FSS, had ~0.84 V TPD with no IMC
• Scanned NPRO temperatures for mode hopping, settled on NPRO crystal temperature of 23.96 °C
• Measured stabilization system TFs and set gains; all gains unchanged except FSS Common gain changed from 15 dB to 14 dB

Mode Matching Lens Positions

We first measured the new positions of mode matching lenses L02 and L21, I'll update the As-Built table layout with the new values.  The new positions:

• L02: 1251.5 mm
• L21: 1137.5 mm

Amplifier Recovery

With the previous day's work resulting in the NPRO being ready for amplifier recovery, this is where we started our recovery work.  Amplifier recovery was straightfoward.  As a reminder, we first measure the power into the amp and the unpumped power out, to assess our intial alignment.  Then we raise the amp pump diode operating current in 1A intervals until we get to the locking point, adjusting beam alignment into the amplifier at each step in current (so alignment follows the formation of the thermal lenses in the amplifier crystals).  For Amp1 we had 1.612 W input and an unpumped output of 1.252 W.  This is 77.6% throughput, which is above our requirement of 65% throughput before starting to pump the amplifier, so we proceeded with recovery of Amp1 (see Amp1 columns in below table).  We finished Amp1 recovery with ~70.2 W output, so we calibrated the Amp1 power monitor PD to this value (was off by a couple Watts).  We then lowered the light level in the Amp1/Amp2 path (using the High Power Attenuator (HPA) after Amp1) and checked alignment, all looked good.  We increased the Amp2 seed with the HPA to ~1.8 W and checked the unpumped output from Amp2.  This measured at ~1.5 W, which is ~83% throughput and above our 65% threshold, so we proceeded with recovery of Amp2.  This also went very well, see the Amp2 column in the below table; we had ~64.0 W output from Amp2 with an ~1.8 W initial seed power (the power was bouncing between 63.9 W and 64.0 W).  With Amp2 fully powered we then used the HPA to increase the Amp2 seed to max, which resulted in ~140.2 W output from Amp2.

Stabilization System Recovery

PMC:  After lunch we began recovering the PSL stabilization systems in order: PMC, ISS, FSS.  We began by using the HPA after Amp2 to lower the power to ~100 mW to check our beam alignment up to the PMC.  All looked good here so we increased the power to max and measured the power incident on the PMC at ~129.4 W.  We then toggled the PMC autolock to ON and it locked without issue.  We needed to use the picomotor-equipped mirrors (M11 and M12 on the layout) to tweak the beam alignment into the PMC, but were only able to get ~102.0 W in transmission with ~27.0 W in reflection.  This is 9 W more than we had after our last NPRO swap, indicating that we really need to take a look at PMC mode matching; since we still had more than enough power to deliver to the IFO we decided to defer the mode matching work to a later Tuesday and continue with PSL recovery.  The PMC Trans and Refl monitor PDs were calibrated to the newly measured values; they were pretty close to begin with, but were still 1-2 W different than our power meter was measuring.  We then returned the amplifer pump diode currents to their previous operating values (9.0 A and 8.8 A for Amp1, 9.1 A and 9.1 A for Amp2), which lowered Amp1 output power from ~70 W to ~68 W and Amp2 output power from ~140 W to ~139 W; this also changed PMC Refl to ~24 W and PMC Trans to ~104 W, indicating our beam is better matched to our current mode matching solution at these pump diode currents.

ISS:  Moving on to the ISS, we first measured the amount of power in our 1st order diffracted beam (the "power bank" for the ISS).  With the loop off and the AOM diffracting a default of 4% we expect ~5.7 W in this beam, and this is what we measured.  AOM alignment was good, so moved on to the ISS PDs in the ISS box.  A voltmeter get plugged into the DC Out ports on the ISS box and a HWP inside the box is adjusted until PD voltages read ~10.0 V.  We did this, but noticed the DC voltage reading on the ISS MEDM screen was much higher, ~12.5 V for PDA and ~13 V for PDB.  We tried to lock the loop and, as expected with PD voltages that high, the loop thought it needed to removed more power from the beam and ran the diffracted power up really high.  We immediately unlocked the ISS and began looking into what could be the problem, as the MEDM reading on the ISS PDs generally matches the voltmeter reading (I say "generally matches" because, for reasons unknown to me, the ISS does not use the DC out from its PDs, it uses a Filter out and "derives" the DC and AC PD voltages from that).  The PDs appeared to be working correctly, and we found no large dark voltages that would indicate a PD failure/malfunction.  When we unplugged the Filter output the PD reading in MEDM began to slowly climb, but when we blocked the light onto the PDs the MEDM reading went to zero.  Looking back at trends we saw the PDs behaving as expected before this most recent NPRO swap, only reading these higher values in MEDM with the relock of the PMC an hour or so prior.  I had never seen this behavior in the past, so wasn't quite sure where the problem could be.  Thinking maybe something had gone wrong in either the ISS inner loop servo box or maybe something in the CER, we called Fil and asked if he could take a look at the CER electronics for the ISS while we moved on to FSS recovery.  It was at this point we found the problem.  When the FSS MEDM screen was opened the first thing we saw was one NPRO noise eater (NE) light green, and the other red.  The green light was our NE enable monitor, indicating that the NE toggle was switched ON in the PSL software; the red light was our NE monitor, which reads the Check output from our NPRO monitor PD that indicates whether or not the NPRO's relaxation oscillation was being supressed.  So we had the NE toggled ON but it was clearly not working, so we toggled it off and on again.  The NE monitor went green and the channel monitoring the relaxation oscillation indicated it was working properly, and the ISS PD values on the ISS MEDM screen now read the correct values.  So I learned that we have another measure of if the NE is working or not, the ISS PD readings on the MEDM screen go higher.  Trending back, the NE stopped working at ~16:58 PST on Thursday, right before Ryan and I left the enclosure for the day.  We'll keep an eye on this, as right now it's not clear why the NE turned off.  At this point everything looked good for the ISS so we moved on to the FSS.

FSS:  For the FSS, we first tried to see if the RefCav would lock with the autolocker; it would not.  We had to manually tune the NPRO temperature to find a RefCav resonance, one was found with a slider value of ~ +0.06.  The temperature search ranges were adjsuted to this new value and we tried the autolocker again.  While we could see clear flashes the autolocker would not grab lock for some reason.  The FSS guardian was paused so it would stop yanking the gains around upon lock acquisition, but this did not help, the autolocker refused to hold lock for some reason.  So I did it manually (from the FSS manual screen, manually change NPRO temperature until a resonance flashed through, then really quickly move the mouse up to turn the loop on; if the loop grabs go back to the FSS MEDM screen and turn on the Temperature loop, if not then turn the loop off and try again), which worked.  With a locked RefCav we measured a RefCav TPD voltage of ~ 0.84 V.  The RefCav Refl spot looked pretty centered so we did not do any alignment tuning.  This completed our work in the enclosure so we cleaned up, turned the computers and monitors off, left the enclosure, and put it into Science mode.  Outside, we scaned the NPRO for mode hop regions and measured TFs of the stabilization loops.

NPRO Temperature Scan

Now outside the enclosure we set up to scan the NPRO temperatures to check for mode hopping.  We took the HV Monitor output from the PMC fieldbox to trigger an oscillscope on the PZT ramp and used the PMC Trans PD to monitor the peaks.  We set the PMC's alignment ramp to +/- 7.0 V and a 1 Hz scan rate, and monitored the peaks as we tuned the NPRO crystal temperature.  We used the slider on the FSS Manual MEDM screen, which gives us a total range of approximately +/- 0.8 °C (0.01 on the slider changes the NPRO crystal temperature by roughly 0.01 °C and the slider goes from -0.8 to +0.8).  Since we were close to zero on slider, sitting at ~ +0.07, we started by moving lower (which reduces the NPRO crystal temperature); our starting crystal temperature, as read at the NPRO power supply front panel, was 24.22 °C.  We got all the way to the negative end of the slider, which gave a crystal temperature of 23.38 °C, and did not see any evidence of mode hopping on the way down.  Heading back up we finally started to see early evidence of mode hopping near the top end of the slider; we could clearly see a new forest of peaks show up in the PMC PZT scan and one of them started to grow noticebly as the temperature was further increased.  This mode hop region began at a crystal temperature of 24.76 °C, and the slider maxed out at 24.91 °C.  At this point we still had not fully transitioned through the mode hop region, but we did have a peak starting to grow very large indicating that we were almost there.  Since we saw no evidence of mode hopping by making the temperature colder, we went back to our starting place of 24.22 °C and then reduced the temperature further to the next RefCav resonance below that; this resulted in a crystal temperature of 23.96 °C at a slider value around -0.17.  Again I had to lock the RefCav manually, as the autolocker did not want to grab and hold lock.  With all of the stabilization systems locked we moved on to TF measurements.

Transfer Functions and Gains

We started with the PMC.  With the current settings we have a UGF of ~1.6 kHz and 60° of phase margin, see first attachment.  Everything looked good so we left the PMC alone.

For the ISS, we have a UGF of ~45 kHz and a phase margin of 37.5°, see second attachment.  Again, everything look normal here so we left the ISS alone.

For the FSS, we started with a Common gain of 15 dB.  Everything looked OK, but since we had seen some potential zero crossings that like to hide in the longer range scans we did a "zoomed in" scan from 100 kHz to 1 MHz.  Sure enough, there were a couple peaks in the 500 kHz to 600 kHz range that were pretty close to a zero crossing.  We lowered the Common gain to 14 dB to move them away from the potential crossing; the third attachment shows this zoomed in area with the Common gain at 14 dB, and the peaks in question are clearly visible.  With this Common gain we have a UGF of ~378 kHz with ~60° of phase margin, see fourth attachment; we took this TF out to 10MHz to check for any weirdness at higher frequency and did not see anything immediately concerning.  To finish we took a look at the PZT/EOM crossover (around 20 kHz) to set the Fast gain.  The final attachment shows this measurement (a spectrum of IN1) at a Fast gain of 5 dB; this looks OK so we left the Fast gain as is.

At this point the NPRO swap was complete, the PSL was fully recovered, and we handed things over to the commissioning team for IFO recovery.  We still need to look at PMC mode matching, and will do so during future Tuesday maintenance periods.  This closes WP 12210.

This afternoon TJ and I placed pieces of damping and elastic foam under the wheels of both CO2X and CO2Y TCS chillers. We placed thicker foam under CO2Y but this did make the chiller wobbly so we placed thinner foam under CO2X.

Unfortunately, I'm not seeing any improvement of the Crab contamination in the strain spectra this week, following the foam insertion.

Attached are ASD zoom-ins (daily and cumulative) from Nov 24, 25, 26 and 27.

This morning at 17:00UTC we turned the CO2X and CO2Y TCS chiller off and then on again, hoping this might change the frequency they are injecting into DARM. We do not expect it to effect it much we had the chillers off for a ling period 25th October 80882 when we flushed the chiller line and the issue was seen before this date.

Opened FRS 32812.

There were no expilcit changes to the TCS chillers bettween O4a and O4b although we swapped a chiller for a spare chiller in October 2023 73704. 

Between 19:11 and 19:21 UTC, Robert and I swapped the foam from under CO2Y chiller (it was flattened and not providing any damping now) to new, thicker foam and 4 layers of rubber. Photo's attached. 

Thanks for the interventions, but I'm still not seeing improvement in the Crab region. Attached are daily snapshots from UTC Monday to Friday (Dec 2-6).

I changed the flow of the TCSY chiller from 4.0gpm to 3.7gpm.

These Thermoflex1400 chillers have their flow rate adjusted by opening or closing a 3 way valve at the back of the chiller. for both X and Y chillers, these have been in the full open position, with the lever pointed straight up. The Y chiller has been running with 4.0gpm, so our only change was a lower flow rate. The X chiller has been at 3.7gpm already, and the manual states that these chillers shouldn't be ran below 3.8gpm. Though this was a small note in the manual and could be easily missed. Since the flow couldn't be increased via the 3 way valve on back, I didn't want to lower it further and left it as is.

Two questions came from this:

1. Why are we running so close to the 3.8gpm minimum?
2. Why is the flow rate for the X chiller so low?

The flow rate has been consistent for the last year+, so I don't suspect that the pumps are getting worn out. As far back as I can trend they have been around 4.0 and 3.7, with some brief periods above or below.

Thanks for the latest intervention. It does appear to have shifted the frequency up just enough to clear the Crab band. Can it be nudged any farther, to reduce spectral leakage into the Crab? 

Attached are sample spectra from before the intervention (Dec 7 and 10) and afterward (Dec 11 and 12). Spectra from Dec 8-9 are too noisy to be helpful here.

TJ touched the CO2 flow on Dec 12th around 19:45UTC 81791 so the flowrate further reduced to 3.55 GPM. Plot attached.

The flow of the TCSY chiller was further reduced to 3.3gpm. This should push the chiller peak lower in frequency and further away from the crab nebula.

The further reduced flow rate seems to have given the Crab band more isolation from nearby peaks, although I'm not sure I understand the improvement in detail. Attached is a spectrum from yesterday's data in the usual form. Since the zoomed-in plots suggest (unexpectedly) that lowering flow rate moves an offending peak up in frequency, I tried broadening the band and looking at data from December 7 (before 1st flow reduction), December 16 (before most recent flow reduction) and December 18 (after most recent flow reduction). If I look at one of the accelerometer channels Robert highlighted, I do see a large peak indeed move to lower frequencies, as expected.

Attachments:
1) Usual daily h(t) spectral zoom near Crab band - December 18
2) Zoom-out for December 7, 16 and 18 overlain
3) Zoom-out for December 7, 16 and 18 overlain but with vertical offsets
4) Accelerometer spectrum for December 7 (sample starting at 18:00 UTC)
5) Accelerometer spectrum for December 16
6) Accelerometer spectrum for December 18