After the watchdogs were reset a lightening strike caused a power glitch. GC UPS reported going into and off of battery power.
h1susauxh2 and h1susauxex went offline, turned out they were rebooting themselves and came back after a few minutes.
PSL is in a bad way, Ibrahim is calling for support.
The lights in my house flickered at the time I saw the sus-aux machines go down. We have been having a storm roll over us for the past hour, moving from Oregon northwards.
SWWDs for ETMY, ITMY and ITMX have tripped.
HWWD for ITMY has just tripped, its RMS is significantly higher than the others.
Strangely ETMX SWWD and HWWD have not come close to tripping.
Ibrahim, Jim, Dave:
SUS RMS have diminished below trip levels. Ibrahim is on his way to the CER to untrip the ITMY HWWD. Jim and I are his remote buddies.
To close this out, Ibrahim successfully reset the ITMY HWWD.
Lockloss due to an EQ that hit before EQ mode could activate. Seems to be either very local or very large - not on USGS yet.
This afternoon a 6.4 mag eq in Fiji provided another good opportunity to test the high asc gain eq mode. This time peak velocities were about 3.6 micron/s on peakmon, around 2 micron/s on the .03-.1hz blrms on the wall fom. We were out of observe for ~1hr, but we probably would have been down for at least 2hrs without the transition. Definitely one of the largest eqs we've ridden out, ever.
On Sept 4th we had a longer commissioning period to allow us to heat up OM2. The main goal was to use this to characterize the mode matching of the arm cavities to the OMC, but we also made some other interesting measurements.
Summary: heating up OM2 now costs us about 1% of optical gain, while it used to cost us 2%. Heating up OM2 also changed the SRCL offset needed to get flat squeezing significantly, and reduced the amount of squeezing that we could get (without adjusting psams).
The interferometer unlocked (86727) while Jennie Wright was running the DARM offset step script with OM2 cold, to get a measurement of HAM6 throughput and look at OMC refl before heating up OM2. As that link says, there wasn't an obvious connection between the DARM offset script which was in it's final steps (nearly back to normal) when the lockloss happened.
We turned on the OM2 heater while relocking after some back and forth, then had an commissioning caused lockloss while trying to recover. By the time we were relocked, OM2 was heated up according to thermistor 2, which is the thermistor who's timescale matched the timescale of optical gain changes in the past (see screenshot of June 2023 example). We also had a large earthquake while relocking, so we paused after power up and before going to nominal low noise, so we do not have tracking of the optical gain using pcal in the first 30 minutes of this thermalization.
The optical gain in this thermalization seemed to be fairly similar to the previous lock where OM2 was cold in the first hour. The change in optical gain between OM2 hot and cold was much smaller this time around, so we needed to see the full thermalization in order to see what the gain change was. We set the OM2 heater off 4 hours and 5 minutes after the power up, the attached screenshot shows a trend of optical gain during the previous thermalization while OM2 was cold, with a vertical cursor 4 hours 5 minutes into the lock. The horizontal cursors show where the optical gain was at 4 hours and once the thermalization was complete, the optical gain continued to increase by 0.2% after the first 4 hours. The next screenshot shows vertical cursors also at the time of power up and 4 hours later, and the horizontal cursors are the same as on the previous screenshot (OM2 cold). It seems that the optical gain was about 1.1% lower with OM2 hot than cold, although fitting these two thermalizations to an exponential might bring them closer by as much as 0.2%. Our current ring heater settings are 0W on ITMY, 1.5 W/segment on ETMY and 0.44W/segment on ITMX and 1W/segment on ETMX.
Since this is a different result than in the past times of OM2 changes, I've gone back to look at old times when we did this change. One possible explanation for the difference could be ring heater settings being different.
Once the OM2 heater was turned back on, the optical gain increased by nearly 1%, but the IFO lost lock before that thermalization finished. There was a 2% decrease in POP18 during the cool off and a 3 urad shift in SRM top mass.
While OM2 was hot, we did a few tests.
TITLE: 09/08 Day Shift: 1430-2330 UTC (0730-1630 PST), all times posted in UTC
STATE of H1: Earthquake
INCOMING OPERATOR: Ibrahim
SHIFT SUMMARY: We stayed locked the whole shift, 14 hours. We dropped obs to ride though a 6.4, we're still waiting to leave EQ mode.
LOG:
Start Time | System | Name | Location | Lazer_Haz | Task | Time End |
---|---|---|---|---|---|---|
14:18 | ISC | Corey | Optics lab/vac prep | N | JAC parts | 14:50 |
15:09 | FAC | Nellie | MidY | N | Tech clean | 15:53 |
15:11 | FAC | Kim | MidX | N | Tech clean | 15:36 |
16:32 | OPS | RyanC | Optics lab | N | Restart dust monitor | 16:35 |
17:20 | FAC | Nellie | H2 encl | N | Tech clean | 17:31 |
18:35 | FAC | Tyler, C&E | Vertex | N | Checkout firehydrant | 18:46 |
19:05 | FAC | Tyler, CeBEX contractor | MidY | N | CEBEX work | 23:29 |
19:59 | VAC | Travis | MidY | N | Parts pickup | 20:25 |
TITLE: 09/08 Eve Shift: 2330-0500 UTC (1630-2200 PST), all times posted in UTC
STATE of H1: Earthquake
OUTGOING OPERATOR: Ryan C
CURRENT ENVIRONMENT:
SEI_ENV state: EARTHQUAKE
Wind: 14mph Gusts, 8mph 3min avg
Primary useism: 0.42 μm/s
Secondary useism: 0.09 μm/s
QUICK SUMMARY:
IFO is in NLN as of 10:30 UTC (14 hr lock)
We are temporarily out of absorbing as we try to ride out a 6.4 EQ using ASC High Gain (new feature), alog 85740
After SEISMIC goes back to CALM, we'll turn off the high gain and go back to OBSERVING
Link to report here.
In the past, when heating up the OM2 heater, we have noticed that the low frequency sensitivity improves, for example alog 78652.
I wanted to make this comparison again, but we have seen that the squeezing performance can be variable, so I first chose to compare a no squeezing time with OM2 hot and cold.
It's also important to note that the calibration has likely changed with the hot OM2. Some of that can be corrected with the TDCFs. However, we saw that the required SRCL offset to minimize SRC detuning with OM2 hot was significantly different, alog 86737. This means that the sensing function is probably significantly different, causing some change in the calibration that is not compensated. We didn't take any calibration measurements with hot OM2, so we have no idea how much or how to compensate the calibration change.
With OM2 hot, the coherence of DARM with SRCL and MICH increased, although SRCL can explain most of the excess noise between the two times. Interestingly, the coherence of DARM with jitter decreased with OM2 hot. There is no significant change in the coherence with PRCL.
Here is a comparison of the cold and hot OM2 times, using GDS CALIB STRAIN CLEAN.
I performed a simple coherence subtraction of SRCL alone, and SRCL and MICH together. I checked that there is no significant coherence between SRCL and MICH.
Given the possible issue with the calibration, I am not certain how comparable the low frequency noise is. There is a small increase in the noise up to 30 Hz with OM2 hot, even with the above subtractions applied.
H1 ISI CPS Sensor Noise Spectra Check - Weekly Famis 26655
BSC high freq noise is elevated for these sensor(s)!!!
ITMY_ST1_CPSINF_H3
In 86589, Jeff points out mysterious noise seen in SRC2 Y CTRL between 1 and 3 Hz that is only seen when the SR3 estimator is fully on with the L to P contribution included.
To verify this, I plotted some other times with the estimators ON and OFF, and looking at those different times, I was able to confirm that the unknown increase in noise Jeff points out between 1 and 3 Hz is NOT caused by the estimator, but by some other noise source in passing.
Camilla, Sheila
We did a series of quick measurements related to filter cavity backscatter, a follow up with plots will come soon.
Injection for linear coupling (varies from day to day, we are repeating to see how much it changes, 1st screenshot):
Fringe wrapping (scattered amplitude seems slightly lower than in 2024 when moving ZM2, slightly higher when moving ZM5):
Open loop gain (also varies from day to day):
FC2 M1/M3 cross over:
Here's the plot of the fringe wrapping measurements in displacement units. It can be compared to a similar measurement made on ZM4 + 5 at LLO: 60856. Over email Peter asked some questions about the power levels needed to explain this.
Power level heading towards HAM7 from OFI:
The power on the DCPDs is 47mW, and there is 12pW retro-reflected off the filter cavity, so the total isolation provided by OFI + SFI2 + SFI1 is 2.5e-10 in power ratio, or 96dB. The OFI isolation ratio was measured to be 43dB in 79379. If this is true it would imply that one of the SFIs is providing less than the 30dB isolation assumed in T1800447, and we should have 2uW of carrier light headed towards SFI2.
Our readback of the 1% pick off of light from the interferometer heading towards SFI2, B:PD1 (OFI PD A) says that we have 0.03mW on it, meaning 3mW from the IFO going towards SFI2, about 1mW of this would be carrier based on (87114),which seems too high.
The responsivity of this PD was checked in 60284, and later double checked because it seemed low (the settings are still the same). The similar PD OFI PDB has a measured responsivity of 0.25A/W and the excelitas website lists a peak responsivity of 0.6A/W at 850nm for these PDs. (ffd-200h-si-pin) If we think that this calibration was mistaken and the real responsivity is more like OFI PD B, 0.25A/W, there is 0.72 mW of light from the OFI heading towards SFI2, ~240 uW of carrier, the OFI isolation would only be 23dB, and the SFIs must be providing something like 36 dB each.
Reflectivity:
If my interpretation of the fringe wrapping measurements into power are correct (12 nW of power is retroreflected from the path that includes ZM5), we are reflecting 50ppm of the carrier scattered toward HAM7 using the (recalibrated) 240uW value from OFI PDB, or 0.6% if we believe the isolation ratio measurement for the OFI and use the 2uW value. B:BS1 is a 1%, so the maximum reflectivitiy we could get from scatter in the B:PD1 path would be 0.01%. This means that the B:PD1 path can't explain the reflectivity needed if there is 2uW headed towards HAM7, and even if there is 240uW heading towards HAM7 this PD seems unlikely to explain the scatter, since it would need to reflect half the light that's incident on the PD. Camilla did alog the check of the alignment (and the beam dump catching the retro-reflection off this diode: 65006)
camilla.compton/Documents/sqz/templates/dtt/20250908_SQZdata.xml
and
attached.Type | Time (UTC) | Angle | DTT Ref |
No SQZ | 16:09:30 - 16:19:00 | N/A | ref 0 |
FIS SQZ (tuned for 1kHz) | 16:22:00 - 16:25:00 | (-)137.5 | ref 1 |
FIS Mid + SQZ (tuned to no sqz) | 16:26:30 - 16:29:30 | (-)165.0 | ref 2 |
FIS Mid - SQZ (tuned to no sqz) | 16:32:00 - 16:35:00 | (-)120.4 | ref 3 |
FIS ASQZ | 16:39:00 - 16:42:00 | (+)252.2 | ref 8 |
Mean SQZ (ADF off) | 16:42:30 - 16:45:30 | N/A | ref 9 |
FIS tuned for 100Hz (to look at thermal noise limits) | 16:52:00 - 16:55:00 | (-)119.5 | ref 10 |
FIS tuned for 100Hz +5deg | 16:55:30 - 16:58:30 | (-)124.2 | ref 11 |
FIS tuned for 100Hz -5deg | 16:59:00 - 16:02:00 | (-)113.8 | ref 12 |
We tuned FIS around 100HZ and then changed the SQZ angle +/-5deg, plot attached. Shiela thinks this could help us constrain thermal noise in the future.
Plot attached of today's data (SRCL offset at nominal -382) compared to last weeks while OM2 was hot (with SRCL offset tuned at -235). Solid lines are cold OM2, dashed lines are hot OM2. FIS is better with cold OM2 as expected.
We noticed that mean SQZ was different <100Hz with the OM2 hot vs Cold. This persisted if I changed the averages so wasn't caused by a glitch and also seemed to be increased looking at Sheila's 86736 data too. Changed SRCL offset to see if this was the cause but it didn't appear to be. Plot attached, so the cause is OM2.
Type | Time (UTC) | SRCL Offset | DTT Ref |
Mean SQZ (ADF off) | 16:42:30 - 16:45:30 | -382 | ref 9 |
Mean SQZ (ADF off) | 17:17:00 - 17:20:00 | -235 | ref 15 |
Mean SQZ (ADF off) | 17:08:30 - 17:10:00 | -100 | ref 13 |
Mean SQZ (ADF off) | 17:11:00 - 17:14:00 | 0 | ref 14 |
OPO Setpoint | Amplified Max | Amplified Min | UnAmp | Dark | NLG |
80 | 0.0395963 | 0.00050063 | 0.00170524 | -2.611e-5 | 22.9 |
Note for Operators, changing the SRCL offset put the THERMALIZATION guardian into error. This is fine.
Once the SRCL offset is back to nominal, just load the THERMALIZATION GRD and it's will go back to normal, I'm not sure what would happen if this was done early in the lock when the GRD was still ramping the offset though.
Mon Sep 08 10:07:09 2025 INFO: Fill completed in 7min 5secs
Gerardo confirmed a good fill curbside. TC-A became good again at 05:56 this morning and looks nominal in today's fill.
Gerardo inspected the TCs and suspects TC-A wiring had been moved by animal activity. Why it corrected itself this morning is a mystery.
J. Kissel After today's H1 SUS SR3 Pitch Estimator's inclusion of the Sus. Point L to M1 P feed forward from the HAM5 ISI GS13s (where we had mistakenly only installed Sus. Point P to M1 P) -- see LHO:86567, I now compare the times of ASC signals (using 0.02 Hz binwidth, 64 sec FFT chunks, 30 averages, and a Hanning window with 50% overlap): 2025-08-20 18:29 UTC - Both P and Y Estimators are OFF 2025-08-24 18:18 UTC - Both P and Y Estimators are ON, but for the P estimator, only the Sus. Point P to M1 P contribution is included in the GS13 FF 2025-08-26 22:00 UTC - Both P and Y Estimators are ON, and for the P estimator, both P to P and L to P contributions are included in the GS13 FF. I'm showing only the control signals, and only the ASC DOFs which are impacted by SR3: DHARD, MICH, SRC1, and SRC2; both pitch and yaw. In All DOFs, the 0.64 and 0.75 Hz modes that had been made worse with only the P to P model of suspension point contribution have now been restored to no-estimator levels. In some DOFs, the 1-10 Hz broadband motion is just barely improved, but enforces the conclusion that SR3 is only partially, if not 'not the dominate contribution' to the ASC signals. Here's a fun one for you -- look at SRC2 Y CTRL -- and look at how much the SRC2 *yaw* motion has changed from including the *longitudinal* suspension point contribution to M1 *pitch* top mass. #ThrowsHandsInAir But -- overall -- with the improvements and all design intent included -- the SR3 P and Y estimators slightly improve the ASC noise from 1 to 10 Hz. Great! As Oli notes in LHO:86551 comparing all of these different configurations from totally different days and times is dubious. We'll get "official" versions of all of these ON vs. OFF configurations on Thursday 8/28. I also attach the local estimator metrics for pitch described in LHO:86553, comparing "only Sus Point P to M1 P modeled contribution" against "P to P and L to P sus point to M1 contribution." That similarly shows that L to P contribution forms a good fraction of the signal needed for damping.
Great to see that the inclusion of the SUSpoint L to M1 P block makes a difference.
Unfortunately, the P2Y coupling is a wierd non-reciprocal coupling we were seeing on the measurements [See page 21 about the SR3 measurements from june after an OSEM calibration test]. The Pitch to Yaw transfer function is consistent with the conversion of pitch motion to observed yaw signals on the LF and RT OSEMs, this apparent motion gets turned into yaw feedback drive and creates the transfer function you see in the measurements linked.
Brian and I discussed it before and we had decided against adding a cross-term in the estimator to address it because it is both not well understood (at least we don't know why the LF and RT OSEMs see Pitch signals) , and because it is possible that we might only be able to address it if we commission the estimators in a fully serialized way, which would be even more time consuming for (probably) minimal benefit.
Depending on schedule, we can figure out if it is worth adding an M1 drive P to M1 Y estimator path, and probably commission a baby version of it with the measurements that Oli already took to see if it makes a difference.
I've confirmed in 86784 that the excess noise seen in the red trace between 1-3 Hz is not due to the SR3 Estimator having L2P compensation
Ibrahim is on his way to the CER MEZ to reset the PSL REFCAV high-voltage supply.
Back on.
Here are details of the power glitches due to the electrical storm Monday night. We had a large glitch at 21:51:26 followed 5 seconds later by a smaller glitch.