J. Kissel During today's Systems Call, it came up that there was scant documentation on the timing performance of the existing fast shutter system. A quick look through the aLOG showed some results from the 2016 era including examples like LHO aLOGs 29062, 28958, and 26263. Koji's LHO:29062 is probably the most conclusive, quoting (repeated here for convenience): "The fast mechanical shutter start blocking the beam at 1.7ms, reaches half blocking at 1.85ms, complete block at 2.0ms." Here, I take some modern data with what digital signals stored in the frames: [65 kHz] H1:OMC-PI_DCPD_64KHZ_AHF_DQ OMC DCPDs (down stream of the OMC Cavity) [4096 Hz] H1:ISI-HAM6_BLND_GS13Z_DQ Vertical GS13s on the HAM6 ISI (nominally calibrated into 1 nm/s, but I've scaled it to arbitrarily show up demonstratively on the OMC DCPD plot) [2048 Hz] H1:ASC-OMC_A_NSUM_OUT_DQ OMC QPD A SUM (up-stream of the OMC Cavity, but still down-stream from the fast shutter) [2048 Hz] H1:ASC-OMC_B_NSUM_OUT_DQ OMC QPD B SUM (""") [2048 Hz] H1:ASC-AS_C_NSUM_OUT_DQ AS_C QPD SUM (up-stream of the fast shutter) [16 Hz] H1:SYS-MOTION_C_FASTSHUTTER_A_STATE Slow-channel record of the logical state of the shutter [16 Hz] H1:YSY-MOTION_C_SHUTTER_G_TRIGGER_VOLTS Slow-channel record of the trigger PD voltage (which is AS_C) With these channels, I show three recent lock-losses. It seems like all of the photo-diode signals show a very long "turn off time," (of order ~1 [sec]) and are pretty un-reliable at precision estimates of shutter timing. This is likely a linear combination of - For the OMC DCPDs at least, there's an *additional* hardware "shutter" where the cavity's length actuator -- the OMC PZT -- are quickly railed to unlock the cavity after a lock-loss trigger, - For the OMC DCPDs at least, there's a non-negligible cavity ring-down time, - For OMC DCPDs and all the QPDs, impulse response of the photo-diode's readout electronics and anti-aliasing filters, and/or the However, the "clunk" of the shutter on the HAM6-ISI is quite obvious and precise, so I use the start of the impulse (a few samples after the transition from "no motion" to "large fast negative start of the clunk's ring-down") that as an upper-bound estimate of when the shutter is completely closed. But, with the imprecision of the [16 Hz] channels -- 62 ms -- it's tough to get anywhere. In short -- what's stored in the frames are a pretty bad metrics for precision timing of the fast shutter system. But anyways -- the upper limit of the time between the change of the logical state of the trigger and the HAM6 ISI GS13s registering a large kick is - 08:23:20 UTC :: 0.3125 (+/-0.0625) and 0.341064 (+/-0.000244) = 0.02856 [sec] = 28.5 [ms]. - 13:01:26 UTC :: 0.125 and 0.1604 = 0.0354 [sec] = 35.4 [msec] - 23:39:28 UTC :: 0.3125 and 0.328857 = 0.016357 [sec] = 16.4 [msec] I'll keep looking for better ways to increase the precision on this statement, but for now, we should still role with Koji's results from LHO:29062
In G2201762 > O3a_O3b_summary.pdf Niko and I showed in O3b, there was a subset of ~25 locklosses where the light fell off H1:ASC-AS_C_NSUM_OUT_DQ on the order of 1ms, where this usually takes ~30ms. There was none of these locklosses in O3a and although the analysis is not currently online, I haven't noticed any of these 1ms fast lcoklosses in O4.
These O3b "Fast" locklosses often had the light fall off POPAIR (shutter now closed in NLN) and IMC_TRANS in the same 1ms period, sometimes with the FSS signals oscillated beforehand, showing these locklosses may have been correlated to issues with the PSL system that were resolved after O3.
Ah HA! Thanks Camilla! Camilla's comment is only tangentially related, but is fruitful anyways! The O3B study she points to is researching lock losses that are dubbed "Fast lock losses" by the collaboration because they happen in under 1 [msec], but as the plots on page two of her linked study show, light "disappears" from the interferometer because the IMC is unlocking, NOT because the fast shutter has triggered. Camilla thought they were related to my aLOG about the fast shutter because of conversations with Rana suggesting that "if these fast locklosses release all of their energy to the dark port prior to the fast shutter firing, then we need to know, and make the fast shutter faster!" HOWEVER, this pointer reminds me of two more channels, [2048 Hz] H1:ASC_A_DC_NSUM_OUT_DQ The "DC" or "QPD" component of WFS A (down-stream of the fast shutter, but upstream of the OMC) [2048 Hz] H1:ASC_B_DC_NSUM_OUT_DQ The "DC" or "QPD" component of WFS B (down-stream of the fast shutter, but upstream of the OMC) Apparently, whatever's going on with the OMC QPDs and the OMC DCPDs (also downstream of the fast shutter) which seem to take a lot longer for light to dissipate, *doesn't* happen with the AS WFSs. So, these channels much more clearly show the cut-off of light. That being said, they corroborate well with the HAM6 ISI GS13s. The uncertainty still remains, though, on when the shutter gets the firing signal -- i.e. when does the shutter's trigger PD get enough voltage above threshold to trigger the shutter. For this we still only have the 16 Hz "SYS-MOTION" channels. And thus my conclusions about timing remain. Anyone know of a faster channel of the trigger PD?
During yesterday's (4/16) maintenance period, a Norco tech came to the site to inspect the 8 LN2 dewars that feed the cryopumps. Inspection report will be posted to Q2000008 once received.
The vacuum jacket pressures were also measured during inspection:
Dewar | Pressure (micron/mtorr) |
CP1 | 68 (gauge fluctuated may need replacing, lowest value recorded) |
CP2 | 26 |
CP3 | 68 |
CP4 (not in service) | 110 |
CP5 | 9 |
CP6 | 33 |
CP7 | 48 |
CP8 | 77 (gauge fluctuated may need replacing, lowest value recorded) |
Comparison between the last pressure check for all the dewar jackets: - CP1: Jun 26th, 2023: 7 mTorr; difference: 68-7=61 mTorr; speed of pressure growth: 61 mTorr / 302 days = 0.202 mTorr/day - CP2: Jun 26th, 2023: 5 mTorr; difference: 26-5=21 mTorr; speed of pressure growth: 21 mTorr / 302 days = 0.070 mTorr/day - CP3: Jun 16th, 2023: 4 mTorr; difference: 68-4=64 mTorr; speed of pressure growth: 64 mTorr / 312 days = 0.205 mTorr/day - CP4: no data, not in service - CP5: Jun 16th, 2023: 4 mTorr; difference: 9-4=5 mTorr; speed of pressure growth: 5 mTorr / 312 days = 0.016 mTorr/day - CP6: Jun 2nd, 2023: 5 mTorr; difference: 33-5=28 mTorr; speed of pressure growth: 28 mTorr / 326 days = 0.086 mTorr/day - CP7: Jun 30th, 2023: 4 mTorr; difference: 48-4=44 mTorr; speed of pressure growth: 44 mTorr / 298 days = 0.148 mTorr/day - CP8: Jul 8th, 2023: 5 mTorr; difference: 77-5=72 mTorr; speed of pressure growth: 77 mTorr / 290 days = 0.266 mTorr/day
Sheila, Naoki, Vicky, Camilla
As we continue to see the nominal SQZ angle change lock-to-lock (attached BLRMs). We edited SQZ_MANAGER to scan sqz angle (takes 120s) every time the SQZ locks, i.e. every time we go into NLN.
In SQZ_MANAGER we have:
We tested this taking SQZ_MANAGER down and back up, it went though SCAN_SQZANG as expected and improved the SQZ by 1dB, range improved by ~10MPc.
We'll want to monitor that the change as SCAN_SQZANG may not give us the best angle at the start of the lock when SQZ is very variable. We expect this won't delay us going into observing as only added 120s and ISC_LOCK is often still waiting for ADS to converge during this time.
I have removed this change of path by removing thew weighting as we can see last night SCAN_SQZANG at the start of the lock took us to a bad squeezing once thermalized.
We weren't seeing this changing angular dependence as much before 77133 with the older PSAMS settings (8.8V,-0.7V) or (7.2V, -0.72V). Current (7.5V,0.5V). We think we should revert to the older setting.
Ran a broadband and simulines calibration sweep at 15:30 UTC and successfully finished at 16:01 UTC.
Now going into planned Wednesday comissioning.
Start:
PDT: 2024-04-17 08:39:27.631946 PDT
UTC: 2024-04-17 15:39:27.631946 UTC
GPS: 1397403585.631946
End:
PDT: 2024-04-17 09:00:59.127599 PDT
UTC: 2024-04-17 16:00:59.127599 UTC
GPS: 1397404877.127599
2024-04-17 16:00:59,060 | INFO | File written out to: /ligo/groups/cal/H1/measurements/DARMOLG_SS/DARMOLG_SS_20240417T153928Z.hdf5
2024-04-17 16:00:59,066 | INFO | File written out to: /ligo/groups/cal/H1/measurements/PCALY2DARM_SS/PCALY2DARM_SS_20240417T153928Z.hdf5
2024-04-17 16:00:59,071 | INFO | File written out to: /ligo/groups/cal/H1/measurements/SUSETMX_L1_SS/SUSETMX_L1_SS_20240417T153928Z.hdf5
2024-04-17 16:00:59,075 | INFO | File written out to: /ligo/groups/cal/H1/measurements/SUSETMX_L2_SS/SUSETMX_L2_SS_20240417T153928Z.hdf5
2024-04-17 16:00:59,079 | INFO | File written out to: /ligo/groups/cal/H1/measurements/SUSETMX_L3_SS/SUSETMX_L3_SS_20240417T153928Z.hdf5
ICE default IO error handler doing an exit(), pid = 685800, errno = 32
TITLE: 04/17 Day Shift: 15:00-23:00 UTC (08:00-16:00 PST), all times posted in UTC
STATE of H1: Observing at 146Mpc
OUTGOING OPERATOR: Tony
CURRENT ENVIRONMENT:
SEI_ENV state: EARTHQUAKE
Wind: 11mph Gusts, 7mph 5min avg
Primary useism: 0.30 μm/s
Secondary useism: 0.12 μm/s
QUICK SUMMARY:
IFO is in NLN and OBSERVING
TITLE: 04/17 Eve Shift: 23:00-07:00 UTC (16:00-00:00 PST), all times posted in UTC
STATE of H1: Aligning
INCOMING OPERATOR: Ryan S
SHIFT SUMMARY: The wind was really bad during my shift and caused the time between the 23:39 LL and NOMINAL_LOW_NOISE to be 3.75 hours. We had a second lockloss at 06:44UTC and just finished an initial alignment.
LOG:
23:00 Detector in NOMINAL_LOW_NOISE and troubleshooting going on wrt sqz
23:34 Into Observing
23:39 Lockloss
- Relocking -
23:57 Lockloss from AQUIRE_PRMI
23:59 Lockloss from LOCKING_ALS
00:00 Started Inital Alignment
00:20 DIAG_MAIN message that ALSY polarization is above 20%
- I using Camilla's instructions(58773) to find the right screen, and went to follow the instructions there, but all I did was press ON and then press Restore like it said, but just by clicking those the ALSY polarization value went down to 7% and ALSX up to 12%, so without needing to adjust anything I pressed OFF.
00:22 Initial Alignment completed
00:40 Lockloss from ACQUIRE_DRMI_1F
00:43 Lockloss from FIND_IR
00:48 Lockloss from LOCKING_ALS
00:51 Lockloss from FIND_IR
- Sitting in DOWN for a bit
01:00 Trying relocking again
01:07 Lockloss from ACQUIRE_DRMI_1F
01:10 Lockloss from LOCKING_ALS
- Sitting in DOWN for a bit again
02:00 Trying to relock again again
- Wind still > 30mph
02:14 Started another Initial Alignment
- Went through CHECK_MICH_FRINGES and then ifo wanted to do CHECK_MICH_FRINGES again
02:40 Initial Alignment done
- Done relocking -
03:23 NOMINAL_LOW_NOISE
03:26 Observing
06:22 Lockloss
- Relocking -
06:44 I took us to initial alignment because we couldn't get past ACQUIRE_PRMI
07:00 Initial alignment done
Lockloss 04/17 06:22 for unknown reasons
After three hours of not being able to get past ACQUIRE_DRMI due to the high wind, we finally are making it up and are currently at MAX_POWER.
04/17 03:26 Observing
Closes FAMIS#26292, last checked 77145
Corner Station Fans (attachment1)
All fans are looking normal and within range.
Outbuilding Fans (attachment2)
MX_FAN1_370_1 is still jumping in noise like it's been doing for the last few weeks. These jumps in noise are still well within range.
All other fans are looking normal and are within range.
Lockloss 04/16 23:39UTC - IX saturation at lockloss
04/17 03:26 Observing
During this lockloss(attachment1), the QUAD L2 MASTER_OUTs had a sudden increase in amplitude ~3.5s before DARM and ETMX L3 MASTER_OUT started losing control, then the ifo seemed to regain control, only for the lockloss to happen 0.8s later.
The HASH_INT channel was updated at 16:00 and its new value was accepted into CDS SDF. These two channels were removed from h1calcs SDF by hand editing the snap file.
As a test that the cal_hash_ioc restores it values on startup, we restarted it at 16:30. CDS SDF didn't notice it had gone, the EDC connected channel counter dropped by 5 for about 15 seconds.
Shiela, Naoki, Rahul, Kar Meng, Terry
Same as yesterday (77188), we are again today having trouble locking the FC. Wind is again constant at 0-20mph. Can get green flashes but no locking, even with FC feedback turned off, VCO locking also fails.
Rahul changed the M1 coil driver state on FC1 and FC2 from state 1 (usually only used in TFs) to state 2: IFO nominal for other triples. State 2 contains a low pass filter.
Rahul took FC2 P and L transfer functions, look healthy and same as 66414.
Rahul took FC2 OSEMINF spectrums and checked ther health, as previously had issues with FC1 BOSEMS (72563). Can see the 0.3 to 0.4Hz peak, Rahul's not worried about it but we could check old data for this peak.
Jim found that the HAM8 ISI has a resonance at the same place as FC2, peak at 0.375Hz see attached. He edited a gain and the motion seemed to improve enough to lock the FC.
During this time Ibrahim, Oli and I had followed ObservationWithOrWithoutSqueezing wiki and edited all the SQZ guardian code nominal states and accepted no squeezing sdfs. We then reverted these changes once the FC locked.
From HAM8 summary pages, I don't see this 0.36 Hz peak between Dec15 - Jan15. Peak is basically exactly where FC2_L is oscillating in yesterday's screenshot. Since Jan 15 2024, the peak looks intermittently there or gone, pretty variable. Maybe exciting this peak is related to wind? Or maybe this is all totally unrelated to wind.. I don't think this was an issue in O4a, maybe something changed after Jan 15.
Seems like another broken GS13 on HAM8, this time a horizontal sensor. I took some driven measurements looking at the l2l cps to gs13 transfer functions and the H1 cps to gs13 tfs is lower than the other 2 sensors by about 2x, see first attached image. This affects the stability of the blend cross-over, which changes the gain peaking in the blends. I've compensated for now with a digital gain, but this may not work for long.
I tried compensating with a digital gain in the calibration INF filters for the ISI, this seems to have improved things, shown in the second image. Top subplot is the M3 pit witness for FC2, second line is the gain I adjusted, third line are LOG BLRMS for the X, RZ and RX GS13s on HAM8. X and RX don't improve much, but the RZ motion improves a bit after changing the gain. Fourth line is the RZ cps residual, which is much quieter after increasing the gain to compensate for the suspected low response of the H1 GS13.
To add to Vicki's comment, the peaks behavior seems complicated, it started at .6hz in January, then some time around March it moved down to its current frequency ~.37hz. Lots of days missing from the summary pages in that time, so it's hard to track. The transience of the peak is also consistent with broken seismometers we've seen in the past. The gain tweak I put in may not be a stable fix.
SDFs that were accepted for observing w/ sqz
FYI - FRS ticket 31005 is tracking the 1/2 gain GS-13
Lately it's been very difficult to fit an efficient SRCL feedforward filter, as reported many times by Camilla et al. (76993). Here I'm trying to figure out why. Spoiler alert: I don't have an answer yet.
The main problem with the SRCL FF filter (see first plot), is that the transfer function to fit has a large phase rotation, that looks basically like a phase advance (the opposite of a delay) of about 2 ms. This is very large, and being an advance, it can't be realized in a precise and simple wasy digitally.
First observation: we can fit a pretty good SRCL FF if we allow for unstable poles, i.e. poles with positive real parts (see second plot) Of course this is not something that can be implemented in the real time system. The fit ends up having a unstable complex pole at about 420 Hz and about 5 Hz. I have no intepretation for the origin of those poles, and they might very well be only a way to reproduce a phase advance (think of the Padé approximation for phase delays).
So the question is: what is the origin of this large phase rotation? It's not seen at LLO, for example see 70548
Second observation: this phase advance appeared after we switched the LSC FF from ETMX (full chain) to ETMY PUM. The third plot compares the MICH and SRCL feedforward to be fit in two cases: an old measurement when the FF was going to ETMX, and a more recent measurement with the FF going to ETMY PUM only. For both MICH and SRCL the orange traces (FF to ETMY) show a phase advanced with respect to the blue traces (FF to ETMX). For some reasons I don't fully understand, this rotation is more problematic for SRCL than for MICH, although fitting MICH has also been more difficult and the MICH FF is relevant at lower frequencies than SRCL, so maybe the phase advanced isn't that problematic.
Looking at the measurement of the MICHFF to DARM and SRCLFF to DARM, one can see that there seems to be an additional phase delay in the FF path through ETMY PUM with respect to the FF path through ETMX full chain. Since this transfer function is at the denominator when computing the ratio SRCLtoDARM/SRCLFFtoDARM that gives use the LSC FF to fit, this seems to explain the additional phase advance we observe.
The ETMY PUM L2 lock filter bank contains a "QPrime" filter module that compensates partially the additional 1/f^2 due to the actuation from L2 instead of L3. This filter however doesn't seem able to explain this additonal phase delay.
I'm now suspicious that there might be something wrong or mistuned in the ETMY L2 drive, maybe a whitening filter missing or not functioning properly or not properly compensated?
It would be worth doing a quick test in the next commissioning time with full IFO locked: inject some white noise on ETMX L2 L and ETMY L2 L and comapre the two transfer functions to DARM. In theory they should be equal, except for a sign difference. If they're not, then there must be something wrong with ETMY, since we're using ETMX L2 to lock without issues.
This is a comparison of the LHO LSC FF and LLO LSC FF. The difference in the absolute scale might eb due to normalizations, but the SRCL FF does not show the large phase advanced visible at LHO
Maybe mistery solved...
The ETMY L2 DRIVEALIGN L filter bank has a "L2L3LP" filter engaged, whiel the corresponding ETMX L2 DRIVEALIGN L filter bank does not. This filter seems to be the origin of the phase rotation. At least it explains part of the phase rotation.
Anybody knows why this filter is engaged in ETMY? Should be turn it off and retune the LSC FF?
We should turn this filter off when we engage the FF (assuming it's needed some time during lock acquistion, to be checked) and retune the LSC FF. When we do that, we should reduce the excitation amplitude and reshape it, taking into account the filter we turned off.
Gabriele, Camilla. This ETMY_L2_DRIVEALIGN_L2L filter is used while locking in TRANSISTION_FROM_ETMX (when we control DARM on EY) and then again when the LSC FF is turned on in LOW_NOISE_LENGTH_CONTORL, plot attached. To not need to change the sensitive TRANSISTION_FROM_ETMX state we should turn the filter off with ISC_LOCK before turning the LSC FF's on. Will need to retune the LSC FF's (from scratch starting with both MICH and SRCL FF off, and adjusting the excitation to take this L2L3LP filter into account).