TITLE: 01/23 Eve Shift: 21:00-0600 UTC (1300-2200 PST), all times posted in UTC
STATE of H1: Commissioning
OUTGOING OPERATOR: TJ
CURRENT ENVIRONMENT:
SEI_ENV state: CALM
Wind: 21mph Gusts, 14mph 3min avg
Primary useism: 0.04 μm/s
Secondary useism: 0.20 μm/s
QUICK SUMMARY:
Tj is out early & I'm starting Eve shift starting now.
H1 is currently in Nominal_Low_Noise and Comissioning.
The Calibration team is running some OMC tests and we will return back to Observing around 22:00 UTC.
TITLE: 01/23 Day Shift: 1530-0030 UTC (0730-1630 PST), all times posted in UTC
STATE of H1: Commissioning
INCOMING OPERATOR: Tony
SHIFT SUMMARY: We are currently finishing up few minor commissioning items and a calibration measurement and then we will be headed into observing. Two lock losses during my shift, one from the calibrators and one most likely from some view port work. Relocks were straight forward.
LOG:
Start Time | System | Name | Location | Lazer_Haz | Task | Time End |
---|---|---|---|---|---|---|
17:16 | SAFETY | LAZER HAZ (\u2310\u25a0-\u25a0) | LVEA | !!!YES!!! | LVEA = LASER HAZARD! | 16:35 |
16:35 | FAC | Kim | Opt Lab | n | Tech clean | 16:57 |
17:55 | FAC | Kim | MY | n | Tech clean | 18:59 |
18:12 | PEM | Robert | LVEA | YES | Setup viewport power metering | 18:47 |
18:15 | VAC | Richard, Ken | EX | n | Look at compressor electrical | 18:47 |
18:49 | ISS | Keita, Rahul, Mayank, Sivananda, Jennie | Opt Lab | n | ISS array prep | 20:36 |
19:41 | PEM | Robert | LVEA | yes | VP pictures near BSC3 | 20:31 |
After the CAL team changed the OMC digital phase in 82413, the SQZ at the start of the lock went through an excursion much larger than usual, all the way to 5dB of ASQZ before settling around -3.5dB of SQZ, plot. We often have a SQZ excursion at the start of the lock but it rarely gets above 0dB. We are unsure if it makes sense that the OMC change would effect the SQZ like this or we were just unlucky.
I paused SQZ_MANGER and took SQZ_ANG_ADF to DOWN. I think tuned H1:SQZ-CLF_REFL_RF6_PHASE_PHASEDEG for the best SQZ and adjusted H1:SQZ-ADF_OMC_TRANS_PHASE to get H1:SQZ-ADF_OMC_TRANS_SQZ_ANG to zero, effectively setting the setpoint of the servo. Adjusted from -138 to -128 sdf. We may need to change this again or revert before going back to observing if the SQZ isn't good with a more thermalized IFO.
Also used this time to reduce the HAM7 rejected SHG power. Enabling (not moving) the picos unlocked SQZ which is surprising.
The supposition of *how* the change in digital anti-aliasing might have impacted the ADF / SQZ loop is as follows: - The actuation / excitation of the ADF / SQZ tuning system is a single line driven into the ADF's VCXO at 322.0 Hz. - That ADF field beats against the IFO field, which is influenced by the DARM control loop. - The new digital AA filter causes -4.5 deg phase loss (and an increase in amplitude of 0.1%) at 322.0 Hz, and changes the DARM open loop gain in that same way. - Thus the 322 Hz DEMOD of the IFO vs. SQZ beatnote field that's picked off at 3.125 MHz needs a phase adjustment. If that (I don't really know what I'm talking about) model of what's happening is happening, I would have expected the ADF SQZ DEMOD phase to need exactly 4.5 [deg] of phase change, much like the OMC LSC SERVO's DEMOD phase needed changing at it's modulation frequency (see LHO:82413). Camilla's main log here suggests a (-138) - (-128) = 10 [deg] phase shift. I very much welcome other mechanisms/models of what has happened if this change in SQZ behavior is a result of the OMC DCPD digital filter change.
Once we'd been locked for 4 hours, I again tweaked the SQZ angle by finding the angle ether side of good SQZ and going to the middle the adjusting ADF phase, diff attached, so that the total phase change since the OMC changes is the 4deg that Jeff predicted.
SQZ at 1kHz+ still isn't as good as I remember so we touched the OPO temp while in observing as in 80461, no change needed.
Reverted back to -128deg ready for reverting CAL team to revert thier changes.
E. Goetz, J. Kissel, L. Dartez In previous aLOGs (see, e.g., LHO aLOG 82405), we had to decimate the 524 kHz data offline in order to evaluate the improvement of TEST channels with changes to anti-alias filtering. We expected to see a reduction in artifacts with the addition of 1 extra 65-16k decimation filter. Attached is a figure showing before and after the ratio of ASDs calculated in DTT from the DCPD A0 channel (not the TEST A channels). This figure shows some improvements (though perhaps hard to see visually) and introduces more questions, especially comparing to a plot like in LHO aLOG 82405, attached here as well. Statistics: Bins above 1% before = 33416 Bins above 1% after = 30273 Bins above 1% before, f < 2000 Hz = 9011 Bins above 1% after, f < 2000 Hz = 8362 Mean before = 1.1087 Mean after = 1.0651 Mean before, f < 2000 Hz = 1.0756 Mean after, f < 2000 = 1.0495 So we do see that the number of bins above 1% has gone down as expected (good), but the raw number of bins above 1% is much different than our expectations. Figure 1 simply seems far noisier than Figure 2. What is the cause of this? It would seem to imply that the IOP downsampling is not simply grabbing 1 value for every 32 samples in a consistent manner, or perhaps the way DTT grabs and exports the PSD data? I'll have to keep digging, but this seems strange
This may be improved by using a the double precision version of diaggui, 'diaggui_test', creates much less noisy ASDs, especially at higher frequencies.
In the attached image, single precision ASD is on the left and double precision is i on the right.
There may be a DTT export precision issue at play here with the ASD as Erik suggests. I wanted to carry out a time series analysis offline, so I exported all of the data before and after for the 16k (H1:OMC-DCPD_A_OUT_DQ) and 524k (H1:OMC-DCPD_A0_OUT) channels. Then I computed the PSD of the 524k channel and 16k channel, plus downsampling the 524k channel and computing the PSD. Then I plot the ratio of the 16k PSD over the 524k PSD (cut off to the 16k Nyquist) to inspect the data for excess noise before and after the addition of the extra 65-16k downsampling filter. I don't understand the red curve, but the blue curve seems reasonable, as well as the black and grey curves. The blue curve shows excess noise that is then suppressed by the additional filter seen in the absence of large ratio values in the black and gray curves. This result shows that the extra filtering is helpful, but until we can push a new calibration, we'll have to hold off adding it in.
I have added whitening and dewhitening filters to the appropriate esd to 28 bit dac filters for the glitch limiting I posted about here. Filters can be accessed from the 28 bit dac test screen called DAC TEST, under the WD tab on the sitemap. Filters aren't engaged, locking has been a challenge this morning and I'm not sure when the filters should be engaged. I also need to try to figure out what the limit should be. I will try to see if we can fit a test in during a commissioning window next week.
Whitening filters are in the L3_ESD_{U/L}{L/R} filters, on the input column of the DAC TEST medm, limits should get applied in those filter banks as well. Dewhitening filters are in the ETMX_18_2_28_CHAN_1/2/3/4 filters in the output row on the bottom of the screen.
Filters I installed are shown in the attached image.
L. Dartez, E. Goetz, J. Kissel, T. Shaffer After we killed the lock stretch by turning on the extra 16 kHz anti-aliasing filter (LHO:82412) -- we found that the OMC wouldn't lock after 4 to 5 attempts during the next lock acquisition attempt. We turned on the 16 kHz AA filter early in the lock acquisition sequence "it would just work" and really -- thinking the cause of the lock loss was the loss of phase margin in the DARM loop. However after seeing the abnormally large number of failed OMC attempts, we suspected the new filter again. Then we realized -- the extra AA filter will cause phase loss at the 4.19 kHz OMC LSC dither line, and thus the OMC LSC DEMOD needs to be rephased to account for it. The magnitude / phase of the 65k to 16kHz AA filter at the 4.19e3 Hz dither line frequency is 1.0837 [ct/ct] / -77.2 [deg]. As such, we adjusted the H1:OMC-LSC_PHASEROT from 56 deg to 56 [deg] - 77 [deg] = -21 [deg], and the OMC "locked right up." (We assume that an 8% increase in the OMC LSC dither line signal would only be *good* for the OMC locking, but this will be confirmed with others later.) We are now in Nominal Low Noise with the extra AA filter on, and have been for 8 minutes (and the many minutes prior that it takes to get from transitioning to DC READOUT and getting to Nominal Low Noise). I've accepted the two changes in the safe and OBSERVE SDFs for the h1omc and h1iopomc0 front-end models.
Screenshots of SDF accepting. h1iopomc0 model's safe and OBSERVE files are linked to the same file, /opt/rtcds/userapps/release/cds/h1/burtfiles/h1iopomc0/safe.snap. h1omc model's safe and OBSERVE files are linked to /opt/rtcds/lho/h1/target/h1omc/h1omcepics/burt/OBSERVE.snap -> /opt/rtcds/userapps/release/omc/h1/burtfiles/h1omc_OBSERVE.snap /opt/rtcds/lho/h1/target/h1omc/h1omcepics/burt/safe.snap -> /opt/rtcds/userapps/release/omc/h1/burtfiles/h1omc_down.snap
Thu Jan 23 10:11:46 2025 INFO: Fill completed in 11min 43secs
Gerardo confirmed a good fill curbside. TCmins [-79C,-77C] OAT (0C,32F). delta-temp trip 10:11:53
J. Kissel, E. Goetz, L. Dartez The lock loss at 2025-01-23 16:41:17 UTC (08:41 PDT Thursday morning) was a a result of our first attempt to turn ON the additional 65k to 16k digital AA filter (see LHO:82404 and references therein). Out of the utmost precaution we (via command line) performed what we do all the time (via script) for a analog whitening filter change: - via command line, ramped all DARM error signal over to DCPDB by simultaneously changing the gain the 16 kHz filter banks (H1:OMC-DCPD_A_GAIN and H1:OMC-DCPD_B_GAIN) from A:1.0 and B:1.0 to A:0.0 and B:2.0 with a ramp time of 10 seconds. - switched ON the second copy of the 65k to 16k "Dec16k" filter in FM10 in the 524 kHz filter bank for A, H1:OMC-DCPD_A0 - command line ramped all DARM error over to DCPDA, from A:0.0 and B:2.0 to A:2.0 and B:1.0 with a ramp time of 10 seconds... ... and it was most of the way through that 10 second ramp back to the new filter configuration of DCPDA that we lost lock. We're going to try again, but this time have the new AA filter configuration on already during lock acquisition.
TITLE: 01/23 Day Shift: 1530-0030 UTC (0730-1630 PST), all times posted in UTC
STATE of H1: Observing at 156Mpc
OUTGOING OPERATOR: Ibrahim
CURRENT ENVIRONMENT:
SEI_ENV state: CALM
Wind: 12mph Gusts, 10mph 3min avg
Primary useism: 0.02 μm/s
Secondary useism: 0.19 μm/s
QUICK SUMMARY: Locked for almost 3 hours, two auto relocks over night. No alarms this morning. Planned commissioning and calibration this morning from 1630-2000UTC.
TITLE: 01/23 Eve Shift: 0030-0600 UTC (1630-2200 PST), all times posted in UTC
STATE of H1: Observing at 155Mpc
INCOMING OPERATOR: Ibrahim
SHIFT SUMMARY:
H1 has been locked and Observing for just under 8 hours.
It's been a quiet night.
No locklosses, but No events either though.
Looking for the latest In-Lock Sus Charge files i find that last ones were made on Jan 7th and already alogged 82163 .
cdsws25: ls /opt/rtcds/userapps/release/sus/common/scripts/quad/InLockChargeMeasurements/rec_LHO -lt | head -n 6
total 527
-rw-r--r-- 1 test_user controls 160 Jan 7 07:58 ETMX_12_Hz_1420300733.txt
-rw-r--r-- 1 test_user controls 160 Jan 7 07:50 ETMY_12_Hz_1420300262.txt
-rw-r--r-- 1 test_user controls 160 Jan 7 07:50 ITMY_15_Hz_1420300244.txt
-rw-r--r-- 1 test_user controls 160 Jan 7 07:50 ITMX_13_Hz_1420300243.txt
-rw-r--r-- 1 test_user controls 160 Dec 17 07:58 ETMX_12_Hz_1418486333.txt
Since I thought I remember us being locked this past Tuesday morning I checked to see if the SUS_Charge Guardian ran and it looks like it didn't run, but we were actually locked?
I don't see a reason why it wouldn't have run. It looks like since the h1guardian1 machine reboot ont he 14th it hasn't run. Looking at the code it wait for exactly 07:45:00 PT. Maybe it missed that exact second for some reason? That said, the EXECTIME channel for that node shows 0, so I would expect it to catch that second. I've reran SUS_CHARGE through INIT and we'll see if it does it next Tuesday. If not, perhaps we change this to have a >1 second buffer on start time.
TITLE: 01/23 Day Shift: 1530-0030 UTC (0730-1630 PST), all times posted in UTC
STATE of H1: Observing at 154Mpc
INCOMING OPERATOR: Tony
SHIFT SUMMARY: Planned commissioning time today that focused on a PR2 spot move. There was a lock loss during this spot move and we decided to revert the move. Recovery was a bit challenging, but pico hysteresis or similar could be the cause. Read more below. One side effect of the picoing from the PR2 move, is that the ALS camera spots are slightly different. Some of the clipping that we would see on ALSY is no longer there and ALSX now has some in the top left corner.
LOG:
Start Time | System | Name | Location | Lazer_Haz | Task | Time End |
---|---|---|---|---|---|---|
17:16 | SAFETY | LAZER HAZ (\u2310\u25a0-\u25a0) | LVEA | !!!YES!!! | LVEA = LASER HAZARD! | 16:51 |
16:01 | FAC | Kim | Opt Lab | n | Tech clean | 16:24 |
16:33 | PEM | Robert | LVEA | yes | Viewport beam spot measuring | 17:26 |
18:42 | FAC | Kim | MX | n | Tech clean | 19:30 |
19:02 | VAC | Janos, tourer | EX, MX | n | Tour | 20:51 |
19:30 | PEM | Robert | LVEA | yes | Closing up viewports | 20:00 |
21:25 | PCAL | Tony | PCAL Lab | local | PCAL lab work | 23:50 |
23:31 | ISS | Keita, Rick, Jennie, Mayank, Sivananda | Opt Lab | n | ISS array |
|
TITLE: 01/23 Eve Shift: 0030-0600 UTC (1630-2200 PST), all times posted in UTC
STATE of H1: Observing at 155Mpc
OUTGOING OPERATOR: TJ
CURRENT ENVIRONMENT:
SEI_ENV state: SEISMON_ALERT
Wind: 2mph Gusts, 1mph 3min avg
Primary useism: 0.04 μm/s
Secondary useism: 0.20 μm/s
QUICK SUMMARY:
All systems seem to be working well. (Execpt that Dust monitor)
Just transitioned into Earthquake mode for a 5.8 M earthquake, hopefully we can ride it out.
Sheila, Jenn{e,ie}, Robert
Continuing efforts to find out how to minimise the beam from PR2 clipping on the scraper baffle, as investigated in alogs #[77870, 77968, 77988, 81329].
At the start Sheila and Jenne agreed we should try to find the two extrema where the beam going from PR2 to PR3 clips the scraper baffle and the one going from PRM to PR2 clips the scraper baffle.
Sheila measured the PR2 Y2L gain by minimising the transfer function from PR2 yaw position to PRCL_OUT, while injecting a line at 30Hz as in [LHO alog #82251] entry.
New P2L: -0.36 from the measurement I did the other week.
New Y2L: -6.25
Now the aim was to move the spot on PR2 to find where each beam hitting it clips the PR2 scraper baffle.
Move PR3 in negative yaw while monitoring LSC-POP_A_LP_NORM (pop power) and PR2 inmon on M1 to check ASC is not changing much to ensure we do not unlock the IFO. Every 13 PR3 microradians is 0.5mm.
We stepped 96 uradians to 68 microradians on PR3 yaw and corrected pitch down every time we dipped too low on LSC-POP or PWR_CIRC, every 1 microradian or so jenne moved picomotor A_8 (the one that aligns to both the ALS PDs and the LSC-POP PDs) by -50 counts to bring back the LSC POP alignment.
I measured our new Y2L to be -5.75 gain at this new value (moved 1 mm according to Jenne's script). Robert looked at the beam reflected off the baffle to the viewport at this point as a check of the power in it relative to our nominal position for the PR2 beam spot.
We kept going after this point but lost lock after moving about 8.5 microradians.
ETMX glitch, and it looks like it was glitching for a tens of seconds before we lost lock - shot from lock lost tool.
Interestingly, ALSX was having issues staying locked after this lock loss. See attached for an example.
J. Kissel, E. Goetz, L. Dartez As mentioned briefly in LHO:82329 -- after discovering that there is a significant amount of aliasing from the 524 kHz version of the OMC DCPD signals when down-sampled to 16 kHz -- Louis and Evan tried a versions of the (test, pick-off, A1, A2, B1, and B2) DCPD signal path with two copies, each, of the existing 524 kHz to 65kHz and 65 kHz to 16 kHz AA filters as opposed to one. In this aLOG, I'll refer to these filters as "Dec65k" and "Dec16k," or for short in the plots attached "65k" and "16k." Just restating the conclusion from LHO:82329 :: Having two copies of these filters -- and thus a factor of 10x more suppression in the 8 to 32kHz region and 100x more suppression in the 32 to 232 kHz region -- seems to dramatically improve the amount of aliasing. Recall these filters were designed with lots of compromises in mind -- see all the details in G2202011. Upon discussion of applying this "why don't we just add MOAR FIRE" option 2xDec65k and 2xDec16k option for the primary signal path, there was concerns about - DARM open loop gain phase margin, and - Computational turn-around time for the h1iopomc0 front-end process. I attach two plots to help facilitate that discussion, (1st attachment) Bode plot of various combinations of the Dec65k and Dec16k filters. (2nd attachment) Plot of the CPU timing meter over the weekend, the during in which these filters were installed and ON in the 4x test banks on the same computer. For (1st) :: Here we show several of the high-frequency suppression above 1000 Hz, and phase loss around 100 Hz for a couple of simple combinations of filtering. The weekend configuration of two copies of the 65k and 16k filters is shown in BLACK, the nominal configuration of one copy is shown in RED. In short -- all these combinations incur less than 5 deg phase loss around the DARM UGF. Louis is going do some modeling to show the impact of these combinations on the DARM loop stability via plots of open loop gain and loop suppression. We anecdotally remember that the phase margin is "pretty tight," sub-30 [deg], but we'll wait for the plots. For (2nd) :: With the weekend configuration of filters, with eight more filters (the copies of the 65k and 16k, copied 4 times in each of the A1, A2, B1, B2 banks) installed and running, the extremes of CPU clock cycle turnaround time did increase, from "never above 13 [usec]" to "occasionally hitting 14 [usec]" out of the ideal 1/2^16 = 15.26 [usec], which is rounded up on the GDSTP MEDM screen to be an even 16 [usec]. This is to say, that "we can probably run with 4 more filters in the A0 and B0 banks," though that may necessarily limit how much filtering can be in the A1, A2, B1, B2 banks for future testing. Also, no one has really looked at what happens to the gravitational wave channel when the timing of the CPU changes, or gets near the ideal clock-cycle time, namely the basic question "Are there glitches in the GW data when the CPU runs longer than normal?"
Unless a DAC, ADC, or IPC timing error occurs, then a long IOP cycle time will not affect the data. The models have some buffering, so can even suffer an occaisional long cycle time beyond the maximum without affecting data.
h1iopomc0 average cycle time is about 8 us (see the IO Info button on the GDS TP screen), so can probably run with a consistent max cycle time well beyond 15 us without affecting data.
Here, the 1st attachment, a two week trend of H1IOPOMC0 front-end (DCUID 179) CPU timing activity during this time periods flurry of activity in installing, turning on, and using lots of different combinations of (relatively low Q, low-order, low SOS number) filters. While the minute trend of the primary "CPU_METER" channel is creeping up, the "CPU_AVG" has only incremented up once to 8 [usec] that Erik quotes above. FYI these channels can be found displayed on MEDM in the IOP's GDS_TP screen, following the link to "IO Info" and looking at the "CPU PROCESSING TIMES" section at the top middle. See second attachment.
Bright beam spot on HAM3 ballast mass baffle moves with ITMY compensation plate yaw motion
We have been looking for the source of the scattering noise that varies with the ITMY compensation plate yaw setting (80499). I recently searched for beam spots in the HAM3 area that move as CPY is yawed, using movies that I took from both the MC2 camera viewport and the PR2 camera viewport near HAM2. Anamaria and I had done some of this before (77631) but this time I recorded the CP movements on the audio track of the movies for a more precise correlation. And I also modified the movies in iMovie to increase visibility of faint spots. Figure 1 shows that I did find a spot that moved precisely with CPY Yaw settings (link to movie clips: https://youtu.be/FDdNDPoQadU ). The spot appears to be on a ballast mass baffle (see Fig. 1), which is not angled as much as the scraper baffle (which I think the beam is supposed to fall on (Alena's slides)) and may thus retroreflect more light.
Mystery beam spot on HAM3 spool piece comes from ITMX direction, not HAM2 direction
I had previously misinterpreted the pattern of light on edges and bellows of the HAM3 spool piece as suggesting that the mystery beam spot (78192) was coming from the HAM2 direction . More recently I found that there was light on the HAM3 side of the MC baffle that had a similar interference pattern and was consistent with being part of the mystery beam spot (Figure 1). The light on the HAM3 side of the baffle was visible when looking through the viewport for the PRM camera at a high angle. Thus, the beam is most likely coming from the ITMX direction, travelling close to the –Y wall of the beam tube.
One possibility is that it actually comes from ITMX, either scattered light from ITMX or scattered light from the back side of MC2 reflecting off of ITMX. Figure 3 shows these suggested paths and a picture taken from the point of view of the beamspot on ITMX that shows that there is a clear path to the site of the mystery beam spot. I think that the cartoon shows that it would be worth using a real model to determine if these paths are possible.
I checked to see if the beamspot on the eye baffle moved or modulated when I actuated the compensation plates. I made movies as I moved the two compensation plates more than 600 microradions in pitch and yaw, but, unlike the spot on the ballast mass baffle, I did not see any modulation or motion of the spot on the eye baffle.
Somehow I used the wrong photo in Figure 3 - it is actually a photo from the beamsplitter. The correct photo from CPx is used in the corrected version of Figure 3 attached here.