Lockloss @ 01:50 UTC - link to lockloss tool
No immediately obvious cause. We had an incoming EQ alert at the same time, so I thought an S-wave could've hit and caused the lockloss, but no noticable ground motion was seen at the time.
TITLE: 06/25 Day Shift: 1430-2330 UTC (0730-1630 PST), all times posted in UTC
STATE of H1: Observing at 145Mpc
INCOMING OPERATOR: Ryan S
SHIFT SUMMARY: Currently Observing and have been Locked for almost 2 hours.
LOG:
14:30 Detector already unlocked and maintenance started
19:37 Took detector to DOWN and then started an initial alignment
- Couldn't see ALSX at all, ended up running the dither align scripts (TMSX, ITMX, and ETMX) and then using the quick sweep from the ETMX dither align script to find a good alignment for ETMX
20:47 Initial alignment done, relocking
21:37 NOMINAL_LOW_NOISE
22:00 Observing
22:22:06 - 22:22:15 Quick jump out and back into Observing due to misclick
23:20 - 23:30 The second Norco truck came down the Xarm and by the corner station on the way back from a CP fill at MX, causing some ground motion tagging Detchar
Start Time | System | Name | Location | Lazer_Haz | Task | Time End |
---|---|---|---|---|---|---|
14:10 | FAC | Kim | EX | n | Tech clean | 15:15 |
14:11 | FAC | Karen | EY | n | Tech clean | 15:06 |
14:14 | VAC | Gerardo | LVEA | n | Drilling holes | 17:15 |
14:15 | CDS | Marc, Erik | EX | n | Install DAC card in H1SUSEX | 15:02 |
15:08 | EE | Fil, Camilla | LVEA | yes | Swap sqz chassis | 15:30 |
15:09 | VAC | Jordan | MY EY | n | Turbopump checks | 18:02 |
15:10 | VAC | Isaiah | LVEA | n | Joining Gerardo | 16:47 |
15:21 | FAC | Tyler | LVEA-WB | n | Craning in West Bay, going to HAM Shack | 18:37 |
15:22 | CDS | Marc, Erik | EX | n | Undoing H1SUSEX work | 16:19 |
15:23 | IAS, PSL | Jason, Christina | LVEA-WB | n | Setting up FARO/PSL property check (Christina out ~16:00) | 17:14 |
15:31 | SAF | Camilla | LVEA | yes | Transition LVEA to SAFE | 15:45 |
15:41 | VAC | Janos | LVEA | n | Joining Gerardo and Isaiah | 16:46 |
15:42 | PCAL | Francisco, Rick | PCAL Lab | yes(local) | PCAL things | 16:36 |
15:45 | FAC | Chris | EX | n | Filter checks | 19:50 |
15:47 | FAC | Karen, Kim, Nellie | HAM Shack | n | Tech clean | 16:22 |
15:52 | EE | Fil | Roof | n | Checking roof Camera hardware | 17:12 |
15:55 | SQZ | Terry | Optics Lab | yes(local) | SHG | 20:05 |
15:57 | SUS | Jim | CR | n | SRM offloading, filter change | 18:43 |
16:20 | PEM | Robert | LVEA | n | Setting up for injections | 18:18 |
16:23 | SQZ | Kar Meng | Optics Lab | yes(local) | SHG | 20:05 |
16:36 | PCAL | Francisco, Rick | End X | YES | PCAL Beam Movement | 18:51 |
16:39 | TOUR | Jeff + GWANW Tour | LVEA | n | GWANW tour | 17:45 |
16:47 | VAC | Gerardo, Isaiah | HAM Shack | n | Testing cables | 17:45 |
16:56 | TOUR | Camilla + tour | LVEA | n | tour | 18:17 |
16:57 | TOUR | Sheila + tour | LVEA | n | GWANW tour | 18:17 |
16:59 | FAC | Kim, Karen | LVEA | n | Tech clean (Kim out 18:45) | 18:22 |
17:06 | FAC | Christina | OSB Recieving | n | Forklift pallet | 17:45 |
17:12 | TOUR | TJ + Tour | LVEA | n | GWANW tour | 17:57 |
17:14 | EE | Fil | LVEA | n | Fixing humidity sensor | 17:46 |
17:14 | IAS | Jason, Ryan C, Tyler | LVEA | n | FARO measurements (Jason, Ryan C out 18:58) | 18:57 |
17:16 | Corey, intern | EX, EY | n | Looking at vegetation along arms | 18:16 | |
17:46 | EE | Fil | EX, MX | n | Dropping stuff off, working on camera | 18:52 |
17:57 | VAC | Gerardo, Isaiah | LVEA | n | Drilling holes | 19:23 |
18:20 | PEM | Robert | EX, EY | n | Looking for equipment | 18:58 |
19:30 | PEM | Sheila, Robert | LVEA | n | Magnetometer moves | 19:49 |
19:54 | PCAL | Rick, Evan | PCAL Lab | y(local) | PCAL things (Evan in at 20:38) | 21:49 |
19:57 | PEM | Robert | LVEA | N | Move magtometer | 20:02 |
20:27 | PEM | Robert | LVEA | n | Moving magnetometer | 20:31 |
20:44 | VAC | Gerardo | LVEA (Y-term. slab) | n | Investigating broken pump | 21:09 |
20:49 | VAC | Janos, Isaiah | CER | n | Getting an air sampler | 21:09 |
21:01 | SQZ | Kar Meng | Optica Lab | y(local) | SHG | 21:53 |
22:01 | EE | Fil | MY | n | Camera fix | 22:38 |
22:38 | PEM | Robert, Neil, others | EY | n | Picking up a small slab of granite | 23:13 |
22:56 | PCAL | Francisco | PCAL Lab | y(local) | PCALing | ongoing |
TITLE: 06/25 Eve Shift: 2300-0800 UTC (1600-0100 PST), all times posted in UTC
STATE of H1: Observing at 146Mpc
OUTGOING OPERATOR: Oli
CURRENT ENVIRONMENT:
SEI_ENV state: CALM
Wind: 14mph Gusts, 9mph 5min avg
Primary useism: 0.01 μm/s
Secondary useism: 0.07 μm/s
QUICK SUMMARY: H1 has been locked and observing for 1.5 hours. Sounds like relocking after maintenance went smoothly.
13:10-13:40UTC. Adjusted ZM4 PSAMs to 2 different settings this morning as LLO started an extended maintenance period.
Only adjusted ZM4 PSAMs as ZM5 seems to have more effect but is harder to realign after, last large raster in 76986.
In each of the two steps, I adjusted the PSAMS offset, used alignment sliders to bring the alignment back, ran scan sqz alignment.
TJ, Camilla. We turned off the HWS SLEDs to save their lifetime as the HWS hasn't been well aligned since our April SRC alignment shift. These channels are not in sdf. We started to realign them in 78083 but paused as may change our SRC alignment again.
Closes FAMIS 28360
The in-lock charge measurements were not run this week.
There was two different sets of anchors drilled for the EMT support in the LVEA, one set on the technical slab, near the termination slab, and the second set on the termination slab (Y-Arm).
(Gerardo)
Anchor holes were drilled for two unistrut post bases, they are for supporting the long run of EMT, anchors were dropped in and unistrut post base was fasten, no issues to report.
(Janos, Isaiah, Gerardo)
The 3 high voltage cables, for the filter cavity tube ion pumps, that were pulled during the last couple of weeks were switched from their temporary controller, in the LVEA, to their permanent controller, in the mechanical room, no issues encountered during the switching process. Next step is to get the controller signal cable connected to the vacuum rack, and get them into their respective MEDM screens.
(Isaiah, Gerardo)
Drilled the last four holes for the short supports, the post bases were anchored without problems, and the rest of the components were fasten to the footings to support the EMT run.
The LVEA has been swept, the only thing I noticed was an unused extension cable left plugged in next to the bier garten which I unplugged.
Tue Jun 25 10:08:05 2024 INFO: Fill completed in 8min 2secs
Gerardo confirmed a good fill curbside.
[Dave, Erik]
Dave found that DACs in h1sush2a were in a FIFO HIQTR state since 2024-04-09 11:33 UTC.
FIFO HIQTR means that DAC buffers had more data than expected. DAC latency would be proportionally higher than expected.
The models were restarted, which fixed the issue.
The upper bound on sush2a latency for the first three months of O4B is 39 IOP
cycles. At 2^16 cycles per second, that's a maximum of 595
microseconds.
At 1 kHz that's 214 degrees of phase shift.
Normal latency is 3 IOP cycles, 46 microseconds, 16 degrees phase shift
@ 1 kHz.
The minimum latency when sush2a was in error was 4 cycles, 61
microseconds, 23 deg @ 1 KHz.
[Erik, Marc, Dave]
h1susex now has a a LIGO 28-bit 32-channel DAC installed.
The timing card was also swapped out for a new card with firmware that's compatible with the DAC.
h1susex now boots from h1vmboot0 running models built with RCG 5.3.0, necessary to support the DAC, as opposed to the rest of the front ends which boot from h1vmboot1 running RCG 5.1.4.
The timing fanout is reporting an firmware version error on the port for h1susex (physical port 4, medm port 3). This is probably because the firmware on the timing card is new. We think we can run with this error.
After the install, DAQ leg 0 was restarted but it only connected to h1susex. When setting up bootserver h1vmboot0, I'd accidentally replaced the DAQ master file. Restoring the old master file resolved the issue.
Ligo 28-bit 32-channel DAC serial number is S2400042
LIGO Timing Card installed is S2101152 flashed with FPGA code version 1000.
LIGO DB25 to BNC Breakout box installed on LD32 port 0 (directly to the adapter board). BNC's 1-8 attach to 2nd PEM chassis ports 1-8.
Fil, Camilla
After finding that the sqz laser glitches may be linked ot the last 9th May TTFSS swap 78549, today Fil and I swapped D2300329 Laser Locking Fiber Beat Note Chassis back to the original.
Installed Chassis S2300258
Removed Chassis (but left in the rack) S2300259
To avoid issues seen after swapping chassis before 77754, 77746 we may want to adjust TTFSS beatnote threshold polarization as RFAMP has dropped from 7.7 to 1.8dB. Plot
TITLE: 06/25 Day Shift: 1430-2330 UTC (0730-1630 PST), all times posted in UTC
STATE of H1: Preventive Maintenance
OUTGOING OPERATOR: Ryan C
CURRENT ENVIRONMENT:
SEI_ENV state: MAINTENANCE
Wind: 5mph Gusts, 3mph 5min avg
Primary useism: 0.06 μm/s
Secondary useism: 0.08 μm/s
QUICK SUMMARY: We went down earlier to start our early maintanence day.
22:00UTC Observing after Tuesday Maintenance finished
State of H1: Observing at 153Mpc; locked for almost 7 hours.
Dropped observing from 23:42 to 00:17 UTC to implement new SRCL FF (alog78632), get 12 minutes of no-SQZ time (from 23:52 to 00:04 UTC), and optimize SQZ angle with the SCAN_SQZANG Guardian state. Otherwise, it's been a quiet shift so far.
There was a glitch during this no SQZ time, we have 9 minutes without a glitch from 1403308348 (2024/06/24 23:52:10 UTC) to 1403308880 (2024/06/25 00:01:02 UTC).
Jennie, Ryan S, Camilla
After Jennie's 78629 measurements, we fit the SRCL FF (not time for MICH). Possible we might add noise at 300Hz but this is FF looks overall better.
Old SRCLFF was FM2 with gain 1.18 (didn't account fort this is code but should have changed this to 1 for best iterative fitting). New FF is FM4 gain 1.18. Plot attached. SDF saved and ISC_LOCK edited and loaded.
A few weeks back Oli put in an alog about IMC and SRM M3 saturations during earthquake lock losses. In April of 2023 Gabriele had redesigned the M1-M3 offload, reducing the gain of the offload somewhat to get rid of 3-ish hz instabilities in the corner cavities. This may have contributed to the SRM saturations that Oli found, so we want to try adding some low frequency gain back into the SRM offloading.
Sheila wrote out the math for me for the stability of both the SRCL loop and the stability of the M1-M3 crossover, so I have been looking at ways to increase the low frequency gain without affecting the stability above 1hz. The open look gain for SRCL looks like :
SRCL_OLG = SRCL_sens * SRCL_FIlter * (SRM_M3_PLANT+SRM_M1_LOCK_FILTER * SRM_M1_PLANT);
The SRM M1-M3 offloading looks like:
SRM_OFFLOAD_OLG = SRM_M1_LOCK_FILTER * SRM_M1_PLANT * SRCL_sens * SRCL_Filter / (1-SRM_M3_PLANT * SRCL_sens * SRCL_FILTER);
Both of these are (or behave like) open loop gains (g), so the suppression/gain peaking can be show by looking at the 1/(1-g) for each.
I made a 50mhz boost filter for this and tried it during the commissioning window this morning. Bode plots for the boost (red), boost *m1 lock filters(blue) and the nominal M1 lock filter(green) are shown in the first image). The affect on M3 drives and SRCL are shown in the second image asds, live traces are with the new boost, refs are without. There is good reduction below 100mhz, but there is gain peaking from the M1-M3 offloading at .2-.4hz. which might bleed into the secondary microseism during the winter. I'm working on a filter with similar gain, but less gain peaking in a region that won't affect the overall rms of the m3 drive as much. I will try installing and testing during maintenance tomorrow.
These are some of the design plots I have been using. First image is the M1-M3 cross-over, red is the Mar 2023 filter that may have been causing 3ish hz instabilities, solid blue is the filter that Gabriele installed at that time, dashed purple is the boost I tried this morning, and dotted yellow is a modified boost that I want to try tomorrow. Second plot is the suppression for each filter. The .2-.3 hz gain peaking I saw during the test this morning is easy to see in the dashed purple on the second plot, I think the dashed yellow will have less gain peaking and move it closer to .7-1hz where it won't affect the rms of the M3 drive as.
The new boost is installed on SRM and ready to try when we get a chance. Attached image shows the bode plots for the boost filter (red), boost*nominal M1 filters(blue), and the nominal M1 filters (green). I think we might try to test these on Thursday.
I tested this new boost yesterday, it works well, so I'm adding engaging FM5 to the ISC_DRMI guardian. Will post a log with the results in a bit.
H1 back to observing at 05:00 UTC.
Lots of unexplained locklosses at random pre-DRMI states, making this reacquisition longer. Not sure what the issue was, but otherwise PRM needed adjustment to eventually lock DRMI.
I also twice had an issue with the ALS X PLL showing the "Beat note strength" error message, which prevented it from locking and would put the ALS_XARM into FAULT. The beatnote was around -11dBm and the lower limit was set to -10dBm, so I simply raised the threshold to -12 and the PLL locked just fine (I later reverted the SDF diff to start observing). Trending the ALSX PLL beatnote back, it does seem to sometimes get this low, but not very often (attached). It's already made its way back up to -5dBm about an hour later.