After chatting with Sushant at LLO, I followed his advice to add a bit of weight to the minimization metric at 60 Hz, and was able to get cleaning parameters that do a pretty good job of subtracting jitter and laser frequency noise, but don't inject noise at the 60 Hz line. The jitter subtraction is a little less good than alog 72276, but it's important to not inject noise with the cleaning, so this is a good balance. I similarly retrained the laser noise, and with both of them on (while other commissioning work was ongoing), I see good subtraction and no noise injection at 60 Hz. This is shown in the first attachment.
After having collected a bit of time with the jitter and laser noise subtracted, I retrained the LSC modulated cleaning. Unfortunately, when trying it in the online system (I don't have the offline mimic of this working yet), it needs a similar mysterious minus sign much like the jitter subtraction needed until I recompiled the code last week. I'm starting to suspect that the LSC NonSENS c-code also needs to be regenerated and recompiled, and hopefully that will solve my minus sign issue. Anyhow, when the LSC noise estimate has that minus sign in place, it gives a reasonable amount of subtraction, as shown in the second attachment.
The third attachment shows the improvement (when blue is above pink/orange) in range from the cleaning. Around 19-20 hours on that plot I'm just subtracting jitter and laser noise. Around 21 hours I add in LSC subtraction, and we get back to ~150 Mpc. So, likely our LSC FF is becoming mistuned, and we'd benefit from either retuning the LSC FF or finally implementing the NonSENS subtraction.
The cleaning review committee meets tomorrow. All of this is turned off when the IFO is in Observing until given approval by the review committee.
While some calibration work was ongoing, I turned off the HAM1 -> CHARD feedforward, so that Elenna / Gabriele can potentially retrain the filters to make further improvements now that Jim has installed new HAM1 seismic feedforward filters (alog 72393).
The switch H1:HPI-HAM1_TTL4C_FF_OUTSW was off from 23 Aug 2023 22:03:47 UTC to 22:55:20 UTC.
TITLE: 08/23 Day Shift: 15:00-23:00 UTC (08:00-16:00 PST), all times posted in UTC
STATE of H1: Observing at 151Mpc
INCOMING OPERATOR: Corey
SHIFT SUMMARY: Optics lab and PSL anteroom dust alarms have been off and on today just as yesterday.
Lock#1:
Lockloss at 15:33UTC
Lock#2:
No flashes on DRMI or PRMI, tried check mich, no luck, went into IA. I had to help out Yarm during green arms (ENABLE_WFS state on Yarm) by tapping pitch a microradian.
NLN at 17:20UTC with no interventions, in Observing at 17:35UTC.
Out of Observing at 19:08 for planned commissioning work. I brought us to NLN_CAL_MEAS to take a calibration measurement at 21:33UTC
Back into Observing at 22:55UTC
LOG:
Start Time | System | Name | Location | Lazer_Haz | Task | Time End |
---|---|---|---|---|---|---|
15:29 | EE | Ken | MidY | N | Light fixtures | 19:26 |
16:12 | FAC | Randy | MidX | N | Parts check | 16:32 |
16:35 | Lance | LVEA | N | Quick check | 16:40 | |
16:39 | FAC | Cindy | Wood shop | N | Tech clean | 17:21 |
16:52 | PCAL | Tony | PCAL lab | LOCAL | Martel measurement | 17:08 |
17:21 | FAC | Cindy | Mech room | N | Tech clean | 18:13 |
19:09 | SQZ | Vicky | Remote | N | SQZ work | 20:12 |
19:32 | FAC | Ken | H2 | N | Drop off lights | 20:36 |
20:11 | PEM | Lance | LVEA | N | Scatter injection, HAM3 | 21:17 |
20:37 | EE | Ken | MidX | N | Pick up equipment | 21:03 |
21:00 | ISC | TJ | FCES | N | Grab stuff | 21:22 |
21:08 | SEI | Jim | CR | N | HAM1 FF | 22:08 |
21:34 | CAL | RyanC | CR | N | Calibration measurement | 22:05 |
I reduced the amplitude of the 17.1 Hz PCALY calibration line. This is a continuation of LHO:71945. Channel Old Gain New Gain Reduction Factor ================= ========= =========== =========== H1:CAL-PCALY_PCALOSC1_OSC_SINGAIN 250 115 2.17 The changes have been saved to observe and safe snap files in the SDF system.
Louis double checked, and these are not touched by Guardian, so with these SDF saves everything should come back just fine next lock.
Naoki, Vicky
Today we tested higher generated SQZ level and FC detuning, summary screenshot here. We turned up non-linear gain from NLG 11 to 17, so gen sqz level from 14.7dB to 17dB, and very barely got more sqz (< 0.2dB?). We set it back to the "normal" 80uW operating point, leaving the injected sqz level unchanged. We ended up changing FC detuning from -25 Hz to -28 Hz. Notes:
I stole the filter that Huyen used for her HAM1 feedforward test, and tried it on the LHO HAM1, with a gain tweak of 17% (ie I multiplied by a gain of 1.17 vs LLO ) to match my measurements and it seems to work well. I was having difficulty with my hand fits with excess low frequency noise or gain peaking where I tried to roll my filters off. First plot shows the on/ off asds for the HAM2 sts and the HAM1 Z HEPI l4cs. I don't know if I quite believe the improvement below 1 hz is due to the feedforward, but Huyen said she got improvement kind of 1-70hz and that seems to be the case here as well. I'm leaving this filter on overnight, to get good low frequency data.
Second image compares one of my filters(red) with the (green) LLO filter. One thing I still don't understand is that my filters have often caused broad low frequency noise, but the LLO filter doesn't seem to. We don't currently have a noise model for HEPI that allows modeling the ff performance, that would help a lot.
Attaching long spectra comparing HAM1 with the LLO feedforward. Still looks pretty good, we should run with this. Live traces are with the feedforward on, refs are with it off, so the improvement in the HAM1 HEPI l4cs is brown to bright green, so something like a factor of 20 improvement at 15 hz, which is the frequency where HAM1 just catches briefly up to the performance of HAM 2 and 4 with this feedforward running.
Second plot compares CHARD pitch asds during these same times. The improvement here is less dramatic, but there is still a factor of almost 2 around 8-9 hz. I suspect the low frequency (.1hz and below) differences is due to wind. I looked at cal deltal, but it seems that squeezing was off or something during my reference time, there's a lot of extra signal above 10 hz.
I ran a calibration measurement at the behest of Louis this afternoon, starting with the broadband:
/ligo/groups/cal/H1/measurements/PCALY2DARM_BB/PCALY2DARM_BB_20230823T213349Z.xml
Then the simulines:
GPS start: 1376862014.581911
GPS end: 1376863342.763444
2023-08-23 22:02:04,350 | INFO | File written out to: /ligo/groups/cal/H1/measurements/DARMOLG_SS/DARMOLG_SS_20230823T213958Z.hdf5
2023-08-23 22:02:04,374 | INFO | File written out to: /ligo/groups/cal/H1/measurements/PCALY2DARM_SS/PCALY2DARM_SS_20230823T213958Z.hdf5
2023-08-23 22:02:04,387 | INFO | File written out to: /ligo/groups/cal/H1/measurements/SUSETMX_L1_SS/SUSETMX_L1_SS_20230823T213958Z.hdf5
2023-08-23 22:02:04,402 | INFO | File written out to: /ligo/groups/cal/H1/measurements/SUSETMX_L2_SS/SUSETMX_L2_SS_20230823T213958Z.hdf5
2023-08-23 22:02:04,417 | INFO | File written out to: /ligo/groups/cal/H1/measurements/SUSETMX_L3_SS/SUSETMX_L3_SS_20230823T213958Z.hdf5
Wed Aug 23 10:11:14 2023 INFO: Fill completed in 11min 10secs
DCPD saturation then lockloss
A few signals saw a kick less than a second before the lockloss, and it looks like CSOFT rang up
If you get a refined time for the lockloss by looking at ASC-AS_A_DC_NSUM_OUT_DQ, you get that the power fell off the PD at 15:33:23.95UTC (1376840021.95)(see attachment - PD channel is bottom right), so the kicks in the ASC channels happened right after the lockloss. That being said, the jumps in the ASC channels right after the lockloss are all kind of small looking? as opposed to the giant jumps we usually see.
TITLE: 08/23 Day Shift: 15:00-23:00 UTC (08:00-16:00 PST), all times posted in UTC
STATE of H1: Observing at 147Mpc
OUTGOING OPERATOR: Ibrahim
CURRENT ENVIRONMENT:
SEI_ENV state: SEISMON_ALERT
Wind: 3mph Gusts, 2mph 5min avg
Primary useism: 0.07 μm/s
Secondary useism: 0.18 μm/s
QUICK SUMMARY:
TITLE: 08/23 Eve Shift: 23:00-07:00 UTC (16:00-00:00 PST), all times posted in UTC
STATE of H1: Observing at 150Mpc
INCOMING OPERATOR: Ibrahim
SHIFT SUMMARY: Uneventful and quiet night. Detector in Observing and Locked for 9hrs 40mins. Dust is finally settling down in the PSL, and our range is creeping back up as compared to the start of my shift.
23:00UTC Start of shift - detector in Observing and Locked for 1.5 hours
23:03 Superevent S230822bm
LOG:
Start Time | System | Name | Location | Lazer_Haz | Task | Time End |
---|---|---|---|---|---|---|
23:23 | CDS | Jonathon, Ajay | n | Turn on DMT | 23:35 |
Previously done in 72264
Closes FAMIS#25080
No In-Lock SUS Charge measurements were made this morning due to the SUS_CHARGE Guardian having been in the DOWN state since last Tuesday 8/15 15:29UTC. TJ had fixed up some errors in the SUS_CHARGE code (72219) and had placed it in DOWN for Tuesday Maintainance but had forgotten it there.
At 3:56UTC I put the Guardian back into the correct WAITING state by selecting INJECTIONS_COMPLETE, as done in 71067.
We are still in Observing and have been Locked for 5hrs 40mins now.
All the dust monitors that have had high dust counts from Tuesday Maintainance are going down, with the exception of both the >300um and >500um counts in the PSL Laser Room, of which the >300um counts is at the second highest it's been in 7ish years (highest it's been in the last ~7 years was two weeks ago). This rise in dust looks like it could be related to the wind at the corner station, so I'll keep an eye on it and hopefully it'll come down as the wind dies down.
TITLE: 08/22 Day Shift: 15:00-23:00 UTC (08:00-16:00 PST), all times posted in UTC
STATE of H1: Observing at 141Mpc
INCOMING OPERATOR: Oli
SHIFT SUMMARY:
Lock#1:
Yarm locked at a low power (~75%, lower power than XARm) and oscillating, no flashes at DRMI or PRMI, CHECK_MICH lockloss. There was a few more LL at FIND_IR and LOCKING ALS so I did an Initial Alignment, which went well untill we got to SRC where it tried for a while then eventually gave me a message "find by hand" where I tapped on SRM in Pitch maybe 10 microradians to maximize the signal and it was enough to push it onwords and finish IA.
Yarm looked better after the IA but was still oscillating, during these troubles the Norco liquid nitrogen truck was filling CP1 but we weren't seeing any extra motion on the CS accelerometers that we looked at.
Reached NLN at 21:25UTC, I had some sus SDF diffs pop up, they were all TRAMPs so I accepted them on SUSTMSX & SUSETMX. The 102Hz peak was noticable at the start of the lock.
In Observing at 21:45UTC, our range is lower now this lock
LOG:
Start Time | System | Name | Location | Lazer_Haz | Task | Time End |
---|---|---|---|---|---|---|
14:57 | PCAL | Tony, Rick | EndX | Y | PCAL measurement | 18:56 |
14:59 | FAC | Chris | Mech room | N | Fan room1 | 15:19 |
15:00 | FAC | Karen | EndY | N | Tech clean | 16:23 |
15:01 | FAC | Cindy | FCES | N | Tech clean | 16:20 |
15:04 | EE | Ken | MidX | N | Light fixtures | 21:54 |
15:17 | FAC | Mitch | West bay | N | Parts dropoff | 19:55 |
15:29 | FAC | Chris | Bake lab | N | Check out fume hood for removal | 15:44 |
15:37 | DAQ | Dave | remote | n | restart nds1 | 19:24 |
15:49 | FAC | Chris | MidX | N | Bring Ken a scissor lift | 16:43 |
15:49 | PSL | Jason | PSL Anteroom | LOCAL | Inventory | 17:48 |
15:53 | SQZ | Vicky | Remote | N | SQZ maintenance | 17:50 |
16:09 | EE | Fill | LVEA | N | Wiring | 17:24 |
16:28 | VAC | Janos, Travis | EndY, LVEA | N | Measurements | 18:31 |
16:36 | EE | Marc | CER | N | Check out power supplies with lasers | 16:51 |
16:38 | FAC | Cindy | LVEA | N | Tech clean | 18:41 |
16:39 | SEI | Jim | CR | N | HAM8 transfer functions, HAM7 | 18:23 |
16:55 | FAC | Mitch, Ibrahim | Staging, Enclosure | N | Move laser blinds | 19:24 |
16:50 | FAC | Karen | LVEA | N | Tech clean | 18:20 |
16:58 | FAC | Chris | LVEA | N | FAMIS checks | 17:23 |
17:24 | FAC | Chris | FCES | N | FAMIS checks | 17:47 |
17:26 | EE | Fil | EndY, then EndX | N | ESD upgrade checks | 19:05 |
18:29 | FAC | Karen | EndY | N | Drop off supplies | 18:56 |
18:41 | FAC | Cindy | High bay | N | Tech clean | 18:58 |
21:05 | VAC | Janos, Travis | EndX | N | Investigate anulus pump | 21:30 |
21:09 | PCAL | Tony | PCAL lab | LOCAL | PCAL post end station work | 23:09 |
TITLE: 08/22 Eve Shift: 23:00-07:00 UTC (16:00-00:00 PST), all times posted in UTC
STATE of H1: Observing at 139Mpc
OUTGOING OPERATOR: Ryan C
CURRENT ENVIRONMENT:
SEI_ENV state: CALM
Wind: 23mph Gusts, 19mph 5min avg
Primary useism: 0.09 μm/s
Secondary useism: 0.11 μm/s
QUICK SUMMARY:
Detector is in Observing and has been Locked for an hour and a half. Decently windy outside.
WP11361 TW1 raw minute trend file offload
Jonathan, Dave:
Last week the files were copied from the almost full SSD on h1daqtw1 to archive spinning media on h1ldasgw1. This morning I completed the transfer by reconfiguring nds1 to use the archive location, and then deleted the files from h1daqtw1's SSD RAID, reducing its usage from 97% to 4%. Jonathan made the nds1 configuration change permanent in puppet.
cdslogin reboot
Jonathan, Dave:
Jonathan rebooted cdslogin at 13:48. The CDS alarm and alert systems came back online with no problems.
Cable clean-up of the VMON channels for monitoring the ESD 18V and 48V power lines. Signals tied to the power lines through BNC bulkheads on the junction box (top of rack). Voltage divider boxes are installed in series. Signal routed through PEM test panel to AA chassis. See attached pictures. Will work with PEM group to see how we want to isolate the divider boxes and route cables.
Got a debrief from Fil on this -- his sentences can be interpreted as a bulleted list describing the *existing* system, not anything that he installed today. The only he did today was install a *new* BNC cable run from the VEAs' SUS-C1 to the CER TSC-C1 racks, without connecting them to anything and instead terminating both ends with 50 Ohm terminators. I can expand on his words a bit to give the reader a better feel for the existing system: "Cable clean-up of the VMON channels for monitoring the ESD 18V and 48V power lines." He's investigated moving forward with clean-up of the voltage monitor channels that the PEM team uses to monitor the dedicated ESD low-voltage low-noise driver's +/-18V and +/-48V DC power input (see why under the last sentence below). "Signals tied to the power lines through BNC bulkheads on the junction box (top of rack). Signal routed through PEM test panel to AA chassis." These voltage monitors are a BNC pick off from the power reduction "junction box" on the top of the end-station VEA SUS-R1 (EX/EY) field racks. The LVLN ESD driver's power is *not* connected from the "standard" D1002189 power strips that are powering the rest of the chassis in SUS-R1. - The dedicated / segregated power supplies live in the ante-room areas of the end-stations, in either DC power racks VDC-(X or Y)(C1 or C2). I don't have info on exactly where these live, so I can't be more specific. The BNC monitor cables are sent to the PEM ADC via an overly complicated path: (a) From the junction box to the 16ch BNC bulkhead PEM test patch panel (D1300779), in U41 of SUS-R1 (EX or EY) (b) That SUS-R1 patch panel is connected via a long BNC cable run to an identical patch panel at U33 of the end-station CER TCS-C1 (XC1 or YC1) racks. (c) Then more BNCs connect the TCS-(XC1/YC1) U33 patch panel to the 32ch 10x gain PEM AA chassis, D1001421, on in to the PEM/TCS IO Chassis. Of perhaps interesting note, it's unclear and inconsistent as to what the voltage monitor signals are monitoring. At both end stations, there're only 2 monitor channels. Fil *thinks* that these are connected to only the positive legs of each voltage. At EX, it's clear from the junction box spigot labeling that this is connected to +18V and +48V. However, at EY, the spigots are labeled +18V and -18V. This deserves clarification. "Voltage divider boxes are installed in series." Out of the field of view of the pictures, in between the junction box and the BNC patch panel in SUS-R1, (a), there're metal project, aka pamona, boxes wrapped in ziploc baggies. These project boxes contain a voltage divider to gain down the voltage suitable for ingestion into one of our ADCs. "Will work with PEM group to see how we want to isolate the divider boxes and route cables. We can do better than metal project boxes in ziploc baggies to electrically isolate them from where they rest on the rack or each other. A simple upgrade would be to just use plastic project boxes. The idea on the table with the new cable run that Fil installed today would be to go directly from the project boxes into the AA chassis, rather than connecting through the patch panel. This has the advantage of re-freeing up the patch panel for temporary tests, and making a rather important voltage monitor more permanent. Attached are Fil's whiteboard sketch of the system -- highlighting the new long BNC cable run he pulled today between VEA SUS-R1 and CER TCS-C1 in blue. Using Omnigraffle, the pictures Fil attaches in the main aLOG, and my knowledge of the system, I enhanced his whiteboard sketch into the attached cartoon.
Maintenance activities have finished and we are going to start relocking and do a quick ALS automation code test while relocking green arms.
Reaquired Observing at 21:45