Tue Jan 06 10:01:38 2026 INFO: Fill completed in 1min 37secs
Short fill because discharge line pressure had been bumping up since last fill.
[Jason, Jennie, Masayuki]
Tagging for EPO
TITLE: 01/06 Day Shift: 1530-0030 UTC (0730-1630 PST), all times posted in UTC
STATE of H1: Planned Engineering
OUTGOING OPERATOR: None
CURRENT ENVIRONMENT:
SEI_ENV state: MAINTENANCE
Wind: 5mph Gusts, 2mph 3min avg
Primary useism: 0.03 μm/s
Secondary useism: 0.31 μm/s
QUICK SUMMARY:
Workstations were updated and rebooted. This was an os packages update. Conda packages were not updated.
WP 12953
I was notified of a buzzing/whistling sound coming from the CER mezzanine. The HV power supply for the OMC PZT was found with audible alarm on and LCD screen not displaying correctly. Power supply was power cycled. Unit tripped immediately. With unit off, the field cabling going to LVEA was disconnected. Unit tripped when powered on. Unit was replaced with spare.
F. Clara, R. McCarthy, M. Pirello
[Sheila, Karmeng]
To align OPO IR beam, we try to lock the IR dither lock at fundamental, but we were unable to see the error signal and dither. CLK_gain were changed from 0.1 to 1000, and the demodulation phase from 245 to 225. The resulting error signal as attached. A 200Hz wide bandpass filter added to the PD input dither around 3kHz, LSC_servo_gain changed from -10 to -300 to lock the OPO.
We also adjusted the beamsplitter (position before the IR camera) to center the IR beam on SQZT7 IR camera.
TITLE: 01/05 Day Shift: 1530-0030 UTC (0730-1630 PST), all times posted in UTC
STATE of H1: Planned Engineering
INCOMING OPERATOR: None
SHIFT SUMMARY: HAM7 and JAC work continued today.
| Start Time | System | Name | Location | Lazer_Haz | Task | Time End |
|---|---|---|---|---|---|---|
| 15:57 | SAF | LASER SAFE | LVEA | NO | LVEA is Upgrade Phase Laser SAFE | 17:16 |
| 16:46 | FAC | Nellie, Kim | LVEA | N -> Y | Tech clean | 17:29 |
| 17:00 | OPS | Oli | LVEA | N -> Y | Transition to HAZARD | 17:16 |
| 17:15 | ISC | Jennie | Optics lab | LOCAL | Gather JAC parts | 17:32 |
| 17:16 | HAZ | LASER HAZARD | LVEA | Y | LVEA IS LASER HAZARD | 01:35 |
| 17:26 | SQZ | Sheila | LVEA | Y | Turn on SQZ laser, maybe take a look at the table | 17:55 |
| 17:29 | FAC | Nellie | MidY | N | Tech clean | 18:26 |
| 17:32 | FAC | Kim | EndX | N | Get garb | 18:38 |
| 18:06 | ISC | Jennie, Rick | PCAL lab | LOCAL | Get parts for JAC | 18:20 |
| 19:01 | ISC | Betsy | LVEA | Y | Check on headsets | 19:14 |
| 19:20 | EE | Marc, Fil | CER | Y | Investigate failing PS, HV HAM6 pzt | 20:26 |
| 21:26 | ISC | Jason, Jennie, Masayuki | PSL enc | Y | JAC work | Ongoing |
19:32 UTC HAM1 ISI WD tripped
21:32 UTC DAQ restart
Jennie, Erik, Dave:
Jennie's new h1ascimc model was installed at 13:30 Mon 05Jan2026. This required a DAQ restart to add 2 slow channels.
At 13:32 we restarted the 1-leg, followed by the 0-leg at 13:37. GDS1 did not need a restart.
Following this DAQ restart we had 3 sponaneous restarts of FW1 after it had ran for 27:48, 8:02 and 6:22 minutes respectively. At the time of writing it has been running with no further restarts for an hour.
Good news: FW1 has now been running 20 hours. Its beginning to look like the usual frame-writer-restarts-soon-after-DAQ-restart but with 3 restarts this time. We are not sure if we had seen a triple before.
Bad news: later yesterday afternoon h1daqgds0 daqd restarted itself coincident with Erik logging off of this machine. We did two more login/logout tests, the first restarted daqd the second did not. At this time is appeared to be related to the method of logging out, CTRL-D crashing daqd and "exit" not. I did another "exit" test this morning and unfortunately this time it did crash GDS0 DAQD. I restarted the 0-leg soon after (at 08:54) to resync the uptimes. So it appears to be independent of the method of logging out and is intermittent.
FRS36466 opened for this issue.
Restart/Reboot Log --------------------------------------------------------
Mon05Jan2026
LOC TIME HOSTNAME MODEL/REBOOT
13:30:32 h1asc0 h1ascimc <<< Install Jennie's new model
13:32:11 h1daqdc1 [DAQ] <<< DAQ 1-LEG restart
13:32:19 h1daqfw1 [DAQ]
13:32:20 h1daqtw1 [DAQ]
13:32:21 h1daqnds1 [DAQ]
13:32:30 h1daqgds1 [DAQ]
13:37:38 h1daqgds0 [DAQ] <<< DAQ 0-LEG restart
13:37:43 h1daqfw0 [DAQ]
13:37:43 h1daqnds0 [DAQ]
13:37:43 h1daqtw0 [DAQ]
14:00:44 h1daqfw1 [DAQ] <<< Triple sponaneous FW1 restarts
14:09:39 h1daqfw1 [DAQ]
14:16:36 h1daqfw1 [DAQ]
16:41:00 h1daqgds0 [DAQ] <<< GDS0 DAQD restart on logout
16:45:12 h1daqgds0 [DAQ] <<< Test GDS0 crash reproducible
16:53:04 h1daqgds0 [DAQ] <<< Clean start of 0-leg
16:53:09 h1daqfw0 [DAQ]
16:53:09 h1daqtw0 [DAQ]
16:53:10 h1daqnds0 [DAQ]
Mon Jan 05 10:04:11 2026 INFO: Fill completed in 4min 8secs
I increased the setting for thermocouple nominal max from 20C to 30C to match current values and remove a VAC-SDF diff.
Closes FAMIS38887 , last checked in alog88362
HAMs 1-4, 7 and BSC2 are in non nominal SEI states due to the vent work.
2026-01-05 08:58:15.266231
There are 14 T240 proof masses out of range ( > 0.3 [V] )!
ETMX T240 2 DOF X/U = -1.625 [V]
ETMX T240 2 DOF Y/V = -1.709 [V]
ETMX T240 2 DOF Z/W = -0.94 [V]
ITMX T240 1 DOF X/U = -2.28 [V]
ITMX T240 1 DOF Y/V = 0.313 [V]
ITMX T240 1 DOF Z/W = 0.485 [V]
ITMX T240 3 DOF X/U = -2.433 [V]
ITMY T240 3 DOF X/U = -1.065 [V]
ITMY T240 3 DOF Z/W = -2.971 [V]
BS T240 1 DOF Y/V = -0.372 [V]
BS T240 3 DOF Z/W = -0.449 [V]
HAM8 1 DOF X/U = -0.316 [V]
HAM8 1 DOF Y/V = -0.444 [V]
HAM8 1 DOF Z/W = -0.755 [V]
All other proof masses are within range ( < 0.3 [V] ):
ETMX T240 1 DOF X/U = -0.007 [V]
ETMX T240 1 DOF Y/V = -0.041 [V]
ETMX T240 1 DOF Z/W = -0.024 [V]
ETMX T240 3 DOF X/U = -0.016 [V]
ETMX T240 3 DOF Y/V = -0.069 [V]
ETMX T240 3 DOF Z/W = -0.045 [V]
ETMY T240 1 DOF X/U = 0.066 [V]
ETMY T240 1 DOF Y/V = 0.208 [V]
ETMY T240 1 DOF Z/W = 0.266 [V]
ETMY T240 2 DOF X/U = -0.075 [V]
ETMY T240 2 DOF Y/V = 0.226 [V]
ETMY T240 2 DOF Z/W = 0.049 [V]
ETMY T240 3 DOF X/U = 0.282 [V]
ETMY T240 3 DOF Y/V = 0.096 [V]
ETMY T240 3 DOF Z/W = 0.149 [V]
ITMX T240 2 DOF X/U = 0.158 [V]
ITMX T240 2 DOF Y/V = 0.283 [V]
ITMX T240 2 DOF Z/W = 0.263 [V]
ITMX T240 3 DOF Y/V = 0.139 [V]
ITMX T240 3 DOF Z/W = 0.086 [V]
ITMY T240 1 DOF X/U = 0.07 [V]
ITMY T240 1 DOF Y/V = 0.147 [V]
ITMY T240 1 DOF Z/W = 0.021 [V]
ITMY T240 2 DOF X/U = 0.021 [V]
ITMY T240 2 DOF Y/V = 0.239 [V]
ITMY T240 2 DOF Z/W = 0.152 [V]
ITMY T240 3 DOF Y/V = 0.085 [V]
BS T240 1 DOF X/U = -0.107 [V]
BS T240 1 DOF Z/W = 0.123 [V]
BS T240 2 DOF X/U = -0.031 [V]
BS T240 2 DOF Y/V = 0.038 [V]
BS T240 2 DOF Z/W = -0.052 [V]
BS T240 3 DOF X/U = -0.222 [V]
BS T240 3 DOF Y/V = -0.289 [V]
Assessment complete.
Averaging Mass Centering channels for 10 [sec] ...
2026-01-05 08:58:27.267417
There are 2 STS proof masses out of range ( > 2.0 [V] )!
STS EY DOF X/U = -4.63 [V]
STS EY DOF Z/W = 2.377 [V]
All other proof masses are within range ( < 2.0 [V] ):
STS A DOF X/U = -0.492 [V]
STS A DOF Y/V = -0.851 [V]
STS A DOF Z/W = -0.499 [V]
STS B DOF X/U = 0.153 [V]
STS B DOF Y/V = 0.944 [V]
STS B DOF Z/W = -0.303 [V]
STS C DOF X/U = -0.867 [V]
STS C DOF Y/V = 0.801 [V]
STS C DOF Z/W = 0.594 [V]
STS EX DOF X/U = -0.218 [V]
STS EX DOF Y/V = -0.16 [V]
STS EX DOF Z/W = 0.036 [V]
STS EY DOF Y/V = 1.254 [V]
STS FC DOF X/U = 0.161 [V]
STS FC DOF Y/V = -1.157 [V]
STS FC DOF Z/W = 0.625 [V]
FAMIS 27701, last checked in alog88650
The script reports high frequency noise is elevated for HAM1_V3, HAM7_V{1,2,3} which makes sense as they're vented. ITMX_ST1_V1 also reports elevated noise, ETMX_ST1_{H1,V3} are slightly elevated at high frequency.
HAMs 1-4 are still locked and the SEI configuration for the BS is in ISOLATED_DAMPED.
TITLE: 01/05 Day Shift: 1530-0030 UTC (0730-1630 PST), all times posted in UTC
STATE of H1: Planned Engineering
OUTGOING OPERATOR: None
CURRENT ENVIRONMENT:
SEI_ENV state: MAINTENANCE
Wind: 12mph Gusts, 6mph 3min avg
Primary useism: 0.02 μm/s
Secondary useism: 0.31 μm/s
QUICK SUMMARY:
Erik, Dave:
All workstations and NUCs which had been powered down during the break have been powered back up.
1. picket fence is working again.
2. I have stopped running nuc_dummy_ioc.py which was temporarily serving dummy NUC EPICS channels to the EDC
3. cds_report has been reverted to the pre-break version (it had been expecting WS to be down and NUC reported had been removed)
Sun Jan 04 10:09:35 2026 INFO: Fill completed in 9min 31secs
At 9:42p local I received a cell alert declaring a loss of chilled water supply at End X. After remotely logging into FMCS I observed that the lead chiller (1) was in alarm and the CH-1 supply temp was hovering around 54F. I've since toggled the lead lag, and manually forced chiller 2 and chilled water pump 2 on. Given the low outside air temps and the lack of temp demands that vent require, this should suffice until all return from the break where we can investigate further. T. Guidry
Sat Jan 03 10:09:51 2026 INFO: Fill completed in 9min 48secs
There were some SEI trips earlier today due to an earthquake. Dave went in and reset the software WDs earlier (88671), so to get the system back up to where it was before the earthquake, I went through and reset ISI and HPI to nominal for the chambers that needed them reset (aka not resetting them for the systems where we already have them down due to venting). Tony's overview and WD screenshots from Wednesday are a good reference for what state everything was in before the earthquake. This is what the OPS Overview looked like before I started resetting everything. Everything now that needed to be reset is back how it was before the earthquake (overview now).
Upcoming LN2 deliveries at x mid and x end required some tumbleweed attention this afternoon. X1 is still largely clear and x mid should be easily accessible. The earlier half of X2 is the worst area. I was able to cut a single lane to X2 before the harvester jammed up beyond what I could free by myself. What remains in the harvester chute needs a few days to dry out. As do I. As a follow up to my previous log I checked the magmeter in the water room which meters domestic supply to the site and found a reading of 1011247. T. Guidry
Site Walk Through 2 Jan 2026
LExC is in great shape no indication of problems.
Staging building is in good shape.
VPW two ovens running and in the parameters that Chris told us. Weld shop temperature was fine so no pipe issues.
LSB looks fine. Tyler was in his office
OSB/LVEA everything was in order. Kobelco running door covers billowing slightly. No signs of problems.
Mid and Ends were fine.
Carpenter shop/ water room fire pump room and electrical room were all fine.
FCES in great shape.
I leave the site with, Tyler clearing a path to EX for LN2 delivery. I am his phone buddy.
Jennie W, Dave B,
Jeff and I put in a bypass in the h1ascimc model (see alog #88465) so we could put in the simulink infrastructure to switch between using the PSL periscope PZT as part of the IMC control or as part of the JAC control.
At the moment the switch 'H1:ASC-IMCJAC_PZTOUTSW' is set to ON which should let the IMC servo use the PZT.
However the logic I put in will not switch the feedback to take inputs from the JAC servo if I turn the switch off.
This is because Choice 2 and 3 in the picture are set to pass their first input if the switch output is '>= 0', so whichever state it is in the IMC PZT output will be sent to the DAC.
I have changed these choices to >0 so that the top input (IMC PZT output signal) will be sent to the DAC if the switch is 1 and the bottom input (JAC PZT output signal) will be sent to the periscope otherwise.
I committed the changed /opt/rtcds/userapps/release/asc/h1/models/h1ascimc.mdl to the svn.
I also added two cdsepicsOutput blocks (ASC-PSL_PZT_P and ASC-PSL_PZT_Y) before the DAC outputs going to the PZT to check what the model is sending to the PZT which will help us double check the switch between IMC and JAC signals works correctly.
See screenshot attached. I rebuilt h1ascimc.mdl and committed it to the svn at userapps/asc/h1/models.