TITLE: 02/28 Day Shift: 1530-0030 UTC (0730-1630 PST), all times posted in UTC
STATE of H1: Planned Engineering
INCOMING OPERATOR: N/A
SHIFT SUMMARY: Both doors and all viewports are now in place on HAM1 and the annulus is pumping down. Next week, after the main volume is at low enough pressure, we'll start commissioning the new JAC in with the rest of the IFO.
LOG:
| Start Time | System | Name | Location | Lazer_Haz | Task | Time End |
|---|---|---|---|---|---|---|
| 15:36 | FAC | Kim, Nellie | LVEA | N | Technical cleaning | 16:19 |
| 15:46 | FAC | Randy | LVEA | N | Prep for HAM1 door | 16:31 |
| 16:09 | VAC | Jordan | LVEA | N | Isolate turbopump on BSC8 | 16:17 |
| 16:49 | VAC | Travis | LVEA | N | HAM1 viewport and door prep | 17:34 |
| 16:50 | VAC | Jordan | LVEA | N | HAM1 viewport and door prep | 17:34 |
| 16:50 | FAC | Kim, Nellie | LVEA | N | Technical cleaning | 18:03 |
| 17:10 | SAF | Richard | LVEA | N | Checking in w/ VAC team | 17:32 |
| 17:48 | FAC | Randy | LVEA | N | Measuring cleanrooms in W-bay | 19:48 |
| 17:54 | SPI | Jeff | Opt Lab | Local | SPI fiber characterization | 20:11 |
| 17:55 | VAC | Jordan, Mitchell | LVEA | N | Prep for HAM1 cleanroom move (Mitchell out @ 18:11) | 19:27 |
| 17:57 | VAC | Betsy, Travis | LVEA | N | HAM1 door and cleanroom move (Betsy out @ 18:12) | 19:27 |
| 18:25 | TCS | Sophie, Gabriele | Prep Lab | Local | CHETA table work | 18:45 |
| 18:49 | FAC | Kim | LVEA | N | Technical cleaning | 19:35 |
| 18:51 | SAF | Richard | LVEA, CER | N | Safety checks in walls | 18:58 |
| 18:54 | TCS | Sophie | Prep Lab | Local | CHETA table work | 20:03 |
| 20:22 | SPI | Jeff, Jim | Opt Lab | Local | SPI fiber characterization (Jeff out @ 23:30) | 23:38 |
| 20:29 | FAC | Randy | LVEA | N | Craning scissor lift | 21:10 |
| 20:37 | VAC | Jordan | LVEA | N | Setting up HAM1 pump carts | 21:38 |
| 20:42 | VAC | Travis | LVEA | N | Setting up HAM1 pump carts | 21:38 |
| 22:15 | SQZ | Sheila | LVEA | N | Turning on SQZ laser | 22:45 |
| 22:45 | VAC | Travis | LVEA | N | Checking HAM1 pumps | 23:03 |
| 22:54 | TCS | Gabriele, Sophie | Prep Lab | Local | CHETA table work (Gabriele out @ 23:15) | Ongoing |
| 23:08 | JAC | Jennie, Keita | LVEA | N | Checking parts, turning off JAC heater (Keita out @ 23:40) | 00:08 |
| 00:23 | ISC | Elenna, Oli | Opt Lab | N | Assembling optics | Ongoing |
Richard, Marc, Jonathan, Erik, Dave:
On Monday 23rd the CHETA slow controls chassis was installed in the Vacuum Prep Lab (VPL). We connected its ECAT ethernet port to the MSR Beckhoff chassis AUX-1 port partially by copper (VPL to Rm163 into CUR) and partially by fibre (CUR CDS edge switch to MSR edge switch).
This appeared to work, but later we found out that the CDS core switch was complaining constantly of rapid movement of a MAC address on the ports used by CHETA. Further reading suggests ECAT does not strictly support unique MAC addresses per Beckhoff terminal, and it appears they may all have the same non-standard MAC address.
In addition, since Monday we have been seeing regular dropouts of the CUR network switch stacks, every 6 hours at 00:41, 06:41, 12:41 and 18:41 for about a minute apiece.
This afternoon we ran a long 148' cat5e ethernet cable from room 163 to the far end of the MSR. At 16:01 we routed the CHETA chassis connection to use this cable, we now have contiguous copper run between the two chassis.
This will fix the MAC movement issues on the CDS core, and time will tell if if fixes the CUR switch dropout.
JAC PZT: H1:JAC-PZT_DRIVER_OFFSET was set to zero, PZT scan was disabled, and the high voltage power supply for JAC PZT driver between the PSL room and the ISC R4 was turned off.
JAC Heater: H1:JAC-HEATER_POWER_SET was set to zero (used to be 1) and the heater driver chassis (ISC R4 slot 23) was turned off.
HAM1 picos: HAM1+HAM3 picomotor controller was disabled via medm screen.
FAMIS 39753
Laser Status:
NPRO output power is 1.845W
AMP1 output power is 70.51W
AMP2 output power is 138.5W
NPRO watchdog is GREEN
AMP1 watchdog is GREEN
AMP2 watchdog is GREEN
PDWD watchdog is GREEN
PMC:
It has been locked 2 days, 4 hr 16 minutes
Reflected power = 27.05W
Transmitted power = 103.9W
PowerSum = 131.0W
FSS:
It has been locked for 0 days 4 hr and 23 min
TPD[V] = 0.4902V
ISS:
The diffracted power is around 3.7%
Last saturation event was 2 days 4 hours and 23 minutes ago
Possible Issues:
PMC reflected power is high
The HAM1 +Y door was installed today. Installation went smoothly and the O-ring cooperated by staying in place today. I will note that torquing the door bolts is becoming more of an issue due to wrench access being increasingly limited near the 5-way cross/feedthru areas now that all the in-air cables have been attached.
The HAM1/HAM2 annulus system is being pumped by 2 turbos/aux carts on the -Y side of the chambers. The mysterious ~order-of-magnitude pressure readout difference at the two carts on the shared annulus system is again present, as was noted the last time this annulus system was pumped down. Not an issue per se, just some vacuum phenomena that leaves us scratching our heads.
Vent Recovery Update
Annulus ion pumps for HAM1 and HAM2 continue to pumpdown, we closed the isolation valves for both of them, but the ion pumps were not able to maintain pressure. On 3/4/26 valves were opened again to continue using the aux carts, and yesterday (3/5/2026) we isolated the aux cart for HAM2 only, all of that can be seen on the attached plot.
Aux carts will be left pumping and annulus systems are going to be evaluated next Monday.
I isolated the HAM1 aux cart (HAM2 was isolated on Friday) from the annulus this morning. The IP current only rose to ~4.7mA before turning around showing it could hold the annulus pressure.
HAM1/2 annulus aux carts were shut down and decoupled this afternoon. The SS500 cart remains at HAM1 and will continue to pump until the pressure is low enough to valve in the HAM1 ion pump.
The CDS_CA_COPY Guardian had not been running for roughly the past month due to three disconnected channels reported by SPM (H1:VID-FC_TRANS_A_{X,Y,SUM}). These channels went dead on January 27th when the new VM cluster was installed (alog88919) because they had been running on a dummy IOC called "cam_fc_trans_a_dummy_ioc" (created in March 2024, see alog76146) that must not have been brought over to the new VM cluster. Dave and I decided that since these channels have all been reporting zeroes for almost three years, possibly because that camera is not working, we would simply comment out these channels from the cds_ca_copy_list.txt file so they aren't referenced. After doing that and restarting the Guardian code, the node is working properly again.
Jennie W
I updated the medm for the IMC WFS to remove the feedback references to the PSL PZT. This feedback path had been removed from the model this morning (thanks Dave for the rev-locked build of h1ascimc and the DAQ restart). The WFS screen output matrices have been updated to put back the fifth DOF and removed the path to the PZT. We never control this fifth degree of freedom but it is still in the simulin model so we should leave it in. The second picture shows the output matrix screens which no longer contain the PZT feedback column.
Fri Feb 27 10:09:01 2026 INFO: Fill completed in 8min 58secs
Closes FAMIS#39856, last checked 89201
Corner Station Fans (attachment1)
- All fans are looking normal and within range.
Outbuilding Fans (attachment2)
- All fans are looking normal and are within range.
Jennie, Keita, Ryan S, EJ, Dave:
Jennie and Keita did a clean up of the h1ascimc model which was installed this morning. A DAQ restart was required, 14 slow channels had been removed.
As we had seen previously, restarting h1ascimc still causes DAC errors on h1iopasc0, and the safest way to restart h1ascimc is part of a full model restart on h1asc0.
Ryan confirmed a good SDF status and all the models were restarted (h1iopasc0, h1asc, h1ascimc, h1ascsqzifo).
The DAQ was then restarted, no issues other than GDS1 needing a second restart.
FW1 had a spontaneous restart 10 minutes after the 1-leg restart.
Fri27Feb2026
LOC TIME HOSTNAME MODEL/REBOOT
09:02:27 h1asc0 h1ascimc <<< first model restart, DAC error on IOP
09:06:53 h1asc0 h1iopasc0 <<< full restart of all asc0 models
09:07:07 h1asc0 h1asc
09:07:21 h1asc0 h1ascimc
09:07:35 h1asc0 h1ascsqzifo
09:12:59 h1daqdc1 [DAQ] <<< DAQ 1-leg
09:13:09 h1daqfw1 [DAQ]
09:13:09 h1daqtw1 [DAQ]
09:13:13 h1daqnds1 [DAQ]
09:13:18 h1daqgds1 [DAQ]
09:13:58 h1daqgds1 [DAQ] <<< gds1 second restart
09:16:17 h1daqgds0 [DAQ] <<< DAQ 0-leg
09:16:23 h1daqfw0 [DAQ]
09:16:23 h1daqtw0 [DAQ]
09:16:24 h1daqnds0 [DAQ]
09:22:03 h1daqfw1 [DAQ] <<< FW1 spontaneous restart
Closes FAMIS#38814, last checked 88932
BRS Driftmon
Auxiliary BRS Channels
Everything looking normal
TITLE: 02/27 Day Shift: 1530-0030 UTC (0730-1630 PST), all times posted in UTC
STATE of H1: Planned Engineering
OUTGOING OPERATOR: None
CURRENT ENVIRONMENT:
SEI_ENV state: MAINTENANCE
Wind: 4mph Gusts, 2mph 3min avg
Primary useism: 0.02 μm/s
Secondary useism: 0.23 μm/s
QUICK SUMMARY: One door and a viewport remain to be installed on HAM1.
Jennie W, Keita K,
While the laser was off and the chamber closed we measured the response function between the JAC PZT driver and the JAC TRANS A PD. We expect some coupling as the two cables are routed together along the table and to the feedthrough.
See the attached plot. The red measurement was at a whitening gain of 10 dB in Beckhoff with the -10dB filter engaged on the JAC TRANS A LF filter bank. The blue measurement is with the whitening gain at its nominal of 30dB, with the -30dB filter engaged in the filter bank instead.
We don't know yet if this level of coupling will affect us until we start locking again at our nominal input power.
Jennie W, Keita K,
Since the doors went on today, Keita and I checked our JAC + IMC model sdfs in prep for model updates to the h1ascimc model tomorrow.
I include a photo of what we accepted/reverted.
Some of these may get changed again during commissioning once we turn up the power.
Still need a similar check of SAFE sdfs for JAC locking but this is less urgent as we don't need any model changes in the near future and are still working on optimising the JAC-REFL locking.
(Travis S., Jordan V., Randy T., Gerardo M.)
Wednesday afternoon we had the opportunity to remove and replace the annulus ion pump body for BSC8 annulus system. To reach the ion pump body we used the scissor lift that Randy moved near the chamber.
No issues were encountered on the removal or installation of the ion pump body. The annulus ion pump system was evacuated and we left it pumping down with an aux cart and a small "can" turbo. On this system we used a noble diode pump, which required us to replace the controller for a positive one. Setpoints were set on the aux cart and at the end of the day the annulus system had reached below 5.0x10-05 Torr.
I powered on the ion pump yesterday morning. After pumping with both the ion pump and aux cart overnight, the IP current began decreasing, so I isolated the aux cart this morning. Ion pump was able to hold pressure no problem, so we disconnected the aux cart and brought it over for the HAM1/2 annulus pumpdown.
Picket Fence earthquake early warning system can't connect to station "UO_TOOM:HHZ", so we're only monitoring on four out of five stations.
This is strange. We shouldn't be monitoring TOOM. We deprecated it a while ago when we connected to the PNSN.
Line 39 of LHO-picket-fence.py should read:
pickets= ["HLID", "NEW", "OTR", "MSO", "DING"]
Is this correct in your version?
Edgard's list is correct. I was looking at some older code. All five stations are working again.
Now that HAM7 is at sufficient pressure (6.4E-7 Torr as of this post) we helium leak checked the two re-installed 12" CF blanks removed for table locking and the entire relay tube assembly which had been removed for the viewport adapter on HAM5.
The Helium background was unstable, so we turned on the HAM7 cleanroom (on 2/18 afternoon) to help flush the area of helium overnight.
Today the background stabilized around 1.5E-10 Torr-l/s, so we were able to continue leak checking. No significant helium signal observed above the leak detector background which hovered between 1.5&2E-10 Torr-l/s during leak checking.
HAM7 continues to pump down with the turbopump, next steps are chamber RGA scans.
HAM7 RGA scans and scan information posted to T2600064. RGA is dirty, but the chamber comparison to last pumpdown (Mar 2024) is posted.
Late entry.
Last Tuesday, 2/24/2026, HAM7 ion pump was introduced to the chamber's main volume, and currently the chamber is pumped with both; the ion pump and the turbo pump. Attached is a trend snap of the chamber's pressure since the introduction of the ion pump.
Vent Recovery Update
On Wednesday (3/4/26) the turbo pump was isolated from HAM7 to leave the ion pump take care of the pumpdown.
Since the ion pump was able to take of the pumpdown on its own, on Thursday the SS500 cart then was turned off, and eventually detached from the turbo pump at HAM7. HAM7 is back to normal operations.
Initial reports suggest the 6-hourly drop outs of sw-cur-aux-stk has been fixed by this move.
EtherCAT terminals do not have MAC addresses. Typically, the network adapter sends an Ethernet frame with its own Ether type that will flow through all terminals without being absorbed. Terminals will just read or write individual bits and bytes of this frame as it passes by, and eventually this frame will be reflected back to the adapter. This is called EtherCAT direct mode and has very good latency characteristics, but it is not comaptible with an IP based infrastructure.