Wed CP1 Fill

Wed Apr 22 10:12:38 2026 INFO: Fill completed in 12min 34secs

 

Ops Day Shift Summary

TITLE: 04/22 Day Shift: 1430-2330 UTC (0730-1630 PST), all times posted in UTC
STATE of H1: Planned Engineering
INCOMING OPERATOR: None
SHIFT SUMMARY: More progress towards preparing to remove the BSC2 cartridge, both in-chamber and out, which is now slated to happen on Monday.

• Walking platforms around the BSC2 ISI were installed: alog89977
• BS OpLev positioning was determined to be good: alog89978
• IOT2L was de-cabled to prepare for its move away from the HAM2 +Y door: alog89975
• More water lines on the TCSX table were replaced: alog89976

LOG:

Start Time	System	Name	Location	Lazer_Haz	Task	Time End
14:39	FAC	Kim, Nellie	LVEA	-	Technical cleaning	16:00
14:39	FAC	Randy	LVEA	-	Craning walk platforms at E-mod	15:36
15:29	SUS	Betsy	LVEA	-	Staging for BSC2	16:26
15:46	SUS	Ibrahim	LVEA	-	Staging for BSC2	16:26
15:48	EE	Fil	LVEA	-	De-cabling IOT2L	16:51
16:00	FAC	Nellie	EY	-	Technical cleaning	16:47
16:07	TCS	Camilla, TJ	LVEA	-	CO2X table water pipe swap	16:58
16:08	FAC	Kim	MX	-	Technical cleaning	16:45
16:52	EE	Fil	MER	-	HAM6 SUS cabling	19:37
17:09	AOS	Jennie, Tony	LVEA	-	Scouting IOT1 table position	17:15
17:12	EE	Marc	LVEA	-	Grabbing a chassis	17:20
17:25	SUS	Ibrahim, Betsy, Oli	LVEA	-	Inspecting BS and OpLev in-chamber	18:57
18:14	TCS	TJ, Camilla	LVEA	-	CO2X table water pipe swap	19:44
18:26	CAL	Tony	EY	-	Checking PCal interlock	18:50
18:31	SUS	Mitchell	LVEA	-	Dropping off parts	18:52
18:33	FAC	Randy	LVEA	-	Walkabout	18:57
19:50	FAC	Randy, Mitch, Travis	LVEA	-	Installing BSC2 walk platforms (Travis out @ 20:47, Mitch out @ 21:38)	21:50
20:04	FAC	Tyler	EX	-	Checking chiller	20:51
20:33	AOS	Betsy	LVEA	-	Staging for BSC2	21:12
20:50	AOS	Ibrahim	LVEA	-	Staging for BSC2	21:50
21:13	ISC	Camilla, Tony	LVEA	-	Rolling up IOT1	21:46
21:22	SUS	Jason	LVEA	-	Checking BS OpLev pointing	22:11
21:32	SUS	Betsy	LVEA	-	Checking BS OpLev pointing, other checks	22:29
21:41	ISC	Jennie, Madi	LVEA	-	Rolling up IOT1	21:46
22:59	EE	Marc	LVEA	-	Installing chassis	23:30

BS OpLev Visual Inspection

B. Weaver, J. Oberling

With trends of the BS OpLev posted here and here, Betsy and I decided to also go out and physically look at where the beam is on the OpLev QPD.  The beam itself sits a little bit low and about half-way to one edge of the QPD.  I've attached a couple of pictures, but they aren't the best quality due to low light and difficult access (the BS OpLev sits on the +X/-Y BSC2 HEPI pier, between the pier and the chamber, roughly 7 feet above the floor).  The 2nd picture is viewing the QPD using an inspection mirror, hence why it is flipped w.r.t. the 1st picture.  My phone camera couldn't really pick out the actual OpLev beam, it instead registered it as a "blob" on the QPD (pointed to by the yellow arrows in each picture); the beam itself is roughly in the center of the blob and looks by my eye to be approximately 1.5mm to 2mm in diameter.  The bright spot seen off to the side in each picture is NOT the beam, it is scatter that is reflecting off of a component on the QPD amplifier board.

Based on this, we decided to NOT recenter the BS OpLev before cartridge removal, as the beam is not near the edge of the QPD.

BSC2 Cartidge preps

PARTICLE COUNTS in Cleanroom Tent on top of BSC2:  All zeros (or puffs of 10) across from the HEPA flow bank on the opposite side of the ISI pillow, see pix attached.  Counted just after crew left area doing walking plates.  The Tent is working as planned.

PEM BNCs wandering across the West bay was coiled up out of the way of all of the heavy foot traffic.

PEM WEST BAY WALL COIL cables across floor has been disconnected and also coiled up and now out of the way of heavy foot traffic. 

Travis/Mitchell/Randy installed the Walking Plates for better access to the ISI up at the platform level.  Note, after some deliberation and re-reviewing of the drawings (which are actually incorrect), it turns out that you cannot attach the bolts to the underside of the flanges anyways due to in-accessibility of the area.  LLO doesn't recall using them recently either. (Last picture)

Majority of TCSX on-table water lines swapped

TJ, Camilla 

We have almost finished swapping all TCSX on table water lines to new ones as started in alog 89974, photo attached. The new beamdump lines didn't fit the connectors tightly so the old lines have been left for now. The table has not yet been tested for leaks. 

ISCT2 Cabling Disconnected

WP 13189

In preparation for HAM2 door removal, the ISCT2 table enclosure cables have been disconnected.

End Station DC Power Supply Photographs

While at the end stations yesterday I took photos of the DC power supplies. I've included them here for future reference.

left-rack/right-rack is as viewed standing in front of the racks. Note that the end stations are mirror images of each other.

 

Ops Day Shift Start

TITLE: 04/22 Day Shift: 1430-2330 UTC (0730-1630 PST), all times posted in UTC
STATE of H1: Planned Engineering
OUTGOING OPERATOR: None
CURRENT ENVIRONMENT:
    SEI_ENV state: MAINTENANCE
    Wind: 26mph Gusts, 17mph 3min avg
    Primary useism: 0.07 μm/s
    Secondary useism: 0.18 μm/s 
QUICK SUMMARY: Activities today mainly to continue prep for BSC2 cartridge removal. Some more TCS water line work and cabling happening today as well. It's raining.

EY Safety Interlock System

WP 13194

The EY interlock system was found with both the ALS and PCAL laser enable outputs disabled. Trending the laser enable channels shows channels went offline during upgrades to the H1SEIEY IO Chassis. Both the EK1501-0010 coupler and EL2904 binary output terminals were replaced. The 24V DC power to the Safety Interlock Chassis was moved to a dedicated 24V power supply.

Ops Afternoon Shift Summary

TITLE: 04/21 Day Shift: 1430-2330 UTC (0730-1630 PST), all times posted in UTC
STATE of H1: Planned Engineering
INCOMING OPERATOR: None
SHIFT SUMMARY: Busy day after taking over from Corey. End-of-day optic alignment trends are attached; only things of note are that MC2 is now MISaligned after the Guardian restart today.

• Work on BSC2 continued with HEPI actuators and walking plates
• TCSX water lines on the optical table started to be replaced
• Guardian computer upgraded to Debian 13
  • When nodes came back online, this turned BS OpLev damping on, so the suspension was erroneously moving a bit for the afternoon (outputs turned off @ 23:18 to fix)
• Laser interlock chassis at EY was worked on, see alog89965 for some details
  • This brought the site interlock down for a while; I've recovered the PSL but other lasers remain off until they're needed again
• Turbopump on CP1 installed, see alog89967

LOG:

Start Time	System	Name	Location	Lazer_Haz	Task	Time End
17:38	CAL	Tony, Marc	PCal Lab	-	Looking for parts	17:52
17:38	TCS	TJ	LVEA	-	TCSX expansion joint	18:05
18:10	IAS	Ryan C	LVEA	-	FARO in West bay	19:11
18:20	IAS	Jason	LVEA	-	FARO in West bay	19:11
18:28	CAL	Tony, Fil, Marc	EY	-	PCal chassis troubleshooting	18:51
18:35	FAC	Randy	LVEA	-	Pictures in mega cleanroom	18:43
19:26	FAC	Randy	LVEA	-	Prep for BSC2 platform craning	19:47
19:29	PEM	Ryan C	CER	-	Testing dust monitor	19:39
19:52	EE	Fil, Marc	EY	-	PCal chassis/interlock work	23:11
20:03	SEI	Jim, Randy	LVEA	-	Craning BSC2 walking plates	21:30
20:05	PEM	Ryan C	CER	-	Swapping dust monitors	20:12
20:41	IAS	Jason, Ryan C	LVEA	-	FARO in West bay	22:41
20:43	TCS	TJ	LVEA	-	Prep for TCSX table line swaps	20:58
20:58	CDS	Dave	EY	-	Chassis power supply swap	22:08
21:04	VAC	Travis, Jordan	LVEA	-	Craning BSC2 walking plates	21:23
21:21	CDS	Erik	CR	-	Powering off h1iopiscey	21:21
21:59	TCS	TJ	LVEA	-	TCSX table water line replacements	23:44
22:09	SEI	Jim, Mitch	LVEA	-	BSC2 HEPI actuators	23:26
22:14	TCS	Camilla	LVEA	-	TCSX table water line replacements	23:51
22:35	CDS	Dave	EX	-	Checking power supplies	23:08
22:51	IAS	Jason, Ryan C	FCES	-	Grabbing equipment	23:24
23:11	EE	Fil, Marc	LVEA/OptLab	-	Inventory	00:11
23:32	PEM	Ryan C	CER	-	Dropping off dust monitors	23:33
23:34	VAC	Jordan	LVEA	-	Pictures of CP1	23:40
23:42	CAL	Tony	EY	-	Bringing PCal back up	01:42

Installation of Turbopump on CP1

In prep for the C1 regen, we installed the SS500 turbopump on the +X port of CP1, along with a full range gauge and roughing port. This replaced an old Edwards turbopump assembly with the new pump which is compatible with the SS500 cart.

Additionally, since we will not be venting the cryopump to atmosphere during the regen, we can not remove the old CETEC valve and replace with a new VAT valve. So we added a 12" spool on the CETEC valve and then the new redundant 10" VAT gate valve. Once the regen procedure is complete the CETEC valve will remain open and isolation will occur using the new VAT valve.

All new joints were helium leak checked, and no leaks found above the leak detector background of ~4.7E-10 Torr-l/s.

CDS Maintenance Summary: Tuesday 21st April 2026

WP13187 restart h1ioplsc0 to fix timing issue.

Dave:

At 09:55 h1ioplsc0 (and therefore all models on h1lsc0) was restarted to see if this would clear up the recent spate of IOP timing glitches seen in the past week. So far, so good.

WP13180 h1susauxb2h34 model, add LO1,2 voltage monitors

Jeff, Oli, Erik, Dave:

A new h1susuaxb2h34 model was installed which reads the newly installed 9th ADC for LO1,2 voltage monitor signals. A DAQ restart was required.

New h1spih23 model

Jeff, Dave:

We installed a new h1spih23 model which added 4 slow channels, REF/MEAS CONSCALE for A/B. A DAQ restart was required.

WP13186 h1guardian1 upgrade to Debian 13

TJ, Erik:

h1guardian1 was upgraded to Debian13. This was a from-scratch install using new boot drives. Puppet did a lot of the configuration but some hand editing was also needed.

DAQ Restart:

Erik, Dave:

The DAQ was restarted for the two model changes above. 

FW0 spontaneously restarted when FW1 had just got going.

NDS1 restarted at the time h1guadian1 was coming up, we assume that this was caused by a guardian NDS query storm.

FW2 has been down since 02:34 this morning and stopped updating around 05:02. At the time of the DAQ restart we found FW2 running again without no intervention. Following the DAQ restart FW2 died completely. I restarted rts-daqd_rs by hand, it kinda worked but seemed to be a whole full frame behind. So I stopped it for now.

WP13190 EY +24V Power Work.   WP13181 PCALY recovery

Erik, Marc, Fil, Tony, Dripta, Richard, Dave:

The cause of the PCALY trip during IO Chassis upgrades Thursday 9th April was tracked to a shared +24VDC power supply between h1seiey and the laser-interlock-chassis.

Fil and Marc moved the interlock power from this shared power supply to a safety-system PS.

This left two remaining issues with EY +24VDC power: h1iscey was not on the correct PS and the SEI-C1 was still supplying the BRS beckhoff mini-terminals.

We took care of the first item. Marc ran a long 24V power cable from the back of h1iscey IO Chassis to the SEI-C1 power strip (mirroring what was done at EX).

We recorded the current draw on all the power supplies before and after the change, and attempted to measure the current surge when h1iscey was powered up.

Here are the +24VDC currents recorded

+24VDC Power Supply	Powers:	Current Before	Current After	Power-On Current Surge
SUS-TC1,2	SUSEY, SUSAUXEY	5.0A	-	-
ISC-YC1, TCS-YC1	Beckhoff -[ISCEY]	9.0A	6.0A	-
SEI-YC1	SEIEY +[ISCEY]	3.2A	5.0A	6.0A (+1 A)

Note that the interlock had already been removed from SEI-YC1 at this time.

This just leaves the BRS Beckhoff terminals incorrectly attached to SEI-YC1, but their current draw sould be negligible.

Here are the EX current values for completeness.

+24VDC Power Supply	Powers:	Current
SUS-C2	SUSEX, SUSAUXEX	5.5A
ISC-C1	Beckhoff	5.0A
SEI-C1	SEIEX, ISCEX	6.0A

 

TCSX supply line expansion joint OK

Randy T., Camilla C., TJ S.

After the chiller was found tripped off and water was found in the plastic "leak containment apparatus" last week (alog89931), we expected to have to replace the expansion joint as we did in January 2024 (alog75657). Turns out, the expansion joint is okay but the fittings have loosened themselves overtime not just on this line but some of the others as well. More details below.

Today when Randy went to go swap the joint out for a used spare, he noticed that the fittings were very loose, not only on the TCSX supply line, but on a few others. He re-tightened all fittings and we decided to test it out slowly with water. Camilla tried to turn on the chiller, but it would shut itself off saying "low flow". She and I then closed the 3way valve in back which makes the chiller run in a closed loop within the chiller. This worked to get it to run. We then slowly opened that valve to slowly allow water to start flowing down the supply line. Randy was waiting and watching at the joint and never saw any water leaking out during the ~5 min test.

At this point we think that the water just leaked out of the loose fittings when the quick connect was disconnected last week. The updated chiller settings most likely helped and turned off the chiller before the pressure reached levels that could cause damage to the system. We will add checking the tightness to the quarterly pipe check FAMIS task. 

Next steps - start on replacing the TCSX table flex lines, and work on making a unistrut cage around the quick connects to avoid bumps in the future.

Tues DAY Ops Summary

TITLE: 04/21 Day Shift: 1430-2330 UTC (0730-1630 PST), all times posted in UTC
STATE of H1: Planned Engineering
INCOMING OPERATOR: None
SHIFT SUMMARY:

Covering the morning Ops shift & handing off to RyanS.
LOG:

• 1431-1553 Technical cleaning @lvea (nellie.kim)
  • 1553-1703  kim will head to  @ex
  • 1553-1630 nellie @my
• 1500-1604 Property inventory checks in livea & optics lab (christina)
• 1547-1552 Checking to see if FARO did an auto-power-up this morning (ryanc)
• 1557-1629 cp1 turbo (new) leak checking (jordan, gerardo)
• 1615-1645 3ifo checks in lvea & then out-bldgs (tyler)
• 1615 FAMIS checks (chris)
• 1619 FARO procedure tests in northbay (jason.ryanC)
• 1628-1645 pipe bridge, tcsx (tj.randy)
  • 1645 TCSy chiller turned OFF (tj)
  • 1645 randy swapping out tcsx expansion joint on piping platform
• 1628 Pcal lab grabbing parts for EY (tony)
  • Went to EY after and was done at EY at 1735.
• 1629-1703 EY annulus pump check (jordan.gerardo)
• 1645 Guardian server work (WP13186) begins with TJ having me taking SEI nodes to desired states (mainly ISI DAMPED HEPI OFFLINE)
  • Eric & TJ beginning guardian server work.
  • 1708 Connection error for many/all guardian nodes
• 1655 h1ioplsc0 restart to try and fix timing errors (dave, W13187); will do a daq restart around 1130.
• 1703 hepi actuator stuff @bsc2 (mitch,jim)
• 1717-1733 return to cp1 turbo (new) leak checking (jordan, gerardo)
• 1720 EY property inventory (fil)
• 1724 Flushing TCSx system test (camilla, randy)
• 1729 Ibrahim looking for randy
• 1739 handing off to RyanS.

h1guardian1 machine down for OS upgrade

WP13186 TJ, Dave, Erik:

10:07 h1guardian1 powered down for OS upgrade to Debian13.