If any of the LVEA pneumatic gatevalues were to change their status (OPEN, SOFT-CLOSE, HARD-CLOSE), the alarms system will now send out text and email messages within 2 minutes.
Following from the airflow changes yesterday at the end station Adnaco chassis, the h1cdsrfm cards have maintained their new temps of (ey, ex, cs) = (64C,75C,61C).
Scanning all the cards this morning, their temps are in the range 61C to 79C (full list below).
61C = h1cdsrfm,h1omc0
79C = h1seib2,h1seih45
h1asc0.txt: 65C
h1cdsh8.txt: 72C
h1cdsrfm.txt: 64C
h1cdsrfm.txt: 75C
h1cdsrfm.txt: 61C
h1iscex.txt: 72C
h1iscey.txt: 71C
h1lsc0.txt: 64C
h1oaf0.txt: 63C
h1omc0.txt: 61C
h1seib1.txt: 72C
h1seib2.txt: 79C
h1seib3.txt: 74C
h1seiex.txt: 71C
h1seiey.txt: 70C
h1seih16.txt: 74C
h1seih23.txt: 71C
h1seih45.txt: 79C
h1seih7.txt: 74C
h1susb123.txt: 72C
h1susex.txt: 66C
h1susey.txt: 71C
h1sush2a.txt: 66C
h1sush2b.txt: 72C
h1sush34.txt: 72C
h1sush56.txt: 66C
h1sush7.txt: 65C
Addressed TCS Chillers (Wed [Aug7] 754-804am local) & CLOSED FAMIS #27795:
FAMIS: 26280
Laser Status:
NPRO output power is 1.829W (nominal ~2W)
AMP1 output power is 64.06W (nominal ~70W)
AMP2 output power is 136.4W (nominal 135-140W)
NPRO watchdog is GREEN
AMP1 watchdog is GREEN
AMP2 watchdog is GREEN
PDWD watchdog is GREEN
PMC:
It has been locked 28 days, 21 hr 1 minutes
Reflected power = 19.8W
Transmitted power = 107.1W
PowerSum = 126.9W
FSS:
It has been locked for 20 days 17 hr and 33 min
TPD[V] = 0.6431V
ISS:
The diffracted power is around 2.2%
Last saturation event was 21 days 18 hours and 46 minutes ago
Possible Issues:
AMP1 power is low
PMC reflected power is high
FSS TPD is low
Wed Aug 07 08:10:45 2024 INFO: Fill completed in 10min 41secs
Travis confirmed a good fill curbside.
Ran the Check_Dust_Monitor script and one of the PSL dust monitor is stuck at the same value & will need to be checked.
edit: this is a KNOWN issue. It's just that incursions into the PSL are somewhat rare & I had forgotten about this one. This is a dust monitor in the anteroom--the dust monitor in the main PSL room is still operational.
I went into the anteroom shortly after 19:00 UTC (12:00 PDT) and reset this dust monitor. It came back to life and successfully completed a counting pass, so communication should be restored.
TITLE: 08/07 Day Shift: 1430-2330 UTC (0730-1630 PST), all times posted in UTC
STATE of H1: Corrective Maintenance
OUTGOING OPERATOR: n/a
CURRENT ENVIRONMENT:
SEI_ENV state: MAINTENANCE
Wind: 4mph Gusts, 3mph 5min avg
Primary useism: 0.01 μm/s
Secondary useism: 0.07 μm/s
QUICK SUMMARY:
Pumpdown of the Corner volume started last night---Janos just went out to continue Corner Pumping this morning. (HAM7 also started to be pumped down yesterday.)
Les Guthman and film crew are here for day 2 of filming.
1,7 and 30 day trends of the INST AIR pressure signal can be viewed on the Ndscope Trend Web Page
Today's activities: - The relay tube was installed, and was leak checked: no leaks bigger than 1E-10 Torr have been detected - The HAM5/HAM6 annulus system is being pumped down. The Turbo backing line is already at around ~4E-5 Torr - The Mobile pumping station with 2 pcs. of ISP1000 pumping carts and with the mobile transformer has been installed next to the OMC Turbo station (see picture, and see the PID according to LIGO-E2300443-v1 Main volume Double Mobile Scroll Turbo Startup Procedure, Appendix II.) - The checklist for pumpdown has been done according to LIGO-E2300169-v2 - The dew point at the OMC venting port in the chamber was measured -38.9 deg C, which is surprisingly good (details: https://alog.ligo-wa.caltech.edu/aLOG/index.php?callRep=79483) - The pumpdown of the corner has started. With the Double ISP-1000 carts it is pretty quick: the pumpdown started at 16:15, and at 19:07 the pressure is already 167 Torr, which means 1900 l/min (at the Turbo station, as the pressure is already <100, it is well over 2000 l/min, as it should be) - The pumpdown of HAM7 has also started, it is pretty fast, as it was anticipated, since no doors were opened there. It is already at 1.2E-5 Torr. See details here: https://alog.ligo-wa.caltech.edu/aLOG/index.php?callRep=79482 As you can see in both pictures, the HAM5-HAM6-HAM7 area is very busy with vacuum equipment, so please only go there if it is absolutely necessary, and if you do, be very careful. Especially the Pfeiffer pumping carts can tip over easily (remember last pumpdown), and in general, Turbo pumps don't like movement - they can easily trip off. Now there are 2 Pfeiffer pumping carts, 3 more small Pfeiffer turbos, a leak checker, a supersucker cart, the new double ISP-1000 mobile pumping station, and the HAM7 turbo up and running. There were a couple of other issues, too: - The PT-154 (MKS) gauge, between HAM7 and BSC3 on the FCT, falsely shows 1E-3 Torr. It needs replacement, which will be done after O4 - The instrument air compressor failed to switch on one more time at around 16:45. The aLog about the last failure is here: https://alog.ligo-wa.caltech.edu/aLOG/index.php?callRep=79443. It was restarted with some struggle, but it seems that the only real solution is to replace it. A Nitrogen and a compressed air bottle was staged in the mechanical room, just in case
Dew point measurement taken this morning read at -43.7 oC. No demand on system, HAM5 and HAM6 all doors on.
Blow down dew point measured at -38.9 oC before pump down started.
HAM7 pump down went very smooth, no issues encountered during this process.
Blowdown dew point measurement was at -40.0 oC.
Pump down cart, SS500, was set to manage the pump down, now that the turbo pump is on, the cart can manage the selenoid valves in case of an emergency.
Pressure at HAM7 is 1.19X10-05 Torr.
HAM7 1 day pump down trend.
In response to recent failures of the air compressor that's holding open some of the gate valves:
There's now a 6-hour trend of the air pressure on the lower left corner of the top screen for nuc28.
If the compressor is working, there should be a saw tooth pattern between 60 and 85 PSI, at 90+ minutes per tooth.
When the pressure drops below 40, the pneumatic gate valves are in danger of closing.
This can be seen on the lhocds screen shots page at (it updates regularly): https://lhocds.ligo-wa.caltech.edu/cr_screens/png/nuc28-1.png It is on the 'lock clock' section of the main screen shots page: https://lhocds.ligo-wa.caltech.edu/cr_screens/ These both require credentials to access.
The control room reported visibility issues with the dark color scheme (blue on black). I have changed it to blue on white and thickened the line.
DaveB, RickS
Dave changed the image on the contrl room PSL screen (Nuc 21) and at the Laser Room to show a larger image of the PSL table.
Laser Room make-up air fan speed set to 100%. Lights are OFF, but will be switched on in the morning.
I changed the make-up air speed back to its nominal setting of 20% at ~19:15 UTC (12:15 PDT) on 8/7/2024. The make-up air being on did cause the Laser Room temperature to drop by a couple degF, which in turn caused the output power of both Amp1 and Amp2 to drop by ~2W each; will monitor over the next several hours to ensure things return to normal as the enclosure returns to its normal thermal equilibrium.
Noticed that GV5 had hard closed on Saturday at 19:59 utc time, no human intervention. It appears as if the instrument air pressure left for soft close GV5 was enough to hard close it. According to PEM instruments near GV5 made lots of noise, see attached plot, accelerometer and microphone data.
I checked the dial on the gauge to measure the instrument air at GV5, and indeed there was only about 10 psi, this value is within the "usual" pressure used for soft clossing pneumatic gate valves and per procedure.
No interaction is required at this moment from the vacuum team.
Tagging ISC, since sensitive equipment is hanging near this gate valve, like cameras and OpLevs.
I converted this microphone DQ signal to an audio wav file. The microphone saturates at +/-32768 for a fraction of a second, but you can hear the echo fade away after this.
Here is the accelerometer as a wav audio:
(new file added at 13:52, orig file was created using the incorrect frequency of 16kHz, this is actually a 8kHz channel)
The ITMY Oplev (aligned at the time) didn't see this hard close, plot attached.
Remember GV1 is closed, this makes ITMY Oplev blind, Sum on trend above is very small.
+<!-- Pneumatic Gate Valves -->
+
+<!--
+
+STATUS 07 AUG 2024
+
+ |
+ |
+ (GV6) OPEN
+ [CP1]
+ (GV5) HARD-CLOSE
+ |
+ |
+ |___________(GV7)[CP2](GV8)________
+ SOFT-CLOSE OPEN
+
+ ANIM PV (hex)
+ OPEN 65280 (0xff00)
+SOFT-CLOSE 4080 (0x0ff0)
+HARD-CLOSE 255 (0x00ff)
+-->
+
+<!-- GV6 -->
+<Channel name="H0:VAC-LY_GV6_ZSM169A_VALVE_ANIM" low="65279" high="65281" description="GV6">
+ <Contact address="5094380826@vtext.com" hot="2" cool="5" description="C:David Barker"></Contact>
+ <Contact address="5094380828@vtext.com" hot="2" cool="5" description="C:Gerardo Moreno"></Contact>
+ <Contact address="5182105653@tmomail.net" hot="2" cool="5" description="C:Jordan Vanosky"></Contact>
+ <Contact address="barker@ligo-wa.caltech.edu" hot="2" cool="2" description="E:Dave Barker"></Contact>
+ <Contact address="gmoreno@caltech.edu" hot="2" cool="2" description="E:Gerardo Moreno"></Contact>
+ <Contact address="tsadecki@caltech.edu" hot="2" cool="2" description="E:Travis Sadecki"></Contact>
+ <Contact address="jvanosky@caltech.edu" hot="2" cool="2" description="E:Jordan Vanosky"></Contact>
+ <Contact address="janos@caltech.edu" hot="2" cool="2" description="E:Janos Csizmazia"></Contact>
+</Channel>
+
+<!-- GV5 -->
+<Channel name="H0:VAC-LY_GV5_ZSM159A_VALVE_ANIM" low="254" high="256" description="GV5">
+ <Contact address="5094380826@vtext.com" hot="2" cool="5" description="C:David Barker"></Contact>
+ <Contact address="5094380828@vtext.com" hot="2" cool="5" description="C:Gerardo Moreno"></Contact>
+ <Contact address="5182105653@tmomail.net" hot="2" cool="5" description="C:Jordan Vanosky"></Contact>
+ <Contact address="barker@ligo-wa.caltech.edu" hot="2" cool="2" description="E:Dave Barker"></Contact>
+ <Contact address="gmoreno@caltech.edu" hot="2" cool="2" description="E:Gerardo Moreno"></Contact>
+ <Contact address="tsadecki@caltech.edu" hot="2" cool="2" description="E:Travis Sadecki"></Contact>
+ <Contact address="jvanosky@caltech.edu" hot="2" cool="2" description="E:Jordan Vanosky"></Contact>
+ <Contact address="janos@caltech.edu" hot="2" cool="2" description="E:Janos Csizmazia"></Contact>
+</Channel>
+
+<!-- GV7 -->
+<Channel name="H0:VAC-LX_GV7_ZSM179A_VALVE_ANIM" low="4079" high="4081" description="GV7">
+ <Contact address="5094380826@vtext.com" hot="2" cool="5" description="C:David Barker"></Contact>
+ <Contact address="5094380828@vtext.com" hot="2" cool="5" description="C:Gerardo Moreno"></Contact>
+ <Contact address="5182105653@tmomail.net" hot="2" cool="5" description="C:Jordan Vanosky"></Contact>
+ <Contact address="barker@ligo-wa.caltech.edu" hot="2" cool="2" description="E:Dave Barker"></Contact>
+ <Contact address="gmoreno@caltech.edu" hot="2" cool="2" description="E:Gerardo Moreno"></Contact>
+ <Contact address="tsadecki@caltech.edu" hot="2" cool="2" description="E:Travis Sadecki"></Contact>
+ <Contact address="jvanosky@caltech.edu" hot="2" cool="2" description="E:Jordan Vanosky"></Contact>
+ <Contact address="janos@caltech.edu" hot="2" cool="2" description="E:Janos Csizmazia"></Contact>
+</Channel>
+
+<!-- GV8 -->
+<Channel name="H0:VAC-LX_GV8_ZSM189A_VALVE_ANIM" low="65279" high="65281" description="GV8">
+ <Contact address="5094380826@vtext.com" hot="2" cool="5" description="C:David Barker"></Contact>
+ <Contact address="5094380828@vtext.com" hot="2" cool="5" description="C:Gerardo Moreno"></Contact>
+ <Contact address="5182105653@tmomail.net" hot="2" cool="5" description="C:Jordan Vanosky"></Contact>
+ <Contact address="barker@ligo-wa.caltech.edu" hot="2" cool="2" description="E:Dave Barker"></Contact>
+ <Contact address="gmoreno@caltech.edu" hot="2" cool="2" description="E:Gerardo Moreno"></Contact>
+ <Contact address="tsadecki@caltech.edu" hot="2" cool="2" description="E:Travis Sadecki"></Contact>
+ <Contact address="jvanosky@caltech.edu" hot="2" cool="2" description="E:Jordan Vanosky"></Contact>
+ <Contact address="janos@caltech.edu" hot="2" cool="2" description="E:Janos Csizmazia"></Contact>
+</Channel>
+