Per WP11435 I performed a health check on the Kepco power supplies at EY, EX, and CER.

EY -All supplies pass, no excess vibrations, no sounds, good airflow, no temperature issues.

EX - All supplies pass, no excess vibrations, no sounds, good airflow, no temperature issues.

CER - All but one supplies pass, no excess vibrations, no sounds, good airflow, no temperature issues.

** ISC C1 - Slot 38 RHS N18V 6A 99F at fan housing, 105 at rear, very slight fan stumbling / rumbling.  We need to keep an eye on this one, spare supply is staged.

While heading out to EX I spied some wildlife very close to the OSB.  Coyote attacks on people are very rare.  What to do if a coyote approaches you, make noise, clap your hands, whistle, they will move along.

Detchar, please tell us if the 1.66Hz comb is back.

We changed the OM2 heater driver configuration from what was described in alog 72061.

We used a breakout board with jumpers to connect all OM2 thermistor readback pins (pin 9, 10, 11, 12, 22, 23, 24, 25) to Beckhoff at the back of the driver chassis. Nothing else (even the DB25 shell on the chassis) is connected to Beckhoff.

Heater voltage inputs (pin 6 for positive and 19 for negative) are connected to the portable voltage reference powered by a DC power supply to provide 7.15V.

BTW, somebody powered the OM2 heater off at some point in time, i.e. OM2 has been cold for some time but we don't know exactly how long.

When we went to the rack, half of the power supply terminal (which we normally use for 9V batteries) was disconnected (1st picture), and there was no power to the heater. Baffling. FYI, if it's not clear, the power terminal should look like in the second picture.

Somebody should have snagged cables hard enough, and didn't even bother to check.

Next time you do it, since reconnecting is NOT good enough, read alog 72286 to learn how to set the voltage reference to 7.15V and turn off the auto-turn-off function, then do it, and tell me you did it. I promise I will thank you.

This morning I ran the OPLEV charge measurement for both of the ETMs. ETMY saw some overflows during the measurement.

ETMX seems to be trending downward towards zero but most of the quads are above +\- 50 [V], ETMY seems stable and none of the quads are above +/- 50 [V].

Tue Sep 19 10:05:33 2023 INFO: Fill completed in 5min 30secs

Note, cooler outside temps mean the TCs did not saturate at -200C.

After we found the CO2X power has been degrading in 72943, I recalibrated the CO2 rotation stages this morning. Last done in March 66724.

Added a README.txt file to /opt/rtcds/userapps/release/tcs/h1/scripts/RS_calibration/ with instructions.

Also adjusted lscparams to output the existing values. Plan to relock with yesterdays output and then during lock, adjust CO2X to output 1.68W as the start of O4.
tcs_nom_annular_pwr = {'X': 0.95, #change back to 1.03 after alog72943 test
                       'Y': 1.19}
 

Picket Fence was updated with new epics channels that report IOC uptime, Picket Fence window uptime, and time since last good data was processed, from which a run status variable is determined.

New channel names are:

H1:SEI-USGS_SERVER_START_STR
H1:SEI-USGS_SERVER_UPTIME_SEC
H1:SEI-USGS_SERVER_UPTIME_STR
H1:SEI-USGS_LAST_PROCESS_GPS
H1:SEI-USGS_LAST_PROCESS_STR
H1:SEI-USGS_SINCE_LAST_PROCESS_SEC
H1:SEI-USGS_SINCE_LAST_PROCESS_STR
H1:SEI-USGS_SERVER_RUNNING
H1:SEI-USGS_IOC_START_GPS
H1:SEI-USGS_IOC_GPS
H1:SEI-USGS_IOC_START_STR
H1:SEI-USGS_IOC_UPTIME_SEC
H1:SEI-USGS_IOC_UPTIME_STR
H1:SEI-USGS_IOC_HOSTNAME
H1:SEI-USGS_IOC_PROCESS

TJ, Camilla. At 15:20 to 15:37 we drove CO2Y PZT at 80Hz and then 45Hz using H1:TCS-ITMY_CO2_PZT_OUT_GAIN_EXC via awggui, see attached. This was to check that we could drive a line using the CO2 PZT that we can later use to inject noise into DARM to understand if in future we'll need to re-install the CO2 ISS (Aidan started T2200341). Hope to repeat with H1 locked later.

Also saw that that CO2Y power meter that is measuring power injected to te IFO saw more lines than CO2X when no excitation was driving either PZT, see attached.

Control room wall displays were updated and restarted.

TITLE: 09/19 Day Shift: 15:00-23:00 UTC (08:00-16:00 PST), all times posted in UTC
STATE of H1: Preventative Maintenance
OUTGOING OPERATOR: Ryan C
CURRENT ENVIRONMENT:
    SEI_ENV state: CALM
    Wind: 8mph Gusts, 6mph 5min avg
    Primary useism: 0.03 μm/s
    Secondary useism: 0.51 μm/s
QUICK SUMMARY: H1 unlocked around 5 hours ago and was not able to relock (see alog 72955 for details). H1 is now down for Tuesday maintenance.

Workstations were updated and rebooted.  The updated included OS packages and Conda packages.  The default Conda environment is also upgraded to Python 3.10.

A list of updated Conda packages can be found here in both the September 5th and 4th versions.

What's new in Python 3.10

The IFOs been struggling to relock following this LockLoss. It couldnt find DIFF IR a few times and I had to intervene (I only had to tap DIFF offset once or twice and it found it) and I ended up doing an initial alignment as it couldn't get  

past PRMI, we spent about 10 minutes in CARM_TO_TR before it said "NO IR IN arms" after the IA. It lost lock shortly after at 14:24UTC. 

Each relock seems to have the same trouble with DIFF IR, it being just 1 or 2 taps away but saying NO IR found

TITLE: 09/18 Eve Shift: 23:00-07:00 UTC (16:00-00:00 PST), all times posted in UTC
STATE of H1: Observing at 135Mpc
INCOMING OPERATOR: Ryan C
SHIFT SUMMARY:  Windstorm rolled through this evening and it was surprising how long H1 was able to stay locked through it (it almost made it through, but eventually succombed.).  Squeezer caused one drop from Observing.
LOG:

• 0000  "Wap on in LVEA, EX, EY" on Verbal.  It was just under 6-secs (and similar to alog 71898).
• 0114 - 0116 Knocked out of Observing due to Squeezer (Manager, FC & LO_LR nodes dropped us out, but they came back on their own within a couple minutes).
• 0327 LOCKLOSS
  • After several consecutive locklosses, took 30min to hold at Green Arms to wait out the breeze.
  • 0435 I should have taken Observatory Mode to WIND after the lockloss (my bad), I took it to WIND at this time to at flag some of the time with wind.
  • When returning to locking, IR Was Not Found, so I paused here and then only need to move Diff Offset a little to Find IR.
  • Since H1's been down a while in the wind, decided to proactively go first to CHECK MICH FRINGES, and then carry on from there....there were a couple of locklosses as PRMI was offloading...so for the next lock and had H1 just go through the normal sequence to NOMINAL LOW NOISE.
  • 0609 H1 is now back to OBSERVING.  (it did take the Camera Servo about 20min before I could take H1 to Observing).

Green arms are now aligned but H1 has had locklosses at early stages (i.e. FIND IR & LOCKING ALS), but winds are still hitting about 25mph.  So will hold at LOCKING ARMS GREEN and then try for more in about 30min.

The wind storm still rages, but it might be showing hints of calming.

There was a 2-min drop from observing due to the Squeezer's IR Filter Cavity unlocked at 0114utc (it came back on its own).

• "Corey, Check Out DARM."   ~Camilla C
• "Not Unexpected, But Unfortunate."   ~Jeff K.

Starting around 30+min ago, the wind gusts have passed the 30mph threshhold and are touching 40mph!  This is leading to our local "perfect storm":  (1) high winds (see image #1) and (2) high microseism (see image #2). 

Jeff mentioned the distinct noise bump on DARM between 20-80Hz (see image #3) is characteristic of stray light hitting our EX Cryobaffle when we have a noisy environment such as this.  This has also dropped our range down around 100Mpc (from 140) [see image #4].

With all this said, it's impressive H1 is riding through this noisy Earth!  According to NOAA, we will be under a red flag warning (screenshot is image #5) for another ~3hrs (or 8pmPT / 0300utc).

The BBB channel was continually going into the alarm range.  It's been removed from Picket Fence FOM and EPICS.

The steps for removal were:

1. Edited /opt/rtcds/userapps/release/isi/h1/scripts/Picket-Fence/LHO-picket-fence.py.  Commented out the block at line 39 that adds the "BBB" channel.

2. VNC to nuc5.  Close the Picket Fecne window.

3. ssh as controls to nuc5.  Run "start/launch.sh".  This restarts the Picket Fence FOM, which also sets the EPICS variables.