WP12302 New h1iopomc0, h1omc and IPC

Jeff, Jonathan, Erik, EJ, Dave:

New h1iopomc0 and h1omc models were installed. A DAQ restart (the first of two) was performed soon afterwards due to INI changes for both models.

h1omc0 uses a custom RCG for duo-tone frequency selection and in the past, filter ramp switching. The models had been built on h1build using the modifed RTS_VERSION and RCG_SRC vars, but the h1iopomc0 model would not start because h1build has a different kernel version to h1omc's boot server (h1vmboot0). The models were rebuilt and installed using h1vmboot0 which fixed the problem.

export RTS_VERSION=5.3.0~~dual_tone_frequency

export RCG_SRC=/opt/rtcds/rtscore/advligorts-5.3.1_ramp

WP12283 Add Locklossalert slow channels to DAQ

Dave:

A new H1EPICS_LLA.ini file was generated containing all the non-string PVs hosted by the locklossalert IOC. This was added to the edcumaster.txt

These channels were added to the DAQ on the second DAQ restart.

WP12296 Vacuum Ion Pump IOC changes

Patrick, Gerardo, Dave:

Patrick made code changes on h0vacmr which resulted in some EPICS channels being removed, some being renamed and some being added.

For those being renamed, their minute trend data using the old name is being referenced using the new names.

Following list shows the oldname/newname mapping.

H0:VAC-MR_IP19_CS119_STATUS H0:VAC-MR_IPFCH7_CSH7_STATUS
H0:VAC-MR_IP19_II119_IC_AMPS H0:VAC-MR_IPFCH7_IIH7_IC_AMPS
H0:VAC-MR_IP19_II119_IC_AMPS_ERROR H0:VAC-MR_IPFCH7_IIH7_IC_AMPS_ERROR
H0:VAC-MR_IP19_II119_IC_VOLTS H0:VAC-MR_IPFCH7_IIH7_IC_VOLTS
H0:VAC-MR_IP19_II119_IC_VOLTS_ERROR H0:VAC-MR_IPFCH7_IIH7_IC_VOLTS_ERROR
H0:VAC-MR_IP19_VI119_PRESS_TORR H0:VAC-MR_IPFCH7_VIH7_PRESS_TORR
H0:VAC-MR_IP19_VI119_PRESS_TORR_ERROR H0:VAC-MR_IPFCH7_VIH7_PRESS_TORR_ERROR
H0:VAC-MR_IP20_CS120_STATUS H0:VAC-MR_IPFCA2_CSA2_STATUS
H0:VAC-MR_IP20_II120_IC_VOLTS H0:VAC-MR_IPFCA2_IIA2_IC_VOLTS
H0:VAC-MR_IP20_II120_IC_VOLTS_ERROR H0:VAC-MR_IPFCA2_IIA2_IC_VOLTS_ERROR
H0:VAC-MR_IP20_VI120_PRESS_TORR H0:VAC-MR_IPFCA2_VIA2_PRESS_TORR
H0:VAC-MR_IP20_VI120_PRESS_TORR_ERROR H0:VAC-MR_IPFCA2_VIA2_PRESS_TORR_ERROR
H0:VAC-MR_IP21_CS121_STATUS H0:VAC-MR_IPFCB1_CSB1_STATUS
H0:VAC-MR_IP21_II121_IC_VOLTS H0:VAC-MR_IPFCB1_IIB1_IC_VOLTS
H0:VAC-MR_IP21_II121_IC_VOLTS_ERROR H0:VAC-MR_IPFCB1_IIB1_IC_VOLTS_ERROR
H0:VAC-MR_IP21_VI121_PRESS_TORR H0:VAC-MR_IPFCB1_VIB1_PRESS_TORR
H0:VAC-MR_IP21_VI121_PRESS_TORR_ERROR H0:VAC-MR_IPFCB1_VIB1_PRESS_TORR_ERROR
H0:VAC-MR_IP22_CS122_STATUS H0:VAC-MR_IPFCB2_CSB2_STATUS
H0:VAC-MR_IP22_II122_IC_VOLTS H0:VAC-MR_IPFCB2_IIB2_IC_VOLTS
H0:VAC-MR_IP22_II122_IC_VOLTS_ERROR H0:VAC-MR_IPFCB2_IIB2_IC_VOLTS_ERROR
H0:VAC-MR_IP22_VI122_PRESS_TORR H0:VAC-MR_IPFCB2_VIB2_PRESS_TORR
H0:VAC-MR_IP22_VI122_PRESS_TORR_ERROR H0:VAC-MR_IPFCB2_VIB2_PRESS_TORR_ERROR

DAQ Restarts

Jonathan, Dave:

The DAQ was restarted for the first time soon after the new h1iopomc0 and h1omc models were installed. This was an unremarkable restart except that gds0 had to be restarted twice before their channel lists synced up.

The DAQ was restarted a second time towards the end of maintenance once PCAL was done and the new h0vacmr IOC had been running for a while.

This restart followed a different procedure to permit renaming of the raw minute trend files while the trend writer was inactive (see above listing).

1. Restart 0-leg, except keep tw0 down

2. Restart EDC on h1susauxb123

3. Rename vacuum raw chan files

4. Start tw0

5. Restart gds0 if needed

5 Repeat above for the 1-leg, except EDC restart is not needed a second time.

All went well except I had a copy-paste error in my raw minute trend renaming script, which required me to go onto the trendwriters afterwards and fix a file naming issue.

J. Kissel, (with model installs from D. Barker)
ECR E2500017
IIET Ticket IIET:33143
WP 12302

This morning, Dave installed the model changes I prepped yesterday (LHO:82479), that installs front-end infrastructure to downsample the output of the OMC DCPD 524 kHz test banks (originally installed in July 2024 LHO:78956), in light of all the flurry of data analysis, and it revealing confusing results in the last two weeks (LHO:82420 and LHO:82294).

These model changes have been committed to the userapps svn repo under
    /opt/rtcds/userapps/release/
        cds/h1/models/h1iopomc0.mdl   rev 30549
        omc/h1/models/h1omc.mdl       rev 30548
        omc/common/models/omc.mdl     rev 30547

Post-install, I built up MEDM screens. For now and for better or worse, all the screens are committed in the same location, 
    /opt/rtcds/userapps/release/cds/h1/medm/     
        Overview screen:
        H1OMC_DCPD_TEST_OVERVIEW.adl   
            Subordinate screens linked from overview:
            H1IOPOMC0_524KHZ_ADC0_INMTRX.adl
            H1IOPOMC0_524KHZ_DCPD_FILTERS.adl
            H1OMC_16KHZ_DCPD_FILTERS.adl
            H1OMC_DCPD_BALANCE_MATRIX_OVERVIEW.adl
            H1OMC_16KHZ_DCPD_SUMNULL_FILTERS.adl

Because the model changes came with a channel name change for the 524 kHz test filter path,
     H1:OMC-DCPD_A1   >>    H1:OMC-DCPD_524K_A1
     H1:OMC-DCPD_B1   >>    H1:OMC-DCPD_524K_A2
     H1:OMC-DCPD_A1   >>    H1:OMC-DCPD_524K_B1
     H1:OMC-DCPD_B2   >>    H1:OMC-DCPD_524K_B2
I needed to re-install all the filtering in the foton file, so I grabbed all the filters shown in LHO:82384 from 
    /opt/rtcds/lho/h1/chans/filter_archive/h1iopomc
        H1IOPOMC0_1421610658.txt
and pushed them to the cited version of the userapps svn 
    /opt/rtcds/userapps/release/cds/h1/filterfiles/H1IOPOMC0.txt   rev 30556

Finally, I set all of the EPICs records to how they're shown in the attached MEDM screen shots, accepted and unmonitored everything in the following SDF save files, and committed the fies to svn:
h1iopomc0 model's safe and OBSERVE files are linked to the same file,
        /opt/rtcds/userapps/release/cds/h1/burtfiles/h1iopomc0/safe.snap.      rev 30557

    h1omc model's safe and OBSERVE files are linked to 
        /opt/rtcds/lho/h1/target/h1omc/h1omcepics/burt/OBSERVE.snap -> /opt/rtcds/userapps/release/omc/h1/burtfiles/h1omc_OBSERVE.snap      rev 30558 
        /opt/rtcds/lho/h1/target/h1omc/h1omcepics/burt/safe.snap -> /opt/rtcds/userapps/release/omc/h1/burtfiles/h1omc_down.snap       rev 30558 

We're now in observing, and Corey had to make no adjustments to the OMCs SDF save file.

OK! That's all the pipe laying and masonry work -- now on the the science of looking at the differences between these channels!!

Closes FAMIS27660

For the CS dust monitors.

Clean & Bake: Passed both flow rate and zero count on the first try.

Staging BBSS lab: Passed both flow rate and zero count on the first try.

DR (diode room): Passed both flow rate and zero count on the first try.

LVEA: 

5: Passed flow and zero count on the first try but it's left off as it's a pumped DM.

6: Passed both flow rate and zero count on the first try.

10: Passed both flow rate and zero count on the first try.

FCES: Passed both flow rate and zero count on the first try.

For the Labs.

LAB1 (Optics): Passed zero count on the first try but the flow was a little low, I increased it.

LAB2 (PCAL/Vac Prep):  Passed both flow rate and zero count on the second try (1 ct of 0.03).

PSL: 101 (Anteroom), 102 (Laser room). I did not check these, RyanS will check them the next time he does a PSL excursion.

For the ends.

EndY: Passed both flow rate and zero count on the first try.

EndX:  Passed the zero count on the first try but I had to increase the flow rate.

After a full docket of activities, started to lock H1 around 1945 (1145am) with an Initial Alignment.  DRMI locking took 9+ min, and H1 was back to Observing by 2110 (110pmPT).

FAMIS tasks 31303 and 31318, WP 12292

Procedure checklist for both stations completed.  No issues were identified at this time.

MX: Scroll pump hours: 225.1

       Turbo pump hours: 136

       Crash bearings: 100%

EX: Scroll pump hours: 7153.0

       Turbo pump hours: 1105

       Crash bearings: 100%

WP 12296

Patrick T., Gerardo M., Dave B.

This work has been completed. The PLC code on h0vacmr is now running git version 3687c4fc15a718dc18aa07996ebcc79a57df2810 at https://git.ligo.org/cds/ifo/beckhoff/lho-vacuum.

The MEDM screens have been updated. Dave has completed the associated DAQ restart.

Since the vacuum PLC library code changed to add the Agilent IPCMini Ion Pump Controller, I built the updated library and installed it as part of this work.

I ran into memory issues again, where it complained that too much memory was in use when I tried to open more than one Visual Studio instance.

I ran into a number of errors running the Powershell script that generates the TwinCAT Visual Studio solution. A screenshot of one of them is attached. The others had more error messages, but I didn't catch them in a screenshot. The last attempt displayed an error, I think the one in the attached screenshot, but seemed to generate a working TwinCAT Visual Studio solution, so I left it at that and used it. During the process of trying to get the script to run I restarted the computer and cleaned out the modified and unversioned files in the git checkout.

Today I tuned up the FSS RefCav, as the TPD had been steadily falling over the last couple weeks.  I started with a power budget of the FSS path (leaving the ISS ON and diffracting ~4%):

• FSS In: 271.7 mW
• AOM In: 271.2 mW
• AOM Out, Single Pass: 158.7 mW
  • Single Pass Diffraction Efficiency: 58.5%
• AOM Out, Double Pass: 112.7 mW
  • Double Pass Diffraction Efficiency: 71.0 %
• EOM Out: 112.7 mW

Clearly the single pass diffraction efficiency is well below its normal value of over 70%, so I proceeded to adjust the AOM alignment to improve it.  Afterwards I adjusted the alignment of mirror M21 to improve the double pass diffraction efficiency.  I then had to adjust the FSS EOM alignment to match the beam, it was almost clipping on the output aperture.  The final power budget after all alignment tweaks (FSS In and AOM In were unchanged):

• AOM Out, Single Pass: 187.3 mW
  • Single Pass Diffraction Efficiency: 68.9%
• AOM Out, Double Pass: 134.5 mW
  • Double Pass Diffraction Efficiency: 71.8%
• EOM Out: 134.5 mW

Try as I might, I could not find an AOM alignment with a higher diffraction efficiency (it usually hangs out in the mid-70% range).  It might be time to start considering replacing the FSS AOM with a spare, as the peak single pass diffraction efficiency we've been able to achieve has been slowly falling over time.

Next I recovered the RefCav.  Some alignment was needed using the RefCav input iris as a reference, and I realigned the RefCav Refl CCD camera to re-center the image.  The RefCav locked without issue and I tweaked the alignment using the picomotor-controlled mirrors; the max TPD I could get while in the enclosure was 0.788 V, well below the maximums we've seen in the past.  Next I aligned the RefCav Refl PD (since the beam alignment had shifted) and measured the RefCav visibility:

• Unlocked: 1.100 V
• Locked: 0.223 V
• Visibility: 79.7%

Visibility is also a little lower than usual, indicating there's some mode matching work to do (or maybe another indication it's time to change the FSS AOM?).  Not much I could do about in the short amount of time left in the maintenance window, so I moved on.  With the lower than normal TPD I checked the FSS TF.  The UGF is currently ~320 kHz, which is a lower than the ~377 kHz we had at the end of the November NPRO swap.  I left the FSS gains as they are (Common Gain of 14 dB, Fast Gain of 5 dB), but we could increase the Common Gain if we find we need more gain to compensate for the lower RefCav TPD.  This complete the on-table RefCav alignment tweak.

By the time I got to the Control Room the TPD had already fallen slightly, likely due slight alignment changes as the enclosure returned to thermal equilibrium (this is normal).  I tweaked the beam alignment from the Control Room and was able to get it back to ~0.775 V (this with the IMC locked).  This completes LHO WP 12305.

Also, seeing the PSL cooling system flows not all the way back at their pre-chiller swap levels, I very slightly increased the chiller flow rate (by decreasing the amount of internal bypass); it was oscillating between 2.7 and 2.8 lpm, and is now a solid 2.8 lpm (as read at the chiller front panel).  The flow rate for the Amplifiers returned to its usual 2.2 lpm, but the flow for the power meters and the return line are still slightly down from where they used to sit, by 0.1 lpm or less.  We will monitor this and see how this effects the system (if at all, it's a very slight change).

Matt Todd, Camilla C.  Contuined from 82281. Layout D1400241.

We swapped HWS the fiber from 200um to 50um and used the CFCS11-A adjustable SMA fiber collimator to make the beam as small as possible (at the limit of collimator), it still was larger than when this work was done at EX 81734, too large to align. 

Instead we took some beam profile measurements of the beam out of the collimator, they are attached along with a photo of the table, L3 had been removed already. There was some strange wings on the beam profiler photo making the D4Sigma values unusable, photo attached. 

 Left the HWS laser off as it isn't aligned. 

FAMIS tasks 31277 and 31285, WP 12301

Procedure checklist for both stations completed.  No issues were identified at this time.

MY: Scroll pump hours: 86

       Turbo pump hours: 223

       Crash bearings: 100%

EY: Scroll pump hours: 85

       Turbo pump hours: 1291

       Crash bearings: 100%

Tue Jan 28 10:04:13 2025 INFO: Fill completed in 4min 11secs

Gerardo confirmed a good fill curbside. TC-B continues to be non-nominal.

TCmins [-79C, -35C] OAT (-2C, 28F), DeltaTempTime 10:04:22 DeltaTemp 61.1C (just squeaked in, trip is 60.0)

TITLE: 01/28 Day Shift: 1530-0030 UTC (0730-1630 PST), all times posted in UTC
STATE of H1: Observing at 157Mpc
OUTGOING OPERATOR: TJ
CURRENT ENVIRONMENT:
    SEI_ENV state: SEISMON_ALERT
    Wind: 5mph Gusts, 3mph 3min avg
    Primary useism: 0.02 μm/s
    Secondary useism: 0.11 μm/s
QUICK SUMMARY:

H1's been locked 4.5hrs and just finished magnetic injections---in Observing until Maintenance....but then just taken out for In-Lock SUS charge measurements!

Workstations updated and rebooted. This was an OS packages update.  Conda packages were not updated.

TITLE: 01/28 Eve Shift: 0030-0600 UTC (1630-2200 PST), all times posted in UTC
STATE of H1: Observing at 151Mpc
INCOMING OPERATOR: TJ
SHIFT SUMMARY: We stayed locked the whole shift, ~9 hours.
LOG: No log.

21:18 UTC Observing

05:14 - 05:22 UTC dropped observing as the SQZer lost lock and relocked. The FC struggled a little to relock.

TITLE: 01/28 Day Shift: 1530-0030 UTC (0730-1630 PST), all times posted in UTC
STATE of H1: Observing at 156Mpc
INCOMING OPERATOR: Ryan C
SHIFT SUMMARY: A lockloss and commissioning time this morning, but once that wrapped up relocking went smoothly and H1 has been observing for just over 3 hours.

• 16:31 - Dropping observing for commissioning
• 16:34 - Lockloss from Idaho EQ
  • Starting PR2 spot move commissioning; alog82481
• 20:22 - Initial alignment complete, starting lock acquisition
• 21:18 - Observing

LOG:

TITLE: 01/27 Eve Shift: 0030-0600 UTC (1630-2200 PST), all times posted in UTC
STATE of H1: Observing at 154Mpc
OUTGOING OPERATOR: Ryan S
CURRENT ENVIRONMENT:
    SEI_ENV state: CALM
    Wind: 4mph Gusts, 2mph 3min avg
    Primary useism: 0.01 μm/s
    Secondary useism: 0.12 μm/s
QUICK SUMMARY:

• We've been locked for a little over 2.5 hours
• Wind is low, 2ndary microseism is decreasing

FAMIS 31070

Since the chiller swap last week, several trends (mostly for cooling) are slightly different even though the chiller setpoints were set the same as the previous chiller.

PMC REFL continues its upward trend. The RefCav alignment is tanking, but that will be fixed with an on-table FSS alignment tomorrow during maintenance.

Summary: H1 was out of observing from 16:31 to 21:18 UTC due to a lockloss and commissioning.

Soon after dropping observing for regularly scheduled commissioning time this morning, H1 lost lock at 16:34 UTC due to a M4.2 EQ from Idaho. Commissioners then decided to still utilize commissioning time for PR2 spot moves with H1 unlocked (see other logs, especially 82481). Once most activities had finished, I ran H1 through an initial alignment and started locking, which went smoothly and automatically.

Camilla, Sheila, Erik

Erik points out that we've lost lock 54 times since November in the guardian states 557 558 transition from ETMX or low noise ESD ETMX. 

We thought that part of the problem with this state was a glitch caused when the boost filter in DARM1 FM1 is turned off, which motivated Erik's change to the filter ramping on Tuesday 82263, which was later reverted after two locklosses that happened 12 seconds after the filter ramp, 82284. 

Today we added 5 seconds to the pause after the filter is ramped off (previously the filter ramp time and the pause were both 10 seconds long, now the filter ramp time is still 10 seconds but the pause is 15 seconds).  We hope this will allow us to better tell if the filter ramp is the problem or something that happens immediately after.