Betsy, Camilla
PSL locked out at 2W. ALS shutter closed. LVEA now in laser safe.
Now nearing closeout of HAM1 ISC/IO (Final cable routing tweeks, SEI table float/bal, and final SUS TTs up next for a day or so):
Stat | Notes | |
All LSC/ASC diode boxes functional and aligned | DONE | All have appropriate channel response |
Finish BDs in front of POP diodes | DONE | Could see with MICH/POP flashes |
Beam Diverters functional and reflection beams dumped | DONE | Daniel swapped the REFL logic which we needed to do for the new beam layout. |
4 Pico-motors tested, center-ish in range | DONE | All functional. |
4 Beams aligned out of chamber, through VP simulator and onto ISCT1 | DONE | Will need to work on ISCT1 to finish alignment once chamber closed |
Finish aligning all beam dumps | DONE | |
Final RF check - Sigg | ||
Final ground loop checks (diodes, PM1, picos, BDVs) | ||
Post SEI table float, last beam check prior to door | Might need a tweek if PM1 gets any SUS adjustments | |
Removed metal name tags | DONE | |
Removed temp mirror knobs | DONE |
Updated Tuesday 13th May to mark the following as DONE: finish BDs in front of POP diodes, 4 Pico-motors tested, center-ish in range, Finish aligning all beam dumps, Removed temp mirror knobs. All laser hazard tasks completed (we may do a final check before closeout).
WP12529
Jonathan, Erik, Daniel, Dave:
The EDC on h1susauxb123 was restarted to ensure a clean connection to the Beckhoff slow controls EPICS channels. Following Daniel's restart of the slow controls IOC yesterday for a code change, it was noted that the EDC was still serving the old value while caget was reporting the correct value. Later when the channel was manually switched the EDC obtained and served the correct value. Testing of a random sample of about 400 channels out of 35,588 did not find any other channels in error, but to be sure we did the EDC restart this morning.
No full DAQ restart was required.
The EPICS channel data gap while the EDC was being restarted was 27 seconds. Attached plot of a vacuum channel shows the details.
Tue May 13 10:11:08 2025 INFO: Fill completed in 11min 4secs
Gerardo confirmed a good fill curbside.
Dry air skid checks, water pump, kobelco, drying towers all nominal.
Dew point measurement at HAM1 -45.8 °C
.
TITLE: 05/13 Day Shift: 1430-2330 UTC (0730-1630 PST), all times posted in UTC
STATE of H1: Planned Engineering
OUTGOING OPERATOR: None
CURRENT ENVIRONMENT:
SEI_ENV state: MAINTENANCE
Wind: 5mph Gusts, 2mph 3min avg
Primary useism: 0.02 μm/s
Secondary useism: 0.29 μm/s
QUICK SUMMARY:
Workstations have already been rebooted.
Remember the LVEA is still lazer Hazard.
The Expected Work today:
Corner station:
Restart the EDC
Workstation Updates Completed
LASER HAZ HAM1 Beam alignment work
HAM1 ISC close out work for payload balancing
VAC Ham1 Top flange guage work
PEM PEM Coil work by clean bay
HAM1 Cable tray & cable straighting
HEPI upgrade, Software part start ?
EX - Bee aware of the bees in the area
Wind Fence Work at EX
ALS beam profiling & troubleshooting
EY
SEI BRS work
ALS beam profiling & troubleshooting
Mid stations:
chiller work
Dust mons outputs :
300nm Minor alarm do not match dcc levels for LVEA5, Clean room on?
500nm Minor alarm do not match dcc levels for LVEA5, Clean room on?
300nm Minor alarm do not match dcc levels for LVEA6, Clean room on?
500nm Major alarm do not match dcc levels for LVEA6, Clean room on?
Workstations updated and rebooted. This was an os packages update. Conda packages were not updated.
TITLE: 05/12 Day Shift: 1430-2330 UTC (0730-1630 PST), all times posted in UTC
STATE of H1: Planned Engineering
INCOMING OPERATOR: None
SHIFT SUMMARY: Started the day by restoring alignments of BS and ITMs to locations on Friday according to top-mass OSEMs following the h1susb123 crash yesterday. More progress with HAM1 today; ISCT1 and the viewport simulator were moved off the chamber and alignment of the POP diodes proceeded. Slow controls was restarted to fix a logic issue with the REFL beam diverter. Wind fence work at EX continued but ended early due to escalating wind speeds this afternoon.
LOG:
Start Time | System | Name | Location | Lazer_Haz | Task | Time End |
---|---|---|---|---|---|---|
15:07 | SAF | LVEA is Laser HAZARD | LVEA | YES | LVEA is Laser HAZARD | Ongoing |
14:46 | FAC | Kim, Nelly | LVEA | - | Technical cleaning | 15:30 |
16:03 | VAC | Jordan | LVEA | - | Purge air checks | 16:13 |
16:26 | ISC | Camilla, Sheila, Betsy | LVEA | YES | HAM1 beam alignment (Betsy out @ 17:08) | 19:04 |
16:37 | SEI | Tony | EX | N | Wind fence work | 18:56 |
16:44 | FAC | Nellie | LVEA | - | Tech clean | 17:50 |
16:47 | Oli | LVEA | YES | Turning up power | 16:56 | |
16:47 | FAC | Kim | LVEA | - | Tech clean | 17:50 |
16:53 | SEI | Jim, Randy, Mitchell | EX | N | Wind fence work | 18:56 |
17:28 | ISC | Betsy | LVEA | YES | HAM1 beam alignment | 19:38 |
17:49 | FAC | Eric | EX | N | Sensor in AH room | 18:41 |
17:50 | FAC | Kim, Nelly | EX | N | Technical cleaning | 18:44 |
19:05 | FAC | Tyler | LVEA | - | Moving ISCT1 | 19:26 |
19:10 | Oli | LVEA | - | Helping ISCT1 move | 19:36 | |
19:29 | Daniel | LVEA | - | 19:36 | ||
19:38 | SEI | Michael, Shoshana | EY | N | BRS work | 21:12 |
19:55 | ISC | Camilla, Jennie | LVEA | YES | HAM1 POP diode alignment (Jennie out @ 21:49) | Ongoing |
20:01 | CDS | Jackie | LVEA | - | Retrieving cables near HAM1 | 20:08 |
20:33 | ISC | Betsy | LVEA | - | Checking on HAM1 team | 20:52 |
20:49 | SUS | Rahul | LVEA | - | RM1 bracket | 22:10 |
21:41 | AOS | Betsy, Jenne | EX | N | Checking in with wind fence team | 22:05 |
21:41 | VAC | Gerardo | LVEA | - | Looking at HAM2 oplev | 21:48 |
21:45 | ISC | Elenna | LVEA | YES | HAM1 POP diode alignment | Ongoing |
22:24 | AOS | Betsy | LVEA | - | Delivering power cord | Ongoing |
[Shoshana, Michael] We've started preparing to install the BRS mass adjuster to the End-Y BRS. The plan is to follow the same procedure/same parts as the End-X install outlined in LIGO-T2400043 and SEI log 1886 (https://alog.ligo-la.caltech.edu/SEI/index.php?callRep=1886). We've taken apart the BRS and discovered that doesn't match the designs on the DCC. How the parts are arranged blocks access to where the pico-motor mount should attach, but we think we have a work around that should work. The electronics/wiring of the BRS is as expected and we've finished all the wiring for the pico-motor so that it should attach to the feed through. Assuming all goes well we plan on installing the mass adjuster parts and begin testin.
[Shoshana, Michael] We've managed to get all of the hardware/parts installed in and we've closed up the BRS chamber. We had to add an inch of shims beneath to motor mount in order to get it to fit/align properly, but otherwise there were only minor complications during installation. We've tested the pico-motor and the mass adjuster using the pico-motor driver that we brought from UW and both seem to work fine. For in air balancing, we left the new mass adjuster centered to increase range for future adjustments for when the BRS is pumped down and running, and tried to just stick to moving masses that are inaccessible when the BRS chamber is pumped down. We unfortunately reached the maximum range with the internal masses and had to slightly move the manual mass adjustment system (what is currently used to adjust the center of mass) from center, but that might be returned to center after we re-balance it when it's pumped down. Right now the resonance frequency looks to be around ~7mHz (around 130 second period) which is about the same as it was before Mass Adjuster installation, but we'll check again after the chamber has been pumped down. Tomorrow we'll finish all of the wiring and electronics to hook up the pico-motor to the LIGO system. The plan is to pump down the BRS chamber tomorrow and re-balance and test the pico-motor some more. The reference pattern has a higher intensity than expected and we aren't sure why. Right now our best guess is that the light source drifted slightly, and we'll look into it more tomorrow.
EPO tag for BRS pics
[Shoshana, Michael] Pumped down the BRS chamber overnight and started the ion pump this morning and got it down to 1.9e-6 Torr before we left end End-X. We also wired up the picomotor to the LIGO picomotor controller system. It is hooked up to the 7th channel X-direction and we tested it out and were able to hear it spinning for both directions. The BRS's thermal insulation was reapplied the box closed and the temperature sensors and heating plate were all re-attached and plugged back in. The reference beam's intensity has gone down to be closer to normal somehow, so it doesn't seem to be anything to worry about We might go back to End-Y one more time tomorrow to clean up the wiring and do a final check of the vacuum pressure. We waited for the temperature to equilibrate a bit before balancing because we were hoping that as the temperature rises it would drift back to center, but we ended up using the mass adjuster to try and balance it. It looks like the + - wires for the damping were switched, meaning when the damping was on it would ring up the BRS. Fixed by changing a line in the BRS code[IF H1_ISI_GND_BRS_ETMY_CAPDRIVE>=0] by switching the [>=0] to [<=0] and switching [H1_ISI_GND_BRS_ETMY_CAPOUTL] and [H1_ISI_GND_BRS_ETMY_CAPOUTR], and [H1_ISI_GND_BRS_ETMY_RELAYL] and [H1_ISI_GND_BRS_ETMY_RELAYR] FROM THE END-X INSTALL: Coupling/decoupling move: 1.25k steps Maximum: +-140k steps Be careful: +-100k steps NOTE: MOVING PICOMOTOR +(POSITIVE) DIRECTION TRANSLATES TO MOVING THE BRS UP TOTAL MOVEMENT TODAY:+21k steps
Centered both ETMY and ETMX BRSs. For ETMX net movement was +2200 steps, for ETMY net movement was -3200 steps. For ETMX we saw that the DRIFTMON was moved by about ~3.27 counts per step, and ~2.3 counts per step for ETMY
Cleaned everything up for the ETMY BRS and relabeled all the wires. The final reading that we saw for the ion pump was 9.9e-7 Torr (186uA, 6950V) which seems about right. We left some extra mass adjuster parts with Jim just in case.
Shoshana, Michael
We took tilt subtraction spectra as a final life check of the BRSs. Both BRSs appear to be in good working order and doing their jobs well.
Sheila, Betsy, Tyler, Oli, Jennie, Camilla,
Day 1: 84193, Day 2: 84228, Day 3: 84230 and 84239, Day 4: 84274, Day 5: 84292, Day 6: 84314, Day 7: 84334
Photos attached of: | REFL (BDV1) | POP (BDV2) |
Location | photo | |
Open Position | photo | photo |
Closed Position | photo | photo |
Beamdump Location | photo | photo |
Beamdump Name | BD5 | BD4 |
Beam dumped | photo | photo |
PSL ALS: we decided that the PSL ALS path was too close to the edge to the VP (84334) we tried moving M13 so the beam traveled in-between M11 and L2 but this didn't give enough separation at the bottom pericope mirror of ISCT1. We then put M1 back to a similar position to wear we started an decided that it was good enough away form clipping the VP. Photos attached of M15 location, beam on M15, beam next to L2, VP simulator, UPM, LPM.
The logic of the REFL diverter has been changed to alternate beam. This required a restart of the slow controls software.
Before lunch, Tyler, Oli and Betsy removed ISCT1 and the VP simulator.
POP Beam to diodes:
Jennie and I aligned the POP beam onto the POP X ASC diode (using flashes then single bounce, with 20W in). We needed to adjust the dark offsets (they are about the same size as the 1.5uW single bounced beam), sdfs accepted in safe attached, properly need to be redone and saved once we get to observe. All segments responded to the beam and a flashlight and we centered the beam in pitch and yaw using PM1 (alignment sliders P:100, Y:50).
Elenna and I aligned the POP beam onto the POP A LSC diode (using flashes then single bounce). We checked the POP LSC picomotor was working as expected. Checked beam was centered on the diode by it was centered by going to the middle of the edges of the diode. All segments responded to the beam and a flashlight and we centered the beam in pitch and yaw using PM1, ndscope. Note that we'll want to check this again tommor0w as we need to offload the picomotor in yaw as it doesn't have much range left.
We couldn't see the didoe reflected beams (using POP flashes, sensitive IR card and IR viewer) so I dead rekon'ed the positions of beam dumps BD1 and BD2, see attached photo.
Leaving IMC locked with 2W in.
Still to do: offload POP LSC pico and check alignment, place BD6a, 6b, 7, 9 (couldn't see beams easily tpday at 2W), final checks (see other alog).
Mon May 12 10:11:32 2025 INFO: Fill completed in 11min 28secs
Dry air skid checks, water pump, kobelco, drying towers all nominal.
Dew point measurement at HAM1 -43.8 °C
.
FAMIS 31085
The brief time in the enclosure 4 days ago to adjust the ALS path shows clearly on trends, and since then the FSS TPD looks to be a bit noisier for some reason. No other events of note this week.
TITLE: 05/12 Day Shift: 1430-2330 UTC (0730-1630 PST), all times posted in UTC
STATE of H1: Planned Engineering
OUTGOING OPERATOR: None
CURRENT ENVIRONMENT:
SEI_ENV state: MAINTENANCE
Wind: 1mph Gusts, 0mph 3min avg
Primary useism: 0.01 μm/s
Secondary useism: 0.17 μm/s
QUICK SUMMARY: Systems appear to be fully recovered after the h1susb123 crash and output arm turbopump shutoff this weekend. More vent work planned for today includes wrapping up HAM1 alignment and more wind fence work at EX.
At 15:36:55 Sun 11may2025 PDT all models on h1susb123 stopped due to an ADC/Timing error.
h1susb123 DMESG output:
[Sun May 11 15:36:49 2025] rts_cpu_isolator: LIGO code is done, calling regular shutdown code
[Sun May 11 15:36:49 2025] h1iopsusb123: ERROR - An ADC timeout error has been detected, waiting for an exit signal.
[Sun May 11 15:36:49 2025] h1susitmpi: ERROR - An ADC timeout error has been detected, waiting for an exit signal.
[Sun May 11 15:36:49 2025] h1susitmy: ERROR - An ADC timeout error has been detected, waiting for an exit signal.
[Sun May 11 15:36:49 2025] h1susbs: ERROR - An ADC timeout error has been detected, waiting for an exit signal.
[Sun May 11 15:36:49 2025] h1susitmx: ERROR - An ADC timeout error has been detected, waiting for an exit signal.
(diskless)controls@h1susb123:~$
If I do a "sudo lscpi" this command freezes for about 30 seconds, then eventually returns. While it is frozen, the EDC disconnects from h1susb123 EPICS channels.
This is a 8-core W2245 machines with 5 models, so 3 general purpose cores. The IOC disconnect suggests the lscpi command is taking over all 3 cores.
Interestingly h1iopsusb123 is not in a DACKILL state, its DAC drives are non-zero, frozen at their last values (see attached).
The IPC senders have stopped updating, causing IPC receive errors downstream and SEI SWWD trips.
System has been recovered by power cycling the front-end computer, no IO Chassis restart was needed.
Procedure:
"rtcds showcards" sees all the ADC/DAC/BIO cards in the IO Chassis.
"sudo lscpi" completes immediately, no 30 second freeze.
I have untripped the SWWDs (SUS and SEI) for BSC1,2,3.
I have not ununtripped any user model watchdogs, will hand over to control room for that.
I've brought the BS, ITMX, ITMY suspensions back to Aligned after untripping the user WD. I also untripped the sei for those and watched them go back to nominal. All looks good.
Sun11May2025
LOC TIME HOSTNAME MODEL/REBOOT
16:52:48 h1susb123 ***REBOOT***
16:55:12 h1susb123 h1iopsusb123
16:55:25 h1susb123 h1susitmy
16:55:38 h1susb123 h1susbs
16:55:51 h1susb123 h1susitmx
16:56:04 h1susb123 h1susitmpi
I've written an EPICS IOC which reads the smart Geist rack power strips and records their current draw in Amps.
CDS racks in the MSR and end stations have two verically mounted, full height, power strips. Most MSR racks have a UPS power strip and a facilities power strip. Rack mount servers with dual redundant power supplies are connect to each power strip for fault tolerance. The MSR exceptions are racks 01 (fiber rack, has a single APC power strip) and the front end racks 03, 04 which have 3-phase power strips with no network connection. Front end computers are not UPS powered because their IO Chassis are also not UPS powered.
The end station racks have two power strips, but they are both on technical power, there are no FE UPS units in the outbuidings.
I have created an MEDM called H1CDS_PWR_STRIP.adl, it can be opened from the CDS pulldown on the SITEMAP.
The IOC calculates the total rack current draw, which is displayed in the circle. UPS power strips are denoted by their orange background.
Attached photograph shows a typical power strip configuration at the rear of a CDS rack, with the UPS strip using keyed outlets to prevent accidental connection to non-UPS outlets.
I forgot to credit Cyrus Reed who installed these smart power strips and put them onto the network many moons ago.
Follow up to 83605.
I created a few templates to do a SR3 OSEM calibration. I called them
sus/trunk/HLTS/H1/SR3/Common/Data/ yyyy-mm-dd_hhmm_H1ISIHAM5_ST1_WhiteNoise_ISO_{X,Y,Z}_0p05to40Hz_calibration.xml
The measurement should be run with all gains on SR3_M1_DAMP_{L,T,V,R,P,Y} set to - 0.1 . Just to make sure the loop gain does not mess with the OSEM measurement of the cage above resonance.
The idea is that we ought to be able to only use the cartesian measurements of the ISI to calibrate all the OSEMs in the suspensions attached by using linear algebra. This is the first pilot for that idea. We want about 100 points between 5-10Hz to make sure we can make a "decent" fit.
___
When Oli runs these templates, the plan is to use them to calibrate the SR3 OSEMs for the estimator work (see 84171 for the latest news as of the making of this post).
We will use Oli's feedback to work out the kinks of the calibration procedure and to export it to other ISIs at a later time.
I've run these three transfer function measurements with settings as follows:
The measurements can be found in /ligo/svncommon/SusSVN/sus/trunk/HLTS/H1/SR3/Common/Data/as 2025-05-07_0000_H1ISIHAM5_ST1_WhiteNoise_ISO_{X,Y,Z}_0p05to40Hz_calibration.xml. They have been committed to the svn as r12295.
Checking the coherence between each excitation channel (H1:ISI-HAM5_ISO_{X,Y,Z}_EXCMON) and SR3's euler basis DOFs, the coherence between 5 and 10 Hz was good between the following channels:
ISO_X -> DAMP_T
ISO_Y -> DAMP_L
ISO_Z -> DAMP_V, but also pretty good coherence with DAMP_L and DAMP_T
I have run the calibration script to get the calibration factors for the SR3 OSEMs. The (multiplicative) factors are:
LF: 1.3206
RT: 1.3705
SD: 1.3806
T1: 2.4539
T2: 1.4819
T3: 1.4125
The factors are calculated by fitting a frequency-independent real factor to the measured uncalibrated transfer functions to fit the modeled one. The fit range is from 5 to 15 Hz. The attached plots show the before and after of the process.
A few observations:
1) As we had seen before, the Left and Right (LF and RT) OSEMs are pretty well matched to one another, which bodes well for our PR3 Yaw OSEM estimator plans.
2) The T1|T2|T3 OSEMs that measure the vertical direction have their orientation flipped respect to the model. I don't think there's a problem, but it is worth pointing out.
3) The T1 OSEM, which is used to distinguish roll is 70% off from T1 and T2. The large factor feels concerning, but it is consistent with other measurements of SR3. See for example 83963, where in the attached .pdf the Vertical to roll coupling is very clean (page 12). And the difference of T1, T2, and T3 can be seen very directly in page 24.
- I think it might be worth revisiting some of these transfer functions after recalibrating just to confirm that we're getting the numbers right.
If we wanted the OSEM measurements to match with the GS13 calibrations between 5-15 Hz, the factors that should be in the OSEM input filters should be:
T1: 3.627
T2: 1.396
T3: 1.345
LF: 1.719
RT: 1.490
SD: 1.781
Since this change will increase the effective gain of the damping loops by a factor of 30% at a minimum, we must compensate by changing the gains for the filter modules in the M1 DAMP filter bank.