david.barker@LIGO.ORG - posted 08:26, Saturday 03 August 2024 (79440)
Sat CP1 Fill
Sat Aug 03 08:05:13 2024 INFO: Fill completed in 5min 10secs
Images attached to this report
Sat Aug 03 08:05:13 2024 INFO: Fill completed in 5min 10secs
TITLE: 08/02 Day Shift: 1430-2330 UTC (0730-1630 PST), all times posted in UTC
STATE of H1: Corrective Maintenance
INCOMING OPERATOR: Nobody
SHIFT SUMMARY:
IFO is in MAINTENANCE for VENTING
HAM6 doors on as of 17:50 UTC.
Ryan C checked and turned on dust monitors - all except for known PSL102 are on. alog 79427.
LOG:
| Start Time | System | Name | Location | Lazer_Haz | Task | Time End |
|---|---|---|---|---|---|---|
| 14:31 | FAC | Karen | Optics, Vac Prep Labs | N | Technical Cleaning | 14:47 |
| 14:48 | FAC | Karen, Kim | LVEA | N | Technical Cleaning | 15:32 |
| 15:33 | VAC | Travis | LVEA | N | HAM5/6 Area Check | 15:46 |
| 16:00 | VAC | Gerardo | LVEA | N | HAM6 Doors Check | 17:48 |
| 16:02 | FAC | Tyler | LVEA | N | HAM6 Doors | 17:42 |
| 16:06 | FAC | Chris | LVEA | N | HAM6 Doors | 17:42 |
| 16:23 | FAC | Eric | LVEA | N | HAM6 Doors | 17:44 |
| 16:23 | VAC | Travis | LVEA | N | HAM6 Doors | 17:44 |
| 16:45 | FAC | Kim | H2 | N | Tech clean | 17:30 |
| 19:36 | OPS | Ryan | LVEA | N | Dust monitor check | 19:42 |
| 19:58 | PEM | Sam, Genevieve, Robert | LVEA | N | Missing BNC Reel | 20:49 |
| 22:08 | VAC | Gerardo | LVEA | N | RGA Check | 22:26 |
Closes FAMIS 26277
Laser Status:
NPRO output power is 1.821W (nominal ~2W)
AMP1 output power is 65.08W (nominal ~70W)
AMP2 output power is 137.6W (nominal 135-140W)
NPRO watchdog is GREEN
AMP1 watchdog is GREEN
AMP2 watchdog is GREEN
PDWD watchdog is GREEN
PMC:
It has been locked 24 days, 1 hr 50 minutes
Reflected power = 19.12W
Transmitted power = 107.6W
PowerSum = 126.8W
FSS:
It has been locked for 15 days 22 hr and 23 min
TPD[V] = 0.6675V
ISS:
The diffracted power is around 2.3%
Last saturation event was 16 days 23 hours and 36 minutes ago
Possible Issues:
PMC reflected power is high
FSS TPD is low
SEI seismometer mass check - Monthly - Closes FAMIS 26492
I've also attached the WD_ALL Mini Screen of what states the SEI platforms were in (FAMIS calls for DAMPED or ISOLATED but since we're venting, some of these are in different variants of damped or isolated.
Averaging Mass Centering channels for 10 [sec] ...
2024-08-02 13:21:31.272178
There are 27 T240 proof masses out of range ( > 0.3 [V] )!
ETMX T240 2 DOF X/U = -0.632 [V]
ETMX T240 2 DOF Y/V = -0.461 [V]
ETMX T240 2 DOF Z/W = -0.522 [V]
ITMX T240 1 DOF X/U = -1.764 [V]
ITMX T240 1 DOF Y/V = -0.302 [V]
ITMX T240 2 DOF X/U = -0.476 [V]
ITMX T240 2 DOF Y/V = -0.35 [V]
ITMX T240 2 DOF Z/W = -0.469 [V]
ITMX T240 3 DOF X/U = -1.844 [V]
ITMX T240 3 DOF Y/V = -0.387 [V]
ITMY T240 1 DOF Y/V = -0.472 [V]
ITMY T240 1 DOF Z/W = -0.611 [V]
ITMY T240 2 DOF Z/W = -0.629 [V]
ITMY T240 3 DOF X/U = -1.345 [V]
ITMY T240 3 DOF Y/V = -0.349 [V]
ITMY T240 3 DOF Z/W = -1.75 [V]
BS T240 1 DOF X/U = -0.594 [V]
BS T240 1 DOF Y/V = -0.928 [V]
BS T240 1 DOF Z/W = -0.457 [V]
BS T240 2 DOF X/U = -0.542 [V]
BS T240 2 DOF Y/V = -0.424 [V]
BS T240 2 DOF Z/W = -0.626 [V]
BS T240 3 DOF X/U = -0.712 [V]
BS T240 3 DOF Y/V = -0.676 [V]
BS T240 3 DOF Z/W = -1.191 [V]
HAM8 1 DOF Y/V = -0.505 [V]
HAM8 1 DOF Z/W = -0.812 [V]
All other proof masses are within range ( < 0.3 [V] ):
ETMX T240 1 DOF X/U = -0.133 [V]
ETMX T240 1 DOF Y/V = -0.112 [V]
ETMX T240 1 DOF Z/W = -0.159 [V]
ETMX T240 3 DOF X/U = -0.1 [V]
ETMX T240 3 DOF Y/V = -0.226 [V]
ETMX T240 3 DOF Z/W = -0.103 [V]
ETMY T240 1 DOF X/U = 0.022 [V]
ETMY T240 1 DOF Y/V = 0.09 [V]
ETMY T240 1 DOF Z/W = 0.148 [V]
ETMY T240 2 DOF X/U = -0.098 [V]
ETMY T240 2 DOF Y/V = 0.152 [V]
ETMY T240 2 DOF Z/W = 0.049 [V]
ETMY T240 3 DOF X/U = 0.155 [V]
ETMY T240 3 DOF Y/V = 0.041 [V]
ETMY T240 3 DOF Z/W = 0.089 [V]
ITMX T240 1 DOF Z/W = -0.092 [V]
ITMX T240 3 DOF Z/W = -0.289 [V]
ITMY T240 1 DOF X/U = -0.25 [V]
ITMY T240 2 DOF X/U = -0.08 [V]
ITMY T240 2 DOF Y/V = -0.185 [V]
HAM8 1 DOF X/U = -0.287 [V]
Assessment complete.
Averaging Mass Centering channels for 10 [sec] ...
2024-08-02 13:24:48.269297
There are 2 STS proof masses out of range ( > 2.0 [V] )!
STS EY DOF X/U = -3.98 [V]
STS EY DOF Z/W = 2.725 [V]
All other proof masses are within range ( < 2.0 [V] ):
STS A DOF X/U = -0.679 [V]
STS A DOF Y/V = -0.648 [V]
STS A DOF Z/W = -0.561 [V]
STS B DOF X/U = 0.287 [V]
STS B DOF Y/V = 0.996 [V]
STS B DOF Z/W = -0.446 [V]
STS C DOF X/U = -0.848 [V]
STS C DOF Y/V = 0.865 [V]
STS C DOF Z/W = 0.506 [V]
STS EX DOF X/U = -0.136 [V]
STS EX DOF Y/V = -0.016 [V]
STS EX DOF Z/W = 0.076 [V]
STS EY DOF Y/V = 0.037 [V]
STS FC DOF X/U = 0.24 [V]
STS FC DOF Y/V = -1.064 [V]
STS FC DOF Z/W = 0.627 [V]
Assessment complete.
Closes FAMIS#26320, last checked in 79324
Corner Station Fans (attachment1)
- Both MR_FAN2 accelerometers show the fan becoming noisier very erratically starting yesterday (08/01) at ~07:16UTC, so just after midnight Pacific time (attachment2). It looks like accelerometer 2 isn't getting as loud in the last 12 hours as it had been getting before that, but is still jumping around a lot. Accelerometer 1 however, looks like every time it jumps up, it's a bit louder than the previous time. Definitely should be checked out!
- MR_FAN6 1 starter getting a bit noisier 07/31 14:51UTC(attachment3), but it's a consistant noisy, and looking back at last week(attachment4), the noise levels had been similar last week before they were (I assume?) corrected.
- MR_FAN5 2, which had been pretty noisy last week, finally went down in amplitude five days ago
- All other fans are looking normal and within range.
Outbuilding Fans (attachment5)
- All fans are looking normal and within range.
(Chris S., Eric O., Travis S., Tyler G., Gerardo M.)
Both doors, ∓X, were installed on HAM6. No issues were encountered during the installation process.
TITLE: 08/02 Day Shift: 1430-2330 UTC (0730-1630 PST), all times posted in UTC
STATE of H1: Corrective Maintenance
OUTGOING OPERATOR: Tony
CURRENT ENVIRONMENT:
SEI_ENV state: MAINTENANCE
Wind: 10mph Gusts, 6mph 5min avg
Primary useism: 0.03 μm/s
Secondary useism: 0.05 μm/s
QUICK SUMMARY:
IFO is in MAINTENANCE for VENT
Pardon the accidentally late alog (that never made it out of draft).
HAM6 Doors are back on as of 17:50 UTC.
Dew point measurement taken this morning read at -44.1 oC. Measurement taken before any activity inside chambers. Soft covers were on HAM5 and HAM6, HAM7 is isolated.
Fri Aug 02 08:05:54 2024 INFO: Fill completed in 5min 50secs
As Ryan C reported yesterday, LVEA dust 5 is reporting a low battery and dust 6 stopped running 16:28 Wed 31jul2024 PDT. Attachment shows MEDMs and 7 day trends of 300nm particulate counts.
I power cycled DM6 which was frozen and I found DM5 unplugged so I plugged it back in and turn it back on. DM5 is in the cleanroom by HAM3 and it needs to be turned back off when we go back to observing(OPSInfo).
I was running the TFs for SRM to confirm that the suspension is good before we close HAM5, but the transfer function for L was a noticable amount lower in magnitude as compared to the measurements taken on July 17th right before we vented HAM5(pdf). We reran L but this time with the OPTICALIGN offsets turned ON, and the results matched our pre-vent measurements, which seemed strange and prompted looking into whether the RT OSEM has a problem. I've looked back at the state of SRM when the July 17th transfer functions were run, and T, V, R, P, and Y were run in DAMPED and OPTICALIGN offsets were OFF(T&R, V&Y, P). HOWEVER, when the L transfer function was run, SRM was ALIGNED and OPTICALIGN offsets were ON (P: 4254, Y: -9231)(L pre-vent). So that's why today's regular (offset OFF) L didn't match the pre-vent L, and why my second measurement of L with the offset on did match.
Yaw is the only other dof that was affected by the offsets being ON vs OFF, but the pre-vent Y measurements were taken with the offsets OFF, and these match with today's offset OFF measurements so we're all good there.
I'm not sure if there are still concerns about the RT OSEM on SRM M1, now that we know why L matches the pre-vent L, so I'm not sure if these results clear us for closing HAM5 or not.
Main set of measurement results (2024-08-01_2000) - SRM DAMPED, OPTICALIGN offset OFF:
$(sussvn)/HSTS/H1/SRM/SAGM1/Results/2024-08-01_2000_H1SUSSRM_M1_ALL_TFs.pdf
Second set of measurement results (2024-08-01_2200) - SRM DAMPED, OPTICALIGN offset ON:
$(sussvn)/HSTS/H1/SRM/SAGM1/Results/2024-08-01_2200_H1SUSSRM_M1_ALL_TFs.pdf
Full comparison of Pre-Vent, Post-Vent offset OFF (main) set, and Post-Vent offset ON set
$(sussvn)/HSTS/Common/Data/allhstss_2024_July17vAug01_H1SUSSRM_M1_PreVsPostOFIVent_ALL_TFs.pdf
I agree with Oli that SRM will be "as good as it has been between 2021 and 2024" if we leave it as is, but for different, more expanded reasons covered below.
To expand on Oli's "RT OSEM has a problem" -- the issue is that with the alignment offsets OFF, the RT (right) OSEM sensor / flag has expanded enough that the flag is only barely occulting the LED / PD beam, close to "open light." Thus the drop in magnitude response for Length and Yaw, the only two DOFs that use the RT OSEM. In fact, the M2 UL and M3 UL OSEMs, i.e. the lower stage left OSEMs are further *engaged*, close to "closed light." This is consistent with an overall positive yaw (+RZ) of the suspension w.r.t. the cage.
The *current* SRM alignment offsets are
(P: 1663, Y: -3095 [urad]) 2024-08-01, post OFI recovery and aux laser alignment, in air, HEPI locked
This digital request of *negative* ~3 millirads of yaw *centers* the OSEMs, implying that the OSEMs have been centered to the *alignment offsets ON* position. With the OSEMs centered, the magnitude of the response increases and looks cleaner because both LF and RT are contributing to measurement of the L and Y DOFs.
This checks out with the last time that we moved the OSEMs w.r.t. to the flags -- in 2021 -- see LHO:60576 where our goal was to keep the physical alignment of the optic the same, even though moving the OSEMs changes the digital request to get there. In that case, we kept the physical alignment and centered the top mass OSEMs to the alignment offsets ON, preserved physical alignment.
Importantly -- the result of the 2021 adventure of reproducing in-vac alignment while the IFO was in air was to leave the alignment offsets at
(P: 1738.28, Y: -3296 [urad]) 2021-11-08 (LHO:60578)
which is within 200 [urad] of the current slider values, and where the OSEMs are reasonably centered and responding well now.
These are also consistent with pre-vent in 2024 with OFI KTP damage in place, where with HAM5/6 HEPIs locked, a single-bounce IFO beam was used to find a good alignment
(P: 2192, Y: -3166 [urad]) 2024-07-17 (LHO:79246)
The offsets that Ibrahim used only on the L DOF during the July 17th health check, as Oli quotes, are:
(P: 4254, Y: -9231 [urad]) 2024-07-17 (LHO:79202)
which I believe were some very-lost, very-brief, temporary "I didn't realize HEPI was locked" alignment state used just prior to the official single bounce restoration later that day, LHO:79246, so the values of these should be ignored.
Finally, I attach a trend of the SRM alignment offsets over the last 4 months of sordid history with the OFI's KTP damage, covering both in-air and in-vac, HEPI unlocked and unlocked.
This also confirms that SRM's alignment, in all of these scenarios, is never needed to be outside of the
(P: 1600-2400 [urad], Y: 3000-3500 [urad])
range, i.e. less than 1 [mrad] from the 2021 positions (and the I suspect the large low pitch request after venting is the need to account for bouyancy of the optic, so really the alignment should stay within 0.5 pmrad] = 500 [urad] of those 2021 values.)
Note that this requested alignment range consumes a little less than half of the DAC range at ~50000 [ct] for the pitch OSEMs (T2 and T3) and yaw OSEMs (LF and RT).
Thus, if we just leave SRM alone, I suspect we'll be just as happy the SRM alignment and OSEM performance as we were between Nov 2021 until Jul 2024. This was the same decision we made in 2021. We'll just have to somehow remember that, for SRM, in order to get centered OSEMs to provide a OK performance on the top-mass "health check" transfer functions, we need the alignment offsets ON and in within 500 [urad] of (P: 2200, Y: -3300 [urad]). We can test where the boundaries of the alignment slider requests vs. RT OSEM performance decay during pump-down.
That being said, if we really want to mechanically relieve the yaw offset and restore centering of M1 RT (and M2 & M3 UL) we can...
Opened IIET Ticket 31769, to record that we've thought carefully about this decision to "let the 2021 OSEM position and SRM mechanical alignment ride," but that we reserve the right to try to mechanically offload *next* time. Hopefully the ticket and this aLOG series provides enough breadcrumbs to remember that we should relieve the alignment when we have the AUX laser set up already.
TITLE: 08/01 Day Shift: 1430-2330 UTC (0730-1630 PST), all times posted in UTC
STATE of H1: Corrective Maintenance
INCOMING OPERATOR: None
SHIFT SUMMARY: Today's work was mostly lots of final checks/cleaning before we can close the enclosures. Doors are not on, but HAM6 TFs show that we are good to go(SUS, SEI), and we are having problems with one of the OSEMs on SRM M1 on HAM5, so we'll be looking at that more tomorrow.
LOG:
| Start Time | System | Name | Location | Lazer_Haz | Task | Time End |
|---|---|---|---|---|---|---|
| 15:07 | FAC | Karen | LVEA | n | Tech clean | 16:04 |
| 15:08 | FAC | Kim | LVEA | n | Tech clean | 15:33 |
| 15:14 | VAC | Gerardo | LVEA | n | Checking on purge air | 15:37 |
| 15:33 | FAC | Eric | EY | n | Chiller tasks | 15:46 |
| 15:33 | Rahul | LVEA | n | Checking with Gerardo about purge air | 15:34 | |
| 16:01 | FAC | Tyler | MY, EY | n | Ladder inspections | 17:22 |
| 16:18 | FAC | Chris | EY, EX | n | Filter work in mech room | 17:06 |
| 16:20 | SUS | Rahul | Remote | n | Taking HAM6 SUS TFs | 17:15 |
| 16:39 | FAC | Karen, Francisco | PCAL Lab | yes(local) | Tech clean | 16:53 |
| 16:56 | OFI | Betsy, Mitchell | LVEA | n | HAM5 finishing up work | 19:09 |
| 17:03 | VAC | Travis | LVEA | n | Adjusting purge air | 17:23 |
| 17:07 | PEM | Robert, Millie, Carlos | EX | n | Moving seismometers into EX | 17:35 |
| 17:09 | FAC | Karen | LVEA | n | Tech clean | 18:30 |
| 17:09 | FAC | Kim | LVEA | n | Tech clean | 18:30 |
| 17:18 | EE | Fil | LVEA | n | Grounding checks for HAM5/6 | 19:12 |
| 18:03 | Sheila, Mattia | LVEA | n | looking into the HAMs (started 17:30) | 18:03 | |
| 18:10 | OFI | Jeff | LVEA | n | Figuring out HAM grounding issues | 19:18 |
| 18:16 | OFI | Keita | LVEA | n | Checking in on OFI team | 19:07 |
| 18:32 | ISI | Jim | LVEA | n | ISI | 19:12 |
| 18:43 | SUS | Ibrahim | LVEA | n | Collecting SUS(picious) parts | 19:14 |
| 19:11 | FAC | Travis + Norco guy | MX, EX, MY, EY | n | Doing repairs | 20:28 |
| 19:16 | OFI | Betsy | LVEA | n | Helping Jeff | 20:04 |
| 19:26 | PEM | Robert, Sam | LVEA | n | Looking at sound equipment | 20:48 |
| 19:28 | VAC | Gerardo | LVEA | n | Adjusting purge air | 19:31 |
| 20:05 | CDS | Dave, Jonathan | LVEA | n | CDS LVEA sweep | 21:08 |
| 20:31 | CDS | Tony | LVEA | n | Setting up PSL nuc outside PSL enclosure | 21:08 |
| 20:36 | SUS | Rahul, Jeff | LVEA | n | Checking EQ stops in HAM5 | 21:23 |
| 20:56 | SUS | Ibrahim | LVEA | n | Dropping off dental mirror | 20:57 |
| 20:58 | OFI | Betsy | LVEA | n | Helping with OFI stuff | 21:23 |
| 21:33 | OFI | Fil | LVEA | n | Cleaning up | 22:02 |
| 21:51 | Camilla | LVEA, OpticsLab | n | Cleaning rampage | 23:42 | |
| 22:06 | EE | Rahul, Fil | LVEA | n | Investigating I/O issue at HAM5 | 22:28 |
| 22:31 | Ibrahim, Fil | LVEA | n | Cleaning up | 22:42 |
Tony, Fil, Erik, Jonathan, Dave:
On the outside of the north-east corner of the LVEA PSL enclosure there is a wall display computer which shows the enclosure camera images.
Today we replaced this aging mac-mini computer with an Intel NUC configured as a FOM machine.
The new machine is called lveapslfom. It is currently configured to show the same camera images as the PSL FOM in the control room.
The computer's display is snapshotted and can be viewed on the CDS web server
I took the SR3 transfer functions this afternoon. I took SUS_SR3 to damped then reengaged the test filter outputs and set gains to 1, and turned off the damping filter outputs and set the M1 coil driver state from 2 to 1.
While taking the V TF Rahul and I noticed the shapes looked weird, from this we noticed that the T1 analog dewhitening coil driver wasn't switching on and off which led to the investigations in alog79419.
Data lives here
/ligo/svncommon/SusSVN/sus/trunk/HLTS/H1/SR3/SAGM1/Data/
2024-08-01_2000_H1SUSZM6_M1_WhiteNoise_L_0p02to50Hz.xml
2024-08-01_2000_H1SUSZM6_M1_WhiteNoise_P_0p02to50Hz.xml
2024-08-01_2000_H1SUSZM6_M1_WhiteNoise_Y_0p02to50Hz.xml
2024-08-01_2000_H1SUSZM6_M1_WhiteNoise_T_0p02to50Hz.xml
2024-08-01_2000_H1SUSZM6_M1_WhiteNoise_R_0p02to50Hz.xml
2024-08-01_2000_H1SUSZM6_M1_WhiteNoise_V_0p02to50Hz.xml
Plots:
- all DOFs to all DOFs compared against the model for this measurement (2024-08-01_2000_H1SUSSR3_M1_ALL_TFs.pdf), and then
- a comparison between this measurement and the 2 most recently available known-good measurement (2024-08-01_H1SUSSR3_M1_Phase4b_unDamped_ALL_ZOOMED_TFs.pdf).
After my discovery in this alog that the phase and gain margins were pretty tight on HAM2, I did a bunch of olg measurements on HAM2&3 and tweaked the loop gains and boost filters to reduce the gain peaking around 40 hz. More or less all DOFs on these chambers had ugfs around 35hz and phase margins around 5 degrees. Kinda suprised this was stable, I haven't looked at these in a long time. I do wonder if something is funky with the measurement, but I don't know what that would be. Attached image shows one of the worst, the Z dof on HAM3. Blue and yellow are the new loops gain and sensitivity, red and purple are the old loop. The filter changes might make things slightly worse in the 10-20 hz region, but that should be somewhat compensated by the HEPI to ISI feedforward. Should improve the 30-40 hz motion somewhat though.
Legend is reversed on the plot. What was old is new, etc.
Fil, RyanC, Rahul
We have replaced the triple top coil driver for SUS SR3 after finding binary issues with T1 channel on the M1 stage - see pic attached. T1 LP filter was not switching OFF and was stuck at ON. We looked at the SUS HAM5-6 system wiring diagram on D1002740 and found out that the chassis is at slot41, Rack C7. At first Fil tried re-setting the chassis (binary chasiss was power cycled) and then replaced cable no 44 and 45 (page 1 0f D1002740), which didn't give us the desired results, i.e T1 was still stuck at On, while channel LF and RT (Test/COIL) turned Red at the AI chassis.
Fil then decided to replace the Top Triple coil drive and this fixed the issue. Given below are the s/n of the old and new coil driver,
New - S1001082
Old - S1100192
I have added the above information on the e-traveler.
Dew point measurement taken this morning read at -43.6 oC. Measurement taken before any activity inside chambers. Soft covers were on HAM5 and HAM6, HAM7 is isolated.
End of the day dew point measurement, at -43.5 oC.
