Hugh R, Jess M
As of 00:53:00 UTC July 15, the ETMY chamber was in the following configuration:
Please leave ETMY in level 2 isolation until 8am tomorrow (if it hasn't tripped by then)
Today Hugh and I spent the afternoon trying to get EMTY stably into level 2 isolation. For stage 1, Hugh brought up the DOFs one by one, and we discovered a giant peak in the actuator output signal (and the L4Cs) in all DOFs at 738Hz as the X DOF gain approached 1. (Giant = most of the actuator power spikes at that high frequency right before the ST1 actuators trips.) We're not sure what might cause this, but it's very reproducible and we plan to look into it later this week.
We noticed a small peak in the open loop transfer function at about the same frequency, and the level 2 isolation filter gain is much higher than levels 1 or 3 in this very high frequency range. (See attached.)
As for stage 2, we had no trouble using the control script to bring it up to level 2 with the Start blend, but sometimes it would trip on the actuators shortly after and we couldn't switch the blend for any DOF without tripping (also on the actuators).
I attach the .pdf of the loop design for reference. In doing so I noticed two things: - Why are we allowing gain peaking of 4+? I thought we'd agreed never to design a loop with gain peaking of more than 2ish? - The prediction of the minimum phase margin is busted. I was about to be saddened by a phase margin of 20.8 [deg] (again, I thought we'd agreed that no less than 35 to 40 [deg] phase margin is acceptable) BUT it turns out the phase margin is 41.9 [deg] at the upper unity gain frequency. So, at least the loop is still stable, but hopefully the designer didn't accept the phase margin of 21 [deg] as stable and move on... Regarding the 738 [Hz] resonance -- what's our high-frequency roll-off policy? Seems like still having high-frequency features at a loop gain of 0.2 is treacherous, especially when the feature is close enough to the Nyquist frequency that the *measurement* amplitude (perhaps not the real amplitude) falls off deceivingly because of the DAQ's down sampling filter. Can we not just toss in pole at ~300 [Hz] where it would cost us little in phase margin, but alleviate the worries of this high-frequency non-sense? I think perhaps, now that the era of "OMG we need to get every platform commissioned yesterday!" is over, we should consider dropping these automated scripts and going back to looking at the loop design in detail, understanding the compromises we've made there, and making sure it all makes sense.
On Sunday ~1957utc, the VFD on the HEPI Pump Controller at ETMY registered an overvoltage error (OV3) and shut down its output. The servo was fine, the fluid level was fine. This OV3 error has occurred before at various pump stations but not too frequently, a few times a year maybe. No issues getting it back on using the documented procedure.
Today, Travis and I worked on aligning the main chain of the ITMy QUAD to IAS tolerances. We first tackled some coarse yaw, then used pushers to push the structure in the +x direction to fix a ~3mm error in the lateral position of the optic. (Some of this error was due to misplacement the first time we set this QUAD on this ISI.) We then continued on pitch and more yaw and have finished the day with the optic within tolerance in position and pointing. We will start transfer functions to check for the suspension health, but will likely hand off to SR3 output alignment checks with the PSL beam before continuing on with this QUAD. (We have not touched the reaction chain yet, other than to clamp it out of the way of the main chain.)
Undamped/damped transfer functions were started on opsws1 and will run overnight
The main chain of ITMy was free of rubbing as of this morning, cf attached results
Checked the following cables for possible shorts. PRM TOP (Cable 10 air side) - Found short on Pin 13 to chamber ground. Andres inspected cabling and saw no obvious short. He removed aluminum foil cable tie on table and short disappeared. Could not reproduce short. PRM RIGHT and SIDE (Cable 11 air side) - Did not find any short to chamber. PRM Middle (Cable 31 air side) - Found short on Pin 13 to chamber ground. Traced in-vacuum cable to feedthru. Short appears when you move the cable going into the connector. Will need to repair or replace cable. MC3 Middle (Cable 25 air side) - Found short on Pin 13 to chamber ground. Andres inspected cabling and saw no obvious short. He removed aluminum foil cable tie on table and short disappeared. Could not reproduce short. Filiberto C. / Andres R.
New preliminary dust monitor code is running to support Met One GT-521S dust monitors at EX. There are 2 monitors that are supported by the code, and it works better if they are not turned off or disconnected. If they need to be moved, contact Jim Batch to make sure they get started and data continues to flow. The following EPICS channels are available for monitor 1: H0:PEM-EX_DUST_VEA1_300NM_PCF H0:PEM-EX_DUST_VEA1_500NM_PCF H0:PEM-EX_DUST_VEA1_300NM_RAW H0:PEM-EX_DUST_VEA1_500NM_RAW H0:PEM-EX_DUST_VEA1_ACTSAMPLETIME H0:PEM-EX_DUST_VEA1_DATESTR H0:PEM-EX_DUST_VEA1_TIMESTR H0:PEM-EX_DUST_VEA1_UNIXTIME H0:PEM-EX_DUST_VEA1_STATESTR Monitor 2 has the same channels with VEA2. Note that the sample time is programmed into the dust monitor at 20 seconds, with a hold time of 300 seconds. These values are not changeable from the control room with the present software. Also, these are two channel devices, and only count 300nm and 500nm particles.
A. Pele, K. Izumi, J. Kissel After unlocking ITMX and pulling the first contact from SRM, we wanted to re-check our report of finding the IFO beam going through the HAM5 OFI. I outline the process below, but in summary, we have found an alignment that again gets the beam through the OFI, but with the beam mis-centered in YAW at SRM with +200 [urad] YAW offset on SR2 ~16 [m] away. Below are the alignment deltas from what we had in DRMI, i.e. pre-vent. We can be comforted in that the alignment change of the input chains are all ~0.5 [mrad] in P and Y, and within the range of the alignment sliders. This gives us confidence that IAS values for the new ITMX are quite good, and we should have only to do a similar amount of effort to get the Y-ARM beam also to go through the OFI hole. Attached are pictures from the morning's activity, as well as a cartoon drawing of how the alignment into the OFI changes between an SR2 Y offset of -800 [urad] (clipping on input) vs. -600 [urad] (centered). The coordinate system drawn to the left the cartoon is global IFO coordinates. Finally, a screenshot of the alignments for all SUS. Alignment Deltas: Pre-vent [urad] Now [urad] Diff [urad] P Y P Y P Y MC1 +1254 -2366.0 +1254.0 -2366.0 (none) (none) MC3 -550.0 -2467.0 -550.0 -2557.0 (none) -90.0 IM1 0.0 +1469.0 0.0 +3786.1 (none) +2317.1 IM2 +4600.0 +2000.0 +35849.3 +5154.7 +31249.3 +3154.7 IM3 -1397.9 +1060.8 +14057.0 +5464.0 +15454.9 +4403.2 IM4 -2350.0 -3607.0 -30000.0 -9337.0 -27650.0 -5730.0 PR2 +434.7 -355.7 0.0 +1350.0 -434.7 +1705.7 PR3 -245.5 -250.9 0.0 +250.0 245.5 +500.9 BS +180.6 -266.4 +750.0 -600.0 569.4 -333.6 ITMX +38.7 -48.9 0.0 0.0 -38.7 48.9 While we've changed the IMs quite a bit in both pitch and yaw (presumably to account for the bypass beam), but downstream all optics (PR2, PR3, BS) have not changed more than 0.5 [urad] in pitch, and PR2 is the worst offender with ~2 [mrad] in yaw, with the rest also below 0.5 [mrad]. These changes (at least of the large optics) are well within the range of the core optics. The largest offsets on the IMs are taking up ~80% of the DAC range. Alignment process this morning (again, after release of ITMX and removal of SRM First Contact): - Check beam at SR3. Looks like clipping - Check beam at AS port, AR side, output side of BS, see clipping. - Check beam centering on ITMX -- is mis-centered. Tweak alignment of PR3 to center on ITMX. - Check beam at AS port, AR side, output side of BS -- clipping alleviated. - Check beam through HAM4 between HWS baffles, no clipping. - Check beam at SR3 -- clipping alleviated. - Re-center beam on SR3 using BS. - Re-center beam on SR2 using SR3, making sure of no clipping on SR2 scrapper baffle. - Re-center beam on SRM using SR2, still no clipping. - Confirm that beam no-longer goes through input of OFI with SRM centering, using SR2 offset of Y = -800 [urad] (P as shown in IFO Align screen). - Move SR2 to Y = -600 [urad], find that beam goes through OFI hole, but is now miscentered on SRM. Should be walk-able / recoverable, but we'll wait for beam from Y ARM before we move anything.
Laser
PMC
FSS
ISS
Restarted End-X weather station epics ioc. It died about 12:09 PDT today for reasons only slightly related to dust monitor work, when the Comtrol web page was accessed.
Late last week after we aligned the entire SR chain with the PSL beam, re rediscovered that we had left the ITMx clamped. So this morning, I entered through HAM 4 (since we have blocked off the door to BSC3 for laser safety reasons) and unclamped the ITMx. Hopefully the realignment now will remove some of the bias we had to put on the BS to shoot to the center of SR3.
After adding a peek tab and waiting a while this AM, I attempted to pull the little 1" sheet of FC from the SRM-HR (surrogate optic) surface. THe peek tab pulled off, removing a perfect square window behind it where the peek tab had been. SO, I filled in the hole in the sheet with more FC and reattached the peek tab in another location around the pericmeter of the sheet. After ~45 mins the peek tab pulled the entire sheet off (with N2 blow). On to re-alignment of the SRs.
So the crew could climb into the plenum, HAM4 HEPI was put on its mechanical stops.
Translational dofs shifted from controlled position less than 60um. Rx tilted -4urads, Ry tilted 2urads, & Rz rotated 3urads; hopefully that is close enough.
What I was able to hear from meeting:
The power watchdog for the frontend laser was (re)started this morning. On a side note, the water level in the crystal chiller was about half way between maximum and minimum. I added 200 millilitres to bring the level up to maximum.
no restarts reported.
no restarts reported.
Worth noting - we had a strong EQ yesterday (an M6.5 off the coast of Japan) arriving at ~19:40 UTC (Friday July 11).
Of the two SEI chambers actively isolating that day:
A trend of the ground BLRMS for the day of July 11 is attached (made with ligoDVweb because BLRMS trends not accessible via nds recently - units in nm/s not counts).
Just one example, but could be worth exploring.
This is kind of what we expect, nice to have it confirmed, assuming that the ETMX was running some form of the 40mHz blends and the ETMY was running with a Start blend( 750mHz) which is usually how level 3 and level 1 controller operate. The blend filters are what is important not the loop gain (level). If you look at Sebastiens entry in the LLO log 13449 you will see that almost all of the extra seismic motion from the Tonga earth quake was between 20-150mHz. At these frequencies the springs are stiff and the platfrom wants to follow the ground so no (or very little) force is needed. When we are in low blend and the ground motion goes up by X100 it takes a lot of force to counter act the ground motion so the actuators saturate and the watch dogs trip. We (Sebastien) are in the process of writing a guradian module that will be able to switch the blends when a earthquake takes place, the tricky part is figuring out how to trigger it
(Travis, Betsy, Kissel)
After getting the handoff beam from the input HAMs, we double checked that the beam was centered on the ITMx. We then traced the beam and found it miscentered on the SR3 HR baffle (in front of SR3). Using the BS bias, we were able to roughly center the beam on SR3 - using ITMx bias didn't seem to drive the beam very much. We needed to use half of the BS YAW bias, however. Once centered, we looked at SR2 and found the beam within 1-2" centered on the optic (with 0 bias on SR3). We then used a bit of SR3 bias to roughly center on SR2. Heading over to SRM, we again found the beam within 1-2" from the center of the optic and centered it using some SR2 bias. We then verified that the beam (although blocked by a layer of First Contact on SRM-HR) sprayed through the OFI and out to HAM6. We suspect the OFI alignment "won't take much."
Notes:
We paused to recheck the ISI locking of HAM5 when we observed that the beam wobbled when we rested on the table. It seemed pretty locked, but the beam didn't seem to wiggle as much after we squeeked the lockers a bit more.
We increased the damping gains on the SR3 in order to help with the wobbling beam.
We started the realignment of the SR3 lower stage OSEMs.
Next up for HAM4:
Install TCS Temp Sensor Cable
SEI ISI Testing
FC Clean SR2
Chamber Closeout
Next up for HAM5:
Align all lower stage OSEMs on SR3 - a nasty task and will take a few hours, including checks of healthy SUS along the way
Pull FC on SRM (minor task)
OFI Alignment
OFI Res Testing
Install TCS Temp Sensor Cable
SEI ISI Testing
FC Clean SR3
Chamber Closeout
Biases as found noonish before we started using biases to align the output beam:
ITMx (why there was bias enabled is beyond me...) We zeroed this.
P = 38.7
Y = -48.9
PR3
P = -245.5
Y = 500.0
BS
P = 187.0
Y = -264.0
PR2
P = 0
Y = 1350
Here are the current alignment values for all suspensions and unlocked HEPIs. With this alignment, as Betsy says, we see a beam going into HAM6 through the OFI.
We accidentally forgot that we had lightly clamped the ITMx for other "parallel" tasks when we were aligning the SR optics last week. Hence, the realignment after unclamping it today.