I am leaving it to the morning PSL crew.
I had another look at the slow drop in sideband powers that consistently breaks lock within 20 minutes of powering up to 50 Watts.
This time I changed the soft loops to X,Y degrees of freedom (first I made the pitch filters for dsoft match csoft, this worked fine but isn't in the guardian). I ran dither lines on the test masses and tried to move offsets in the soft loops to keep the spot positions stable, but this didn't help the tanking sideband powers at all. I tried moving PR2/SR3/POP offsets. SR3 can help improve the AS90 build up after a PR2 move that helps POP18 but walking these together didn't work out well. I tried locking at 40 Watts where we have more time to move offsetsm but didn't find any alignments that could help the sideband build ups. We might have to look at some lensing. I tried using offsets in the POPX to PR3 loop, but as we expect these only made things worse.
The fastshutter lockloss checker seemed to think that the shutter had not fired in one lockloss today, but as shown in the attached screenshot, it did fire. Leaving the IFO with Kiwamu for the night.
On the fast shutter script:
I forgot to mention that I fixed a typo inthe LOCKLOSS_SHUTTER_CHECK yesterday. The arm power check looked at the x-arm power twice (instead of both arms, i.e. I changed line 26 from
if circ_power_x >=arm_power_upper_thresh or circ_power_x >=arm_power_upper_thresh:
to
if circ_power_x >=arm_power_upper_thresh or circ_power_y >=arm_power_upper_thresh:
and line 34 from
if circ_power_x < arm_power_lower_thresh or circ_power_x < arm_power_lower_thresh:
to
if circ_power_x < arm_power_lower_thresh or circ_power_y < arm_power_lower_thresh:
It looks like the checking script now sometimes triggers without the interferometer actually dropping lock - the Guardian time stamp on Sheila's plot does not agree with the actual lock-loss.
This probably happened because during the transition the Y arm fulfilled the HIGH_ARM_POWER criteria, while the X arm fulfilled the LOW_ARM_POWER criteria.
Thus I changed line 26 from an 'or' to and 'and'. This hsould properly latch the transition.
if circ_power_x >=arm_power_upper_thresh and circ_power_y >=arm_power_upper_thresh:
return 'HIGH_ARM_POWER'
The last 4 lock-losses (two from Sheila's two locks in INCREASE_POWER, and two of Stefan's lock in COIL_DRIVER_SLOW
After Peter King brought back the laser, we relocked the interferometer.
We had to increase the OMC scan range ( omcparams.scan_vramp ) from 40 to 60 for the guardian to find both sidebands.
Then we again lost it twice during the COIL_DRIVER swtiching because of a 2Hz CSOFT signal (pitch and yaw) ringing up. Lockloss plots of both locks are attached.
Next we switched back to ther old COILD_DRIVER_SLOW switching. Interesting, we still had problems once we stated switching test masses (ETMY - the first one tried). All the corner optics switched without problems (Actually, SRM and SR2 had 0 seconds matrix ramp time, and still were fine. I set it to 1 sec for now - we should speed that switching up. )
In a second attempt I tried only switching ETMY by itself - with all top mass relief loops off (because the high BW offloading was one of the things we changed). still no luck - same 2Hz instability.
Still something changed with the test masses - it is not just the switching script.
A large earthquake spopped further work. I left the slow COIL_DRIVER_SLOW state as a parallel path in the Guardian for debugging. Also It currently only switches PRM, PR2, SRM, SR2, BS.
Kiwamu will try to do some ISS work with the IMC during the quake.
Is the coil driver switching still trying to go from state 2 (highest range) to state 3 (lowest range)? If so, you might try going from state 2 to state 1 (ACQ off, LP off), in case the lock loss problems come from lack of range.
Attached is a 5 minute plot of the monitor signal for the current of diode box 3. The initial reported value of 50.14 A is corrected. ~44 seconds after the start of the plot, the monitor signal hits 100 A. Whilst the switching from the true value to the false value was going on, the error bit on the corresponding Beckhoff terminal did not change state from 0 to 1. The output value changed from ~12460 to ~24880 counts. Since an ADC most likely does not change its reported value unless the signal it is monitoring changes, the problem would seem to lay with the output monitoring signal of the power supply. Without knowing what is in the output monitoring circuit of the power supply, the problem I have is explaining why it resets itself after a period of inactivity unless it is a temperature related fault. The evidence for it being temperature related is purely circumstantial at this stage. I would suggest that the power supply be switched out.
Came to site just now to find laser off.
Hi Terra,
Bummer, sorry to hear that. You likely already know this, but just in case - if you or anyone else would like to check the PSL status before heading out to the site on a night or weekend, while there are a number of ways, one quick one is to point your netscape nagivator to the LHO summary pages, click on "Today" then "PSL" then "Front End" to check the laser status. The plot you made is updated there automatically - e.g., see this link.
5pm local 12 sec to overfill CP3 with LLCV bypass valve 1/2 turn open. Next fill due Tuesday, Sept. 6.
TITLE: 09/03 Eve Shift: 23:00-07:00 UTC (16:00-00:00 PST), all times posted in UTC
STATE of H1: Commissioning
INCOMING OPERATOR: None
SHIFT SUMMARY: Commissioning and an EQ. Toward the last bit of the night we made it to DC_READOUT_TRANSITION wher the OMC_LOCK Guardian went to the state, WAIT_FOR_AS_LIGHT. Seems that the light on the OMC QPDs was below its threshold of 100. Searching through alogs, Terra and I only found alog22289 that referenced this type of situation. We tried following Jenne's suggestion of making sure the Master gain was 0 (though it was actually 0.05, whoops) and then clearing the history of the ANG filter banks. But it didnt work, and when we tried to clear the history for the POS filter banks, because why not at this point, it just dropped the lock. We are done for the night, leaving it in down.
Overall message:
More about CSOFT PIT:
We were using a control filter that had a pair of complex zero compensating the 0.4 Hz resonance, which meant we had very little gain to supress the instability using ASC. I changed this to a single real zero, which gives us 20 dB gain at the instability frequency. The filter comparison is attached, and a measurement taken at 2 Watts. In the green measurement I had made a msitake in the filter at 1.5 Hz, the red measurement is with this fixed and the phase should be unchanged from the old design at these frequencies.
Here are some plots to illustrate the alignment progress described in Jenne's alog 29457
The first attachment shows various powers plotted against input power for a power up with the old PRC alignment (blue) and the new PRC alingment (orange).
You can see that we are still loosing recycling gain as we power up, but less so than with the old alignment. We know that we can move the PR2/POP offsets a bit more; we stopped where we did last night because we started to rail the POP PZT and had to realign on the in air table. You can also see that the sideband powers are not dropping quite as much as with the old alignment, although we start with POP 18 lower.
The bottom row shows REFL normalized by the input power; the plot below shows normalized refl power vs recycling gain. (Time during the power up goes from right to left on this plot). You can see that as the alingment gets worse the interferometer is approaching critically coupled, with the old PRC alignment the reflected power starts to increase again for recycling gains below about 27.
After one of the locklosses in the morning the IMC would not relock. Clearing some of the IMC WFS DOF histories brought it back. I often had to adjust the BS in pitch to lock on DRMI. At some point the X arm alignment ended up such that engaging the WFS would drive the green alignment off. Jenne and I trended the optical levers back for ITMX and ETMX and tried bringing these optics back to those values. This did not seem to help so Jenne suggested that I go through an initial alignment. I did and was able to lock both arms on green without difficulty after that. After the initial alignment we kept losing lock engaging the DRMI ASC loops. Jenne and I stopped at LOCK_DRMI_1F and minimized the ASC loop error signals by hand. Eventually this allowed us to move on. 16:26 UTC Betsy to LVEA west bay 16:31 UTC Kyle to LVEA to take RGA scans 16:51 UTC Betsy done 17:48 UTC Kyle back, not able to take RGA scans 18:51 UTC Chris sending excitation to ITMX 18:53 UTC Kyle back 20:14 UTC Chris sending excitation to ITMX 21:40 UTC Kyle retrieved computer from LVEA 21:49 UTC Starting initial alignment 22:14 UTC Done initial alignment 22:42 UTC Kyle to mid Y to fill CP3
The laser tripped again. Suspected cause is the same as the trip from earlier this morning. Maintenance Tuesday will most likely be quite invasive.
~1550 - 1615 hrs. local -> Kyle to and from Y-mid Opened exhaust check-valve bypass-valve, opened LLCV bypass-valve 1/2 turn -> LN2 @ exhaust in 18 minutes 28 seconds -> restored valves to as found configuration. NOTE: I increased CP3's LLCV %open value from 20% to 21% in response to the time needed to fill today
Please when the laser trips, disable the locking for the PMC, FSS, and ISS. It doesn't make much sense to keep ramping the NPRO PZT when there's no chance of any of the cavities acquiring lock.
It would be best to write a guardian to do this if it is necessary. There are not always people here when the laser trips.
I added a few lines to the LASER_PWR Guardian so that when this node goes to FAULT from a lack of light, then it will turn OFF the autolockers for the FSS, PMC, ISS in that order.
[Sheila, Jenne, Kiwamu, Terra]
We have reset the initial alignment offsets, including realigning several paths on ISCT1, to match the alignment that we liked from yesterday (alog 29430). So far, we think that it's good. We have powered up part way twice since, and the power recycling gain no longer drops very much! It still drops a bit, so we could consider going a bit farther, but this is probably plenty good to move on and focus entirely on low noise efforts. Now at 40W it is something like 31, rather than something in the mid/low twenties. Plots coming tomorrow.
In order to do this, we did the following (hardware alignment changes noted in bold):
1st screenshot: powering up from 2 watts to 32 Watts without loosing recycling gain. The POP18 build up still drops, but AS90 is much more stable than with previous alignments. According to the POP/IM4 monitor, this is a recycling gain of over 32 at 32 Watts, calculated from the arm transmissions it is a recycling gain of 34.4
2nd screenshot: Slider values for new alignment.
3rd screenshot: Modification to CSOFT pit filter to add phase and gain around 0.4 Hz, the frequency of the dPdtheta instabilty. On the right side of that screenshot is a measurement of the loop, taken with the digital gain set to 0.1. The nominal gain used for the references was a factor of 5 higher and we have now restored the loop to that gain. We can probably get more supression of the instability out of this loop.
Apart from the recycling gain, we seem to see a slight improvement in the beam shape at the dark port after the PR2 move. The below are camera images of the AS port a few days ago and today, respectively
A concentric circle pattern (with circle pattern's center at around x,y = 350,270) became dimmer. Note that the old image was taken about 17 min. after the interferometer had reached 50 W, while the latest image was taken a few minutes after a 50 W lock. Also, the third attachment shows a comparison of the horizontal beam profile around the center in which the latest picture shows less significant features.
Not that this is a surprise or anything, but I was noticing that the light on the OMC trans camera changes noticeably as the IFO thermalizes.
I've temporarily increased the exposure of the camera to 7000 (usually 569). You can't see much at 2W, but you start to see it at 20W and 35W - again not so surprising. What is perhaps more interesting is the way the light there changes after we've been at 50W for a while. The titles of the attachments include how long we were at each power. All images were taken during the same lock, so the 2 min at 50W image is after 5 min at 20W, and then 5 min at 35W, so it's not straight 2W->50W on this acquisition.
Since the original images are .tiffs, I've included a screenshot of all 6 images. Top row, left to right: 2W, 5min@20W, 5min@35W. Bottom row, left to right: 2min@50W, 6min@50W, 30+min@50W.
From the picture @2min 50W, I could see that this mode is probably one of the 9th-order modes.
I made the attached HOM map, based on the transverse mode spacing (TMS) of this OMC, measured during the final test.
It is likely that this 9th order mode is +9MHz sideband.
In order to try to push this mode away from the resonance, you can tune the DC voltage of the OMC PZT.
There must be two or three carrier TEM00 resonances in the OMC PZT range (0~100V) as one FSR corresponds to ~40V of the PZT voltage.
Choose the lowest voltage one. The DC voltage of the PZT changes the curvature of an OMC mirror and then the TMS by about 10ppm/V.
(Increasing the PZT voltage will not give us a good solution. It causes 10th -45MHz (cyan) mode comes into the resonance.)
You may already be at the lowest resonance, or the lowering the operating PZT voltage may not be enough to push the resonance away.
If this resonant HOM is still problematic, we need to reduce the leakage 9MHz sidebands from the interferometer.
[Sheila, Jenne]
We now lock the OMC on the carrier with the lowest PZT voltage possible, which is about 20V. We used to be locking with about 60V. It's not yet clear if this is enough of a change - we need to do some intensity noise coupling measurements with both lock points.
Here are some camera images though. Recall that in the last alog (29395) we spent some time at medium PSL powers before going up to 50W, so the total IFO thermal state isn't the same when we first arrive at 50W. The top row of images is from one lock, and the second row is from a different lock, although the times since arriving at 50W are accurate in the image titles. Top left is 2W DC Readout, then just after getting to 50W, then 2 min and 5 min at 50W. In a different lock the second row shows 35 and 45 minutes after arriving at 50W.
Posting Jenne's pictures for comment above