After a lot of alarms going off including a message from Jim, I discovered that most of the DMT processes had skidded to a dead standstill. The problem seems to have been that the broadcast frames had increased their length so that the data buffer lengths had to be increased also. The buffer lengths are now updated and the SenseMonitor outputs should now be working again. Yet again, Please! Let me know, preferably in advance, any time the broadcast frame list is changed.
Dan, Jim, Dave:
we tried several things today to try to make h1fw0 more stable. These are:
reintroduction of h1ldasgw2 to take NDS traffic away from h1ldasgw0 (leaving it only used by h1fw0)
upgrade the network link between h1fw0 and h1ldasgw0 from a cat5e 1GE to a fiber opitcs 10GE using borrowed intel 10GE cards from LDAS
reconfigure fw0 to not write commissioning frames
power cycle fw0 and ldasgw0
these changes have not made fw0 any more stable. fw1 continues to be more stable, some of its restarts were coincident with fw0 restarts (within several minutes)
The measurements of HARD loops with different laser powers were posted before (alog 27864, 27885, 27920).
We found that the big discrepancies between the measurements and modeling for Pitch are caused by a mistake in the simulation. I fixed it and replotted the measurements at 10w and 40w (37w actually) as below.
Now the modeling curves fit the measurements much better. In the 10w plots, the black dots are measurements without the optical levers servos on for the ETMs, and the red ones are measurements with OL on for all the TMs. (The blue curves are the modeling results, which assume only OL on for ITMs.)
State of H1: Peter and Jason are out of the PSL and locking will resume shortly
Activities today:
Still in play:
The first plot shows IM2 pitch changing by as much as 0.4urad at lock loss (lock loss after IMC power oscillations).
Subsequent lock losses on the plot show it moved by 0.3urad, 0.2urad, 0.2urad,and 0.2urad, for an average change in alignment of 0.26urad at lock loss from a 40W H1 lock.
This result supports my theory that the beam on IM2 is no longer centered, and is off center enough to explain the oscillations in it's pitch and yaw signals that I aloged here, and in an attachment here (where I showed that IM4 Trans sees the oscillation), while the IMC was oscillating in power from 22W to 57W.
The second plot shows that when H1 was no longer locking, the jumps in IM2 alignment stopped.
BS beam is not centered and it might be moving with power.
Last Friday, I placed a digital camera on a tripod in front of the CRT for the analog BS video looking at BS from BSHR side, and took some pictures. I conclude the following:
It's only digital camera image of CRT screen of analog video that saturates at 40W (but not really badly). Take it with a grain of salt, but if you believe that the pictures are not unreasonable representation of the reality, the following shows the BS beam positions at each power.
| 10W | 40W | |
| PIT from center (mm, positive=low) | 7.5 | 8.2 |
| YAW (mm, positive=right viewed from BSHR side) | -5.5 | -6.5 |
Note that YAW offset is seen from the -X+Y direction. You need to divide YAW (but not PIT) by sqrt(2) to convert it to the lateral beam shift.
I also took 2W picture but it's dubious because the background (dark) image subtraction didn't work well (see below).
I don't know for now how significant this is as far as the recycling gain is concerned. I'll ask simulators.
In the mean time, it might be useful to explore CSOFT offsets.
Fundamental assumptions.
Video lens, CRT screen and the digital camera are all reasonably rectlinear.
Bright thing is the beam on BSHR, not on BSAR.
BS X and Y elliptical baffle are as in D1200704, 703, 750, and the position of BS relative to baffles is exactly as in D1500239.
Mapping from picture to the physical position.
The first attachment is an annotation, so to speak, of one of my pictures (40W full lock) and the screen shot of CAD drawing D1500239 looking at the BS from roughly the same POV.
In the picture, red line is the edge of the BS Y elliptical baffle hole, yellow is X, green is the back side (AR) edge of the BS.
There are two black rectangular things between the red and the green line. Larger one is the side of the wire protection baffle structure. Smaller one is probably the ear on BS.
Baffle hole edge comprise two identical ellipses. The narrowest part is defined by two apexes (apices?) or points where two ellipses intersect. For mapping purpose I ignore all edges and only use these two points per baffle. Red and yellow vertical lines and dots on the picture are the center lines and the center point of Y and X baffle hole, respectively.
Since I know the physical position of these four points (two per baffle), distance from Y baffle to the BSHR surface, and from BSHR surface to X baffle, I can map e.g. the physical center of BSHR surface to this image shown as green dot in the first attachment. I can also map (X, Y) coordinate of any point on the BSHR surface in this picture to the physical coordinate.
Note that you need to account for the fact that we're looking through 60mm-thick BS to look at X baffle (but not Y and BSHR).
The position of two apexes for the Y baffle is quite well defined, but X is somewhat dubious because none of the pictures shows both sides of the apexes on X baffle (see e.g. second attachment). I assume that the edge on the picture ends at one of the points. This means that the yellow line could be to the right than in the picture, which subsequently push the BSHR center to the right, which subsequently push the YAW offsets in the table above more negative (i.e. larger YAW offset).
The length calibration on this image at BSHR surface is about 0.15mm/pixel. This is mostly determined by the distance between the Y baffle apexes and only weakly dependent on the X baffle because BSHR is much closer to the Y baffle than X.
How the images were taken and processed.
The third attachment shows the 40W image with and without dark image subtraction. I calculate the image COG inside the blue circle to find the center of the beam (yellow cross). The green circle is the center of BSHR.
The baffle looks odd after "dark" subtraction because the "dark" image is not dark for baffle scattering. That's because I used DRMI as a "dark" image (4th attachment). No true "dark" image was taken because I didn't want to interrupt locking activities. You can see in the dark image that the scattering from the baffle is already significant but not at the beam on BSHR, and that there's a reflection of the camera and the tripod on the CRT screen. Anyway, this is subtracted from the left of the third attachment to produce the right after taking into account the exposure time difference.
The beam position doesn't change much with or without dark subtraction.
Plots under the pictures show the red, green and blue channels across red horizontal lines in the pictures to see if the video image or the camera image itself was saturating, and it seems the video was, but not really badly.
The 5th and 6th attachments show 10W and 2W, respectively.
At 10W, maybe it's hard to see the benefit of dark image subtraction on the image itself, but if you look at the beam center cross section plot, removing the shadow of the camera and the tripod actually made the beam shape nicer.
At 2W, dark subtraction didn't work well. If you look at the frame of the CRT it's apparent that the dark subtraction failed. If you look at the edge of "SANYO" or the left edge of orange-ish sticky note, it's apparent that the digital camera was off in YAW significantly. But the bright image clearly shows the shadow of the camera and the tripod, and I don't know if the bright image is useful for guessing the beam position either.
After finding that the WFS on IOT2L had driffted offcenter to values around 0.7-0.8, an allert was put into the IMC_LOCK guardian.
The alert was set to be active at the limit of 0.3 for any WFS DOF.
WFSA yaw has drifted from 0.25 up to 0.28, causing the alert to flash on/off all the time, as the max WFSA yaw values crosses 0.3.
Since we are focused on getting ER9 started, I consulted Jenne and we came up with the plan to adjust the alert to 0.5, and recenter WFSA yaw next Tuesday.
Overnight fw0 became unstable again. We have two things to try: [1] offloading NDS QFS-NFS data using the new h1ldasgw2 machine, and [2] upgrading a frame writer's NFS network from 1GE to 10GE.
We just did the item [1]. We restarted the h1ldasgw2 solaris machine and hooked it back up to both QLogic switches. This solaris server sees both file systems (h1-ldas-frames and cds-h1-frames), and exports them as read-only NFS mounts. We reconfigured both h1nds0 and h1nds1 to only NFS mount h1ldasgw2, and set up their /frames symbolic links to both see /cds-h1-frames (i.e. the frames written by h1fw1).
So now on the h1fw0 system, h1ldasgw0 is only serving h1fw0 and not h1nds0, and no one is reading its frames except for LDAS disk-to-disk which is archiving the science frames (remember commissioning frames are archived from h1fw1).
State of H1: not able to make it through Locking ALS
Activities:
No significant site activities.
Chris B. noticed that the PINJ_TRANSIENT filter modules were all turned off. I have turned them back on, and updated the Guardian state so that these filters are monitored and set to be on in the observe mode.
Was ~23% and brought it down to 2%.
ALS X was also at 2%
Attached below are the past 10 day PSL trends. The trends reflect, largely the incursion into the enclosure due to the diode failure that occurred on Tuesday morning (July 5)
As usual refer to more in depth analysis to Jasoin O or Peter K.
In depth Chiller analysis can be referred to Jeff B
Came in and engaged the ISS. Found it was in manual mode. Left it in auto. The integrator engaged straight
away. This was before I did any temperature tuning of the laser diodes.
Attached is the average diffraction over the past week. I don't know why the spread was larger over the
past ~4 days and wonder if it was/is a portent of diode troubles. Things seem okay at the moment.
After yesterday's front end diode box replacement, the diode temperatures were left at the values from the old diode box. The diodes are now temperature tuned for what I think is close to the optimum values. Optimum being decided by the output power of the front end.
Trouble keeping MC and FSS locked. 23:14 UTC Chandra to CP3 23:17 UTC Jenne and Sheila to LVEA to measure MC open loop gain 00:07 UTC Jenne and Sheila back 00:37 UTC Sheila to LVEA to plug in SR785 for analog measurement of MC open loop gain 00:44 UTC Sheila back 00:50 UTC Sheila to LVEA 00:54 UTC Sheila back 01:44 UTC Sheila to LVEA to set up RF analyzer 01:59 UTC Sheila back
[Sheila, Keita, Jenne, Patrick]
We have been struggling to lock anything at all today. Sheila is going to post about the loop measurements that we made today, but this alog is a cry for help with regard to the ISS.
The ISS average diffracted power has been much more noisy than usual, ever since Friday. Since today's PSL work, it's even worse. We suspect that this may be bad enough that we are unable to lock. We can no longer keep the integrator for the first ISS loop engaged for more than a few minutes before the loop starts to oscillate. But, with or without the integrator on, the diffracted power is moving around like crazy.
At this point, we are leaving the IFO in Down, and hopefully someone from Team PSL will come in and look at the ISS tomorrow, and then maybe locking will be possible.
As a side note, it appears that everything in the PSL is misaligned by a bit. Both the PMC and RefCav transmissions are about 25% lower than normal, with corresponding increases in their reflected powers. This is probably the reason that we've had to increase the FSS loop gain earlier today to make locking even the IMC possible (see Sheila's alog).
Attached are measruements of the IMC open loop gain. We cannot measure the FSS gain without going into the PSL, but Peter King posted some measurements from May
The first attached plot shows that the IMC goes unstable around 200 kHz when the FSS gain drops by only 2dB. Since the power transmitted by the reference cavity droped 25% after the laser problem, this probably explains why we were having trouble keeping the IMC locked with our old FSS gain of 14dB. (see Hoacun's measurement of the time when we reduced the fast gain from 20 to 14 dB for a comparison.) It seems like we want more than 2dB of gain margin though... The orange trace shows that the IMC OLG continues to improve as we turn the common gain up to 20dB, but in this configuration the FSS cannot recover from a lockloss. If this is the reason we keep the FSS gain marginal, we could write a gaurdian to automate relocking at a lower gain and turning up the gain once locked.
We checked that the IMC optical gain has not changed since Evan H's mid June measurement. (taken on the day the IMC gain was reduced by 4 dB from a IN1 gain of 20dB for 2 Watts to 16 dB at 2Watts which gives us a UGF of about 65kHz).
The second plot shows what happens when we change the fast gain by +/- 4 dB, reducing the gain makes gain peaking at 200 kHz.
The data attached is for the configuration we are leaving, IMC locked at 2 Watts with 16dB IN1 gain, FSS common gain 16 dB, FSS fast gain of 22 dB.
Also, there seems to be a problem with ALS DIFF after today's maintence. We tried flipping the bias sign back, but that didn't help. Since we still have laser/FSS/IMC problems we didn't investigate much further.
My guess based on the LLO experience of late is its the ISS AOM. My suggestion (from afar) is to realign and recalibrate the ISS AOM (its something that Christina B from AEI suggested should be done each time laser alignment could change). Since Ive done ours, our fluctuations that were on the order of %'s during O1 and before has really settled down to barely vary at all (hopefully I haven't jinxed myself now).
However doing this to the ISS AOM will probably misalign the PMC a bit (but if its already misaligned and need to redo the alignment anyway, now is maybe a good time to try realigning and recalibrating the ISS AOM)
J. Kissel, E. Goetz, K. Izumi, D. Tuyenbayev Evan will post the details of the work we've had to do to get the model running, but in the interest of time, I've taken what we needed from the Matlab model to update the CAL-CS front-end filters. Since early results indicate that the only low-frequency (sub-Nyquist) things that have changed from the O1 model are in the sensing function (see LHO aLOG 28171): - Lower optical gain = 9.071e5 [ct/m], - Lower frequency DARM coupled cavity pole frequency, f_c = 328.7 Hz, and - New SRC-detuned optical spring frequency, f_s = 9.831 Hz. I only needed to update the H1:CAL-CS_DARM_ERR inverse sensing function filter (see further discussion below). The new settings have been captured in the SDF system. Details of the design: Foton Design String -- zpk([9.831;-9.831;328.7],[0.1; 0.1;7000],1,"n")gain(9574.81)*gain(1.102e-6) The gain of 1.102e-6 is 1 / 9.071e5 [ct/m], this lives separately in FM4, called "ER9gain." In FM3, in the filter called "SRC D-2N" for "Signal Recycling Cavity De-Two-Ne" there lies: - The pair of real poles at 9.831 Hz, one of which is in the right-half-plane, reflect the detuning dynamics. Note that we've rolled of these inversion zeros at low frequency of two real poles 0.1 Hz. - The 328.7 Hz is the new f_c, and we retain the same high-frequency roll off of 7000 Hz. - The gain of gain(9574.81) which is the correct normalization gain to get the over-all gain to be unity at 100 Hz, which is the frequency at which I matched the no-detuning gain of the (unused) 329:7000 filter in FM3. The attached PDF shows that the ER9 gains agree between detuning and no detuning, and as expected, the overall optical gain is ~20% lower that O1 because we've not yet digitally compensated for the ~20% lower optical gain (because of 20% lower PRC gain; see LHO aLOG 28133) in the DARM loop. Further Discussion on why I've only updated the Sensing Function: All actuation strengths are within ~5% of there O1 values (see LHO aLOG 28130), and we've compensated all electronics better (see LHO aLOGs 27180, 27150, and 28087), so we need not update anything in the actuation chain. Rana and Evan H. have changed the local, top-mass damping loop filters for the QUADs, so nominally the QUAD dynamics have been changed, but that should be a small effect in the GW band. We'll update for O2, but no need for ER9. There have been several changes to effects at high-frequency, but all of those are covered in the GDS FIR filters which absorb the CAL-CS output and acausaly correct for these super-Nyquist frequency effects.
J. Kissel, E. Goetz
After exporting the above SRCD-2N filter from foton and importing it back into matlab to compare against the matlab model of the sensing function, we discovered that my gain normalization was not perfect, and had a ~1% systematic error. This is likely because there is still some influence of the 9.8 Hz detuning poles at 100 Hz where I chose to normalize to the no-detuning filter.
As such, instead, I've re-normalized to the gain at 500 Hz above the DARM coupled cavity pole. This results in a now-better-than-0.01% agreement with the matlab model in gain at all frequencies. I've updated the design string to
zpk([9.831;-9.831;328.7],[0.1; 0.1;7000],1,"n")gain(9674.74)
and loaded coefficients.
Rana, Evan
WE measured the SRM to SRCL TF today to find the frequency and Q of the internal mode. Our hypothesis is that the thermal noise from the PEEK screws used to clamp the mirror into the mirror holder might be significant contribution to DARM.
The attached Bode plot shows the TF. The resonance frequency is ~3340 and the Q ~150. Our paper and pencil estimate is that this may be within an order of magnitude of DARM, depending upon the shape of the thermal noise spectrum. If its steeper than structural damping it could be very close.
"But isn't this ruled out by the DARM offset / noise test ?", you might be thinking. No! Since the SRCL->DARM coupling is a superposition of radiation pressure (1/f^2) and the 'HOM' flat coupling, there is a broad notch in the SRCL->DARM TF at ~80 Hz. So, we need to redo this test at ~50 Hz to see if the changing SRCL coupling shows up there.
Also recall that the SRCLFF is not doing the right thing for SRM displacement noise; it is designed to subtract SRC sensing noise. Stay tuned for an updated noise budget with SRM thermal noise added.
** see https://alog.ligo-wa.caltech.edu/aLOG/index.php?callRep=27455 for pictures of the SRM compsoite mass.
The peak is also visible in the DARM spectrum. In this plot the peak is at 3335 instead of 3340 Hz. Why is there a 1.5% frequency shift?
Here are projected SRM thermal noise curves for structural and viscous damping.
Given a typical SRC coupling into DARM of 1×10−4 m/m at 40 Hz, 20 W of PSL power, and 13 pm of DARM offset (25019), this would imply a noise in DARM of 1×10−20 m/Hz1/2 at 40 Hz if the damping is structural.
When I modelled the optics in https://dcc.ligo.org/LIGO-T1500376 and in particular the surrogate SRM I had assumed optic was bonded. After looking again earlier with Rana and Betsy realised it is held with 2 set screws (Peek?) on barrell at 12 o'clock and two line contacts at 4 and 8 o'clcok. See https://dcc.ligo.org/LIGO-D1200886.
The previous bonded model for the SRM surrogate (I believe) had a fisrt mode predicted around 8k Hz. However, from a quick model I ran today (with the set screws etc ... ) the first mode appears to be around 3400 Hz. The mode is associated with the optic held with the peek screws. (Now I was doing model using remote desktop so I will need to check it again when I get a better connection, so more to follow on this. I will also post updated model, once I get back to Caltech.)
The ~3340Hz peak is also clearly visible in the PDA/PDB x-correlation spectrum. See alog 26345.
A couple of comments on this topic:
Danny, Matt (Peter F remotely)
Due to the issues currently seen at LHO, we were asked how the LLO SRM surrogate was put together and if we could add to the alog for a record of the process. The easiest way is to do it via photos (which we have of the assembly process).
IMG_1462....There are only two setscrews that hold the optic in place. Can be seen putting these in place below in the "cup" that holds the optic (eventually). Im not sure of the material but Peter F's speculation is that "I think those set screws must be the carbon-loaded PEEK type. The only other option I can think of for a black set screw would be carbon-steel, and it surely isn’t that."
IMG_1455...Here you seen the three main parts. The optic, the “cup” that the optic goes into and then the main mass the cup goes in. Note in the “cup” you see the two raised parts at around 4 and 8 o’clock that the setscrews ‘push’ the optic onto. So its not 'really' a three point contact, its 2 points (set screws) and 2 lines (in the holder)
IMG_1466...Here is the optic going into the cup making sure the fiducial on the optic lines up with the arrow on the cup
IMG_1470.....Optic now in the cup and doing up the setscrews that hold it in place. I cant remember how much we torqued it up (we only did it by hand). But as Peter F again speculated that perhaps we just did the setscrews up tighter than LHO
IMG_1475....Flipping the cup (with the optic in it) over and placing in main mass
IMG_1478....Cup now sitting in Main mass (without screws holding cup into main mass)
IMG_5172......the SRM surrogate installed into the suspension
It looks like there might be a mode in the L1 SRM at 2400 Hz. See the attached plot of SRCL error signal from January, along with DARM and the coherence. There is also a broad peak (hump) around 3500 Hz in SRCL, with very low coherence (0.04 or so) with DARM. The SRCL data has been scaled by 5e-5 here so that it lines up with DARM at 2400 Hz.
Here are two noise budgets showing the expected DARM noise assuming (1) structural (1/f1/2) SRM damping and (2) a hyperstructural (1/f3/4) SRM damping. This hyperstructural damping could explain the DARM noise around 30 to 40 Hz, but not the noise at 50 Hz and above.
I also attach an updated plot of the SRCL/DARM coupling during O1, showing the effect of the feedforward on both the control noise and on the cavity displacement noise (e.g., thermal noise). Above 20 Hz, the feeforward is not really making the displacement noise coupling any worse (compared to having the feedforward off).
Note that the PEEK thermal noise spectrum along with the SRCL/DARM coupling is able to explain quite well the appearance of the peak in DARM.
I am attaching noise budget data for the structural case in 27625.
in a final attempt to make h1fw0 stable for tonight I have reduced its configuration to only save science frames (is not writing commissioning, second trends or minute trend frame files). Since that time fw0 has been stable (2 hours) with fw1 restarting once. The issue certainly appears to be file system access, we will continue our investigation tomorrow.
Note that on the DAQ overview MEDM screen, only the science frame size should match, CRC and Commissioning size numbers will not match.