Injected a MICH or SRCL line at 45 Hz, tuned the MICH or SRCL feedforward gains to minimize the line in DARM.
Small improvement by changing MICH_FF_GAIN from -1 to -0.955. No improvement by chaning SRCL_FF_GAIN. Those gain changes have been absorbed into the Oct10 filter, so the nominal gains in the filter banks are still -1 and -1
The attached plot shows the effect of switching on the MICH and PRCL feedforward (beware that the reduction of the ~50 Hz / ~ 100 Hz bumps is due to closing the beam diverters)
While locked at 20W, we adjusted the soft offsets, the POP_A offsets and the SRM/SR2 angular position, trying to improve the carrier recycling gain. We did not get back all the build-up we could (the lock broke before we were done).
The realignment not only improves the recycling gain for the carrier, but also reduces the coupling of frequency noise at high frequency.
So part of the increase of frequency noise when we power up can be recovered by tuning the alignment set point.
We updated the soft offsets and the POP_A offset to the best value found so far:
caput H1:ASC-X_TR_A_PIT_INMON -0.168109
caput H1:ASC-X_TR_A_YAW_INMON -0.208626
caput H1:ASC-X_TR_B_PIT_INMON -0.021139
caput H1:ASC-X_TR_B_YAW_INMON -0.076330
caput H1:ASC-Y_TR_A_PIT_INMON -0.148733
caput H1:ASC-Y_TR_A_YAW_INMON 0.372014
caput H1:ASC-Y_TR_B_PIT_INMON 0.078767
caput H1:ASC-Y_TR_B_YAW_INMON 0.434853
Screenshot of error attached. Restarted computer. IOC did not reconnect to PLCs upon auto start at computer boot. Did after restarting the IOC manually. This kind of error has been much more frequent at the end stations. This is the first time, at least in a long time, that I have seen it at the corner station.
During the low noise lock at 4:50 UTC today (Oct 11), there is a comb of lines in h(t) at 56.84 and multiples. They are quite narrow lines. The most interesting characteristic is that they have extreme amplitude modulation. The first attachment is the h(t) spectrum with the lines marked. The second shows narrow BLRMS around each of the lines. The fundamental at 56.84 Hz has a half-period of about 24 minutes. The amplitude goes very close to zero, and looks very periodic. Each multiple n has zeros in the same place, but the period is n times shorter. Maybe this could be all generated from the fundamental with the right kind of nonlinearity. I'm not sure what would give such a slow but extreme modulation - maybe some centering servo? The BRUCO results show a lot of channels at End-X coherent. Accelerometers on BSC9 seem to see it, but without amplitude modulation. PCal X sees it in the TX and RX PDs, but stronger in RX; but it doesn't seem anywhere near the level to get into h(t).
The 56.84 Hz comb is a blast from the past. Here is an entry from March 2013 concerning H2 one-arm data suggesting that the comb could be purely DAQ-related: https://alog.ligo-wa.caltech.edu/aLOG/index.php?callRep=5806
This one is close enough to the 57Hz ETM HWS that we've seen in the past that I thought I should mention it here. However, we've recently overhauled that system and I've not confirmed what the new frame-rate is yet.
Here's the old analysis: https://alog.ligo-la.caltech.edu/aLOG/index.php?callRep=14778
I Looked at an empty EX ADC channel (H1:PEM-EX_ADC_0_08_OUT_DQ) and found that the 58.64 Hz comb is there too, indicating that the comb comes from some source independent of the interferometer (i.e. in the DAQ or RF pick-up). I have attached ASDs of the empty ADC in 0.1mHz bins both for the entire spectrum (0-1024Hz) and near to the 14th 56.84 harmonic (~795.76Hz). I was slightly surprised that a second nearby line (that would explain the amplitude modulation) was not seen even with the 0.1mHz resolution.
Yes - the ETM HWS are running at 57Hz. This doesn't mean that this is the issue since it appears to be DAQ related, buuuut .....
aidan.brooks@zotws11:~$ caget H1:TCS-ETMX_HWS_SYNC_FREQUENCY
H1:TCS-ETMX_HWS_SYNC_FREQUENCY 57 Hz
aidan.brooks@zotws11:~$ caget H1:TCS-ETMY_HWS_SYNC_FREQUENCY
H1:TCS-ETMY_HWS_SYNC_FREQUENCY 57 Hz
I've searched EX channels and found some channels where amplitude modulation is seen: H1:SUS-ETMX_L3_DRIVEALIGN_L_OUT_DQ H1:SUS-ETMX_L3_ISCINF_L_IN1_DQ H1:SUS-ETMX_L3_LVESDAMON_LL_OUT_DQ H1:SUS-ETMX_L3_LVESDAMON_LR_OUT_DQ H1:SUS-ETMX_L3_LVESDAMON_UL_OUT_DQ H1:SUS-ETMX_L3_LVESDAMON_UR_OUT_DQ H1:SUS-ETMX_L3_MASTER_OUT_LL_DQ H1:SUS-ETMX_L3_MASTER_OUT_LR_DQ H1:SUS-ETMX_L3_MASTER_OUT_UL_DQ H1:SUS-ETMX_L3_MASTER_OUT_UR_DQ Attached plots are BLRMS and zoomed spectrum of H1:SUS-ETMX_L3_DRIVEALIGN_L_OUT_DQ as an example. The vertical line (orange, dotted) in the zoomed spectrum is at 568.404 Hz (10th harmonics).
NO
we moved the Hartmann sync frequency and the lines moved accordingly - its Hartmann, not DAQ.
Why does the Hartmann sensor so strongly couple to DARM?
With regards to the coupling, the ETM HWS are served by the same power supply as the ring heaters. It's a long shot but it might be worthwhile to try disconnecting the ring heaters from the driver while the to see if the coupling of the 57Hz to DARM is changed.
https://dcc.ligo.org/LIGO-E1100891

While the commissioners were at JC and in a meeting, I ran the new clean HEA vacuum over the parts of the TCS-X table that were within reach. Very little water was extracted as most had evaporated during the past week. I did not vacuum under the periscope mount or along the back wall of the enclosure due to limited access. The enclosure panels were put back on and the laser restarted around 13:00PT. Per TJ's request, I left the left side door cracked and the fan on. TJ will finish closing up the table later today.
The new Debian9 environment was missing the LIGO_RT_BCAST variable, which prevented diaggui and awggui from selecting EXC test point channels for excitation. I have opened an FRS for this
https://services.ligo-la.caltech.edu/FRS/show_bug.cgi?id=11637
The problem has been fixed.
In addition to adding this environment variable, we also installed the pydotplus packaged needed for guardian graphing, and defined the 'z' alias to cdsutils.
Richard, Fil, Dave:
The Contec6464 binary card for h1susitmx was replaced. Procedure was:
* this did not boot on power up, it was stuck at the console message:
BMC IP:10.99.101.128
DXE--Intec Reference Code Execution
We waited for several minutes, then powered the chassis completely off by pulling the power cords. On reapplication of power the system booted and started the models. SWWDs had tripped on SEI by this time.
A second model restart was required after the binary input/ouput chassis were subsequently power cycled.
[Sheila, Haocun]
We began to work on guardian for squeezing automation.
- A new state "PREP_SQZ_ALIGN" was added in ALIGN_IFO. This locks OPO --> Misalign PR2, SR2; Align SRM --> open the beam diverter.
- 'SUS_SR2', 'SUS_PR2' and 'SQZ_LOCK' were added into the nodelist.
Daniel, Terry, Nutsinee
We temporary locked LO loop (with PSL LO) using additive offset on TTFSS just so we can figure out why is it so noisy (slow path still output to OPO PZT, fast goes to TTFSS AO). We saw 3MHz leaking out of PFD IMON and it also shows up in LO common mode board fast control signal. Some filters need fixing.
LO loop OLG transfer function shows UFG at 63kHz (without 4Hz/400Hz slow path compensation). Transfer function at fast path shows crossover ~700Hz (with 4Hz/400Hz). Within a factor of 2 of what we calculated.
With the original Pomona box (alog44446) we would've needed a gain of 36dB on the fast path for a reasonable cross over. Daniel doodly clipped a 220Ohm resister in parallel to the existing 1kHz to give us 14dB less gain in the slow output to PZT. This allow fast gain to be within +32dB slide bar range.
One of the issues we discovered was that the TTFSS was modified to have a pole/zero and more gain in the sensing path. This was done to make the OPO look more like a reference cavity with a 70kHz pole. However, this reduced the AO path gain by 20. To get this gain back we need to move the compensation to the next OpAmp, after the AO is added; see LIGO-E1800283.
The second issue is with the PFD and the 3.125 MHz LO. The PFD filter is designed for LO frequencies >9MHz. At 3.125 MHz there is only 12dB of attenuation which results in a 1V LO signal leaking into the servo board. We can add a notch filter by stuffing C14 and C19 with ~260pF on LIGO-D1002471.
Craig, Sheila
We engaged the MICH and SRCL FF with the filters that Jenne and Gabriele loaded 44470. There is some remaining coherence with MICH and SRCL, so our FF could be tuned. There is a lot of noise due to CHARD up to 40 Hz. We also have frequency noise above 1 kHz, we haven't boosted the CARM loop yet. (see attachment)
The peaks we've seen the last 2 nights at 50Hz and harmonics went away when we closed the REFL and AS beam diverters.
The calibration isn't done yet, but Craig did a spot check with PCAL at 90 Hz and it seems like the calibration there is not off by much. We still have a lot of broadband noise from 45-150 Hz, we will wait until this is calibrated to make a comparison with the noise which appeared after the Montana EQ.
The BRUCO scan that Gabriele ran had coherence with REFL 9 Q (which was plugged into I last night but is now fixed so that digital I is really I and digital Q is really Q) around 100 Hz. This coherence is eliminated along with the peaks at by closing the beam diverters.
We are leaving the interferometer alone to get at least 25 minutes of data with no one doing anything starting at 4:50 UTC Oct 11.
Lockloss at 1223271902 in state CLOSE_BEAM_DIVERTERS, the guardian did not take us to DOWN straightaway, I had to manual there.
Lockloss likely ASC, oscillation at 0.5 Hz in POP 18 and 90.
I tried to set up an LSC sensing matrix measurement while locked at 21.7 W, but was unable to excite anything using awggui or DTT.
DTT reports there are no available channels for excitations, and awggui will not connect to any EXC channels.
awgSetChannel: failed awgnewchannel_1(chntype = 1, arg1 = 0, arg2 = 0, awg_clnt[31][0] = 0) H1:SUS-BS_M3_LOCK_L_EXC
BruCo scan of the time starting at 4:50 UTC Oct 11 (1223268618 + 600s):
https://ldas-jobs.ligo.caltech.edu/~gabriele.vajente/bruco_1223268618/
Recently the noise at 100Hz is consistently smaller than the plot Sheila posted (top, green trace is now, red is the same as Sheila's plot).
One question was if this difference is somehow bogus due to unintended calibration model/parameter change. Calibration was changed at some point but was reverted back on the same day. I looked at uncalibrated OMC DCPD SUM (bottom) and the same difference is there, so this cannot be the calibration difference.
Seems like broad noise is somehow related to CM gain. (Sheila, Craig, Keita)
In the attached, the color of the traces on the right corresponds to the color of arrows on the left top. Green is the same time as Sheila's plot.
It turns out that H1 BNS range used to nose dive right after going high power but it stopped doing that after Oct/11/2018 10:40:00 UTC or so, that's right after the blue. And that's where the broadband noise got much better (red).
No activities at that time other than Craig's changing gains in CM path (44480), e.g. in the left bottom you can see that Craig changed MCL gain from 5 to 20.5.
From high kHz bump, it seems like the frequency noise coupling and/or frequency noise itself are changing slowly at the same time as the broad band noise at about 100Hz (compare orange, brown, green and blue).
It's not clear to me if this is somehow coming from the residual frequency noise at 100Hz (gain-limited or what?). Need more investigations e.g. reducing CM gain, noise budget, and maybe injections.
DaveB is looking into it, but DTT isn't ramping down excitations using noise injection. This is something we've been seeing, but usually it just causes saturations. I think it *may* have caused a lockloss a week or so ago, but it definitely killed a lock today.
I attach an ndscope showing that the excitation just suddenly stops, as well as 2 screenshots showing my excitation and measurement settings. You can see in the Measurements tab that I've got a rampdown time set for the excitation.
For now, since these are noise injections, I can use awggui for the injection, which doesn't seem to have these same ramp down problems.
I append these screenshots to FRS ticket 11367.
This could be a repetition of a problem two years ago where the output filter rings for a long time such that at the time the excitation is turned off the output amplitude is still non-zero.
We could only come up with a work-around, using diag to manually control the output gain stage of the awgtpman excitation channel to ramp the output down to zero over a ramp time.
Here is the wiki page describing the work around:
Here are the original alogs from 2016:
I was able to reproduce the problem on a PEM-MY test channel (attached plot)
This current problem is covered by FRS FRS-11367
I think awggui does ramp down correctly (or at least someone should check) so a good option is for people to just use that for their excitations until dtt can be really properly fixed.
Terry, Nutsinee
There was an error in the previous mode matching solution that contributed to a miserable -23 dBm beat-note signal at the detector. The solution (attached) still gives a fairly miserable -16 dBm beat-note. However maintenance Tuesday finished before it was fully optimized and I was concerned about bumping into the HEPI by HAM6 now that ISCT6 is in its final position. There is also maybe an issue of saturation with .7mW from the Mephisto path and .5mW from the PSL path (detector should have a 1 mW max.) a change of beam-splitter should fix this if necessary.
To minimize squeezer down time from table work I intend to address this when we install the amplitude modulator (to measure the TF from pump modulation to OPO phase modulation), and replace the PSL table fiber (with APC) and add a motorized waveplate and flipper to SQZT6 (to replace the manual versions), probably Thursday.
The 1611 detector was definitely saturated at 1.2 mW. Attenuating the power to 0.4mW had about similar RF beat-note power (~ -20dBm) and the DC readout voltage also made sense (~ -3.3V, instead of -1.5V at 1.2mW of power). Next put in appropriate beam-splitter to optimize power at somewhat less than 1 mW.
Figure 1 shows coherence between the IMC DC WFS and DARM, with photos of the optic mounts that are producing the jitter peaks, based on this log: https://alog.ligo-wa.caltech.edu/aLOG/index.php?callRep=42551 . The Qs are fairly high so damping should help. One tool that would be useful, is a small tuned mass damper, variable across the 200-800 Hz band, that can easily attach to a U200-A mount with a little clamp or epoxy. A possible clamping scheme is visible in the picture on the bottom left of Figure 1: I have used two commercial spring clamps near the adjustment screws to broad-band damp (via the mass and the red rubber grips) the U200-A mount. The spectrum shows that this and other damping has reduced the Q relative to the other two mounts, but a tuned mass damper on a clamp like this might be useful on the other mounts and possibly on this one. The jitter spectrum also has some fairly high-Q U100-A mounts (see above log entry).
Figure-2 compares DARM, IMC DC WFSs, coherence and table motion for Monday night and for O2. This is a bit premature since DARM and the WFSs are not yet well calibrated, and so I can’t make a definitive comparison of jitter coupling. But in this preliminary look, the change seems consistent with the table motion reduction being the biggest factor. The ~344 Hz peak seems to be a lot lower, and the table motion has decreased by 5 or more in that band. But the 483 Hz peak is in a band where the table motion has not really decreased (it was already low in O2 in this band, compared to nearby bands) and the 483 Hz peak does not seem to have improved by much in DARM. But, again, this is a first look; calibrations to come.
The second page of Figure 2 includes accelerometer signals when the water was off, showing that we could still improve by a factor of a few in the band around 500 Hz. We are planning to improve some water circuits during the vent. It might also be possible to reduce some flow rates.
Yesterday, I noticed that the bottom periscope mirror (IO_MB_M5) and the steering mirror into the power rotation stage (IO_MB_M3) do not have any green foam. Not sure that will help, but if so, we could add.
Regarding the PZT mount, if swapping out the current mount for the upgrade, that's currently installed at LLO, would reduce the PZT contribution to noise, we can make plans to do that. The PZT mount is here and could be ready to install as early as next Tuesday.
We have 3 days to work on the PSL in November, and installing the PZT mount is being considered for that time frame as well.
Green foam in the usual spring locations should be part of the treatment, but I don't think it will make a major improvement. The current highly-modified PZT mount is the prototype for the new one, and has versions of all design improvements, so I think the new one could be a little better, or a little worse. For this reason, I think that the decision for when to replace it should not be made based on hoped for improvements, but based on standardization.
Note that we're not running ISS 2nd loop yet.
I wanted to try adding the "jel" packs that Arnaud and Eyal have been using at LLO (for instance, here ), because it seems to help the low frequency noise. Jason had some left from the oplevs (excess beyond 3IFO needs), so I tried adding some the ETMY BRS, see attached photo. In the process, I must have bumped the "mass adjuster" in the process, because when I checked the BRS status before leaving the end station, it was dead, out of range. So, I set about rebalancing, and found that the rdesktop program (which I had aliased) with the new zotac workstation was laggy and basically useless. After talking to Carlos, I tried using remmina, which was much better, but still laggier than rdesktop was on the old mac/debian workstations. When I left the BRS was still rung up and not ready to use, but was slowly settling down. With the low microseism, this shouldn't interfere with commissioning, so I don't want to risk trying to settle it by hand, yet. If it's still angry tomorrow, I can try soothing it.
The capacitive damper cable from the relay box to the vacuum flange has broken solder joints. There are 3 soldered connections here and the 2 that are actually attached to anything inside the BRS enclosure are both broken. The remaining wire doesn't connect to anything.
Fil resoldered and we re-installed the cable this morning after we figured out the pin-out yesterday afternoon. The cap plates are attached to pins 2 & 5, as you go clockwise around the flange. Filed and close FRS ticket 11638. Attaching my summary here:
After adding insulation to BRS platform, the capacitive damping stopped working, alog https://alog.ligo-wa.caltech.edu/aLOG/index.php?callRep=44453 and comment. Found that the solder joints on the cable at the vacuum flange were broken. No documentation of the pin-out, there are five pins at the flange, only one is used on this BRS. We measured capacitances between the pins and the vacuum vessel, 3 were ~10pf two were ~60pf. Fil re-soldered the cable and we re-installed. Testing was done by watching the damping, when we had the pins reversed the damping rung the beam up, swapping the leads fixed the damping. BRSY is fixed now, but we should check the cable at EX.
TJ, TVo
Daniel suggested that we try swapping the cameras with any spares we have in order to see if the bad pixel problem goes away. From the user manual, it is not clear what happens when a pixel "malfunctions' on the CCD so this may require some more testing.
TJ and I found two spare cameras in the cabinet, one is labeled SN 008 and the other is unlabeled. The original installed camera for ITMX HWS was SN009. We first installed the unlabeled camera and the noise was worse with more bad pixels, then we installed SN008 and saw that there were less bad pixels so we left that one in.
The stationary (no transient heating) noise in the spherical power seems to have decreased with this new installation with the variance being about 3 udiopters over the course of half an hour (time series attached). Also attached is a gradient plot overlapped with the raw CCD images with the plates on and off. There are one or two gradient vectors which stand out in the upper half of the images so it still behooves us to try and implement a bad pixel finder which eliminates these bad data points before going into the HWS code which fits the spherical power.
Keita suggested that a histogram of the intensity of the centroids versus the length of the gradient vectors could give a threshold for eliminating problematic pixels. Using the HWS code to figure out the centroids and mapping the average intensities for the surrounding pixels, I attached the resultant plots.
The next step maybe to apply a digital masking to get rid of both the outlying problematic pixel in the upper left hand corner as well as the fringing effects from the baffle. There is a possibility that these bad pixels change their intensity over time so I can also try to make a movie gif of this time period where there isn't alot happening to see how the bad pixels fluctuate.
Applying a digital mask to the data cleans up the low end pretty well but there are a few outlying points in the histogram. It's possible that these points are dead pixels on top of Hartmann plate holes which is unfortunate, but could be remedied a bit by steering the beam away. I tuned the mask by hand but there's no reason we couldn't try to fit a Gaussian to find the center of the intensity distribution for future purposes.
We added back in the filters in REFLDC BIAS in the TR_CARM step. If we increase the gain in the IMC board input, we change the gain of the input for CARM, this was probably the cause of problems.