Jenne, Sheila, Hang
We wrote a piece of code to automate the measurement of ASC sensing matrix (using method described in alog 25648). It is available at
/opt/rtcds/userapps/release/isc/h1/scripts/SenMtrx
This is a complementary code to the existing one. The new one does not connect to the nds server but only uses ezca, so it may be more stable. On the other hand it can only do elementary measurement right now.
=============================================================================================================
We used this code to measure the sensing matrix with only DRMI locked. The values are
Optic | WFS | ct/ct | W/rad |
PR3 | REFL_9A_I | -3.2e-1 | -6.1e+1 |
PR3 | REFL_45A_I | 1.2e-1 | 2.3e+1 |
PR3 | REFL_9B_I | -2.2e-1 | -4.1e+1 |
PR3 | REFL_45B_I | 9.5e-2 | 1.8e+1 |
PR2 | REFL_9A_I | -1.1e0 | -2.1e+2 |
PR2 | REFL_45A_I | 4.8e-1 | 9.1e+1 |
PR2 | REFL_9B_I | -7.8e-1 | -1.5e+2 |
PR2 | REFL_45B_I | 3.4e-1 | 6.5e+1 |
IM4 | REFL_9A_I | -1.5e-1 | -2.8e+1 |
IM4 | REFL_45A_I | 4.8e-2 | 9.1e0 |
IM4 | REFL_9B_I | 9.5e-2 | 1.8e+1 |
IM4 | REFL_45B_I | -4.6e-2 | -8.6e0 |
SR3 | AS_36A_I | -1.7e-2 | -1.6e0 |
SR3 | AS_36A_I | -1.1e-2 | -1.1e0 |
The secondary microseism is back down, bring the blends back.
Kyle, Joe D. The plan now is to splice-in the longest piece of the excess good cable left over from the initial install. The resulting o.a.l of this repaired cable will be very close to what is needed but may require routing through a, yet-to-be-created, wall penetration into the adjacent room where the pump controller resides - or not.
I broke away to give a tour to Perry Technical College of Yakima from 10am -noon. (Jeff B covered me during this time.)
After the h1bootserver issue, DRMI locking looked bad, so I did an initial alignment (everything except ALS since they looked good). After this DRMI locked within 10min & it looked noisy at first, and also needed to be touched up. Handed to commissioners for ASC work....but quickly after this...
...Alignment went to La La Land. Helped Jenne work on restoring groups of optics to where they were when we last locked DRMI. She's still working on alignment.
LVEA Laser Hazard late morning
EX Laser Safe late morning
All times in UTC below
DAY Checksheet Notes:
I have written a script which provides the list of guardian nodes which use any specified file. This will aid in restarting all the Guardian nodes impacted by a python script change.
The command is called which_guardian_nodes_are_using_this_file. It takes the file name (full or partial path) as an argument.
Because scanning all 80 Guardian nodes and generated the list of files they use is time consuming (about 30 seconds), there is an optional second argument (-s) to skip this step and use the results of previous invocations.
The list of files are in the /ligo/data/guardian/files directory. There is a file gnodes.txt which lists all the guardian nodes. For each node there is a file named by the node. Here is an example call to the script
which_guardian_nodes_are_using_this_file /opt/rtcds/userapps/release/sus/h1/guardian/sustools2.py -s
Checking which Guardian node(s) use the file /opt/rtcds/userapps/release/sus/h1/guardian/sustools2.py
Guardian Node(s) using this file:
SUS_BS
SUS_ETMX
...
SUS_TMSX
SUS_TMSY
Using SUS-BS as an example here is a way to get the files its Guardian uses:
cat /ligo/data/guardian/files/SUS_BS
/opt/rtcds/userapps/release/sus/common/guardian/burt.py
/opt/rtcds/userapps/release/sus/common/guardian/SUS_BS.py
/opt/rtcds/userapps/release/sus/h1/guardian/susconst.py
/opt/rtcds/userapps/release/sus/h1/guardian/SUS.py
/opt/rtcds/userapps/release/sus/h1/guardian/sustools2.py
You can of course always just use guardutil directly to get this information as well:
jameson.rollins@operator1:~ 0$ guardutil files SUS_BS
/opt/rtcds/userapps/release/sus/common/guardian/SUS_BS.py
/opt/rtcds/userapps/release/sus/h1/guardian/susconst.py
/opt/rtcds/userapps/release/sus/h1/guardian/sustools2.py
/opt/rtcds/userapps/release/sus/common/guardian/burt.py
/opt/rtcds/userapps/release/sus/h1/guardian/SUS.py
jameson.rollins@operator1:~ 0$
This is probably preferable, since it's always up-to-date.
Thursday: AS WFS 90MHz centering (afternnon), Noise hunting afterwards
Friday: HWS/TCS morning, OMC noise/noise hunting afterwards
Saturday: SRC work
Sunday: -
Monday: Noise hunting
Tuesday: TCS work
I wanted to try using the buried STS at ETMY for sensor correction when it wasn't windy, to see if it worked. On the 22nd, for half an hour or so I switched it, and it seems to work. Attached spectra shows that using the buried STS gives similar performance to the STS in the building, at least when the wind is low, and we are using sensor correction at the micrseism. Red and pink are the ST1 T240 and buried STS when using the buried STS, dark blue and light blue are the ST1 T240 and the inside STS when running in our normal configuration. Both measurements were taken with the 90mhz blends, so all of the isolation between the T240 and ground between .1 and ~.2 hz is due to the sensor correction.
Unfortunately, when I tried this when it was windy, I got no isolation at all. I'm still looking into that.
at 11:10 PST h1boot generated an nfsd error (see below). All front end computers have locked up. We tried rebooting h1susauxh2 but h1boot is no longer permitting this (missing root file system). We need to first reboot h1boot, then all front end computers.
h1boot has gone 230 days without a file system check. An fsck on the /opt/rtcds (800GB) file system is in progress, will take almost an hour to complete.
h1boot completed its fsck and started running. Looks like all the front end real-time cores ran the entire time. This raises an interesting problem, should they run when there is no operator/guardian control of them? Did guardian keep trying to control the system and, with no feed-back, continue to 'push' the system.
The DAQ data continued to flow for the entire time. We see evidence of some channels glitching when the front end controls was recovered.
We will test this scenario further to see if a solution is needed.
Downtime was 11:10 - 12:40 PST
Filed an FRS for this since we lost 1.5hrs of commissioning time. This is FRS #4429.
Note: it wasn't clear what units of time to enter for "Orig. Est", and I entered 90 (as in minutes), but this turned out to be an entry of 90hrs! I believe it has been corrected to 1.5hrs.
Cao, Elli
In order to use the ITMX HWS during TCS commissioning, we have removed the polarization sensor optics which were placed in the HWSX path on the HWS table by HAM 4. (Placement of the polarization sensors is detailed in alog 24046.) We removed the PBS and the HWSX_ALIGN_M1 mirror from next to the periscope and have bolted them out of the way behind the HWSX camera for the time being. We also dumped the two sled beams coming through HWS_ALIGN_BS. We can see the sled beam on the HWS. I adjusted HWS STEER M10 (the mirror right before the camera) to center the beam on the camera, and did not touch the periscope mirrors.
Updated the corner Beckhoff code to incoporate the tidal servo engagement delay and the new EOM driver readback calibration.
Does this tidal servo engagment delay also need to be propagated to the end stations? We have had the same problem tonight that was described in 25695
Looks like there is a failing CPS at ETMY. I noticed on the Detchar sumary page, ETMY was not performing as well as the other BSCs above 1 hz, and has been for a little while (since about Feb 2nd). When I started looking at spectra, I saw that the Y CPS blend in was high at high frequency, digging down to individual sensors, it looks like ST2 H3 is to blame. LLO had a similar failure last year sometime. We should be able to stick a new card in and still run okay, or maybe we just need to check some connections. Probably not a big deal for now, but we should address this soon. Attached plots shows the CPS for St2 (first plot) and St1(second). Green on the first plot is the bad sensor. The St1 sensors look okay, though H2 (blue, second plot) looks a little high as well.
FRS 4424
Evan, Den
Tonight we asked ourselves a question whether 1/f (or 1/f^2) noise, seen in DARM around 100Hz, comes from the OMC or not. We put a bandstop filter to the DARM control loop at 92-127Hz and made a correlation measurement between AS 45 WFS SUM and OMC PDs at this frequency band. The idea is that if there is any OMC noise coherent between 2 OMC PDs, it should not be present at the RF detector.
Attached plot shows the results of the measurement. Cross-spectrum between WFS and OMC PDs around 100Hz is almost the same (15% lower) as cross-spectrum between two OMC PDs. We integrated for 3.5 hours and AS 45 WFS SUM channels are not DQ. We can significantly improve the measurement if we record these channels and integrate for ~20 hours.
At the current precision of the correlation we can not say that noise around 100Hz comes from the OMC. Right now it looks vice versa.
We have also measured coherence between DARM and voltage noise of +15V signal going into the vacuum. Noise level is 2uV/sqHz at 100Hz and coherence is <10-3. This noise is insignificant for the current sensitivity.
Den, which +15V signal is this that you measured?
Rich, we have measured the noise on pin 6 (+15V head 1, D1300502). This noise is highly coherent with noise on pin 2 (+15V on head 2) and partially coherent (0.4) with noise on pin 7 and 3 (-15V, head 1 and 2). For this reason, we did not measure DARM coherence with other pins.
Today Keita and I spent some time thinking about OMC length noise, there will be an update coming soon with more information and a noise projection.
We spent some time looking at some nonlinear behavoir noise in the drive to PZT1. Our dither frequency is 4100 Hz, and looking at the low voltage PZT monitor we can see a small 8 Hz and a larger 16 Hz comb. There is also other non stationary noise in the monitor, and a broad peak at 12.7 kHz. We have moved the dither line frequency to 4100.21 Hz, so if this was the cause of the 16 Hz comb in DARM we would now expect it to be more like a 16.84 Hz comb. Evan Goetz tells us that we need 15 minutes or more of data in low noise to evaluate if this has changed any combs in DARM.
We have just reached nominal low noise at 3:14:34 UTC Feb 25th, although the low frequency noise (below 50 Hz) is worse than normal. I've temporarily changed the dither frequency in the OMC guardian, so if there is a longer lock later tonight it should also have this changed dither frequency. (If anyone wants to double check what the dither frequency is, the channel is H1:OMC-LSC_OSC_FREQ
To quote Bill Murray in Groundhog Day, "Anything different is good." (at least in this context) The 16-Hz comb does indeed appear to have changed into a 16.84-Hz comb. A DARM spectrum from two hours (400-sec coherence time) last night in the 150-250 Hz band is attached, along with one from January on a day when the 16-Hz comb was strong. New lines are seen in this band at 151.56 Hz 168.40 Hz 185.24 Hz 202.08 Hz 218.92 Hz 235.76 Hz Some 1-Hz zooms are shown for a couple of the new lines. So...can we fix this problem?
Keita, Sheila
So that we can keep the OMC dither small while driving a reasonable level of counts out of the DAC, we added a voltage divider (somewhat creatively built) to the D-sub from the DAC to the driver chassis. This is a 11k/110 Ohm divider on pins 1 +6. We have increased the dither amplitude from 6 cnts to 600 cnts, so the round off errors will now be 100 times smaller compared to our signal.
The attached screenshots show the PZT1 AC monitor before and after this change. The lines below 1 kHz are always there, (even when there is 0 coming out of the DAC) and are not present on the analog signal coming into the driver chassis for the monitor.
We have reverted the frequency to 4100 Hz. If we get a long enough low noise lock tonight we can hope that the 16 Hz comb will be better. If things look good we should upgrade our voltage divider.
Thing is, our dither line used to be 12 counts pk-pk, so the rounding error was actually significant (signal/error ratio is something like 10 in RMS), and the error showed up as lots of lines because we're sending in only one sinusoidal signal. These lines actually drive the PZT length.
Making the dither bigger, the round off error RMS doesn't change much so RIN will become smaller.
We inserted two sets of 11k-110 Ohm resistive divider, one each for positive and negative input of the low voltage pzt driver input because it was easy. This is a temporary non-solution. A permanent solution is TBD.
The first attachment shows the spectrum of the DAC IOP channel for the dither, i.e. the very last stage of the digital, before we increased the amplitude. RMS of the forest of lines is about a factor of 10 below the RMS of the dither.
The second plot is after increasing the amplitude by a factor of 100, the rounding error RMS is still at the same level though you cannot tell from the plot, the dither to error RMS ratio should be more like 1000 now.
Three large lines in the second plot are not round off errors but imaging peaks that were previously buried in the round off errors: 12283.8kHz=16384-4100.2Hz, 20484.2Hz=16384+4100.2Hz, and 28667.8=32768-4100.2Hz.
Actually, the dither line is still at 4100.21 Hz for tonight, (I had forgotten that I put this into the guardian). We will revert it tomorow.
Splendid -- no 16-Hz or 16.84-Hz comb seen in a 2-hour stretch from last night! See attached spectrum 150-250 Hz spectrum for comparison with above plots, along with 0-1000 Hz spectra from last night and from the night before, with the 16.84-comb present. Many thanks from the CW group as we look ahead to O2.
Sheila pointed out that the noise floor for the 2nd spectrum is considerably higher than for the 1st and could be hiding residual lines due to the dither. So I tried shifting the 2-hour time window a half hour earlier, to avoid the hellacious glitch seen in the inspiral range (see 1st figure) near the end of the original Feb 26 interval. The 2nd figure shows the resulting spectrum with a noise floor closer to that on Feb 25. The 16.84-Hz comb still does not appear. So I think it's safe to say that the 100 times multiplication / divide trick did indeed suppress the 16.84 Hz (originally 16 Hz) comb a great deal, but of course, we will need long coherence times and long integrations to see if what's left causes residual trouble for CW searches.
Per work permit 5741 began the process of modifying all Suspension Satellite Amplifiers. Drawing D0901284-v4 calls for the addition of Cap C601(10uF) and C602 (.1uF) between the -17V to Ground around U503 the Negative Regulator VEE1. Today with Ed M. Soldering away in the lab we were able to complete all of Han2 units. Complete are: MC1, MC3, PRM, PR3, MMT1, MMT2, SM1, SM2 All Stages. We did have a problem with two Sat Amps. One shared between MC1 and MC3 and the one for MMT2,a trace blew when it was powered up. So replaced SN 1100117 with SN S1000287 and SN1100068 with SN1100066.
Tracking Names: SM1 = IM1, PMMT1 (MMT1) = IM2, PMMT2 (MMT2) = IM3, SM2 = IM4
UPDATE:
As of today all HAM3, HAM4 and EX Amps have been modified. HAM2 amps will have to be re-addressed due to an error in installation of the mod. 3IFO boxes are in process.
- Ed
Den, Sheila, Evan
~> We tried reverting to the old QPD offsets (the ones we used throughout O1) for the soft loops and the PRM pointing loops. These seemed to make the recycling gain slightly worse, and did not improve the jitter coupling. This indicates that (as we had suspected) these offsets are no longer good to use.
~> We measured the 9 MHz oscillator phase noise coupling into DARM. This had been done previously (19911), but with a suspicious calibration and in a way that also drove the 45 MHz phase. This time, we used the OCXO to drive both the harmonic generator (bypassing the 9 MHz distribution amplifier) and to serve as a reference for an IFR/OCXO PLL with a >40 kHz bandwidth. The IFR is used to drive the 9 MHz distribution amplifier. The error point of the PLL was offset in order to maintain the relative time delay of the 9 MHz and 45 MHz signals. When we relocked, we found that the 18 MHz and 27 MHz signals had flipped sign, but otherwise the interferometer locked normally. However, there was a great excess of 45 MHz noise in DARM (worse even than before we installed the 9 MHz bandpass). Nevertheless, we were able to drive enough to see the effect of 9 MHz phase modulation in DARM. The coupling is roughly 2–4×10−6 mA/Hz above 100 Hz.
Also, twice last night (while locked on the IFR) we were battling a 900 Hz line in DARM that increased over the duration of the lock, and eventually caused EY to saturate.
We suspected PI, but this line was also present at 900 Hz in the DCPD IOP channels. So it is not folding around the 8 kHz Nyquist of the digital downsampling.
This line does not appear in the IOP channels for the end station QPDs. (2 W, dc readout)
It's the third harmonic of the beamsplitter violin mode. Den added a stopband filter to the BS M2 length drive, and the line went down.
Unclear why this had not been a problem before.
Why are the signals from PR3 so weak and weaker than those from PR2 ? Maybe typos ?
Typo fixed