Attached are the PSL Laser Head flow rates for the last 3 days. On 7-22-2017 at 15:45 UTC (8:45 PDT) all 4 heads saw a drop in flow of ~0.03 lpm. This lasted for ~2 hours, and then all flow rates returned to normal. None of the other flows or pressures showed a change at this time, so it is unclear what the cause was. The flow reading from the Head 2 flow sensor continues to have periods of noisy readings, which has been the case for this sensor since it was installed.
TITLE: 07/24 Day Shift: 15:00-23:00 UTC (08:00-16:00 PST), all times posted in UTC
STATE of H1: Observing at 50Mpc
OUTGOING OPERATOR: Travis
CURRENT ENVIRONMENT:
Wind: 20mph Gusts, 17mph 5min avg
Primary useism: 0.08 μm/s
Secondary useism: 0.15 μm/s
QUICK SUMMARY: 3.5 hour lock at 50Mpc. useism is on the rise.
TITLE: 07/24 Owl Shift: 07:00-15:00 UTC (00:00-08:00 PST), all times posted in UTC
STATE of H1: Observing at 51Mpc
INCOMING OPERATOR: TJ
SHIFT SUMMARY: One lockloss mid-shift. Otherwise, no issues of note that aren't already logged.
LOG: See previous aLogs.
14:33 Bubba to EX to check vaporizer
Confirmed with LLO.
No issues after the one lockloss during relocking noted in my earlier aLog. Accepted SDF diff for LSC-REFL_SERVO_IN1GAIN in screeshot attached.
After the 10:16 UTC lockloss, DIAG_MAIN began reporting that, in addition to the known PCAL Y issues, PCAL X was also off by more than 1%. Trending the RX PD OUTPUT shows that the output changed in a step coincident with the lockloss. I'll not attempt to do anything about this at the moment and let those in the land of the living decide what actions to take.
The Y-end TX PD doesn't show any changes during this time and hence that end would not have been cause of any problem. The X-end changes are small and hence wouldn't have been a cause either. Actually the full rate X-end channel (16 kHz DQ) doesn't show any changes (first plot) and so the changes we see in '*OUTPUT' channel might be some artifact. The small changes we see in Y-end is response to the lock loss. The second zoomed-in plot show that the changes in Y-end happen after the lock loss and only in RX PD. This is indication of test mass moving (oscillating) after the lock loss, due to kick. The PCal could cause lock losses when most of it's power (~100%) changes suddenly or the optical follower servo loop becomes unstable. It wasn't the case here.
DIAG_MAIN was reporting that "ISI HAM6 WD saturation count is greater that 75% of max", so I pressed the "Clear Saturations Only" button from the ISI WD MEDM screen.
No obvious cause.
Lockloss at LOWNOISE_ESD_ETMY while relocking. Had symptoms similar to what Patrick describes in aLog 37710 starting around DC_READOUT.
TITLE: 07/24 Owl Shift: 07:00-15:00 UTC (00:00-08:00 PST), all times posted in UTC
STATE of H1: Observing at 52Mpc
OUTGOING OPERATOR: Patrick
CURRENT ENVIRONMENT:
Wind: 18mph Gusts, 13mph 5min avg
Primary useism: 0.05 μm/s
Secondary useism: 0.09 μm/s
QUICK SUMMARY: No issues handed off. Lock is 13 hours old.
TITLE: 07/23 Eve Shift: 23:00-07:00 UTC (16:00-00:00 PST), all times posted in UTC STATE of H1: Observing at 48Mpc INCOMING OPERATOR: Travis SHIFT SUMMARY: Remained in observing entire shift. Made no changes. Range has been degrading since the beginning of the lock, possibly somewhat correlated with wind. LOG: 00:02 UTC Kyle out of VPW 00:50 UTC GRB alert 00:56 UTC Kyle leaving site
The range has been slowly degrading since the beginning of the lock ~9 hours ago. Have remained in observing.
TITLE: 07/23 Eve Shift: 23:00-07:00 UTC (16:00-00:00 PST), all times posted in UTC
STATE of H1: Observing at 51Mpc
OUTGOING OPERATOR: TJ
CURRENT ENVIRONMENT:
Wind: 18mph Gusts, 15mph 5min avg
Primary useism: 0.05 μm/s
Secondary useism: 0.07 μm/s
QUICK SUMMARY: Kyle is in VPW. No issues to report.
TITLE: 07/23 Day Shift: 15:00-23:00 UTC (08:00-16:00 PST), all times posted in UTC
STATE of H1: Observing at 51Mpc
INCOMING OPERATOR: Patrick
SHIFT SUMMARY: One lock loss that I can't explain, but it relocked with little fuss. I had one weird instance around 21:19UTC where the IFO showed signs that it was experiencing an earthquake (~1hz osciallations in control signals and IMC-F_OUT channel, slight motion in OMC Trans camera, DIAG_MAIN even reported a very breif instance of an earthquake from the LSC-CPS_FF channel), but nothing on USGS or the siesmometers. It was very brief, maybe less than a minute.
LOG:
Unknown cause.
Back to Observing. PR3 was off in yaw and violins were all more rung up than usual. There are still a few of the usual culprits that are high, but the rest have damped.
TITLE: 07/23 Owl Shift: 07:00-15:00 UTC (00:00-08:00 PST), all times posted in UTC
STATE of H1: Preventive Maintenance
INCOMING OPERATOR: TJ
SHIFT SUMMARY: started with locked, lost lock, relocked, lost lock due to monster PI modes 27 and 28, relocked,
LOG:
I've tested the addition of +30deg phase on ITMY ROLL and for this lock I saved F6 in SDF, but ran out of time to modify guardian.
The new filter worked well for me as well. I added it to ISC_LOCK
The glitchy periods at 10 UTC today, and 8 UTC on July 20, seem to be due to overflows in all of the test mass L2 coils. The cause of the overflows looks to be CSOFT pitch. The attached plots show timeseries of CSOFT pitch and ITMX L2 master for one quadrant, then a spectrogram of the coil signal. It looks like most of the power is in the 2.8 Hz pitch mode of the test masses. From the summary pages, it looks like the RMS of CSOFT pitch has crept up over the last few months. When the coil drive goes over 131,072 counts, the DAC overflows and the coil glitches. It's possible that I have things backwards, and the glitch comes first and the overflow is a symptom, but that doesn't seem to match the behavior of the RMS at non-glitchy times. Is there a way to get CSOFT pitch lower, or maybe suppress some of the feedback at 2.8 Hz (which I think is the biggest contributor)?
FRS Ticket 8591 has been open on this subject.
Laura, Andy, TJ, Duncan
I looked in to the test mass L2 stage DAC overflows and found ITMY is the main culprit. At least the overflows of the ITMY L2 stage encompass the times when ETMX/Y and ITMX are also overflowing. I ran gwdetchar-overflow from the 16th July to today and the attached plots show an omicron glitchgram before and after the ITMY L2 overflows are removed.
I opened our common ASC template for CSOFT_P (in /ligo/svncommon/IscSVN/iscmodeling/trunk/ALIGOH1/ASC_loops/Measurements/CSOFT/), and see that Sheila measured CSOFT pitch on June 26th. It looks from that measurement like we have more than 10dB of gain peaking at 2.8Hz. Ooops. Although, if that's how we've been running since at least mid-June, I guess we haven't noticed it since our microseism has been very low, so we've had much less motion to suppress, so there has been less output from the loops, so we've been narrowly avoiding saturations?
The peak is not present in the soft loop spectra on June 15th, but it is there on the 17th. This coincides most closely with the ISS 3rd loop being re-engaged.
FAMIS4737
All oplevs seem to be where they should be, looks good.
Concur with TJ, all oplevs look normal.
I'm checking the coil driver switching while we wait for the earthquake to ring down, to ensure that the analog switches are actually switching. Here's a rough note of my method:
* Set BIO state request to negative of the value that you want (i.e. -2 for state 2, -3 for state 3). This gives you control of the coil out filter banks (ex. H1:SUS-ITMX_L2_COILOUTF_UL). Do this for all 4 quadrants.
* Turn off all filters, so you have a flat digital TF from the excitation point to the driver. Do this for all 4 quadrants.
* For BS (only one with oplev damping), disable oplev damping.
* Take TF from coil output filter bank excitation to fastimon channel (ex. H1:SUS-ITMX_L2_COILOUTF_UL_EXC to H1:SUS-ITMX_L2_FASTIMON_UL_OUT).
* Switch analog coil driver state, retake TF, confirm that it changed as expected.
* Put state request back to positive number that it started at; this resets the digital filters appropriately.
All switching seems fine for PRM M3, SRM M3, ITMX L2, ITMY L2, ETMX L2 and ETMY L2, which is all suspensions and stages that we switch coil driver states for, except for BS M2. BS M2's UR coil is different from the other coils on BS M2.
I'm attaching a screenshot of the BS measurements, showing that the shape of the UR analog driver is slightly different in each state, and the overall gain is different by about 8dB.
I ask that the BS M2 coil driver be looked at first thing in the morning.
Looks like BS M2 UR has been like this at least since January. That doesn't mean it shouldn't be fixed, but it does mean that it probably won't help the new noise. I checked a time in January and another in early June. The noisemon and fastimon have always been lower in amplitude than the others, and have some extra forests of lines. The lines are coherent between the noisemon and fastimon, so I think they are showing real junk somewhere in the drive path. The plots show a comparison of UR with another quadrant recently, then a similar plot from January. Last, the coherence shows that the lines in the notch at 300 Hz are coherent between noisemon and fastimon, and there's no drop in coherence near the forests of lines.
Corresponds to FRS Ticket 8594 Ticket has been marked for closure given that the coil driver has been swapped LHO aLOG 37694 and the problem his disappeared.