Tidal and ASC (PRCL1, DHARD) was running away.
The ifo is locked at NLN but not observing. RF45 still glitching.
Lockloss again at 07:00 UTC
DHARD ran away again. I lowered the gain as soon as I noticed the oscillation. The amplitude of the oscillation didn't seem to decrease. Maybe I didn't catch it quick enough?
I also couldn't connect to the nds sever. So no dataviewer.
I will be taking a few minutes to grief.....
Dataviewer seems to work on a different computer. Resume relocking.
Hmmm, maybe we just should always be using the lower DHARD gains when we're on the 45mHz ISI blends? I think DHARD Pit is usually 10, and should go to 7. DHARD YAW is usually 15, and should go to 10.
I don't think that the oscillation that nutsinnee shows in the screen shot is the one that can be fixed by lowering the gains, that is around 0.6Hz, while the screenshots show an something happening at around 20mHz. This large low frequency motion of DHARD yaw was happening durring earthquakes durring ER8.
I would be more inclinnded to leave DHARD gains alone or try to increase the low frequency gain for Yaw, depending on what was really happening (was this ground motion or a loop oscillation?). I think that lowering the gain could actually make things worse in either case.
For a rough model of DHARD yaw loop with thee new boost added, see https://alog.ligo-wa.caltech.edu/aLOG/uploads/21768_20150921225603_DHARDYAWOLGwithboost.png
Since the data is probably going to be cat1 vetoed anyway, I decided to help the situation the only way I know how. The RF45 Mod was 23.2 dB, now at 21.2 dB. I dropped out of Observing when I did this. I asked Kiwamu to make sure that it's okay to leave the gain at this value.
The glitches stopped for about 15 minutes. While writing this alog it seems to be coming back again. I might decrease the gain even further if it doesn't stop.
RF45 mod gain decreased to 20.2 dB.
If you go more than 2 dB lower than nominal you risk unlocking the interferometer. There is also no clear evidence that reducing the modulation depth fixes this issue, but of course it doesn't hurt to get another data point.
I can see that DHARD isn't happy. I put the gain back to 21.2dB.
I just noticed SUSETMY has timing error. I hit Diag Reset to clear this. ETMY saturation continues.
Observing again at 01:20 UTC. ETMY continues to saturate. I don't think there's anything else I can do to help.... If you have an idea please call the control room.
Decreased RF45 MOD to 20.2 dB again after RF45 amplitude increased and stuck there causing DARM noise floor to rise. Forgot to go out of Observing when changing the gain.
I called Mike and he suggested I take the ifo out of Observing and wait until the RF45 situation gets better. The BSN range is at 15-20 Mpc at the moment. RF45 MOD set to 21.2 dB.
TITLE: Nov 6 DAY Shift 16:00-00:00UTC (08:00-04:00 PDT), all times posted in UTC
STATE Of H1: Observing
SUPPORT: Kiwamu
LOCK DURATION: ≈2.5 hrs (this shift)
INCOMING OPERATOR: Nutsinee
END-OF-SHIFT SUMMARY: IFO Locked and very glitchy(too many ETMY saturations to list). High amounts of earthquake activity had us down since Patrick turned over to me. Then another barrage of quakes ensued. µSeism is between .7-1+microns. High ground motion is obvious in POPAIR_LF_90, ASC Yaw signals and in Tidal StripTool Wind is picking up this afternoon exceeding 20mph only for a short while. Handing Nutsinee a locked Interferometer.
ACTIVITY LOG:
16:20 Robert out to LVEA to install a shaker.
17:30 Spent some time on the phone with Kiwamu getting this M2 to M1 SR3 offloading issue handled. Then another 3.9µcron from a 6.4mag in Indonesia. It’s going to be a bumpy day.
19:21 Looks like a good time to try and make something happen. EQ bands are back down in the .1µ region
20:15 after much struggling with alignment, Kiwamu is on site and showed me how close I was and how to overcome my impasse. Alignment commences. EQ bands now below .1µ. Sudarshan is also on site.
21:42 Intent Bit to Undisturbed
22:36UTC IFO very glitchy and Livingston not locked.
Andy, Jordan
There has been extreme glitchiness and range drops since the beginning of the current lock. Thought to be caused by the recurring RF45 issue.
Spectrograms comparing GDS-CALIB_STRAIN and the control signal:
https://ldvw.ligo.caltech.edu/ldvw/view?act=getImg&imgId=107526
https://ldvw.ligo.caltech.edu/ldvw/view?act=getImg&imgId=107525
a bit delayed, but 21:42UTC
MID-SHIFT SUMMARY: Still trying to get IFO aligned after eq activity calming down. µSeism is still high ≈.9microns. Kiwamu on site to help.
Details can be found here: https://wiki.ligo.org/viewauth/DetChar/DataQuality/DQShiftLHO20151102 Summary: Duty Cycle: 68.4%,45.75% and 47.55% (Ignored last two locks of 4th, affected by RF45 noise) respectively. - Range varied between 75-80 Mpc - Glitch rate increased at the end of 3rd's lock. Last to locks of 4th Nov are ignored. -EY Magnetic Glitches Periodic 60Hz magnetic glitches are still present and are vetoed out using the channel PEM-EY_MAG_VEA_FLOOR on 2nd, 3rd and 4th. -Loud Glitches The Loud glitches are still there. -RF45 Glitches Some issue related to RF45 noise was noticed after 18:00 UTC on 4th November. There were few efforts to fix this issue. The details can be found in these alogs -23120, 23119 -Low Frequency Glitches Low frequency cluster of glitches are present over the weekdays starting from ~13:00 UTC (end of day light saving time). HVeto is able to veto them out using the corner station seismic channels (Related alog and subsequent comments) . Laura/TJ noticed that each time 10-30Hz BLRMS channel crosses the threshold of 600nm/s, a cluster of glitches can be noticed in DARM (Related alog- 22494,22710). DQ Flag details: https://wiki.ligo.org/DetChar/DataQuality/O1Flags#H1:DCH_45ISI_ITMY_Z_BLRMS_10_30_GT600:1 - Mainsmon Glitches Loud SNR glitch rate increased significantly for the last couple of hours of 3rd November. HVETO has used PEM-EY_MAINSMON_EBAY_QUAD_SUM channel to veto out these glitches at round 1. Corner station seismic channels also have huge significance drop at the round 1 of HVETO. Related alog: 23113
This morning during down time I clamped the heavy EM shakers on the blue cross beams of HAMs 5 and 6. We think that HEPI and ISI will keep the alignment, as for previous shakers, but these are about 4 times as heavy.
TITLE: 11/08 [OWL Shift]: 08:00-16:00 UTC (00:00-08:00 PDT), all times posted in UTC STATE Of H1: Aligning SHIFT SUMMARY: Lost lock after earthquakes. Tried initial alignment starting with IR. Lost lock at ENGAGE_ASC_PART_3. Trouble staying locked on ALS. Started initial alignment from beginning. Waiting for ALS to converge. Got timing error on h1iopacs0. Cleared with diagnostic reset. Earthquake band has come back down to between 0.01 and 0.1 um/s. Microseism is still very high between 0.3 and 1 um/s. Winds have subsided to below ~ 10 mph. INCOMING OPERATOR: Ed
TITLE: Nov 8 DAY Shift 16:00-23:00UTC (08:00-04:00 PDT), all times posted in UTC
STATE Of H1: Locking
OUTGOING OPERATOR: Patrick
QUICK SUMMARY: IFO is unlocked due to a series of earthquakes. µSeism is exceeding 1micron! It’s going to be a fun-filled interactive morning, it looks like. Doing initial alignment.