Nutsinee's plot of the CPSs this morning revealed a bump in the ITMY ST2 H2 and V2 CPS around 80Hz.  As I look thru time since then, it has dropped in frequency, now around 78Hz. Two and three days ago it was at 90Hz.

I last reported on this in early June, where it was affecting the same channels, stage2 corner 2.

Noise not seen after power outage on June 6, maybe something needs a power cycle.  FRS 5615 was closed after the bump went away.

Addendum--FRS 7565.

Laser Status:
SysStat is good
Front End Power is 34.0W (should be around 30 W)
HPO Output Power is 169.0W
Front End Watch is GREEN
HPO Watch is GREEN

PMC:
It has been locked 1 days, 7 hr 49 minutes (should be days/weeks)
Reflected power = 14.45Watts
Transmitted power = 64.21Watts
PowerSum = 78.67Watts.

FSS:
It has been locked for 0 days 20 hr and 20 min (should be days/weeks)
TPD[V] = 1.746V (min 0.9V)

ISS:
The diffracted power is around 3.8% (should be 3-5%)
Last saturation event was 0 days 21 hours and 33 minutes ago (should be days/weeks)

Possible Issues:

TITLE: 03/08 Day Shift: 16:00-00:00 UTC (08:00-16:00 PST), all times posted in UTC
STATE of H1: Observing at 65Mpc
OUTGOING OPERATOR: Nutsinee
CURRENT ENVIRONMENT:
    Wind: 7mph Gusts, 4mph 5min avg
    Primary useism: 0.02 μm/s
    Secondary useism: 0.32 μm/s 
QUICK SUMMARY:

Keeping an eye on PSL enclosure temperatures.

TITLE: 03/08 Owl Shift: 08:00-16:00 UTC (00:00-08:00 PST), all times posted in UTC

STATE of H1: Observing at 63Mpc

INCOMING OPERATOR: Patrick

SHIFT SUMMARY: PSL AC briefly turned on. Richard and Peter were in the control room so they went in and fix it. The PSL temperature should slowly climb back to normal. Computers are on at EX and EY (can see this from the camera) 

LOG:

14:00 Richard+Peter to PSL to check on the AC. The DIAG_MAIN notification just came on. Went out of Observe.

14:10 Richard+Peter out. Back to Observe. The range also went up.

14:57 Landscapers are here and headed to Xarm.

15:01 Chris towing forklift to MY.

15:03 Richard to LVEA to turn off the lights. Did not go out of Observe.

15:04 Richard back.

16:01 Karen to MX, Christina to MY.

The landscape crew has resumed bailing and are currently on X-2, ~100 meters from the mid station and working toward the corner.

Coincidentally when Richard and I were in the Control Room, Nutsinee mentioned that there was a temperature alarm
in the PSL Enclosure.  Richard went outside to check whether or not the compressor was running - it was.
We went into the LVEA to check the AC/HEPA fan control unit.  It indicated that both AC units were off, all HEPA
FFUs were off and both AC units were off.

    We checked that the make up air fan was running at the science mode nominal of 20%.  It was.

    One thing that I noticed was different from previous encounters with the control unit was that the AUTO
button was illuminated.  Today and during yesterday's maintenance window were the only time that I can recall ever
seeing that button illuminated.

    Attached are two temperature trend plots.  One from today, the other for the past 10 days.  The change in
behaviour started around March 1st at ~20:00 (UTC) or around midday last Wednesday.

    The control unit is currently OFF.  We checked that the compressor was not running after exiting the
LVEA.  Indeed it was not running.

Still locked and Observing. Range dropped slightly -- probably due to the increase traffic on Rt. 10

Cleared up 5GB of space in /data/ITM/ITMX and /ITMY. The code was already running and throwing error about disk space. Now it can write data again.

TITLE: 03/08 Owl Shift: 08:00-16:00 UTC (00:00-08:00 PST), all times posted in UTC

STATE of H1: Observing at 65Mpc

OUTGOING OPERATOR: Ed

CURRENT ENVIRONMENT: Wind: 8mph Gusts, 7mph 5min avg Primary useism: 0.01 μm/s Secondary useism: 0.33 μm/s

QUICK SUMMARY: Ed has the IFO locked for me. Not much else going on.

TITLE: 03/08 Eve Shift: 00:00-08:00 UTC (16:00-00:00 PST), all times posted in UTC
STATE of H1: Observing at 66Mpc
INCOMING OPERATOR: Nutsinee
SHIFT SUMMARY:

After Initial Alignment, H1 locked stably for 2.5 hrs 
LOG:

3:09 PSL Low Temp notification from Verbal Alarm

3:39  PSL Low Temp notification from Verbal Alarm

PI mode 28 ringing up wasn't responding to changes. PLL wasn't locking so I made some changes to mitigate and that caused SDF to kick me out. I accepted changes and reste the Intention bit at 5:54UTC.

• 4:37 Begin Initial alignment
• ETMX UL RMS Watchdog was tripped
• Cleared and re-aligned both arms
• 5:06 UTC Initialized Locking
• 5:12 Diag Reset H1IPASC01
• 5:28 NLN 
• 5:30 Damping ETMX and ITMY Bounce modes
• 5:40 accepted damping changes in SDF and set Intention Bit to 'Undisturbed'

H1 back to Observing @ 68.9Mpc

4:23 and 5:03UTC H1 not locked.

The tumbleweed baling was halted at ~ 1630 PST. Will resume tomorrow at ~0700 PST. A short section to complete on the X Arm and then moving to Y Arm. 

The night started out rather calm:

• There was a strange lockloss earlier in the night 34661
• Then there was a flurry of GRBs w/ another lockloss 34662
  • This one, I think, was caused by wind.
• Currently trying to get back locked. Locklosses during Find_IR.

...the first was at 3:32:13UTC. The guardin node was doing it's thing. Then the second came 10 minutes later. Not being sure whether guardian was going to extend the time, should a second or third trigger come, I went ahead and noted the time and manually killed injections. Upon confirming the second GRB alert with Livingston, Bryan informed me that they had just lost lock so I then returned the guardian node back to INJECT_SUCCESS, manually. 

P.S.

  While I'm typing this, H1 loses lock for yet another unknown reason (perhaps the wind spiking up to nearly 40mph). Then... a THIRD GRB alert. So I guess ignore the action I took and please comment on the question of the time extention? 

All Times in UTC

I had to do  a bit of BS, PRM, and PR2 tweaking. I also had to clear the WFS on the IMC to get it stable before I could begin.

2:02 Lockloss - reason unknown

2:47 OMC giving me trouble locking- attempts made 2

2:59 Intention Bit Undisturbed 69.7Mpc

With a nudge from peterF and mevans, I checked to see how hard it might be to do some time-domain subtraction of the jitter in H1 DARM.  This is similar to what Sheila (alog 34223) and Keita (alog 33650) have done, but now it's in the time domain so that we could actually clean up DARM before sending it to our analysis pipelines.

The punchline: It's pretty easy.  I got pretty good feedforward subtraction (close to matching what Sheila and Keita got with freq-domain subtraction) without too much effort. 

Next steps:  See if the filters are good for times other than the training time, or if they must be re-calculated often (tomorrow).  Implement in GDS before the data goes to the analysis pipelines (farther future?). 

I was finding it difficult to calculate effective Wiener filters with so many lines in the data, since the Wiener filter calculation is just minimizing the RMS of the residual between a desired channel (eg. DARM) and a witness (eg. IMC WFS for jitter).  So, I first removed the calibration lines and most of the 60Hz line.  See the first attached figure for the difference between the original DARM spectrum and my line-subtracted DARM spectrum.  This is "raw" CAL-DELTAL_EXTERNAL, so the y-axis is not in true meters. 

I did not need to use any emphasis filters to reshape DARM or the witnesses for the line removal portion of this work.  The lines are so clear in these witnesses that they don't need any help.  I calculated the Wiener filters for each of the following channels separately, and calculated their estimated contribution to DARM individually, then subtracted all of them at once.  H1:CAL-PCALY_EXC_SUM_DQ has information about the 7Hz line, the middle line in the 36Hz group, the 332Hz line and the 1080Hz line.  H1:LSC-CAL_LINE_SUM_DQ has information about the highest frequency line in the 36Hz group.  Both of those are saved at 16kHz, so required no extra signal processing.  I used H1:SUS-ETMY_L3_CAL_LINE_OUT_DQ for the lowest frequency of the 36Hz group, and H1:PEM-CS_MAINSMON_EBAY_1_DQ for the 60Hz power lines.  Both of these channels are saved slower (ETMY cal at 512Hz and MainsMon at 1kHz), but since they are very clean signals, I felt comfortable interpolating them up to 16kHz.  So, these channels were interpolated using Matlab's spline function before calculating their Wiener filters. Robert or Anamaria may have thoughts on this, but I only used one power line monitor, and only at the corner station for the 60Hz line witness.  I need to re-look at Anamaria's eLIGO 60Hz paper to see what the magical combination of witnesses was back then.

Once I removed the calibration lines, I roughly whitened the DARM spectrum, and calculated filters for IMC WFS A and B, pit and yaw, as well as all 3 bullseye degrees of freedom.  Unfortunately, these are only saved at 2kHz, so I first had to downsample DARM.  If we really want to use offline data to do this kind of subtraction, we may need to save these channels at higher data rates.  See the second attached figure for the difference between the line-cleaned DARM and the line-and-jitter-cleaned DARM spectrum. You can see that I'm injecting a teeny bit of noise in, below 9Hz.  I haven't tried adjusting my emphasis filter (so far just roughly whitening DARM) to minimize this, so it's possible that this can be avoided.  It's interesting to note that the IMC WFS get much of the jitter noise removed around these broad peaks, but it requires the inclusion of the bullseye detector channels to really get the whole jitter floor down. 

Just because it's even more striking when it's all put together, see the third attachment for the difference between the original DARM spectrum and the line-and-jitter-cleaned DARM spectrum.