Last Tuesday (24th Nov) Jim and I modified the monit on h1hwinj1 machine such that when it restarts the psinject process it smoothly ramps the excitation amplitude over a time period of 10 seconds. We manually started the new system on Tuesday and since then there have been no crashes of psinject until the last 24 hours. There have been 4 stops (with subsequent automatic restarts) in the past 24 hours, each stop was logged as being due to the error:

SIStrAppend() error adding data to stream: Block time is already past

Here are the start and crash times (all times PST). Monit automatic restarts are maked with an asterix

On Nov3, the ITMY Coil Driver was powered down in an attempt to clear its brain which had been giving false bad status indicators.  We also changed the code so as to not drop out during these glitches, see T1500555.

Trending the channels show no status drop outs since the 3 Nov power cycle.  Before the power cycle, the status had indicated a problem erroneously several times with at least twice dropping the IFO out of observing.

VerbalAlarm script was stopped, but unfortunately when trying to restart it, I get an error (see below).  Not sure of a back-up alarm system to employ if this goes down.  I have the Calibration medm (with GraceDB up on my work station), but not sure what else we should have up as a back up.

No notable changes for first part of shift.  Seismic is pretty much unchanged.

H1 is going on an 8+hr lock with a range which is hovering a little over 75Mpc.

Beamtube work has been canceled today due to a non-functioning manlift, and freezing conditions.

Attached are 7 day trends for all active H1 oplevs in pitch, yaw, and sum.

O1 days 72,73

model restarts logged for Sun 29/Nov/2015 No restarts reported

model restarts logged for Sat 28/Nov/2015 No restarts reported

As Patrick surmised in alog 23788, the lockloss at ~2240 pst Saturday, this lockloss came about after the Tidal signals ultimately driving HEPI hit its ISC imposed limit of 250um about 75 minutes prior.

The attached 1 day trend shows the HPI-ETMX_ISCMON hitting the 250 limit imposed just upstream at the HPI-ETMX_ISCINF filter.  HEPI has no problem opening up this relief and I'm sure I should have done so already.

This amount of "Tide" is not real though so something else must be driving the requirement.  I suspect an initial acquisition offset that ends up at HEPI or temperature changes either at the ends or in the PSL area?  Attached too is a 30 day trend of the 'tidal' drives to the End HEPIs.  One other lockloss is attributable to this limit being reached on 10 November.

TITLE:  11/30 DAY Shift:  16:00-00:00UTC (08:00-16:00PDT), all times posted in UTC     

STATE of H1:  NLN at 

Outgoing Operator:  TJ 

Quick Summary:

TJ mentioned issue with getting the OMC to lock on the carrier during overnight lockloss.  He made a change to how the slider sweeps for the carrier in Guardian (will send an email to Kiwamu).

useism is about 0.4um/s in LVEA.  Winds are calm (under 10mph).  Range is hovering around 75Mpc.

CER temperature has been higher by 5 degrees C than before since 11-27-2015 13:00 UTC-ish (right bottom in the attached). This is a day-ish later than when they started receiving air handler alarms. I notified Richard.

An interesting side effect of this is that I can now see that the output level of RF distribution amplifiers has a small temperature dependence. It's about -0.04dBm/K for 45MHz amplifier in CER (eyeballing right middle and right bottom).  This is picked up by the RF AM stabilization (left middle and middle bottom). Not that this is a bad thing in itself.

Also, diode room air conditioning stopped switching on and off repeatedly (middle top) at the same time the CER temperature went up. I notified Peter.

Discussed IFO status:

• TJ mentioned issue with OMC locking on carrier last night.
• Blend filters and a study.  implementing 45mHz appeared to help.  This is another data point; can we get a protocol established from studying this & other data points?
• Input Alignment pointing, are we happy with the restore we did over the weekend?
• 0.6Hz spike at HAM3 revisited last week
• Discussed the lockloss related to tidal on Sat night.  Hugh mentioned wanting to look at some of his channels.

Substem Reports:  Nothing for SEI, SUS, CDS, FACILITIES

Maintenance Activities Tomorrow:

• TCS/polarization characterization, measurement set-up (oberling)
• reconfig Y-End garbing station (bartlett)
• restart HAM3 ISI restart?  probably not
• finish connections/cabling for end station vacuum gauges (EX/EY)
• 71Mhz signal investigation out on floor for CPS sychro for all chambers
• TCS shut off to install safety switches (might hold off until after oberling 
• EX & EY vea to compressor room, finish routing high V cable
• x28/y28 generator running, move generator from x28 to y28
• Possible LN2 delivery
• refcav alignment adjustment  (King, oberling)
• rock delivery, balers to pick up bales (bubba)
• DARM OLTF + PCAL z DARM TF
• Went over Work Permits

• Title: 11/30 OWL Shift: 08:00-16:00UTC (00:00-8:00PDT), all times posted in UTC
  

• State of H1: Observing ~80Mpc for the last 4hrs
  

• Shift Summary: Quiet shift besides one issue after a lockloss from 4.5 in Oklahoma. <a href="https://alog.ligo-wa.caltech.edu/aLOG/index.php?callRep=23821">alog23821</a> describes the OMC issue and my solution.

• Incoming Operator: Corey

• Activity Log:

• 09:59 -  Lockloss, 4.5 in Oklahoma
• 11:58 - Observing

Following on from Patrick's entry regarding the reference cavity transmission falling below 0.9 V ...

Attached are two plots of the reference cavity transmission and the Laser Room temperature as measured
by a sensor on the table, along with an image of the various spots from the pre-modecleaner and reference
cavity.  Since I didn't save any previous camera image, I will simply have to go on memory.  The
pre-modecleaner reflected spot looks like it's drifted to the right in yaw (as you look at the image).
The reference cavity reflected spot has moved up in pitch.  Both alignments were tweaked during last
Tuesday's maintenance period.

Also attached is a plot of the U100 mirror mount drift due to temperature and similar data from the
Newport website for their Suprema series mirror mount.  The plots suggest that pitch suffers with
any temperature variation, although it's hard to quantify given the ~0.5 degC temperature change.  The
plot for the U100 mount, suggests that the pitch adjustment does not recover.

The degradation in the transmission signal seems to coincide with colder temperatures of late.  Prior
to last week the last time the alignment was tweaked was mid-July.

Another possible reason might be that the reference cavity is slipping in its suspension, for whatever
reason.  Given the fact that the transmission can almost always be corrected for by a pitch alignment
I don't think this is a likely reason.  The reference cavity is the same as that used for the Initial
LIGO H1 PSL and I do not recall any mention of frequent alignment tweaks to preserve the transmission
signal.

Observing 11:58 UTC at 80Mpc.

Had some sissues with finding the 45MHz carrier on the OMC, see alog23821.

Violin modes took a longer time than usual to damp. Wasn't any one in particular, all of them seemed to have started out pretty high.

At ENGAGE_ASC_PART3, I noticed that the OMC_LOCK was not in READY_FOR_HANDOFF. Re-requesting it did not seem to help. There was a notification that it could not find the 45MHz sideband. I went through the code and saw that adjusting the OMC-PZT2_OFFSET slider while watching H1:OMC-PZT2_MON_DC_OUT and H1:OMC-DCPD_SUM_OUT could work. I thought I got it to where it needs to be, I manually moved past the FIND_CARRIER step and all seemed well until DC_READOUT.

The initial voltage scan for the PZT was changed from -30 to -24 on Nov 18, I found the sidebands to be at an offset voltage of 25.25V. Not sure if I even really got it, but perhaps this initial value needs to be changed slightly?

• TITLE: "11/30 OWL Shift: 08:00-16:00 UTC (00:00-08:00 PDT), all times posted in UTC"

• STATE Of H1: Observing at 80 Mpc for 7hours.

• OUTGOING OPERATOR: Patrick

• QUICK SUMMARY: Cold as usual, wind is low, useism = 0.5 um/s, LVEA/VEAs lights off. TPD flashing on Ops Overview, this wasn't noticed until after going into observing but should still be okay.
  

TITLE: 11/29 [EVE Shift]: 00:00-08:00 UTC (16:00-00:00 PDT), all times posted in UTC

STATE Of H1: Observing @ ~ 80 MPc.
SHIFT SUMMARY: Quiet since locking at NLN. 45mHz ISI blends made all the difference. Winds have increased slightly to between ~ 0 to 10 mph. Earthquake band has come down slightly to between ~ 0.02 and 0.1 um/s. No significant change in microseism.
SUPPORT: Kiwamu
INCOMING OPERATOR: TJ
ACTIVITY LOG:

00:52 UTC Switched ISI blends to 45mHz
01:12 UTC NLN
01:28 UTC Observing