Out of observing at 2205 UTC

We would like to reconcile safe.snaps at 8am, for Ops team.

Safety:

• Be cautious of animals on the road. Reports of high numbers of strikes recently.
• Forest fires in the state have created high particle counts on site. Use caution if you have respiratory issues. Jeff B. can get n1000 masks for you if you need them.

Tues. Maintenance: See attachment for whiteboard of scheduled activities.

Edit- updated picture

FAMIS#12859

I didn't notice any new features.

FAMIS#11229

ITMY P is greater than 10urad from center. ETMY P is nearing 10.

PMC power on it's usual downward excursion and FSS TPD currently at 4.1 which is approx 1V down from the last alignment on 7/02/2019.

TITLE: 08/05 Day Shift: 15:00-23:00 UTC (08:00-16:00 PST), all times posted in UTC
STATE of H1: Observing at 115Mpc
OUTGOING OPERATOR: Patrick
CURRENT ENVIRONMENT:
    Wind: 7mph Gusts, 4mph 5min avg
    Primary useism: 0.02 μm/s
    Secondary useism: 0.05 μm/s
QUICK SUMMARY: 26 hour lock, calm environment.

TITLE: 08/05 Owl Shift: 07:00-15:00 UTC (00:00-08:00 PST), all times posted in UTC
STATE of H1: Observing at 113Mpc
INCOMING OPERATOR: TJ
SHIFT SUMMARY: Remained locked and in observing entire shift. Rode through earthquake in Tonga.
LOG:

09:11 UTC SEI_CONF to EARTH_QUAKE for earthquake from Tonga
11:01 UTC SEI_CONF to WINDY

Have remained locked and in observing. Rode through earthquakes in Tonga.

TITLE: 08/05 Owl Shift: 07:00-15:00 UTC (00:00-08:00 PST), all times posted in UTC
STATE of H1: Observing at 115Mpc
OUTGOING OPERATOR: Cheryl
CURRENT ENVIRONMENT:
    Wind: 5mph Gusts, 4mph 5min avg
    Primary useism: 0.01 μm/s
    Secondary useism: 0.05 μm/s 
QUICK SUMMARY: No issues.

TITLE: 08/05 Eve Shift: 23:00-07:00 UTC (16:00-00:00 PST), all times posted in UTC
STATE of H1: Observing at 117Mpc
INCOMING OPERATOR: Patrick
SHIFT SUMMARY:locked, out of Observe for violins, into SEI EQ, and back to WINDY
LOG:

• 00:29:10 - H1 to Commissioning, violin guardian to Damping_on_simple, ETMX violin mode 13, alog 51019
• 00:37:11 - H1 in Observe
• 00:53 - incoming EQ
• 00:54:14 - H1 SEI to EQ
• 01:49:22 - H1 SEI back in WINDY, transition back at around 48 on ISI STS EQ Z BLRMS
• 02:32:57 - GRB, standing down a minimum of 15 + 2, to make a full hour
• 02:54:13 - restored inject_success

• changed RANGE_RLP_5, purple, from +/-0.3 to +/- 0.35, to bring the trace back into view (was off the top)
• changed RANGE_RLP_2, yellow, from "0 to 80", to "0 to 20", to bring the trace out from behind RANGE_RLP_1 (light blue)
• saved the values, and posted here if there's a need to revert

• 00:29-00:37 - H1 out and back in to Observe, ETMX violin mode 13, alog 51019
• 00:53 - incoming EQ
• 00:54:14 - H1 SEI to EQ
• 01:49:22 - H1 SEI back in WINDY
• 02:32:57 - GRB, standing down a minimum of 15 + 2, to make a full hour
• 02:54:13 - restored inject_success

• I noticed the BLRMS striptool traces 6 and 7 (530Hz-980Hz, 1KHz-2KHz) were smoothly increasing, and about to exit the striptool view off the top
• found ETMX mode 13 was at 5.3
• 00:29:10 - H1 to Commissioning, violin guardian to Damping_on_simple
• ETMX mode 13 gain set to +30, no other changes
• 00:37:11 - H1 in Observe
• first plot attached shows the BLRMS striptool
• second plot attached shows this lock, mode 13 started out at around 2, and grew to 5.3
• third plot show 10,000 seconds and how mode 13 was ringing up other modes

TITLE: 08/04 Eve Shift: 23:00-07:00 UTC (16:00-00:00 PST), all times posted in UTC
STATE of H1: Observing at 116Mpc
OUTGOING OPERATOR: TJ
CURRENT ENVIRONMENT:
    Wind: 10mph Gusts, 6mph 5min avg
    Primary useism: 0.02 μm/s
    Secondary useism: 0.05 μm/s
QUICK SUMMARY: locked in Observe.

TITLE: 08/04 Day Shift: 15:00-23:00 UTC (08:00-16:00 PST), all times posted in UTC
STATE of H1: Observing at 115Mpc
INCOMING OPERATOR: Cheryl
SHIFT SUMMARY: Breezy, but locked for 10hours. Sqz kicked us out of observing once, but quickly relocked.
LOG:

• 1852-1853 Out of observing, squeezer lost lock.
• 1900 GRB, Fermi, short. Standing down for 15min.

The squeezer lost lock, but then quickly relocked within a minute or two.

[JeffK, Jenne]

After Jeff noted that last night's lock had a somewhat low optical gain (kappa_C value of ~0.93), we moved the offsets in the OMC ASC QPDs to try to maximize optical gain.  The attachment shows the moving that we did.  It's possible that we could get a bit more if we were able to move in the direction that saturates the OMC SUS, but I'm not 100% sure about that, and to get it we'd have to pico the AS WFS so that we can move OM1 and OM2 to offload some of the alignment move. 

We were able to convice the optical gain to come back to a value of 0.96ish, which is closer to what we've been having at 37W injected power for the last several weeks of O3.  The offsets aren't very different from what they had been - for the most part the optical gain was happier where the alignment had been.

C. Gray, K. Kawabe, J. Kissel, D. Sigg

After initial alignment was complete (2019-07-24 ~20:00 UTC), we spent a bit of time stuck with several lock losses upon reaching LOCKING_ALS. Manually running what happens in LOCKING_ALS, we narrowed down the problem to ALS DIFF, and after 45minutes of searching, I happened to lance at the ETMX ESD driver's analog voltage monitors and noticed they looked abnormal. At 2019-07-24 20:42 UTC, I hit the H1:SUS-ETMX_BIO_L3_RESET ("HV ON/OFF") button on the QUAD overview screen once to turn OFF the driver, then once again a few seconds later to turn it ON.

It's likely that the ETMX ESD driver got locked up in a funky state after all of the power and computer issues over night. 

The bigger question is why (what we thought were several) warnings that should have been triggered didn't:
    (1) DIAG_MAIN guardian node "used to" (our memory of the O2 past) have a check of the analog voltage monitors, and would throw a warning.
    (2) The DOWN / PREP_FOR_LOCKING state should have a similar check of the analog voltage monitors, throw and error when failed, and not allow progress until fixed.

Others are investing further and will comment / fix later.