Reports until 16:23, Tuesday 19 March 2019
H1 General
betsy.weaver@LIGO.ORG - posted 16:23, Tuesday 19 March 2019 - last comment - 20:29, Tuesday 19 March 2019(47680)
Status after Tuesday Maint session today

No alogs from today yet state the situation, so here is the current status - we're still recovering from Tuesday Maint currently locked in Low Noise, however we have a bit of a mess to work through.

The LSC computer was glitched this morning at 9am when EE rack fan isolation work was taking place.  CALINJ is now red out of nominal (OFF). Dave brought the LSC back up (details below eventually), then numerous activities took place as per the morning plan:

- PCAL maint checks at both EY and EX

- Fan isolation in corner LSC and ASC racks, EX and EY ISC racks

- IMC board work by Daniel

- Charge measurements of ETMX

- DAQ/EDCU work by Dave

- 1Hz comb troubleshooting - no alogs to report anything on this yet

- Minor PMC and REFCAV alignment tuneup

- PSL REFCAV EOM driver cable swap

However, once back up at ~3pm local, major noise was present and we saw numerous SDF settings changes in the OBSERVE file (which was clean during the locking last night) mostly related to the OMC (from LSC model).  These were probably settings not saved correctly to the SAFE SDF file and then hung around through the locking to low noise.  Sheila has just attempted to walk those back by hand but the lock blew.  Back to locking now.

PEM was supposed to have some time today, however the maintenance/relocking went long, so they will attempt to work for a few more hours while yielding some hour long segments for OBS MODE starting later in the evening.  Slow thermal TCS tuning may also resume while in OBS MODE overnight, similar to last night.

Comments related to this report
sheila.dwyer@LIGO.ORG - 19:03, Tuesday 19 March 2019 (47693)

Yesterday we updated many OBSERVE.snaps in order to get to oberseving, but we didn't have a chance to do a similar cleaning up of safe.snaps before this morning's glitch which took down some computers as Betsy says.  
Jenne and I updated a handful of things that we fixed by hand in the safe.snaps, but we need to take a bit of time in the "DOWN" state after a lockloss to update the safe.snaps to prevent these problems in the future. 

betsy.weaver@LIGO.ORG - 20:29, Tuesday 19 March 2019 (47698)

We'll mobilize to get some help on this in the next day or so. No more unexpected crashes tho, right!? Famous last words.