TITLE: 09/09 Eve Shift: 2330-0500 UTC (1630-2200 PST), all times posted in UTC
STATE of H1: Earthquake
INCOMING OPERATOR: Corey
SHIFT SUMMARY:
IFO is in OMC_WHITENING and LOCKING
The first 5 hours of this extended shift were quiet and well behaved. Truly the calm before the earthquake before the storm. Lockloss alog 86792.
Thanfully the next 3 hours were action packed due to 2 environmental events: a 5.8 EQ (and 4.9 aftershock) off the coast of Oregon and an electrical storm power glitch.
The Earthquake (alog 86793)
5.8 EQ from Oregon downed the IFO before SEI or SUS had a chance to prep.
- A very violent lockloss which tripped: ISI EY ST1 WD, ISI EY ST2 WD, SUS TMSY WD, ISI IX ST1 WD, ISI IX ST2 WD, ISI IY ST1 WD, ISI IY ST2 WD, ISI EX ST2 WD, SUS IX WD, SUS IY WD, SUS EX WD, SUS EY SW WD, SUS IY SW WD, SUS IX SW WD, SEI EY SW WD, SEI IY SW WD, SEI IX SW WD, HEPI EY WD (twice), HEPI IY WD (twice), HEPI IX WD (twice), ISI IY ST2 WD, IY Hardware WD (with warnings from all the others) (pic attached)
- EX overperformed its sibling QUADs by being the only one that didn't completely trip somehow
- Jim and Dave came online to the rescue and we immediately began diagnosing and eventually, untripping.
- IY Hardware WD had tripped so I went into the CER to untrip it successfully
- While I was in the CER, the lights flickered, I heard a loud rumble and when I was back some more greens were red - that was the high voltage.
The Storm (alog 86795)
The storm caused a slight power glitch that caused the high voltage for both HAM6 and the PSL to turn off.
- The PMC was flickering on the camera and I called Ryan S who pointed me to the right place to realize the high voltage had tripped. Jim simultaneously realized this on DIAG_MAIN.
- I called Richard (and TJ but Richard called back and he walked me through how to turn the high voltage back on (pic attached)
- I once again ventured into the CER, this time to the mezzanine and turned on the high voltage
- When I arrived, Jim and Dave had finished untripping the WDs and with that, all the reds were green and that's universal for go - so I started relocking.
The Aftershock:
While relocking in INITIAL_ALIGNMENT, we got an aftershock (4.9 EQ) from the same location, wich prompted EQ mode to turn on.
- I had to INIT some nodes since some of the QUADs were in auto and not managed,
which marked the end of my OPS intervention. Just kidding! See below.
- Like most sequels these days, it was underwhelming. It did not even affect initial alignment, which ran fully auto.
- Funnily though, we went into MICROSEISM since the secondary microseism was high enough after EQ mode went to CALM
Initial alignment finished, I began locking, DRMI caught immediately and thanks to the awesome power of nature, this shift was not boring. Except of course, the OMC is not locking (despite turning the high voltage back on) - see below for the 3rd installment nobody asked for.
The OMC:
The OMC high voltage also tripped though I did turn it on (narrator: or so he thought)
- The problem it seems is that the sweep it was doing in looking for lock was going between -40 and 40 instead of -50 and 50, and it's jumping instead of sweeping.
- After ~10 dead ends, and one accidental lockloss trying to fix this, I think I found the solution.
- My guess is that the issue isn't the high voltage but that guardian is not doing a fine sweep to find the right PZT2 steps and is jumping instead. From alog 85876, I think we should auto the OMC guardian and step through the high voltage in 1.0 steps to get the OMC locked.
- Last time the High Voltage tripped, this happened too. Thus, I anticipate we will be stuck at PREP_FOR_DC_READOUT. From context clues, I think this has to be done at DARM_OFFSET properly instead of at PREP_DC_READOUT but frankly, I have no idea.
- Alright guess what? It was the high-voltage AGAIN. The attached picture is from hours ago when I turned it on the first time. It crapped out again, I turned it back on - it's working now.
- We're past PREP_FOR_DC_READOUT. The OMC is still in AUTO so now figuring out how to put it back in MANAGED. Honestly, we should check this power supply out on Tuesday, which is in a few hrs.
- Re-managed OMC_LOCK by Temp-manual -> INIT -> whatever-state-I-manualled-at.
Other:
The DARM FOM is having trouble connecting to NDS so I can't see the Violin Modes but they're extremely high (maybe due to the possbily fake measured 573 Lin Velocity of that Oregon EQ). Violin medm attached.
Anyway, I should log off now before I summon a tornado or something. Honestly, this has been a fantastic learning oppurtunity (and don't worry I have the day off tomorrow).
LOG: