TITLE: 07/24 Day Shift: 1430-2330 UTC (0730-1630 PST), all times posted in UTC
STATE of H1: Planned Engineering
INCOMING OPERATOR: None
SHIFT SUMMARY:
Comissioners got in today and we started trying to lock PRMI and align the input arm.
After a short while.... something happened. and there were some suggestions that a power outage had happened.
Which also coincided with FW0 connection issue. ( The control room was running on FW1 and otherwise the CDS "one leg" as opposed to the zero leg which is good, cause FW0 is not connected.)
So we all started trying to gather data of all the things that would have been tripped or otherwise upset by a power glitch.
We even made a list!:
[Sheila] 10:20 PDT JAC REFL power drops -- i.e. we lost the beam out the JAC into the IFO.
[Sheila] 10:20 PDT JM1 OSEMs show sharp change in behaviour " exponential droop" at the ~few [urad] level (JM1 is upstream of JAC)
[Sheila] 10:20 PDT IMC PWR IN PD also shows a (faster) "exponential droop" from 2 [W] to 0.8 [W]
[Sheila] 10:27 PDT Started making changes to laser power guardian (requesting 10 [W]) to get back to 2 [W]. This turns the IO rotation stage. OSEMs on JMs, RM1, seem to witness this
[Dave] 10:20 PDT h1sush12 DAC2, channel 20 (the JM1 UL channel) shows a spike glitch, at the 0.01e6 [ct] ~= 1.5 [mV] output voltage level (28-bit DAC, so [DAC V] = [DAC ct] * 20/2^28 [DAC V/DAC ct])
[Dave] 10:20 PDT ADC3 channels 0-3 (JM1's OSEM PDs) change mean behavior, similar "exponential" but up,
[Dave] 10:29 PDT another sharp "glitch" feature change in the ADC3 CH 0-3 (JM1 OSEMs)
[Dave] 10:29 PDT Reported "glitch" in the corner station power
[Dave] 10:33 Frame writer went unstable
So I started looking for the MAINS channels to document the voltage change.
H0:FMC-EX_MAINS_CHAN_1_VOLTAGE looked very strange, so did 2, and 3. They haven't reported Voltage correctly since JUN 18th! Perhaps from a Hardware Swap or a Beckhoff change?
Thankfully dave has these channels in an ndscope template that still work to determine power glitches:
H1:PEM-CS_MAINSMON_EBAY_1_DQ , and ebay 2 and 3.
Turns out there was a button pusher and an alog about how that button no longer exists which you can read about here: alog 91246 .
M6.0 Earthquake from Vanuatu Shook up End X so much I had to go down to EX and tickle the H1:HPI-PUMP_EX_RMT_PRESS_PUMP_CTRL_OUTPUT control loop until it worked again.
LOG:
| Start Time | System | Name | Location | Lazer_Haz | Task | Time End |
|---|---|---|---|---|---|---|
| 14:47 | FAC | Kim, Dawn | H2, MY, EY, MX, EX, HAM SHAQ | N | Tour of VEA areas and resupplies. | 16:13 |
| 15:41 | VAC | Jordan | MY | N | Setting up outside pump | 16:59 |
| 15:51 | PEM | Robert Shrey | LVEA | y | Setting up shaker and accelerometers | 16:18 |
| 16:27 | FAC | Kim | LVEA | y | Technical Cleaning & resupply | 16:55 |
| 16:31 | PEM | Robert , Carlos, Shrey | LVEA | y | Debugging Shaker issues | 17:25 |
| 17:00 | VAC | Mitchell & Jordan | LVEA | y | Taking pump cart Down from platform | 17:14 |
| 17:26 | PEM | Robert, Carols, Shrey | Just over the over pass | N | Seismometer testing | 19:37 |
| 18:14 | CDS | Dave | Remote | N | Restarting the Entire \ | 18:44 |
| 18:17 | ISC | Jennie | LVEA | yes | Opening IOT1 to check beams | 18:40 |
| 18:59 | EE | Jennie W & Marc | CER | N | Checking on the SAT AMP JM1 | 19:44 |
| 19:37 | CDS | Jonathan | Remote | N | Restarting 0 leg | 19:44 |
| 20:24 | JAC | Sheila, Jennie, Keita | LVEA | yes | Working on the JAC Table | 21:09 |
| 20:27 | PEM | Carlos & Miranda | Overpass | N | Setting up seismometers | 22:08 |
| 20:31 | vac | Jordan | LVEA | N | Corner RGA work | 22:08 |
| 22:06 | Tour | Robert, Shrey & Co | LVEA & Roof | y | Giving a tour of the LVEA | 23:48 |
| 23:01 | ISC | Sheila & Jennie | LVEA | yes | Working in ISCT1 | 23:17 |
| 23:35 | VAC | Jordan | Mid Y | N | Shutting down Pump | 23:54 |
| 00:40 | SEI | Tony | EX | N | restarting the HEPI Pump controller. | 00:42 |