aLIGO LHO Logbook

LHO General

patrick.thomas@LIGO.ORG - posted 17:24, Wednesday 20 January 2016 - last comment - 16:16, Thursday 21 January 2016(25057)

Ops Day Shift Summary

STATE OF H1: Still recovering from power outage.

ACTIVITY LOG (some missing):
15:44 UTC Unexpected power outage
16:38 UTC Fire department through gate to check on RFAR boxes
16:56 UTC Richard, Jeff B. and Jim W. to end stations to turn on high voltage and HEPI pumps
17:14 UTC Richard turning on h1ecaty1
17:14 UTC Jason and Peter to LVEA to look for an optic
17:39 UTC Richard and company done at end X and going to corner station to turn on TCS chillers and HEPI pumps
17:49 UTC Filiberto to end X to reset fire panel
17:56 UTC Vacuum group touring LVEA (6 or 7 people)
17:57 UTC HEPI pump stations and TCS chillers started in corner station
18:18 UTC Filiberto back from end X
18:24 UTC Jeff B. and Jason to LVEA to start TCS X laser
18:49 UTC Hugh bringing up and isolating HAM ISIs
19:16 UTC Richard and Jim W. to end stations to turn on ALS lasers
19:30 UTC Sheila to CER to power cycle all of the Beckhoff chassis
22:55 UTC Jason to LVEA to look at optical levers
23:02 UTC Jason back
23:34 UTC Dave restarting the EPICS gateway between the slow controls network and the frontend network in an attempt to fix an issue with the Beckhoff SDF
23:47 UTC Dave restarting the Beckhoff SDF code

Other notes:
End stations: end Y IRIG B chassis power cycled; end X, end Y high voltage turned on; end X, end Y HEPI pump station computers started; end X, end Y ISI coil drivers chassis reset; end Y Beckhoff computer turned on
Corner station: TCS chillers turned on; HEPI pump controllers turned on (Jeff B. had to push power button on distribution box); Sheila power cycled all Beckhoff chassis in CER; Sheila turned on the AOS baffle PD chassis in LVEA

I started the h0video IOC on h0epics2.

Conlog was running upon arrival. However it crashed during the recovery. It still needs to be brought back.

Joe D. and Chris worked on beam tube enclosure sealing.

There was some trouble starting the corner station HEPI pump controller computer.

There was some trouble finding the strip tool template for the wind speeds. I'm not sure if it was found or if TJ created a new one.

Things to add to the 'short power outage recovery' document:
- Turn on high voltage supplies
- Push reset on ISI coil drivers
- HEPI pump controller and pumps
- TCS chillers
- TCS lasers
- ALS lasers
- Turn on video server

Comments related to this report

patrick.thomas@LIGO.ORG - 17:29, Wednesday 20 January 2016 (25058)

Link

Jeff K. turned and left on wifi at end stations since we are no longer running in science.

patrick.thomas@LIGO.ORG - 17:38, Wednesday 20 January 2016 (25059)

Link

From Jeff K.:

- The PSL periscope PZTS had to be aligned using the IM4 and MC2 QPDs. Setting them back to their previous offsets did not work.
- There was trouble with the end Y ESD beyond the fact that the high voltage got tripped off with the Beckhoff vacuum gauges.

patrick.thomas@LIGO.ORG - 17:45, Wednesday 20 January 2016 (25060)

Link

01:43 UTC TMSX guardian set to 'SAFE'. Ed and Jenne reset controller at end X. TMSX guardian set to 'ALIGNED'.

jeffrey.kissel@LIGO.ORG - 15:56, Thursday 21 January 2016 (25080)CDS, DetChar, SUS

Link

J. Kissel, T. Shaffer, E. Merilh, E. Hall

A little more detail on the problems with the EY driver:
- We knew / expected the High Voltage Driver of the ESD system to need reseting because of the power outage, and because of several end-station Beckhoff computer reboots (which trip the vacuum interlock gauge, and kill the high voltage power supplies to the HV driver)
- However, after one trip to the end station, to perform the "normal" restart (turn on high voltage power supplies via rocker switches, set output voltage and current limit to 430 [V] and 80 [mA], turn on output, go into VEA and hit the red button on the front of the high voltage driver chassis), we found that the *high voltage* driver was railed in the "usual" fashion, in which the high voltage monitors for all 5 channels (DC, UL, LL, UR, LL) show a fixed -16k, regardless of request output.
- We'd tried the "usual" cure for an EY railed high voltage driver (see LHO aLOG 19480), where we turn off the driver from the red button, unplug the "preamp input" (see LHO aLOG 19491), turn on the driver from the red button, plug in the cable. That didn't work.
- Desperate, after three trips to EY, I tried various combinations of unplugging all of the cables and turning on and off the driver both from the remote switch on the MEDM screen and the front-panel red button, and only when I'd unplugged *every* cable from the front, and power cycled the chassis from the front-panel did it clear up the stuck output.

Sheesh!

jeffrey.kissel@LIGO.ORG - 16:16, Thursday 21 January 2016 (25084)

Link

Three FRS Tickets files on this; problems/faults uncovered/re-exposed by the power outage:
EY HV ESD Driver Railed: FRS #4254
PSL Periscope PZT Offset Problems: FRS #4251
IM's Offset Problems: FRS #4252