Reports until 12:04, Tuesday 20 October 2015
H1 GRD (SEI)
jim.warner@LIGO.ORG - posted 12:04, Tuesday 20 October 2015 (22678)
Some difficulties recovering HAM chambers post power outage

This morning after Betsy and Jenne recovered the CS SUS, I tried turning the seismc platforms back on. The HAMs were unusually difficult, the chamber manager was stalling and insisting that the ISI and HPI nodes were stalled. A few things I tried mostly on HAM2, a few on the others:

1. Init-ing every body.

2. Engaging master switches. Occasionally, the chamber manager would go around behind me and turn them back off.

3. Stopping and restarting guardian nodes. On HAM2 I tried just the chamber manager, then all HAM2 nodes.

4. Stopping and Execing all nodes.

5. Reloading all the code on all 3 nodes.

 

Finally, the only way I could recover the HAM chambers was to go and engage the masterswitch on ISI and HPI, put ISI in Damped, HPI in Isolated, then when HPI was up, I put ISI in High_isolated. When that was done the chamber manager was happy, after hitting INIT on the manager. I've checked HAM4 and HAM6 after and those chamber managers work. The BSC guardians have also been behaving all morning, from what I've seen.

Currently all seismic platforms are up and running.