RickS, TravisS, SudarshanK

Using the same procedure used at END-X (LHO alog 29873), we optimized the Pcal beam locations at END-Y today. 

In each of these figure, the optimal locations, 111.6 mm from the center of the face of the optic in both positive and negative y direction, are denoted by red cross and the actual pcal beam locations by cyan circle.

Attached figure (1) shows the beam before they were optimized.  The offsets ([xoffset, yoffset]) from the optimal locations for upper and lower beam were: U[1.36, 7.58] and L[3.18, -8.60] in mm and uses standard co-ordinate sign convention.

Attached figure (2) shows the beam after they were steered to their optimal positions using the Pcal transmitter module steering mirrors.  The new offsets from the optimal locations are U [-0.96, -0.67] and L[-0.59, 0.39].

Everything looks to have restarted on its own or taken care of by the likes of Patrick (EndX) but I haven't been able to pin him down on that.  Actually, just managed to break into those guys--the computers did not stop so there was no restart.  Manual intervention to restart at EndX would be required but this glitch did not drop the BRSs out.

The Ion Pump at EndY has been reprogrammed to restart on its own and that was verified to still be running by EE this morning as well as the drift trends.  The attached shows these trends and the medms of the BRSs.  Again, things look to be running fine.

Krishna

BRS-X, BRS-Y and c-BRS seem to be functioning normally at the moment. I don't know if they were restarted manually or on their own, but ligo-dv web shows normal looking drift channels on BRS-X and BRS-Y and CTRL channel on c-BRS (trends attached).

Jonathan, Jim

The front end computers on the DAQ test stand have been restarted following this morning's power glitch.

J. Kissel, K. Kawabe, T. Shaffer, C. Gray

After a message popped up on the ISC_LOCK guardian to review the last check of the AS port fast shutter, and we realize the last check should have been during the power glitch recovery, we manually checked the functionality of the fast shutter. The fast shutter appears functional, stopping light into the OMC breadboard and the GS13s show an impulse.

The manual check: 
Setup:
- The IMC is locked, and the IFO aligned enough to see flashes on the AS port camera
- Watching the OMC Breadboard QPDs MEDM screen to see a spot moving around (channels H1:ASC-OMC_A_[YAW,PIT]_OUTMON)
- Watching the HAM6 GS13s on a dataviewer session to watch for fast physical motion of the shutter (channels H1:ISI-HAM6_BLND_[X,Y,Z]_GS13_CUR_IN1_DQ)

The test:
- Use the fast shutter detail MEDM screen (sitemap > LSC > shutters > bottom middle "Detail" under the "HAM6 Fast Shutter" name)
- Hit "open" then "close" several times, watch for light to disappear from the OMC Breadboad QPDs, and watch for large impulse on GS13s.

We need to do a similar test after every power outage, no matter how small.
TJ has agreed to create a guardian "PRECHECK" state such that we can do manual check of the fast shutter functionality. (To date we've only done the automatic checks every 48 hours).
Note: There already exists a guardian check in the FAST_SHUTTER node, however, the check is programmed to fail without the IFO MUCH further into the lock acquisition sequence (i.e. DRMI locked), and we'd prefer to check the functionality far before this.

Post power glitch, ETMY ring heater was on with 0.55 W top and bottom. DIAG_MAIN reported that this is nominally OFF, and trends for the past few days agreed. I brought these back to 0 and double checked the others as well.

The ITM ring heaters were not checked in DIAG_MAIN so I added them. As of right now it will check if they are off or on (not for specific values), if only one half is on, and if the top and bottom differ by some threshold percentage. I'd like to add checks to make sure that they are at their correct values as well, once that seems to be in a stable state.

X wrong polarization % before = 15

Y wrong polarization % before = 6 (then 13 after turning the box on)

-----

X wrong polarization % after = 5

Y wrong polarization % after = 3

10am local

Took 14:30 min to overfill CP3 with 1/2 turn on bypass LLCV. Increased manual setting to 19% (from 18%).

Left exhaust bypass valve open.

J. Kissel, B. Weaver, C. Vorvick, C. Gray

After front-ends were recovered (LHO aLOG 30088) from last night's power glitch (LHO aLOG 30083), we slowly have gone through all SEI and SUS untripped watchdogs, recovered full isolation, restored damping and alignment. All systems appear free of damage. It is likely, however, that bounce, roll, and voilin modes of the QUADs will be rung up, so we'll be mindful of them as recovery continues.

We've also confirmed that ESDs are functional, and all bias signs are where they're supposed to be as of the most recent sign flip (LHO aLOG 29397).

This morning around 8:30am, Nutsinee and I went out and restarted the TCS chillers and the TCS lasers.  We also took the opportunity to swap the greenish filters.  Recall, we had flushed both chillers last week, but when we installed a new set of filters we noticed that they were tinging green immediately even though we had just flushed the system.  These filters sat for ~a week and we swapped them today in hopes that whatever immediately turned them green last week was just still pushing throgh the system.  We also had to add another 750mL (to top off the half way full indicator to full) and again inspected for leaking water (none found).

We'll need to look up how to clean these recyclable filters.

Found that the dewpoint monitor IOC had frozen, the values on the MEDM screen were white.  Killed the processes and restarted the IOC.  Since these values don't change much normally, it's difficult to tell when it stopped running.  A trend for the last 10 days shows no variation.

Richard restarted all the front end computers after the power glitch.  The push button switch on h1susb123 stuck in, preventing the computer from starting.  Once that was discovered, the models on the Dolphin network should have started but didn't.  Suspecting another computer was down, I started the dxadmin tool on the h1boot server, and found that the dolphin node manager wasn't running.  After starting that, the models started coming to life.  Models on three computers didn't start, h1susey, h1sush56, h1sush2b, so those were killed and started manually.  IRIG-B timing on the h1ioppsl0 model went negative, but recovered within 30 minutes. IRIG-B timing on h1iopasc0 and h1iopsush56 drifted positive, and are working down toward a normal value.

This morning, after the power glitch, I went out to check the settings for the analog communication voltage scaling for the TCS chillers.

For both TCSX and TCSY chillers:
High Volts: 10.0
Low Volts: 0.0
High Temp: 40.0
Low Temp: 5.0

These are the same as the defaults listed on page D-5 of the Thermo Scientfific ThermoFlex Recirculating Chillers (Deluxe Controller) manual (P/N U00939, Rev. 08/14/2014).

The PSL is now up and running after this morning's power glitch.  Once the front ends were alive the PSL came up without any issue.  I reset the injection locking relock counter.

While it was down I took the opportunity to power cycle the diode chiller.  The front panel of the chiller has been scrambled since the chiller started behaving funny (alogs here and here), the power cycling cleared the screen up; the water temperature is still oscillating.  We are in talks with the chiller manufacturer about this issue.

TITLE: 09/30 Day Shift: 07:00-15:00 UTC (00:00-08:00 PST), all times posted in UTC
STATE of H1: Power glitched -- Front Ends are down (but Beckhoff seems to have survived). Waiting for people to show up to help with the recovery.
INCOMING OPERATOR: Corey
SHIFT SUMMARY: Kiwamu and Stefan left the interferometer locked and asked me to touch knobs to try to reduce broad bump around 100-1kHz. I gained about 15 Mpc by putting -0.05 offset to CSOFT pitch and CSOFT yaw (details and pretty plot in alog30085) but didn't get rid of the mysterious bump. Terra was here all night dealing with PI.

LOG:

13:08 Power glitched

13:29 Richard to CER

13:31 Richard going to power cycle stuff at end station

14:41 Jeff B. going to EX to check on dust monitor vacuum pump

14:56 Jeff done at EX, going to EY.

14:59 Turn over to Corey

(Betsy, Gerardo)

This morning added 500 ml of water, and walked/crawled the length of the pipe looking for water drops, none found.  The inside of the TCS-Y table was not inspected.