J. Kissel, B. Gateley, Apollo

Bubba and Apollo have been actively working on the upgrade of the EX HVAC system during the day today and will continue tomorrow, but since we've learn so much from EY (LHO aLOG 36271), I wanted to look at EX in the same light. No need to take any action other than planned thus far.

Unfortunately it looks like, in the midst of the upgrade, EX is going to get even hotter than EY. The PCAL temperature sensors report a 4.1 [deg C] = 7.38 [deg F] change from where we were 5 days ago. As such, the suspensions are in quite a different place than when in observation. We look forward to the completion of the upgrade, but we should be aware that it will take quite some time for the SUS to recover.

Both these cold cathode gauges went out today. I found PT-410's interlock OFF. Neither should have been effected by today's events:  1) corner beckhoff reboot; 2) Robert powering OFF rack at EY.

Machine was responding slowly when I went to update the vacuum site overview.

We have been working to stabilize the temperatures, mostly at End Y because that is the station that has the completed FMCS controls. End X should be completed by the end of this week.
During this process several changes have been made to various components such as the face/by-pass damper, cooling valve, chillers etc. Currently the changes have only been made to the End Y station where we were trying to maintain 68 degrees F. 

After several conversations with Jeff K. and some calculations made by Jeff, he has determined that a more suitable temperature for E Y would be ~64 degrees F. I have changed the set point in the E Y VEA to to 64 F. 

I will monitor the temperature closely tonight and hopefully this will have the correct effect on the suspensions.

I also had an alarm on the Mid X supply fan this morning and upon further investigation, I found that someone had turned the fan off at the electrical disconnect. I restored the HOA switch to auto position and started the fan.         

• Gate valves are still closed
• IMC is locked
• ISC_LOCK is in IDLE

Activitites: all times UTC

• 17:30 - Betsy, out of the LVEA
• 17:35 - Patrick starting work on WP6639. vacuum Beckoff code, only channels that have MR in their name will alarm
• 17:37 - Fil to the vault
• 18:13 - Chandra called, EY VAC signal disappeared, tracked down to Robert
• 18:30 - Nova interviewing JeffK
• 18:51 - Robert leaving EY
• 18:54 - Karen to H2 electronics room
• 18:55 - Aidan and TJ to HAM4
• 18:57 - Carlos to EY
• 19:06 - DaveB, DAQ restart for ION pumps
• 19:08 - HVAC person here to see Bubba
• 19:27 - Fil still at the vault
• 19:27 - Karen done in the H2 electronics room
• 19:32 - Jim, starting long measurements at EX
• 19:46 - Betsy and Travis to MY to look for 3IFO parts, moving bin to VPW
• 19:47 - Nova filming Fred
• 21:19 - Cheryl to LVEA to prep for Laser Safe, covered viewports and locked table doors
• 21:53 - Bubba to EY

DAQ was restarted at 12:06 PDT to reconfigure the IP6 channels. Diff of H1EDCU_VAC.ini shown below:

-[H0:VAC-MR_IP6_166_STATUS]
-[H0:VAC-MR_IP6_CS166_A_STATUS]
-[H0:VAC-MR_IP6_CS166_B_STATUS]
-[H0:VAC-MR_IP6_EI166_A_HV_KVOLTS]
-[H0:VAC-MR_IP6_EI166_A_HV_KVOLTS_ERROR]
-[H0:VAC-MR_IP6_EI166_A_HV_VOLTS]
-[H0:VAC-MR_IP6_EI166_A_HV_VOLTS_ERROR]
-[H0:VAC-MR_IP6_EI166_B_HV_KVOLTS]
-[H0:VAC-MR_IP6_EI166_B_HV_KVOLTS_ERROR]
-[H0:VAC-MR_IP6_EI166_B_HV_VOLTS]
-[H0:VAC-MR_IP6_EI166_B_HV_VOLTS_ERROR]
-[H0:VAC-MR_IP6_HS166A_A_START]
-[H0:VAC-MR_IP6_HS166B_A_STOP]
-[H0:VAC-MR_IP6_HS166C_B_START]
-[H0:VAC-MR_IP6_HS166D_B_STOP]
-[H0:VAC-MR_IP6_II166_A_IC_VOLTS]
-[H0:VAC-MR_IP6_II166_A_IC_VOLTS_ERROR]
-[H0:VAC-MR_IP6_II166_B_IC_VOLTS]
-[H0:VAC-MR_IP6_II166_B_IC_VOLTS_ERROR]
-[H0:VAC-MR_IP6_VI166_A_PRESS_TORR]
-[H0:VAC-MR_IP6_VI166_A_PRESS_TORR_ERROR]
-[H0:VAC-MR_IP6_VI166_B_PRESS_TORR]
-[H0:VAC-MR_IP6_VI166_B_PRESS_TORR_ERROR]
-[H0:VAC-MR_IP6_XA166_A_FAULT]
-[H0:VAC-MR_IP6_XA166_A_FAULT_ERROR]
-[H0:VAC-MR_IP6_XA166_B_FAULT]
-[H0:VAC-MR_IP6_XA166_B_FAULT_ERROR]
+[H0:VAC-MR_IP6_CS166_STATUS]
+[H0:VAC-MR_IP6_EI166_HV_KVOLTS]
+[H0:VAC-MR_IP6_EI166_HV_KVOLTS_ERROR]
+[H0:VAC-MR_IP6_EI166_HV_VOLTS]
+[H0:VAC-MR_IP6_EI166_HV_VOLTS_ERROR]
+[H0:VAC-MR_IP6_II166_IC_AMPS]
+[H0:VAC-MR_IP6_II166_IC_AMPS_ERROR]
+[H0:VAC-MR_IP6_II166_IC_VOLTS]
+[H0:VAC-MR_IP6_II166_IC_VOLTS_ERROR]
+[H0:VAC-MR_IP6_VI166_PRESS_TORR]
+[H0:VAC-MR_IP6_VI166_PRESS_TORR_ERROR]
 

Around 1:30 pm local time, Gerardo and I opened GV 1,2 slowly by ramping up to 500 rpm, 800 rpm, 1200 rpm, finally 1700 rpm. Note that the gate annuli were pumped out before opening. GV2's volume was sustained by its AIP alone. GV1 needed help from aux turbo cart.

GV 5,7 are LOTO.

All ion pumps are ON and valved out, except IP1 which is OFF because its isolation GV leaks (valve open).

Check list before opening GV 5,7:

1. Valve in IPs
2. Turn IP1 ON
3. Collect RGA scan
4. Pump out GV gate annuli

I've set up the HWSY CCD to be close to the conjugate plane of ITMY_HR. There are four beams coming from this region (ITM HR, ITM AR, 2x CP_AR). If the angular separation between them is relatively small, they will make it through all the apertures in the system and also show up in the HWS image. We see this with one of the CP AR reflections:

If we can - we'd like the CP offset set to -400 counts (subject to noise investigations).

H1:SUS-ITMY_R0_OPTICALIGN_P_OFFSET = -400 (just ITM HR beam, no CP_AR beam)

H1:SUS-ITMY_R0_OPTICALIGN_P_OFFSET = 100 ( ITM HR beam, CP_AR beam encroaching)

H1:SUS-ITMY_R0_OPTICALIGN_P_OFFSET = 500 (fully both ITM HR beam & CP_AR beam)

[Aidan,TJ,Nutsinee]

Following the HWSY lens replacement during last week's mini-vent, we have been working to recover the alignment of both HWS beams. Without the ALS beams, this is accomplished using the more laborious method of injecting the HWS beams into the vacuum system, close to centered on the in-vacuum lens, and swinging SR3 around in PITCH and YAW. The return power on the HWS CCDs is plotted as a function of position and yaw. This technique relies on the ITMs being properly aligned.

HWSX

We received no return beam from ITMX in any portion of the PIT and YAW phase space. We concluded that, given the HEPI lock down and ITMX activity last week, ITMX has not returned to the same alignment that it had before the vent. Without access to the ALS beams or the optical levers, it was difficult to make any progress on HWS alignment until the ITMX alignment is corrected. The HWSX alignment effort is on hold until ITMX is fixed.

HWSY

After locating three regions in SR3 angular phase space that held a total of four return beams, we identified which belonged to the ITMY HR surface by running a ring heater test and observing the expected thermal lens (in agreement with the online simulation).

We had to fold the HWSY layout to lengthen the distance from the last lens to the HWSY CCD such that the latter could be placed at the image plane of ITMY. We added an additional optic and moved the HWS CCD as shown in the attached images. The return beam looked much cleaner and the main BS EQ stops look much sharper (less diffraction).

The current status is that the HWSY camera is running WITHOUT the Hartmann plate installed but WITH the bandpass filter installed. The HWSY CCD is currently attached to the HWSX computer (H1HWSMSR) instead of HWSX. This is a temporary measure until the HWSY computer (H1HWSMSR1) is functioning correctly.

Before:

After:

HWSY return beam - misaligned to show the EQ stops.

WP 6639

The Beckhoff PLC code for h0vacmr was updated to match the change of the IP6 controller from a dualvac to a gamma. This required stopping and restarting the code, so there should be a gap in the data for the vacuum MR channels during this time.

The control room MEDM screens are updated except for the dedicated vacuum computer in the back of the room. I will update that one when the film crew is done.

The minute trend files were renamed to make the following changes:

Old -> New
H0:VAC-MR_IP6_EI166_A_HV_VOLTS -> H0:VAC-MR_IP6_EI166_HV_VOLTS
H0:VAC-MR_IP6_EI166_A_HV_VOLTS_ERROR -> H0:VAC-MR_IP6_EI166_HV_VOLTS_ERROR
H0:VAC-MR_IP6_EI166_A_HV_KVOLTS -> H0:VAC-MR_IP6_EI166_HV_KVOLTS
H0:VAC-MR_IP6_EI166_A_HV_KVOLTS_ERROR -> H0:VAC-MR_IP6_EI166_HV_KVOLTS_ERROR
H0:VAC-MR_IP6_II166_A_IC_VOLTS -> H0:VAC-MR_IP6_II166_IC_VOLTS
H0:VAC-MR_IP6_II166_A_IC_VOLTS_ERROR -> H0:VAC-MR_IP6_II166_IC_VOLTS_ERROR
H0:VAC-MR_IP6_VI166_A_PRESS_TORR -> H0:VAC-MR_IP6_VI166_PRESS_TORR
H0:VAC-MR_IP6_VI166_A_PRESS_TORR_ERROR -> H0:VAC-MR_IP6_VI166_PRESS_TORR_ERROR
H0:VAC-MR_IP6_CS166_A_STATUS -> H0:VAC-MR_IP6_CS166_STATUS

The following channels are no longer available through dataviewer:

H0:VAC-MR_IP6_166_STATUS
H0:VAC-MR_IP6_CS166_A_STATUS
H0:VAC-MR_IP6_CS166_B_STATUS
H0:VAC-MR_IP6_EI166_A_HV_KVOLTS
H0:VAC-MR_IP6_EI166_A_HV_KVOLTS_ERROR
H0:VAC-MR_IP6_EI166_A_HV_VOLTS
H0:VAC-MR_IP6_EI166_A_HV_VOLTS_ERROR
H0:VAC-MR_IP6_EI166_B_HV_KVOLTS
H0:VAC-MR_IP6_EI166_B_HV_KVOLTS_ERROR
H0:VAC-MR_IP6_EI166_B_HV_VOLTS
H0:VAC-MR_IP6_EI166_B_HV_VOLTS_ERROR
H0:VAC-MR_IP6_HS166A_A_START
H0:VAC-MR_IP6_HS166B_A_STOP
H0:VAC-MR_IP6_HS166C_B_START
H0:VAC-MR_IP6_HS166D_B_STOP
H0:VAC-MR_IP6_II166_A_IC_VOLTS
H0:VAC-MR_IP6_II166_A_IC_VOLTS_ERROR
H0:VAC-MR_IP6_II166_B_IC_VOLTS
H0:VAC-MR_IP6_II166_B_IC_VOLTS_ERROR
H0:VAC-MR_IP6_VI166_A_PRESS_TORR
H0:VAC-MR_IP6_VI166_A_PRESS_TORR_ERROR
H0:VAC-MR_IP6_VI166_B_PRESS_TORR
H0:VAC-MR_IP6_VI166_B_PRESS_TORR_ERROR
H0:VAC-MR_IP6_XA166_A_FAULT
H0:VAC-MR_IP6_XA166_A_FAULT_ERROR
H0:VAC-MR_IP6_XA166_B_FAULT
H0:VAC-MR_IP6_XA166_B_FAULT_ERROR

With the vent and FMCS HVAC work can clearly see some variances on some oplevs (namely at the End Stations).  First attachment are the Oplev Pit/Yaw/Sum 7-day trends. 

NOTES: 

• ETMx Pit has nose dived down and is currently more than -30 counts. (Yaw is still within "good" range.)
• ETMy Pit has been a bit all over during the last week, but is under +/- 30counts. (Yaw is nominal.)
• SR3 has had various steps in both Pit/Yaw over the last week.  (updated edit:  This is probably due to TCS HWS work).
• BS yaw was down at -80 (!) at the beginning of the week (2nd Attachment) and returned to nominal values on Monday (5/15).  Pit has had no change & is nominal during this time.

EX Temperature Up 4-degF In Last 24hrs (5/17)!  EY Took 4-degF Step Up On Mon (5/15)  (see 3rd Attachment for 2-week temperature trend)

Apollo started controller work at EX 24hrs ago, and you can definitely see this on the ETMx oplev in Pit.  The temperature sensors (the FMCS sensor went down during this work, but you can see the temperature variances with the Dust Monitors).

EY controller looks like it's back & I chatted with Apollo person in the Control Room and they hope to have the EX controller back tomorrow-ish/possibly today.

This closes FAMIS#4728.

[Jenne, Kiwamu, Vaishali with help from JimW and JeffK]

Continuing the locking effort from yesterday (36197), we managed to get the mode cleaner to lock. Here's a roll down of the events from today:

1. We (Jenne and I) first aligned the MC2 REFL camera because we were almost on the edge of the PD.

2. As this didn't fix the not locking problem, we asked Kiwamu for help and then we looked at a bunch of parameters like filters, gain thresholds, ramp times.  We also looked to check if the suspensions were behaving correctly and then found the mirror which had been turned off. This button (MC2 M2) was not in use at all. Maybe we should have double checked the sdf differences but we know better now.

While we were aligning the MC2 REFL we noticed that MC2 Trans wasn't looking like what it used to. We tried to trace the beam and found that the camera was being illuminated by a ghost beam and not the actual transmission beam of the MC. We found a bright spot by looking into the light pipe and then found that the beam wasn't coming onto the telescope at all. As we couldn't see anything on the viewer card, we turned up the laser power to 10 W and found the beam again in the light pipe only with the IR viewer.

Jenne then tried to gently tap the light pipe (this is the same pipe that had problems yesterday and was fixed) with me looking at the bright spot and it didn't move at all which leads to us believe that the beam might be hitting the edge of the table somewhere.

After hypothesising out loud that this might have been because the tables hadn't returned to the correct positions, we were corrected by JimW who told us that the ISIs return back to their positions on their own.

We then tried to change the axis of the modecleaner in order to redirect the beam in the light pipe but we weren't too successful.

Not having solved this mystery of what happened to MC Trans, we concluded the work for today with a modecleaner that locks at 2 W and 10 W.

Jenne will correct me if I have missed something or used wrong names of mirrors in comments !