PeterK, RickS with help from Patrick, Filiberto, Mark, et al.

After Peter swapped in the spare chiller pair (Crystal and Diode), and moved the hardware for reducing the pressure of the Crystal chiller loop (valve and fittins), we had a small leak at the supply side of the Crystal chiller.  We found that two of the  SS 3/4 straight pipe thread fittings were seized, and we were were thus unable to eliminate the leak.

We were forced to switch back to the Crystal chiller that was operating earlier today (it was the Diode chiller that failed).  However, after plumbing it in, we found that the controller failed to initialize.

We swapped in the controller from the spare Crystal chiller, the one with the seized water fittings, and we now seem to be back in business.  

The PSL is back on-line, servos are locked, etc.

We need to a) order the supply side output connector for the spare crystal chiller from Termotek and b) order a replacement controller for the original chiller (that is now in service), and c) make sure we have enough spare parts - controllers, etc.

TITLE: 02/12 Day Shift: 16:00-00:00 UTC (08:00-16:00 PST), all times posted in UTC
STATE of H1: Preventive Maintenance
INCOMING OPERATOR: None
SHIFT SUMMARY:

Today was a full Maintenance Day with LHO Site opening up after being closed for last 3-days due to snow.  Notable items:

1. X-Arm is CLOSED!  (and blocked with a vehicle.  This arm as not been plowed yet.)
2. PSL CHILLER WORK CONTINUES:  PSL Chiller work is running long due to leak which was taking longer to address than expected (as of 3:30, heard it was going to be on the order of hours....or days?).
3. Y-arm Gate Vaves CLOSED:  MY Ion Pump is currently being craned into place.  Next up will be opening Y-arm gate valves at MY.

LOG:

• Snow plowing in the morning as well as prep work for MY ion pump work.
• 18:54 TCSy CO2 alignment work (Danny & TJ)
• 19:33 Several SEI & SUS systems tripped....corresponding with loud bang heard from Control Room...suspecting this is from a big chunk of ice crashing nearby.
• 19:35 Magnetometer installation in/near CER at the Diode Room (Robert, Kara)
• 19:40 CDS crash of several front ends (noticed this as I was recovering from SEI/SUS trips.  Dave contacted.
• 20:21-23:00 ISCT6 work (Nutsinee)
• 20:50 ETMx & y Charge Measurements (Corey)
• 21:55 - 22:55 EX install new illuminator chassis and work on HV power supply (Fil & Marc)
  • White SUV is stuck midway between LVEA & MX.
• BS Guardian transition investigation by Jenne
• 0:02 Installing shakers (Robert, Kara)

Attached are trends.

Notes:

• PITCH values beyond +/- 10:
  • ETMy is pitched down to -30 (drifting since Saturday)
  • ITMx is below -20 (trended below -10 over last few days)
  • ETMx is hovering around -10
• YAW values beyond +/- 10:  Looked OK

Notes on the procedure/measurements:

• Step 1c: (HV values)  For ETMy it's HVMON values were low (i.e. -3).  Think I noticed this last time I did this on 12/5/18
• Step e&f:  The ETMy has a much different pitch value than a few months ago.  That's fine, but I did notice Oplev pitch was pretty high over -30.  I just went ahead and zero-ed this 
• General Prep Note:  ETMx & ETMy look different.  ETMx ESD Coil outputs all have values, on order of 50k (vs. ETMy whose similar channels are all zero).  I don't look at these screens enough, but maybe this is due to how we use the ESD on ETMx and how ETMy continues to have a bad ESD (i.e. the LR).
• For ETMx measurement (see attached), the 1st data file had errors, so I only had (4)  good measurements. 
• For ETMy measurement (see attached), the 1st & 4th data file had errors, , but als had (4) decent measurements (with L
• Long Tred Plot (see attached) note:  
  • For ETMx made stop time:  2019,02,12,23,00,0
    • Used usual Long_Trend.m script.
    • ETMx ESD Charge Eff Bias Trend showed only the Mean data point for my measurement.
    • ETMX ESD Actuatioon Strength Trend showed all the data points at 0.
  • For ETMY made stop time:  2019,02,12,23,00,0
    • Used Long_Trend_ETMY_LHO.m script.
    • ETMy ESD Charge Eff Bias Trend showed only the Mean data point for my measurement.
    • ETMY ESD Actuatioon Strength Trend showed all the data points at 0.
• Let both charge scripts run to completion.  Returned pit/yaw sliders for both optics.  Returned ETMx Cal Line amplitude to 0.55 (from 0 from measurement).

Here are the original Slider Values (which I returned to after the measurement):

ETMx:

• Pit:  102.9
• Yaw:  -123.6

ETMy:

• Pit:  188.2
• Yaw:  -124.4

Laser Status:
Front End Power is 31.53W (should be around 30 W)
70W Output Power is 71.57W
Front End Watch is RED
70W Watch is GREEN

PMC:
It has been locked 0 days, 0 hr 44 minutes (should be days/weeks)
Reflected power = 10.69Watts
Transmitted power = 53.62Watts
PowerSum = 64.31Watts.

FSS:
It has been locked for 0 days 0 hr and 42 min (should be days/weeks)
TPD[V] = 2.033V (min 0.9V)

ISS:
The diffracted power is around 2.7%
Last saturation event was 0 days 0 hours and 33 minutes ago (should be days/weeks)
Possible Issues:
PSL chiller was swapped today, so it had come back recently when this report made.

The spare chiller (Gromit) was swapped in, after some plumbing adjustments.  Laser is back up.
The current flow rates look about the same as before.  Not so sure about the water
pressures.  The valve at the back of the crystal chiller needs to be adjusted to where
it was.





  Fil, Patrick, Peter

Richard, Corey, Dave:

We have just had timing errors on three front end computers (h1lsc0, h1seib3 and h1seih45). There is no immediately obvious connection between these three FECs.

All 3 FECs still see their IOChassis.

I've captured the diagnostics and am in the process of restarting the models.

WP 8089 was approved by Keita, Jeff, and Dave over email, and the DMT production computers have been updated to gds-2.18.14.

TITLE: 02/12 Day Shift: 16:00-00:00 UTC (08:00-16:00 PST), all times posted in UTC
STATE of H1: Preventive Maintenance
OUTGOING OPERATOR: None
CURRENT ENVIRONMENT:
    Wind: 5mph Gusts, 4mph 5min avg
    Primary useism: 0.10 μm/s
    Secondary useism: 0.54 μm/s
QUICK SUMMARY:

"LHO Site Open" with a suggested arrival time of 10am, but please exercise caution with travel.

Tuesday Maintenance is still on:

• PSL Chiller swap (ongoing)
• Snow plowing continues (so far around Corner Station area).
• VAC team is working at MY (there is a work permit for Ion Pump removal at MY, which would require gate valve closures)
• TCSy CO2 table alignment work started this morning.
• LN2 deliveries were canceled today due to snow.

Richard, Dave:

We restarted all the models on h1susb123 (h1sus[itm[x,y,pi], bs], h1iopsusb123) to clear the DAC drive issue. 

The laser has since tripped since being brought back.  Attached is a plot of the laser power and
diode chiller temperature.  It looks like the loss of cooling capacity coincides with the laser
tripping.  Even with no heat load, the water temperature of the diode chiller has not come down
in the last 30-40 minutes.

    Prepping to sub in the spare chiller.

In an email from Jeff this morning:

All,

Thanks to efforts of the advance team for the last two days, the LIGO Hanford site is now open. Employees electing to work on site should use caution and judgment in safe routes of travel. As start times have been delayed to 9:00 am and 9:30 am for DOE Hanford site workers, given the heavy traffic that entails, it is strongly advised to plan arriving from 10 am.

Also, please note that ice and snow, along with snow-covered ice, are present even in cleared areas, and that personnel are advised to walk carefully in the parking lots and on the walkways between buildings.

Best Regards,

Jeff Jones

[Rana, Jamie]

We spent the evening trying to get more measurements of the 9MHz RIN situation, basically redoing what was done in LHO log 46586.  We went to ITMY single-bounce and locked OMC on carrier, then went to PRMI and locked OMC on 9MHz.  I'll post plots tomorrow.

FYI the OMC and PRMI configurations might be a little bit funky.  We didn't get to reset everything yet to get back to low noise, just in case any one tries to brave the snow to get back out here.