While looking at temperature averages at the end stations just before noon, I noticed that the B Temperature sensor at each end station was reading ~1 degree F higher than the other 3 sensors. I took the B sensor out of the equation to try and help stabilize the temperature. 

I made one other change and that was to switch the supply air temp control from manual to auto reset.

During this upgrade to the entire HVAC controls system, many of the older programs were copied and because of the nature of the older system, many of the points were set to manual. We have been working diligently at trying to catch all of these settings but inevitably some have slipped through. We continue looking.    

WP7007

Chandra, Dave:

the vacuum users crontab on vacuum1 has been changed to run the CP3 and CP4 overfill scripts daily instead of only Monday, Wednesday and Friday. The crontab is now:

# Change to daily, WP7007 30 May 2017
# CP3 autofill
01 11 * * * /opt/rtcds/userapps/release/cds/h1/scripts/run_autofill_cp3.bsh &
# CP4 autofill
02 11 * * * /opt/rtcds/userapps/release/cds/h1/scripts/run_autofill_cp4.bsh &

TITLE: 05/30 Eve Shift: 23:00-07:00 UTC (16:00-00:00 PST), all times posted in UTC
STATE of H1: Planned Engineering
OUTGOING OPERATOR: Ed
CURRENT ENVIRONMENT:
    Wind: 20mph Gusts, 17mph 5min avg
    Primary useism: 0.05 μm/s
    Secondary useism: 0.08 μm/s 
QUICK SUMMARY:

Jenne and Vaishali working on locking ALS on X arm.

TITLE: 05/30 Day Shift: 15:00-23:00 UTC (08:00-16:00 PST), all times posted in UTC
STATE of H1: Planned Engineering
INCOMING OPERATOR: Patrick
SHIFT SUMMARY:
LOG:

• Maintenance Day

15:10 Cleaning crew to end stations

15:!5 Jeff out to the cleaning area

15:15 HFD on site to do some testing

15:18 more Fire system maintenance people

15:22 more fire system maintenance people

15:30 Keita and Sigg out to EX for ALS LASER swap

16:10 Sensor correction for both ends is turned off.

16:23 Chris to CER to erect more scafolding.

16:23 Richard back from EX

16:24 Karen leaving EY

16:29 Sigg back from EX

16:35 TJ to LVEA

16:37 Nutsinee to LVEA

16:39 Norco on site for LN2 deleivery to vessel 80 (EX)

16:44 Kyle to MY

17:00 More fire dept on site

17:06 Keita is back from EX for now but is going back.

17:12 Pep to EY

17:20 Keita, Sigg and McCarthy back at EX

17:40 Fire bell testing at EX. The crew working on ALS have ben notified.

18:02 Carlos heading to EX

18:06 Jeff B heading to end stations

18:09 Chris and Bubba done in the CER

19:34 Hanford Monthly Emergency Test phone call.

20:03 Keita and Daniel are back from EX

20:04 Sheila and Kiwamu are going to EX

20:32 Fred in LVEA with a tape measure.

20:46 Fred out

21:19 Fil to EY

21:43 Hugh into LVEA

21:57 Hugh out

22:07 Called EY to "kick" Fil out so we can start locking.

Temp A: 24.4 ºC
Temp B: 21.6 ºC
Diode: 1.80A
Laser Crystal Temp: 29.60 ºC
Doubler Temp: 33.62 ºC

J. Kissel

Checking in on the End station temperatures after the HVAC upgrade. I think I may have found a clue looking into the individual temperature sensors that comprise the average at each end station, which is what's used for the error signal in the FMCS HVAC control servo. Namely, it may be that the first zone is hooked up with a sign flip, or is somehow 180 deg out of phase with the other three zones, which makes the average seem more stable than reality, so the HVAC servo doesn't do anything about it.

In addition to these diurnal oscillations, the overall temperature is trending colder over the past 5-6 days (as reported by the suspensions displacement [first two attachments] and in temperature units, the PCAL temperature sensor), even though the FMCS HVAC error signal is holding steady.

Check out the associated attachments for proof. I've divided up the past 25 days [second two attachments] into several more detailed zooms [the rest of the attachments]: 
    - A pre-upgrade long (~5-6 day) trend
    - A pre-upgrade zoom of one day           -- this shows that all four zones used to be relatively in sync
    - A post upgrade long (~5-6 day) trend    -- this shows that zone A is ~180 out-of-phase with zones B, C, and D

I'll get in touch with Bubba to see if this sign-flipped Zone A is possible, and what we can do about the overall drift.

WP7008

Chandra, Dave:

The high alarm level for beam tube vacuum was lowered from 5.0e-08 to 5.0e-09 Torr for all beam tube gauges except for LX and LY, which are kept temporarily high following the corner station vent. Chandra will open a service-request FRS to request these alarm levels remain high until such time they can be reduced. The FRS will act as a reminder that LX and LY are out-of-configuration.

On Chandra's request I also added CP3's pump LN2 level back into the daily status texts to support ongoing CP3 work (example report shown below).

cp1=92.0  cp2=92.2  cp3=5.6  cp4=0.0  
cp5=92.0  cp6=92.0  cp7=92.0  cp8=92.0  

Laser Status:
SysStat is good
Front End Power is 34.02W (should be around 30 W)
HPO Output Power is 157.9W
Front End Watch is GREEN
HPO Watch is GREEN

PMC:
It has been locked 5 days, 5 hr 57 minutes (should be days/weeks)
Reflected power = 15.33Watts
Transmitted power = 59.06Watts
PowerSum = 74.39Watts.

FSS:
It has been locked for 0 days 20 hr and 33 min (should be days/weeks)
TPD[V] = 2.956V (min 0.9V)

ISS:
The diffracted power is around 3.6% (should be 3-5%)
Last saturation event was 0 days 4 hours and 23 minutes ago (should be days/weeks)

Possible Issues:
Head 1-4 flow error, see SYSSTAT.adl

h1fw0 had file write issues Friday afternoon. I power cycled the Solaris LDAS-QFS writer machine h1ldasgw0 and h1fw0 has been stable since then.

At the time h1ldasgw0 was rebooted it had been running since 14 Dec 2016 (163 days). For comparison, h1ldasgw1 has an uptime of 250 days. So we don't seem to be seeing a "running too long" issue and there is no explanation for h1ldasgw0's problem other than we have seen this  before with the same solution.

Chandra had to run some errands on the way to work but is on her way.  

As found this morning, the GN2 flow into CP3 via the sensing line hookup had increased overnight from > 2 LPM to > 5 LPM this morning (0950 hrs. local).  The GN2 bottle still had 1200 psi this morning and the regulator output (when adjusted for near zero flow) was still as left, i.e., 25 psi.  ->   I valved-in the parallel connected magnahelic diff. pressure gauge and it was in good agreement with the pressure transducer used by CDS.  I manually filled CP3 via CDS by changing the LLCV %open from 20% to 50%.  The exhaust thermocouples responded in 1 1/2 minutes or so.  Thinking that the 2 LPM contribution from the GN2 may have caused the T/Cs to respond prematurely, I went outside and opened the LLCM bypass valve 1/2 turn and observed LN2 at the exhaust after a minute or so.  So, CP3 is full.  I experimented by increasing the regulator output to 40 psi and increasing the GN2 flow to >> 5 LPM (5 LPM is max on this flow meter).  

I am leaving the setup at 40 psi regulator output, 3 LPM flow and the magnehelic gauge valved-out.  

Updated the NDS2 client to 0.14.2 (the code that should be pushed to the LSC repos as 0.14.2 later today).

This addresses problems in:

• https://alog.ligo-wa.caltech.edu/aLOG/index.php?callRep=36418
• https://alog.ligo-wa.caltech.edu/aLOG/index.php?callRep=36287

TJ, Nutsinee

Per Aidan's request we misaligned ITMs and moved ETMs around to see if the CR HWS sees any reflection from the ETM surface. HWSY streamed images didn't appear to have any residuals from the ETMY but HWSX saw some light from the ETMX.

Here's HWSX with only ITMX misaligned (ITMX delta YAW = -191.3u)

And here's HWSX with both ITMX and ETMX misaligned (ETMX delta YAW = -110.5u)

We also appeared to have this mesh-looking feature on the left hand side. Stray light?

We had a potentially scary situation tonight at mid-Y and through crazy coincidence managed to fix it before it became a serious problem. Sheila contacted me around 10 pm local time about a verbal pressure alarm that was going off in control room for BSC7 (gauge PT-170). I checked the MEDM screen from home and didn't see anything abnormal - except that the pressure is a bit high since the vent (7e-8 Torr). Most likely it's alarming because of set point setting.

This alarm made me look at our site pressure trend (48 hr trend here) and noticed that PT-210 at mid-Y was quickly drifting up starting around 7pm. Suspected CP3 and/or CP4 were warming up due to very hot temperatures we've had this weekend. Gerardo was unable to remotely log into CDS to initiate a remote overfill even though we were supposed to have permission until June 1. I drove out to the site to manually overfill both cryopumps at the skid by opening the bypass valve 1/2 turn (just like the good ole days). Filled CP3 first and observed an almost immediate drop in pressure. Took 50 min. to overfill (verified by watching LN2 pour out of exhaust). As soon as I started the fill, the exhaust flow increased to turbulent. CP4 didn't exhibit the same turbulent behavior, and took 30 minutes to overfill. Conclusion is CP3's valve actuator setting from Friday was too low at 15% open. I reset to 18%. Also increased CP4 from 37% to 39% open. Tomorrow is supposed to be 98F!

Need to learn what the current pressure alarms are set to; I propose we tighten these just for mid-Y so vacuum staff is alerted quickly when pressure starts to rise. I also suggest we try to maintain seconds vs. minutes of overfill time as we approach a hot summer.