further investigation of strange signal behaviour when timing was reprogrammed

As Hugh noted in his July 19th alog (https://alog.ligo-wa.caltech.edu/aLOG/index.php?callRep=28525) when we reprogrammed the site-wide timing systems on 19th May 2015 and 19th July 2016 the HEPI pump controller units saw a bogus drop in hydraulic fluid pressure. On 19th July of this year the drop at EY was sufficient for the PID controller to attempt to correct, resulting in an excess of presssure which caused problems.

At these times we also saw a bogus increase in cold cathode gauge readings from the vacuum controls system (Kyle put in an alog). Initially I thought more systems were being affected, but today I did some more in depth investigation and the problem appears to be limited to hepi pressure and vacuum cold cathode signals.

At EY I trended all the raw ADC channels in the Beckhoff Vacuum system (terminals M12-16 chans 1-4). The only channels which saw an increase were M11-chan2, M12-chan1 and M12-chan3. These are the input signals for the three cold cathode gauges. When we trend these same signals from May 2015 (back when the computer was the orignal VME system) these same signals show bogus deviations. I looked at the slow-controls Beckhoff system and the weather station, but could not see the problem there.

There are some exceptions to the rule (for example in 2015 hepi-EX did not see a change) but generally when we reprogrammed the timing system the Cold Cathode and Pump Controllers saw a change of input voltage. The question is why only timing reprogramming causes the problem and not the many reboots we have done over the years. I suspect the powering of the 12V units (fanout, comparator, RF Amp, IRIG-b) which we rarely do as opposed to the more frequent powering of the 24V IO Chassis may be a clue.

Tomorrow, under WP 6035, we will go to EY and repeat the power cycling sequence we followed on 19th July. We will repeat everything except for the actual reprogramming. We will be closely monitoring the ADC inputs for these signals. At the end of the excercise Ansel will upgrade the FPGA on the EY fanout using Daniel's latest code.

FSS optical path tweak

The alignment into the reference cavity was tweaked.  Mostly a vertical adjustment followed by a
minor adjustment to the yaw.  The transmission as reported on the MEDM screen went from ~2.6V to
~4.6V.

    Measured the power before the lens located in front of the ALS fibre to be 33.4 mW.  At this
time MEDM reported 4.62V.

    With a DMM, the DC output of the locking photodiode was measured.
 - locked: 0.124 - 0.134 V
 - unlocked: 0.772 - 0.777 V
So the reference cavity visibility is 83.3%.  The gain of the filter yielding the DC output of the
locking photodiode was changed from -0.050 to +0.500 as this agreed better with the value measured
with the DMM.  Not sure why the big change other than I had noticed that since the CDS reboot of a
couple of weeks ago, the reflected DC was different.  Perhaps this gain setting wasn't saved?

    For the transmission photodiode, when the FSS was unlocked the DMM measured -1.8mV.  MEDM
reported ~0.121V at the same time.  When the FSS was locked and MEDM reported ~4.6V in transmission
the DMM measured -2.766V to -2.777V.



Jason/Peter

TCS measurement pending

Kiwamu, Nutsinee

A code is scheduled to run at 9 pm tonight. The code will power up CO2 to 1.3W and power it back down to 0W after 6 hours. Please do not touch ITM optics.

3rd OMC unit - added EP30 supports to PD housings

After a few days of consult with SYS and ISC, today I added some side supports to the OMC PD housings that Koji and I found to be problematic last Thur (alog 28714).  Attached are pictures of 1 of the 2 PD mounts with the 2 new 10mm glass prisms and the 1 new D1600316 metal prism.  I tried to use a minimal amount of glue on the bottom of the glass prisms in order to have a nice rounded (low stress) bond there, and then use a bit more glue on the upright side wall which is more of a porous surface.  Although after a few minutes I stopped having sliding issues with the glue bonded prisms, I left them with a guge block applying a little bit of pressure at the front edge in case they slide away during the night of curing.  The lab temperature has been set to ~83deg F in order to assist the cure.

Reset HAM6 Cleanroom Dust Monitor Alarms

   Reset the HAM6 cleanroom dust alarms from Clean-10000 to Clean-100. There will be minor alarms at 70 counts and major alarms at 100 counts. 

   OPS if you are getting alarms, do not adjust the alarm levels or ignore them. This monitor (LVEA #6) is in a running cleanroom which has been prepped for tomorrows chamber opening. Alarms should be investigated if their source is not known.  

   DM LVEA #6 was tested and is functioning as expected.    

Ops Day Summary: HAM6 vent is tomorrow, other activities that require closed gate valves being planned

State of H1:  Lightpipe is closed and locked, rotations stage is disabled at 2W, venting HAM6 tomorrow

Activities:

15:00-16:00UTC: 

- morning meeting, alog 28769

- commissioning meeting

 

16:00-20:00UTC:

- JeffB - LVEA - dust count

- Fil/Alfredo/Elizabeth - HAM6/BSC3/BSC7 - pulling able to ITMX chamber for vacuum gauge

- tour in Control Room

- Hugh - helped with HAM6 SEI configuration, alogged here, alog 28773

- I took a snapshot of the last good alignment, alog 28779

 

20:00-22:00UTC:

- Chandra - MY - CP5 overfill

- Gerardo - EY - retrieved a yellow viewport cover

- Richard - disabled the rotation stage, alog 28786

- Richard - lightpipe locked, alog 28788

- Kyle - LVEA - measured dewpoint, alog 28782

- JimW/Micheal/Krishna: JimW + UW crew

    - bringing in a new seismometer 

    - will be careful to avoid adding contamination to the LVEA

    - will be taking it to the vertex - hand cary over or slide under the beamtube

- Fil/Alfredo/Elizabeth - HAM4, BSC3, BSC7 - pull new cable to vacuum gauge on BSC7

- Peter/Jason - PSL air conditioning has been changed, no entry into the PSL as of 22:00UTC

- Nutsinee - LVEA - TCS

- HAM6 ISCT6 moving crew - LVEA - moved the table away from HAM6 - Jenne, Keita, TJ, JeffB

- Gerardo - LVEA - HAM6 - covered a viewport with a yellow cover

- JeffB - LVEA * 4 - checking air quality / dust - other vent prep

- Robert/Richard/Fil - on the roof for anemometers

- Robert/Fil/Richard - back from the roof

- Jenne, TJ, Keita - out of the LVEA

- Chandra - back from MY

- Gerardo - back from EY

- Richard - back from LVEA

- Nutsinee - back from the LVEA

- Gerardo - back from HAM6

- JeffB - out of the LVEA

 

22:00-22:35UTC:

- JimW - out of the LVEA

- Fil/Alfredo/Elizabeth - out of the LVEA

 

22:35-23:00UTC

- Krishna/Micheal - out of the LVEA

Update on Fire on Rattlesnake Mt.

An update on the fire at the base of Rattlesnake Mt. from the DOE Hanford Works:

Subject:	PRIORITY MESSAGE: FIRE UPDATE
Date:	Mon, 1 Aug 2016 20:52:06 +0000
From:	Hanford EOC

PSL IO Rotation Stage is disabled:

Rotation stage is disabled at 2W input power to the IMC.

Of course, the shutter is closed, so there is no beam from the PSL into the vacuum system.

ISCT6 moved (Kiwamu, Stefan, Jenne, TJ, Filiberto, JeffB, Keita)

We closed the shutter for two laser beam pipes between PSL and HAM1.

Lexan plates were installed on all HAM6 viewports. Yellow covers were installed on these viewports except one. For the remaining one, Gerardo will find and install one later).

Cable connections were documented and photographed, and all cables were disconnected from the table.

The accelerometer cable on HAM6 North door was disconnected fron the accelerometer and was taped on HAM5 North door. But the accelerometer itself is still on HAM6 North door.

ISCT6 was moved out of the way.

CP3 overfill

Took 12 sec. to overfill CP3 until LN2 poured out exhaust, with 1/2 turn open on LLCV bypass valve.

Lowered CP3 LLCV from 18% to 17%.

~1100 hours local -> Started CS vent/purge air supply (Kobelco)

Chandra, Gerardo, Kyle

Added ~ 2 Qts Turbine oil.  Routing output to LVEA

~1330 hrs. local 

Measured dew point in LVEA < -35C 

Lightpipe is closed - no IR beam in the vacuum system

In order to move ISCT6, the lightpipe from the PSL needed to be closed.

Jenne closed it and locked it closed - it should remain until after the HAM6 vent.

snapshot of last alignment before closing the lightpipe

• The arms were locking in green with buildups of 1.06.
• The IMC was locking well and had been locked at 2W for about 12 hours.
• IR power in TR_X(Y)_NORM_OUT was flashing, though no locking in IR was attempted

Change to ITMX Coil Driver seems to have worked

Hugh did a lot of work over the last few weeks diagnosing the ITMX ISI, with respect to it tripping earlier than the other platforms during an earthquake. His fix last week seems to have worked, at least for the earthquake Friday. First 2 attached plots are the ST1 WD Triggers (the ISI has tripped when the trigger /= 0, first plot shows the triggers separately, second is all on the same plot) , and ITMX, ITMY and ETMX all trip at roughly the same time. ETMY and the BS trip several minutes later, but they were in different configurations (BS is always Isolated_Damped, ETMY had it's sensor correction turned off). This was a large earthquake that came up quickly (third plot shows ETMY Z STS 30-100 mhz BLRMS and ITMX WD trigger) , but for now it looks like ITMX is behaving like the other platforms.

Trends Of LVEA Dust Monitors

Attached are trends of the LVEA Dust Monitors.  

• Dust Monitor #6 is in the HAM6 Cleanroom
• Dust Monitor #10 is in the Beer Garden

On the 24hr trend, there was a little bit of dust in the LVEA between 8am-1pm, but in the cleanroom, were have been near zero for the last 24 hrs.

On the 4-day trend, the only dust in the HAM6 cleanroom was from technical cleaning on Friday.

Jeff is going to take some more readings outside.

   Checked particle counts from outside and inside the OSB and in the LVEA. 

   Summary: Outside air is currently around 330,000 for 0.3um particles. As one moves through the OSB towards the LVEA the counts drop as the building air filtration system does its job. Counts in the LVEA range from 1290 to 270 03.um particles. The attached spreadsheet has the complete readings for all sampled locations. 

   Will continue to monitor as the fire continues to burn.   
 

   Second Mid-day check of air around the site shows air quality is not improving. Fires continue to burn or smolder and light wind is not helping clear the air. Posted are the 13:00 hours data. Outside and inside counts are up considerable. Particle counts inside the cleanrooms remain well within acceptable levels for in chamber work.   

LSC-PR_GAIN back at 30 for 50W

Terra, Evan, Stefan

With the spot move script from last alog we could reliably maximize the recycling gain. We reached 30 (as measured by LSC-PR_GAIN - Evan claims this is more like 35).

The instability in AS90 could be removed by manually aligning the SRM - but POP18 got worse when doing so.

Interestingly - the same move that fixes the recycling gain at 50W, has almost no impact on the recycling gain at 2W.

 

For reference, the last lock loss was at about 6:15 UTC on Aug 1st.

We had to adjust the soft loop gains to

            ezca['ASC-DSOFT_P_GAIN'] = 0.5 # 3 killed it
            ezca['ASC-DSOFT_Y_GAIN'] = 3  # oscillates at lower UGF when much lower
            ezca['ASC-CSOFT_P_GAIN'] = 0.5 # designed differently
            ezca['ASC-CSOFT_Y_GAIN'] = 3  # oscillates at lower UGF when much lower