During the power outage recovery,(06/06/2016) took the opportunity to replace the PSL in-line coolant filters. 

   The first set of filters are located in the Chiller Room on the discharge side of the chiller. There was some debris in the bottom of the Crystal Chiller filter. There was significantly less debris in the bottom of the Diode Chiller filter. There was little difference in the discoloration between the two filters in the Chiller room. After 31K hours of operations these filters are in very good condition. 

   The second set of filters are located in the PSL enclosure on the intake side of the cooling system manifold block. There was very small amount of debris in the bottom of the Crystal chiller filter. There was no noticeable debris in the Diode chiller filter. There was no noticeable difference in discoloration between these two filters. As expected, these filters were not as discolored as the filters in the Chiller Room. 

   In general, the PSL filtration appears to be working very well. In the future, these filter will be replaced at the same time the primary and backup chillers are swapped (planned for once a year). 

   I am working on getting a local lab to analyze the debris from the Cristal chiller. When we know what all this material is, we can make a better informed decision as to the internals of the PSL cooling system.           

ETMX Mode3: FM1, FM2, FM4,  +10 gain (BP, -60deg, 100dB) seems to have worked quite well. No need to turn on a damping for 505.707 (which should be checked again with 0.0001 BW to see if it's really exists). 505.707 should be watched while damping 505.710 just in case.

The new violin mode table is being uplated slowly. The modes with Damp Setting column filled out are the one that's been sucessfully damped by the filter settings indicated in the table.

Morning Meeting

- ER9 in a month

- Extended maintenance is cutting in commissioning time. Try to not do it on Mon,Wed, Fri

SEI: No issue on recivering

CDS: "Fine"

Software: Don't assume things are perfect (due to the recovery from scratch).

FAC: Facility assessment tomorrow

Activities (All time in UTC)

~15:30 Fil to EX

16:00 Kristina to MX, Karen to MY

16:48: Robert setting up stuff by PSL

17:00 Robert out

18:04 Karen leaving MY

18:20 Betsy to LVEA

18:30 Betsy out

19:20 Fil back

~19:30 dave to Mid stations

20:00 Dave back

20:05 Betsy to optics lab

20:20 Fil to EX outside VEA (pulling cables)

21:01 Kyle to CP3 overfill

          Patrick, Krishna, Michael, Dave, Jim to EX to install BRS Beckhoff comp.

21:29 Kyle back

21:55 Dave+Jim back

22:07 Patric+Fil back

22:10 Fill dropping stuff at EX

Drift over 3+ hours:

• IM3 pitch = 6.8urad, with a rate of change of 35nrad/minute
• IM2 pitch = 4.7urad, with a rate of change of 25nrad/minute
• IM1 pitch = 0.05urad, with a rate of change of 0.3nrad/minute (not dissipating charge)

1410 - 1425 hrs. local -> To and from Y-mid 

Opened exhaust check valve bypass, opened LLCV bypass valve 1/2 turn -> LN2 at exhaust after 4 minutes and 40 seconds -> Restored valves to as found -> Increase CP3 LLCV manual %open from 19% to 20%.  

Next manual overfill to be Friday, June 10th.

Terra, Carl B., Rich

Terra and Carl had noticed a ~20mVp-p 1.3MHz oscillation on the ETMX ESD Driver at viewed with an oscilloscope at the output (SHV connectors on the front panel) leading to the ETM.  After confirming that the oscillation was really generated by the ESD Driver, Carl and I opened the spare to see if we could find a set of conditions that might produce such an oscillation.  By examining the spare, we were able to trace the potential instability to the first stage of the two stage pole-zero dewhitening filter.  Poking at this stage with my finger will occasionally get it to latch into the 1.3MHz oscillation state.  We drove the output of the opamp in question with a 1vp-p, 1kHz square wave through 400 ohms to get a better feel for the dampling and phase margin under normal operating conditions.  This stage is completely stable with the pole-zero stage engaged, but becomes marginally stable with the pole-zero stage bypassed.  The problem can be cured by the addition of a small (~30pf) capacitor across the feedback 21kohm resistor implying it is worsened by input capacitance.

We opted not to pull all the drivers and fix this problem.  The reasoning is that this stage is in its stable state (pole-zero engaged) while the driver is used as a low noise driver for length control of the ETM.  There is really no driving need to fix this at this point, but we wanted to document its existence for optional repair at a later date.  A fault report will be written to further document the issue.  

As I reported in 27622, the elevated noise is still present in the Stage1 V1 CPS of the ITMX.  We should try a power cycle of the chassis at earliest opportunity.  I don't have access to DetChar at the moment to see if this noise is impacting the ISI performance.

I have analyzed the IM OSEM signals from the May 19th ISI trip, while both the ISI and the IM optics were tripped, and have injected a step funtion into TEST PIT and TEST  YAW to measure Q values.

Power Spectrums:

Length signals for IM1-4, and the signal for IM4 shows clean peaks for yaw and it's 1st harmonic and length and it's first harmonic.  All other IMs have peaks that are lower than the peaks in IM4.

Q values:

I measured the length and yaw Q values for each IM, and my original post is alog 27327.  In that post, I list pitch and yaw, however the resonant frequency I measured that's labeled as pitch is actually length. 

IM4 shows the highest Q values for length and yaw, and comparing the Q values for IM1-3, they are all between 54% and 95% of the IM4 Qs.

Time Series:

The time series of the individual OSEM signals reveals a difference in amplitude in the oscillations of OSEMs, when comparing the four OSEMs on each optic.  

I measured the period of oscillations for each OSEM on each IM, and in reality the period was not very enlightening, however, I also collected the oscillation amplitude of each OSEM near the end of the time the optic was tripped.  The oscillation amplitudes proved to be very revealing, and show that the OSEMs on IM4, the IM that has never shown an alignment shift , have very different behavior than the OSEMs on IM1-3, that have all had significant alignment shifts. 

Details / Summary of power spectrums for IM1-4: attachment 1

• all IMs, yaw and length peaks
• all IMs, yaw and length first harmonics
• all IMs, pitch and roll peaks
• IM4 yaw peak and it's 1st harmonic
• IM4 length peak and it's 1st harmonic
• IM1 yaw peak and it's 1st harmonic
• IM1 length peak and it's 1st harmonic
• IM3 yaw peak and it's 1st harmonic
• IM3 length peak and it's 1st harmonic
• IM2 yaw peak and it's 1st harmonic
• IM2 length peak and it's 1st harmonic

Details / Summary of oscillation amplitude data for IM1-4: attachment 2

IM4: no alignment shifts observed in my IM investigation, highest average percent of max oscillation at 94%

IM2: largest and most consistent alignment shifts observed, has the OSEM with the lowest percent of max OSEM oscillation at 70%

IM3: second largest alignment shifts, has the lowest average percent of max oscillation at 81%

IM1: smallest alignment shifts, one OSEM at 92%of max oscillation, others at 76% and 82%

TITLE: 06/08 Eve Shift: 23:00-07:00 UTC (16:00-00:00 PST), all times posted in UTC
STATE of H1: Corrective Maintenance
INCOMING OPERATOR: None
SHIFT SUMMARY:  Spent the entire shift getting through Initial Alignment.  Major by-hand alignment required at every step of IA.  Things are still drifting as a result of temperature excursion during power outage.  But we made it . . through IA that is.
LOG:  8 hours of aligning
 

DAQ frame writers

The frame writers instability cleared up overnight without us doing anything. Today fw1 was more unstable than fw0 (one fw0 restart, three fw1 restarts). Still a far cry from fw0 restarting every few minutes yesterday afternoon.

DAQ EDCU connection to digital video channels

After the power outage the DAQ EDCU would not connect to any digital video channels. Today I remembered that the EDCU only uses EPICS gateways to access IOCs on other subnets. The gateway between the H1AUX lan and the H1FE lan was not in the start script. I started the gateway and corrected the script. The only channels not connecting to the EDCU are now the end station HWS channels.

HWS code at end stations

Nutsinee, Jim, Dave:

When we tried to start the HWS EY code ('python run_HWS.py') on h1hwsey, the EPICS IOC started with both ETMY and ETMX channels (though only the ETMY channels had valid data). This appears only a problem with the new python based system at EY, EX only runs ETMX channels. We'll continue this tomorrow.

SUS PI work

Terra, Rich, Jeff, Carl, Betsy, Tega, Ross, Dave

model changes were made to h1susitmx, h1susitmy, h1susbs, h1susitmpi, h1omcpi. DAC allocations were changed, SHMEM IPC added for binary data exchange, new quad master, new C code. There were several rounds of model and DAQ changes.

ETMY HWWD

Dave, Jim

We are unsure if the hardware watchdog unit at ETMY is working after restoration of power. One sure way is to power cycle the unit and monitor the LEDs for the startup sequence, but that would power down the ISI coil drivers. We can check if the code is running by disconnecting one of the monitor cables and checking for the LED error. We'll test some more on the test stand before risking ETMY.

DTS

Jim

The DTS was powered up and made fully functional. Interestingly like H1 some front ends wound up with the incorrect time because the boot server had not synced up. We'll remember to check on that in future (Tega got compile errors on x1lsc0 because of this).

Attached are the usual long trends of the charge on ETMx and ETMy with the latest data appended.  The ETMx charge accumulation is still decaying towards 0, but not there yet.  The ETMy charge is also near zero in almost all 4 quadrants.  Kissel and I decided we will leave the signs of the ESD bias as they are for another week.  It doesn't look like the ETMx data from today was affected too much with the ISI tripped this morning (the SUS was still damped).

J. Kissel, R. Abbott, T. Hardwick, C. Blair, D. Barker, and J. Betzwieser

After a good bit of chasing our tails and simulink model juggling, we've confirmed that the new infrastructure necessary for the new ITM ESD drivers (see E1600064) is ready to go. 

I'll post more details and screens later, but below are a summary of the things we'd touched during the day's installation:
- Several top-level models are affected by this change, 
/opt/rtcds/userapps/release/sus/h1/models
h1susauxb123.mdl   <-- for the new voltage monitor channels
h1susbs.mdl        <-- in charge of distributing the BIO signals
h1susitmx.mdl      <-- integration into the control system
h1susitmy.mdl      <-- integration into the control system

- We also, sadly needed to create a new QUAD library part, because the ITM ESD driver infrastructure is that much different from the ETM ESD driver system; that now lives here: 
/opt/rtcds/userapps/release/sus/common/models/QUAD_ITM_MASTER.mdl

and in addition, we added a new function to the 
/opt/rtcds/userapps/release/sus/common/src/
CD_STATE_MACHINE.c

called "ESD_ITM" which is called in the BIO block of the new QUAD library part. 
- Also, in the clean up of models, we also re-installed all DAC cards directly from the CDS_PARTS library, which means that a few of the MEDM macro descriptions needed updating -- plus the new macros for the ITM ESD drivers themselves. Those are in 
/opt/rtcds/userapps/release/sus/common/medm
susitmx_overview_macro.txt
susitmy_overview_macro.txt

- Both the new BIO block and QUAD Library parts needed associated entirely new MEDM screens which are now separate offshoots of the ETMs, 
/opt/rtcds/userapps/release/sus/common/medm/quad/
SUS_CUST_QUAD_ITM_OVERVIEW.adl
SUS_CUST_QUAD_ITM_BIO.adl

- I updated the sitemap to call these new SUS_CUST_QUAD_ITM_OVERVIEW screens, passing the appropriate macro files for each optic. The sitemap has been committed here: 
/opt/rtcds/userapps/release/cds/h1/medm/
SITEMAP.adl

During the power outage the controller at Mid-Y failed its transition from facility power to generator power, Kyle borrowed the controller from Y-End to power the ion pump at Y-Mid (IP9).  Today I attempted to swap the DUAL type controller (borrowed controller) with a Gamma type, but the Gamma controller failed, brand new controller, so by mistake I installed the original controller that had been removed by Kyle, such controller decided to work now without problems, so I left installed.  I returned the borrowed controller back to Y-End station to power IP11, but it turns out that the signal wire connector is falling apart and needs to be fixed, which will be done on the next opportunity.

The new Gamma controller was bench tested and fuses checked, it continues to fail, it only outputs -50 VDC, not good, it will get send out for warranty repair.

Pulled cable from the annulus ion pump controller on BSC5 all to way to the rack on the south wall of X-End VEA.  Next opportunity we'll have the cable landed and terminated.
 

Michael, Krishna

We are investigating the electrostatic/capacitive actuator on BRS-Y by driving it with a small 50 mV modulation at 20 mHz and at different Bias voltages. BRS sensor correction is turned off and should not be turned ON during the test (winds are low). Avoid going near the instrument, if possible.

It occured to me that the hysteresis of the pzt might be something I could overcome by dithering the pzt around the values that were restored when we brought the system up.

I started the dither at +/-5000, then dithered at +/-1000,  then +/-100, then +/-10, then +/-1, with 20 second sleeps between each change.

I dithered both pitch and yaw.

When the beam from the PSL was restored, the IMC REFL beam was completely on the camera, and the IMC locked (though at low value, WFS are off).

I have copied Evan's new actuation function to the h1hwinj1 directory currently used
for CW injections: ~hinj/Details/pulsar/O2test/. I used the one that corrects for the
actuation delay:  H1PCALXactuationfunction_withDelay.txt.

For reference, the uncorrected version (no "_withDelay") sits in the same directory,
along with the one we first tried last week: H1PCALXactuationfunction.txt.25may2016.
The perl script that generates the command files in.N (N=0-14) has been updated to
use "_withDelay" and the command files regenerated.

The CW injections have been killed and automatically restarted by monit. Attached 
are second trends before and after the gap showing that things look about the same,
as expected, but there is a small increase in injection amplitude (~5%).