State of H1:

• EY: vented, first contact applied
• MY: bake continues
• CS:
  • HAM6/SQZ:
    • in-chamber work at HAM6 is complete, or close to complete
    • ISCT6 is sitting on the North side of the chamber and is wired up
    • the SQZ table is on the South side of the chamber and is being commissioned
  • TCSX: the laser was turned on today
• MX: card access work continued today
• EX: Pcal baffle work
• all optics aligned, except ETMX and TMSX which are damped
• all SEI platforms that aren't locked are in damped or states above damped (robust_isolated)
• SEI config is in Large EQ NOBRSXY

Activity Detail:

• 09-03-18 15:12 Marm and Mark craning the lift over the beam tube in LVEA, under 500lbs
• 09-03-18 16:31 Fil to EY to work on access system
• 09-03-18 16:35 Mark to EY to get the snorkle lift and bring back to the CS
• 09-03-18 17:07 Mark to CER and LVEA to trace a cable
• 09-03-18 17:16 Mark is done moving the snorklelift
• 09-03-18 17:30 APS is at MX
• 09-03-18 17:37 Jim, Marer, Niko, Corey, to EX for Pcal baffle install
• 09-03-18 17:58 Ken to EY to remove equipment from the outside of the building
• 09-03-18 18:10 Ken back from EY
• 09-03-18 18:21 Matt to LVEA to look for iLigo TCS lasers
• 09-03-18 18:22 Travis and Betsy to EY for first contact
• 09-03-18 18:26 Terry to HAM6 SQZ table
• 09-03-18 18:29 Peter to TCS chillers to check hi and low setpoints
• 09-03-18 18:32 Fil is done ay EY and is now at MX
• 09-03-18 18:43 Chandra to MY
• 09-03-18 18:44 Karen to MY
• 09-03-18 18:44 Matt is back from the LVEA
• 09-03-18 18:50 Karen leaving MY
• 09-03-18 19:14 Fil done at MX now at MY
• 09-03-18 19:32 Mark done installing table over HEPI peer on North side of HAM6
• 09-03-18 19:32 Chandra to LVEA to spin up the Y beam manifold pump
• 09-03-18 19:46 Richard back from outbuildings
• 09-03-18 20:04 Ed and Jason out of PSL for lunch
• 09-03-18 20:16 Liz going to outbuildings for access control work
• 09-03-18 20:25 Pcal crew back from EX
• 09-03-18 20:37 Betsy and Travis to EY
• 09-03-18 20:38 Nutsinee to HAM6
• 09-03-18 20:48 Fil and Liz to MY
• 09-03-18 20:58 TVo and Olivia to LVEA to turn on a CO2 laser
• 09-03-18 21:14 TVo and Olivia back from LVEA, TCSY laser was turned on
• 09-03-18 21:18 JeffB to LVEA to reset Dust5
• 09-03-18 22:10 JeffB to EX to reset dust monitor
• 09-03-18 22:19 Nutsinee to HAM6
• 09-03-18 22:26 EY temperature has been giving alarms since 22:00 for high temperature
• 09-03-18 22:27 Bubba took a look and the temperature has leveled out at about 66F
• 09-03-18 22:27 EY setpoint is 65F so temperatures there should be coming down
• 09-03-18 22:56 Travis and Betsy back from EY
• 09-03-18 22:56 Fil and Liz at EY
• 09-03-18 23:03 Ed and Jason to PSL enclosure
• 09-03-18 23:07 Mark to Cosmic Ray detector in LVEA and CER
• 09-03-18 23:22 Mark done in LVEA
• 09-03-18 23:35 FIl and Liz back from EY and all other outbuildings

Today, Betsy and I embarked on the final First Contact cleaning of the new ETMy.  We started by taking a charge measurement with a handheld electrometer (although we didn't hold it in our hand, we used a mount specifically made for it mounted to the AERM side of the Quad lower structure).  Since the new AERM has a hole in the middle, we had questions about where to mount the electrometer.  We attempted to contact Calum from the end station, but ran into the usual working-at-the-end-station issues i.e. no GC WiFi to use WiFi calling from cell phones, no cell signal, and we were unable to locate TeamSpeak on the workstation.  Using the landline phone in these situations is often impractical since we are usually fully garbed in which case you are supposed to stay in cleanrooms and the phone is located on the other side of the beamtube.  After driving back to the corner station, we learned that the workstation does have TeamSpeak installed, but needed to be accessed via command line and there was no microphone/speaker anyways.  

We then measured the charge in 5 locations (center, upper right, upper left, lower right, lower left) and found that all 5 locations were ~10 volts.  We'll remeasure these after First Contact removal/TopGun blowoff.  We then sprayed/painted on the First Contact layer onto the HR surface of the ETM.  We'll let the paint dry and continue with chamber closeout activities on Monday.

I set the TCSX QPD dark offsets earlier today, but not TCSY QPDs offsets, and on both TCSX and TCSY QPD A and B sums I put an offset of 3 to keep the sum above zero, normal sums are around 10K counts.

In support of the CP4 bake-out, I've created a temporary Rate-Of-Change (ROC) medm and linked it as the last item on the VE pull-down on the SITEMAP. It is calculating the ROC for a CP3 thermocouple, which is actually located at CP4. When the 1-HOUR measurement exceeds 1.0degC/hour in either direction, the gray rectangle turns RED, indicating a cell phone alarm has been issued.

Note, ROC also calculates the LN2 consumption rate of EY-CP7-Dewar as a test channel (consumption is about 1% dewar capacity per day).

I have a script check_guardian_nodes_against_medm_screen which reports: nodes which exist but are not on MEDM screen, nodes which are on MEDM screen which do not exist. It produced one report: CS_BRS on the overview but does not exist. I have removed this node from the MEDM file.

Note: INJ_TRANS is white on the overview, Jamie is working on restarting this node.

WP7399

The process of offloading raw minute trend files from h1tw0 to the DAQ SATABOYS has been started. The first part of the procedure was to switch writing the current data to a new directory on h1tw1 and adding the directory which contains the last 6 months of data to the NDS archive_raw_minute_dirs list. This was done and both NDS were restarted at noon.

The next step is to use h1fw1 to copy of files from h1tw1's SSD RAID over to the SATABOY RAID (a fully compressed ZFS specifically built to hold archived raw minute). I started this process at 12:52 PST. Note that this transfer uses ionice to reduce this transfer's impact on the frame writing.

Posted below are plots for the PSL Chiller water usage for the past 2.5 years. 

   Water usage in the Crystal chiller appears to be constant between 300ml and 100ml per week. It should be noted water is not added every 7 days, but as it is needed and per the operator's FAMIS task. The average is one week between top offs. The water usage in the Diode chiller is not tracked as it's reservoir is much larger and only needs occasional attention. 

Service timeline of the two chiller:    

   The chiller known as Gromit (S/N Crystal 64150, Diode 63793)was in service from May 2015 until May 2016. It was put into backup for annual maintenance rotation.  

   The chiller known as Wallace (S/N Crystal 44801, Diode 44807) was in service from May 2016 until September 2016. It was put into backup for service due to Crystal chiller trips. The faulty Crystal chiller controller was replace. 

   The Chiller known as Gromit was in service from September 2016 until February 2018. It was put into backup for annual maintenance rotation. 

   The Chiller known as Wallace is in service as of February 2018.  
    

The CP4 enclosure temperature ramp is slowing down and the heater has been running at 100% for the last day. I've been increasing the temp of the GN2 flowing into CP4 so it's not a heat sink. I'm also trying to increase flow by increasing head pressure of Dewar (valve is wide open).

Here is another snapshot of Y-arm pressures over five days. We don't see a response in Y2 from changes in CP4 temperature, but Y1 side trends closely with CP4. GV11 (nearer to mid-station) has an outer o-ring leak in gate, but we evacuated this annulus and valved out. GV12 (Y2 boundary valve) has both inner and outer o-ring leaks on gate - also evacuated and valved out.

When BSC6 was replaced with spool at mid-Y several years ago, GV11 was exposed to air and the spool was not baked after installation (was it baked at factory?), so we expect outgassing from these components during the CP4 bake, but the sharp cuffs in Y1 pressure are not what we would predict with temperature changes in steel.

CP4 air temp trend over five days in enclosure is also attached.

Kyle and I replaced a bad solenoid valve on the compressed air drying tower skid outside after getting alarms 'after hours'. Loss of compressed air caused the safety valves on the three turbo stations to close and thus spin down turbos. It also caused GV 6,8 to sag. After we regained compressed air we spun turbos back up, but YBM turbo is being difficult and keeps shutting itself down due to vibration (a known issue). We tried all the tricks with bypass valve and air admittance to load rotors. We'll let it spin 100% down tonight and try again tomorrow. I closed all three turbo isolation gate valves in a timely manner so the corner should not have been affected from back streaming. Pressure rose for a period while turbos were valved out. I didn't have time to check on in-vacuum high voltage equipment - don't think anything was turned on.

FYI: we did not replace the solenoid portion of the valve at the drying tower.

The guardian upgrade has been completely aborted, due to the unexplained segfaults described in elog thread 40765 .  The entire guardian system is back to the exact same configuration as it was two weeks ago (guardian 1.0.3, h1guardian0 ubuntu12).  All nodes are up and running nominally.

h1guardian1 has been left in place to run demon excision tests: 20 fake guardian nodes are running under valgrind in the hope of catching a crash that would point to the problem.  These tests should not affect interferometer operation in any way.

After ~3 days of ground loop hunting, fixing, breaking, fixing as well as a relocking of the ISI, we finally are getting good results on the 18 DOF transfer functions for all 3 suspended chains in BSC10 (ETMY main, ETMY reaction, and TMS).

Attached are results of the TMS.  Peaks from today overlap peaks from previous closeout sessions.

Kissel has cast an eye on these and calls them good.

Will post the ETM set shortly.

Next up:  First contact and electrometer optic readings, chamber clean-out, then closeup!

After a lot of experimentation, I have found a way to improve the attenuation of frequencies below 9 Hz in the calibration by 1-2 orders of magnitude, without significantly increasing the computational cost or latency of the pipeline. Here is a list of what I've changed and what I've kept the same:

• In the actuation path, before the actuation filter, I have added a separate high-pass filter using Matlab's firls() function (documentation). firls() designs a linear-phase FIR filter that minimizes the weighted integrated squared error between the desired frequency response in specified intervals and the approximated response of the filter. The filter I've found most effective is designed to have a frequency response of 1 from 9 Hz to the Nyquist rate, and 0 from DC to 8 Hz.  I found improvement when I weighted the stop band more heavily by a factor of 100.  This filter was 2 seconds in length for the tests that I ran.
• I shortened the actuation filter itself from 6 seconds to 4 seconds. (The main reason we needed such a long filter before was to prevent spectral leakage, which is now taken care of by the previous high-pass filter.) It still contains half of a Hann window to the fourth power to roll off low frequencies, in order to further attenuate those frequencies. I found that this roll-off actually worked better than any version of least squares filter I tried in its place.
• In the inverse sensing filter, I replaced the half Hann window to the fourth power with Matlab's least squares filter using firls(). For some reason, this worked better in the inverse sensing filter than the Hann window stuff, even though it did not work better for the actuation. I designed this filter to have a frequency response of 0 from DC to 5 Hz (weighted by a factor of 100) and a frequency response of 1 from 9 Hz to the Nyquist rate. This is what seemed to produce the best results. I did not add a separate high-pass filter in the inverse sensing path, as it seemed unnecessary, and filtering at 16384 Hz gets expensive.

Of all the things I tried, this is what worked the best. Reasons I did not make this even better include:

• I haven't figured out a better way yet
• It is possible to do better with longer or more filters, but since we are doing this in the time domain with FIR filters, adding more filtering gets computationally expensive and adds latency. It is necessary to balance computational cost with quality, as we do not want the pipeline falling behind in low-latency or taking forever to produce offline data on the clusters.

Several plots are attached to show the new features. The first 5 plots are the frequency responses and comparisons to the ideal models for each of the filters used. The last 3 plots are comparisons of C01 data with data produced using the new filters. The attenuation is better by about 1-2 orders of magnitude, and there is just a very small amount of ripple added below 20 Hz.