Site recovering from power spike during the weekend (storm related)

Sprague spraying along x-arm

0900 Christina and Peter re-starting PSL

930 Betsy working on BSC3

0930 Dave restarting all frontends.

1120 Pablo working in H2 enclosure

1400 Hugh working on Ham 6 HEPI

1430 Thomas and Greg doing Ring Heater install in LVEA

1500 RickS and Christina working on PSL

We started assembly of the work platform around BSC 3. With approval from Richard and Filiberto, we repositioned a rack that was located between BSC 2 & 3 containing SUS stuff and was impeding leg placement for the work platform.
We also assisted Cheryl and Cory with moving the cube for the TMS from the lab to the VEA at E X.
Tyler worked in the machine shop on parts for Betsy.

All the front end systems did indeed get rebooted yesterday at 18:20, only h1seib2 did not startup correctly. I noticed that the Dolphin IPC was not working in the MSR. I power cycled all Dolphin connected front ends plus the two Dolphin switches in the MSR. This resolved the IPC issues.

There does not appear to be a similar problem at EX. The LVEA test stand are showing problems, but we will be rebooting them soon as part of the RCG upgrade and no systems are being controlled by these systems at the moment.

The LDAS SATABOY disk RAID system came back online. I restarted h1fw0, it is writing frames again. The data gap for the h1fw0 system is:

Aug 25 18:24 - Aug 26 10:22

Reminder, h1fw1 ran throughout this event and lost no data. Jim made h1nds1 the default NDS.

Looking over the Pump Station ops I found EndX was not running; the other pump stations were fine.  The servo was on but output was maxed and pressure zero.  No response to remote manipulation.  Found VFD in OU3 fault and needing reset.  Restarted to normal running w/o issue.  Looking at the trends however, found this actually dropped at ~noon 21 Aug.  No alogged potential causal issues found.  This "Overvoltage--Running at Constant Speed" trip has occurred here before--will investigate.

[Peter, Christina]

We restarted the laser and found out that after the power outage the current limit of the HV units was set to 0 (I recall that is a known problem). We set it to 200mA and the laser locked immediately. The PSL came back without any other issues.

I turned it off for now and will service/replace 

The default NDS server has been changed to h1nds1, effective with new shells and programs started after 9:30 AM PDT.

Greg reports LSB is without power after an electrical storm passed through the region this evening. LDAS is subsequently down for the evening.

The CDS status is:

DAQ is still running. h1fw0 has no disk system (it is located in the LSB) but h1fw1 continues to write frames to the MSR RAID. I have turned off monit on h1fw0 to stop it constantly going through  a start/crash/restart cycle. The MEDM screens could not resolve h1dc0's epics channels. I verified that daqd was running on h1dc0 (has been since 21st of this month) and that CA clients on the H!FE LAN can see this IOC. So it appears to be an EPICS gateway issue. I restarted the h1fe-cds epics gateway on h1cdsegw0 and this cleared the problem. Now only h1fw0 is blank on the DAQ medm screens, as expected.

I verified that h1fw1 is writing full, second and minute trend files.

All the front ends seem to have riden out the storm (pun intended) except for h1seib2 (seismic BSC). It reports having been rebooted at 18:19 local time, and is apparently missing timing at its IO Chassis so no models are running (ADC and DAC cards are visible, so IO Chassis is powered up). With no IOP model running, I assume the DAC outputs are stable at zero volts and it is safe to leave this in this state overnight.

All vacuum controls systems are operational, and their medm snapshots are being updated on the CDS web page.

I finished the green arm initial alignment medm screen and fixed the corresponding front end code (h1asc.mdl) to properly deal with gain ramping of the dither drives, and to include input monitors.
The front end code was recompiled and installed, but I did not restart the DAQ.

Still missing are the IPC links to the various optics.

We are at svn version 5501.

Attached are pictures of the medm screen as well as the model. Four such screens and front-end code blocks are installed: XPIT, XYAW, YPIT and YYAW.

Updated the software for the EPICS/TwinCAT gateway to the most recent version. Also, loaded the most recent SYS and PLC code.

(Cheryl, Corey, Jodi, Justin)

There were ambitious thoughts of trying to get the TMS mounted on the ISI this week, but even with tons of people, I don't think it would have happened (unless we worked into the wee hours on a lonely Friday night). 

Where we're at:  The TMS was roughly completed over a week ago.  It was then handed over to Arnaud (Mr. SUS) and he ran transfer functions to assess the mechanical functionality of this newly-assembled TMS.  Over the day/days he had it, he deemed it good to go---meaning it was good to decouple the ISC Table/Telescope Assy from the Upper Mass & move both assemblies to the ISI in the VEA on the Test Stand.

So today, with a limited crew steps were taken to get us closer to making The Big TMS Move next week.  This is how the storyline went today:

Decoupling the Table/Telescope From the Upper Intermediate Mass Assy (Corey, Justin)

With Justin at the controls of the Genie, and myself snaked into a position under the TMS, we took the load of the Table/Telescope off the Upper Mass, by lifting it with the Genie.  The wire clamps were then removed from the Table (decoupling these systems).  Some of the (8) bolts of these clamps were not easy to unscrew.  The first pair were the toughest.  Thoughts of galled bolts went through my cautious head, but we eventually got the first pair out (maybe that clamp slipped a bit when the assy was suspended and wedged the screws a little).  Either way, the other (6) bolts came out fine.  We then removed the Telescope, installed  the Tooling Feet on the Telescope and laid the whole assembly on the low Optics Table. 

Oh, it should be noted that we also decoupled the Vertical Safety Wire clamp from the Telescope; strung cables up higher and out of the way of the bottom of the Upper Mass, and removed the TMS Cables from the Table.

This all took roughly 2hrs.

Initial Round of TMS Cleaning

Jodi set me up with tools for cleaning:  pre-soaked Alpha wipes, & vacuum.  (we had de-ionizing gun, but I didn't get to that today)

With the Table/Telescope Assy removed, the first thing I inspected/cleaned was the bottom of the Upper Mass--this is because it won't be accessible when the Upper Mass is removed and on the "Transportation Cube".  We don't want to clean the whole thing while it's clamped to the Bosch Frame because we don't want to have to deal with shedding from loosening the dog clamps next week. 

We'll want to remove the Safety Support Beams next week--firstly because some errant screws were installed on this assembly, and secondly because it would be nice to put the lid on the SUS Transportation Cube when we move this guy---it'll keep the Upper Mass sealed & clean. 

I then moved to the Table/Telescope and cleaned them.  This was tough cuz I had to be careful not to bump any optic alignment and I also didn't want to contact any optic glass surfaces.  In other words, I basically focused on vacuuming the metal flat surfaces which were accessible.  I first cleaned the Table in sections.  I did this keeping all the optics covered with huge Alpha wipe blankets as much as possible as I went.  When I was done with the Table, I moved to the Telescope below.  Not much to do here.  I did notice particulates on the mirrors.  I removed some by carefully placing vacuum nozzle tip close to mirror surface.  We'll want to use the de-ionizing gun on these guys later.

Overall, just this cleaning took 3hrs.  And this couldn't really have been done in parallel (unless we had another vacuum).  And we still have cleaning to do (i.e. blowing off optics with deionizing gun).

TMS Protective Cover Installed

I assume this is to prevent bumping optics on the Table?  Either way, all optics were covered with Alpha Wipes.  Then I installed this Protective Cover on top of the Table.  Would be nice to have a Tyvec cover for this guy when it is moved.  A BSC Door is too small.  So maybe a HAM door or BSC Dome Flat?

On Monday's/Next Week's Menu

• I have the alignment template and we can install this on the ISI (this is a trivial/quick task).
• Find the 5-axis table and Transportation cube for the Upper Mass, and then move the Upper Mass from the TMS Lab to the ISI (but also remember to clean the upper part of it at some point).
• Move the Table/Telescope & attach to the Upper Mass on the Test Stand (this requires moving the whole thing inside a cleanroom (!) from the TMS Lab to the Test Stand. 
• Fun, fun, fun.

I left the HEPI ISI controlled for performance measuurements over the weekend.

For future reference, open light values have been taken for ITMX currently at the test stand (QUADTST on medm)

M0F1 22745      1.319 -11372
M0F2 25209      1.190 -12604
M0F3 25497      1.177 -12748
M0LF 25276      1.187 -12638
M0RT 24820      1.209 -12410
M0SD 23964      1.252 -11982
R0F1 25057      1.197 -12529
R0F2 30488      0.984 -15244
R0F3 29015      1.034 -14507
R0LF 29178      1.028 -14589
R0RT 27580      1.088 -13790
R0SD 27366      1.096 -13683

The position of V4 held for a couple hours so I deemed the use of the Springs as explained below ok.  Also, no one in SEI land objected to this.  I then got the V3 Actuator attached.  This did go much smoother than V4.  So two down six to go.

Today we finished disassembly of the work platform @ end y and transported to hi bay and after wipedown, transported into LVEA. Took measuremeants to verify placement of work platform and clean room. Will begin assembly Monday.
Tyler completed the modifications of the baffles for Thomas V and got them off to C&B.
Rick S and myself went to E Y to verify the breadboard placement on the leaner pier. We clamped the breadboard/jig in place and will possibly weld on Monday.

Sprague came on site near noon to fog the X enclosure.  Pablo worked in the H2 LVEA enclosure through ~2:00 PM.  Corey and Justin worked on transmon at X end.  Cyrus visited the outbuildings during the afternoon for CDS work.

Dust alarms:

** The monitors in the OSB bake lab and vac prep area went off regularly with 0.3um values in the low hundreds
** The beer garden monitor went off several times in the late morning and early afternoon.  Apollo and cleaning personnel were sometimes but not always visible in the vicinity.
** Near 2:00 PM the EY monitor alarmed with counts of ~60,000 (3um) and 9,000 (5um).
** The diode room alarmed three times in the early afternoon in the hundreds (3um).
** Monitor 16 near HAM6 went in and out of white all morning, alarming each time.

This morning I reattached the V4 Actuator for the fourth time biasing the Crossbeam 30mils high.  This time the beam was pulled down 45 mils.  Ah geez... While I have resisted doing this in the past, this time I decided to just pulled the beam back up with the DSCW HEPI Springs.  I do this with trepidation cause I'm not sure how this might affect the other corners.  Still, it may make sense.  The attachment of the Actuator imparts a load and why not have the Springs carry this?  OK more Actuators after the SEI Weekly meeting.

We installed a new Endevco into the PEM rack, which replaced Endevco 2. We redid the cross studies for this new Endevco using an accelerometer installed on a shaker and increasing to just before saturation.

We have also now calibrated all of the accelerometers and microphones. Their new calibrations can now be found on the PEM website.  pem.ligo.org

Emily