I became aware (in the middle of the night) of a voice message left by Cyrus R. on my work cell phone informing me of a reboot and burt restore of the Y-mid VE computers that had occured earlier in the evening.  At 1030 this morning I logged in (remotely) to view the Vacuum Site Overview (as I routinely do on non-work days) and noticed that CP3 and CP4 were "in the red" and indicating 40% full levels.  I immediately came to the site and corrected the problem which was due to the lack of enabling the instrument air to the liquid level control valves (LLCV) -> Following a reboot, manual enabling of this is required from the "Fill Control" portion of the HOVE_MY.adl screen.  The PID outputs of the CDS system have no effect on the LLCVs, and thus can't control the 80K pump levels, if the electropneumatic LLCV valves don't have instrument air available, i.e., enabled.  

I am not sure why the default following a reboot is for the instrument air to the LLCVs be disabled.  If this is the result of concern of overpressuring the 80K pumps(?) then we should revisit this reasoning.  

NOTE:  Cyrus had left me the voice message shortly after rebooting and burt restoring on Friday evening-Good!  I did not recieve any alarms via text message during the entire period-Bad!  Had I not routinely logged in this morning, it is entirely possible that CP3 and CP4 would have got "warm" over this 3 day weekend (boil-off rate ~2.5%/hour).  Had this happened 13 years of adsorbed water and "gunk" would have be release into the beam tubes and all of us would be looking for new employment opportunities!!!!  

No crisis is more important than preventing the site 80K pumps from getting too low (except maybe shattering a viewport, hmmm)

I came in the control room around 5PM to find that all the channels for h0vemy were invalid, and the vacuum alarm handler was complaining loudly.  Telnetting in produced a long list of dead task and memory errors, so I rebooted it.  Had to run the startup scripts by hand (probably startup.cmd -> startup.h0vemy change).  Burtrestored it to midnight, and refreshed the CP PID values with the help of Richard.  It appears to be working OK now, but should probably be checked up on now and again over the weekend.

~9:00 – work begins on chipping away under HAM 12
~11:00 Cheryl turned on TCS chiller pumps
~15:40 – Robert out to Y-End

work under HAM 12 was finished by sometime before 3pm. 

Just a heads up the H1 TCS chiller are running again, so temperatures should all be green on overview.  Posted in other elog as well.

Rodney, Zack, Michael R.

We layed out the floor plan for the H2 PSL laser room and ante-room. We couldn't mark the airshower because the PSL table is in the way, but that doesn't matter since we aren't replacing linoleum in the airshower. Area was vacuumed and mopped to clean up chalk lines used for marking.

White tape indicates the footprint of these rooms, along the outside walls. We will eventually replace the linoleum inside the taped region.

Work continues on removing the grout underneath HAM11.
The PSL is running on but locked up with padlocks and bars. The squeezers may have found the source of a problem with one of the installed fibers.
ADCUSUS was brought back to working status this morning.

Yesterday Robert and I found that the pump in the mechanical room that pulls air for the dust monitors that have their internal pump removed was not pulling air. Today I read the flow on the attached flow meter as .15. This means that the data from locations 1 (ISCT4), 7 (H2 racks) and 10 (H1 PSL) has been invalid for an unknown period of time. Also possibly location 8 (H1 racks), which had been replaced with one with an internal pump earlier. So today I went and replaced locations 1, 7 and 10 with ones that have an internal pump. Note also that dust monitor 3 was moved yesterday into a clean room next to where the jack hammering is taking place. Also for a period yesterday, location 4 was moved onto the floor by the H1 PSL, but has been moved to location 8 today.

Locations of LVEA dust monitors:
1 ISCT4
3 Clean Room over BSC4
5 Beer garden
6 Diode room
7 previous location of H2 racks
8 H1 racks
10 H1 PSL

Highlights:
- Michael Rodruck boots h1psl OPC, shouldn't affect anything, just a backup system.
- Jackhammer work at HAM11 to free the chamber from the floor.  Much dust was kicked up by the process as sensed by the dust monitors in the LVEA.  The West Emergency Egress Door is remaining open as a hose passes from the outside to the hammering area.  Operators: ignore related alarms.
- Keita Kawabe, Conor Mow-Lowry turn PSL on, links laser by fiber to the squeezer by HAM6.  LVEA is laser hazard during this procedure.
- One load of elementary school kids visited the Control Room.
- Oscar finished baling tumbleweeds at ~3pm, usual time.
- No deliveries, to my knowledge.
- Hanford Fire Department was on site.

Corrected problems with the bscteststand and suswork1 workstation:

On suswork1 - 
  re-cached the shared library paths, some were missing
  sync'ed the time with bscteststand, restarted the ntp daemon.

On bscteststand -
  ran the script startqts to restart the front-end processes since they were not behaving properly.

Tested using diaggui and the BS-FM/yyyy-mm-dd-hhmm-BS-xTF.xml input file, test ran to completion.

Nothing exciting today

• FFEPI was running, (numbers were flashing on overview screen but output to piezos was disabled), couldn't find an entry about this so I ramped it down
• Tumbleweed baling

Did not resume pumping X-end following yesterday's power outage.  Leaving X-end as rough vacuum until IP controller can be upgraded.

Restarted fmcs epics channels. There was a problem with the controls account missing the path to the caRepeater. It is unknown why it would have changed after the power outage.

Dale gave a tour

Surveying continued for HEPI

Oscar was bailing tumbleweeds

Construction of shelving continued in the EE lab

Michael R. capped the conduit holes from the H2 PSL

A truck went through the gate, but did not contact the control room. It may have been here to pick up the recycling.

I noticed metal shavings around the HAM6 clean room legs, possibly due to work on the motorized raising and lowering of the legs. Does anyone know the source of this?

Started workstation attached to seiteststand, applied updates.

suswork1 attached to bscteststand was already running.

Checked seiteststand and bscteststand, the iMacs attached to them were running properly, both time machine usb drives are still attached with over 50% capacity still available, and time machine is doing regular backups.

Times in PST:
0950 - Power is out.  Started later than scheduled because Benton PUD received a delivery later than scheduled.
1005 - Power is back, no internet
1007 - Starting workstations in the control room.  control0 is trying to connect to granite, even though we wanted it to do otherwise.  control3 should have been on UPS, but the old Sun machine was on the UPS instead.  
1015 - Email/Phones back
1024 - Wrote a frame level
1645 yesterday -> 1024 today: data lost
1047 - Richard fixes access system on ISCT1 and ISCT3
1108 - h1susepics starting
1302 - Diamond Freight arrives
1450 - Oscar done baling tumbleweeds

CDS Summary: All H1 systems are back except for AWG and FMCS.  FMCS is being worked on right now.  AWG is not responding well.

Dani and Richard investigated the access system including reproducing the door-bouncing at the LVEA entrance.

Notice to all: Unless there is an emergency, do not exit the LVEA by pulling the door open before the system has read your card.  We recommend that you just pull on the big handle above the door handle.  If your card has not been read the door will not open, which will give you a chance to retrace your steps, saving us all from time-expensive door alarm investigations.

Following the restoration of site power at about 10am, we brought all CDS systems back online.

iLIGO: all the h1 front end systems were restarted in prep for the squeezing experiment. The systems we were not able to restore are h1awg0 (irig-b timing problem) and FMCS (comms error with the web server).

aLIGO: all the aligo systems in the MSR, control room and Computer Users Room were brought back. We took this opportunity to create a power recovery document in the daq wiki and are updating the reboot/restart procedures.

Tomorrow we will scan the site for CDS machines which were missed today.

The BS has different lever arms for the sensors, and we are going to dial these into the R0 and L2 screens of the quad. The last quad settings are at 

/data/autoburt/2011/02/09/17:01/l1qtsepics2011020917:01.snap

On Tuesday, Mark found that he could not actuate on the BS so after some verification that the coils looked good at the pseudo vacuum feed through on the mechanical stand, we called in the big guns.
Yesterday, Richard and Filiberto powered off bscteststand computer, blue IO chassis, powered on, started some code, rebooted, started the proper code code.  Stuff works now.  We're not entirely sure what fixed it, but putting an offset in the Test filter modules clearly pegs the coil dials now.

0950 - Power is out
1005 - Power is back, no internet

1007 - Starting workstations in the control room.  control0 is trying to connect to granite, even though we wanted it to do otherwise.  control3 should have been on UPS, but the old Sun machine was on the UPS instead.  

1015 - Email/Phones back

Liveblogging...