I deenergized IP7 and removed the HV connectors from the pump and disconnected the ground cable. This pump is going to be removed soon to facilitate the 2K output mode cleaner tube removal/replacement.
Locations 1, 3, 5 and 8 got stuck holding. Dani restarted them for me at ~10:08 am.
On Friday, we finished up rebuilding the Solid Stack with modified parts which allow for more head-room while working. We helicoiled, and fit the Upper Structure with Top Masses, Top wires, and the necessary Table cloth walls. Joe O'Dell (RAL in the UK), Travis, and I continued working on the QUAD3 build today (Sun). Joe loaded the Upper Structure onto the Solid Stack while we re-made a few sets of wire assemblies. Joe also reset the UIM blade tips to the new heights of 15mm (nominal was 12mm). We are working towards making a few measurements of lateral blade tip deflection while Joe is here, so we are currently building the QUAD with the following configuration. The Reaction Chain will likely need to be refit to match the Main Chain after measurements are analyzed. The Main Chain matches LLO's Q13 Build, and what they are working towards on Q14. MAIN CHAIN Top Mass Weight = 22kg UIM Weight = 22 kg Top Mass Blade Tip Heights = 9.7mm shims (nominal was 6.7mm) UIM Blade Tip Heights = 15 mm (nominal was 12mm) Middle Wire Length = 2.7mm shorter than nominal Bottom Wire Length = 3mm shorter than nominal REACTION CHAIN Top Mass Weight = 22kg UIM Weight = 22 kg Top Mass Blade Tip Heights = nominal at 6.7mm) UIM Blade Tip Heights = nominal at 12mm Middle Wire Length = nominal per D060516 Bottom Wire Length = nominal per D060516
I became aware (in the middle of the night) of a voice message left by Cyrus R. on my work cell phone informing me of a reboot and burt restore of the Y-mid VE computers that had occured earlier in the evening. At 1030 this morning I logged in (remotely) to view the Vacuum Site Overview (as I routinely do on non-work days) and noticed that CP3 and CP4 were "in the red" and indicating 40% full levels. I immediately came to the site and corrected the problem which was due to the lack of enabling the instrument air to the liquid level control valves (LLCV) -> Following a reboot, manual enabling of this is required from the "Fill Control" portion of the HOVE_MY.adl screen. The PID outputs of the CDS system have no effect on the LLCVs, and thus can't control the 80K pump levels, if the electropneumatic LLCV valves don't have instrument air available, i.e., enabled. I am not sure why the default following a reboot is for the instrument air to the LLCVs be disabled. If this is the result of concern of overpressuring the 80K pumps(?) then we should revisit this reasoning. NOTE: Cyrus had left me the voice message shortly after rebooting and burt restoring on Friday evening-Good! I did not recieve any alarms via text message during the entire period-Bad! Had I not routinely logged in this morning, it is entirely possible that CP3 and CP4 would have got "warm" over this 3 day weekend (boil-off rate ~2.5%/hour). Had this happened 13 years of adsorbed water and "gunk" would have be release into the beam tubes and all of us would be looking for new employment opportunities!!!! No crisis is more important than preventing the site 80K pumps from getting too low (except maybe shattering a viewport, hmmm)
I came in the control room around 5PM to find that all the channels for h0vemy were invalid, and the vacuum alarm handler was complaining loudly. Telnetting in produced a long list of dead task and memory errors, so I rebooted it. Had to run the startup scripts by hand (probably startup.cmd -> startup.h0vemy change). Burtrestored it to midnight, and refreshed the CP PID values with the help of Richard. It appears to be working OK now, but should probably be checked up on now and again over the weekend.
~9:00 – work begins on chipping away under HAM 12 ~11:00 Cheryl turned on TCS chiller pumps ~15:40 – Robert out to Y-End work under HAM 12 was finished by sometime before 3pm.
Just a heads up the H1 TCS chiller are running again, so temperatures should all be green on overview. Posted in other elog as well.
Rodney, Zack, Michael R.
We layed out the floor plan for the H2 PSL laser room and ante-room. We couldn't mark the airshower because the PSL table is in the way, but that doesn't matter since we aren't replacing linoleum in the airshower. Area was vacuumed and mopped to clean up chalk lines used for marking.
White tape indicates the footprint of these rooms, along the outside walls. We will eventually replace the linoleum inside the taped region.
Yesterday Robert and I found that the pump in the mechanical room that pulls air for the dust monitors that have their internal pump removed was not pulling air. Today I read the flow on the attached flow meter as .15. This means that the data from locations 1 (ISCT4), 7 (H2 racks) and 10 (H1 PSL) has been invalid for an unknown period of time. Also possibly location 8 (H1 racks), which had been replaced with one with an internal pump earlier. So today I went and replaced locations 1, 7 and 10 with ones that have an internal pump. Note also that dust monitor 3 was moved yesterday into a clean room next to where the jack hammering is taking place. Also for a period yesterday, location 4 was moved onto the floor by the H1 PSL, but has been moved to location 8 today. Locations of LVEA dust monitors: 1 ISCT4 3 Clean Room over BSC4 5 Beer garden 6 Diode room 7 previous location of H2 racks 8 H1 racks 10 H1 PSL
3 moved into clean room over HAM 12 4 added outside clean room over HAM 12 9 added at H2 PSL area
Highlights: - Michael Rodruck boots h1psl OPC, shouldn't affect anything, just a backup system. - Jackhammer work at HAM11 to free the chamber from the floor. Much dust was kicked up by the process as sensed by the dust monitors in the LVEA. The West Emergency Egress Door is remaining open as a hose passes from the outside to the hammering area. Operators: ignore related alarms. - Keita Kawabe, Conor Mow-Lowry turn PSL on, links laser by fiber to the squeezer by HAM6. LVEA is laser hazard during this procedure. - One load of elementary school kids visited the Control Room. - Oscar finished baling tumbleweeds at ~3pm, usual time. - No deliveries, to my knowledge. - Hanford Fire Department was on site.
Corrected problems with the bscteststand and suswork1 workstation: On suswork1 - re-cached the shared library paths, some were missing sync'ed the time with bscteststand, restarted the ntp daemon. On bscteststand - ran the script startqts to restart the front-end processes since they were not behaving properly. Tested using diaggui and the BS-FM/yyyy-mm-dd-hhmm-BS-xTF.xml input file, test ran to completion.
Nothing exciting today
Did not resume pumping X-end following yesterday's power outage. Leaving X-end as rough vacuum until IP controller can be upgraded.
Restarted fmcs epics channels. There was a problem with the controls account missing the path to the caRepeater. It is unknown why it would have changed after the power outage. Dale gave a tour Surveying continued for HEPI Oscar was bailing tumbleweeds Construction of shelving continued in the EE lab Michael R. capped the conduit holes from the H2 PSL A truck went through the gate, but did not contact the control room. It may have been here to pick up the recycling.
I noticed metal shavings around the HAM6 clean room legs, possibly due to work on the motorized raising and lowering of the legs. Does anyone know the source of this?
Started workstation attached to seiteststand, applied updates. suswork1 attached to bscteststand was already running. Checked seiteststand and bscteststand, the iMacs attached to them were running properly, both time machine usb drives are still attached with over 50% capacity still available, and time machine is doing regular backups.
Times in PST: 0950 - Power is out. Started later than scheduled because Benton PUD received a delivery later than scheduled. 1005 - Power is back, no internet 1007 - Starting workstations in the control room. control0 is trying to connect to granite, even though we wanted it to do otherwise. control3 should have been on UPS, but the old Sun machine was on the UPS instead. 1015 - Email/Phones back 1024 - Wrote a frame level 1645 yesterday -> 1024 today: data lost 1047 - Richard fixes access system on ISCT1 and ISCT3 1108 - h1susepics starting 1302 - Diamond Freight arrives 1450 - Oscar done baling tumbleweeds CDS Summary: All H1 systems are back except for AWG and FMCS. FMCS is being worked on right now. AWG is not responding well. Dani and Richard investigated the access system including reproducing the door-bouncing at the LVEA entrance. Notice to all: Unless there is an emergency, do not exit the LVEA by pulling the door open before the system has read your card. We recommend that you just pull on the big handle above the door handle. If your card has not been read the door will not open, which will give you a chance to retrace your steps, saving us all from time-expensive door alarm investigations.
Following the restoration of site power at about 10am, we brought all CDS systems back online.
iLIGO: all the h1 front end systems were restarted in prep for the squeezing experiment. The systems we were not able to restore are h1awg0 (irig-b timing problem) and FMCS (comms error with the web server).
aLIGO: all the aligo systems in the MSR, control room and Computer Users Room were brought back. We took this opportunity to create a power recovery document in the daq wiki and are updating the reboot/restart procedures.
Tomorrow we will scan the site for CDS machines which were missed today.
The BS has different lever arms for the sensors, and we are going to dial these into the R0 and L2 screens of the quad. The last quad settings are at /data/autoburt/2011/02/09/17:01/l1qtsepics2011020917:01.snap
