1600 hrs. local 2.1 x 10-6 torr @ turbo inlet -> Foreline @ 3.7 x 10-3 torr NOTE: temporary pump system used for this pump-down is ~1/4 the pump speed of the nominal MTP *Venting adjacent volume today (BSC2....etc) did not communicate to gauge on HAM3, HAM3 annulus is vented*
It appears the I/O Chassis for the h1susbstst computer (in the LVEA) has died. I can not get it to power up, after disconnecting the power cord and reconnecting, turning on the power switch results in a momentary flash of LED's, then everything remains dark.
Timing went bad on IOP model running on h1sush2b computer about 10:48 PST this morning. Restarted h1susim and h1iopsush2b models to reset timing. Checked with the usual suspects, but no one claims credit for this event.
The baling crew worked on clearing a second lane from the mid-station to the end. The road to the end is passable and both mid and end nitrogen storage tanks are accessible, with turn-around space for trucks. Bubba and I checked on the status of preparations for the vinyl installer, who is due on-site tomorrow. The floor in front of BSC6 is clear and ready.
1200 hrs. local 2.4 x 10-6 torr @ turbo inlet -> Foreline @ 3.9 x 10-3 torr Y-mid is now accessible -> Mechanical gauge @ tank 8514372 indicates 68" WC of LN2 Tumbleweed crew working toward Y-end. 1225 hrs. local -> Leaving site now
1040 hrs. local 2.7 x 10-6 torr @ turbo inlet -> Foreline @ 4.1 x 10-3 torr Domestic water storage tank @ 43", raw water storage tank > 60" BT roads still not passable -> tumbleweed crew working towards Y-mid 1100 hrs. local -> Leaving site now
We have completed the removal of the two infrastructure racks in the H2 Building, with their contents now relocated in the MSR. All items went into the right side two MSR racks with the exception of:
the Qlogic switch which was moved to the DTS DAQ rack (previously the H2 DAQ rack)
the GC switch which was relocated into the DTS computer rack
the conlog machine which was relocated to the H1 DMT rack, this will become an H1 FE computer
The cdswiki machine was finally made to boot via a manual grub startup. This machine looks like it lost one of its LVM2 drives. Since it will be replaced with the new Debian box next week, we will hope it holds together until then.
The backup file server died again, we suspect a bad boot drive. It is scheduled for a reinstall on the second boot drive soon.
Work continues on the rack relocation from the H2 Building to the MSR. Today we are fixing the cdswiki problems, moving the conlog machine into the H1 DMT rack, getting all services restarted and gutting the old H2 racks. Access to the DTS is down while we reconfigure the GC network in the H2 Building.
Attached is a picture of the two new MSR racks. They are the computer racks next the the two UPS racks.
WP 3615, Dave B and Jim B
We shutdown all the servers in the H2 Building, starting at 9am today. All machines were re-racked in the MSR. The original network switches were moved along with the computers. All were connected to the Raritan Paragon KVM system.
We powered the machines on in order of importance: file and boot servers, admin servers, ifo servers, web and login servers.
All came back except for cdswiki, which appears to have a disk error. We will continue to work on this tomorrow, but for tonight there is no CDS web services: medm snapshots, web pages, work permit, cds wiki. If we cannot get cdswiki working tomorrow, we will put a temporary web server in place to serve the medm screen shots.
Staff with login account should be able to use their accounts now.
We check that the DAQ is acquiring the Vacuum controls and FMCS signals. All front ends were unaffected by this move.
All Ubuntu workstations in the control room needed a power cycle to get operational, we suspect DHCP issues.
I'll post a more detailed alog later.
1300 hrs. local 3.3 x 10-6 torr @ turbo inlet -> foreline @ 4.4 x 10-3 torr
Tumbleweed crew are working their way to Y-mid
The h1boot computer had a kernel panic Dec. 25 in the morning. Rebooted at 11:19 PST Dec. 26.
logs suggest that h1boot became unresponsive at 01:55am Christmas Morning.
HAM3 pressures as of Dec 24, 11:00 am
Cold Cathode - 5.6 e-6
Pirani - 5.6 e-3
Not a typo - both gauges read 5.6 but 3 decades apart.
Tumbleweed baling continues.
The buildings are relatively clear now. One lane has been opened to XMID, the crew expects this lane to be done to XEND at the end of today.
Wednesday they will start on the YARM - we need access for LN2 and work planned for the YEND station in early January. They expect to work
through the holidays except for Dec 25.
1345 hrs. local -> Leaving site now
Expect to be here 30 mins.
1030 hrs. local -> HAM2-HAM3 @ 1.2 x 10-1 torr -> Relatively fast rough-down (scroll pump) due to 2" hose connection to 2.5" Vent/Purge valve as opposed to pumping through deenergized turbo pump (observed ultimate pressure of this particular scroll pump is 3 x 10-3 torr). Tumbleweed crew bailing near Y-arm penetration. 1115 hrs local -> Leaving site now.
The CDS backup disk server cdsfs1 crashed late last night and would not reboot today. We could not recover its boot disk, so we reinstalled Ubuntu 10.04LTS. The backup raid contents were preserved, so no need to rsync everything from /ligo and h1boot again. We are now re-installing the backup scripts and linking the tape backup system.
cdsfs1 had become very flakey lately, hopefully the rebuild will fix this.
