recently h1fw1 has been quite unstable, restarting itself every two to four hours. During my investigation, I noticed that the raw minute trend files stopped getting updated about an hour before h1fw1 crashed, but the framed data (minute, second and full) kept being written right up to the crash. Also h1fw0 does not show this problem, or has it at a much lower rate. I extended the raw minute update rate from 5 mins to 15 mins on both h1fw0 and h1fw1 by setting in their daqdrc files:
set raw_minute_trend_saving_period=15;
The new configuration went in at 4pm Monday afternoon. As of time of writing, h1fw1 has been up for 17 hours.
The fact that the identical h1fw0 does not have the same behavior suggests a QFS issue with the SATABOY for this system.
Attached are plots of dust counts > .5 microns.
...continuing from Corey's shift: - 2:43pm: H2 DAQ restarted so HWS channels can be added to the DAQ. - 3:30pm: Dale leads tour in LVEA for visiting teachers. - 4:00pm: OSB Doors locked.
~1130 hrs. local Took RGA scan ye061812*soft-closed GV17*burped GV18 gate annulus into aux. cart*opened GV18 ~1530 hrs. local Valved-in IP11*Valved-out MTP
Report includes work from Friday, 15 June, since I did not alog that day. On Friday, brushing and first vacuum in HAM6 (The chamber formerly known as HAM5)were completed. Today, the crew worked on wipe down which took most of the day (that is much longer than it usually takes to wipe down a HAM). The chamber did not look much better after wipe down than it did when cleaning started so Bubba and I asked John to come out and have a look. The crew took some pix including a close-up that shows an "orange peel" surface that appears to retain quite a lot of the original oxide(See below). Second vacuum was completed just prior to end of shift. John asked me to let Rai and Mike Z. know what we have found so that they can weigh in.
Below is Rai's response to the reported condition of HAM6 interior. "I don't know what to make of these surfaces. It looks as though they were heated by welding and then quenched while still fluid. I don't think you can do anything about the surface but I also suspect they are not a major particle source."
(covering shift for Jeff Garcia)
Day's Activities
Jonathan is covering my last 2hrs.
A complete set of M1-M1 transfer functions had already previously been taken for MC2 (HSTS), with damping loops OFF (see LHO aLog entry 3108). Another complete set of transfer functions has now been taken, but this time with damping loops ON (n.b. using the same damping loop parameters as determined for LLO HSTS's, see LLO aLog entry 2705). Both the un-damped and damped MC2 M1-M1 transfer functions have been plotted and compared to the equivalent LLO MC2 suspension, during the same phase of testing (allhstss_2012-06-15_AllHSTS_ALL_ZOOMED_TFs.pdf). Plot Key:- Blue trace = Model Orange trace = MC2 Phase 1b at LLO test-stand with damping loops OFF Black trace = MC2 Phase 1b at LHO test-stand with damping loops OFF Pink trace = MC2 Phase 1b at LHO test-stand with damping loops ON Power spectra have been taken with damping loops both ON and OFF for each stage (2012-06-15_2000_X1SUSMC2_M*_ALL_Spectra.pdf ). Power spectra data, with both damping ON and OFF have been taken, which compare all phases of MC2 measurements (allhstss_2012-06-16_ALL_Spectra_Don.pdf and allhstss_2012-06-16_ALL_Spectra_Doff.pdf). In addition, power spectra for specific degrees of freedom (L, P and Y) can be more conveniently compared across multiple stages (M1, M2 and M3) of the same suspension in the final plots found below (allhstss_2012-06-16_X1SUSMC2_M1M2M3_Spectra_ALL_Don.pdf). Finally, all data, plots and scripts have been committed to the SUS svn as of this entry. This should now be sufficient to complete Phase 1b testing of the MC2 suspension.
I came over to address the FSS issues and found that the laser had shut down at around noon (I would have hoped that the operator would notify me, but maybe he/she didn't notice it). Seems that the NPRO tripped (again!). Got the laser back on line, then started working on the FSS. It appears that something is not right with the database. 0.1 unit changes on the FSS Common gain result in 4 dB gain changes - way too much. I went back to two delay units (left and right) in series to get the loop locking (24 nsec on the left unit and 14 nsec on the right unit). With gains at 0.8/0.3 (Common/Fast) the UGF is near 350 kHz with about 50 deg of phase margin. Auto lock is working with threshold set at 0.2. I will let it run over the weekend and investigate further next week.
Replaced R111 on all four channels from 10K to 100K to fix issues with the signal input selection monitor bits for the PUM. Serial number of unit S1102653.
The ALS PLL now locks stably for several minutes by using a modified version of the servo filter. The bandwidth is about 12.5 kHz and the phase at the UGF is 127 degrees. Earlier the loop was stable with only a very small gain of the common mode servo board (-47dB). Because of that, the PLL range was insufficient and the lock would brake after few seconds. To better redistribute the gain, Keita made a small filter with gain of 1 at DC, a pole a 4Hz and a zero a 4kHz inside of a small Pomona box (see attached schematic). This provides a gain of -40dB above 4kHz and so it relieves the attenuation by the common mode board. Today we connected this filter between the output of the phase-frequency discriminator and the input of the common mode board. After a bit of tinkering with the common mode board gains and switches, Keita found a stable set of parameters. Input 1: ENABLED Input 1 Polarity: ENABLED Com. Comp: ENABLED COM. EXC.: ENABLED Fast: ENABLED Gain IN1: 0 Gain Fast: -6 The lock now breaks only when the laser temperature drifts out of the PZT range (+/- 15V). The slow control will have to make up for that. Work is in progress.
Looked at cabling for ISC at End Y. Found following DB37 cables without Pin 19 connected, or connected to cable shield. Modified cables with pin 19 connected on both ends (not to sheild), and shield connected to the backshell on the female side. H2:ISC-BSC6-20 H2:ISC-BSC6-21 H2:ISC-BSC6-39 H2:ISC-BSC6-40 H2:ISC-BSC6-76 H2:ISC-BSC6-77 H2:ISC-BSC6-78 H2:ISC-BSC6-79 H2:ISC-BSC6-80 Filiberto Clara
The following is a list of work of which I was notified, in no particular order.
Y-End
- Reboot of computers to fix timing error, Jim B.
- Cable work, Filiberto and Rodney
- Viewport location, Cheryl V.
- Many other visitors, but no information about their work
Corner Station
- HAM03 work, Corey and crew, see Corey's entry
Doors locked at 4:20 PM.
HAM6 was placed into a shipping container around January 27th, Corey's alog, and purged with a Nitrogen boil-off from a dewar. To the best of my knowledge it has not been purged since that time. To determine what the humidity levels inside the container were like, a super elaborate no expenses spared contraption was developed to capture the exhaust from the container during the purge (photos attached). Data logging using a testo 645 dew point probe was started as soon as the purge began and ran for about 19 hours (graph attached). Direct LN2 boil-off read at -48.5 td°C, 9.2 °C; while ambient LVEA readings were at 4.4 td°C, 20.1 °C. Purge rate is ~10 L/m with ~5,442 L of empty volume inside the container.
Future data from purges will be stored on the DCC here. T1000714.
Over the weekend (6-15 to 6-18) purge of the HAM6 shipping container.
Attached is a handy Moisture Conversion Table by request of John Worden.
(caleb aka "counterweight", corey, ed, mark, randy, stephany)
With the ISI Installation Fixture installed at HAM3 & Lifting Connectors mounted on the HAM-ISI yesterday, today's installation activities started at ~8am. Yesterday's work and today's were conducted under the expert instruction of Mr. Radkins' updated & redlined ISI Installation Procedure (LIGO-E080012-A-D v3); Hugh added specific notes to procedure from lessons learned from the HAM2 Installation last week.
The Apollo crew craned the ISI with the West crane close to HAM3 (this was done with the pair of 2-legged slings connected to the crane---we didn't want to use the long Installation chain because we wanted clearance to hoist the ISI over BSC chambers).
From here, all went according to procedure. ISI landed on Cart, to hand off ISI to other crane; ISI attached to Installation fixture; ISI rolled into HAM3. I wish I took photos of clearances for this move, but we moved too fast and efficiently---main thing: careful alignment of A-Frames made it easy to slide the ISI into place. Did not need to move cleanroom for any of this work.
It should be noted that the ISI did not hang completely level. One could see with a bubble level that we were slightly off. This was even more important when the ISI was lowered on to the HAM3 Support Tubes. For this landing, the SW corner touched down first, and the west side touched down first with the east side high by about 1". So, it did take some jiggling and vertical cycles to finally start threading all the bolts. (we also had Caleb put on some In-Chamber boots and stand on our high side of the ISI to help make it level and ease threading the eastern bolts.
Similarly, to HAM2, it was observed that a couple of bolts appeared to have issues with their thread (they'd get bolted down, and when a torque was applied, the bolts just spun in their holes without getting tight). Ultimately, we replaced the bolts, and the fresh bolts did the trick. (We went ahead and installed/torqued a new bolt in the missing SW bolt for HAM2 with no problem.)
On the east side, we were not able to install a southeast bolt--it was blocked by a Shipping Bracket. On the west side, we were not able to install one of the 5" bolts which was below a Vertical Actuator (this bolt also not installed on HAM2). Other than that, all bolts were torqued down (just need to remember to install that bolt on the east side.)
Here is a link to all photos taken for HAM3 Installation work, here.
Install time: 8 - 11:30am
THREE more to go!
An IRIG-B timing error occurred at about 22:15 UTC June 14, 2012 on all of the front end computers at the Y end station. This went unnoticed until this morning. I have corrected the problem by restarting the models on the following computers: h2pemey h2susauxb6 h2tcsey h2pemeyaux Note that the remaining two computers, h2susb6 and h2seib6 were restarted late yesterday afternoon to correct what appeared to be a RFM error, so the IRIG-B time was reset then. Models affected: h2pemey h2iscey h2susauxb6 h2tcsetmy h2pemeyaux and the IOP models for the computers. Work completed at 17:45 UTC June 15.
Matt Evans noticed that I had screwed up the time between the start of the BSC8 curve and the initial pump down it is 5.9 days. This makes the BSC8 curve the same as the initial LIGO pumpdowns. It still leaves us with the problem of what to do about BSC6 with its more gradual slope and factor of a little over two higher pressure.
The figure shows a revised version of the pumpdown curves. The variation of the pressure with time for BSC 6 is still slower than 1/t. A least squares fit to the curve gives a dependence of 1/t^0.865 which as indicated before implies some diffusion of water from inside of materials, the phenomena is not just desorption from the surface. The plastic in the cables or the viton could be the source. The pumpdown curve for BSC8 is the first formal continuous pumping of this chamber which occured about 20 days after the initial roughing. John Worden made a time line graph of the various conditions of BSC8 in a prior entry. If you are interested in understanding the reasoning for the curve plotted here look at John's time line. In the initial pumping of this chamber a broken feedthru was discovered and replaced. The chamber was being pumped or living in dry backfill gas for those twenty days. For water outgassing from the surface it should not make a great deal of difference whether the water is removed by a purge gas or by evaporating into a vacuum. Clearly a vacuum is better as there is less repopulation of the surface, but the purge works too with some higher probability of repopulating depending on the remaining humidity in the gas. The conclusion I draw from this is that the BSC6 is not so anomolous and that we will need to take steps to reduce the water in the ISI for the next installations using techniques such as continuous dry purges in bags around the ISI with the ability to gain entry for adjustments etc. If we want now to speed up the time to a pressure of 10^-7 torr it would take a low temperature bake, say to 50C. The danger to the instrument associated with such a bake and schemes for carrying it out are being studied at the moment.
In between assembly and final testing the ISIs have been in a Nitrogen purged environment. We attempted to ascertain what the conditions were like inside of a shipping container that had been sealed and Nitrogen boil-off purged on January 27th. Here are the results from that: 6-14-12 HAM6 purge. All of the ISIs are stored in similar conditions. The only differences being whether they are stored in shipping containers or storage containers.
I verified the location of viewports on the A-17B adaptor, and compared those positions to the stated plan in T1000746-v5, and found that the most likely viewport position (VP5) to use for the video camera, has a blank on it. See attached file.
Lisa Austin confirmed today that, at EY on the A-17B Adaptor, VP5 should be a video viewport, but is currently a blank, and VP10 should be a blank, but is currently a viewport.
Forgot to mention that the reason this instability has just appeared is that the H1 DAQ system was recently expanded from just the PSL to include all SUS and SEI systems for HAMS 1,2,3. The number of channels in the DAQ is now 42k, making it comparable with the H2 DAQ.
This begs another question, why isn't H2 DAQ, with a 5 minute raw min trend rate, not seeing this problem?