J. Kissel, T. Sadecki Travis and I have taken close out transfer functions of H1SUSMC1, H1SUSMC2, H1SUSMC3, H1SUSPRM, and H1SUSPR2. After some hiccups with PR2 (aLOG pending), all suspensions look great. Note, PRM TFs were accidentally taken with extra TEST P&Y misalignment gains on the excitation, which is why it appears to have errantly high response. Excellent work team!! We're ready to finish this vent!! The data templates live here: /ligo/svncommon/SusSVN/sus/trunk/HSTS/H1/ MC1/SAGM1/Data/2017-12-21_2155_H1SUSMC1_M1_WhiteNoise_L_0p01to50Hz.xml MC1/SAGM1/Data/2017-12-21_2155_H1SUSMC1_M1_WhiteNoise_P_0p01to50Hz.xml MC1/SAGM1/Data/2017-12-21_2155_H1SUSMC1_M1_WhiteNoise_R_0p01to50Hz.xml MC1/SAGM1/Data/2017-12-21_2155_H1SUSMC1_M1_WhiteNoise_T_0p01to50Hz.xml MC1/SAGM1/Data/2017-12-21_2155_H1SUSMC1_M1_WhiteNoise_V_0p01to50Hz.xml MC1/SAGM1/Data/2017-12-21_2155_H1SUSMC1_M1_WhiteNoise_Y_0p01to50Hz.xml MC2/SAGM1/Data/2017-12-21_2044_H1SUSMC2_M1_WhiteNoise_L_0p01to50Hz.xml MC2/SAGM1/Data/2017-12-21_2044_H1SUSMC2_M1_WhiteNoise_P_0p01to50Hz.xml MC2/SAGM1/Data/2017-12-21_2044_H1SUSMC2_M1_WhiteNoise_R_0p01to50Hz.xml MC2/SAGM1/Data/2017-12-21_2044_H1SUSMC2_M1_WhiteNoise_T_0p01to50Hz.xml MC2/SAGM1/Data/2017-12-21_2044_H1SUSMC2_M1_WhiteNoise_V_0p01to50Hz.xml MC2/SAGM1/Data/2017-12-21_2044_H1SUSMC2_M1_WhiteNoise_Y_0p01to50Hz.xml MC3/SAGM1/Data/2017-12-21_2155_H1SUSMC3_M1_WhiteNoise_L_0p01to50Hz.xml MC3/SAGM1/Data/2017-12-21_2155_H1SUSMC3_M1_WhiteNoise_P_0p01to50Hz.xml MC3/SAGM1/Data/2017-12-21_2155_H1SUSMC3_M1_WhiteNoise_R_0p01to50Hz.xml MC3/SAGM1/Data/2017-12-21_2155_H1SUSMC3_M1_WhiteNoise_T_0p01to50Hz.xml MC3/SAGM1/Data/2017-12-21_2155_H1SUSMC3_M1_WhiteNoise_V_0p01to50Hz.xml MC3/SAGM1/Data/2017-12-21_2155_H1SUSMC3_M1_WhiteNoise_Y_0p01to50Hz.xml PR2/SAGM1/Data/2017-12-21_2035_H1SUSPR2_M1_WhiteNoise_L_0p01to50Hz.xml PR2/SAGM1/Data/2017-12-21_2035_H1SUSPR2_M1_WhiteNoise_P_0p01to50Hz.xml PR2/SAGM1/Data/2017-12-21_2035_H1SUSPR2_M1_WhiteNoise_R_0p01to50Hz.xml PR2/SAGM1/Data/2017-12-21_2035_H1SUSPR2_M1_WhiteNoise_T_0p01to50Hz.xml PR2/SAGM1/Data/2017-12-21_2035_H1SUSPR2_M1_WhiteNoise_V_0p01to50Hz.xml PR2/SAGM1/Data/2017-12-21_2035_H1SUSPR2_M1_WhiteNoise_Y_0p01to50Hz.xml PRM/SAGM1/Data/2017-12-21_2155_H1SUSPRM_M1_WhiteNoise_L_0p01to50Hz.xml PRM/SAGM1/Data/2017-12-21_2155_H1SUSPRM_M1_WhiteNoise_P_0p01to50Hz.xml PRM/SAGM1/Data/2017-12-21_2155_H1SUSPRM_M1_WhiteNoise_R_0p01to50Hz.xml PRM/SAGM1/Data/2017-12-21_2155_H1SUSPRM_M1_WhiteNoise_T_0p01to50Hz.xml PRM/SAGM1/Data/2017-12-21_2155_H1SUSPRM_M1_WhiteNoise_V_0p01to50Hz.xml PRM/SAGM1/Data/2017-12-21_2155_H1SUSPRM_M1_WhiteNoise_Y_0p01to50Hz.xml
F. Clara, J. Kissel, R. McCarthy, B. Weaver Proving that doors-on is always when the crazies come out of the wood-work, PR2 also showed a similar relay failure mode as PR3 (LHO aLOG 39540, LHO aLOG 39878, FRS Ticket 9497) when we first started checking its close out transfer functions. However, PR2 had failed in the opposite direction, with its T3 OSEM failed with the low pass ON (i.e. binary HIGH). We tried first to re-seat cables in the in-vac side of the feedthru, suspecting that ground loop investigations had left cables a little wonky. Didn't fix it. After that, we'd remembered PR3 problems, and went to PR2's coil driver. However, the fix only required disconnecting and reconnecting the binary IO input cable to the coil driver (yuck!). Attached are - Screenshot of how I found it -- the BIO screen showed the T3 OSEM coil driver state was not like the others. - Screenshot of the top mass Pitch to Pitch transfer function the revealed the problem. BLACK is nominal, RED is with T3 OSEM coil driver channel in the wrong analog state. But, as mentioned above, all is clear now. We did not need to change out any coil drivers.
Evan G., Rick S. We transitioned the EY VEA to laser hazard and then turned on and unshuttered the EY Pcal laser (previously turned off before the Thanksgiving break). Next we checked the positioning of the two beams on the receiver module relay mirrors. The outer beam mirror required more adjustment than the inner beam mirror. The positioning was adjusted to center the Pcal beams and both beams were aligned to the center of the integrating sphere aperture. After this procedure, we shuttered the laser, turned it off, and transitioned the EY VEA back to laser safe. This work was done in preparation for the EY vent to take place in January.
We did not have any ITM OPLEV data from the 2014 vent/pump down because gatevalves were closed and blocking beams at just the correct times. Today, I tried to trend the ITM OPLEV data from the vent this last Sept. Of course, there had been a power outage the weekend before the Monday vent (Sept 18, alog 38708), which blinded us from actually being able to "watch" the wobble of the ITMs during the vent since they had glitched/died and didn't come back up until Tuesday. Foiled again.
HOWEVER, the before and after trends of the PITCH and YAW of ITMY indicate that it did not misalign by more than ~10uRad during the vent. See the attached - note, ignore any data correlated when the SUM is near 0.
New TFs match well with previously healthy TFs taken in July. Results can be found at:
/ligo/svncommon/SusSVN/sus/trunk/HLTS/Common/Data/allhltss_2017-12-21_H1_HLTS_Phase3a_PR3_M1_Doff_ALL_TFs.pdf
/ligo/svncommon/SusSVN/sus/trunk/HLTS/Common/Data/allhltss_2017-12-21_H1_HLTS_Phase3a_PR3_M1_Doff_ALL_ZOOMED_TFs.pdf
Snaps attached of P and Y for example.
F. Clara, J. Kissel, R. McCarthy Sadly, we'd battled a bit of confusion while taking these close out TFs -- namely, that the T3 OSEM on the TOP coil driver that had failed earlier in the vent (see LHO aLOG 39541 FRS 9497) caused further problems manifesting as a *slight* change in the Pitch response of the top 2 top transfer functions (see attached screenshot). Rather than investigate thoroughly, we just swapped the coil driver with a spare. We'll include more details in the FRS after bench testing the failed driver. For now, PR3 remains with a temporary spare on one of its two TOP coil drivers. Attached is the pitch-to-pitch transfer function that revealed the problem. BLACK -- Prior to vent MAGENTA -- during T3 coil driver problem RED -- after problem was resolved
Summary:
Main activities today have been closing out HAM2 & HAM3 (the latter had doors installed). There were also some model/front end/DAQ restarts as well.
Day's Activities:
WHAM2--This platform had not been unlocked for some time, ~Nov 6 when Jim did TFs.
After unlocking, balanced the tilt as close as possible to the locked position of the last few days. Limited mass choice and position only allows getting so close.
After Jim ran TFs today, the free hanging positions are 41, 7, & 96 urads for RX, RY, & RZ. The positions while locked the last few days have been 43, 8, & 82 urads. So the Tilt are very close but the RZ difference is some 14 urads. Sadly, we can't do anything about the RZ now. The solution should be that when we first vent, give SEI some time to adjust the lockers to minimize this--probably a day or two at least. And, as the payload changes and the platform is climbed on, this free hanging/locked position difference will change further. We can do two things now going forward, servo RZ to the locked position which might make the ISI Isolation loops turn-on a bit touchy, or, as SEI would prefer, servo to the free hanging position and we'll see if IO notices/cares. Alternatively, if the ISI is touchy and IO does care, we can twist the platform with HEPI--which we are perfectly happy to do. For what it is worth, when Jim had the platform unlocked for the TFs in early November, the RZ position was similar to now.
For WHAM3--Comparing the locked position over the last couple days to the last couple months, the tilts and RZ are consistent: -6, -6, & -5 urads for RX, RY, & RZ. The current now free hanging positions are -9, -8, & 5 urads. So, similar to HAM2, the RX & RYs are within a few urads but the RZ has an ~10 urads twist when unlocked. Like HAM2, will let IO decide if this twist is too much and if so, SEI will decide if we can tolerate it on the ISI or if it needs to be offloaded to HEPI.
Attached photos show a couple of bundles of cables on the +X-Y and -X+Y corners of the ISI Stage0 of HAM2 heading to the chamber feedthrus. HEPI won't have any difficulty dealing with it now but may be an issue if we attempt any real isolation--could complicate the TFs. Maybe these cable bundles could be done differently if it seems to be a problem.
Carlos, Dave:
Carlos patched and restarted cdslogin this morning. I restarted the cell phone notification system at 13:09 PST.
The DAQ was restarted today to install several changes:
new h1asc code (see alog 39868)
latest H0EDCU_SAFETY.ini
new nds configurations
The NDS reconfigurations are:
h1nds0: New daqdrc file to serve h1ldasgw0's archived raw minute trends from its SATABOY RAID.
h1nds1 (the default nds): now NFS mounts h1ldaswg1's /frames-1 and /trend-1 exports (was temporarily serving h1ldasgw0 while the E18 upgrade was progressing). Also new daqdrc file to serve h1ldasgw1's archived raw minute trends from its SATABOY RAID.
After the restart the EDCU did not connect to many of h1ecaty1's EPICS channels. Remember that the hourly autoburt machine started having connection issues to h1ecaty1 over the weekend. The autoburt machine was rebooted today, which did not fix its connection problems. This coupled with the EDCU issues leads us to think a restart of the IOCs on h1ecaty1plc[1,2,3] is needed. We will see if this can be scheduled pre-holidays.
I have verified that raw minute trend data for times prior to May 2017 are now available (I trended a weather channel for all of 2016).
Continuing from yesterday's afternoon closeout festivities, this morning Travis and I finished pulling the rest of the HAM2/HAM3 HSTS/HLTS First Contact and spot cleaning the optic edges. We did the usual N2 top gun blow during and after the pulls. We double checked tables for extra parts and tools, and finished laying the 3" and 1" witness optics and wafers. We wiped tables in lots of places. There are still a few particle-looking spots on some of the HR surfaces but they do not want to move so we had to leave them behind.
While looking at TFs we re-discovered that the PR3 Pitch Transfer Function looked a bit odd, peaks were in the correct place but the signal was steeper in places than expected. This was due to a broken relay on the BIO chassis. Fil swapped the unit and things looked better.
Meanwhile, the PR2 Pitch TF also exhibited this and was tracked down to a "stuck" BIO state which was fixed by unplugging and reseating the cable somewhere in the external chain.
Kissel and Travis are finishing up the suite of TFs for all 6 of these suspensions (IMs were done yesterday 39845), to be posted in a bit.
Jim and Hugh finished ISI floating, balance tweeks, and TFs, logs pending.
Sign-off sheets were completed. Vern will file to the DCC after the holiday.
Bubba and crew are starting top put doors on, beginning with HAM3 then to HAM2.
Pump down will likely happen early next week after we let the purge air dry things over the holiday weekend.
WP7230
Richard, Sheila, Marc, Dave:
The ADC inputs to h1asc were remapped following the addition of the first ADC.
The PSL Bulls Eye photo-diode channels were remapped as-per E1600381 drawings. The 9pin DSUB cable for this PD was moved on the 6th AA chassis from the last 4 channels to the next-to-last 4 channels. The model's four segments were remapped to be in segment order and not ADC channel order (see attachment)
After the h1asc model was restarted:
the DAQ was restarted
the Bullseye Input Matrix was modified to switch SEG1 and SEG3 settings. We think the SEG2,4 settings are still correct.
the ISC_CUST_BULLSEYE.adl medm file was modified to correct the segment drawing (see attachment)
While CER work was ongoing to SUS coil driver repair, the front end systems h1sush2a and h1sush2b were glitched. On h1sush2b all models stopped running. On h1sush2a the IOP model continually ran long, with ADC and TIM errors which would not clear. All models on both FECs were restarted.
Hugh unlocked HAM3 this morning after SUS people finished in there this morning. I've taken dtt tfs and they look ok. Hugh reported purge is high, so tfs look a little ratty, but resonances seem clear.
Nutsinee, Terry, Daniel
We installed all the in-air coax cables for the squeezer that were on hand. Six weeks after the promised delivery date, it still seems ~20% are missing due to being back ordered...
Fil et al. started laying down the long D-sub cables.
We also completed the missing chassis in the racks. All racks are now according to drawings with the exception of a missing quadplexer for WFS AS_B in ISC-R3.
While installing the north door on BSC 1 this morning, as we were inspecting the flange, I saw what appeared to be a rust spot on the flange in the sealing area of the inner O-ring at roughly the 5 o clock position (facing the BSC from inside the biergarten). I wiped, rubbed, and wiped again. I repeated this several times. There was no drag felt on the alcohol wipe, or on my clean gloves, no "rust residue" or any other foreign material came off on the wipe or glove. I put a piece of tape on the bolt head located near this position and showed Kyle the picture. Kyle said he would make a comment on this post.
The area of interest bridges the inner O-ring contact patch and might result in an inner O-ring leak. We began pumping the annulus space soon after this door was installed and will be able to get useful information via the pressure data as we will have atmosphere on the VE side of this inner O-ring for the next several days. Though undesirable, an inner O-ring leak wouldn't require immediate attention as would a leak across an outer O-ring. The main issue resulting from an inner O-ring leak is the scenario where relatively large amounts of air get introduced into the annulus volume as part of an annulus ion pump replacement. We have work-arounds for this case and, as a matter of policy, always assume that an inner O-ring leak exists when replacing ion pumps or otherwise have a need to introduce air into an annulus space.
Squashed bug? Who did I leave the stoning tools with?
John, I have the stones
4.4 x 10-6 Torr this morning at the cart backing the locally mounted turbo ("hung" turbo). This is excellent for the vent/pump duration.
WP7252:
During today's CDS meeting Rolf reported that moving the fast front-end computer's IRIG-B card away from slot-1 resolved timing issues on his test system. To try this out on a production system, this afternoon I moved h1susey's IRIG-B card.
Recall (alog 39361) that on 09nov2017 I had moved h1susey's OneStop from slot-2 to slot-5 as part of this investigation. Today I returned the OneStop back to slot-2, and moved the IRIG-B card from slot-1 to the newly vacated slot-5.
slot id | 7 | 6 | 5 | 4 | 3 | 2 | 1 |
before | empty | empty | OneStop | 5565 | Dolphin | empty | IRIG-B |
after | empty | empty | IRIG-B | 5565 | Dolphin | OneStop | empty |
It was a messy restart of h1susey. After taking it out of the Dolphin fabric and issuing the poweroff command, the OS got stuck trying to umount NFS after apparently disabling its network ports. I had to power down using the front panel button, knowing that this would most probably cause a Dolphin glitch. Sure enough, on restoration of power the EY dolphin fabric glitched, requiring a restart of models on h1seiey and h1iscey. EY is now back in operation.
Tagging DetChar, so it's on their record books that this change was made.
The upcoming front-end OS upgrade (Gentoo with 3.0.8 kernel) has a much cleaner startup/shutdown process that works with the OS instead of fighting with it. This should help those issues.
I also took the opportunity to move the eyws1 iMac workstation to EY. It is located on a cart parked by the computer racks.
Unfortunately there were two h1iopsusey blips this morning at 03:20 and 06:02 PST.