IMC/IOT2L alignment - progress and an alignment issue to be resolved tomorrow
- Jenne, Keita, Cheryl
J. Kissel I've run detailed analysis on the post-vent transfer functions for all HSTSs -- MC1, MC2, MC3, PR2, PRM, SR2, SRM -- taken in LHO aLOGs 39975 and 39993. All suspensions are free of rubbing at a corner volume vacuum level of ~1e-6 Torr. A few oddballs in the results are due to measurement error: - The gains on the P and Y TEST bank (through which excitation is driven) of PRM were not set to unity, so the P to P and Y to Y transfer functions look like they have higher response than previous measurements, but the scale difference is exactly the extra TEST gain. - SRM transfer functions were taken with the HAM5 ISI in DAMPED only, not ISOLATED, so the second zero in the T to T transfer function shows a cross coupled mode of the ISI. Both are non-issues. Note, I've made a pretty major overhaul to the comparison script /ligo/svncommon/SusSVN/sus/trunk/HSTS/Common/MatlabTools/plotallhsts_tfs_M1.m namely, I've rearranged the measurement list to be alphabetical by IFO, then by optic. This has a few benefits: (1) The optics that we aren't measuring regularly, the LIGO India Optics are at the top. Since they don't get any new measurements ever added, we don't have to increment the measurement counter. We had to before, because they were interspersed between the other IFOs. (2) LLO gets to be at the bottom, so they don't have to increment LHO's measurement numbers when they add a new SUS measurement (3) The list is grouped by IFO, so once you add your IFOs new suspensions, it'll be more obvious if the other IFO's numbers have gotten screwed up. This is a step toward some future better way of handling this gigantic list of data. We'll get there one day! The changes have been committed to the SusSVN repo.
TITLE: 01/04 Day Shift: 16:00-00:00 UTC (08:00-16:00 PST), all times posted in UTC
STATE of H1: Planned Engineering
INCOMING OPERATOR: None
SHIFT SUMMARY: IMC Trans work, CDS cabling, and a temperamental h1ioplsc0 are the highlights of the day. In other work, EY clean room is set up and running, corner station HWSX table is aligned (Y is still in progress), and TCS Y chiller sprung a leak.
LOG:
Measured -30.4 deg C
(CDS team)
The cables for the squeezer were pulled. This should include all cables within the CER, SQZ-R1 and in-between. All cables going to the optics table are in the cable tray towards the squeezer bay. The TT/OFI cables still need to be finished.
I wanted to try restoring the controls configurations of all of the ISI, so I changed the SEI_CONF manager to windy, which caused the EX configuration node to complain about the state of the BRSX. When I opened the BRSX overview, the driftmon was railed at -16k. I logged onto the beckhoff machine and found the C code dead. Looking at time series for the driftmon and cbit it looks like BRSX started getting glitchy, then the C-code crashed on New Years Day. Not sure what happened, but the spikes on the driftmon channel kind of remind me of what happens when someone stays connected the the beckhoff machine and walks away for a couple days. Something also seems to repeatedly ring the BRS up, maybe a result of some code mini-crashes? I don't know, weird stuff. I'm filing an FRS to track this.
[TVo, Jenne, Cheryl]
The IMC is still flashing nicely from yesterday, so we left the MC mirrors alone and worked on aligning the IMC Trans path. We moved the trans path periscope and all of the optical elements in the path toward the PSL enclosure by 3 holes, so all of the path lengths are roughly preserved.
After this, Cheryl removed the HWP that was in the PSL enclosure to rotate us to the wrong polarization (to make IMC flashes easier to see). So, now we're at the correct polarization, but we're still working on getting the alignment back, since that was a pretty thick optical element.
J. Kissel
I've taken standard rubbing-check, top-mass to top-mass transfer functions for all suspensions in HAM4, HAM5, and BSC2 now that we're down to about 1e-6 Torr (which is sufficient a vacuum that the suspension positions won't change further from buoyancy). Good news: All suspensions are free of rubbing after pumpdown, including SRM, SR2, SR3 and BS
Data files are listed below. Detailed results will be processed and posted in due time.
/ligo/svncommon/SusSVN/sus/trunk/HSTS/H1/SR?/SAGM1/Data/2018-01-04*.xml
/ligo/svncommon/SusSVN/sus/trunk/HLTS/H1/SR3/SAGM1/Data/2018-01-04*.xml
/ligo/svncommon/SusSVN/sus/trunk/BSFM/H1/BS/SAGM1/Data/2018-01-04*.xml
As a teaser / proof, I attach screenshots of each M1 Pitch to M1 Pitch transfer functions for the Triples.
J. Kissel Detailed transfer function analysis of SR3. Everything looks fabulous -- no complaints!
J. Kissel Detailed analysis of the beam splitter's transfer functions also show no problems. Free and clear!
There is an accelerometer on top of HAM2 that is just laying on its side. It obviously had been glued to the SS at some point in the past as there is a remnant patch of glue in close proximity.
Ran quarterly check on dust monitors. All test out OK. Adjusted vacuum pump flow rate in the CS and at End-X to bump up the flow rate. Could not check the monitor in the Diode Room as the access card is no longer in the control room key box. Will get with the LSO for access.
IO and TCS/HWS Tables are back in place and being aligned.
VAC
CS pump down is around 10-6Torr. ITM TMDS is waiting till we are confident that we will not have to vent again. Vac crew wants to pop off the HAM6 S door to place a stopper so the HAM5 doors can be tested. Monday morning hard closing MY gate valves. Hoping to vent EY early next week. North door will be coming off and the clean room is set up. Will need to isolate Y-beam manifold to leak check, perhaps a few weeks out. Short one ion pump in the CS until it is repaired. Kyle will want to commissioning the neg pumps this month, which will be climbing on chambers and running pumps.
SQZ
Cabling is continuing, what is here is installed but more to come. VIP is still waiting for the OPO and a few other parts before further progress can continue. The slow controls testing in the SQZr Bay for the table can start. Siskyou mounts being built in the Opt Lab.
COMM
IMC locking this week. OM alignment, DRMI, and peak down the arm coming up in the next week or two.
SUS
Jeff K has been running transfer functions on the vented sus and checking for rubbing and other issues.
CDS
Security patch needed, this will mean that all control room work stations and many of the CDS machines will need reboots. Tuesday all of the "big" machines will be rebooted, this will take some time, expect much of the day. H1IOPLSC has been glitching lately, could be caused by work around the machine but CDS will be looking into it. Restarting the models has solved the issue in the past, but still under investigation.
SEI
EY HEPI locked up. EX HEPI is still operational and there will be some testing and filter maintenance. Been relieving HEPI biases, this will relieve harsh trips and hopefully have fewer trips.
TCS
Seal on one of the TCS Y chiller pumps failed, spare is being hooked up. This was the same one that we have been having leaking issues with previously, could have been the issue (or part of). More TCS maintenance will happen during PSL upgrade.
Please take some time to go through the LVEA and put stuff away. It's nobody's stuff, which means it's everybody's stuff
I restarted the h1lsc0 models today. Dave Barker is trending the timing information and state word and may have more to add. But at this point we suspect it is likely a glitch in the IRIG-B as seen yesterday. The system was not responsive via the network via ssh or EPICS CA. The MEDM screen on the control room wall showed everything green, but trying to view the medm screen from another computer (a new connection) failed with the channels not connecting. Going to the console showed that the repeated error 'nf_conntrack: table full, dropping packet'. The system was set to track 64k connections. I changed the limit (until reboot) to 100,000. At that point new connections could be made and the medm screens went red with IPC. I am suprised by this behavior, I would have though the IPC bit would have gone bad on the other machines irregardless of the state of the lsc machine. At this point I killed all the models and restarted them. Then TJ and I went through and cleared all the IPC errors through the site after verifying that they where related to h1lsc0. Reviewing the dmesg output and filtering out nf_conntrack errors showed an ADC TIMEOUT on h1lscaux, h1omc, h1sqz, h1omcpi, h1lsc at 7246965.68s since boot.
BTW: the network filter connection tracking problem seen on h1lsc0 today was also seen on h1oaf0 in November 2016.
alog: Link
The EDCU is configured to read two EPICS channels from the h1ioplsc0 model via channel access (H1:FEC-7_STATE_WORD and H1:IOP-LSC0_ADC_DT_OUTMON). Of the two, the latter should be constantly changing and would show if it froze to a single value. Trending this channel shows that the EDCU did not lose its connection to h1ioplsc0 this morning, but the hourly autoburt could not connect at 10:10 PST. The autoburt could however connect to the user models on h1lsc0 at this time (only the IOP model was disconnected).
Restarted the models again around 22:50 UTC. They are working in the CER moving fibers and such around so we expect this glitch was caused by this work.
GGrabeel, TVo
Topped off the chillers and started them back up this afternoon. They immediately faulted out, due to a set-point error. I set them to run in manual while I checked for leaks, there were no apparent leaks. TVo found the problem in EPICS where an integrator on a control loop was causing the set point to steadily increase (It was up to about 500,000 degrees Celsius I think). After turning off some inputs and filters we were able to get the more reasonable value of 21 degrees Celsius. The chillers will continue to run and be re-checked tomorrow.
This morning I noticed a large puddle of water under the TCS-X chiller. Water level looked OK in the site glass.
J. Kissel
I've taken standard rubbing-check, top-mass to top-mass transfer functions for all suspensions in HAM2 and HAM3, now that we're down to about 1e-6 Torr (which is sufficient a vacuum that the suspension positions won't change further from buoyancy). Good news: All suspensions are free of rubbing after pumpdown, including MC1, MC2, MC3, IM1-4, PRM, PR2, and PR3.
Data files are listed below. Detailed results will be processed and posted in due time.
/ligo/svncommon/SusSVN/sus/trunk/HSTS/H1/MC?/SAGM1/Data/2018-01-03*.xml
/ligo/svncommon/SusSVN/sus/trunk/HSTS/H1/PR?/SAGM1/Data/2018-01-03*.xml
/ligo/svncommon/SusSVN/sus/trunk/HLTS/H1/PR3/SAGM1/Data/2018-01-03*.xml
/ligo/svncommon/SusSVN/sus/trunk/HAUX/H1/IM?/SAGM1/Data/2018-01-04*.xml
As a teaser / proof, I attach screenshots of each M1 Pitch to M1 Pitch transfer functions for the Triples.
Detail results for IM1, IM2, IM3, and IM4, plus the collection are attached. This detailed analysis confirms that they're free of rubbing.
Detailed results for PR3. Note that these latest transfer functions were taken *after* the repaired T3 LF RT SD Top mass coil driver has been re-installed (See LHO aLOG 39946). Everything looks good. This should be enough evidence to close out FRS Ticket 9497. The only that catches one's eye are the apparent extra L resonances in the Yaw to Yaw transfer function. We've seen such features before, and we usually attribute it to the benign effect of poor common mode subtraction in the LF and RT OSEMs. In other words, Yaw is a differential measurement of the horizontal rotation about the vertical center of mass, and it has been polluted by the common mode horizontal measurement which contains Longitudinal. If (a) the sensors / flags are laterally misaligned, (b) the sensor gains are not well matched, or (c) the suspension rotates about an axis that is misaligned with the cage location of the OSEMs, then you would see such an effect as we see. I'd say all are plausible, and again all are benign.
R. McCarthy, M. Pirello
We replaced the spare (S1001082) Triple Top Coil Driver with the repaired original (S1100195). The original had a bad relay and was swapped back in December with the spare. The unit was repaired, tested, and replaced into its original configuration.
Alog of events leading up to this: 39877
This is PR3's top mass (T3 LF RT SD) coil driver. It actually resolves the issue of PR3 (LHO aLOG 39540, LHO aLOG 39878, FRS Ticket 9497) -- not PR2 (the aLOG linked above).
J. Kissel The only other suspension in HAM2 / HAM3 that is rubbing is PR3. As with MC2, it doesn't look too serious, because the Qs are all nice and high. Probably another grazing EQ stop or two. Black 2017-07-25_1507 pre-vent clean reference Red 2017-11-10_2044 current rubbing state Betsy has been made aware, and will address when convenient.
Problem fixed -- it was the Front HR Upper Right stop grounded on the face of the optic. See LHO aLOG 39416.