I finally got tired of watching the hourly autoburts spam everything in the network with broadcasts as it's done since, well, pretty much forever. So I stood up a small virtual machine to handle this task (aptly named 'autoburt'), the main new difference being a local EPICS gateway process to act as a proxy for any CA requests. The gateway code caches the channel name -> IOC mapping (for a configurable interval, default 7200 seconds (or if you prefer, '2 hours')). This means that if we route all the CA requests through this local gateway (listening on the loopback address, 127.0.0.1), it should only have to broadcast for channel names once, as the burt snapshots are taken every hour (thus refreshing the cache). After the initial broadcast, the only things that should trigger a CA search request are: if a channel moves to a different IOC, if a channel is in a request file but does not exist (such channels are marked 'dead' after 2 minutes in the gateway and unlearned/discarded), or new channels are added. Since the local gateway process is close to the source of the packets, it can learn the status and location of every requested channel (assuming it's valid), so it does not need to re-broadcast for channels it would never find (as is the case with a central gateway for an individual subnet). To this end, attached are plots (in bits and number of packets) of the reduction in traffic after making the aforementioned change. These plots are from the interface for Vlan20 on the core switch, which all the broadcast traffic would traverse. The initial 'fuzzyness' is the overlap between the new machine taking over and the old snapshots finishing up. In addition there were some other model changes that made channels unavailable for a bit. The remaining peaks in traffic are from invalid channels in the autoburt snapshots, which to address I will have to track down the responsible parties and 'educate' them. One additional change I made is that the 'H1' autoburt now runs at 10 min after the hour. This give the 'H0' autoburt time to run and finish, and should help sort out if one or the other is having issues. Yes, it's perhaps quibbling to worry about 500k of traffic (a whole 0.05% of 1Gbps!), but the previous behavior was just dumb and I wanted to look at something prettier.
11:15 Mike - going into LVEA 11:17 Keita – Transition End-X to laser safe 11:56 Gerardo – Going to End-X and End-Y 12:31 Nichole – In LVEA and Optics lab looking for parts 13:24 Matt – Working on IO alignment 13:35 Keita – Going to End-X 13:57 Corey – Looking for cables in the LVEA 14:00 Mike – Taking DetChar group on LVEA tour 14:18 Keita – Transition End-X to laser hazard 15:10 Jeff – Chiller water level good
(Sheila, Daniel)
We installed 2 MCL PZT drivers, 2 PZT steering mirrors, a DE-to-SE driver chassis, and associated cabling in EY. The ISCEY model updates were already introduced during the last maintenance perdiod. The electronics and software are turned on and ready. The DAC outputs to the MCL drivers have been tested. The mirrors still need alignment once ETMY is back under damping and aligned. A simple integrator has been loaded into the new filter modules. Documentation can be found here.
Staging building seismic test stand - Restarted both models and the framewriter and nds processes to get the time sync'ed properly. Tested using diaggui to do a transfer function, test passed.
Went down to EX after lunch and locked the ISI, after Hugh turned off HEPI offsets. I had to move one of the witness plates on the floor, because I had to slide under the suspensions to get to the far side of the chamber. To reach the lockers, I had to steal a clean-er stool from the LVEA from around HAM5, as our regular in-chamber stools have been mis-placed, wiped it down multiple times, and foiled the base. Wherever this stool came from, we should get a couple more because it was the perfect height for this job. Slid nicely under all of the suspended obstructions, but tall enough that I could reach the lockers. I left the stool down there sitting outside the chamber in-case TMS needs it.
Although I did not really find a smoking gun on SR3, I moved a few EQ stops back and recentered one middle stage OSEM (LR). Now, V and P TFs seem healthy. Moving on.
Kyle came out and checked the purge in the LVEA in light of the fact that we removed the dam - he reports that it is "normal" and functioning as best as it can. Note, he also reported that he checks it every other day. Good.
To all: Please alog if you are adjusting any purge - I'm trying to catch a phantom.
Before doing much in HAM2, but just after APollo worked on "bib around door":
0.3 um 20
0.5um 10
1.0um 0
In the midst of beam hunting this morning, we started quick TFs on SR3. We immediately see some rubbing as V TFs don't look healthy. I took a quick glance at the SUS and did not see anything obvious. Aargh. Back at it after a quick lunch.
In an attempt to resume alignment of the output HAM optics, this time with the aligned ITMy, we unshuttered the PSL beam and entered HAM5 to look for it. We found nothing. Tracing steps backwards, we seem to find that the bypass optics near MC3 got brushed yesterday during the ground look hunt. The PSL beam hits the monument on the wall a bit off in yaw. So, we'll need to reflash the MC and tweek up the alignment of the bypass. Kiwamu has already adjusted the power leaving the PSL down to 200mW. After lunch, we'll start again.
Jeff and Andres spent the morning aligning the SR3 2 lower stage OSEMs.
Andres R. & Jeff B. After completing the magnet repair on SR3, we recentered and realigned the AOSEMs on the Intermediate and Test Masses. The AOSEMs have been adjusted to 50% light. No problems were encountered during alignment or centering. Left SR3 suspended with the EQ stops set close to their final positions. Particle Counts: Before Work In cleanroom, Cover on: 0.3 = 10, 0.5 = 8, 1.0 = 2 In chamber, Cover on: 0.3 = 346, 0.5 = 202, 1.0 = 46 In chamber, Cover 1/2 off after 2 Minutes: 0.3 = 107, 0.5 = 59, 1.0 = 12 During Work In chamber, Cove 1/2 off: 0.3 = 30, 0.5 = 17. 1.0 = 9 After Work In cleanroom, Cover on: 0.3 = 0, 0.5 = 0, 1.0 = 0 In chamber, Cover on: 0.3 = 8, 0.5 = 4, 1.0 = 0
The opportune shut down of the HEPI Pump during the vent allowed the HEPI Mechanical to respond to the change of state. The Z & Y dofs trend 10s of um with the Y sliding 60um. X waffled around in a window of 3um so basically didn't move. The yaw and tilts are a couple to 15urads so again maybe nothing. See the attached trends remembering the local sensors these are derived from are from the top of the SEI Piers to the suspended HEPI. So, there is most likely coherent motions relative to the floor that these don't see.
Last Thursday, I modified the allowed PV list to further exclude FMCS channels which do not exist in the vacuum subnet (/H0:FMC-.*_H2O_PRESS.*/ rather than /H0:FMC-.*/). Attached is a plot of the corresponding reduction in broadcast traffic in the vacuum subnet. The second plot shows this change (in 'Week 28') relative to the previous change (in 'Week 27') that eliminated most of the redundant broadcasts for reference.
At essentially the exact same time as the EndY shutdown reported yesterday, EndX HEPI Pump Station stopped its output with a OV3 error. Suppose this makes sense. The LVEA road through this fine. Pump Station restarted in the documented manner.
Laser Status: LVEA-HAZARD, EX-HAZARD, EY-HAZARD
(covering Morning for Jeff B)
NOTE to Operators (and others)
With the EX Chamber work, there have been a pair of new Dust Monitors installed (along with new code, alog12738). Unfortunately, the Dust Monitor signals aren't connected to alarms, and do not come up on the main EX Dust Monitor Screens. You can find out counts on these Dust Monitors by bringing up their Expert Screens. So, we will want to look at these screens every now and then.
The Dust Monitors work locally, so those doing in-chamber work should be mindful of any audible alarms (if any) the Dust Monitors may give.
Travis, Betsy
In prep for the PSL alignment check off of ITMy, we pulled the First Contact sheet from the CP-AR surface.
Since IAS finished taking this morning's alignment measurements, Travis and I went into BSC1 and dropped the dam that was standing between BSC1 and BSC2. It is currently laying under the ITMy QUAD in the chamber in the event we need it again soon.
It should be noted that the pitch is without the 352 µrad correction for the First Contact currently on the HR face of the ITMy; this will have to be corrected for after the output arm work, in addition to the yaw and the X axis position. Also, I applied a +40 yaw bias to the ITMy. This zeros the yaw in our alignment equipment (the current slider calibration is a little off).