TITLE: 12/10 Owl Shift: 08:00-16:00 UTC (00:00-08:00 PST), all times posted in UTC
STATE of H1: Observing at 69.4542Mpc
INCOMING OPERATOR: Cheryl
SHIFT SUMMARY: Quiet Shift
LOG:
Nothing to report, Corey had the IFO locked when I got here, it's still locked as I'm leaving.
Bubba and Chris found our water leak! Overnight the potable water tank level held steady at 4.3 feet after the warehouse water was shut off. Next comes the digging.
TITLE: 12/10 Eve Shift: 00:00-08:00 UTC (16:00-00:00 PST), all times posted in UTC
STATE of H1: Earthquake
INCOMING OPERATOR: Jim
SHIFT SUMMARY:
Once I sat down to H1, able to get to NLN with no issues. Have had a handful of EYSaturations during this lock. Seismic trends are steady & winds are getting quiet.
LOG:
Forgot to note that while handing off to Jim last night, that he did have to make some quick adjustments to the MODE28 (in the 8-9utc hour).
Had a pair of EQs reported on Terramon within 8min of each other and both near the Solomon Islands
Since we've been having constant Dust Alarms for the PSL Enclosure (#101), looked into trends over the last 2 months (looked at #101, wind, and some FMCS/HVAC channels).
Since the levels as they currently are I wanted to inch them up a little (by x2). This will help to reduce the constant alarms we get and prevent us from ignoring them. But it is a small enough bump that we'll still get them when we are at higher levels. Since there has been no change post-cleaning on 12/5, Jeff should investigate the air filtration system for the PSL. Do we have requirements for cleanliness levels for the PSL Enclosure?
Alarm Setting Changes
0.3um: MINOR: 70->140 & MAJOR: 100->200
o.5um: MINOR: 70->140 & MAJOR: 100->200
Locked for 3+hrs. Rode through a couple of Solomon Island rumblers (L1 went down). Also ran an A2L an hour or so after this lock (right as L1 was joining us). H1 started off at a high range (almost 80Mpc, slowly dropped around 65Mpc & is back up to around 73Mpc. Smooth saling.
As soon as H1 went up, L1 went down.
EQ levels subsided so immediately proceeded with locking (only hitch was a low X-arm for ALS & this was remedied with a slight TMSx tweek). Made it to NLN with no issues.
I saw we had quite a few Test Points open on the CDS Overview (some were 20+ for some PEM front ends). I went about running a TP Clear on all of them (except H1CALEX which had 1). In case you were interested the frontends I did a TP Clear on, had the following DCUIDs: 24, 30, 31, 75, 50, 54, 55, 60, 98, 99, 80, 118, 10, 19, 121, 88, 89, 91, & 84.
Shortly thereafter, I hammered down the MODE28 PI before it got raucous (phase sign flip).
Range is hovering around 75Mpc.
Transitioned OBSERVATORY_MODE from EARTHQUAKE to OBSERVING.
Looking at Violin Mode peaks on DARM, we have:
TITLE: 12/10 Eve Shift: 00:00-08:00 UTC (16:00-00:00 PST), all times posted in UTC
STATE of H1: Earthquake
OUTGOING OPERATOR: Jeff
CURRENT ENVIRONMENT:
Wind: 10mph Gusts, 6mph 5min avg
Primary useism: 0.04 μm/s
Secondary useism: 0.34 μm/s
QUICK SUMMARY:
While double-checking locked doors (and front door knob also locked), I went ahead and turned OFF lights for weekend conditions, this included the Mechanical Room & Mass Storage Room.
Shift Summary: The IFO was locked and observing for the past 5.5 hours. At 19:23 lost lock due to a Mag 6.9 EQ near the Solomon’s. Primary microseism is up to 8.0um/s, secondary is 1.5um/s. HAM6 ISI was the only tripped. I put the SEI_CONF LARGE_EQ_NOBRSXY.
Put the SEI_CONF back to WINDY. Microseism has calmed down. Start relocking.
Double the fun!
1:30 pm local
Finished installing TCs at CP4 exhaust. Needed to swap TC wires at beckhoff rack.
CP4 took less than 1 min. to overfill at 70% on LLCV. Returned to nominal 38%. I filled CP4 from beckhoff console at MY to verfiy LN2 flow out exhaust when TCs read below -30C.
CP3 took 36 min. to overfill at 50% on LLCV. Nominal at 19% (from previous 18%).
Dave Barker pointed out that CP3's Dewar level readback is noisy as he was writing an alarm script that looks at slope. Trending back 3 years, it looks like this noise comes and goes with cold weather, and is somewhat diurnal.
IFO has been locked and Observing for 5.5 hours, when lost lock due to Mag6.9 EQ near the Solomon Islands. Primary microseism remains high but is starting to come down. Should be able to try relocking soon.
Attached are plots of the reference cavity transmission for the past week. Plotted along with the laser room temperature, and the reflection locking photodiode output. The decay is not due to any degradation of the pre-modecleaner transmission. Correction almost always involve a pitch alignment correction, most of which is the top mirror mount in the periscooe.
Terra asked detchar to investigate whether changing PI damping settings might cause glitches. Conclusion - they do not, at least for the examples I've seen.
I looked at 22 examples from alogs 31892, 31824, 31560, 31516, 31485, 31461, 31444, 31440, 31191 where operators reported changing the settings on modes 3, 26, 27 and 28 in either/both phase and gain. I plotted a 10 minute timeseries around the times reported in the alogs of channels SUS-PI_PROC_COMPUTE_MODE#_DAMP_GAIN and SUS-PI_PROC_COMPUTE_MODE#_PLL_PHASE and a spectrogram of GDS-CALIB_STRAIN of the same time. Two of the times I could not find any change in either the phase/gain so I really only looked at 20 examples.
Attached is an example where both the phase and gain of mode 28 were changed by the operator in alog 31485. The change in gain and phase makes no obvious glitches/change to the spectrogram. All other exmaples I have seen show no obvious change either. When pycbc live triggers have been available (because they only get generated when we're in oberserving) I can not find any noticeable change.
If you really want to look through all the plots yourself they are here.
Thanks Laura!
PI phase and gain settings are currently unmonitored in observe SDF, so we can keep them that way. Note that saturating the ESD drive does couple into DARM, so if you ever try significantly increasing PI gains (say, above 15,000), it would be best to drop out of Observe.
Posted are the plots for the CPS Sensor Spectra.
It seems like there are some PI modes that we are no longer damping that are slightly run up according to the dtt. I also wonder if the peaks at around 13000hz are modes that we had not had issues with before, or maybe something else entirely? I don't see any mention of them on the PI medm and they are currently the highest. I will try to damp some of the other ones if they get any higher.
The attached shows the PI dtt just after reaching low noise.
Well I think things are stable now. I ended up flipping the sign for the both the phase and gain on mode 27. Mode 26 also came up and changing the phase got it to, very slowly, go down. I took some screen shots of the dtt template at 20min, 26min, and 32min into the lock. The modes that the Striptools said were ringing up, didnt necessarily agree with the dtt. I dont remember how much the modes can shift in frequency, but it seems like some of them were off by a couple of hz.
A couple things:
Please any operator contact me at any time if help/explanations/etc is needed.
For the couple hz off thing, I was mainly refering to the frequencies listed on the medm above the modes. I'm not sure how accurate these are suppose to be, but like mode 27 says 18041, and the dtt was saying that 18038 seemed to be more rung up (see second attached). I didn't remember how much they shifted, and I did not look at the actual filters themselves at the time.
I was able to make it work (on the second try) with just changing phase and gain so I didn't look into it too much after that. But, yes, following your instructions and changing the BP would have been next on the list.
In alog32385 you mention that you will put a reference trace to show what is normal and what is not. I would love this because I looked at the dtt picture that is on the wiki and saw that it was much different. Either way, it was a good learnign process for me since I have only ever had to change phases for PI modes.