After the Calibration mesurement this morning, and as I was getting ready to slip H1 back into OBSERVING, noticed some SDF diffs (SEI_DIFF will be noted later).
The odd one was 10^13 diff for an IM2 Yaw offset (see atached). I know we want to keep an eye on these slider values, so I just ACCEPTed it, but why did this SDF diff appear? Was it related to the short calibration measurements I ran or purely coincidental?
TJ mentioned having another Diff due to IM offset before going to OBSERVING this morning.
With LHO closed over the holidays, and O3 still taking place 24/7 over the holidays, Site-Walkthrus have been schedule to be performed by operators during their shifts (DAY). I performed one this morning per instructions here. Since inspection of the LVEA, EX VEA, EY VEA are required, these incursions would require us to go out of OBSERVING. I chose to lump those three inspections together to minimize/optimize time we were out of OBSERVING (where I would take H1 out of OBSERVING, walk through the LVEA, and then drive out to EY & then EX consecutively, AND then finally return H1 to OBSERVING & finish remaining items of the Walk-Through.)
This morning I had H1 down for 35min to run calibration measurements, I was going to tack on VEA incursions to this down time, but we received an Earthquake Alert, so instead, I took H1 to OBSERVING & monitored the EQ in case we needed to transition SEI_CONF to the EARTHQUAKE state (this wasn't needed). Instead, it was observed the Calibration measurement prossibly affected Calibration Lines. Took H1 out of Observing, fixed this, and then began VEA incursions. Here is log:
Duration Total of Site Walk-Thru: ~90min (18:14 - 19:45utc)
Duration out of OBSERVING: ~51min
Ice On Liquid Nitrogen Dewars
One item we were asked to check was the exhaust of the LN2 dewars as we drove the site. I wasn't totally sure where the exhaust was, but eventually figured it out.
As you inspect the dewars there is frost/ice build up at various points (i.e. input plumbing where Norco connects, output to VEAs, & output exhausts [see attached photos for examples]). I texted Chandra and she mentioned alot of this is normal, but she said posting photos is good. Found ice on exhausts at End Stations and LVEA. Notes:
Ice build up on LN2 exhaust looks normal, because the vertical pipe is not insulated and heat trace is not active. Thanks for checking, Corey.
TJ has updated the instructions so that we do not go into the VEAs if we are OBSERVING.
Topped off Crystal Chiller with 125 mL. Diode Chiller OK. Filters look fine (slight yellow tint of Crystal filter [known item]).
Busy morning with:
Yesterday, I was supposed to run some normal & accepted H1 calibration measurements, but unfortunately an EQ changed my plans.
Today I chose to run these measurements. Before running the measurements, I wanted to minimize time out of OBSERVING as much as I could, so I got everything set up ahead of time. I opened up (3) separate DTT sessions with each measurement ready to go (so I can easily run them and also save them while running other ones. When starting a measurement, I turned on my Timer on my phone so I would get a reminder when it was done.
note: Attached is a screenshot of my desktop with all three completed measurements.
H1 Status:
New Measurements files:
Noticed DIAG MAIN message:
"PCAL: PCAL Y OFS servo malfunction" Will send a text to Jeff K.
After I posted this alog, Jenne phoned because she noticed we didn't have some of our Cal Lines. She said we don't want to be in OBSERVING w/o out Cal Lines, so I took us out and then we investigated PCal Y.
We brought up the PCal-Y medm and the gray time series box eventually showed a flat line at around -8. (this should be "fuzzy" instead....it looked like it was stuck at a value). So we toggled the Loop Enable button (clicked OFF for 3-secs and then turned ON). This brought back a more real (& fuzzy) signal & we were happy.
H1 Had Cal Lines Back!
(Since we were out of Observing, this is when I started the Holiday Walk Through of VEAs.)
While scanning monitors on the walls, noticed that the 45MHz spectra was above reference from 0.1-20Hz. (attached is a screenshot, but this was after a few minutes and it began to trend down; currently this spectra is down to the reference for all frequencies.)
This was something which looked odd, so thought I would post a note about it.
Yes, The reference trace has not been updated in a long time.
Most of the time this guy is at the reference. Just happened to catch a few minutes where it was high. Anyway, just something out of the norm I wanted to share.
TITLE: 12/26 Day Shift: 16:00-00:00 UTC (08:00-16:00 PST), all times posted in UTC
STATE of H1: Observing at 110Mpc
OUTGOING OPERATOR: Niko
CURRENT ENVIRONMENT:
SEI_CONF state: WINDY
Wind: 6mph Gusts, 5mph 5min avg
Primary useism: 0.04 μm/s
Secondary useism: 0.51 μm/s
Looks like microseism is slightly beginning a trend down. Low winds. No noticeable EQs in last 12+hrs *knock on wood*.
QUICK SUMMARY:
TITLE: 12/26 Owl Shift 08:00 – 16:00 (00:00-08:00), all times posted in UTC
STATE of H1: Observing
INCOMING OPERATOR: Corey
SHIFT SUMMARY: Quiet shift, locked and Observing for 16.5 hours.
LOG:
Nothing to report
Ops Shift Transition: 12/26/2019, Owl Shift 08:00–16:00 (00:00-08:00) - UTC (PT)
State of H1: Locked
Intent Bit: Observing
Weather: 0-5 mph wind
Primary 0.03 – 0.1Hz: 0.01 um/s
Secondary 0.1 – 0.3Hz: 0.5 um/s
Outgoing Operator: Jeff
Quick Summary: Locked and Observing for 8.5 hours. Wind is low, microseism high.
GRB Alert #358439 (599031294) Lat = 36.72 sec, TD = 0.016 sec. Spoke with LLO. INJECT_KILL for 15 minute stand down.
The first half of the shift saw a Swift GRB alert and continued earthquake activity. Went into EARTHQUAKE mode for a series a three quakes from the New Caledonia area. Given that microseism remains high and Peak Mon is also elevated, it seemed prudent to make the switch. Rode through these quakes and went back into WINDY. The winds are around 5 to 8 and the fog has cleared somewhat. Range is around 111.5Mpc.
00:32 (16:32) GRB Alert #E358420. Lat = 99.62 sec, TD = 1.024sec. All sites are up. In 1 hour stand down.
TITLE: 12/25 Day Shift: 16:00-00:00 UTC (08:00-16:00 PST), all times posted in UTC
STATE of H1: Observing at 114Mpc
INCOMING OPERATOR: Jeff
SHIFT SUMMARY:
Nice first half of the shift, and then an EQ made for a rough 2nd half. Locking was tough after the EQ with many locklosses (no notes in this summary, because they were all submited in the Ops Survey).
Restored IMs (per Niko + Cheryl IM alog) & this made locking not a problem.
SEI_DIFF prevented Observing, so had to jump through a few hoops to get us back up (see my most recent alog).
Did not get to run Sensor Calibration measurements due to EQ. Also missed a superevent candidate which rolled in while H1 was down. :(
LOG:
After rough going with H1 after the 6.3 Canada EQ from last night (I had many locklosses and issues ranging from not being able to find IR, lots of Saturations, ASC not being happy, etc.....all was logged to the best of my abilities in the Ops Survey).
IMs Restored
SDF Diffs (see 1st attachment)
A few items kept me from immediately going to OBSERVING. First off were SDF Diffs:
1) Obviously we had new IM biases: I accepted these
2) SEI PROC Diffs for CPS Diff stuff from the new SEI_DIFF node: I accepted these
Then there was a "Not OK" Guardian Node for the Intent Bit related to the (once again) SEI_DIFF....
SEI_DIFF Guardian Node Prevented Observing
Since microseism has been gradually increasing since yesterday, I took SEI DIFF from the CORNER CPS state (NOMINAL State for this node) to the DOWN state while locking earlier today. Unfortunately, since DOWN isn't the NOMINAL state, this Guardian came up in the list of "NOT OK" Guardian Nodes for the Intent Bit (see 2nd attachment). I don't know how to change the NOMINAL state, so I intentionally called shenanigans, and:
This then gave me a new list of SDFs for the SEI PROC. I just went ahead and ACCEPTED these. (maybe we should Firstly NOT MONITOR all channels related to this new system since this will be a state which changes with weather. Secondly, we should add the SEI_DIFF guardian nodeto the "Exclude List" (TJ thought it might have already been added, but it isn't), since it's NOMINAL state will change from OFF to whatever state (i.e. CORNER_DIFF_CPS) we want when microseism is low.