State of H1: Lock Acquisition
After a lockloss @ 01:44 UTC, had to troubleshoot some minor relocking issues, but we're back to relocking successfully now. Currently in MAX_POWER.
TITLE: 06/04 Day Shift: 15:00-23:00 UTC (08:00-16:00 PST), all times posted in UTC
STATE of H1: Observing at 135Mpc
SHIFT SUMMARY:
- Arrived to H1 relocking
- Passing the IFO to Ryan S. locked and in observing, H1 appears to be stable and seismic motion is very low
- Lock #1:
- Lock #2:
LOG:
No log for this shift.
TITLE: 06/04 Eve Shift: 23:00-07:00 UTC (16:00-00:00 PST), all times posted in UTC
STATE of H1: Observing at 133Mpc
CURRENT ENVIRONMENT:
SEI_ENV state: CALM
Wind: 7mph Gusts, 4mph 5min avg
Primary useism: 0.02 μm/s
Secondary useism: 0.10 μm/s
QUICK SUMMARY: Taking over from Austin. H1 has been locked and Observing for just over an hour.
After recovering the HAM 7 ISI interface chassis (alog), we are back in OBSERVING as of 18:51 UTC.
Austin, Jim, Dave:
Starting at 06:56 PDT the h1seih7 ADC1 (2nd) channels 08-19 started misbehaving. All the other channels on this ADC are unaffected.
Austin confirmed that the AA chassis for this ADC looks correct on the mezzanine.
Jim confirmed that this block of channels are associated with a single ISI interface chassis which feeds the AA.
The six broken signals are:
H1:ISI-HAM7_L4CINF_[V2,H2]_MON
H1:ISI-HAM7_GS13INF_[V2,H2]_MON
H1:ISI-HAM7_CPSINF_[V3,H3]_MON
The asds of the CPS, GS13 and L4C in this chassis all look identically bad, the other sensors seem fine. All ISI controls are off, loops can't be re-engaged at this point and we probably can't get the squeezer back on. I don't think we can get to Observe without fixing this.
Attached ADC Monitor MEDMS for h1iopseih7 and h1isiham7 highlight the broken channels. The signals have two modes, the are either somewhat static with incorrect low values, or they are in a flashing mode, where they transition between the low value to a very high value (tens of thousands) with a flash frequency of about 1Hz, they then go back to the quiet mode for 10-20 seconds.
For about 30 minutes after the 06:58 failure these signals were very noisy all the time, and then they settled to the static/flash-modes we are seeing now.
Marc, Austin and I pulled a spare ISI interface chassis from the staging building test stand and replace the corner 2 unit. So far signals all look normal now and the ISI was able to re-isolate. Marc opened the chassis and it looks like a cap or something failed on the power board.
We also noticed at the mezzanine racks that all of the chassises there are quite hot, I think Marc said he saw 110 F on some part of a chassis. It's warm out there, maybe we should space those chassises out a bit on the rack.
We replaced S20000568 with S1201328. This spare interface is an ALIGO spare and the last one we have.
IFO stayed locked this whole time, but squeezer was down. Vicki has now relocked and we are back observing.
C5 blown on power regulator.
Asds of sensors after chassis swap.
Nice recovery, well done all.
Tagging SEI, OpsInfo, and FRS. Opened and closed FRS Ticket 28196. Observation time lost is ~5 hours, see attached screenshot.
TITLE: 06/04 Owl Shift: 07:00-15:00 UTC (00:00-08:00 PST), all times posted in UTC
STATE of H1: Lock Acquisition
CURRENT ENVIRONMENT:
SEI_ENV state: CALM
Wind: 11mph Gusts, 9mph 5min avg
Primary useism: 0.03 μm/s
Secondary useism: 0.11 μm/s
QUICK SUMMARY:
8:15 UTC 18hours of Lock!
13:56 Lockloss due to ETMX L3 Motion after 23 hours of lock.
Relocking:
I tried to just quickly relock with out an Initial Alignment, and lost lock at Locking ALS.
I then did a Initial Alignment and and started relocking again.
There were 2 Locklosses at TRANSITION_DRMI_TO_3F, but on the 3rd attempt H1 was able to make it PREP_ASC_FOR_FULL_IFO.
Current IFO Status: LOCKING.
After the long lockloss occurred, the ISI HAM 7 WD was tripped and was not reset properly upon relocking. We are now relocking at MAX_POWER with the WD still tripped and all BLRM bandpasses are railed - ss attached, preventing me from untripping the WD. Will monitor as the BLRMs seem to be slowly going down. - Tagging SEI
It looks like the corner2 ISI Interface chassis might have failed. Working with Dave and CDS to try to get someone out to try to replace it.
It looks like the corner2 ISI Interface chassis might have failed. Working with Dave and CDS to try to get someone out to try to replace it.
TITLE: 06/04 Day Shift: 15:00-23:00 UTC (08:00-16:00 PST), all times posted in UTC
STATE of H1: Lock Acquisition
CURRENT ENVIRONMENT:
SEI_ENV state: CALM
Wind: 13mph Gusts, 9mph 5min avg
Primary useism: 0.03 μm/s
Secondary useism: 0.08 μm/s
QUICK SUMMARY:
- H1 is currently relocking at PREP_TR_CARM after almost a 24 hour long lock (so close!)
- SEI/CDS/DMs ok
Current IFO Status: Unlocked
H1 just had a LockLoss after 23 hours and 41 minutes of NOMINAL_LOW_NOISE & OBSERVING.
https://ldas-jobs.ligo-wa.caltech.edu/~lockloss/index.cgi?event=1369922215
It's currently unclear what cause the Lockloss.
TITLE: 06/04 Owl Shift: 07:00-15:00 UTC (00:00-08:00 PST), all times posted in UTC
STATE of H1: Observing at 136Mpc
CURRENT ENVIRONMENT:
SEI_ENV state: CALM
Wind: 9mph Gusts, 5mph 5min avg
Primary useism: 0.01 μm/s
Secondary useism: 0.08 μm/s
QUICK SUMMARY:
Current IFO Status: NOMINAL_LOW_NOISE & OBSERVING
H1 has been locked for over 16 hours!
TITLE: 06/04 Eve Shift: 23:00-07:00 UTC (16:00-00:00 PST), all times posted in UTC
STATE of H1: Observing at 136Mpc
SHIFT SUMMARY:
H1 has now been locked for almost 17 hours. Other than a few small earthquakes passing through, very quiet shift. Wind and seismic are low.
ETMX saturations at 23:22, 23:32, 01:30, 02:25 (included a large DCPD saturation).
Handing off to Tony for the overnight.
LOG:
No log for this shift.
Magnitude 5.8 earthquake from New Zealand caused a lockloss before we could reach low noise.