An earlier glitch required a restart of all models at EY (h1susey, h1seiey, h1iscey and h1susauxey). The order was to stop all models on the Dolphin'ed machines, then start all the models in the order h1iscey, h1seiey and h1susey. Then the sus aux was stop-started. Finally all IPC errors and CRCs were cleared.
Later an unknown glitch caused the models on h1sush2b (sus-im system) to stop. The dmesg is just showing Dolphin-like errors. I stopped and restarted the two models on this system.
WP 7064
FRS 8013
alog 35974
alog 37169
Continued looking at the ~4300 ct offset on some of the monitor channels for ETMY L1 (UIM). SCSI cable was disconnected from both the AA and IO chassis. Visual inspection showed no bending of pins on either the cable or connectors. Cable was reconnected and all monitor signals showed reasonable values, no offset. Missing mounting hardware was placed on the ADC interface cards on the IO chassis. During this work, the front end computers at EY glitched and had to be restarted.
I performed the weekly PSL FAMIS tasks during today's maintenance window.
HPO Pump Diode Operating Current Adjustment (FAMIS 8429)
All HPO pump diode operating currents were increased by 0.2 A (this was done with the ISS OFF). The first attachment shows the diode box decay over the last 7 days, and the second shows the PSL Beckhoff main screen after the operating current adjustment was complete (included for future reference). The below table summarizes the operating current change:
| Operating Current (A) | ||
| Old | New | |
| DB1 | 48.7 | 48.9 |
| DB2 | 51.6 | 51.8 |
| DB3 | 51.6 | 51.8 |
| DB4 | 51.6 | 51.8 |
I did not adjust the operating temperatures of the diode boxes. The ISS has been turned back ON and the PSL is now outputting 157.5 W. This completes FAMIS 8429.
Power Watchdog Reset
I reset both PSL power watchdogs at 16:22 UTC (9:22 PDT). This completes FAMIS 3657.
TITLE: 07/05 Owl Shift: 07:00-15:00 UTC (00:00-08:00 PST), all times posted in UTC
STATE of H1: Observing at 65Mpc
INCOMING OPERATOR: Jim
SHIFT SUMMARY:
Quiet shift with H1 locked for 16hrs in quiet seismic conditions & Wed Maintenance Day begins.
TITLE: 07/05 Owl Shift: 07:00-15:00 UTC (00:00-08:00 PST), all times posted in UTC
STATE of H1: Observing at 67Mpc
OUTGOING OPERATOR: Cheryl
CURRENT ENVIRONMENT:
Wind: 6mph Gusts, 3mph 5min avg
Primary useism: 0.01 μm/s
Secondary useism: 0.06 μm/s
No wind & usieism in the weeds. Nice quiet night (knock on wood).
QUICK SUMMARY:
video0 & video4 are down, so I'll bring them back as I go through the Ops Checksheet as well. Whoops, and L1 just went down as well.
TITLE: 07/05 Eve Shift: 23:00-07:00 UTC (16:00-00:00 PST), all times posted in UTC
STATE of H1: Observing at 67Mpc
INCOMING OPERATOR: Corey
SHIFT SUMMARY: locked most of the shift
LOG:
TITLE: 07/04 Eve Shift: 23:00-07:00 UTC (16:00-00:00 PST), all times posted in UTC
STATE of H1: Observing at 66Mpc
OUTGOING OPERATOR: Patrick
CURRENT ENVIRONMENT:
Wind: 6mph Gusts, 3mph 5min avg
Primary useism: 0.03 μm/s
Secondary useism: 0.06 μm/s
QUICK SUMMARY: H1 in Observe, 4:23UTC - EY CRC error, checked summary page and looks ok
TITLE: 07/04 Day Shift: 15:00-23:00 UTC (08:00-16:00 PST), all times posted in UTC STATE of H1: Observing at 66Mpc INCOMING OPERATOR: Cheryl SHIFT SUMMARY: Recovered from lock loss without major issues, except that the RF45 seemed to be glitching until the REDUCE_RF45_MODULATION_DEPTH state. Rick gave a tour to 5 guests earlier in the morning. LOG: 17:44 UTC Rick and 5 guests walking to overpass 18:04 - 18:30 UTC Rick and guests in control room 22:13 UTC Lockloss 22:57 UTC Back to observing
Lockloss at 22:13 UTC. No immediate apparent cause. RF glitching during reacquisition. Seems to have subsided after REDUCE_RF45_MODULATION_DEPTH state. Back to observing at 22:57 UTC.
It appears we have successfully ridden through a 5.9 magnitude earthquake in Chile. Rick took 5 guests to the overpass and into the control room. We have remained in observing mode with no issues.
Just noticed on BLRMS. No verbal alarm. LLO has dropped lock. LHO has so far remained locked. USGS has the depth at 10 km. Seismon has the depth at 1.0 km.
TITLE: 07/04 Day Shift: 15:00-23:00 UTC (08:00-16:00 PST), all times posted in UTC
STATE of H1: Observing at 65Mpc
OUTGOING OPERATOR: Corey
CURRENT ENVIRONMENT:
Wind: 2mph Gusts, 0mph 5min avg
Primary useism: 0.01 μm/s
Secondary useism: 0.06 μm/s
QUICK SUMMARY: No issues.
TITLE: 07/04 Owl Shift: 07:00-15:00 UTC (00:00-08:00 PST), all times posted in UTC
STATE of H1: Observing at 65Mpc
INCOMING OPERATOR: Patrick
SHIFT SUMMARY:
Decent shift with only a few glitches. Lock approaching 35hrs at a steady 65Mpc. Most of the shift the PCal y DIAG_MAIN alert was not around, but it appeared at the end of the shift.
Today would normally be a Maintenance Tuesday, but this week we are making it a Maintenance Wednesday due to today's holiday.
LOG:
13:58utc (6:58amPDT) - 14:36: Ace Portapotty contractor allowed onsite.
Since they will only be driving down the arms & staying outside, will keep H1 in OBSERVING.
Approaching 31hrs of lock. H1 running at steady 65Mpc.
Took a peak toward the fire area and might have saw a faint glow on the other side of the Umtanum Ridge---nothing to worry about.
edit: ~4:10 amPDT Saw a vehicle lingering around the LHO entrance, then the sign and then parking a while from the sign for ~15min.
T240 Centering Check:
Averaging Mass Centering channels for 10 [sec] ...
2017-07-04 02:46:11.358502
There are 8 T240 proof masses out of range ( > 0.3 [V] )!
ETMX T240 2 DOF X/U = -1.166 [V]
ETMX T240 2 DOF Y/V = -1.116 [V]
ETMX T240 2 DOF Z/W = -0.848 [V]
ETMY T240 3 DOF X/U = -0.305 [V]
ITMX T240 1 DOF X/U = -0.774 [V]
ITMX T240 3 DOF X/U = -0.802 [V]
ITMY T240 3 DOF X/U = -0.305 [V]
ITMY T240 3 DOF Z/W = -0.386 [V]
All other proof masses are within range ( < 0.3 [V] ):
ETMX T240 1 DOF X/U = -0.08 [V]
ETMX T240 1 DOF Y/V = -0.055 [V]
ETMX T240 1 DOF Z/W = -0.034 [V]
ETMX T240 3 DOF X/U = -0.073 [V]
ETMX T240 3 DOF Y/V = -0.179 [V]
ETMX T240 3 DOF Z/W = -0.079 [V]
ETMY T240 1 DOF X/U = -0.071 [V]
ETMY T240 1 DOF Y/V = 0.239 [V]
ETMY T240 1 DOF Z/W = -0.279 [V]
ETMY T240 2 DOF X/U = 0.113 [V]
ETMY T240 2 DOF Y/V = -0.27 [V]
ETMY T240 2 DOF Z/W = -0.004 [V]
ETMY T240 3 DOF Y/V = -0.089 [V]
ETMY T240 3 DOF Z/W = 0.224 [V]
ITMX T240 1 DOF Y/V = -0.234 [V]
ITMX T240 1 DOF Z/W = -0.156 [V]
ITMX T240 2 DOF X/U = -0.186 [V]
ITMX T240 2 DOF Y/V = -0.142 [V]
ITMX T240 2 DOF Z/W = -0.199 [V]
ITMX T240 3 DOF Y/V = -0.146 [V]
ITMX T240 3 DOF Z/W = -0.096 [V]
ITMY T240 1 DOF X/U = -0.039 [V]
ITMY T240 1 DOF Y/V = -0.057 [V]
ITMY T240 1 DOF Z/W = -0.065 [V]
ITMY T240 2 DOF X/U = 0.114 [V]
ITMY T240 2 DOF Y/V = 0.135 [V]
ITMY T240 2 DOF Z/W = -0.005 [V]
ITMY T240 3 DOF Y/V = 0.041 [V]
BS T240 1 DOF X/U = -0.166 [V]
BS T240 1 DOF Y/V = -0.039 [V]
BS T240 1 DOF Z/W = 0.204 [V]
BS T240 2 DOF X/U = 0.062 [V]
BS T240 2 DOF Y/V = 0.179 [V]
BS T240 2 DOF Z/W = 0.008 [V]
BS T240 3 DOF X/U = 0.011 [V]
BS T240 3 DOF Y/V = -0.067 [V]
BS T240 3 DOF Z/W = -0.127 [V]
Assessment complete.
STS Centering Check:
Averaging Mass Centering channels for 10 [sec] ...
2017-07-04 02:52:11.355942
All STSs proof masses are within healthy range (< 2.0 [V]). Great!
Here's a list of how they're doing just in case you care:
STS A DOF X/U = -0.618 [V]
STS A DOF Y/V = 0.146 [V]
STS A DOF Z/W = -0.377 [V]
STS B DOF X/U = 0.479 [V]
STS B DOF Y/V = 0.3 [V]
STS B DOF Z/W = -0.312 [V]
STS C DOF X/U = -0.616 [V]
STS C DOF Y/V = -0.67 [V]
STS C DOF Z/W = -0.153 [V]
STS EX DOF X/U = -0.029 [V]
STS EX DOF Y/V = 0.612 [V]
STS EX DOF Z/W = -0.036 [V]
STS EY DOF X/U = -0.014 [V]
STS EY DOF Y/V = 0.147 [V]
STS EY DOF Z/W = 0.458 [V]
Assessment complete.
This closes FAMIS #6088.
I took the opportunity while the IFO was down for PSL stuff to recent ITMX and ETMX. Will wait for the others to get worse before addressing them.
Averaging Mass Centering channels for 10 [sec] ...
2017-07-05 09:39:18.356265
There are 3 T240 proof masses out of range ( > 0.3 [V] )!
ETMY T240 3 DOF X/U = -0.309 [V]
ITMY T240 3 DOF X/U = -0.307 [V]
ITMY T240 3 DOF Z/W = -0.39 [V]
All other proof masses are within range ( < 0.3 [V] ):
ETMX T240 1 DOF X/U = 0.118 [V]
ETMX T240 1 DOF Y/V = 0.121 [V]
ETMX T240 1 DOF Z/W = 0.106 [V]
ETMX T240 2 DOF X/U = 0.07 [V]
ETMX T240 2 DOF Y/V = 0.062 [V]
ETMX T240 2 DOF Z/W = 0.095 [V]
ETMX T240 3 DOF X/U = 0.058 [V]
ETMX T240 3 DOF Y/V = 0.022 [V]
ETMX T240 3 DOF Z/W = 0.134 [V]
ETMY T240 1 DOF X/U = -0.078 [V]
ETMY T240 1 DOF Y/V = 0.243 [V]
ETMY T240 1 DOF Z/W = -0.283 [V]
ETMY T240 2 DOF X/U = 0.114 [V]
ETMY T240 2 DOF Y/V = -0.272 [V]
ETMY T240 2 DOF Z/W = -0.008 [V]
ETMY T240 3 DOF Y/V = -0.096 [V]
ETMY T240 3 DOF Z/W = 0.224 [V]
ITMX T240 1 DOF X/U = 0.074 [V]
ITMX T240 1 DOF Y/V = 0.196 [V]
ITMX T240 1 DOF Z/W = 0.188 [V]
ITMX T240 2 DOF X/U = 0.136 [V]
ITMX T240 2 DOF Y/V = 0.211 [V]
ITMX T240 2 DOF Z/W = 0.245 [V]
ITMX T240 3 DOF X/U = 0.193 [V]
ITMX T240 3 DOF Y/V = 0.163 [V]
ITMX T240 3 DOF Z/W = 0.166 [V]
ITMY T240 1 DOF X/U = -0.038 [V]
ITMY T240 1 DOF Y/V = -0.055 [V]
ITMY T240 1 DOF Z/W = -0.065 [V]
ITMY T240 2 DOF X/U = 0.115 [V]
ITMY T240 2 DOF Y/V = 0.135 [V]
ITMY T240 2 DOF Z/W = -0.004 [V]
ITMY T240 3 DOF Y/V = 0.043 [V]
BS T240 1 DOF X/U = -0.166 [V]
BS T240 1 DOF Y/V = -0.039 [V]
BS T240 1 DOF Z/W = 0.206 [V]
BS T240 2 DOF X/U = 0.062 [V]
BS T240 2 DOF Y/V = 0.181 [V]
BS T240 2 DOF Z/W = 0.008 [V]
BS T240 3 DOF X/U = 0.013 [V]
BS T240 3 DOF Y/V = -0.066 [V]
BS T240 3 DOF Z/W = -0.128 [V]
Laser Status:
SysStat is good
Front End Power is 33.94W (should be around 30 W)
HPO Output Power is 156.7W
Front End Watch is GREEN
HPO Watch is GREEN
PMC:
It has been locked 6 days, 16 hr 55 minutes (should be days/weeks)
Reflected power = 17.64Watts
Transmitted power = 55.9Watts
PowerSum = 73.54Watts.
FSS:
It has been locked for 1 days 6 hr and 33 min (should be days/weeks)
TPD[V] = 2.787V (min 0.9V)
ISS:
The diffracted power is around 3.7% (should be 3-5%)
Last saturation event was 1 days 6 hours and 33 minutes ago (should be days/weeks)
Possible Issues:
PMC reflected power is high (Attaching trend of last 45 days.)
This closes FAMIS 7445.