TITLE: 09/27 [DAY Shift]: 15:00-23:00 UTC (08:00-16:00 PDT), all times posted in UTC
STATE Of H1: Observing at ~73 Mpc. The ifo has been locked 42 hours now.
SUPPORT: Mike
QUICK SUMMARY: The RF45 hasn't been acting up much (Laura suggested it probably was acting up between ~20:00-21:00 UTC, but the glitches was probably settle since it didn't set off the Verbal alarm) . Hardly any ETMY glitches alarm today. Wind speed ~10 mph. Seismic activity in 0.03-0.1 Hz band coming back to nominal.
INCOMING OPERATOR: Patrick
ACTIVITY LOG:
NO ACIVITY. It's been a boring shift (good for science!).
A 4.9M earthquake in Chile is coming through. Wind speed ~10mph. Increasing seismic activity in the earthquake band. Only one ETMY glitch caused by the 45 MHz so far.
Parameters:
GPS Start Time = 1127333892 # Beginning of time span, in GPS seconds, to search for injections
GPS End Time = 1127420292 # Ending of time span, in GPS seconds, to search for injections
Check Hanford IFO = True # Check for injections in the Hanford IFO frame files.
Check Livingston IFO = True # Check for injections in the Livingston IFO frame files.
IFO Coinc Time = 0.01 # Time window, in seconds, for coincidence between IFO injection events.
Check ODC_HOFT = True # Check ODC-MASTER_CHANNEL_OUT_DQ channel in HOFT frames.
Check ODC_RAW = True # Check ODC-MASTER_CHANNEL_OUT_DQ channel in RAW frames.
Check ODC_RDS = True # Check ODC-MASTER_CHANNEL_OUT_DQ channel in RDS frames.
Check GDS_HOFT = True # Check GDS-CALIB_STATE_VECTOR channel in HOFT frames.
Report Normal = True # Include normal (IFO-coincident, consistent, and scheduled for network injections and consistent and scheduled for IFO injections) injections in report
Report Anomalous = True # Include anomalous (non-IFO-coincident, inconsistent, or unscheduled) injections in report
No injections found. No scheduled injections within the time span checked.
TITLE: 09/27 [DAY Shift]: 15:00-23:00 UTC (08:00-16:00 PDT), all times posted in UTC
STATE Of H1: Observing at ~70Mpc. The ifo has been locked for 36 HOURS!
OUTGOING OPERATOR: Ed M.
QUICK SUMMARY: 45 MHz EOM driver hasn't been glitching since shift started. Mike called to give advice on how to fix GraceDB query issue. I'm reading 0 mph wind speed everywhere on the PEM weather medm screen. A little bit of seismic activity in 3-10 Hz band which seems to correspond to the slight drop in BNS range but otherwise everything else looks quiet. The ifo is locking and going strong.
ER8 day 33 (last day). O1 days 1 - 9
Fri 18 - Mon 21: No Restarts Reported
model restarts logged for Tue 22/Sep/2015
2015_09_22 10:57 h1nds0
2015_09_22 10:57 h1nds1
2015_09_22 11:22 h1broadcast0
Maintenance Tuesday. NDS starts related to offloading raw minute trends from SSD. Detchar O1 DMT channel list applied to broadcaster.
Wed 23 - Sat 26: No Restarts Reported
I simply logged in to the alog using my credential on Ops station. I opened up GraceDB webpage and noticed that the GraceDB querying is good again.
Please disregard the alog. Mike just told me that GraceDB working was coincidence with Dave restarting the Python script. It wasn't me...
The ext_alert.py script which periodically views GraceDB had failed. I have just restarted it, instructions for restarting are in https://lhocds.ligo-wa.caltech.edu/wiki/ExternalAlertNotification
Getting this process to autostart is now on our high priority list (FRS3415).
here is the error message displayed before I did the restart.
File "ext_alert.py", line 150, in query_gracedb
return query_gracedb(start, end, connection=connection, test=test)
File "ext_alert.py", line 150, in query_gracedb
return query_gracedb(start, end, connection=connection, test=test)
File "ext_alert.py", line 135, in query_gracedb
external = log_query(connection, 'External %d .. %d' % (start, end))
File "ext_alert.py", line 163, in log_query
return list(connection.events(query))
File "/usr/lib/python2.7/dist-packages/ligo/gracedb/rest.py", line 441, in events
uri = self.links['events']
File "/usr/lib/python2.7/dist-packages/ligo/gracedb/rest.py", line 284, in links
return self.service_info.get('links')
File "/usr/lib/python2.7/dist-packages/ligo/gracedb/rest.py", line 279, in service_info
self._service_info = self.request("GET", self.service_url).json()
File "/usr/lib/python2.7/dist-packages/ligo/gracedb/rest.py", line 325, in request
return GsiRest.request(self, method, *args, **kwargs)
File "/usr/lib/python2.7/dist-packages/ligo/gracedb/rest.py", line 201, in request
response = conn.getresponse()
File "/usr/lib/python2.7/httplib.py", line 1038, in getresponse
response.begin()
File "/usr/lib/python2.7/httplib.py", line 415, in begin
version, status, reason = self._read_status()
File "/usr/lib/python2.7/httplib.py", line 371, in _read_status
line = self.fp.readline(_MAXLINE + 1)
File "/usr/lib/python2.7/socket.py", line 476, in readline
data = self._sock.recv(self._rbufsize)
File "/usr/lib/python2.7/ssl.py", line 241, in recv
return self.read(buflen)
File "/usr/lib/python2.7/ssl.py", line 160, in read
return self._sslobj.read(len)
ssl.SSLError: The read operation timed out
I have patched the ext_alert.py script to catch SSLError exceptions and retry the query [r11793]. The script will retry up to 5 times before crashing completely, which is something we may want to rethink if we have to.
I have request both sites to svn up and restart the ext_alert.py process at the next convenient opportunity (the next time it crashes).
TITLE: Sep 26 OWL Shift 23:00-07:00UTC (16:00-00:00 PDT), all times posted in UTC
STATE Of H1: Observing
LOCK DURATION: Entire Shift
SUPPORT: N/A
INCOMING OPERATOR: Nutsinee
Activity log:
09:13 SUS E_T_M_Y saturating (Sun Sep 27 9:13:21 UTC)
09:13 SUS E_T_M_Y saturating (Sun Sep 27 9:13:23 UTC) .6Mpc
10:19 SUS E_T_M_Y saturating (Sun Sep 27 10:19:5 UTC) 3Mpc
11:45 SUS E_T_M_Y saturating (Sun Sep 27 11:45:40 UTC) odd...no loss of range
12:21 Noticed the GraceDB quey failure.
14:15 Mike checked in by telephone. He suggested that I e-mail Duncan, Leo and Peter S about the GraceDB query failure that has existed for the duration of my shift.
Shift Summary: Smooth sailing with the IFO locked at 74Mpc. Wind speeds <10mph. 4 ETMY glitches. No obtrusive seismic or weather activity. I e-mailed Duncan, Leo and Peter S about the GraceDB query failure that has existed for the duration of my shift. Handing off to Nutsinee.
Mid-Shift Summary: Smooth sailing so far with the IFO locked at 74Mpc. Wind speeds have decreased to <5mph. 3 ETMY glitches so far.
TITLE: Sep 27 OWL Shift 07:00-15:00UTC (00:00-08:00 PDT), all times posted in UTC
STATE Of H1: Observing
OUTGOING OPERATOR: Patrick
QUICK SUMMARY:. IFO Locked at 70Mpc/22.9W. No injections are running. All lights are off in LVEA, MID, END and PSL. Wind is below 15mph. Microseism seems to be riding steady @ ~.1µm/s. EQ seismic seems nominally steady @ .2µm/s. No noticable 45Mhz RFAM glitching noticible in triggers, in the last hour at least. Verbal Alarms is down on FOM,Video5.
TITLE: 09/26 [EVE Shift]: 23:00-07:00 UTC (16:00-00:00 PDT), all times posted in UTC STATE Of H1: Observing, ~71 MPc SHIFT SUMMARY: Remainder of shift quiet except for SUS ETMY saturations. Wind has come back below 20 mph. Seismic in 0.03 - 0.1 Hz is coming down at end X and end Y. INCOMING OPERATOR: Ed ACTIVITY LOG: 03:59 - 4:06 UTC Stepped out of control room ETMY SUS Saturations: SUS E_T_M_Y saturating (Sat Sep 27 0:2:19 UTC) SUS E_T_M_Y saturating (Sat Sep 27 0:14:27 UTC) SUS E_T_M_Y saturating (Sat Sep 27 0:57:42 UTC) SUS E_T_M_Y saturating (Sat Sep 27 2:23:2 UTC) SUS E_T_M_Y saturating (Sat Sep 27 2:23:5 UTC) SUS E_T_M_Y saturating (Sat Sep 27 2:40:7 UTC) SUS E_T_M_Y saturating (Sat Sep 27 2:41:41 UTC) SUS E_T_M_Y saturating (Sat Sep 27 3:20:30 UTC) SUS E_T_M_Y saturating (Sat Sep 27 4:0:59 UTC) SUS E_T_M_Y saturating (Sat Sep 27 4:18:21 UTC) SUS E_T_M_Y saturating (Sat Sep 27 5:0:57 UTC) SUS E_T_M_Y saturating (Sat Sep 27 5:7:52 UTC) SUS E_T_M_Y saturating (Sat Sep 27 6:20:14 UTC)
23:12 UTC Tour in control room before 23:36 UTC Tour out of control room 23:37 - 23:39:10 UTC Stepped out of control room 23:55 UTC Tour in control room 00:13 UTC Tour out of control room 00:30 - 00:39 UTC Stepped out of control room 7 SUS ETMY saturations. Range is starting to trend down over last hour, now at ~ 65 MPc. Winds have ranged up to 30 mph. Seismic in 0.03 - 0.1 Hz band at end X and end Y has come up to ~ .1 um/s. Corner station is at ~ .01 um/s. Have remained in observation mode since beginning of shift.
Executive summary:
A matlab file (37 MB) containing the averaged inverse-noise-weighted spectrum from the first week can be found here: https://ldas-jobs.ligo.caltech.edu/~keithr/spectra/O1/H1_O1_week1_0-2000_Hz.mat Because of the way multiple epochs are handled, the matlab variable structure is non-obvious. Here is how to plot the full spectrum after loading the file: semilogy(freqcommon,amppsdwt{1,1})
Keith has found: "There is a sporadic comb-on-comb with 0.088425-Hz fine spacing that appears with limited spans in three places near harmonics of 77, 154 and 231 Hz (ambiguity in precise fundamental frequency)" Using the coherence tool, we have seen coherence between h(t) and a number of auxiliary channels that shows this comb around 77 Hz. Seems to be around the input optics, in channels: H1:PEM-CS_MAG_LVEA_INPUTOPTICS_Z_DQ H1_SUS-ITMY_L1_WIT_L_DQ H1:SUS-BS_M1_DAMP_L_IN1_DQ H1_SUS-ITMY_L1_WIT_P_DQ H1:SUS-BS_M1_DAMP_T_IN1_DQ H1_SUS-ITMY_L1_WIT_Y_DQ H1:SUS-BS_M1_DAMP_V_IN1_DQ H1_SUS-ITMY_L2_WIT_L_DQ H1:SUS-BS_M1_DAMP_Y_IN1_DQ H1_SUS-ITMY_L2_WIT_Y_DQ See the attached figures. Nelson, Soren Schlassa, Nathaniel Strauss, Michael Coughlin, Eric Coughlin, Pat Meyers
The structure at 76.4Hz Nelson listed some channels for above shows up in at least 50 other channels. Greatest coherence is consistently at 76.766 Hz, second greatest is (mostly) consistently at 76.854Hz. Spacing between the two combs is about 0.0013Hz. The epicenter seems to be the INPUTOPTICS/the SUS-BS and SUS-ITM* channels, like Nelson said (see below for fuller list). The plots above are pretty typical, but I have plots for all channels listed and can post any more that are useful. Most or all channels showing the comb with max coherence greater than 0.1 are listed below. Max coherences over 0.2 are marked below as strong, and max coherences under 0.15 as weak. Those marked strongest are around 0.22. I haven't included anything of max coherence <0.1 but I'm sure there are many. H1:ASC-AS_A_RF36_I_PIT_OUT_DQ (weak) H1:ASC-AS_A_RF36_I_YAW_OUT_DQ H1:ASC-AS_A_RF36_Q_PIT_OUT_DQ H1:ASC-AS_A_RF36_Q_YAW_OUT_DQ (weak) H1:ASC-AS_B_RF36_I_YAW_OUT_DQ H1:ASC-AS_B_RF36_Q_YAW_OUT_DQ (strong) H1:ISI-BS_ST2_BLND_RZ_GS13_CUR_IN1_DQ (strong) H1:ISI-BS_ST2_BLND_Z_GS13_CUR_IN1_DQ (strong) H1:ISI-HAM2_BLND_GS13RZ_IN1_DQ H1:ISI-HAM2_BLND_GS13Z_IN1_DQ H1:ISI-HAM3_BLND_GS13Z_IN1_DQ (strong) H1:ISI-HAM5_BLND_GS13RZ_IN1_DQ H1:ISI-HAM5_BLND_GS13Z_IN1_DQ H1:ISI-HAM6_BLND_GS13RZ_IN1_DQ H1:ISI-ITMX_ST2_BLND_RX_GS13_CUR_IN1_DQ (weak) H1:ISI-ITMX_ST2_BLND_Z_GS13_CUR_IN1_DQ (strong) H1:ISI-ITMY_ST1_BLND_RZ_T240_CUR_IN1_DQ (weak) H1:ISI-ITMY_ST1_BLND_Y_T240_CUR_IN1_DQ (weak) H1:ISI-ITMY_ST2_BLND_RZ_GS13_CUR_IN1_DQ (strong) H1:ISI-ITMY_ST2_BLND_Z_GS13_CUR_IN1_DQ (strong) H1:LSC-PRCL_IN1_DQ H1:PEM-CS_LOWFMIC_LVEA_VERTEX_DQ (strong) H1:PEM-CS_MAG_LVEA_INPUTOPTICS_Y_DQ (strongest) H1:PEM-CS_MAG_LVEA_INPUTOPTICS_Z_DQ (strong) H1:SUS-BS_M1_DAMP_L_IN1_DQ (strongest) H1:SUS-BS_M1_DAMP_T_IN1_DQ (strong) H1:SUS-BS_M1_DAMP_V_IN1_DQ (strong) H1:SUS-BS_M1_DAMP_Y_IN1_DQ (strong) H1:SUS-ITMX_M0_DAMP_R_IN1_DQ (strong) H1:SUS-ITMX_M0_DAMP_V_IN1_DQ (strong) H1:SUS-ITMY_L1_WIT_L_DQ (strong) H1:SUS-ITMY_L1_WIT_P_DQ (strong) H1:SUS-ITMY_L1_WIT_Y_DQ (strong) H1:SUS-ITMY_L2_WIT_L_DQ (strong) H1:SUS-ITMY_L2_WIT_P_DQ (strong) H1:SUS-ITMY_L2_WIT_Y_DQ (strong) H1:SUS-MC1_M3_WIT_L_DQ H1:SUS-MC1_M3_WIT_P_DQ (weak) H1:SUS-MC2_M1_DAMP_L_IN1_DQ H1:SUS-MC2_M1_DAMP_T_IN1_DQ H1:SUS-MC2_M1_DAMP_Y_IN1_DQ H1:SUS-PR2_M1_DAMP_P_IN1_DQ H1:SUS-PR2_M1_DAMP_R_IN1_DQ H1:SUS-PR2_M1_DAMP_V_IN1_DQ H1:SUS-PR2_M3_WIT_L_DQ H1:SUS-PR2_M3_WIT_P_DQ (weak) H1:SUS-PR2_M3_WIT_Y_DQ (weak) H1:SUS-PR3_M1_DAMP_P_IN1_DQ H1:SUS-PR3_M1_DAMP_V_IN1_DQ H1:SUS-PRM_M1_DAMP_L_IN1_DQ (strongest) H1:SUS-PRM_M1_DAMP_T_IN1_DQ H1:SUS-PRM_M1_DAMP_Y_IN1_DQ (strong)
The 99.9989Hz comb Keith found (designated H) appears in 109 channels (list is attached). Coherence is uniformly greatest at the ~500Hz harmonic, with many channels approaching .7 and greater, drops off sharply at the ~600Hz and ~700Hz, and is invisible after 700. (See spreadsheet titled "comb_H_sigcohs_wk1.xslx" for a list of cohering channels by line, with coherence value.) At all harmonics except the ~300Hz, the structure manifests in the signal and the coherences as two lines .001Hz apart, but if I recall correctly .001Hz is the resolution of the frequency series, so it's safer to say that this is a bulge with .001Hz < width < .002Hz. At ~300Hz, almost all the cohering channels with data in that range show a bulge of width about 0.5Hz (see attached "disjoint_plots" for a comparison of typical channels by harmonic). This bulge, and the fact that it appears in all the same channels associated with the rest of the comb, makes me think that the fundamental may be the bulge at ~300Hz and not the line at 99.9989Hz. An interesting feature of the bulge is that in many cases, it has a prominent upward or downward spike at 299.96Hz, which is just the place the line would be if it were there (see "bulge_w_spike.jpg"). More to come re: changes in week 4 data, patterns in cohering channels, and the spike.
LHO hosted a public event this afternoon. Arrival time at LSB = 1:00 - 2:30 PM PM. Departure time = 3:00 - 5:00 PM. Group size = ~170 adults/children of all ages. Vehicles at the LSB = ~50 passenger cars (very uncertain). A series of three walking tours between 3:00 and 5:00 brought a total of ~120 people into the control room during this time span.
TITLE: 09/26 [DAY Shift]: 15:00-23:00 UTC (08:00-16:00 PDT), all times posted in UTC
STATE Of H1: Observing at ~75 Mpc
SUPPORT: Mike
QUICK SUMMARY: Less 45MHz glitches during my shift. DHARD Y boost turned off (as MIke requested). Wind speed coming below 20 mph. Several small earthquakes throughout the shift.
INCOMING OPERATOR: Patrick
ACTIVITY LOG:
18:07 Jodi to high bay area looking for contamination control stuff. Still observing.
18:14 Jodi out
19:08 Switched the ifo to Commissioning to turn off the DHARD Y boost filter.
19:09 Back to Observing
22:33 A big tour group starting to march in the control room. ~20 adults. There was also a 5.1M earthquake at Pacific-Antarctic Ridge arrving at about the same time so there were glitches in DARM during the time. Just in case anyone wants to look into outreach noise.
22:46 Group leaving.
23:00 Handing off to Patrick.
TITLE: 09/26 [EVE Shift]: 23:00-07:00 UTC (16:00-00:00 PDT), all times posted in UTC STATE Of H1: Observing at ~71 MPc OUTGOING OPERATOR: Nutsinee QUICK SUMMARY: Lights appear off in the LVEA, PSL enclosure, end X, end Y and mid X. I can not tell from the camera if they are off at mid Y. Seismic in 0.03 - 0.1 Hz band is coming down from a small peak to ~.7 um/s. Seismic in 0.1 - 0.3 Hz band is around .09 um/s. Wind speeds are less than 20mph, may be coming down.
The LIGO-Caltech systems folks have set up a dedicated account for GWIstat and the associated processes that Chad set up to feed it information about the LIGO detectors, running on the ldas-grid machine at Caltech. The new URL for the GWIstat display is https://ldas-jobs.ligo.caltech.edu/~gwistat/, and it does not require ligo.org authentication any more. The old URL now redirects to the new URL. (At least I think so -- let me know if you run into any problems.) Due to moving GWIstat to its new location, the durations of the current observing segments are not reported correctly.
Parameters:
GPS Start Time = 1127247535 # Beginning of time span, in GPS seconds, to search for injections
GPS End Time = 1127333935 # Ending of time span, in GPS seconds, to search for injections
Check Hanford IFO = True # Check for injections in the Hanford IFO frame files.
Check Livingston IFO = True # Check for injections in the Livingston IFO frame files.
IFO Coinc Time = 0.01 # Time window, in seconds, for coincidence between IFO injection events.
Check ODC_HOFT = True # Check ODC-MASTER_CHANNEL_OUT_DQ channel in HOFT frames.
Check ODC_RAW = True # Check ODC-MASTER_CHANNEL_OUT_DQ channel in RAW frames.
Check ODC_RDS = True # Check ODC-MASTER_CHANNEL_OUT_DQ channel in RDS frames.
Check GDS_HOFT = True # Check GDS-CALIB_STATE_VECTOR channel in HOFT frames.
Report Normal = True # Include normal (IFO-coincident, consistent, and scheduled for network injections and consistent and scheduled for IFO injections) injections in report
Report Anomalous = True # Include anomalous (non-IFO-coincident, inconsistent, or unscheduled) injections in report
All injections found were UNSCHEDULED CBC injections in H1. There were no injections found in L1. All injections were consistent.