Due to a number of bugs and other issues, analysis reports from HWInjReport had been suspended indefinitely until these issues could be resolved. I am happy to report that these issues have been resolved and have resulted in the release of HWInjReport v2.2. This version contains a number of fixes to the analysis logic to improve accuracy and reliability.
Several features were added to HWInjReport for this version. The first is that the application has been modified to use direct access to the data nodes when running on a CONDOR machine; this has the effect of significantly improving runtime by a factor 3 or better due to no longer needing to wait on the archive robot to load files, which was the case when running from LDAS-pcdev1, for instance. In part of this, HWInjReport now uses gw_data_find to find frame files instead of the deprecated ligo_data_find. The second feature is support for analyzing the CAL-INJ channel in RAW frame files and checking the TRANSIENT bit within that channel for hardware injections. The third feature is support for recognizing STOCHASTIC injections.
Also with this version, the output format has been compressed some for better readability (the output is not as wide as it originally was), and the threshold for IFO coincidence between Hanford and Livingston has been increased to 12ms from 10ms.
With these changes, version 2.2 is the latest stable release of HWInjReport. It is still expected that changes and improvements to the software will continue into the future as necessary; however, hopefully, these changes will not necessitate another cessation of analysis using HWInjReport due to validation issues.
TITLE: 11/17 [DAY Shift]: 15:00-23:00 UTC (08:00-16:00 PDT), all times posted in UTC STATE Of H1: Down SHIFT SUMMARY: Too windy to lock. Entire day devoted to maintenance. INCOMING OPERATOR: Ed (holding off on coming in upon instructions from Mike) ACTIVITY LOG: 15:00 Ken installing GPS clock in control room 15:07 Bubba and Peter K. to H2 PSL enclosure to check on makeup air fan 15:53 Jeff and Jodi to H2 PSL enclosure for OMC extraction 15:59 Jim B. restarting broadcaster daqd 16:03 Jim B. done restarting broadcaster daqd 16:16 Gerardo to LVEA to join Jeff and Jodi 16:16 Filiberto pulling cable from electronics room to H1 PSL racks over HAM1 and HAM2 for EOM monitoring chassis 16:21 Joe D. to check charge in scissor lift at end Y 16:23 Keita to H1 PSL enclosure to start installation of chassis. Karen going with him to clean. 16:34 Hugh to end stations to check HEPI fluid levels 16:34 Sudarshan to MSR to check PCAL camera 16:37 Jason to H1 PSL diode room to reset PSL watchdog 16:41 Jason done resetting PSL watchdog, going to end X and then end Y to zero optical levers 16:43 Vinnie and Borja to end Y for glitch hunting 16:52 Kyle going back and forth to X28 in preparation for baking ion pump 17:08 Bubba done checking H2 PSL enclosure makeup air fan 17:16 LN2 delivery through gate (two trucks) 17:20 Joe D. back from end Y 17:21 Ryan working on alog 17:24 Sand truck through gate 17:24 Travis at end Y restarting PCAL camera 17:28 Travis done 17:28 Rick and Evan to end stations to put tamper stickers on PCAL hardware 17:37 Hugh and Travis back 17:37 Jason done at end X, going to end Y 17:39 Filiberto done pulling cable in LVEA, going to end Y to pull fiber for vacuum gauge 17:40 LN2 truck through gate 17:42 Bubba and John to end Y to check for noise from trap primers 17:54 Karen and Christina done cleaning in the LVEA, going to end stations. Christina reports a problem with the card reader between the LVEA and high bay. 17:56 Ryan done working on alog 18:17 Jodi and Jeff done. OMC extracted and craned over beamtube. 18:23 Gerardo out of LVEA 18:14 Started trying to lock ALS. 18:31 Arms would not stay locked on green. Gave up and put guardian back to down state. 18:32 Bubba and John back from end Y. Bubba getting meter left in LVEA. 18:37 Jason done zeroing optical levers at end stations, going to zero optical levers in LVEA 18:37 Offloaded SR3 M2 per "SR3 Cage Servo warning: Align SR3 to offload M2 actuators" guardian notice. Jenne put instructions in the ops "Troubleshooting the IFO" wiki. 18:42 Karen and Christina done at end Y, heading to end X 18:47 Betsy to electronics room to take picture of wifi cable for wiki 18:48 Rick and Evan done putting tamper stickers on PCAL hardware 18:56 Betsy to turn on wifi in LVEA for Jason in LVEA 19:01 Keita done installing chassis, starting rephasing 19:04 US Linen delivery, LN2 truck leaving 19:08 Jeff B. working on dust monitor plugging near HAM4 and HAM5 19:13 Pressed 'DAQ Clear Accumulated CRC' on CDS overview 19:15 Joe D. to end Y to unplug battery charger 19:26 Travis to end X and end Y to install protection covers on PCAL hardware 19:31 Karen and Christina done cleaning, leaving end X 19:38 Restarted CDS and OPS overview on video2. Dave changed the OPS overview medm to increase the gracedb query failure notice timeout time. 19:47 Filiberto done pulling fiber for vacuum gauge at end Y, going to pull fiber for vacuum gauge at end X 19:49 Hugh to LVEA to inventory 3IFO equipment 19:50 Jeff B. done 19:56 Joe D. back 19:58 Jeff B. back to LVEA to make one connection on dust monitor plumbing 20:11 Keita done rephasing 20:11 Betsy starting charge measurements 20:15 Jason done 20:21 Hugh done 20:30 Madeline W. updating calibration filters (WP5605). Notified over teamspeak. 20:31 Travis back 20:33 Madeline W. done. "The DMT/GDS h(t) pipeline is restarted and running again at LHO" 20:55 Vinnie and Borja back 21:20 Charge measurements done 21:21 Filiberto back 21:31 Dave restarting DAQ 21:31 Keita and Kiwamu remeasuring phase 21:50 Kyle and Gerardo to X28 to drill anchor holes 22:23 Keita and Kiwamu done 22:36 Bubba to mid X to check water/fogging on surveillance camera lens 22:47 Keita to PSL enclosure to measure RF level 22:56 Vinnie and Borja back to end Y to recheck glitch hunting results 22:58 Beckhoff SDF crashed, Dave leaving off, EDCU is red 23:07 Bubba back from mid X 23:07 Kyle and Gerardo back 23:20 Keita done 00:11 Power glitch !!! 00:14 Vinnie and Borja back 00:18 Dave restarting h1lsc0
With help from Peter King and Ken from S&K Electric we determined that the disconnect was turned off for the H-2 PSL make up air fan. I turned the disconnect on and the fan is working properly now. The fan disconnect was not labeled, however, Peter said he would print a label and install it on the disconnect.
Cleared counters in attached screenshot.
I took a few charge measurements this morning, however a few of each set were garbage due to an atttempted MICH lock. Then, the other few look noisy due to the ongoing 30-70mph winds we've felt all morning. I'll try to catch a quieter period for more measurements this week. Plots coming...
Winds are too high to lock so maintenance is running past noon.
I've updated tinj.m to use CAL-PINJX_TINJ* instead of CAL-INJ_TINJ*. The new changes have been implemented at LHO. The EPICs records changed are: * H1:CAL-PINJX_TINJ_STATE * H1:CAL-PINJX_TINJ_START * H1:CAL-PINJX_TINJ_ENDED * H1:CAL-PINJX_TINJ_TYPE * H1:CAL-PINJX_TINJ_ENABLE * H1:CAL-PINJX_TINJ_PAUSE * H1:CAL-PINJX_TINJ_OUTCOME To do this: (1) Edited tinj.m to replace CAL-INJ_TINJ* with CAL-PINJX_TINJ*. The only exception was CAL-INJ_EXTTRIG_ALERT_TIME since ext_alert.py still uses this channel and has not been switched over yet. (2) At 20:57 UTC turned run_tinj off with the monit web interface. (3) Compile run_tinj using: mcc -R -nojvm -R -nodisplay -R -singleCompThread -m run_tinj (4) At 21:00 UTC turned run_tinj on with the monit web interface. (5) Commit changes. I checked tinj.log and it was updating as expected. We will need to coordinate the switch-over of CAL-INJ_EXTTRIG_ALERT_TIME to CAL-PINJX_EXTTRIG_ALERT_TIME. And update LLO to this version as well.
Because Dave is finding that these are changing more frequently and thus causing him to commit more SDF snap files to the svn than he had originally planned for, I finished setting all of the SUS OPTICALIGN PIT and YAW channels (just 2 per each SUS) to not be monitored by the SDF. I also started clearing house on the new BECKHOFF SDF. In OBSERVE, this system sees more channel settings which differ from lock stretch to lock stretch. The following were set to NOT MON in SDF:
H1:*-*_*_LIMITCOUNT (Counter channelswhich have just been incrementing since the begining of the run)
H1:ALS-C_COMM_VCO_CONTROLS_SETFREQUENCY (Changes by very small amounts from lock to lock for ALS locking)
Today I re-zeroed all of the active H1 optical levers. The table below shows their pitch/yaw values before re-zeroing and the values as they read when I finished each oplev (there could be relaxation in the motors causing a slow, slight drift, especially in the BS and HAM2 oplevs which are zeroed with piezo motors steering a 2" turning mirror). This closes work permit #5606.
Optical Lever | Old (µrad) | New (µrad) | ||
Pitch | Yaw | Pitch | Yaw | |
ETMx | -2.4 | -2.2 | -0.2 | 0.3 |
ETMy | -1.3 | -6.7 | 0.1 | 0.0 |
ITMx | -10.2 | -8.2 | -0.2 | 0.0 |
ITMy | 7.9 | -2.6 | -0.2 | -0.0 |
PR3 | -1.1 | -2.9 | 0.0 | 0.0 |
SR3 | 10.1 | -5.7 | 0.0 | 0.2 |
BS | -13.3 | -9.2 | -0.4 | 0.4 |
HAM2 | -20.6 | -39.0 | 0.1 | -0.1 |
Tagging SUS, DetChar, and ISC for future reference.
I reset the PSL power watchdog at 16:40 UTC (08:40 PST).
O1 day60
model restarts logged for Mon 16/Nov/2015
2015_11_16 15:46 h1sysecatc1plc1sdf
2015_11_16 15:46 h1sysecatc1plc2sdf
2015_11_16 15:48 h1sysecatc1plc3sdf
2015_11_16 15:48 h1sysecatx1plc1sdf
2015_11_16 15:48 h1sysecatx1plc2sdf
2015_11_16 15:48 h1sysecatx1plc3sdf
2015_11_16 15:48 h1sysecaty1plc1sdf
2015_11_16 15:48 h1sysecaty1plc2sdf
2015_11_16 15:48 h1sysecaty1plc3sdf
2015_11_16 15:54 h1sysecatc1plc1sdf
2015_11_16 15:56 h1sysecatc1plc2sdf
2015_11_16 15:56 h1sysecatc1plc3sdf
2015_11_16 15:56 h1sysecatx1plc1sdf
2015_11_16 15:56 h1sysecatx1plc2sdf
2015_11_16 15:57 h1sysecatx1plc3sdf
2015_11_16 15:57 h1sysecaty1plc1sdf
2015_11_16 15:57 h1sysecaty1plc2sdf
2015_11_16 15:59 h1sysecaty1plc3sdf
2015_11_16 16:06 h1sysecatc1plc2sdf
Beckhoff SDF system (running on h1build) needed a restart following problems with h1build. Note this was done in observation mode, this is a pure EPICS monitor system which access the IOC via an EPICS gateway.
At about 10:15 this morning Bubba and I disabled the fridge and the outdoor AC unit at YEND. We also concluded that the trap primers at YEND are likely mechanical only and not electrically operated.
I have completed the update and restart of the dmt software. This includes generation of segments based on ETMY-ESD DAC and DCPD ADC overflows and a few minor bug fixes. The restart also activates the calibration filter file changes made by Maddie.
TITLE: 11/17 [DAY Shift]: 16:00-24:00 UTC (08:00-16:00 PDT), all times posted in UTC STATE Of H1: Down OUTGOING OPERATOR: Nutsinee QUICK SUMMARY: Start of maintenance
The h1broadcast0 daqd process has been restarted to add additional channels to the broadcast frame.
Load issues seemed to cause the server running the diskcache to freeze ast night. Now it looks like the diskcache crashed soon after I rebooted the server. I'll restart it, and the summary pages should start to update again.
Unable to maximize the ALS transmitted power just by touching ETMs and TMS alone. ITMs didn't move much compared to where it was after the lockloss. COMM beatnote is low (3ish) and touching PR3 didn't improve it.
Another 5.4M earthquake from Greece coming through...... Pause the initial alignment.
We also just had a wind gust at ~50 mph. EQ band seismic is on the rise. Relocking is going to be a while......
First try relocking. Lockloss at REDUCE_CARM_OFFSET (11:02:17 UTC). Wind speed ~30 mph.
Wind reaching 40 mph. Locking seems hopeless right now. Just lost lock again at CARM_ON_TR (11:08:2 UTC). Put ISC_LOCK to DOWN.
I noticed SRC_CAGE_SERVO user message tells me to "Align SR3 to offload M2 actuators". I'm not what action to take but I've attached the cage servo output below. I also noticed OMC shutter was opened while locking DRMI couple of times. Could that have intefered with DRMI locking? I don't remember the shutter being opened that early.
Tidal still high. Relocking still unsuccesful.
Wind speed decreased to ~20mph. So I tried again. Lockloss while locking PRMI. Looks like ETMX ran away.
Wind speed is back to ~30 mph.
The forecast lied to me saying the wind speed would decrease towards the morning. The wind has been 30-40 mph since 10 hours ago with no sign of decreasing. LLO has been down also because of wind. I'm calling it a night (or morning?).