07:39 - 07:46 UTC Stepped out of control room
07:59 UTC Acknowledged program errors reported by WaPac program on access card reader computer. Closed and restarted the WaPac program.
09:14 - 09:23 UTC Stepped out of control room

SUS E_T_M_Y saturating (Oct 7 7:57:48 UTC)
SUS E_T_M_Y saturating (Oct 7 8:59:0 UTC)
SUS E_T_M_Y saturating (Oct 7 10:9:27 UTC)

Still observing @ ~79 MPc.

TITLE: "10/06 [EVE Shift]: 23:00-07:00UTC (16:00-00:00 PDT), all times posted in UTC"

STATE Of H1: Observing at ~80 Mpc for the past 7 hours.

SUPPORT: Jenne, Sheila, Evan, Mike

SHIFT SUMMARY: Was acquiring lock during the first hour of this shift. Once the ifo was locked the rest of the shift was quiet. Wind stays below 5 mph. Couple of earthquakes but the ifo stays locked. Just me and Marissa here for most of the night. Mike called to check on the GraceDB alert make sure it's not missing anything (since the code update).

INCOMING OPERATOR: Patrick

ACTIVITY LOG:

0:12 Ifo back to Observing.

2:45 Robert left the control room

~6:30 Patrick came in

I checked GraceDB again to make sure the alarm didn't miss anything that might have popped up during my shift.

TITLE: 10/07 [OWL Shift]: 07:00-15:00 UTC (00:00-08:00 PDT), all times posted in UTC
STATE Of H1: Observing @ ~ 79 MPc.
OUTGOING OPERATOR: Nutsinee
QUICK SUMMARY: From the cameras the lights are off in the LVEA, PSL enclosure, end X, end Y and mid X. I can not tell if they are off at mid Y. Seismic in 0.03 - 0.1 Hz band is around .015 um/s. Seismic in 0.1 - 0.3 Hz band is around .1 um/s. Winds are less than 10 mph.

We have finished generating and fine-tuning the filters we will use for the recalibration of ER8/O1 data.  The filters are generated using the LHO DARMmodel:

H1DARMOLGTFmodel_O1.m

with paramsters file H1DARMparams_1125963332 from SVN r1616 in the calibration SVN (aligocalibration/trunk/Runs/O1/H1/Scripts/DARMOLGTFs)

The filters file to be used for recalibration is located in the calibraiton SVN under aligocalibration/trunk/Runs/O1/GDSFilters:

H1DCS_1128173232.npz

The TST actuation filter was generated using

par.A.getFreqResp_TST(f)

The PUM/UIM actuation filter was generating using

par.A.getFreqResp_USUM(f)

The sensing filter was generated using

par.C.getFreqResp_total(f)

In addition, we have filters to dewhiten (IFO):CAL-DARM_ERR_WHITEN_OUT_DQ and (IFO):CAL-DARM_CTRL_WHITEN_OUT_DQ.  The whitening schemes for these filters can be found in DCC T1500463.  The dewhitening filters are made by switching the poles and zeroes and adjusting the gain appropriately.

The filters file also contains reference values of the calibration model needed for the computation of the time-varying calibration factors (kappa's).  These reference values are obtained from EPICS records in online mode, but since the EPICS records are not accurate for the entire time we are recalibrating, the reference values will instead be read from the filters file for recalibration.  

Attached are plots that compare the frequency response of the FIR filters for TST actuaiton, PUM/UIM actuation, and inverse sensing to their respective frequency domain models, obtained as described above.  

I have also attached a plot that compares the output of the online GDS-CALB_STRAIN channel to the output of DARM_ERR and DARM_CTRL calibrated using these FIR filters.  The two agree to better than 1% in magnitude and 1 degree in phase. 

TITLE: 10/6 [EVE Shift]: 23:00-07:00UTC (16:00-00:00 PDT), all times posted in UTC"

STATE Of H1: Observing at 79 Mpc. The range has been slowly increasing since the lock was acquired an hour ago.

OUTGOING OPERATOR: Ed

QUICK SUMMARY: We finally locked and Observed for the first time in 8 hours. Clean DMT Omega in the past hour. Wind below 5 mph. Nominal seismic activity in the earthquake band. Terramon reported a 3.9M earthquake off the coast of Oregon that should have arrived 17:33 UTC and dropped us out of lock. We seem to have ridden through it just fine.

Jonathan, Dave

we initially intended to run the new code on h1fescript0 (Ubuntu 12), but this ran into errors this morning. To run a long term test overnight on H1 we are running a gentoo version on h1build. This system is not monitoring Beckhoff, rather it monitors three weather station wind speeds (so we get continuously varying "setpoints"). This test has shown an interesting problem not seen on the DTS tests. Jonathan is investigating, we'll keep this running overnight.

We had a few tricky things to overcome today, in order to get the IFO relocked. 

• IFO needed careful initial alignment after TMSX motion today

  • Symptom:  Although we were able to run through the initial alignment, and get so far as DRMI locked, we were repeatedly failing the SWITCH_TO_QPDS step of the carm offset reduction sequence.  The SRC ASC loops looked happy and converged in the state just before this, but some component of this state was causing the SRC ASC loops to start to go crazy, and then we'd lose the lock. 
  • Solution: Sheila pointed out that this can happen if the alignment isn't good enough (even though DRMI locked), and since the TMSX moved today as a result of the beam diverter closing (see aLog 22286), we went back and redid the initial alignment.  The INITIAL_ALIGNMENT state of the individual arms' ALS guardians can take a long time (today we waited 15-20 minutes for full convergence), but it was worth the wait.  After we finished the alignment sequence, we were able to fully reduce the CARM offset on the first try through the lock sequence.

• OMC ASC outputs needed histories to be cleared. 

  • Symptom:  ISC_LOCK seemed to not be able to finish the DC_READOUT_TRANSITION state, which was because the OMC_LOCK guardian was getting reset to DOWN.  In the OMC_LOCK log, there was a notification that there was no light on the OMC QPDs, so it was going to DOWN. 
  • Solution:  The outputs of the OMC ASC ANG servos (on the OMC_CONTROL screen) were stuck at their limiter values of 1000. First, we asked the ISC_LOCK guardian to stay at DC_READOUT_TRANSITION, so that it wouldn't go any farther while we were fixing this.  We then turned the MASTER GAIN (vertical blue bar to the left of the servos, on that screen) of the OMC ASC to zero, and pressed the "graceful clear history" button below the ASC servos.  This seems to have fixed things. 
  • Cause: I think this was happening because the OMC ASC was getting swapped over to the dither lines before the OMC was truely locked.  We may need to put in a check to ensure that the OMC is locked before allowing the DITHER_ON OMC state to run.  I suspect that we haven't seen this before because it's taking a bit longer to find the OMC resonance, since we're now starting from much farther away (see aLog 22268). 

• OMC locked on the wrong mode

  • Symptom: This isn't a new one, but the OMC Trans camera was quite dim, even though the OMC_LOCK guardian said everything was good to go.  There was only ~1.4mA of light on the OMC_DCPD_SUM_OUTPUT (top right of OMC_CONTROL screen), when it should be ~14mA at this stage.
  • Solution: We re-selected the READY_FOR_HANDOFF state, and it found the correct mode on the second try.  Maybe the OMC guardian needs a check for this, and it should at least put up a notification that it's not in a good state.

To get to Observation mode, we had a few SDF diffs to take care of.

• Accepting the FM8 bounce and roll notches that Sheila mentioned in aLog 22273.  Easy.
• Some TRAMPs in TMSX had differences.  We suspect that the dither alignment that Ed ran earlier today (which we very rarely run, since the TMSs don't move that much that often) set the TRAMPs to some value, and didn't put them back to the original values.  We reverted these to the values in the observe.snap.  This script should probably be modified to reset the TRAMPs appropriately, at the end of the script.

The online GDS calibraiton filters were updated today to fix several bugs and add a few more corrections that were uncovered by the calibration group over the past week.  The updates include the following changes:

1) Compensation for known IIR warping by Foton in the inverse sensing filter installed in the CALCS model.  See DCC G1501013.

2) Fix bug in how digital response of AA/AI filters were called.  (par.C.antialiasing.digital.response.ss -> par.C.antialiasing.digital.response.ssd andpar.A.antiimaging.digital.response.ss -> par.A.antiimaging.digital.response.ssd)

3) Additional compensation for OMCDCPD (par.C.omcdcpd.c).

The new filters were generated using 

create_partial_td_filters_O1

checked into the calibration SVN under

Today we noticed that the EX beam diverter has been open since June 18th.  We don't normally switch this so it is not guardian controlled but we "usually" leave it closed.  It is beckhoff controlled so it is not monitored in SDF.  Today TJ added all the beam diverters we don't normally change in guardian to SYS_DIAG to prevent this from happening again (it was already checking the others).

We have now locked with the beam diverter closed, and see that the QPD spectra look the same between EX and EY.   (20418 and 21767 have some history.)  The peak in DARM at 78 Hz is also not here.  We will see if it stays gone, and check soon to see if the blinear coupling of ETMX ISI motion to DARM is gone with the beam diverter closed.  

Taped signs on fume hood sashes stating the fume hoods were off for O1

I have placed an additional gige camera on the AS_Air path on ISCT6, in order to measure the gouy phase of the SRC. For reference the ISCT6 table layout is in D1201210. 

Attached is a diagram of the modified table layout, and photos of the changes.  I added two new components to the table.  I placed a 50/50 BS after AS-BS1, so that half of the beam going to the AS-Air Gige camera is sent across the table to the new Gige camera.  I am powering the new camera with the cable intended for the OMC Refl Gige camera, which is currently not being used.  In the photos, Optic A is the additional beamsplitter.  Camera C is the additional camera.  Camera D is the OMC-Refl camera from which I borrowed the ethernet cable to run Camera C.  Optic B is the beamsplitter AS-BS4, I adjusted this optic to keep the image on AS_Air gige centered.

Jim added the additional camera to the gige camera system.  This camera is Cam_17 and can be accessed through the digital video cameras medm screen.   If we want to use OMC_Refl, we can still switch the ethernet cable back to the OMC_REFL camera.

Because the power going to the AS_Air Gige camera has been dropped by 50%, we have doubled the exposure setting of this camera.  (The AS_Air camera is used to visually assess Mich aligment during initial alignment.)  The exposure of AS_Air is sett in the guardian, so I have modifed the ISC_LOCK guardian (lines 380 and 2644) and the ALIGN_IFO guardian (line 316) to set VID_CAM_18_EXP to double what it was previously (origional exposures were 1800 in DOWN state of ISC_LOCK, 18000 in CLOSE_BEAM_DIVERTERS in ISC_LOCK, and 80000 in MICH_SET in ALIGN_IFO.)  We believe this is the only effect of adding the additional camera, and does not change the IFO configuration in full lock.

TITLE:   Oct 6 DAY Shift 15:00-23:00UTC (08:00-04:00 PDT), all times posted in UTC

STATE Of H1: Aligning/Locking

LOCK DURATION: N/A

SUPPORT: Sheila, Jenne, TJ

INCOMING OPERATOR: Nutsinee

Activity log:

14:55 Safety Kleen is on site

14:57 Sheila performing scattered light noise hunting testing on EX WP#5528

14:58 Richard starting his temperature Beckhoff system room temperature sensor work. WP#5534

15:00 Jeff B running forklift WP#5506

15:08 Lockloss

15:12 Jody to begin executing WP#5537 upon completion of Jeff B’s work (#5506)

15:13 Ken out to EY for Solar Panel work WP#5493

15:15 Jim batch informed of DMT maintenance. EQ blrms, range, IR integrand. etc

15:19 Joe out to LVEA to check water, batteries. etc

15:22  Robert’s equipment is unloaded and he will begin PEM injections

15:24 Greg Mendell informed me of the start of the DMT update WP#5522

15:26 Joe turning on lights in LVEA

15:27 Kyle and Gerardo out to  execute WP#5532. Informed me that new LN2 vendor will be arriving on site today.

15:30 Richard is turning on wireless in LVEA. WE NEED TO REMIND THE SWEEP TEAM TO TURN IT OFF.

15:35  Switched observatory mode to Corrective Maintenance

15:40  NORCO on site for LN2 delivery Y end

15:42 Vinnie into the electronics room to investigate two accelerometers.

15:46 Jody called to inform that forklift was loaded and they’re headed down X arm. WP#5537

15:49 Richard finished temp sensors in corner. He’s headed to EX

15:51  Sheila will be breaking the current lock. Betsy will do some charge measurements.

15:53 Hugh out to do weekly HEPI fluid checks at all out buildings and corner.

16:02 Christina called. Leaving EY headed to EX.

16:06 John W driving down to EY to meet LN2 driver.

16:08 Jason in to LDR to do regular weekly Watchdog reset .

16:15 Septic truck on site

16:19 Richard called to confirm operation of sensors at EY

16:23 Ellie and Miguel headed out to ISCT6 to execute WP#5540. (camera)

16:26  Gerardo back from EX to remove some vac equipment to take back to EX

16:30 Richard and Fil at EX for Ecat Temp sensor install/test

16:40  Second Norco truck on site to service CP2

16:42  Christina leaving EX. Returning to get mid station key.

17:01 Sheila is going to start the A2L script testing.

17:05  Vinnie to EX

17:06  Jodie and Jeff done at MX and headed to MY.

17:07  Kyle back from EX

17:07  Safety Kleen leaving site

17:08 John Back from EY

17:15  Richard and Fil are done.

17:28 Eliie and Miguel out of the LVEA for the moment. They plan to return.

17:30  Fil out to Biergarten to label TCS racks.

17:37 Christina leaving MX and heading to MY

17:48  Ellie and Miguel back out to ISCT6. Misaligned SRM, PRM and ITMX for single beam

17:55 Jody called. They’re done at the Mid stations. They’re going to park the forklift by the LSB.

17:57  Richard down to EY to join Ken.

18:03 Ace finished on Y arm and heading down X arm

18:04  Bubba moving something with a forklift from LSB to OSB.

18:05 Vinnie called to let me know that he’s at EY.

18:14 Jody and Jeff out to LVEA to pull temperature data from 3IFO containers

18:19  Hugh to end stations for photos

18:20 Christina and Karen into LVEA for cleaning

18:23 EY LN2 truck leaving

18:26 Evan out to LVEA to look at ISC racks by the PSL

18:29 Evan back

18:44  Ellie and Miguel out of LVEA

18:46 Ellie back out to put in a beam dump

18:47 Jody and Jeff are out of the LVEA

18:48  Carlos done for the day

18:52  Ellie out

18:54 Landry into LVEA for photos

19:06 Richard out to LVEA to turn wireless router off and turn off power distribution cart by output arm.

19:15 Gerardo called from EX (phone showed MY). Pumpe replaced but auc cart neds to stay running for another hour to hour/half

19:30 Kyle leaving Xarm and travelling to EY to check something

19:31 Vinnie back from EY

19:38 Robert and Vinnie ou to EY to position a magnetometer

19:57 LVEA sweep team headed out to the LVEA

20:01 Science mode (after locking) will be hindered by an aux pump still running at EX, Dave and Jonathan doing computer work and an SDF change that’s going to happen due to PEM work at EY to investigate glitching. THe latter will require a work permit that will remain open as the present work will be a temporary fix.

20:18 Ellie is still in the LVEA for Fine Aligning of ISCT6 LVEA sweep will be final upon her exit. Wireless Router was turned back on for her use.

20:35 Dither align script has been renamed from what the wiki page says “ ./dither_align.py” to “./ditherAlign.py”

20:35  Begin initial alignment

22:25  Jeff B into the optics lab

22:33 Jeff B out of the optics lab

23:00 Still struggling to re-lock. Handing off to Nutsinee

Shift Summary: See Activity Log

   The PSL Diode was showing a low water alarm this afternoon. I added about a quart, and cleared the alarm.

Two accelerometers in the corner station have been showing unusual looking spectra.  During maintenance today I moved them to different endevco channels to see if that was the problem, and it their resulting spectra would suggest that it is.

H1:PEM-CS_ACC_LVEAFLOOR_BS_Z showed excess low frequency noise in its spectra.  When switched to a different endevco channel the noise was noticeably lower below ~6-7 Hz.  Both images are attached to this post.

H1:PEM-CS_ACC_LVEAFLOOR_HAM1_Z also showed an unusual spectrum.  When ran through a different endevco channel the overall noise level changed by a factor of ~10.  Two images of these spectra are attached as well.

   Added 250ml water to the TSC-Y chiller. This is the second time I've added water to this chiller. The TCS-X chiller water level was fine.   

(Kyle, Gerardo)

Removed and replaced the AIP for BSC5.
Pump had failed early last week.

This morning I did a few things:

First I made some injections to the EMTX ISI (WP5528).  This data can be used to make a projection to the normal level of noise. 

I made 3 guardian changes (WP 5533):

I added a new state to the OMC_LOCK guardian which tries to keep the OMC off resonance, and the ISC_LOCK guardian requests this for the early part of lock acquisition.

Added a function which checks that the ETM pit oplevs have an rms less than 0.5 urad before we attempt to start locking again.   This will prevent tidal from acculating junk while the optics are still swinging. 

Changed the decorators in the ISC_LOCK guardian so that we do not check the DRMI lock once CARM is locked on the transmitted power (this will reduce th confusion in lockloss logs).

I also copied a bunch of medm screens and filters in the ASC ADS system from LLO, as well as scripts with help from Carl, Adam and Marie.  This is in preparation to try using Marie's modifications to Hang's A2L script.  

Motivated by our locking difficulties at the end of last week, I downloaded guardian state data for the last two weeks to look into our locklosses durring the CARM offset reduction.

To start with the good news, the script that I use to do this automatically makes a few figures that tell us about our duty cycle, and we are doing well overall. As usual, I am only looking at the guardian state, and not considering any intent bits.  My reaasoning is that the hardest part is getting and keeping the IFO locked, and that is currently the important limit to our duty cycle. 

• We have been locked in the nominal low noise state for 83% of the time (compared to 68% for the last week of ER8).  A good part of the improvement is probabably because the ground has been quieter in the last 2 weeks, although I didn't try to quantify that. (guardian state pie chart is the first attachment).
• About half of our DRMI locks result in nominal low noise locks (33/64).  A lockloss pie chart is in the second attachment. We have fewer locklosses in the late stages of the guardian, which could be because we are waiting for the first sets of ASC loops to engage before we engage the soft loops (alogs 21583 21587)
• The median low noise lock stretch was 5.5 hours long, while the longest was 59.7 hrs long.  A histogram of the length of low noise locks is in the third attachment.

The main weakness in our lock acquistion sequence now seems to be the early steps of CARM offset reduction, as we saw yesterday. 

•  We certaintly have a harder time with these early steps of CARM offset reduction when the ground motion is high, which explains most of our down time from the 2nd to the 3rd.
  • The 4th attachement show a histogram of locking attempts bined by ground motion, which is the maximum of the sum of the Y direction blrms for 30mHz-100mHz and 100-300mHz bands durring the locking attempt. I chose the Y direction at Y end because that tends to have more wind induced tilt, so this should include the impact of wind, earthquakes and useism.  You can see that we struggle to lock when the ground motion in these bands is above 250nm/sec, although occasionally we do suceed.  In the version of the plot attached here, I called a locking attempt sucsesfull if it reached the low noise state, but the plot doesn't change much if you instead make it for locks which make it past the stage where the DHARD ASC loops come on. 
  • The 5th attachment shows the ground motion over the last week, with a plot of the range to illustrate where the long stretch of downtime was.  Clearly, this was mostly time when the ground motion was high enough to cause us locking difficulties.
• One thing that might be hurting us in these early stages of CARM offset reduction is OMC flashing, see alog 22237. We will pull this off resonance using the guardian soon.  These OMC flashes are mostly not bright enough for us to see them on the AS camera, and it may just be that we see more OMC flashes when there is more light at the AS port because of bad alignment or high ground motion.