evan, nic, sheila

The temperature at EY was stable for most of the last month to within ~0.5 deg C until the last few days. Recently there were excursions of as big as 3 deg C. We think this is responsible for TMS misalignments.

model restarts logged for Tue 11/Nov/2014
2014_11_11 01:42 h1fw0
2014_11_11 10:27 h1fw1
2014_11_11 12:23 h1broadcast0
2014_11_11 12:23 h1dc0
2014_11_11 12:23 h1fw0
2014_11_11 12:23 h1fw1
2014_11_11 12:23 h1nds0
2014_11_11 12:23 h1nds1
2014_11_11 20:50 h1pslpmc
2014_11_11 20:52 h1ioppsl0
2014_11_11 21:11 h1ioppsl0
2014_11_11 21:14 h1pslpmc
2014_11_11 21:17 h1ioppsl0
2014_11_11 21:17 h1psldbb
2014_11_11 21:17 h1pslfss
2014_11_11 21:17 h1psliss
2014_11_11 21:17 h1pslpmc
2014_11_11 21:49 h1ioppsl0
2014_11_11 21:49 h1psldbb
2014_11_11 21:49 h1pslfss
2014_11_11 21:49 h1psliss
2014_11_11 21:49 h1pslpmc

Two unexpected restarts. Tuesday maintenance. Multiple restarts of Beckhoff chassis (not shown) with associated DAQ restart. Restart of h1psl0 models as part of investigation into PSL issues in CER.

See the attached for a look at these very conservative 2Hz controllers.  The correct matrices will have to be installed before these will work.  I'll put these in when Keita says okay or on Tuesday Maintenance day which I expect are the same!

K. Venkateswara, J. Warner

The BRS damper (see 14388)  has been malfunctioning since yesterday afternoon. It's controller is an open loop system that assumes it is in the centered position when it is first started. Occasionally it can get restarted accidentally when the insulation box is bumped (probably due to a short somewhere, but I'm not sure where). It looks like this happened yesterday around noon.

This requires a manual re-centering of the turn-table for the feedback system to work as designed. I've attached the directions to do this. Jim will do this later today or tomorrow.

I have started to tar and compress older autoburt snapshot files to free up disk space - the snapshots saved so far consume over 1TB on disk, which is about 25% of the capacity of the /ligo filesystem.  Currently the plan is to retain roughly the last three months of data in it's uncompressed form, with data older than that retained on disk in a compressed tar archive only.  Files will be archived by month (so all of the files from a given month will be in a single tarball).  Since the snapshot files are all ASCII text, they should compress down well.  This should also speed up the rsync backups, since there will no longer be 2.8 million files to traverse looking for changes.  If you need assistance accessing older snapshot files stored in the tar archives, please see one of the CDS admins.

Something happened at about 10:30PM (11-12-2014 6:30 UTC) and the 363Hz oscillation of the end Y PZT mirror(s?) went totally unstable.

Daniel and Alexa are heading to EY to swap the controller.

In the attached right, references are from 24 hours ago, current traces are as of now. The trend shows the green QPD and the VEA temperature for 3 days.

As I reported in 14965, I suspected WHAM3 ISI OpLev Pitch and Yaw were reveresed as I believe is HAM2's.  See the attach where I yaw'd WHAM3's HEPI.  The HEPI Pitch moves as well but a couple of orders of magnitude less.  Likewise on the OpLev, the Pitch responds much more than the Yaw, so yes,

HAM3 ISI OpLev Pitch & Yaw are Reversed

The chilled water temperature at MIDY alarmed HIGH this morning. There is no demand for cooling so the water is bypassing the cooling coils completely and therefore the water pump is only heating the water.

I have turned both mid station pumps off.

This cold front has sent our temperature control loops out of whack - Last night I turned on heaters in both end stations. Today we will monitor and perhaps turn on more heat in both the LVEA and the end stations.

Alexa, Evan, Nic, Sheila

We seem to have lost the -24 V rail and the -12 V on several racks in the electronics room.  The PSL/IO/TCS beckhoff chassis power switch was in the off position when we went out there, I tried flipping it to on and the rocker switched off again immediately.  On the cds overview we have lots of red on the PSL frontends, this chassis is in the same rack as the PSL/IO/TCS beckhoff chassis, and they are on the same 24 V supply.  Nic restarted the front end models several times, then restarted the computer, then restarted the computer and restarted the PCIE expansion box.  (before we realized that we were missing power). 

(Alexa, Sheila, Evan)

As we were trying to lock ALS DIFF, we noticed that both the COMM and DIFF beatnote were too weak. We trended these values and found that the beatnote first disappeared when the PSL went down and then again at around 9am PST. I then tried locking the IR to the x-arm and found that I had to move PR3 by 4 urad in pitch to lock. The input wfs then moved IM4 and PR2 to increase the buildup.  We suspect things got moved around again with the work and trips on HAM2, HAM3. We didn't spend too much time investigating the exact cause, and we did not want to go through the entire alignment to lock DRMI and check the POP18 counts since we want to focus on DIFF right now. Hopefully we didn't introduce a new clipping in the PR2 baffle by the amount we moved. 

IMPORTANT: I have not saved these new alignment values, so if the guardians get realigned they will restore the old alignment values.

Also, the beam in the AS AIR camera looks too far to the right.

After yesterday and today recentering and tweaking, the ISS second loop is back to good working condition. The first attached plot compares some signal with the second loop open and closed. Dashed line, loop open, solid lines, loop closed.

The ISS second loop signals (SUM14 and SUM58) are calibrated in volts and the whitening filter is compensated. Using the slow DC channels, I could compute the total signal for each combination, which is about 11-12 V. I used those values to calibrate the signals in terms of RIN as in the figure. This should roughly correspond to about 20 mW total power hitting the array.

The out-of-loop signal is still showing some excess noise with respect to a flat level. Assuming that there are 10 mW impinging on the four out-of-loop diodes in total, the shot-noise-limited dP/P should be sqrt(2*nu*hplanck/P) = 6e-9 /rHz. Counting both the in-loop and out-of-loop shot noise, we get an additional sqrt(2). Therefore we expect the out-of-loop signal to be at the level of 8.6e-9 /rHz, not too far from the 1e-8 /rHz that we see at about 100 Hz.

The structures between 10 and 50 Hz are variable, but I was not able to change them significantly moving the IMC alignment or the picomotors in front of the ISS array. Notably, for most of the day there was an additional bump between 10 and 20 Hz, which disappeared some time at about 13.05 local time, without any conscious intervention on my side. See second plot. No idea what the origin of this thing is, but it was there also yesterday.

One more peculiar thing. We can use IM4_TRA_SUM to measure the RIN in transmission of the IMC, as an additional out-of-loop sensor. This is included in the attached plots. When the second loop is open, the RIN measured by IM4_TRANS agrees quite well with what is measured by the ISS second loop diodes. However, when the second loop is closed, IM4_TRA measures a significantly larger noise. This might be due to the sensor electronic or dark noise (I haven't checked it yet). However, at least at 10-30 Hz it measures the same structures visible in the ISS diodes, but a factor 4 larger. The shape is also slightly different. Surprinsingly, there is no coherence between IM4_TRANS and  SUM58. This might tell us something about the origin of those peaks, but what, it's not clear.

The peaks between 15 and 25 Hz are visible, with different amplitudes and shapes, in all the eight  photodiodes, but there is little coherence among them. See third plot. These peaks are not visible in the ISS QPD signals, even though there is a wider bump at similar frequencies. They may be due to scattered light. The most prominent structure is a 18 Hz peak.

Beckhoff. Daniel and Dave

Following Daniel's changes to the Beckhoff systems, I applied the latest INI files to the DAQ and restarted the DAQ. Unfortunately h1ecatx1 needed a restart shortly after this and we have some channels disconnected. I also copied the latest Beckhoff REQ files into the appropriate target areas and Patrick reconfigured the conlog using them.

Conlog: Patrick and Dave

I modified the script which creates the conlog channel list to use the generic include.txt file as well as the generated fe_include.txt and grd_include.txt. I changed the script which generates the Guardian autoBurt.req file (which is used to create grd_include.txt) to include the USERMSG byte encode strings for conlog logging. I created a script to convert the output of USERMSG to a string. Patrick reconfigured conlog's channel list.

Guardian: Dave

I checked that the running guardian nodes and the GUARD_OVERVIEW medm screen are in sync with each other (they are). I updated the guardian autoBurt.req file (using guardctrl list to get the node listing).

Filtermodules Load Status: Dave

Many H1 models are running with partial loaded filter files. Plus two models (SUSPR3 and SUSMC2) had modified filter files. I pressed the "LOAD COEFFICIENTS" button on the GDS_TP screen for the following models to resync them with their filter files:

ISIHAM[3,4,5,6], ISIETMX, SUS[PRM,PR2,SR2,SRM,BS,ETMY,ETMX,PR3,MC2], TCSCS, LSC, LSCAUX, OMC, ASC, ASCIMC, ISC[EX,EY]. No problems were encountered.

inicheck of all DAQ INI files: Dave

I ran inicheck on all the DAQ INI files, we have channels with mixed case on the systems: ISI[BS,ITMX,ITMY,ETMX,ETMY] and LSC.

foton check on filter files: Jim and Dave

We ran foton -c on a copy of all the running filterfiles. Most of the errors we saw relate to obsolete filters left in the body of the file but no longer in the MODULES header. At some point we should make the effort to clean up the filter files of obsolete material (quak generated files exempted from a foton cleanup).

There's a huge 364Hz line in ALS TRY.

I'm not sure if this was already there for a while. Though we probably changed the loop gain of the ALSY PDH loop when we realigned the green path on ISCTEX today.

Gerardo & Hugh

We recentered these oplevs to make better use of their tracking.  And especially HAM2 as it seemed to be way off on one quadrant.  Luckily we didn't lose the beams.

First attached is a three day trend showing yesterdays fun with HAM2 and the recentering this morning.

Next is the last eighty minutes, maybe given the wandering, the X-Y plots on the medm should have their window zoomed out some.  This seems to be an issue mostly on HAM3 Yaw.

The third plot shows the five hour detail around yesterday morning on HAM2 with the HEPI Cartesian RZ (yaw) RY (pitch) and HP, the horizontal pringle mode.  This further shows even though the HEPI RZ has servo'd back to its reference, the OpLev Yaw would disagree.  Likewise, even though the HEPI pitch shifted way off for most of the time and then came almost all the way back, the OpLev Pitch doesn't follow that in any reasonable way.  Even though these OpLevs have no caibration as I understand, this says alot about system distortion.  I've included a feducial from the large shift in the HP calculation but it doesn't appear to correlate to anything in the OpLev response.