Received an FMCS Air Handler HIGH RED alarm. This evening. I've acknowledged it, and it will probably stay in the RED state until addressed (if this is a new running state, we should update the alarm handler).
This might be correlated with John turning off heaters on Tuesday, but not sure.
Will send an email to John/Bubba.
Hmmm. I note that this seems to roughly correspond in time with our locking (and esp. alignment) troubles of the last 2 days.
A better representation of LVEA temperature is this signal:
H0:FMC-LVEA_CONTROL_AVTEMP_DEGF
see plot for the last 4 days.
Keita, Sheila
While the average temperature in the LVEA has been stable, the temperature has changed by about 1 degree C in several zones. Here is a plot of PR3 PIT (oplev and osem) as the temperature changes. These sensors could both be sensitive to temperature, but the optic could also have really moved with the temperature change.
It still seems plausible that our alignment difficulties of the last few days are related to temperature.
I reduced the gain of the OMC length locking loop by a factor of 3, the UGF has gone from 10 Hz to 3 Hz, and added a 30 Hz low pass. The new open loop is attached, as well as a spectrum of the drive signal before and after this change. There are low passes in the PZT driver that mean this is not as dramatic a change in the OMC length RMS as it seems.
Noise projections coming soon.
Sheila, Den We have tuned DRMI servos to reduce the acquisition time. First of all, we noticed that MICH servo saturates the BS actuator during the flash. In order to solve this issue we have copied control filters from LLO. Attached plot shows comparison of LLO and old LHO MICH servos. Next we have changed locking threshold for SRCL and changed ramping time for PRCL and SRCL boosts. New changes are in the guardian's "NEW_DRMI_SETTINGS" state. We tested these filters (~10 times) and concluded that there is an improvement in lock acquisition time. Average DRMI wait time is 1 minute.
The main change to the MICH loop is that we are no longer using the invPlant filter, and are now using a simpler compensator, and that we use more aggressive low pass filtering for acquisition. Attached is a (not great) measurement of the new loop compared the the old one (in blue), and uncalibrated spectra of the error signals showing that things are fairly similar in the end.
We have now made these new settings the default guardian settings, and there are no longer two alternative DRMI paths in the guardian.
This means that our MICH loop is a little different in low noise, and that we will have to adjust our MICH FF to compensate. We have put the new compensation filter in the MICH FF bank, and den found that a gain of -15.9 gave the best subtraction at 30 Hz, and that the coherence was low. We can check with braodband excitations but have had trouble getting back to low noise since we did this.
We also made these changes to the MICH loop that is used in initial alignment to lock the dark michelson.
[Cao, Ellie, Dave O, Aidan]
To whoever will be around in the control room last after commisioning, here are the steps for SR3 scanning to align Y arm HWS:
1- Turn off SR3 Cage Servo , Make sure that all mirrors are in ALIGNED state.
2- Run arbitrary waveform generator for H1: SUS-SR3_M1_OPTICALIGN_P_EXC.
Frequency has been set to 41.7 mHz
Amplitude has been set to 750 urad
3- Run arbitrary waveform generator for H1: SUS-SR3_M1_OPTICALIGN_Y_EXC immediately after step 2
Frequency has been set to 10.3 mHz
Amplitude has been set to 1550 urad
Let it run over night
All relevant windows have been left open on computer operator1 10.20.0.81
Started ca 08:33:00 Z.
Stopped ca 16:23:00 Z.
This afternoon, we replaced the Sat Amp units for TMSX. New units have the same modifications as the SR3/OMC units. Two decoupling capacitors were placed on the input of the negative regulator (U503), as implemented at LLO. C602 0.1uf C601 10uf New Unit S1100098 Old Unit S1100168 New Unit S1000292 Old Unit S1100066
Title: 2/17 OWL Shift: 16:00-00:00UTC (08:00-16:00PDT), all times posted in UTC
State of H1:
Shift Summary: Pretty unsuccessful in terms of locking. Earthquake in the beginning of the shift, then bits of commissioning/fixing to help relock, but then CDS went to replace the sat amps for TMSX bringing us down for a bit more.
Incoming Operator: Corey
Activity Log:
15:10 Hugh into LVEA STS2A setup
16:35 Hugh into LVEA by bier garten
17:08 Chris, Nicole into EX for parts hunt
17:06 hugh out
17:24 Mitchel, film crew into LVEA and out a few various times until ~20:00 UTC
19:50 Vinny, Brin to EY for magnetometer work
21:02 Vinny, Brin back
23:35 Vinny, Brin To EY again
at 14:11 PST h1dc0 froze up with a kernel panic. We reset the computer by pressing the front panel RESET button, but it did not come back cleanly.
When h1dc0's daqd process first was restarted, it ran for only a short period and then died. It was logging GPS timing jumps of one to many seconds.
Monit restarted it and it is now running correctly. The other DAQ systems restarted at this time correctly, except h1broadcast0 took a long time to get going.
Frame gap due to this problem is
1139782208 to 1139782912
Feb 17 2016 22:09:51 UTC to Feb 17 2016 22:21:35 UTC
The TCS simulation model to estimate the lenses and ROC of the optics is now running. The following lists gives the nominal values and the transfer functions used for all the filters:

This screen is accessible from the TCS_MASTER > SIMULATION button.
The static lenses from the ITMs have been added also (see T1400602)
This morning while TJ was trying to relock, ETMX HEPI tripped again. Kiwamu, Sheila and I all poked around at this a bit and can't find an obvious culprit yet. It's definitely something to do with the X HEPI position (tidal or something else). First attached plot is the ETMX actuators time series at the trip. The little shark tooth just before the trip seems to be caused by something in tidal (a reaction to HEPI walking off, maybe? Or something causing the IMC to do something weird?). When I looked a the cartesian signals, the movement seems to be all in X. The second plot is the time series over the same 32 second window of a few other signals, but none of them are particularly enlightening. The dark blue trace on the middle left is the HEPI X location, which goes on some 30 micron excursion, which ultimately causes the lock loss. But the motion seems to be chickens/eggs. Did tidal get some other input that drove HEPI or did HEPI go crazy and drive off tidal? I don't know.
model restarts logged for Tue 16/Feb/2016
2016_02_16 13:58 h1tcscs
2016_02_16 14:27 h1isietmy
2016_02_16 14:29 h1dc0
2016_02_16 14:31 h1broadcast0
2016_02_16 14:31 h1nds0
2016_02_16 14:31 h1nds1
2016_02_16 14:31 h1tw1
Maintenance day. TCS and ISI-ETMY model changes. H0EDCU_VE.ini change. Related DAQ restart.
Wed 10/Feb/2016 - Mon 15/Feb/2016 No restarts reported.
TCS model change. WP5732
Dave, Aidan:
Aidan made model changes to h1tcscs.mdl
Buried EY Seismometer added to h1isietmy model. WP5733
Jeff, Robert, Dave:
h1isietmy was modifed to read the external seismometer, these channels were added to the science frame.
Adding all Vacuum Controls channels to the DAQ. WP5731
Dave:
All the vacuum controls channels were added to the DAQ. Increased the number of channels from 280 to 1777
DAQ restart
Jim, Dave:
DAQ was restarted to support all the above changes. After several hours h1fw1 became unsynchronized to h1fw0 (we had not seen this before). Restarting h1fw1 fixed this.
GLIBC patching
Dave:
Patched and restarted critical servers and about half of the control room workstations.
I filled the PSL diode chiller with 350ml of water. Attached is a 30 day plot showing where the diode chilller was filled on Feb 4th, and then the alarm level increasing starting around Feb 13th.
How does this alarm? Is it on Verbal? Audible alarm out in the Diode Room? Or is the red light the only way to tell if it's low. In general, the Crystal Chiller is the one which requires action every week. For the Diode Chiller all we have is the red LED to warn us of low levels (I've never seen it). We (operators) just need to remember to also keep checking the Diode Chiller when performing this task.
Conceivably, we check this every Thursday. If the alarm goes off on Friday, is it OK for this chiller to be in alarm until it's checked the next Thursday?
I wonder if we should include trending the alarm level on the FAMIS procedure for this as Cheryl did.
Unfortunately the red LED on the face of the diode chiller is the only alarm we have and checking this LED is part of the FAMIS procedure. Additionally, especially with Peter and I in Germany until mid-March, if anyone is in the diode room for any reason and sees this red LED lit, fill the diode chiller immediately until the light goes out and post in the alog that water was added and how much. If the water level gets too low, the chiller will shut off, which also shuts off the entire PSL. We need a better alarm (especially in the hypothetical situation Corey brings up, this could result in a laser shut down if not caught before the next scheduled check), but this is what we have for now.
I have increased the LLCV valve setting to 18% (from 15%) to try and compensate for changing conditions.
Factors that are changing are:
The supply pressure is falling as the liquid level in the storage dewar falls.
Heat leak to the liquid transfer line is increasing with outdoor temperature. This results in more vapor in the line and less liquid to the pump.
Radiation from the beam tube as the beam tube warms.
The attached plot shows 100 days of the control valve setting. The flat line at 15% is due to the failure of the differential pressure sensing- we have had to resort to manual setting of this valve.
For reference the liquid capacity of the pump reservoir is ~77 gallons when full.
I forgot about the heat into the pump due to radiation from the surrounding vacuum chamber in the mid station. Here is a plot of recent VEA temperatures at MID Y.
That is illuminating, thanks. We take feedback controls for granted around here; don't miss it till it's gone. Hope this sophisticated PIL* control algorithm will tide us over until we can regen & fix the level sensor.
*Primate In Loop
Jeff, Darkhand, Kiwamu,
We have been meaning to do this, but kept missing a chance to do. Today we have fliiped the sign of the ESD bias voltage both on ETMX and ETMY.
This alog only describes what we did on the digital front end models. We will perform a set of confirmation measurement and verify the H1 DARM model later.
See alog 22135 for a concise summary of the bias flip.
[Bias flip on ETMY ]
[Bias flip on ETMX]
We took open loop and Pcal sweep measurements in nominal low noise after the biases were flipped. They reside at:
/ligo/svncommon/CalSVN/aligocalibration/trunk/Runs/PostO1/H1/Measurements/DARMOLGTFs/2016-02-16_H1_DARM_OLGTF_7to1200Hz.xml/ligo/svncommon/CalSVN/aligocalibration/trunk/Runs/PostO1/H1/Measurements/PCAL/2016-02-16_PCALY2DARMTF_7to1200Hz.xmlDarkhan will process the data later.
P.S.
I have updated the SDF accordingly for SUS-ETMX and ETMY and CAL-CS when the interferometer was in nominal low noise.
Kiwamu, Darkhan,
Summary
Our analysis of a DARM OLG TF and a PCALY to DARM TF measurements taken after the ESD bias sign flip on Feb 16, 2016 showed that:
Disscussion (actuation function)
The ETM ESD drivers' electronics and front-end FOTON filters associated with the ESD responses were recently updated, see LHO alogs 25468, 25485. Since the front end filter's do not perfectly cancel the ESD response, in the Matlab parameter files we used a better approximated ZPK responses that are based on the old ESD electronics measurements. Since currently we do not have TF measurements for the new ESD driver electronics, we have removed all of the compensations (for the non-perfect front-end filters) from the Matlab analysis of the DARM and PCALY to DARM TF measurements.
Measurement files, scripts
DARM OLG TF and PCALY to DARM TF measurements have been committed to CalSVN:
Runs/PostO1/H1/Measurements/DARMOLGTFs/2016-02-16_H1_DARM_OLGTF_*.txt
Runs/PostO1/H1/Measurements/PCAL/2016-02-16_PCALY2DARMTF_*.txt
Up to date filter files have been copied to
Common/H1CalFilterArchive/h1omc/H1OMC_1125881488.txt
Common/H1CalFilterArchive/h1susetmy/H1SUSETMY_1126240802.txt
DARM parameter file and comparison script have been committed to
Runs/PostO1/H1/Scripts/DARMOLGTFs/CompareDARMOLGTFs_O1andPostO1.m
Runs/PostO1/H1/Scripts/DARMOLGTFs/H1DARMparams_1139722878.m
Results (plots) are in
Runs/PostO1/H1/Results/DARMOLGTFs/2016-02-16_*.pdf