After getting the PSL back, Keita mentioned to me that the alignment into the IMC was off and that he would like me to bring the pre-modecleaner body temperature back to where it was before the power outage, namely 304.5 K (as indicated on the MEDM pre-modecleaner screen). It was sitting at 304 K when Keita ask me. To do this I disabled the temperature loop and increased the heater offset. I had increased the heater offset as high as 0.96. Then the temperature reached 304.5 K, I locked the pre-modecleaner, reduced the heater offset back to its previous value of 0.72 and re-engaged the temperature loop. On a different matter, it might be that the reference level at the ~middle left hand side of the MEDM screen may need some adjustment/tweaking. For a long time, this was set to 1.35 (on the slider). However at times the pre-modecleaner had difficulty locking and that was because the value between the two less than signs was larger than the upper limit. So the front end model thinks the pre-modecleaner is locked even though it's obviously not. Reducing the reference level down to 1.2 or 1.1 solves the locking problem, however Jason and I were informed that the pre-modecleaner locked on a non-TEM00 mode when it was set to 1.10.
Because there have been some indications the now missing HAM3 .6hz line was electronic, I checked that it was still gone after this morning's power outage. It is, so far. Attached spectra are the GS-13s.
It looks like the line reappeared for a while on Oct 13. It is visible in the DetChar summary page for HAM3 at the link below https://ldas-jobs.ligo-wa.caltech.edu/~detchar/summary/day/20151013/plots/H1-ISI_ODC_1B8A8B_MEDIAN_RATIO_SPECTROGRAM-1128729617-86400.png I've attached a png of the plot which is linked to above.
The front-end projection matrix elements for propagating HAM2 table motion to the IMs' suspension points had apparently never been installed.
However, the projections have already been computed in userapps/isc/common/projections/ISI2SUS_projection_file.mat, and the displacement vectors used in the computation agree with the systems diagrams (D120062[3456]). So I propagated these projection matrix values to the front-end.
It would also be nice to make and install the projection matrices for the OMs as well, since these have not been computed yet.
J. Kissel I've updated the CAL-CS and CAL-EX front end models for the bug fix to the INJ ODC, as described in LLO aLOG 21804. As expected, no DAQ restart was required. I suspect that all ODC records reed to be re-filled out, I'll inform Duncan.
Recovery from the power outage is still ongoing. All planned maintenance day activities have been postponed until recovery is complete. Currently Keita and Peter are tweaking temps in the PMC.
All running now.
Corner--Pushed Level trip reset button and Green button on the controllers and restart was normal. Except, PS #1 (south unit) was outputting less pressure than the other three. We've seen this before after a restart and sure enough the pump was noisy gurgling like. I changed the ACC & DEC parameters on the VFD and spun down the pump slowly. I set these parameters to 600 seconds but it was still a little fast for the super low ugf of the controller s I doubled the PID gain to help it out. A little glitch as the pump stopped and started going backwards before we got the valve closed. After hitting the VFD reset it started back up and again a pressure glitch as the pump starts and the output valve was reopened. Pretty sure no one cared at that point. VFD and PID parameters returned to nominal.
Ends--The VFDs were registering a Low Voltage error, (not sure why this was not the case with the corner station--maybe because they have no power to them until the level trip is reset.) This requires an EE approved panel intrusion to hit the reset and the normal restart follows.
At EndX the PV di not seem to be holding as it should after it looked like it was doing fine so I expected some kinda issue. I made a trip to the EndX but it seemed fine at that point. I spun it down anyway and restarted again and it again and since seems fine.
Travis, the operator, used the wiki instructions and managed okay with them.
I've now checked all HAMs by requesting offline, waiting for the chamber to go down, then requesting isolated and they all seem to be working now.
(This was supposed to be attached to my previous log about HAM ISI guardian problems. w/e)
This morning after Betsy and Jenne recovered the CS SUS, I tried turning the seismc platforms back on. The HAMs were unusually difficult, the chamber manager was stalling and insisting that the ISI and HPI nodes were stalled. A few things I tried mostly on HAM2, a few on the others:
1. Init-ing every body.
2. Engaging master switches. Occasionally, the chamber manager would go around behind me and turn them back off.
3. Stopping and restarting guardian nodes. On HAM2 I tried just the chamber manager, then all HAM2 nodes.
4. Stopping and Execing all nodes.
5. Reloading all the code on all 3 nodes.
Finally, the only way I could recover the HAM chambers was to go and engage the masterswitch on ISI and HPI, put ISI in Damped, HPI in Isolated, then when HPI was up, I put ISI in High_isolated. When that was done the chamber manager was happy, after hitting INIT on the manager. I've checked HAM4 and HAM6 after and those chamber managers work. The BSC guardians have also been behaving all morning, from what I've seen.
Currently all seismic platforms are up and running.
Nutsinee, Peter, Jason, Jeff B. Checked the TCS-Y chiller system for leaks. Found no active leak in (1) the chiller unit, (2) the external plumbing, or (3) on the TCS-Y table. There were signs of older leaks on both ends of the RF amp. These were dry stains and I could find no current drips around these fittings. I checked in the table (very limited view) and found no evidence of water pooling inside the table. A check of the plumbing under the beam tube, last week, (from the mechanical building to the vertex) was also negative. We had a quick look at the TCS-X table, and found no apparent problems. Both chillers are up and running. I topped off both chillers so they are at the same levels. Will continue to monitor the system.
RF Oscillator is set at 40.68 MHz.
DC power supplies set at 29.99V and 28A. Output reads 30.00V and 0.75A for TCSX, 30.00V and 0.78A for TCSY.
The rotation stage has been reset for both TCSX and Y (searched for home, then go-to power). TCSX output is now 0.229W.
TCSY laser is currently turned off. It's been off for over a month. I checked with Evan and he said it should be left off for now since no one will play with it anytime soon. To turn it on just hit "ON" button on the CO2Y medm screen. The controller box is ready to go.
The trigger reference level for the pre-modecleaner was changed from 1.35 to 1.10. This change was accepted in SDF. The reason for the change is
that with the previous value, the sequencer for the pre-modecleaner thought it was locked when clearly it wasn't. The lower value was more consistent
with observation.
Trigger reference value set back to 1.35 because the pre-modecleaner locked on a non-TEMO0 mode after it was changed to 1.10
Having trouble restarting end Y.
Evan power cycled the comtrol and weather station at end Y. It is now working.
If I remember correctly: h1ecatc1 was running but had some terminals in the INIT ERR state. h1ecatx1 was white on the CDS overview. h1ecaty1 was still running and all terminals were in the OP state. For h1ecatc1, h1ecatx1 and h1ecaty1: Opened the system manager from the target directory. Activated the configuration and restarted in run mode. Opened each PLC from the target directory. Logged in and ran it (if it was not already running). I believe I also restarted the EPICS IOC on h1ecatx1. Burtrestored all to 5:10 this morning.
'OpsInfo' and 'Lockloss' tags have been added to the LHO and LLO aLOGs. CDS Bugzilla 941 for reference.
... and added OpsInfo task to H1 and LHO sections.
J. Kissel, K. Izumi, D. Tuyenbayev As expected from preliminary analysis of the actuation strength change (see LHO aLOG 22558), DARM Open Loop Gain TFs and PCAL to CAL-CS transfer functions reveal minimal change in the calibration of the instrument. For these measurements, all we have changed in the CAL-CS model is switching the two signs in the ESD stage, which in turn cancel each other. As such, the only change should be the change in discrepancy between the canonical model and the actual current strength of the TS / L3 / ESD stage. Again, this change was small (sub ~10%, 5 [deg]), and has been well-tracked by calibration lines, so we will continue forward with focusing our efforts on determining how to apply the time-dependent corrections. Attached are screenshots of the raw results. Darkhan's working on the more formal results. Stay tuned! The after-bias-flip results live here: /ligo/svncommon/CalSVN/aligocalibration/trunk/Runs/O1/H1/Measurements/DARMOLGTFs/ 2015-10-15_H1_DARM_OLGTF_7to1200Hz_AfterBiasFlip.xml /ligo/svncommon/CalSVN/aligocalibration/trunk/Runs/O1/H1/Measurements/PCAL/ 2015-10-15_PCALY2DARMTF_7to1200Hz_AfterBiasFlip.xml
Jeffrey K, Kiwamu, Sudarshan, Darkhan
Some conclusions based on the analysis of the DARM OLG TF and the PCAL to DARM TF measurements taken after flipping the ESD bias sign:
1although the total L3 stage actuation function sign did not change, the ESD bias sign flip was reflected in two of the SUSETMY L3 stage model EPICS replicas in CAL-CS model: H1:CAL-CS_DARM_ANALOG_ETMY_L3_GAIN and H1:CAL-CS_DARM_FE_ETMY_L3_DRIVEALIGN_L2L_GAIN.
Below we list kappas used in the kappa corrected parameter file for the measurements taken after the ESD bias sign flip on Oct 15. We used 43 minute mean kappas calculated from 60sec FFTs starting at GPS 1128984060 (values prior bias sign flip are given in brackets, previously they were reported in LHO alog comment 22552):
κtst = 1.004472 (1.057984)
κpu = 1.028713 (1.021401)
κA = 1.003843 (1.038892)
κC = 0.985051 (0.989844)
fc = 334.512654 (335.073564) [Hz]
An updated comparison script and parameter files for the most recent measurements were committed to calibration SVN (r1685):
/trunk/Runs/O1/H1/Scripts/DARMOLGTFs/CompareDARMOLGTFs_O1.m
/trunk/Runs/O1/H1/Scripts/DARMOLGTFs/H1DARMparams_1128979968.m
/trunk/Runs/O1/H1/Scripts/DARMOLGTFs/H1DARMparams_1128979968_kappa_corr.m
Comparison plots were committed to CalSVN (r1684):
/trunk/Runs/O1/H1/Results/DARMOLGTFs/2015-10-15_H1DARM_O1_cmp_AfterSignFlip_*.pdf
As a double check we created Matlab file with EPICS values for kappas using H1DARMparams_1128979968.m parameter file and made sure that the values agree with the ones currently written in the EPICS. The logs from calculating these EPICS values was committed to CalSVN (r1682):
/trunk/Runs/O1/H1/Scripts/CAL_EPICS/D20151015_H1_CAL_EPICS_VALUES.m
/trunk/Runs/O1/H1/Scripts/CAL_EPICS/20151015_H1_CAL_EPICS_*
For the record, we changed the requested bias voltage from -9.5 [V_DAC] (negative) to +9.5 [V_DAC] (positive).
J. Kissel, K. Izumi (with relocking team help from J. Warner, J. Driggers, and S. Dwyer) We've (finally) completed the couple of ETMY iStage actuator to DARM sweeps + PCAL to DARM sweeps with the IFO locked on ETMX. This took several attempts because (a) the transition from locking the DARM on ETMY to ETMX failed, (b) we accidentally rapidly flipped the ETMY bias while locked on ETMX which glitched the mass, and (c) in efforts to lock, we've rearranged when ASC gets turned on, and in doing so, during the last attempt we forgot to turn on a few of the loops. However, rubbin's racin'. More details to come once we've processed the measurements carefully, but the preliminary message is that the ESD actuation strength has decreased by 7-8% -- going from ~5-6% stronger than the model, as expected from the continuous estimate of the actuation strength from calibration lines to ~1-2% weaker than the model. Both the UIM and PUM have not changed strength at all, also as expected. As such, because the changes have been accurately tracked by the calibration lines, and the change in TST stage actuation has brought the model systematic from +5 to 6% to -2 to -1%, we will *not* be updating the front-end CAL-CS calibration (and that *includes* the EPICs record to compute the time-dependent parameters). We should also expect to see this change perfectly in the estimation of the actuation strength in the next few hours of this lock stretch. We're currently retaking DARMOLGTFs and a PCAL2DARM TF to get a similar before vs. after result comparing against this morning's result (LHO aLOG 22546), but we expect to be up and running within the hour, with as good a calibration accuracy as we've had before. More details, plots, and quantitative results to come! The data have been committed to /ligo/svncommon/CalSVN/aligocalibration/trunk/Runs/O1/H1/Measurements/FullIFOActuatorTFs/2015-10-15 2015-10-15_H1SUSETMY_L1toDARM_FullLock.xml 2015-10-15_H1SUSETMY_L2toDARM_FullLock.xml 2015-10-15_H1SUSETMY_L3toDARM_LVLN_LPON_FullLock_negativebias.xml 2015-10-15_H1SUSETMY_L3toDARM_LVLN_LPON_FullLock_positivebias.xml 2015-10-15_H1SUSETMY_PCALYtoDARM_FullLock.xml and exported to /ligo/svncommon/CalSVN/aligocalibration/trunk/Runs/O1/H1/Measurements/FullIFOActuatorTFs/2015-10-15/ 2015-10-15_H1DARM_ETMY_L1_State1_Drive_coh.txt 2015-10-15_H1DARM_ETMY_L1_State1_Drive_tf.txt 2015-10-15_H1DARM_ETMY_L2_State3_Drive_coh.txt 2015-10-15_H1DARM_ETMY_L2_State3_Drive_tf.txt 2015-10-15_H1SUSETMY_L3toDARM_LVLN_LPON_FullLock_negativebias_coh.txt 2015-10-15_H1SUSETMY_L3toDARM_LVLN_LPON_FullLock_negativebias_tf.txt 2015-10-15_H1SUSETMY_L3toDARM_LVLN_LPON_FullLock_positivebias_coh.txt 2015-10-15_H1SUSETMY_L3toDARM_LVLN_LPON_FullLock_positivebias_tf.txt 2015-10-15_H1SUSETMY_PCALYtoDARM_FullLock_coh.txt 2015-10-15_H1SUSETMY_PCALYtoDARM_FullLock_tf.txt
For the record, we changed the requested bias voltage from -9.5 [V_DAC] (negative) to +9.5 [V_DAC] (positive).
J. Kissel We're taking the IFO out of observation intent and beginning measurement prep for flipping the H1 ETMY bias sign. Stay tuned for detail aLOGs.
J. Kissel DARM OLTGF Is Complete. Results saved and committed to /ligo/svncommon/CalSVN/aligocalibration/trunk/Runs/O1/H1/Measurements/DARMOLGTFs/ 2015-10-15_H1_DARM_OLGTF_7to1200Hz_BeforeBiasFlip_A_ETMYL3LOCKIN2_B_ETMYL3LOCKEXC_coh.txt 2015-10-15_H1_DARM_OLGTF_7to1200Hz_BeforeBiasFlip_A_ETMYL3LOCKIN2_B_ETMYL3LOCKEXC_tf.txt 2015-10-15_H1_DARM_OLGTF_7to1200Hz_BeforeBiasFlip_A_ETMYL3LOCKIN2_B_ETMYL3LOCKIN1_coh.txt 2015-10-15_H1_DARM_OLGTF_7to1200Hz_BeforeBiasFlip_A_ETMYL3LOCKIN2_B_ETMYL3LOCKIN1_tf.txt 2015-10-15_H1_DARM_OLGTF_7to1200Hz_BeforeBiasFlip.xml
J. Kissel PCAL to DARM Transfer Functions complete. We're going to quickly run an A2L measurement, then open the beam diverters. After which, we'll try to preserve the lock by transitioning over to ETMX for DARM control. However, this will require turning the ETMX HV ESD driver back ON, and we're on 50% confident that the IFO lock can survive that turn on transient. Wish us luck! PCAL 2 DARM results have been committed to /ligo/svncommon/CalSVN/aligocalibration/trunk/Runs/O1/H1/Measurements/PCAL/ 2015-10-15_PCALY2DARMTF_7to1200Hz_BeforeBiasFlip_A_PCALRX_B_DARMIN1_coh.txt 2015-10-15_PCALY2DARMTF_7to1200Hz_BeforeBiasFlip_A_PCALRX_B_DARMIN1_tf.txt 2015-10-15_PCALY2DARMTF_7to1200Hz_BeforeBiasFlip.xml
DARMOLGTF model vs. meas. comparison plots from measurements prior to ESD bias sign flip are attached to this report.
Parameter files for these measurements and updated comparison scripts are committed to calibration SVN (r1673):
/trunk/Runs/O1/H1/Scripts/DARMOLGTFs/CompareDARMOLGTFs_O1.m
/trunk/Runs/O1/H1/Scripts/DARMOLGTFs/H1DARMparams_1127083151_kappa_corr.m
/trunk/Runs/O1/H1/Scripts/DARMOLGTFs/H1DARMparams_1128956805.m
/trunk/Runs/O1/H1/Scripts/DARMOLGTFs/H1DARMparams_1128956805_kappa_corr.m
Plots and a .MAT file with the models are committed to calibration SVN (r1673):
/trunk/Runs/O1/H1/Results/DARMOLGTFs/2015-10-15_H1DARM_O1_cmp_bfSignFlip_*.pdf
/trunk/Runs/O1/H1/Results/DARMOLGTFs/2015-10-15_H1DARM_O1_cmp_bfSignFlip_DARMOLGTF.mat
In the kappa corrected parameter file for the measurements taken on Oct 15 we used average kappas over 1 hour calculated from SLM tool starting at GPS 112894560. The values are listed below:
κtst = 1.057984
κpu = 1.021401
κA = 1.038892
κC = 0.989844
fc = 335.073564 [Hz]
For kappas used in parameter files for Sep 10 and Sep 23 see LHO alog comment 22071.
For the record, we changed the requested bias voltage from -9.5 [V_DAC] (negative) to +9.5 [V_DAC] (positive).