State of H1: aligned and locking, has made it to NLN but lost lock, ALS Y arm fiber polarization shot up to 28%, now adjusted back down
Activities:
H1 Observations:
It appears that the new channels in the h(t) frames contain some NaN or inf values that the DQ program refused to process. This cause the low-latency data to hang. In order to repair this I had to set an environment variable and restart the process managers on h1dmt0 and h1dmt2. Hopefully everything will run smoothly from here out.
Attached are the results of the BSC and HAM spectra as requested by FAMIS 6871. I didn't see anything glaring, but I also don't know what I'm looking at.
Generally these all look fine with regard to the intention of this test. There are no outlying base levels in the higher frequency (above the 'details' < 20 Hz) range.
here is the timeline of yesterday evening's h1oaf0 DAC problem which required a restart of the IOP model
All times are local PST.
Prior to the problem, h1iopoaf0 STATE_WORD is 512 (OVERFLOW)
| delta-T | time | event |
| 0:00 | 19:23:00 | IOP DAC drives go to zero volts. h1iopoaf0 STATE_WORD=652(ADC,DAC,DACKILL,OVERFLOW) |
| +5:00 | 19:28 | phone conversation, decision to restart IOP models |
| +11:00 | 19:33 | models restarted after killing them, DAC drive is restored. Presumably killing model h1susprocpi caused lock loss |
Jeff,
This monitor has been regularly sounding. Below are the PSL dust monitors in their current configurations. There were no incursions today. No fans or environmental controls were changed and winds are below 10 mph.
J. Oberling, E. Merilh
The PSL tripped out this morning due to the commissioning work detailed here. The cause is the ILS losing lock, which then triggered the HPO power watchdog and shut off the HPO; the 35W FE and the chillers remained operational. The system recovered without issue and is now back up and running. I took the opportunity to reset the injection locking counter in both Beckhoff and the Laser MEDM screen, and tweaked up the beam alignment into the PMC (hooray for remote control!) to recover the PMC transmitted power we had yesterday (alignment drift due to temperature changes in the PSL enclosure with the environmental controls on and off).
Keita Daniel
Yesterday, a large oscillation around 1 MHz was observed on the DC readout of the PMC locking diode. The DC readout is tapped directly at the HF transimpedance amplifier with a 50 Ω series resistor, see D1002163. It is available at the rack and hooked to the trigger PD input of the field box. There doesn't seem to be any termination on the rack side! The DC level of the PMC readback was about 120 mV, whereas the ILS PD showed about 1 V. The transimpedance for the PMC locking diode is 1 kΩ, where it is 820 Ω for the ILS diode. No oscillation was observed. We also looked at the signal on the RF spectrum analyzer. But, when we tried it for the ILS, the HPO tripped. End of expedition.
16:51 Daniel and Keita out to LVEA to work on PMC
17:09 Hugh reports that ISI_CONF reporting ETMY at BLEND_45mHz_SC_useism is actually incorrect. It's actually set to the 250mHz.
17:13 LASER tripped (injection locking) while Keita and Daniel working in PSL rack. Jason coming to control room to restart.
17:56 Relocking resumed
17:57 Cheryl on site
Added 175ml to the crystal chiller
We had at least one lockloss tonight that seemed to be caused by SR2 glitches. Screenshot is attached.
It seems like SR2 was noisier after maintence day today.
But our main problem tonight was that the refl WFS (which we have taken in and out several times over the last week) don't work when the microseism is around the 90th percentile or more.
For such high microseism situations, it may be worth switching back to the 45 mHz blends for all the test-mass chambers, with or without sensor correction.
We are leaving the IFO in observe, but there is scattering from ISCT1 because we can't move to REFL wfs with the higher ground motion. This is something to look at in the morning, but it caused us many locklosses tonight.
The IMC WFS offsets that were working early last week don't seem repeatable tonight.
Nutsinee switched the test mass ISIs to BLEND_45_SC_useism, that went OK except for some large glitches when switch ETMX, but when I tried switching to REFL WFS again we dropped the lock. We probably need to look at finding a better matrix for refl WFS and getting rid of the oscialltion in the centering and IMC WFS.
Speculation about REFL WFS. Yesterday I was concerned that PR2 had moved what seemed like a lot (8-10urad) when I did the Inital Alignment. I would expect something smaller like 2urad. I couldn't find a cause for that, but I did notice IM4 also changed by 20urad in yaw. A change of 20urad in yaw of IM4, assuming PRM moved to match the change of the PRC input beam, would propigate to the REFL WFS, and my estimate for the change in beam position at REFL WFS to be 168um. I don't know the beam size on REFL WFS, but the IMC WFS is about 250um, so if REFL WFS is about the same, the 168um is a beam position change of ~70%.
Jeff K, Sheila, Nutsinee, Dave (on phone)
We got a verbal alarm warning that TCS chillers are about to trip. On OAFIOP GDS TP screen -- ADC, DAC, IPC, and DK were red. We restarted the model following procedure from alog27435. For the record temperature goes down 0.1 C per minute, which gives us about 50 minutes to recover as soon as OAF crashed (Sorry Jeff, we probably could have waited until your measurement was finished). As soon as the model got restarted PI Mode27 jumped up and broke the lock. That part was unclear why.
| Work Permit | Date | Description | alog/status |
| 6310.html | 2016-11-08 11:14 | Mount scroll pump on previously installed unistrut framing within Turbo pump stand*Test functionality of Turbo "safety valve" interlock when control cable is connected to scroll pump box*Requires running both pumps for a few minutes | 31325 |
| 6309.html | 2016-11-08 08:44 | Perform scheduled maintenance to scroll compressor #1, #2 @ X-MID vent/purge-air supply skid. Maintenance activity will require for the compressors to run for brief periods of time. Lock-out/tag-out power to skid. | 31339 |
| 6308.html | 2016-11-07 23:19 | Install gstlal-calibration-1.0.7 on the DMT. * Bug fixes to the demodulation routine for kappa calculations (https://alog.ligo-la.caltech.edu/aLOG/index.php?callRep=29156) * Addition of six new channels for un-gated kappas in h(t) frames * Removal of two deprecated channels in h(t) frames | 31315 |
| 6307.html | 2016-11-07 22:38 | Turn off automatic turn on on power failure on Beckhoff BRS computers in bothe end stations and install KVM cables in both as well | 31327 |
| 6306.html | 2016-11-07 14:23 | update H1EDCU_HWS.ini file to latest HWS python code EPICS channels. DAQ restart required. | 31327 |
| 6305.html | 2016-11-07 14:12 | Request for Fred to give a tour of the LVEA for Bill Althouse (LIGO's 1st Chief Engineer) on Thurs (11/10). | |
| 6304.html | 2016-11-07 13:57 | Tour of facilities by a group from the University of Utah. | |
| 6303.html | 2016-11-07 12:45 | Rebuild daqd on h1fw2 against a newer FrameCPP (the version installed at LLO) which has an updated leap second table. We will compare the frames generated by h1fw2 with the production machines to verify it is safe to update h1fw0 & h1fw1 next week. | 31310, 31327 |
| 6302.html | 2016-11-07 10:43 | Re-center active H1 optical levers. This includes ETMx, ETMy, ITMx, ITMy, BS, PR3, and SR3. These optics need to be in their "Aligned" state for the duration of the re-centering. No viewports will be exposed during this work. | 31333 |
| 6301.html | 2016-11-07 10:40 | Tweak the PSL prior to LHO entering ER10. This will involve tweaking the beam alignment into the FSS Reference Cavity, checking the beam alignment through the FSS AOM, and tweaking the HPO pump diode currents so the HPO is operating at an optimal power level. | 31326 |
| 6300.html | 2016-11-07 10:38 | Improve PMC mode matching. This will be done by moving mirrors L02 and L03, and possibly L01. Depending on whether or not we need to move L02, we may need to move mirror M37 for clearance purposes. M37 directs the 1st order diffracted beam from the ISS AOM into a beam dump, so moving this mirror will require a re-alignment of this beam path. This work will also require re-aligning the beam into the PMC. | 31326 |
| 6299.html | 2016-11-07 09:45 | Renew SSL certificate for marble | |
| 6298.html | 2016-11-07 07:48 | Change lights in mechanical room at Y End per FRS 6417. This FRS was filed on M Y but I talked to the person that filed the report and it is actually E Y. We will need to transport the single man lift to the end station for this work. | |
| 6297.html | 2016-11-07 07:41 | Bail tumbleweeds near the H-2 electronics building and possibly along the Y arm, time permitting. | |
| 6296.html | 2016-11-04 15:24 | Weekend work. Isolate the water at different buildings individually in an attempt to locate a water leak. This work may be done on Saturday or Sunday or both depending on how many people are on site. | |
| 6295.html | 2016-11-02 12:21 | Activity: modify the models h1pemex, h1pemey and h1lsc to record ESD power supply monitor channels to the DAQ. To avoid changing the common LSC.mdl this DAQ-block will be added to h1lsc.mdl. DAQ restart and permission to add 9*4096 chans to frame needed. | 31327 |
| 6294.html | 2016-11-02 12:08 | Install low pass filtering in the DAQ readbacks of the IMC servo board. | |
| UPDATES of PRIOR POSTINGs | |||
| 6287.html | 2016-10-31 14:27 | Add an extra PEM ADC to the h1oaf0. Shuffle the new ADC with the one used by h1ngn. h1iopoaf0 model change. DAQ restart. | 31075, 31316, 31327, 31308 |
WP6287 Add PEM ADC card to h1oaf0
Jim, Dave, commissioning
this turned into a large task. Please see alog 31316 for details. Currently the ADC card is in the chassis and we are not seeing any errors. We will monitor for any recurrence of ADC/DAC errors on this system, or nf_conntrack table errors.
WP6295 Add PEM-EX chans to DAQ for ESD-PS monitoring
Ansel, Robert, Dave
h1pemex was modified to add three test ADC channels to the DAQ at 2048Hz.
WP6303 Run later version of Frame-cpp on DAQ FW2
Jonathan,
as a test of using frame-cpp version 2.5.2 in the DAQ, the new version is being tested on h1fw2. This is the latest version supported by Ubuntu-12. It does have the leap-second modification needed for 31Dec2016.
WP6307 Add BRS Beckhoff computers to CDS KVM
Carlos
The new Beckhoff branded BRS computers at EX and EY were added to the KVM so we don't need to support an additional monitor, keyboard and mouse. These computers do not have an on/off switch, so we are unable to stop them booting up when power is restored after an outage.
WP6306 Update Hartmann Wavefront Sensor channels into DAQ
Kiwamu, Nutsinee, Dave
I have updated the H1EDCU_HWS.ini file now all four hws systems are running the new python code. Starting with the EPICS database file, I made a list of non-string channels (i.e. binary and analog channels).
Interestingly ITMX was found to be missing 14 channels which appear in the other systems. These channels have ITMM in their names. After discussion with Kiwamu and Nutsinee we decided to remove these from the ini file for now.
DAQ Restart
Jim
DAQ was restarted to: add ADC to h1iopoaf0, add chans to h1pemex, add new H1EDCU_HWS.ini.
Following the install of an updated H1EDCU_HWS.ini file this morning, Nutsinee has started the h1hwsey code and the DAQ EDCU is GREEN again. Note to operators, from now onwards if the EDCU block on the CDS overview becomes PURPLE we should investigate why.
J. Kissel, D. Tuyenbayev Following preliminary results from Darkhan on the individual actuation strength of the UIM and PUM stages for H1SUSETMY (see, thus far LHO aLOG 31275), and the current delightfully long lock stretch with them in place, I'm bringing this study to a close. I've turned off the temporary L1 and L2 calibration lines at 33.7 and 34.7 Hz, respectively. We do not intend on turning on these lines again for the duration of the run. These lines were turned OFF at Nov 07 2016 21:21:49 UTC.
Summary
A refined analysis of the L1, L2 and L3 stange actuation strenghts was done using the data from last several days that include several low-noise lock stretches. Actuation strength factors are:
KU = 8.020-8 +/- 2.983-10 N/ct ( std(KU) / |KU| = 0.0037 )
KP = 6.482-10 +/- 2.748-12 N/ct ( std(KP) / |KP| = 0.0033 )
KT = 4.260-12 +/- 1.313-14 N/ct ( std(KT) / |KT| = 0.0031 )
Details
Following 4 lines were used to calculate the factors: UIM (L1) line at 33.7 Hz, PUM (L2) line at 34.7 Hz, TST (L3) line at 35.9 Hz and PcalY line at 36.7 Hz. The most recent DARM model parameters were used for this analysis. Also, values past Nov 5 were calculated with the updated DARM filters (see LHO alog 31201), not accounting for this would produce results biased by 1-2%.
Each data point is a quantity calculated from 10s FFTs. The outliers were removed in two steps:
- took the mean and the standard deviation of all data points in intervals when the IFO range was >=50 MPC, removed 3-sigma outliers;
- removed the 3-sigma outliers from the mean of the remaining data points.
The mean values and the standard devitaions noted above were taken from GPS time interval [1162369920 1162413500], ~11 hours of low-noise data (blue markers). Standard errors on the mean values, std(Ki) / sqrt(N), are orders of magnitude smaller compared to the Pcal and the DARM loop model uncertainties (number of data points in the seletected interval - N=4251).
For preliminary results from Nov 4 data and before see related reports: 31183, 31275.
Recall the ER8/O1 values for these coefficients were
'Optic' 'Weighted Mean' '1-sigma Uncertainty' '1-sigma Uncertainty'
'Stage' '[N/ct]' '[N/ct]' '%'
'ETMY L1' '8.17e-08' '3.2e-09' '3.9'
'ETMY L2' '6.82e-10' '5.2e-13' '0.076'
'ETMY L3' '4.24e-12' '4.1e-15' '0.096'
from LHO aLOG 21280.
Comparing against numbers above,
KU = 8.020-8 +/- 2.983-10 N/ct ( std(KU) / |KU| = 0.0037 )
KP = 6.482-10 +/- 2.748-12 N/ct ( std(KP) / |KP| = 0.0033 )
KT = 4.260-12 +/- 1.313-14 N/ct ( std(KT) / |KT| = 0.0031 )
This means a change of
(ER8 - ER10)/ER8 =
ETMY L1 0.0183
ETMY L2 0.0495
ETMY L3 -0.0047
We will compare these numbers against those determined by frequency-dependent transfer functions, e.g. the to-be processed data from LHO aLOG 31303, and update the low-latency/ calibration accordingly next week. It will also be interesting to re-cast the L1 and L2 numbers into a combined actuation strength change from ER10/O1, and compare it against the constantly calculated kappa_PU and check consistency there.
Data points prior to DARM filter update mentioned in the report were analyzed with the help of following DARM model parameters:
ifoIndepFilename : ${CalSVN}/Runs/PreER10/Common/params/IFOindepParams.conf (r3519)
ifoDepFilename : ${CalSVN}/Runs/PreER10/H1/params/H1params.conf (r3640)
ifoMeasParams : ${CalSVN}/Runs/PreER10/H1/params/H1params_2016-10-13.conf (r3519)
and after the the DARM filters were updated (GPS 1162336667) the following configuration was used:
ifoIndepFilename : ${CalSVN}/Runs/PreER10/Common/params/IFOindepParams.conf (r3519)
ifoDepFilename : ${CalSVN}/Runs/PreER10/H1/params/H1params_since_1162336667.conf (r3640)
ifoMeasParams : ${CalSVN}/Runs/PreER10/H1/params/H1params_2016-10-13.conf (r3519)
Scripts were uploaded to CalSVN at
${CalSVN}/Runs/PreER10/H1/Scripts/Actuation/2016-11-08/
5 days SLM data (75 MB): ${CalSVN}/Runs/PreER10/H1/Measurements/Actuation/2016-11-08/
Plots: ${CalSVN}/Runs/PreER10/H1/Results/Actuation/2016-11-08_H1_UPT_act_strengths_*
We discovered that in the single-line analysis we had an incorrect sign for TST stage actuation (we incorrectly set the sign of the N/ct coefficient).
The updated results have been posted in LHO alog 31668.
This is a comparison between the ISS, ILS and PMC signals before (REF traces) and after the changes in the electroncis and the modulation depth, see 31095.
A few observations:
A better plot showing the relationship between the ILS and PMC mixer and HVMon signals.
Reducing the ILS gain by 16 dB increases the noise seen by the PMC by the same amount below 1 kHz. This change reduced the ILS ugf from ~10 kHz down to ~1 kHz.
The PMC PZT is decribed in alog 30729:
The ILS PZT is
Lockloss tool cannot connect.