Fault Report 4683
WP 6211
One of the binary cards inside IO Chassis SEIEY was replaced this morning. This was to fix the remote auto-zero function for the STS-2 chassis. Hugh did a functionality check for the binary input/outputs for associated card. The h1seiey IO chassis and front end computer were restarted.
J. Batch, F. Clara, H. Radkins
WP 6214 Dave, Jim, Jamie Added 24G of RAM to h1nds0 to bring a total of 72GB. Increased daqd's memory buffer usage in the daqdrc from 50 to 100. Jamie tested his application that collects recent data, which now works properly. This was actually done in two steps, the first try installed a total of 96GB. We determined that was far more than was needed, so we backed that out to a total of 72GB, made up of 3-16GB DIMM in the first bank, 3-8GB DIMM in the second bank.
The LHO DMT machines were updated today with the gstlal-calibration-1.0.3 package. The GDS pipeline was restrated to work from this package at 1159637032.
For the record, the chiller controller software versions for both crystal chiller and diode chiller are:
CCC-3
Firmware-Vers. 0.82
That does not necessarily imply that a controller for the diode chiller can be replaced with one from
a crystal chiller and vice versa.
TCS-X: Full, level at 29.0, 3.7 gpm, 20.5 deg. C
TCS-Y: found water level at 4.3, added 500 mL water, raised water level to 8.7, 4.0 gpm, 20.3 deg. C
Attached are what the signals from the Kobold vortex flow sensors look like as read across
a 240-ohm resistor.
TEK00001.png shows the signals corresponding to switching off and back on the chiller.
TEK00002.png shows the signal decay from the power meter circuit flow sensor when the
chiller is switched off.
TEK00004.png both signals when the chiller is switched off.
TEK00005.png looking for glitches when one of the sensors drops
TEK00007.png both signals when the chiller is switched off, only this this both outputs
fell to zero within the same oscilloscope sweep
TEK00008.png both flow sensors were physically disconnected to simulate a power failure or
dramatic sensor failure.
TEK00010.png the power meter flow sensor output was switched off
There are a couple of things of interest to note:
1. The signal from the sensors is much "cleaner" than what comes out of data acquisition,
most likely due to the digitisation of the readout Beckhoff terminal.
2. Using an AC mains powered oscilloscope introduces a large 60 Hz signal on top of whatever
is there. A battery power oscilloscope was used for these measurements.
Time-dependent parameter ("kappas") trends calculated from two lock stretches on September are attached to this report.
It seems that the front-end produced fairly smooth kappas several hours after the most recent update of the front-end setttings (LHO alog 29992). See figures 1 and 2.
However, from later lock stretches on September 30 (after the Tuesday activites), it looks like the synchronized oscillators for SUS line were synched with an incorrect phase of 143.6 degress w.r.t. each other (see KAPPA_TST values in Fig. 3 and TF phase in Fig. 4). A similar issue was reported in the previous report (LHO alog 29992). I was able to fix the problem for this particular line by resetting the line frequency to 0 Hz (turning off the line) in the SUS-ETMY model and then setting it back to its nominal state 35.9 Hz (see Fig. 5). We probably need to check "FIXED_PHASE_OSC_WITH_CONTROL.c" for bugs.
Tagging CDS so they can help fix the bug!
A while ago we noticed that the auxillary loops have had increased noise compared to O1. Here is a plot verry similar to what I posted in 30032, but with correct labels.
Here is a more detailed timeline:
March 8th, the noise is pretty much the same as O1.
March 12th: a 2W lock where the low frequency noise is similar to O1, but the shot noise is high.
March 14th-20th, we were down for grouting work in which I think we lost the green camera references, alignment redone March 19th.
March 20th the exposure of the PR2 camera was increased from 500 to 1 million, then reset to 1000 March 21st. Since the camera was saturated at 1000, I have now reset it to the old exposure of 500.
I cannot seem to get data from late march until April 2nd, when the noise is already elevated.
April 4th the HPO is turned on, and we are down for several weeks, the noise stays around.
So, this noise could be due to some clipping or other problem that was introduced when we lost our alingment references.
TITLE: 10/04 Eve Shift: 23:00-07:00 UTC (16:00-00:00 PST), all times posted in UTC
STATE of H1: Commissioning
INCOMING OPERATOR: None
SHIFT SUMMARY: PSL down. Work continues in the morning. Calling it a night due to no laser.
LOG: None
For reasons best known to itself, the diode chiller is no longer cooling the diodes but heating them up.
This was the most likely reason why the laser tripped out when it was fired up this afternoon.
Another report will follow later about the signals we observed from the front end flow meter and the
power meter circuit flow meter.
The crystal chiller has been left running. The diode chiller is off. A new controller for it is
expected soon.
Jason/Peter
Last week (Sept. 30th) I set CP4 in manual mode and doubled the LLCV to double nominal value (up to 66% open). Fill from 92% to 100% full took about 17 min. and another hour to see LN2 spew out the exhaust. Then I set LLCV back to nominal 32% open (actually slightly less than nominal probably given the level of the Dewar) to see how long it would take to boil back to 92% full. Answer is ~ 26 hrs. Today I remembered to set the CP4 PI lower limit setting back to 20% (important when Dewar gets filled).
2:30pm local 20 sec. to overfill CP3. Left bypass exhaust valve open. Next fill due Wednesday.
* PSL down all shift for troubleshooting * 15:09 UTC Jeff B. opening rollup door between cleaning and receiving area 15:48 UTC Jim B. taking down h1lsc0 frontend to allow Filiberto to turn off IO chassis. (WP 6197) 16:13 UTC Ed starting WP 6198 16:24 UTC Filiberto done 16:33 UTC Filiberto to end Y EE room to look at remote reset for STS2 seismometer. (Hugh reports it is not working) 16:40 UTC Jeff B. starting check of dust monitors in LVEA 16:42 UTC Cheryl to TCSY table to check for water leaks 16:43 UTC Betsy starting ESD charging measurements on both ETMs 16:51 UTC Peter to PSL rack to look at connectors and signals related to chiller 16:59 UTC Hugh going to ITMX for CPS work (WP 6207) 17:05 UTC Jeff B. moving to end Y (compressor room and VEA) 17:15 UTC Gerardo to LVEA to check TCS chiller pipes for water leaks 17:16 UTC Richard transitioning LVEA to laser safe 17:19 UTC Filiberto's work on STS seismometer at end Y tripped ISI. Jim W. turned off sensor correction. Betsy restarting ESD charge measurements. 17:29 UTC LVEA transitioned to laser safe 17:29 UTC Jeff B. moving to end X (compressor room and VEA) 17:37 UTC Hugh back to ITMX 17:37 UTC Cheryl done, checked both TCS tables, no signs of water. 17:47 UTC Betsy turning TCS laser back on (tripped, cause unknown). Holding off on charge measurements due to multiples ISI trips at both end stations 17:53 UTC Jamie starting guardian update (WP 6208) 17:54 UTC Gerardo done 17:59 UTC Ed done 18:06 UTC Jeff B. done 18:12 UTC Hugh to end Y to look at CPS 18:22 UTC Chandra going for jog on X arm 18:28 UTC Filiberto done 19:04 UTC Peter and Jason breaking for lunch 19:52 UTC Betsy restarting charge measurements 20:19 UTC Peter and Jason back to LVEA PSL racks 20:34 UTC Hugh to LVEA to check CPS for BS 20:52 UTC ETM charge measurements done 20:55 UTC Chandra to mid Y to fill CP3 22:00 UTC Betsy to optics lab 22:05 UTC Vern to LVEA to check on Peter and Jason 22:50 UTC Photographer for Science magazine through gate Forgot to log time: Karen and Christina to LVEA to swift
Since the PSL was being worked on this morning, I took the opportunity to take the ETM charge measurements so that we don't have to take up time tomorrow. The coherence data looks good, however NDS is whining about something and won't let me produce the long trend. Show me the money!
Soooo, TBC...
(Note, I had to restart the measurements a few times this morning since the ISIs kept tripping unexpectedly with expected SEI work.)
NDS likes me more than Betsy. Conclusion: We can wait another week or so before flipping the biases again. ETMY is close to needing it than ETMX, but ETMY has one quadrant that's got ~20V more negative charge than the rest, so we'll let it accumulate more positive ions and flip them both at the same time again.
In an attempt to bring some clarity into the beam jitter discussion I looked at the Gouy phase evolution of the input beam. I collected distance and focal length information from a variety of sources, notably T1200470 and E1200616.
The biggest uncertainty I had was the PSL persicope to HAM1 viewport distance - if someone knows that, let me know.
The MATLAB script with all the numbers is in ~controls/sballmer/20160930/inputBeamCalc.m. It creates a structure of the following form, fully describing the beam and optical mode:
IMC =
lambda: 1.0640e-06 % The wavelength in m
q: 0.2325 +13.3832i % The input Gaussian beam parameter q=z+izR in m
N: 4 % number of optics
dist: [16.2406 16.2406 0.2325 0.2325 0] % Distances between the optics (one more than N)
ifoc: [0.0731 0 0 0] % inverse focal length for all lenses and mirrors (f=R/2 for mirror)
label: {'MC2' 'MC3' 'Waist' 'MC1'} % optic names
The attached .mat file contains the following structures of that form::
IMP: Input beam: From PSL periscope to MC3
IMC: Input Mode Cleaner
IMCp: Input Mode Cleaner from MC1 to MC3 only (output path inside IMC)
IM: Input Mirros: from IMC to PRM
PRC: Power Recycling Cavity forward path
PRCr: Power Recycling Cavity return path
PRCrt:Power Recycling Cavity round trip
Below are plots and data for the different beam segments.
Input Mode Cleaner:
IMC =
lambda: 1.0640e-06
q: 0.2325 +13.3832i
N: 4
dist: [16.2406 16.2406 0.2325 0.2325 0]
ifoc: [0.0731 0 0 0]
label: {'MC2' 'MC3' 'Waist' 'MC1'}
Pin: 50
z= 00.0000 m, Gouy phase: 00.0000 deg after passing MC1; Spot size w=2.1293 mm
z= 16.2406 m, Gouy phase: 49.9133 deg after passing MC2; Spot size w=3.3764 mm
z= 32.4812 m, Gouy phase: 99.8267 deg after passing MC3; Spot size w=2.1293 mm
z= 32.7137 m, Gouy phase: 100.822 deg after passing Waist; Spot size w=2.129 mm
z= 32.9462 m, Gouy phase: 101.8172 deg after passing MC1; Spot size w=2.1293 mm
Round trip Gouy phase: 101.8172 deg
Gouy Phase from input coupler (MC1) to output coupler (MC3): 99.8267 deg
Input mirrors: From PSL periscope to MC3:
IM =
lambda: 1.0640e-06
q: -0.2325 +13.3832i
N: 6
dist: [0.2325 0.5507 1.0613 1.1703 1.2071 0.4130 0]
ifoc: [0 0 0.1562 -0.3199 0 0.0409]
label: {'Waist' 'IM1' 'IM2' 'IM3' 'IM4' 'PRMlens'}
z= 0.0000 m, Gouy phase: 0.0000 deg after passing MC3; Spot size w=2.1293 mm
z= 0.2325 m, Gouy phase: 0.99527 deg after passing Waist; Spot size w=2.129 mm
z= 0.78319 m, Gouy phase: 3.3516 deg after passing IM1; Spot size w=2.1308 mm
z= 1.8445 m, Gouy phase: 7.8634 deg after passing IM2; Spot size w=2.1444 mm
z= 3.0148 m, Gouy phase: 13.8099 deg after passing IM3; Spot size w=1.7841 mm
z= 4.2219 m, Gouy phase: 19.9983 deg after passing IM4; Spot size w=2.1257 mm
z= 4.6349 m, Gouy phase: 21.6763 deg after passing PRMlens; Spot size w=2.2471 mm
Input beam: From PSL periscope to MC3:
(The PSL periscope to input viewport distance is an educated guess.)
INP =
lambda: 1.0640e-06
q: -7.3931 +13.3832i
N: 6
dist: [0 2.7100 4.0180 0.2118 0.1400 0.2563 0.2895]
ifoc: [0 0 0 0 0 0]
label: {'PSLperiscope' 'INPUTViewPort' 'PeriscopeTop' 'PeriscopeBottom' 'Steer1' 'Steer2'}
z= 0 m, Gouy phase: 0 deg after passing PSLperiscope; Spot size w=2.4323 mm
z= 2.71 m, Gouy phase: 9.6308 deg after passing INPUTViewPort; Spot size w=2.2556 mm
z= 6.728 m, Gouy phase: 26.0719 deg after passing PeriscopeTop; Spot size w=2.1316 mm
z= 6.9398 m, Gouy phase: 26.9771 deg after passing PeriscopeBottom; Spot size w=2.1302 mm
z= 7.0798 m, Gouy phase: 27.5759 deg after passing Steer1; Spot size w=2.1296 mm
z= 7.3361 m, Gouy phase: 28.6729 deg after passing Steer2; Spot size w=2.129 mm
Power Recycling Cavity:
PRCrt =
lambda: 1.0640e-06
q: 7.1228 + 5.2551i
N: 8
dist: [16.6128 16.1551 24.8880 0 0 24.8880 16.1551 16.6128 0]
ifoc: [-0.4391 0.0556 -2.3189e-04 -0.0010 -2.3189e-04 0.0556 -0.4391 -0.1818]
label: {'PR2' 'PR3' 'ITMlens' 'ITMback' 'ITMlensr' 'PR3r' 'PR2r' 'PRM'}
z= 00.0000 m, Gouy phase: 00.0000 deg after passing PRM; Spot size w=2.2471 mm
z= 16.6128 m, Gouy phase: 23.9355 deg after passing PR2; Spot size w=6.1716 mm
z= 32.7679 m, Gouy phase: 24.8769 deg after passing PR3; Spot size w=53.9602 mm
z= 57.6559 m, Gouy phase: 25.0458 deg after passing ITMlens; Spot size w=52.9743 mm
z= 57.6559 m, Gouy phase: 25.0458 deg after passing ITMback; Spot size w=52.9743 mm
z= 57.6559 m, Gouy phase: 25.0458 deg after passing ITMlensr; Spot size w=52.9743 mm
z= 82.5438 m, Gouy phase: 25.2148 deg after passing PR3r; Spot size w=53.9602 mm
z= 98.6989 m, Gouy phase: 26.1562 deg after passing PR2r; Spot size w=6.1716 mm
z= 115.3117 m, Gouy phase: 50.0916 deg after passing PRM; Spot size w=2.2471 mm
Round trip Gouy phase: 50.0916 deg (one-way Gouy phae: 25.0458 deg)
I see you've used 2.71 [m] as your distance between the PSL periscope an the HAM1 viewport, and mentioned this was a big uncertainty. If I take the corner station Rack/Cable tray layout D1002704, which tells the distance between the HAM1 viewport and the +X edge of the PSL table is 86 [in], and add it to the distance from the edge of the table to the periscope mirrors from D0902114 -- 14 [in] -- I get an even 100 [in]. Thus, 2.54 [m] is likely a better number. I tag Systems just in case they have an even more accurate/precise number, but I think past the ~inch level precision, we'd need to measure it.
| T1000696-v2 | PSL table to HAM1 door flange | 88in |
| T1000696-v2 | HAM door depth | 18in |
| picture | top periscope mirror to edge of table | 14in |
| total | top periscope to input viewport | 84in, 2.134m |
T1000696-v2 has verified distances.
D1002704 is measuring PSL table North edge to HAM1 door flange, and states it's 86 inches.
D1102219-v1, Micheal Rodruck's document, aptly named H1_table_v1.pdf, has what I believe are measured values, though not in a form that's easy to use, but what I've looked at is consistant with T1000696-v2.
Using this combination of documents, the outer PSL wall to the input viewport is calculated to be 70 inches, something that could easily be measured.
This is a plot of the jitter measured by the IMC WFS DC PIT/YAW sensors during last nights lock. The 280 Hz periscope peak reaches about 1x10-4/√Hz in relative pointing noise, or about 3x10-4 rms. The relative pointing noise out of the HPO is about 2x10-5/√Hz at 300 Hz. After the attenuation through the PMC this would correspond to a level below 10-6/√Hz. The jitter peaks show up in DARM, if they are high enough. This is clearly visible in the coherence spectra.
The ISS second loop control signal is an indication of the intensity noise after the mode cleaner with only the first loop on. The flat noise level above 200 Hz is around 3x10-6/√Hz in RIN, with peaks around 240 Hz, 430 Hz, 580 Hz and 700 Hz. Comparing this to the free-running noise in alog 29778 shows this RIN level at 10^-5/√Hz. We can also compare this with the DBB measurements, such as in alog 29754: the intensity noise after the HPO shows a 1/f behaviour and no peaks. Looking at the numbers it explains the noise below 300 Hz. It looks like a flat noise at the 10^-5 level including the above peaks gets added to the free-running intensity noise after the PMC. The peaks in the controls signal of the second loop ISS line up with peaks visible in the pointing noise. But, neither the numbers nor the spectral shape matches. These peaks have coherence with DARM.
Checking the calibration of the WFS DC readouts I noticed a calibration error of a factor of 0.065. So, all angles measured by the WFSs should be scaled by this number. This still makes the jitter after the PMC dominant, but one might expect to see some of the HPO jitter peak show through in places where the downstream jitter has a valley. In any case, we should repeat the PSL jitter measurement with the IMC unlocked.
A report of the measured beam jitter at LLO is available in T1300368.
An earlier measurement at LHO is reported in alog 21212. Using an IMC divergence angle of 1.6x10–4 rad, the periscope peak at 280 Hz is around 10^-4/√Hz. This is closer to the first posted spectrum with the "wrong" calibration. Here I post this spectrum again and add the dbb measurement of the jitter out of the HPO propagated through the PMC (1.6%), but scaled by a fudge factor of 2. The Sep 11, 2015, spectrum shows a more or less flat noise level below 80 Hz, whereas the recent spectrum shows 1/f noise. The HPO spectrum also shows as 1/f dependency and is within a factor of 2 of the first posted spectrum. If jitter into the IMC is the main coupling mechanism into DARM, the HPO jitter peaks above 400 Hz are well below the PSL table jitter after the PMC and the would not show up in the DARM spectrum.
Kiwamu, Sudarshan, Jenne, Darkhan
Overview
EPICS records that are used for calculating DARM time-dependent parameters ("kappas"), were updated using corrected DARM model (with the correct sign of the ETMY_L3_DRIVEALIGN_L2L gain). These EPICS values result in reasonable kappa values (see details).
"512 Hz DAQ downsampling" filter was installed into CAL-CS synched oscillator that replicates 35.9 Hz cal. line (ESD).
Investigations showed that the synched oscillators for 35.9 Hz cal. line were running at 180 degrees out of phase w.r.t. each other. They got synched to the same phase after I played some with the oscillator settings in CAL-CS model.
Jenne noticed that today fC was oscillating between 320 and 360 Hz at the time-scale of ~20s. This issue was resolved by turning on low-pass filters in the CAL-CS model.
Details
Sudarshan confirmed that kappas calculated from SLM tool data using these EPICS values are within reasonable ranges. After updating EPICS records one of the issues was that κTST calculated in the front-end was around -1.0. Further investigations showed that the synched oscillators for 35.9 Hz cal. line in SUS-ETMY and CAL-CS models were running at 180 degrees out of phase w.r.t. each other. We could get rid of the discrepancy by setting the phase of the CAL-CS oscillator to 180 degrees (see attached plot).
After changing settings on the synchronized oscillators their phases somehow got synchronized. So, I removed 180 degrees of an additional phase in the CAL-CS oscillator. It is still not clear what was the cause for the phase of two synched oscillators being exactly 180 degrees off. Now the oscillator outputs (after the 512 Hz DAQ downsampling) are pretty much the same (TF measurement at 35.9 Hz is attached).
New EPICS values and corresponding logs were commited to calibration SVN. The values were accepted in SDF_OVERVIEW.
Tagging CDS so they can help address the bug in the synchronized oscillators!
Here is a frequency noise coupling transfer function during tonight's lock.
I calibrated REFL9 into watts using a the factor 2900 V/W (from the diode to the output of the demodulator) and 12 dB, −21 dB, and 2 V/V for the analog and digital signal gains.
If the loop is shot-noise-limited (with 4.6 mW on the diode), this implies a noise of about 40 pW/Hz1/2. This would imply a noise in DARM that is more than a factor of 10 below DARM shot noise.
Daniel and I spent some time looking at the various CARM error and control signals we have on hand.
Here we have referred the fast (ao) control signal back to the error point in watts. The horizontal line is the shot noise for 5 mW.
The slow control signal (LSC-REFL_SERVO_SLOW) would also probably work as a proxy for the error point, once properly referred. The error readback (LSC-REFL_SERVO_ERR) is heavily contaminated by some kind of white noise. Ditto LSC-REFL_A_RF9_I_ERR.
I have keyed off the TCSY laser in order to check the chiller reservoir further.
I turned the TCSY laser back on. Not much more to say on the chiller story - we're still adding a little water every day. I'll let another few days go and trend fill data to see if we're tapering off.