Displaying reports 52961-52980 of 83305.Go to page Start 2645 2646 2647 2648 2649 2650 2651 2652 2653 End
Reports until 05:54, Friday 04 November 2016
H1 PSL
peter.king@LIGO.ORG - posted 05:54, Friday 04 November 2016 (31194)
PSL high power attenuator
I looked over the mechanical drawings of the high power attenuator.  The position of the mount holding
the thin film polarisers is largely set by two dowel pins in the base and the machining tolerances.
However the nominal angle of incidence of the design is 55.014 deg.

    The thin film polariser coating has a measured transmission of 99.552% and 0.036189% for p and s
polarisations respectively, which is a ratio of ~2750:1.  There is no information about the coating's
sensitivity to incident angle but generally speaking these sort of coatings do tend to be a little
sensitive to incident angle.  That said, it might just be that the beam alignment into the high power
polariser is off a little.
H1 PSL
thomas.shaffer@LIGO.ORG - posted 02:13, Friday 04 November 2016 (31192)
Weekly PSL Chiller Reservoir Top-Off

FAMIS#6495

No water was added to the crystal or diode chiller, both were at their nominal levels.

H1 General
edmond.merilh@LIGO.ORG - posted 23:59, Thursday 03 November 2016 (31191)
Shift Summary - Eve
TITLE: 11/04 Eve Shift: 23:00-07:00 UTC (16:00-00:00 PST), all times posted in UTC
STATE of H1: Lock Aquisition
INCOMING OPERATOR: TJ
SHIFT SUMMARY:
Decent locking tonight. PEM work done. Some Violin mode damping practice. Fairly quiet night.
LOG:

23:32 Adjusted fiber polarization for Y arm and tweaked X arm as well

23:35 /ligo computer crash, momentarily interrupted work stations and internet.

00:05 Robert out to EY. OpLev Damping L2 P gain ramped to 0 from -300.

00:39 a2l_min_LHO.py

00:42 script done 

00:47 a2l_min_PR2.py

00:48 set observatory mode to 'commissioning' about 1 hour late.

00:50 script done

00:53 00:39 a2l_min_PR3.py

00:57 script done

01:28 damping violin modes: ETMY mode7 and ETMX mode4.Y- Mode 7; I changd gain from -20 to -60 significant damping occurred. X-Mode4 reversed phase from +60 to-60 and changed gain from -18.343 to -150. It seemed to be damping slightly but then returned.

02:37 after reverting ETMX Mode4  phase and changing gain to -120.343, the RMS value has come down to 4.42 from 4.59. I'm not sure if this is my doing or just a normal ringdown.

05:54 PI mode 27 ringing up. changed phase from 150˚ to 80˚.

05:08 Lockloss. Turning BRS back on at EY. Also, OpLev damping re-enabled back to -300 gain.

06:59 Turning over to TJ

H1 PEM
robert.schofield@LIGO.ORG - posted 22:37, Thursday 03 November 2016 (31190)
Air currents in the PSL enclosure: makeup air is just below limiting DARM, temperature differences along beam path reach 9 degrees C

I checked that the makeup air in the PSL enclosure was not limiting us at the 20% nominal setting. However, I found that at 100%, it would limit us. Figure 1 shows the difference in DARM between makeup air on/off  at 100% fan speed. Red is makeup air on, Blue, off.  I am particularly concerned with the regions such as between 15 and 22 Hz where the DARM noise increases but the microphone level does not increase. I don’t think we can make accurate estimates of air current noise using the microphones.

Another source of air currents that may produce jitter are the temperature variations along the beam path. Figure 2 shows a FLIR image of the beam path between the HPO and the DBB. I took this image on Monday. The table surface reading was 23 degrees C while the walls of the HPO were 26 degrees and the walls of the DBB were 26.5. I think that the temperature differences with respect to the table may generate an air current down onto the table, crossing the beam path, and up the sides of the boxes. The space between the Front end and the HPO is a similar channel. Downstream of the jitter-reducing PMC, near the main beam path under the periscope, lies the PI piezo controller (Figure 3). Because of its transformer, it is a warm 32 degrees C, nearly ten degrees hotter than the surrounding environment. The cool air coming in to replace the rising current above the controller may cross the main beam path. This would be very easy to move somewhat further away to test for any change in DARM.

Non-image files attached to this report
H1 General (SEI, SUS)
edmond.merilh@LIGO.ORG - posted 22:11, Thursday 03 November 2016 (31189)
05:08 Lockloss. Turning BRS back on at EY. Also, OpLev L2 P damping re-enabled back to -300 gain.
H1 SEI (PEM)
brian.lantz@LIGO.ORG - posted 20:59, Thursday 03 November 2016 (31188)
looking at wind history for windy time Oct 17
for my own edification, I took a look at End X during a wind time on Oct 17. 
wind storm started at about 1 am Pacific time and went for about 8 hours. 

(note to self - repeat this for Oct 14 - see Jim Warner alog
https://alog.ligo-wa.caltech.edu/aLOG/index.php?callRep=30547)

I can see several things:
1) The wind direction indicator seems to work as long as the wind is blowing hard enough. This is great. 
Conversion is : add (180-37) = 143 degs. 
This makes 90 (towards -Y) into 233 (from the SW, up along the Y arm)
see plots 1&2 for wind history during monitor period.


2) building tilt is still related to wind. From 1 mHz to 20-30mHz, the relation between floor tilt and wind-speed^2 is quite clear - good coherence, time series look similar. 
(plots 3&4)
TF is odd though,(plot 5) it doesn't appear to follow Kramers-Kronig. 


3) The wind speed indicator gives decent data at frequencies below 20-30 mHz. This limit is set by the discrete reporting levels in some ADC.
(see plot 6) There may also be some low pass filters, but those are the biggest limit on data quality. 

Non-image files attached to this report
H1 General
edmond.merilh@LIGO.ORG - posted 20:13, Thursday 03 November 2016 (31187)
Mid-Shift Summary
H1 ISC
sheila.dwyer@LIGO.ORG - posted 19:51, Thursday 03 November 2016 - last comment - 06:02, Friday 04 November 2016(31186)
Some noise estimates

Here are some noise estimates for our current configuration (at 25W).  The PMC PZT noise was measured before tuesdays fix, if I can get some time I will remeasure that tonight.

 These curves are a combination of excess power measurements, gwinc curves for thermal and residual gas, and Evan Hall's noise budget code. 

Obvious things that are still missing are frequency noise and ESD DAC noise.

Images attached to this report
Comments related to this report
sheila.dwyer@LIGO.ORG - 06:02, Friday 04 November 2016 (31193)

Looking at the noise budget above, we should be limited by shot noise around 100Hz, so increasing the power should expose the noise more.  I decided to try 35Watts to see what we can learn.    

We locked at 50Watts with similar settings 2 weeks ago without problems, but there were a few things to work out for locking at 35Watts:

  • PI have been OK, both TJ and Ed adjusted the phases for mode27
  • Some of our ASC tuning for 25 Watts doesn't work for 35Watts
    • The change from POPX to REFL WFS didn't work at 35 Watts.  For now I left the beam diverter open, which is probably hurting the noise around 100Hz. 
    • The hard loops are in a hybrid state right now that works and isn't too bad for noise.  TJ and I put code in LOWNOISE_ASC that should do most of this, the only thing missing is that for DHARD_Y the guardian will still turn on the 40Watt cutoff (FM1) which is not stable.  JLP35 (FM8) is fine.  
    • The SRM loop is open, so I've touched the alingment by hand.  I tried the signals we have been using at 25 Watts but it is not good. 
  • The sideband powers started to drop gradually over 30 minutes or so.  The 45MHz sideband powers were different by about a factor of 2 when I went into the LVEA to look at the OSA.  Turning up the CO2X power brought the sideband build ups back to what they normally are, and improved the sideband imbalance slightly.  We just took another step up in CO2X power (to 0.4Watts), and TJ will check on the imbalances in a while.  We can't find the ethernet adapter to download the data from the scope.  
  • The noise from 150Hz up is more peaky at 35Watts, confirming what we saw once before on Oct28th.  The noise around 100Hz and below is not terribly different, so it probably is a usefull exercise to take a look at a 35Watt configuration (with SRCL and MICH FF tuned) and try to measure a noise budget here, especially for frequency noise. 
  • The reason the low frequency noise is worse in the attached spectrum is probably not something to worry about, we should run a2l,  and tune feedforward before deciding if that noise is better or worse. 
Images attached to this comment
H1 OpsInfo
edmond.merilh@LIGO.ORG - posted 17:25, Thursday 03 November 2016 - last comment - 08:41, Friday 18 November 2016(31182)
Running a2l scriptS now

There are now THREE a2l scripts that we will be running once during EACH lockstretch. Patrick mentioned them in his time log. I'm tagging Opsinfo with the information again.

cd /opt/rtcds/userapps/release/isc/common/scripts/decoup

./a2l_min_LHO.py

./a2l_min_PR2.py

./a2l_min_PR3.py

that is all :)

Comments related to this report
corey.gray@LIGO.ORG - 10:34, Monday 07 November 2016 (31280)

A note on the (3) A2L measurements.  

  1. The ...LHO.py file can improve H1 performance.
  2. The ...PR2 & PR3.py files are for data-taking purposes (Jenne alignment study).
corey.gray@LIGO.ORG - 08:41, Friday 18 November 2016 (31586)OpsInfo

As of this week, we want to run the ...LHO.py file at the beginning of locks (i.e. right after we reach NLN).  It takes on the order of 10min.  

Sometimes you might not want to run it.  If the DARM specrtra looks good around 20Hz, then you are good.  It's a judgement call, but in general, this helps with sensitivity.  Will put this in the Ops Sticky Note wiki & should get in the Ops Checksheet soon.

(Thanks to Jenne & Ed for sharing the alogs about this!)

H1 ISC
stefan.ballmer@LIGO.ORG - posted 17:11, Thursday 03 November 2016 - last comment - 11:01, Friday 04 November 2016(31181)
POPAIR_B_90 demodulator LO input broken

Over the last couple of days we noticed the POPAIR_B_90 was randonly jumping up and down.

Further investigating this, we found that just touching the SMA connector of the 90MHz LO of the POPAIR_B_90 demodulator box, the phase jumps by easily 90deg.

Smells like that LO input is broken - but we'd have to take the chassis out to fix it.

Comments related to this report
richard.mccarthy@LIGO.ORG - 11:01, Friday 04 November 2016 (31199)SYS
Found the SMA connectors to be over tight.  I could not remove them with out pliers.   The SMA insulating sleeves were in bad shape.  The filter for 90MHz was not seated properly.  Re-seated the filter,  Change the rear panel with a new one.  Made sure all of the connector inside the chassis were torqued properly.  Re-installed chassis.
Fault report 6599
https://services.ligo-la.caltech.edu/FRS/show_bug.cgi?id=6599

While in the LVE re-torqued all the SMA connections in the racks by the PSL.  There were a number of loose ones.  (AGAIN)

We have a torque wrench lets use it.

H1 General (DetChar, PEM)
edmond.merilh@LIGO.ORG - posted 17:09, Thursday 03 November 2016 (31180)
ETMY L2 Pitch OpLev damping turned off (also BRS)

In preparation for Robert's incursion into the VEA for testing.

H1 CAL (DetChar, SUS)
jeffrey.kissel@LIGO.ORG - posted 16:42, Thursday 03 November 2016 - last comment - 22:07, Monday 07 November 2016(31179)
Increased Amplitude of H1SUSETMY L1/L2 Temporary Calibration Lines
J. Kissel, D. Tuyenbayev

We're still not getting the IFO duty cycle to get the desired uncertainty on the single-frequency actuation strength scale factor measurement of the UIM and PUM stage and we're running out of time, so I've increased the SNR of these temporary lines by another factor of ~3 over yesterday's increase (see LHO aLOG 31108).

Oscillator       Freq (Hz)      Old Amp (ct)   New Amp (ct)
ETMY UIM          33.7           180            500
ETMY PUM          34.7            81            300

Hopefully Robert's activities tonight won't impact the ~30 Hz region of the sensitivity, and we can turn things off soon.
Images attached to this report
Comments related to this report
darkhan.tuyenbayev@LIGO.ORG - 18:18, Thursday 03 November 2016 (31183)CAL

Jeff K, Darkahn T,

We calculated actuation strengths of L1 (UIM), L2 (PUM) and L3 (TST) actuation stages using calibration lines from 6 lock stretches in the last two days.

Preliminary results are given in the attached plots. Standard deviation on estimations of AU and AP are ~1.2% and for AT is ~0.4%.

Data points were taken at GPS times with HOFT_OK_BIT = 1 (segments are listed below).

# seg    start           stop            duration
0        1162123790.0    1162124750.0    960.000
1        1162124840.0    1162125190.0    350.000
2        1162125280.0    1162125480.0    200.000
3        1162127120.0    1162129210.0    2090.000
4        1162134280.0    1162137150.0    2870.000
5        1162162170.0    1162163370.0    1200.000

Increased line amplitudes will hopefully allow us to get AU and AP actuation strengths with subpercent 1-sigma error bounds.

Images attached to this comment
darkhan.tuyenbayev@LIGO.ORG - 09:04, Monday 07 November 2016 (31275)CAL

Jeff K, Greg M, Darkhan T,

After the L1 and L2 line amplitude increase it seems that we got better uncertainties in the esitamtions of the sus. stage actuation strengths.

This time we filtered the data using the IFO range channel, we used 50 MPC as a threshold. And from the remaining data we made historams of three different time intervals. We did not yet investiage why the noise levels of the lines are different at each of these intervals. The uncertainties for A{U,P,T} are given for the least noisy interval (blue data points).

Non-image files attached to this comment
darkhan.tuyenbayev@LIGO.ORG - 22:07, Monday 07 November 2016 (31302)CAL

Jeff K, Greg M, Darkhan T,

We calculated [N/ct] actuation force factors calculated from the ~35 Hz independent L1, L2 and L3 lines:

KU = 8.012-8 +/- 3.873-10 N/ct   ( std(KU) / |KU| = 0.0048 )

KP = 6.482-10 +/- 2.748-12 N/ct   ( std(KP) / |KP| = 0.0042 )

KT = 4.253-12 +/- 1.679-14 N/ct   ( std(KT) / |KT| = 0.0039 )

During a Nov. 4 lock stretch we got a factor of 3 improvement of the standard deviations compared to the previous day (blue data points vs. green).

In most recent 2 days we got more data with longer lock stretches, which can help us to better bound the uncertainties. Analysis of this data would require including an updated DARM digital filters, the IFO response changed on Nov. 5 (see LHO alog 31201) which can bias on our calculations if not taken into account.

The outliers were removed in a following way:

- Took >= 50 MPC data and removed data points that fall outside of 2-sigma std. deviation (some large outliers were not filtered by this step);

- one more time calculated std. and mean in the remaining data points and removed 2-sigma outliers (this step helped to remove large outliers).

- The mean and 2std. of these data points were shown with black solid line and dashed lines.

The final reported mean values and standard deviations were taken from the blue data points ( GPS [1162252470, 1162271230] ), L1 and L2 data was least noisy during this period. This mean value and its std. were shown with blue solid and dashed lines.

Non-image files attached to this comment
H1 ISC
stefan.ballmer@LIGO.ORG - posted 16:36, Thursday 03 November 2016 - last comment - 12:05, Wednesday 09 November 2016(31176)
Frequency nboise at least a factor of 8 below the noise floor.

Evan, Stefan,

We re-measured the frequency noise coupling to DARM from the four sensors we have: REFL9 (in-loop), and POP9, REFL45, POP45 (all out-of-loop).

Plot 3 shows that transfer function in m/ct.  (For REFL 9, the calibration from Evan 1.5e-7W/ct, see e.g. 30286. We didn't calibrate the others in W yet.)

Plot 1 shows the projection of all 4 sensors to DARM. The fact that POP9 disagrees with the others - but is coherent with them (Plot2) suggests that what limits our sensing is not frequency noise.

Finally, Plot 4 shows the relative calibration of the four sensors for frequency noise.

The xml files are in

/ligo/home/controls/sballmer/20161103/FreqNoiseProjection.xml

/ligo/home/controls/sballmer/20161103/REFLPOPV2.xml

Also, for reference, the frequency noise injection was done between 21:36:50 and 22:02:50 UTC on Nov 03 2016.
 

Images attached to this report
Comments related to this report
evan.hall@LIGO.ORG - 12:05, Wednesday 09 November 2016 (31367)

Here is a frequency coupling TF calibrated into meters per hertz, using the above data.

The calibration uses the whitening gain (12 dB), the digital gain (0.36 ct/ct), the ADC gain (216 ct / 40 V), the demod gain and transimpedance (2600 V/W), and an assumed CARM plant with a dc gain of 13 mW/Hz and a pole at 0.63 Hz. The numbers for the plant come from OLTF budgeting from O1 (so these numbers are quite old and may have changed).

Images attached to this comment
H1 General
edmond.merilh@LIGO.ORG - posted 16:32, Thursday 03 November 2016 (31177)
Adjusted Fiber Polarization Y-Arm

Y arm was wrong polarization by 21%. I adjusted it down to 1%. I also tqweaked X-arm a little to ≈3%.

LHO General
patrick.thomas@LIGO.ORG - posted 16:04, Thursday 03 November 2016 (31175)
Ops Day Shift Summary
TITLE: 11/03 Day Shift: 15:00-23:00 UTC (08:00-16:00 PST), all times posted in UTC
STATE of H1: Unknown
INCOMING OPERATOR: Ed
SHIFT SUMMARY: IFO is at NLN. Robert and Matt are taking measurements at end X. The SEI config at end X and end Y are on BLEND_Quite_250_SC_useism. Robert will call when he goes to end Y to have us turn off the optical lever damping there.
LOG:

16:07 UTC Robert to LVEA to setup for tests. May increase PSL makeup air, but not enough to keep from locking.
16:38 UTC Trouble keeping PRMI locked. Starting initial alignment.
? Robert back
16:51 UTC Betsy and Jason to mid stations
17:09 UTC Initial alignment done
17:10 UTC Peter to optics lab
17:18 UTC DRMI_LOCKED. Diffracted power is low (~.6). Adjusted reference signal to bring it back to ~4.
17:54 UTC Error message: 'POPA has a large offset. ENGAGE PRC1 by hand.' Stefan looked and said the offsets are not really large so he manually reran ENGAGE_ASC_PART2. The error message went away.
18:15 UTC Stopped at REDUCE_45_MODULATION_DEPTH. Diag messages saying waiting for soft loops to converge. H1:ASC-AS90_OVER_POP90_MON is oscillating wildly.
Stefan says the limits on the check to move on are not large enough, and it is safe to do so.
18:37 UTC NLN
18:45 UTC Stefan moving spot on PRM
19:05 UTC Lockloss (Stefan?). Diffracted power came up to ~7.
19:23 UTC Lockloss from ANALOG_CARM
19:48 UTC NLN
19:59 UTC Running a2l
cd /opt/rtcds/userapps/release/isc/common/scripts/decoup
./a2l_min_LHO.py

20:06 UTC Karen cleaning in H2 electronics room

./a2l_min_PR2.py
./a2l_min_PR3.py

~20:27 UTC Restarted lock clock. One of the two python scripts had crashed after losing connection to H1:GRD-ISC_LOCK_STATE_N.
20:39 UTC The trace for LLO on the DMT range plot just disappeared.
20:54 UTC Richard to CER mezzanine to look at some grounds
21:01 UTC Kyle to mid X
21:11 UTC Joe moving forklift a few feet from OSB wall
? Richard back
21:34 UTC Noises in control room from cleaning on roof.
21:58 UTC Cleaning on roof done.
22:00 UTC Kyle back from mid X
22:03 - 22:10 SEI at end X and end Y changed to BLEND_Quite_250_SC_useism
22:12 UTC Robert to end X
22:18 UTC Jim W. restarted SEI ETMY guardian node
LHO VE
kyle.ryan@LIGO.ORG - posted 13:58, Thursday 03 November 2016 - last comment - 16:26, Friday 04 November 2016(31170)
60 day trend of PT140
Attached is a 60 day trend of PT140 which is a one of the new Inficon BPG402s?  IP7 and IP8 have been a steady 5000 volts for this time period.  Is this a gauge thing?  I haven't been intimate with what Gerardo, John and Chandra have learned regarding the behavior of these new wide-range Bayard-Alpert/Pirani hybrids but this slope looks "not insignificant"
Non-image files attached to this report
Comments related to this report
chandra.romel@LIGO.ORG - 18:58, Thursday 03 November 2016 (31184)
That slope looks really fishy. Are both IPs fully pumping? What does HAM6 pressure look like (also hot cathode ion gauge)? Did PT 170 and 180 flatten out after degassing?
gerardo.moreno@LIGO.ORG - 13:50, Friday 04 November 2016 (31208)

We think that the pressure increase is due to temperature, see attached.  aLOG noting temperature change.

Images attached to this comment
gerardo.moreno@LIGO.ORG - 16:26, Friday 04 November 2016 (31215)SUS

Since we are talking temperature change in the LVEA, note the vertical change on some of the optics (BS and ITMs), other are affected as well.

Images attached to this comment
LHO General
patrick.thomas@LIGO.ORG - posted 13:23, Thursday 03 November 2016 - last comment - 16:36, Thursday 03 November 2016(31167)
Ops Day Mid Shift Summary
The fault in the fast shutter check appears to have been cleared for now. Unfortunately I am still not entirely certain of the mechanism by which it was resolved or if it will return.

We have been to NLN twice since. I believe Stefan broke the first lock moving the beam spot on PRM. We are currently on the second lock and I have just finished running the three a2l scripts. All three reported errors at the end:

cd /opt/rtcds/userapps/release/isc/common/scripts/decoup
./a2l_min_LHO.py

Traceback (most recent call last):
  File "./stop_osc_LHO.py", line 29, in 
    matrix.asc_ads_lo_pit[osc, optic]=0
  File "/ligo/apps/linux-x86_64/cdsutils/lib/python2.7/site-packages/cdsutils/matrix.py", line 300, in __setitem__
    self.put(row, col, value)
  File "/ligo/apps/linux-x86_64/cdsutils/lib/python2.7/site-packages/cdsutils/matrix.py", line 266, in put
    inds = list(self.__rc_iter(row, col))
  File "/ligo/apps/linux-x86_64/cdsutils/lib/python2.7/site-packages/cdsutils/matrix.py", line 151, in __rc_iter
    rs = [self.__rows[row]]
KeyError: 'OSC2'
a2l script done!

./a2l_min_PR2.py
Traceback (most recent call last):
  File "./stop_osc_LHO.py", line 29, in 
    matrix.asc_ads_lo_pit[osc, optic]=0
  File "/ligo/apps/linux-x86_64/cdsutils/lib/python2.7/site-packages/cdsutils/matrix.py", line 300, in __setitem__
    self.put(row, col, value)
  File "/ligo/apps/linux-x86_64/cdsutils/lib/python2.7/site-packages/cdsutils/matrix.py", line 266, in put
    inds = list(self.__rc_iter(row, col))
  File "/ligo/apps/linux-x86_64/cdsutils/lib/python2.7/site-packages/cdsutils/matrix.py", line 151, in __rc_iter
    rs = [self.__rows[row]]
KeyError: 'OSC2'
a2l script done!

a2l_min_PR3.py
Traceback (most recent call last):
  File "./stop_osc_LHO.py", line 29, in 
    matrix.asc_ads_lo_pit[osc, optic]=0
  File "/ligo/apps/linux-x86_64/cdsutils/lib/python2.7/site-packages/cdsutils/matrix.py", line 300, in __setitem__
    self.put(row, col, value)
  File "/ligo/apps/linux-x86_64/cdsutils/lib/python2.7/site-packages/cdsutils/matrix.py", line 266, in put
    inds = list(self.__rc_iter(row, col))
  File "/ligo/apps/linux-x86_64/cdsutils/lib/python2.7/site-packages/cdsutils/matrix.py", line 151, in __rc_iter
    rs = [self.__rows[row]]
KeyError: 'OSC2'
a2l script done!

The commissioners are in the Thursday commissioning meeting.
Comments related to this report
jenne.driggers@LIGO.ORG - 16:36, Thursday 03 November 2016 (31178)

Sorry about the a2l error message.  Everything gets set so it's okay before the thing that errored happens, but obviously you still shouldn't get errors. 

In the "stop everything" script we had the columns and rows of some matrices backwards - it ran fine for me now after fixing it, and I've checked it in.

H1 CDS (ISC, SUS)
jeffrey.kissel@LIGO.ORG - posted 12:54, Thursday 03 November 2016 - last comment - 09:18, Friday 04 November 2016(31165)
SDF Issues with SUSITMPI Model Upon Unplanned Restart Were the Cause of PI Problems; Now Resolved
J. Kissel, M. Evans, D. Barker, H. Radkins

A confusing bit of settings wrangling* after the unplanned corner station computer restarts on Tuesday (LHO aLOG 31075) in the SUSITMPI model meant that a large fraction of the EPICs records in the ITM PI system were wrong. As such, we believe this was the cause of battles with Mode 27's PI a few nights ago (LHO aLOG 31111).

In order to fix the problem, we used the hourly burt backups in
/ligo/cds/lho/h1/burt/yyyy/mm/dd/hh:mm/
to restore settings all settings to Monday (2016/10/31), before the computer restarts. 

Further, Matt performed a few spot checks on the system, and suspected it good.

*Settings wrangling:
There were several compounding problems with the SDF system which meant that 
(1) The front-end did not use the safe.snap file upon reboot, and restored bogus values
(2) The safe.snap file, which we'd thought had been kept up to date, had not been so since May.

Why?
(2) The safe.snap file for SUSITMPI used upon restart,
/opt/rtcds/lho/h1/target/h1susitmpi/h1susitmpiepics/burt/safe.snap,
is a softlink to
/opt/rtcds/userapps/release/sus/h1/burtfiles/h1susitmpi_safe.snap.
Unfortunately, *only* that model's safe.snap that had its permissions mistakenly set to a single user (coincidentally me, because I was the one who'd created the softlink from the target directory to the userapps repo.), and *not* the controls working group. That means Terra Hardwick, who had been custodian of the settings for this system, was not able to write to this file, and the settings to be restored upon computer reboot had not been updated since May 2016. Unfortunately, the only way to find out that this didn't work is to look in the log file, which lives in
/opt/rtcds/lho/h1/log/${modelname}/ioc.log
and none of us (save Dave) remember this file existed, let along looked at it before yesterday **.
There are other files made (as described in Hugh's LHO aLOG 31163), but those files are not used by the front-end upon reboot.

I've since fixed the permissions on this file, and we can now confirm that anyone can write to this file (i.e. accept & confirm DIFFs). We've also confirmed that there are no other safe.snap files that have their write permissions incorrectly restricted to a single user.

** Even worse, it looks like there's a bug in the log system -- even when we confirm that we have written to the file, the log reports a failure, e.g. 
    ***************************************************
    Wed Nov  2 16:39:10 2016 
    Save TABLE as SDF: /opt/rtcds/lho/h1/target/h1susitmpi/h1susitmpiepics/burt/safe_161102_163910.snap
    ***************************************************
    Wed Nov  2 16:39:10 2016
    ERROR Unable to set group-write on /opt/rtcds/lho/h1/target/h1susitmpi/h1susitmpiepics/burt/safe.snap - Operation not permitted
    ***************************************************
    Wed Nov  2 16:39:10 2016
    FAILED FILE SAVE /opt/rtcds/lho/h1/target/h1susitmpi/h1susitmpiepics/burt/safe.snap
    ***************************************************


(1) This is quite alarming. Dave has raised an FRS ticket (see LHO aLOG 6588) and fears it may be an RCG bug. I wish I could give you mode information on this, but I just don't know it.



In summary, we believe the issues with SUSITMPI have been resolved, but there's a good bit of scary stuff left in the SDF system. We'll be working with the CDS team to find a path forward.
Comments related to this report
keith.thorne@LIGO.ORG - 19:29, Thursday 03 November 2016 (31185)CDS
The LLO CDS system has scripts running that do regular checks on file permissions on the /opt/rtcds file system to try to catch these.  Please contact Michael Thomas for details.  We'll check that we are looking for this issue as well (and are acting when problems are found)
david.barker@LIGO.ORG - 09:18, Friday 04 November 2016 (31197)

I've opened FRS6596 to do the same snap file permissions checking as LLO.

H1 ISC
jenne.driggers@LIGO.ORG - posted 01:55, Thursday 03 November 2016 - last comment - 14:48, Thursday 03 November 2016(31157)
New a2l scripts for PR2 and PR3

I have made scripts that we can run that will adjust the a2l gains for PR2 and PR3.  These use the same a2l engine that the test mass script does, it just sets the settings for PR2 and PR3.  They can be found in the same location (just checked in): .../userapps/isc/common/scripts/decoup/a2l_min_PR*.py, where * is either 2 or 3. 

Each script has been run tonight, so we now have non-zero a2l elements for both those mirrors.

Comments related to this report
sheila.dwyer@LIGO.ORG - 03:27, Thursday 03 November 2016 (31158)

Nutsinne is having trouble relocking, with instabilities around 3.5 Hz that ring up when she engages PRC1 ASC.  We removed both the new offset from POP A pit and the new a2l from PR3, hoping that this will help. 

Stefan's offset for POP A was -0.05, Jenne's a2l coefficients were PR3_M3_DRIVEALIGN P2L 0.85 and Y2L 1.85

The problem was the new cut offs added to the PRC1 loop tonight, they seemed fine at low noise but aren't stable when the loops forst come on.  We have just removed them from the gaurdain for now.  

jenne.driggers@LIGO.ORG - 14:48, Thursday 03 November 2016 (31173)

Hmmm, odd.  Anyhow, the cutoffs now come on in LowNoiseASC rather than earlier.

Displaying reports 52961-52980 of 83305.Go to page Start 2645 2646 2647 2648 2649 2650 2651 2652 2653 End