I restarted the PSL after the power glitch.
To do this I also had to reset the settings on the KEPCO power supply, and I reset the long range actuator.
When everything locked, the ISS difracted power was around 21%, I tried toggling the noise eater (nothing else on the ODC indicated a problem with the noise eater). This didn't help, and I ended up adjusting H1:PSL-ISS_REFSIGNAL to bring the diffracted power down to 9%
With wind gusts in the 70mph range, we are seeing spikes in the dust counts, most notable at EX with counts in the 100000s at 0.3um and 20000s at 0.5um. Counts are also elevated in the LVEA around HAM3, HAM4, beer garden, and Y-arm spool but only into the 2000s at 0.3um and high 100s at 0.5um.
Replaced the batteries in the main cabinet of the Mass Storage Room UPS. Also replaced the backup control module. This had gone bad a while ago so we were running without some redundancy.
This dust storm was fast. Here are some photos of the approach. Two power glitches preceded the storm (around 4:00pm).
EX: Switched filter box for ESD (Filiberto)
EX ISI TF running overnight (Jim)----> No banging on chamber!
Leak checking: y-beam manifold (Gerardo) & everywhere else (Kyle)
EY checking accelerometer locations for B&K tests (Arnaud/Tim)
EX calibration work (Paul, Jordan)
13:30 Greg turning on TCS CO2 laser in squeezer bay.
Justin refilled crystal chiller (Corey and Travis present as trainees)
PR3 oplev work beginning (Doug & Jason)
3IFO Quad work in the West Bay (Betsy)
13:54 Old conlog briefly being taken down (Cyrus)
14:23 Pablo to EY for ALS VCO characterization work
Dust monitor #15 (beer garden) alarm (13000 @ 0.3um but 0 @ 0.5um, check functionality??)
14:39 Tim and JeffK to EY to setup B&K measurements
15:03 Doug & Jason out of LVEA
16:00 Kyle opening GV2
16:25 Pablo done for the day
15:42 Paul & Jordan to EY installing voltage monitors
15:44 Hugh to EX restarting HEPI pump station
Two power glitches (~4:00pm local) from a giant Dust Storm that just hit us. Front ends died after the first glitch. Winds are gusting up to 70+ MPH. We're going to wait until the storm passes before beginning to restore everything. Pictures are just before the storm hit.
Old alog 13299. Checked the two RF amp in ISC-R2 and found surprisingly high attenuators of 6dB and 4dB. Replaced the first with a 1dB and the second with a 2dB.
New readbacks:
=== Rack ISC-R2 U38 ===
H1:ISC-RF_C_REFLAMP45M_OUTPUTMON = 22.6
=== Rack ISC-R2 U37 ===
H1:ISC-RF_C_REFLAMP9M1_OUTPUTMON = 22.4
The amplifier in the RF amp is nominally +12dB. 10dBm input will give close to 13dBm on each output at the tested 30 MHz. The slow readbacks should be around 22dB, typically no more than a 1dB off.
Readbacks for other 9 MHz and 45 MHz units in R2 went up accordingly. Some are now too high and need to be readjusted. WFS should be ok, since they use an RF splitter to distribute the LO to the 4 channels.
=== Rack ISC-R2 U18 (WFS REFL_A) ===
H1:ASC-REFL_A_RF9_DEMOD_LOMONCHANNEL_1 = 19.1
H1:ASC-REFL_A_RF9_DEMOD_LOMONCHANNEL_2 = 19.0
H1:ASC-REFL_A_RF9_DEMOD_LOMONCHANNEL_3 = 18.9
H1:ASC-REFL_A_RF9_DEMOD_LOMONCHANNEL_4 = 19.3
=== Rack ISC-R2 U16 (WFS REFL_A) ===
H1:ASC-REFL_A_RF45_DEMOD_LOMONCHANNEL_1 = 18.3
H1:ASC-REFL_A_RF45_DEMOD_LOMONCHANNEL_2 = 18.4
H1:ASC-REFL_A_RF45_DEMOD_LOMONCHANNEL_3 = -75.0432
H1:ASC-REFL_A_RF45_DEMOD_LOMONCHANNEL_4 = -74.9568
=== Rack ISC-R2 U10 (WFS REFL_B) ===
H1:ASC-REFL_B_RF9_DEMOD_LOMONCHANNEL_1 = 19.3
H1:ASC-REFL_B_RF9_DEMOD_LOMONCHANNEL_2 = 19.2
H1:ASC-REFL_B_RF9_DEMOD_LOMONCHANNEL_3 = 19.2
H1:ASC-REFL_B_RF9_DEMOD_LOMONCHANNEL_4 = 19.2
=== Rack ISC-R2 U08 (WFS REFL_B) ===
H1:ASC-REFL_B_RF45_DEMOD_LOMONCHANNEL_1 = 18.5
H1:ASC-REFL_B_RF45_DEMOD_LOMONCHANNEL_2 = 18.2
H1:ASC-REFL_B_RF45_DEMOD_LOMONCHANNEL_3 = 18.3
H1:ASC-REFL_B_RF45_DEMOD_LOMONCHANNEL_4 = 18.4
The 2 broken channels (together with the RF readbacks) are from Beckhoff chassis corner 4 terminal M4. All channels on this module read a value close to zero. Could be a cable problem between the demod chassis and the ASC demod concentrator.
I'm moving the old conlog machine to a new rack, so it (and by extension the historical data) will be unavailable for 15-20 min. The new production conlog system will be unaffected.
h1conlog-old should be available again. It took slightly longer as I needed to correct an IPMI configuration issue.
Jeff gave links in his alog for previous occurances of this error. This table summarizes the date for the front ends which exhibited this error over the past year:
8/11 2014 | h1susb123 |
8/9 2014 | h1seih23 |
4/21 2014 | h1sush2a |
3/18 2014 | h1sush2a |
2/27 2014 | h1seih23 |
12/16 2013 | h1seih23 |
11/7 2013 | h1sush2a |
11/7 2013 | h2sush34 |
8/8 2013 | h1seih23 |
9 events in one year. h1sush2a and h1seih23 show this error more than once (3 times and 4 times respectively)
I have compiled all models using RCG2.8.5 in preparation for Thursday's upgrade. The procedure was:
If anyone needs to compiled models today or tomorrow, please email me as I may have to rebuild against the new IPC file tomorrow.
Running full measurement, but should be done tomorrow morning.
08:00 LVEA is LASER HAZARD 08:00 Visitor - Tim McDonald arrived 08:50 "low/major" alarm in HO:FMC-EX_CY_H2O_SUO-DEGF- John Worden notified 09:01 M Landry - shuttering LASER temporarily for viewport inspection by vacuum team Vac team will be allowed to remove glasses for this operation. . Un-shutter immediately after. Remain LASER hazard 09:15 J Batch - bringing framewriter 1 down to move files. Should only take a few minutes. 09:30 J. Bergman - re-opening PSL shutter 09:30 Kiwamu and Sheila to PSL to instal some PD an AOM to take IMC cavity pole measurements for prep to run at higher power. - out at 12:21 THey will go back in some time this evening. 09:32 Nathan to optics lab 09:34 Jordan and Paul to End-Y to swap out AI chassis for PEM - out 10:17. 09:44 D Barker - "Code Freeze" UNTIL NOON 09:48 Doug and Jason into LVEA to wander and look for pieces parts for OpLev -out at 10:30 09:55 Kyle and Gerardo going to postpone crawling around on chambers in LVEA until after lunch. 10:05 Travis out to HAM 3 to check on Mobility experiment 10:20 Betsy out to hunt LVEA for ISC HAM6 parts 10:39 Praxxair out (didn't see them arrive) 10:40 Betsy working in West Bay on Quad 10:42 Kyle out to End-Y VEA to turn something off. -out at 11:00 12:30 Karen to End-Y 12:13 Pablo called to report he was at End-Y to do characterization on ALS and VCO. 12:34 Filiberto to End-Y to change the bias filter box for the ESD...... to be continued by Corey
As part of the upgrade to RCG2.8.5 I am taking the opportunity to rebuild the H1.ipc file from scratch because it contains a lot of orphaned channels and jumps in channel numbering.
I wrote a script to parse the H1.ipc INI file, compressing each channel into a single line so we can do diff,awk,sed type operations on it (script is parseIpcIniFile)
Here are the orphaned channels which are being removed (Qty 40):
20 days of the end station pressure including the two injection events.
Because of maintenance, the default NDS server has been changed to h1nds0. The raw minute data files for the last several months are being moved and would be unavailable on h1nds1.
The results from today's diagnostic breadboard scan. The relative power noise measurement doesn't look too bad. Better than the reference measurement at low frequencies below about 20 Hz but worse elsewhere but not by much. The first loop power stabilisation servo performance is better than the reference signal at frequencies below about 40 Hz but worse for frequencies above about 1 kHz. The frequency noise measurement is out of whack. It is known that perhaps the gains on the servo are not adjusted to their correct values. Currently the common gain is set to 27 dB and the fast gain to 17 dB. This will have to be tuned up when time permits. The beam pointing measurement looks good, or at least okay. The mode scan looks almost identical to last week. The percentage higher order mode content is fractionally lower this week but not significant I think.
model restarts logged for Mon 11/Aug/2014
2014_08_11 09:36 h1hpiitmy
2014_08_11 09:36 h1iopseib1
2014_08_11 09:36 h1isiitmy
2014_08_11 10:42 h1iopseih23
2014_08_11 10:42 h1isiham2
2014_08_11 10:42 h1isiham3
2014_08_11 10:44 h1hpiham2
2014_08_11 10:44 h1hpiham3
2014_08_11 13:58 h1iopsusb123
2014_08_11 13:58 h1susbs
2014_08_11 13:58 h1susitmx
2014_08_11 13:58 h1susitmy
2014_08_11 14:34 h1iopsusb123
2014_08_11 14:36 h1susbs
2014_08_11 14:38 h1susitmy
2014_08_11 14:39 h1susitmx
recovery restarts due to several problems with cpu freeze and non-driving DACs
[Alexa, Dan, Masayuki, Kiwamu, Keita, and Koji]
(updated 8:15AM, correction of the window deflection angle)
HAM6 alignment work is in progress. The beam reached to the OMC but not aligned to the OMC QPDs yet.
Here is more details of the work done on Aug 11.
= Guiding the beam to HAM6 =
The beam was guided to HAM6 by centering the beam on the SRM. By shaking the SRM alignment in pitch and yaw, we could confirm
how the spot was centered. In reality, we initially suffered from not noticing intentional misalignment of PR2. Once the PR2 alignment was
restored, it was not so difficult to find the spot around the SRM aluminum holder.
= Locating the beam axis at the center of the clear aperture =
Once the beam was found in HAM6, we again shook the SR2 to find the aperture free from clipping by the SRM or OFI.
The beam was settled at the center of the clear aperture.
Note: this does not necesarily mean that the beam is still at the center of the SRM.
The beam coming in the HAM6 chamber has in deed a different angle from the design layout (D1000342).
The beam entrace point is located almost as designed. At the edge of the table the beam height was 97.5mm (3.84"). This already suggests the
beam is downward. The beam is angled not only in vertical, but also in horizontal. At the position of the OM1 tip-tilt, the beam is 2" to South
(towards OMC) and 0.5" too low. This angle is, in deed, 32mrad and 8mrad, respectively. This couldn't only be caused by the spot location on SR2
as it requires tens of cm shift on SR2. Therefore we suspected any wedged optics around HAM5, which means the septem window and
wedged prisms in the OFI.
Keita called LLO and confirmed they had similar horizontal beam shift but observed no vertical shift. This may mean that the horizontal angle
is a systematic effect. We confirmed the wedged window is installed so that it wedges almost horizontally (see attached photo).
Keita calculated the wedge effect of the septem to be 6mrad. This is not enough to explain the angle we actually saw.
We also wondered how the wedged prisms are installed in the OFI.
We checked if the beam power does make sense or not. The detected power right after the spetem was 3.2mW. This is reasonable as it is
not so far from the expected value of 4mW. [1.9W (Pin) x 0.8 (IMC) x 0.03 (PRM) x 0.35 (SRM) x 1/4 (Michelson) = 4mW]
= OM1 Tip-tilt / OM1 transmission path (AS_AIR and AS_C QPD) =
For now, we decided to continue to align the other optics. Firstly, we moved the OM1 to South (towards OMC) by 2".
The transmission path of OM1 had to be moved by 2" as well. This actually causes the counter mass moved towards East door by 2".
Therefore the table balance has to be reviewed eventually. The other steering mirrors were also moved as well. The first two steering mirrors
after OM1 had to be largely angled in pitch to absorb 8mrad beam tilt at OM1. The beam was centered on the last steering and the beam is directed
to AS_C QPD. We used CDS to finely align the beam on the QPD. The beamsplitter before the last steering was aligned such that the beam exits
from the enter of the window emulator.
The beam diverter and its beam dump were aligned. The beam diverter is open when the mirror is at the west side (HAM5 side)
and is closed when the mirror is at the east side (East door side).
= OM1 Tip-tilt alignment =
OM1 was moved so that the beam hit the center of OM2. This requred OM1 facing upward to compensate the vertical angle of the incoming beam.
This was done by the counter balancing screw on OM1. The range was not enough only by moving the screw, the screw was inserted from the back
to give more weight at the back side of OM1.
= Fast shutter / beam dump =
The fast shutter could not be placed at the planned place as the body structure of the shutter blocks the incoming beam.
The shutter was placed west side (HAM5 side) of OM3 rather than the east side. The upwarding beam in this path caused the fast shutter reflection
going up. This caused the beam on the beam dump too high by 1". This needs to be fixed before closing the door.
= OM2 alignment =
OM2 was rotated in yaw in order to accommofate the spot on OM3. The natural misalignment of OM2 in pitch made the spot on OM3 almost at the center.
= OM3 alignment =
We rotated OM3 to hit the input mirror of the OMC cavity. The OMC REFL beam was found. We did not hit any of the OMC QPDs yet.
= Beam clearance =
In the end, the beam is enough away from the tip-tilt cages desppite the move of the incoming beam.
The distance between OM2 and the incoming beam is about 2". The one between OM3 and the incoming beam is about 2.5".
The distance between OM2 and the relfected beam from OM1 is about 0.5" while the beam size there looked less than a mm.
= Adding dog clamps =
The many of the optics on the table was fixed only with one screw or a dog clamp. We started to add more clamps to them. It's not complete yet.