Reports until 14:04, Wednesday 09 September 2015
H1 DetChar (DetChar, ISC)
andrew.lundgren@LIGO.ORG - posted 14:04, Wednesday 09 September 2015 - last comment - 12:16, Thursday 10 September 2015(21347)
A simple test to help diagnose the loud glitches
One possible cause of the DAC overflows we've been seeing (the ETMY saturation warnings) is something at high frequency using up the range of the drive. We only record the last output to the ESD DAC at 2048 Hz, so we don't see anything happening above a kHz. It's possible some high frequency line or feature bumps up against 2^17 counts and that makes the DAC overflow, which then causes a much larger glitch - once there's an overflow the whole thing will go crazy.

To try to investigate this, the simplest thing to do is to record a channel like SUS-ETMY_L3_MASTER_OUT_LL_DQ at the highest rate possible, or something equivalent that monitors the actual signal sent to the ESD DAC. Once an ETMY overflow happens, save the data for several seconds around the time somewhere that people offsite can access it, preferably in a common format like ASCII or frames. Some time without an overflow would be good for comparison. Then we can see if there's something using up the drive range, or if it's just something sudden from somewhere else in the DARM loop. A few instances of overflows would be nice.

If this is not possible, there's another tack we can take but it's more involved, so I'd prefer this.
Comments related to this report
evan.hall@LIGO.ORG - 18:02, Wednesday 09 September 2015 (21350)

If it's any help, we do record H1:SUS-ETMY_L3_ISCINF_L_IN1_DQ at the full rate (16 kHz). In full lock, this is the only signal (other than the calibration line) that is sent to the ESD. With an adequate knowledge of the filters between this channel and the ESD master outs, it should (in theory) be possible to reconstruct the master out signals at the full rate. That was the original motivation for recording this channel at full rate, anyway.

andrew.lundgren@LIGO.ORG - 07:54, Thursday 10 September 2015 (21360)DetChar
Yes, using ISCINF was the other tack that I meant. I checked the MEDM screen when I knew the detector was locked. Here's what I see in the chain:

ETMY_L3_ISCINF_L - seems to be empty
ETMY_L3_LOCK_L - FM1,3,5,6,8,9,10; gain is 1.25
ETMY_L3_DRIVEALIGN - L2L is only thing used, just a gain of -30
ETMY_L3_EULER2ESD matrix - factor of 0.25 to each OSEM
ESD linearization - bypassed, so I think we can ignore it
ETMY_L3_ESDOUTF_LL - FM6,7; gain is 1. (I think the four coils get nearly the same drive, so any quadrant is fine).

The needed filters are available from the web SVN in this text file.

So there's only two filter banks to apply, and a few gains. I think this is doable, though it seems like it would just be easier to record SUS-ETMY_L3_MASTER_OUT_LL_DQ at 16384 Hz for a few hours of lock. Maybe one or two of the LSC Fellows could take on this more complicated method.
jordan.palamos@LIGO.ORG - 12:16, Thursday 10 September 2015 (21369)

I managed to capture the full data for SUS-ETMY_L3_MASTER_OUT_LL around the time of the most recent glitch. I put it on my account on caltech at /home/jordan.palamos/detchar/ETMY_glitch.txt and also at https://lhocds.ligo-wa.caltech.edu/exports/jordan.palamos/.

The start time is 1125946072.8

Images attached to this comment