Displaying reports 16521-16540 of 86646.Go to page Start 823 824 825 826 827 828 829 830 831 End
Reports until 14:40, Tuesday 15 August 2023
H1 CAL (CAL)
juliannamarie.lewis@LIGO.ORG - posted 14:40, Tuesday 15 August 2023 (72236)
Movement of Pcal Beam from previous down position on the ETM to test impact on X/Y comparison

Julianna Lewis, TonyS, RickS This morning we moved the upper (inner) Pcal beam at X-end back to center, then horiztonal by 5 mm at the entrance aperture of the Pcal Rx sensor to test the impact on the calibration of the Pcal system at X-end. This work is a continuance from the previous movement on August 8th 2023. See the following alog, Alog from August 8th, 2023

We expect that the impact on the calibration of the Xend Pcal will be given by the dot product of the Pcal and IFO displacement vectors on the ETM.

The work proceeded as follows:

  1. Disabled all excitations for the Xend Pcal system.
  2. Blocked the lower (outer) beam in the transmitter module.
  3. Installed a target at the entrance aperture of the Rx sensor and adjusted the roll angle so that the rows of holes in the target were aligned with the vertical and horizontal directions 
  4. Increased the Pcal AOM offset in the OFS servo from 3.33 to 5.0. (GPS time 1376154600)
  5. Adjusted the inner beam back to its nominal location and the Rx sensor output level increased to about 0.301 W from about 0.300 W. (GPS time 1376155600) 
  6. We moved the beam horizonal to the left hole on the target  Rx sensor level was 0.312 W (GPS time 1376156390)
  7. We were concerned the Rx sensor output is increased by 1 percent. After waiting, the Rx sensor droped from 0.312 W to 0.309 W. (GPS time 1376158470)
  8. Removed the target from the Rx sensor. Rx sensor level 0.3326 W. With OFS offset at 5.0. (GPS time 1376158650)
  9. Unblocked lower (outer) beam Rx sensor with OFS offset still at 5.0, Rx sensor 0.6679 W (GPS time 1376158845)
  10. Changed OFS offset back to 3.33, Rx sensor 0.4432 W (GPS 1376149180)
  11. We expect that this horizontal beam movement will change the unintended rotation of the test mass. 

We will gather data for the following 7 days and observe any changes in the X/Y comparison. 

H1 SUS (DetChar)
jeffrey.kissel@LIGO.ORG - posted 13:48, Tuesday 15 August 2023 - last comment - 13:55, Tuesday 15 August 2023(72230)
Hunting for TMSX Violin Modes; Something at 103.585 Hz, Nothing at 102.128 Hz
J. Kissel

Executive Summary: Driving TMSX in YAW from the top mass (M1) OSEM coils, and using the same stage M1 OSEM sensors as my response channels -- thus far, I can only report null results for finding any excitable mechanical features 102.12833 Hz. I found a feature at 103.585 +/- 0.004 Hz, but it's only a single feature, so I suspect it's the M1, "lower" blade bending mode rather than any evidence for violin modes. But, given the arrangement of sensors, actuators, and the wires on the transmon, I retrospectively am not surprised to not have found violin modes.

I'm looking to confirm whether the frequency that the IFO has been ringing up recently, 102.12833 Hz, is a violin mode of TMSX, as is currently "the most likely suspect" for what this giant feature is that rings up for the first ~3 hours of a lock stretch, after "apparently" being "rung up" by the turn on process for the LSC feed-forward (see, among others, LHO aLOG 72064, 72214, 72221).

Recall the TMTS is a double suspension -- see D0901880 for top-level assembly drawing.
Recall that TMSX is a "production" TMS, rather than a "First Article" TMS, but I can't find a single source link that tells us the difference clearly and concisely.
   - From the ISI, there are two blades (no drawing! Only an excel spreadsheet of characterization under D1200116), and two wires suspending the top mass (M1). 
   - From M1, there are also two blades (no drawing! Only an excel spreadsheet of characterization under D1200117), and *four* wires suspending the optical bench and telescope assembly. The TMS is unique in that it's the only 4-wire suspension clamped from 2 blade tips (see D1101163).

So, if we drive the M1 stage (the only place we can), and with no IFO all we have are M1 stage sensors, then we would hope to see 
   - two violin modes from the Sus. Point to M1 "upper" wires, *maybe* each split into two orthogonal DOFs if the Q is high enough and the bending points move asymmetrically enough
   - four violin modes from the M1 to M2 "lower" wires, again, *maybe* split into eight.
T1300876, table 3.11 for the "production" TMTS predicts a single violin mode frequency from first principles, the properties of the wires, and the load on the wires, to be 
   - Upper -- 331.7 Hz
   - Lower -- 104.2 Hz

Looking at the OSEM arrangement for the TMTS (see E1200045) -- which is *like* the QUAD, but rotated 90 deg such that only one SD OSEM senses / actuates in Longitudinal -- I chose to start the exploration for violin modes by driving in Yaw around 100-110 Hz using awggui, and measuring the responses, transfer functions, and coherence simultaneously in DTT. I slowly narrowed in my 6th order elliptic band pass on the region, such that I could drive more and more power. I had plenty enough SNR in the M1 OSEM to M1 OSEM transfer function at these frequencies that I could get coherent transfer functions.

I did find a feature at 103.585 +/- 0.002 Hz, but since it's only one feature rather than four (or eight), I can't claim that "this is *the* violin mode(s)" but I guess instead that it's a blade bending mode of the "lower" M1 to M2 blades. Why? 
    :: These TMTS M1-to-M2 blades are much like the QUAD's M0-to-L1 and L1-to-L2 blades -- copies and pastes of the UIM blades -- which have bending modes at around ~110 Hz (see analysis for the QUAD blade conditions in T1300595).
    :: while I expect energy is getting into the violin modes from the M1 Yaw drive, I guess I'm not surprised that the energy of those violin modes does not couple back through the blade clamps, the blades, and the M1 mass to the OSEM flags enough to see above the OSEM sensor noise.

Here's some of the data:
    - 1st attachment: The transfer function between M1 Y drive to M1 Yaw and Transverse OSEM response, with an FFT length of 128 seconds for a frequency resolution of 1/128 = 0.0078125 Hz (and an effective noise bin width of (1/128)*1.5 = 0.01171875 Hz given that I'm using the default Hanning window, which has a NENBW of 1.5 bins). This was the first clue that I wouldn't find anything at 102.129 Hz, and that there was something at 103.585 Hz.
    - 2nd attachment: Yaw Drive with a tighter band-pass filter from 102 to 103 Hz, and measured with the same 0.0078 mHz resolution, we see nothing in this band.
    - 3rd attachment: Yaw Drive with a higher frequency 1 Hz band pass, from 103 to 104 Hz, and measured with a much higher frequency resolution -- FFT length of 512 seconds, for a resolution of 1.95 mHz, and effective noise binwidth of 2.92 mHz.
Images attached to this report
Comments related to this report
jeffrey.kissel@LIGO.ORG - 13:55, Tuesday 15 August 2023 (72246)
awggui settings, and drive amplitudes

Attachment 1: drive settings for the 101 to 105 Hz band pass.
Attachment 2: drive settings for the 102 to 103 Hz band pass.
Attachment 3: drive settings for the 103 to 104 Hz band pass.

Attachment 4: TMTSs at H1 still have 18-bit DACs, i.e. a saturation limit of 2^17 = 131072 ct_peak, or an rms limit of 2^17/sqrt(2) = 92681 ct_rms. I drove the TMS with the top mass coil driver in state 1 (analog low pass OFF), with a F2 and F3 DAC output request RMS of 40000 ct_rms (this is captured during the 103 to 104 Hz band pass settings).
Images attached to this comment
LHO General
thomas.shaffer@LIGO.ORG - posted 13:40, Tuesday 15 August 2023 (72243)
Ops Day Mid Shift Report

Maintenance concluded around 1pm PT, we are relocking now and testing some new ALS automation code along the way.

H1 General
filiberto.clara@LIGO.ORG - posted 13:39, Tuesday 15 August 2023 (72242)
New Fiber Run - MSR to RM163

WP 11367

Yesterday morning a new fiber run was pulled from the MSR to General Computing (RM163). Fiber bundle is a MTP with 24 fiber pairs. Ryan Short noted start and end times in alog 72192. Work required lifting of tiles in the MSR/Control Room/Computer Users Room/General Computing Room. We spend some time pulling out many unused/damaged fibers and cables.

A Bernal, F. Clara

H1 ISC (AWC, DetChar-Request, ISC)
keita.kawabe@LIGO.ORG - posted 13:39, Tuesday 15 August 2023 - last comment - 20:52, Wednesday 16 August 2023(72241)
OM2 Beckhoff cable disconnected, voltage reference is used as a heater driver input

As a followup of alog 72061, a batter-operated voltage reference was connected to the OM2 heater chassis. Beckhoff cable was disconnected for now.

Please check if the 1.66Hz comb is still there.

Comments related to this report
keita.kawabe@LIGO.ORG - 13:45, Tuesday 15 August 2023 (72244)

Beckhoff output was 7.15V across the positive and negative input of the driver chassis (when the cable was connected to the chassis), so the voltage reference was set to 7.15V.

We used REED R8801 because its output was clean (4th pic) while CALIBRATORS DVC-350A was noisy (5th pic).

Images attached to this comment
ansel.neunzert@LIGO.ORG - 13:50, Tuesday 15 August 2023 (72247)

detchar-request git issue for tracking purposes.

keita.kawabe@LIGO.ORG - 11:10, Wednesday 16 August 2023 (72277)

As you can see from one of the pictures above, the unit is powered with AC supply so we can leave it for a while.

keita.kawabe@LIGO.ORG - 20:52, Wednesday 16 August 2023 (72286)CDS, ISC

How to recover from power outage

If there is a power outage, the voltage reference won't come back automatically. Though I hope we never need this instruction, I'll be gone for a month and Daniel will be gone for a week, so I'm writing this down just in case.

0. Instruction manual for the voltage reference (R8801) is found in the case of the unit inside a cabinet where all voltage references are stored in the EE shop. Find it and bring it to the floor.

1. The voltage reference and the DC power supply are on top of the work table by HAM6. See the 2nd picture in the above alog.

2. The DC supply will be ON as soon as the power comes back. Confirm that the output voltage is set to ~9V. If not, set it to 9V.

3. Press the yellow power button of the voltage reference to turn it on. You'll have to press it longer than you think is required. See the 1st picture in the above alog.

4. Press the "V" button to set the unit to voltage source mode. Set the voltage to 7.15V. Use right/left buttons to move cursor to the decimal place you'd like to change, and then use up/down buttons to change the number.

5. Most likely, a funny icon that you'll never guess to mean "Auto Power Off" will be displayed at the top left corner of the LCD. Now is the time to look at the LCD description on page 4 of the manual to confirm that it's indeed the Auto Power Off icon.

6. If the icon is indeed there (i.e. the unit is in Auto Power Off mode), press power button and V button at the same time to cancel Auto Power Off. You'll have to press the buttons longer than you think is required. If the icon doesn't go away, repeat.

7. Confirm that the LCD of R8801 looks exactly like the 1st picture of the above alog. You're done.

H1 DetChar (CAL, DetChar)
derek.davis@LIGO.ORG - posted 13:23, Tuesday 15 August 2023 - last comment - 14:56, Thursday 15 August 2024(72239)
Issue with calibration line subtraction at beginning of locks

Arianna, Derek

We noticed that the calibration line subtraction pipeline is often not correctly subtracting the calibration lines at the start of lock segments.

A particularly egregious case is on July 13, where the calibration lines are still present in the NOLINES data for ~4 minutes into the observing mode segment but then quickly switch to being subtracted. This on-to-off behavior can be seen in this spectrogram of H1 NOLINES data from July 13, where red lines at the calibration frequencies disappear at 1:10 UTC. Comparing the H1 spectrum at 1:06 UTC and 1:16 UTC shows that the H1:GDS-CALIB_STRAIN spectrum is not changed, but the H1:GDS-CALIB_STRAIN_NOLINES spectrum has calibration lines in the 1:06 UTC spectrum and no lines in the 1:16 UTC spectrum. This demonstrates that the problem is with the subtraction rather than the actual calibration lines. 

This problem is still ongoing for recent locks. The most recent lock on August 15 has the same problem. The calibration lines "turn off" at 4:46 UTC as seen in the attached spectrogram

The on-to-off behavior of the subtraction is particularly problematic for data analysis pipelines as the quickly changing line amplitude can result in the data being over- or under-whitened.   

Images attached to this report
Comments related to this report
aaron.viets@LIGO.ORG - 14:56, Thursday 15 August 2024 (79558)CAL

A while back, I investigated this and found that the reason for occasional early lock subtraction problems is that, at the end of the previous lock, the lines were turned off, but the TFs were still being calculated.  Then, at the beginning of the next lock, it takes several minutes (due to the 512-s running median) to update the TFs with accurate values.  There were two problems that contributed to this issue.  I added some more gating in the pipeline to use the line amplitude channels to gate the TF calculation.  This fix was included included in gstlal-calibration-1.5.3, as well as the version currently in production (1.5.4). However, there have been some instances in which those channels were indicating that the lines were on when they were actually off at the end of the previous lock, which means this code change, by itself, does not fix the problem in all cases.  The version that is currently in testing, gstlal-calibration-1.5.7, includes some other fixes for line subtraction, which may or may not improve this problem.

A more reliable way to solve this issue would be to ensure that the line amplitude channels we are using always carry accurate real-time information.  Specifically, we would need to prevent the occurance of the lines turning off long before these channels indicate this has occurred.  The names of these channels are:

{IFO}:SUS-ETMX_L{1,2,3}_CAL_LINE_CLKGAIN
{IFO}:CAL-PCAL{X,Y}_PCALOSC{1,2,3,4,5,6,7,8,9}_OSC_SINGAIN

H1 SEI (CDS)
filiberto.clara@LIGO.ORG - posted 13:19, Tuesday 15 August 2023 (72238)
End Station HEPI Pump Controls moved to UPS

WP 11373

Recent power glitches have tripped HEPI at both end stations. SEI group requested the Beckhoff electronics for the HEPI pumps be placed on a UPS to help ride through the power glitches. This morning HEPI was taken offline. The Beckhoff computer was remotely powered down. Cabling was pulled in from the vacuum rack (24V, power supply on UPS) to the mechanical room. The dedicated HEPI power supply was disconnected and new 24V terminated. After code was restarted, the pump panel was power cycled. Work was done at both end stations.

F. Clara, T. Shaffer, P. Thomas, J. Warner

H1 SEI
jim.warner@LIGO.ORG - posted 13:01, Tuesday 15 August 2023 (72237)
3d-l4c dq channels added to HAM1 model temporarily.

Dave mentions in his summary below, HAM1 HPI model was restarted this morning so I could add some temporary DQ channels to the frames for the ground to HPI feedforward I'm working on at that chamber. These channels are meant to be temporary until we decide if the FF is going to be permanent or not, but having in the frames right now will make commissioning the ff easier. These channels are: 

 0$ check_model_daq_configuration h1hpiham1
--------------------- file times ----------------------
Mon Aug 14 13:52:54 2023 = Model build time

Tue Aug  8 11:32:55 2023 = Current configuration load time


DAQ configuration is changed, processing...

++: fast channel H1:HPI-HAM1_3DL4CINF_A_X_IN1_DQ added to the DAQ
++: fast channel H1:HPI-HAM1_3DL4CINF_A_Z_IN1_DQ added to the DAQ
++: fast channel H1:HPI-HAM1_3DL4CINF_B_X_IN1_DQ added to the DAQ
++: fast channel H1:HPI-HAM1_3DL4CINF_B_Z_IN1_DQ added to the DAQ
++: fast channel H1:HPI-HAM1_3DL4C_FF_X_IN1_DQ added to the DAQ
++: fast channel H1:HPI-HAM1_3DL4C_FF_Y_IN1_DQ added to the DAQ
++: fast channel H1:HPI-HAM1_3DL4C_FF_Z_IN1_DQ added to the DAQ
Total number of DAQ changes = 7
(7 additions, 0 deletions)

 

The A_X, A_Z, B_X and B_Z channels are the uncalibrated individual adc channels that I connected to the 3dl4c ff path. A_X and B_X don't currently have any sensors attached, but I hope to do something about that soon. The FF_X, FF_Y and FF_Z channels are the calibrated cartesian basis channels that get filtered and summed into the cart drives drives. FF_Z is the only channel that has any real data on it at the moment. No real changes to the model to do this, but I did have to make a custom library part to add the channels to the table. Added channels are in the screen shot.

 

 

Images attached to this report
H1 CDS
david.barker@LIGO.ORG - posted 12:03, Tuesday 15 August 2023 - last comment - 12:12, Tuesday 15 August 2023(72232)
CDS Maintenance Summary: Tuesday 15th August 2023

WP11361 TW1 raw minute trend files offload

Dave:

I have started the file copy from h1daqtw1's SSD-RAID (93% full) over to h1ldasgw1 SATABOY HDD storage.

The first step was to get TW1 to write trends to a new empty directory, freeing up the full directory for file copy. This required a temporary change to h1daqnds1's daqdrc file and a daqd restart. The restart was incorporated into the main DAQ restart of h1hpiham1 model change.

The file copy was started at 11:50 and is expected to take about 2 days.

WP11364 Signal reordering in h1oaf model

Jenne, Dave:

Jenne created a new h1oaf.mdl which was installed this morning. No DAQ restart was needed.

WP11369 Temporary addition of 1kHz DQ channels to DAQ for h1hpiham1

Jim, Dave:

A new h1hpiham1 model was installed, which adds seven 1kHz DQ channels to the DAQ. DAQ restart was needed

DAQ Restart

Dave, Jonathan, EJ:

The DAQ was restarted for the h1hpiham1 model change and the new NDS1 daqdrc configuration.

This was a messy restart. On the plus side, neither GDS0 nor GDS1 needed a second restart.

When the h1oaf model was restarted, FW0 took about 21 seconds longer to write the full frame it was in the process of writing. FW1 did not show this behaviour.

I started the 1-leg first, waited for about 5 minutes and then started the 0-leg. As was seen two weeks ago, while FW0 was coming back, FW1 spontaneously restarted itself, resulting in two frame files not written by either frame writer.

Comments related to this report
david.barker@LIGO.ORG - 12:05, Tuesday 15 August 2023 (72233)

Missing Full Frame Files:

scanning directory 13761
FW0 Missing Frames [1376149248, 1376149312]
FW1 Missing Frames [1376148928, 1376148992, 1376149248, 1376149312]
ERROR: no frame written for GPS 1376149248!!!
ERROR: no frame written for GPS 1376149312!!!

 

david.barker@LIGO.ORG - 12:12, Tuesday 15 August 2023 (72234)

Tue15Aug2023
LOC TIME HOSTNAME     MODEL/REBOOT
08:32:27 h1seih16     h1hpiham1   <<< Add DQ channels to DAQ


08:33:21 h1oaf0       h1oaf       <<< reorder inputs to C-code blocks


08:36:02 h1daqdc1     [DAQ] <<< 1-leg restart
08:36:11 h1daqfw1     [DAQ]
08:36:12 h1daqtw1     [DAQ]
08:36:13 h1daqnds1    [DAQ] <<< temporary daqdrc for TW1 offload
08:36:21 h1daqgds1    [DAQ]


08:41:10 h1daqdc0     [DAQ] <<< 0-leg restart
08:41:22 h1daqfw0     [DAQ]
08:41:23 h1daqnds0    [DAQ]
08:41:23 h1daqtw0     [DAQ]
08:41:31 h1daqgds0    [DAQ]


08:41:34 h1daqfw1     [DAQ] <<< Spontaneous FW1 restart!
 

H1 TCS
camilla.compton@LIGO.ORG - posted 11:11, Tuesday 15 August 2023 - last comment - 11:56, Tuesday 15 August 2023(72229)
HWS Cleaning code running on ETMY

Cao's new HWS cleaning code is running on EY HWS. hws-server/-/tree/fix/python3 The code works for python3 that we currently only have at ETMY. We should soon get all HWS computers running with python3 and then can use this code on all optics.

This doens't effect any of the old HWS code but adds new channels, see 68748. This code adds functionalities to estimate wavefront centers (H1:TCS-{OPTIC}_HWS_CENTER_ESTIMATE_{X,Y}) rather than relying on the those set by the user (H1:TCS-{OPTIC}_HWS_ORIGIN_{X,Y} ), and filters unusually large gradients to update center and spherical powers for clean channels.

Images attached to this report
Comments related to this report
huy-tuong.cao@LIGO.ORG - 11:56, Tuesday 15 August 2023 (72231)

A note on the new cleaned spherical power channels:

The new spehrical powers (CLEAN_SPHERICAL_POWER_X and CLEAN_SPHERICAL_POWER_Y) are computed from performing overlap integral of the numerical wavefront from the HWS with the nominal gaussian beam size of ITM and ETM (53 mm and 62 mm  respectively) to compute the scattering coefficient to HG20 (spherical power x) and HG02(spehrical power y)  which are then used to convert to RoCs.  The wavefront is computed by fast FFT integration  rather than standard  HWS numerical integration.

The old spherical powers  (H1:TCS-ETMY_HWS_SPHERICAL_POWER)  instead computed spherical power by fitting a polyomial to the gradient profile of HWS  and is thus dependent on the area of  Hartmann probe  available in the data, and not neccessarily the effective RoC sees by IFO beam.

 

LHO VE
david.barker@LIGO.ORG - posted 10:53, Tuesday 15 August 2023 (72228)
Tue CP1 Fill

Tue Aug 15 10:09:42 2023 INFO: Fill completed in 9min 38secs

Images attached to this report
H1 SEI (SEI)
ryan.crouch@LIGO.ORG - posted 10:47, Tuesday 15 August 2023 (72225)
H1 ISI CPS Noise Spectra Check - Weekly

Closes FAMIS 19671, last check alog72031

BSC:

ITMX_ST2_CPSINF_H1 high freq noise is high!

ITMY_ST2_CPSINF_H2 high freq noise has reduced

HAM:

Looks good.

Non-image files attached to this report
H1 SUS (DetChar, INJ, ISC, OpsInfo)
jeffrey.kissel@LIGO.ORG - posted 09:52, Tuesday 15 August 2023 - last comment - 14:26, Monday 23 October 2023(72221)
ETMX M0 Longitudinal Damping has been fed to TMTS M1 Unfiltered Since Sep 28 2021; Now OFF.
J. Kissel, J. Driggers

I was brainstorming why LOWNOISE_LENGTH_CONTROL would be ringing up a Transmon M1 to M2 wire violin mode (modeled to be at 104.2 Hz for a "production" TMTS; see table 3.11 of T1300876) for the first time on Aug 4 2023 (see current investigation recapped in LHO:72214), and I remembered "TMS tracking..."

In short: we found that ETMX M0 L OSEM damping error signal has been fed directly to TMSX M1 L path global control path, without filtering, since Sep 28 2021. Yuck!

On Aug 30 2021, I resolved the discrepancies between L1 and H1 end-station SUS front-end models -- see LHO:59772. Included in that work, I cleaned up the Tidal path, cleaned up the "R0 tracking" path (where QUAD L2 gets fed to QUAD R0), and installed the "TMS tracking" path as per ECR E2000186 / LLO:53224. In short, "TMS tracking" couples the ETM M0 longitudinal OSEM error signal to the TMS M1 longitudinal "input to the drivealign bank" global control path, with the intent of matching the velocity of the two top masses to reduce scattered light.

On Aug 31 2021, the model changes were installed during an upgrade to the RCG -- see LHO:59797, and we've confirmed that I turned both TMSX and TMSY paths OFF, "to be commissioned later, when we have an IFO, if we need it" at
    Tuesday -- Aug 31 2021 21:22 UTC (14:22 PDT) 

However, 28 days later,
    Tuesday -- Sept 28 2021 22:16 UTC (15:16 PDT)
the TMSX filter bank got turned back on, and must have been blindly SDF saved as such -- with no filter in place -- after an EX IO chassis upgrade -- see LHO:60058. At the time, that RCG 4.2.0 still had the infamous "turn on a new filter with its input ON, output ON, and a gain of 1.0" feature, that has been since resolved with RCG 5.1.1. So ... maybe, somehow, even though the filter was already installed on Aug 31 2021, the IO chassis upgrade rebuild, reinstall, and restart of the h1sustmsx.mdl front end model re-registered the filter as new? Unclear. Regardless this direct ETMX M0 L to TMSX M1 L path has been on, without filtering, since Sep 28 2021. Yuck!

Jenne confirms the early 2021 timeline in the first attachment here.
She also confirms via a ~2 year trend of the H1:SUS-TMSY_M1_FF_L filter bank's SWSTAT, that no filter module has *ever* been turned on, confirmed that there's *never* been filtering.

Whether this *is* the source of 102.1288 Hz problems and that that frequency is the TMSX transmon violin mode is still unclear. Brief investigations thus far include
    - Jenne briefly gathered ASDs of ETMX M0 L (H1:SUS-ETMX_M0_DAMP_L_IN_DQ) and TMSX M1 L OSEMs' error signal (H1:SUS-TMSX_M1_DAMP_L_IN1_DQ) around the time of Oli's LOWNOISE_LENGTH_CONTROL time, but found that at 100 Hz, the OSEMs are limited by their own sensor noise and don't see anything.
    - She also looked through the MASTER_OUT DAC requests (), in hopes that the requested control signal would show something more or different, but found nothing suspicious around 100 Hz there either.
    - We HAVE NOT, but could look at H1:SUS-TMSX_M1_DRIVEALIGN_L_OUT_DQ since this FF control filter should be the only control signal going through that path. I'll post a comment with this.

Regardless, having this path on with no filter is clearly wrong, so we've turned off the input, output, and gain accepted the filter as OFF, OFF, and OFF in the SDF system (for TMSX, the safe.snap is the same as the observe.snap).
Images attached to this report
Comments related to this report
jeffrey.kissel@LIGO.ORG - 10:39, Tuesday 15 August 2023 (72226)
No obvious blast in the (errant) path between ETMX M0 L and TMSX M1 L, the control channel H1:SUS-TMSX_M1_DRIVEALIGN_L_OUT_DQ, during the turn on of the LSC FF.

Attached is a screenshot highlighting one recent lock acquisition, after the addition / separation / clean up of calibration line turns ons (LHO:72205):
    - H1:GRD-ISC_LOCK_STATE_N -- the state number of the main lock acquisition guardian,
    - H1:LSC-SRCLFF1_GAIN, H1:LSC-PRCLFF_GAIN, H1:MICHFF_GAIN -- EPICs records showing the timing of when the LSC feed forward is turned on
    - The raw ETMX M0 L damping signal, H1:SUS-ETMX_M0_DAMP_L_IN1_DQ -- stored at 256 Hz
    - The same signal, mapped (errantly) as a control signal to TMSX M1 L -- also stored at 256 Hz
    - The TMSX M1 L OSEMs H1:SUS-TMSX_M1_DAMP_L_IN1_DQ, which are too limited by their own self noise to see any of this action -- but also only stored at 256 Hz.

In the middle of the TRANSITION_FROM_ETMX (state 557), DARM control is switching from ETMX to some other collection of DARM actuators. That's when you see the ETMX M0 L (and equivalent TMSX_M1_DRIVEALIGN) channels go from relatively noisy to quiet.

Then, at the very end of the state, or the start of the next state, LOW_NOISE_ETMX_ESD (state 558), DARM control returns to ETMX, and the main chain top mass, ETMX M0 gets noisy again. 

Then, several seconds later, in LOWNOISE_LENGTH_CONTROL (state 560), the LSC feed forward gets turned on. 

So, while there is control request changes to the TMS, at least according to channels stored at 256 Hz, we don't see any obvious kicks / impulses to the TMS during this transition. 
This decreases my confidence that something was kicking up a TMS violin mode, but not substantially.
Images attached to this comment
jeffrey.kissel@LIGO.ORG - 10:33, Wednesday 16 August 2023 (72275)DetChar, DetChar-Request
@DetChar -- 
This errant TMS tracking has been on throughout O4 until yesterday.

The last substantial nominal low noise segment before the this (with errant, bad TMS tracking) was on  
     2023-08-15       04:41:02 to 15:30:32 UTC
                      1376109680 - 1376148650
the first substantial nominal low noise segment after this change 
     2023-08-16       05:26:08 - present
                      1376198786 - 1376238848 

Apologies for the typo in the main aLOG above, but *the* channels to understand the state of the filter bank that's been turned off are 
    H1:SUS-TMSX_M1_FF_L_SWSTAT
    H1:SUS-TMSX_M1_FF_L_GAIN

if you want to use that for an automated way of determining whether the TMS tracking is on vs. off.

If the SWSTAT channel has a value of 37888 and the GAIN channel has a gain of 1.0, then the errant connection between ETMX M0 L and TMSX M1 L was ON. That channels has now a value of 32768 and 0.0, respectively, indicating that it's OFF. (Remember, for a standard filter module a SWSTAT value of 37888 is a bitword representation for "Input, Output, and Decimation switches ON." A SWSTAT value of 32768 is the same bitword representation for just "Decimation ON.")

Over the next few weeks, can you build up an assessment of how the IFO has performed a few weeks before vs. few weeks after?
     I'm thinking, in particular, in the corner of scattered light arches and glitch rates (also from scattered light), but I would happily entertain any other metric you think are interesting given the context.

     The major difference being that TMSX is no longer "following" ETMX, so there's a *change* in the relative velocity between the chains. No claim yet that this is a *better* change or worse, but there's definitely a change. As you know, the creation of this scattered-light-impacting, relative velocity between the ETM and TMS is related to the low frequency seismic input motion to the chamber, specifically between the 0.05 to 5 Hz region. *That* seismic input evolves and is non-stationary over the few weeks time scale (wind, earthquakes, microseism, etc.), so I'm guessing that you'll need that much "after" data to make a fair comparison against the "before" data. Looking at the channels called out in the lower bit of the aLOG I'm sure will be a helpful part of the investigation.

I chose "a few weeks" simply because the IFO configuration has otherwise been pretty stable "before" (e.g., we're in the "representative normal for O4" 60 W configuration rather than the early O4 75 W configuration), but I leave it to y'all's expertise and the data to figure out a fair comparison (maybe only one week, a few days, or even just the single "before" vs. "after" is enough to see a difference).
ansel.neunzert@LIGO.ORG - 14:31, Monday 21 August 2023 (72357)

detchar-request git issue for tracking purposes.

jane.glanzer@LIGO.ORG - 09:12, Thursday 05 October 2023 (73271)DetChar
Jane, Debasmita

We took a look at the Omicron and Gravity triggers before and after this tracking was turned off. The time segments chosen for this analysis were:

TMSX tracking on: 2023-07-29 19:00:00 UTC - 2023-08-15 15:30:00 UTC, ~277 hours observing time
TMSX tracking off: 2023-08-16 05:30:00 UTC - 2023-08-31 00:00:00 UTC, ~277 hours observing time

For the analysis, the Omicron parameters chosen were SNR > 7.5, and a frequency between 10 Hz and 1024 Hz. The Gravity Spy glitches included a confidence of > 90%. 

The first pdf contains glitch rate plots. In the first plot, we have the Omicron glitch rate comparison before and after the change. The second and third plots shows the comparison of the Omicron glitch rates before and after the change as a function of SNR and frequency. The fourth plot shows the Gravity Spy classifications of the glitches. What we can see from these plots is that when the errant tracking was on, the overall glitch rate was higher (~29 per hour when on, ~15 per hour when off). It was particularly high in the 7.5-50 SNR range and 10Hz - 50Hz range, which is typically where we observe scattering. The Gravity Spy plot shows that scattered light is the most common glitch type when the tracking is both on and off, but reduces after the tracking is off.

We also looked into see if these scattering glitches were coincidence in "H1:GDS-CALIB_STRAIN" and "H1:ASC-X_TR_A_NSUM_OUT_DQ", which is shown in the last pdf. From the few examples we looked at, there does seem to be some excess noise in the transmitted monitor channel when the tracking was on. If necessary, we can look into more examples of this. 
Non-image files attached to this comment
debasmita.nandi@LIGO.ORG - 14:26, Monday 23 October 2023 (73674)
Debasmita, Jane

We have plotted the ground motion trends in the following frequency bands and DOFs

1. Earthquake band (0.03 Hz--0.1 Hz) ground motion at ETMX-X, ETMX-Z and ETMX-X tilt-subtracted
2. Wind speed (0.03 Hz--0.1 Hz) at ETMX
3. Micro-seismic band (0.1 Hz--0.3 Hz) ground motion at ETMX-X

We have also calculated the mean and median of the ground motion trends for two weeks before and after the tracking was turned off. It seems that while motion in all the other bands remained almost same, the microseismic band ground motion (0.1-0.3 Hz) has increased significantly (from a mean value of 75.73 nm/s to 115.82 nm/s) when the TMS-X tracking was turned off. Still, it produced less scattering than before when the TMS-X tracking was on. 

The plots and the table are the attached here.
Non-image files attached to this comment
H1 SQZ (OpsInfo)
camilla.compton@LIGO.ORG - posted 11:48, Monday 14 August 2023 - last comment - 10:36, Thursday 14 September 2023(72195)
Unmonitored syscssqz channels that have been taking IFO out of observing

Naoki and I unmonitored  H1:SQZ-FIBR_SERVO_COMGAIN and H1:SQZ-FIBR_SERVO_FASTGAIN from syscssqz observe.snap. They have been regularly  taking us out of observing (72171) by changing when the TTFSS isn't really unlocking, see 71652. If the TTFSS really unlocks there will be other sdf diffs and the sqz guardians will unlock. 

We still plan to investigate this further tomorrow. We can monitor if it keeps happening using the channels.

Images attached to this report
Comments related to this report
sheila.dwyer@LIGO.ORG - 10:42, Tuesday 15 August 2023 (72227)

Daniel, Sheila

We looked at one of these incidents, to see what information we could get from the beckhoff error checking.  The attached screenshot shows that when this happened on August 12th at 12:35 UTC, the beckhoff error code for the TTFSS was 2^20, counting down on the automated error screen (second attachment) the 20th error is Beatnote out of range of frequency comparator.  We looked at the beatnote error epics channel, which does seem to be well within the tolerances.  Daniel thinks that the error is happening faster than it can be recorded by epics.  He proposes that we go into the beckhoff code and add a condition that the error condition has to be met for 0.1s before throwing the error. 

Images attached to this comment
camilla.compton@LIGO.ORG - 10:17, Friday 18 August 2023 (72317)

In the last 5 days these channels would have taken us out of observing 13 times if they were still monitored, plot attached. Worryingly, 9 times in the last 14 hours, see attached.

Maybe something has changed in SQZ to make the TTFSS more sensitive. The IFO has been locked for 35 hours where sometimes we get close to the edges of our PZT ranges due to temperature drifts over long locks. 

Images attached to this comment
victoriaa.xu@LIGO.ORG - 12:25, Tuesday 22 August 2023 (72372)SQZ

I wonder if the TTFSS 1611 PD is saturated as power from the PSL fiber has drifted. Trending RFMON and DC volts from the TTFSS PD, it looks like in the past 2-3 months, the green beatnote's demod RF MON has increased (its RF max is 7), while the bottom gray DC volts signal from the PD has flattened out around -2.3V. Also looks like the RF MON got noisier as the PD DC volts saturated.

This PD should see the 160 MHz beatnote between the PSL (via fiber) and SQZ laser (free space). From LHO:44546, it looks like this PD "normally" would have like 360uW on it, with 180uW from each arm. If we trust the PD calibrations, then current PD values report ~600uW total DC power on the 1611 PD (red), with 40uW transmitted from the PSL fiber (green trend). Pick-offs for the remaining sqz laser free-space path (iem sqz laser seed/LO PDs) don't see power changes, so unlikely the saturations are coming from upstream sqz laser alignment. Not sure if there's some PD calibration issues going on here. In any case, all fiber PDs seem to be off from their nominal values, consistent with their drifts in the past few months.

I adjusted the TTFSS waveplates on the PSL fiber path to bring the FIBR PDs closer to their nominal values, and at least so we're not saturing the 1611. TTFSS and squeezer locks seem to have come back fine. We can see if this helps the SDF issues at all.

Images attached to this comment
camilla.compton@LIGO.ORG - 10:36, Thursday 14 September 2023 (72881)

These were re-monitored in 72679 after Daniel adjusted the SQZ Laser Diode Nominal Current, stopping this issue.

Displaying reports 16521-16540 of 86646.Go to page Start 823 824 825 826 827 828 829 830 831 End