OPS OWL Mid-Shift Update Summary

Mid-Shift Update Summary

1. NUC 30 DARM FOM is not able to gather data for some reason. I restarted the entire NUC30 per the wiki but other than that, no guidance is given as to how to proceed. I’m sure this is an easy fix but I’ve never dealt with it so I’m a bit confused - wiki is not too useful for this specific issue. EDIT: Added error screenshot
2. Lockloss at 8:30 UTC due to unknown reasons (DRMI unlocked)  - investigating other FOMs to see - violins looked good. Letting guardian try to relock on its own
   1. On the 3-10Hz seismograph (Nuc5), there’s a very sharp and short pulse of microseismic activity exactly at the time of the lockloss - I wonder if this is due to 3.3 in Nevada (unlikely).
3. Lock 1:
   • ALS Locked on its own though had to go to increase flashes for ALS_X but caught eventually
   • Couldn’t lock DRMI without going into PRMI
   • IR was found very quickly
   • Touched BS because couldn’t find lock PRMI
     1. Went into Check mich fringes
     2. ALS_Y DOF_1_Y and ALS_X DOF_2 P not converging
   • Will touch BS and PRM if still not working
     1. PRMI locked then PRMI_ASC immediately unlocks
     2. Had to take it very slowly while aligning the BS and PRM - initially didn’t work so I misaligned PRM to check if the BS was aligned and it was so I realigned PRM.
     3. Touched up PRM mostly until the brief PRMI_locked and then switched to touching BS while looking at AS AIR trying to “overlay” the peanut shaped beams. I was also looking at POPAIR 18 and 90 and manually attempting to move them up (as per ops_wiki PRMI/DRMI troubleshooting) - this did the trick!
        1. Briefly when nothing was working, touched PR2 by 2 or so notches and then undid the change.
   • Finally worked! Got all the way up to OMC_Whitening - there are a few pesky violins that I'm damping before we can proceed to NLN - very very close!
     1. that took about 20 minutes (with help) to ring down primarily EY1 (G=+2.2, all else equal), IY12 (following Tony's change I set the gain from +2 to -2; I think GRD must've changed it back looking at the trend), and EX7 (not touched)
   • NLN and OBSERVING as of 11:15 UTC

IFO STATUS:

NOMINAL LOW NOISE and OBSERVING

OPS Owl Shift Start

TITLE: 05/30 Owl Shift: 07:00-15:00 UTC (00:00-08:00 PST), all times posted in UTC
STATE of H1: Observing at 132Mpc
CURRENT ENVIRONMENT:
    SEI_ENV state: CALM
    Wind: 7mph Gusts, 5mph 5min avg
    Primary useism: 0.02 μm/s
    Secondary useism: 0.12 μm/s
QUICK SUMMARY:

IFO is in NLN and OBSERVING

Keeping an eye on violins mentioned in Tony's alog 69992

Monday Eve OPS Shift End

TITLE: 05/30 Eve Shift: 23:00-07:00 UTC (16:00-00:00 PST), all times posted in UTC
STATE of H1: Observing at 133Mpc
CURRENT ENVIRONMENT:
    SEI_ENV state: CALM
    Wind: 10mph Gusts, 9mph 5min avg
    Primary useism: 0.02 μm/s
    Secondary useism: 0.12 μm/s
QUICK SUMMARY:

2:49 UTC NOMINAL_LOW_NOISE
2:56 UTC OBSERVING

ITMY MODE5 Current State 4.51 and rising I Changed the Damping for Mode 5 from 0.01 to 0dBm.

ITMY Mode8 current state 4.83 and rising at 3:05UTC I change damping gain from +0.08 to 0 for Mode 8.
ITMX Mode 12 is also ringing up so I took the Gain from +2 to -2.

3:33 UTC Tried changing the gain on ITMY M8 to -0.08 instead of zero. This worked out very well. 

IFO Current Status: Lock in NOMINAL_LOW_NOISE & OBSERVING

Monday Eve OPS Mid Shift update

Mid Shift Summary:
Started Sift with a Locked H1
23:45 UTC I notice that ITMY Mode5, 6, 8 Violin modes are ringing up  
ITMY Mode5 current state 4.55
ITMY Mode6 current state 4.52
ITMY Mode8 current state 4.82
at 23:47UTC I change damping gain from +0.08 to 0 for Mode 8 and watch patiently.
at 0:08UTC I Changed the Damping for Mode 5 from 0.01 to 0.

0:56 UTC Lockloss  https://ldas-jobs.ligo-wa.caltech.edu/~lockloss/index.cgi?event=1369443375

1:26 UTC Lockloss during DRMI_1f likey due to ground motion from 5.8M earthquake.
https://ldas-jobs.ligo-wa.caltech.edu/~lockloss/index.cgi?event=1369445196

1:28UTC lockloss due to 5.8M Earthquake
https://ldas-jobs.ligo-wa.caltech.edu/~lockloss/index.cgi?event=1369445338

Had to Touch up BS & PRM during DRMI/PRMI but otherwise easy locking without Initial_Alignment.

2:49 UTC NOMINAL_LOW_NOISE
2:56 UTC OBSERVING

Current IFO Status: Locked NLN and Observing.

"Tagging FMCS" with Temps:
LVEA Temp fluctuations for the last 7 days.

Along with EX & Y temps for the same time 

Monday OPS Day Shift End

TITLE: 05/29 Eve Shift: 23:00-07:00 UTC (16:00-00:00 PST), all times posted in UTC
STATE of H1: Observing at 127Mpc
CURRENT ENVIRONMENT:
    SEI_ENV state: CALM
    Wind: 11mph Gusts, 9mph 5min avg
    Primary useism: 0.02 μm/s
    Secondary useism: 0.10 μm/s
QUICK SUMMARY:

IFO Status: NOMINAL_LOW_NOISE & OBSERVING

 

 

Ops Day Shift Summary

TITLE: 05/29 Day Shift: 15:00-23:00 UTC (08:00-16:00 PST), all times posted in UTC
STATE of H1: Observing at 128Mpc
SHIFT SUMMARY:

Shift started with Jennie and I testing new MICH and SRCL FF filters (see alog 69985) since the IFO was thermalized from being locked for over 6 hours.

Lockloss @ 16:40; lockloss tool analysis failed, immediate cause unclear.

I then struggled for a while to reacquire lock. PRMI was able to lock quickly, but I could not get alignment good enough to not have the PRMI ASC pull the spot away when it came on. I got to the point where I was convinced I needed to adjust PR3 alignment, so I did, but then I soon put it back when I realized I was only making POP18 and POP90 signals worse. I opted to try a full initial alignment just to be safe, which went relatively smoothly (only BS needed adjusting during MICH_BRIGHT) until it was time to align the SRC. I ran through SR2 alignment and offloaded it, then tried to hand align SRM to prepare for the full SRC alignment. I realized after the fact that I was doing this SRM adjustment in the DOWN state of ALIGN_IFO while I should have moved to PREP_FOR_SRY, as SRM had been misaligned for the SR2 alignment and the DOWN state does not realign it. This meant I was not actually achieving proper alignment of SRM (lesson learned). Once I realized my mistake, I properly aligned SRM and SRC align, and therefore initial alignment, was able to finish successfully.

Locking after this alignment was straightforward and unaided. NLN reached @ 21:49 and Observing @ 21:59

Handing off to Tony for the evening.

LOG:

No log for this shift.

PSL Status Report - Weekly

FAMIS 21442

Laser Status:
    NPRO output power is 1.826W (nominal ~2W)
    AMP1 output power is 67.6W (nominal ~70W)
    AMP2 output power is 135.0W (nominal 135-140W)
    NPRO watchdog is GREEN
    AMP1 watchdog is GREEN
    AMP2 watchdog is GREEN

PMC:
    It has been locked 13 days, 3 hr 21 minutes
    Reflected power = 16.27W
    Transmitted power = 110.1W
    PowerSum = 126.4W

FSS:
    It has been locked for 0 days 2 hr and 15 min
    TPD[V] = 0.8546V

ISS:
    The diffracted power is around 1.7%
    Last saturation event was 0 days 2 hours and 15 minutes ago

Possible Issues:
    ISS diffracted power is low

PSL 10-Day Trends

FAMIS 19978

No major events of note on these trends.

Feed Forward Tests with new filters after thermalisation

Jennie W., Ryan S., Evan H.

We tested the new filters Elenna & Gabriele designed in this alog. Previous effeorts to design these recently are in this alog.

These were previously tested by Ryan C. here.

Executive Summary

The aim was to do a test > 6 hours in as the filters were optimised for a thermalised IFO.

The new FF filters make DARM sensitivity worse.

SRCLFF coupling to DARM looks better with the new filters between 12 and 56Hz roughly.

MICHFF coupling to DARM looks worse below 100Hz with new filters.

Tuning the gains of MICHFF up and down made the coupling worse.

---

Test 1

We took a background measurement at 15:32:23 UTC.

This was with the old filters for MICHFF and SRCLFF1 - labelled as 4-23-23 in filter banks.

Ended before 15\;33\;39 UTC.

SRCLFF1 gain = 1, MICHFF gain = 1

Ref 0 - CAL-DELTAL_EXTERNAL_DQ Power Spectrum

Ref 1 LSC-MICH_OUT_DQ/CAL-DELTAL_EXTERNAL_DQ Coherence

Ref 2 LSC-SRCL_OUT_DQ/ CAL-DELTAL_EXTERNAL_DQ Coherence

 

Test 2

Went out of OBS, chnaged the ramp time of both banks to 5s. Turned gain to 0. Turned off 4-23-23, turned on 5-20-23. Turned gain back to 1.

We did the MICH filter first, it was turned on by 15:37:50 UTC.

Then the SRCL filter by 15:38: 29 UTC.

Both banks have a gain 1 nominally.

SRCLFF1 gain = 1, MICHFF gain = 1

Measurement start = 15:38:56 UTC

Measurement end = 15:40:00 UTC

Ref 3 CAL-DELTAL_EXTERNAL_DQ Power Spectrum

Ref 4 LSC-MICH_OUT_DQ/CAL-DELTAL_EXTERNAL_DQ Coherence

Ref 5 LSC-SRCL_OUT_DQ/ CAL-DELTAL_EXTERNAL_DQ Coherence

 

Test 3

For the next test I misread the data, decided SCRL was worse with the new filter and so tuned the gain a bit.

SCRLFF1 gain = 1.1, MICHFF gain = 1

Measurement start = 15:42:59 UTC

Measurement end = 15:44:10 UTC

Ref 6 CAL-DELTAL_EXTERNAL_DQ Power Spectrum

Ref 7 LSC-SRCL_OUT_DQ/ CAL-DELTAL_EXTERNAL_DQ Coherence

Afterwards I realised that SRCL was better with the new FF filters, so we put the SRCLFF gain back to one at 15:49:39 UTC and took some measurements while tuning the MICH gain which is broadly worse with the new filters.

 

Test 4

MICHFF gain changed by 15:51:06 UTC

SCRLFF1 gain = 1, MICHFF gain = 0.9

Measurement start = 15:51:58 UTC

Measurement end = 15:53:15 UTC

Ref 8 CAL-DELTAL_EXTERNAL_DQ Power Spectrum

Ref 9 LSC-MICH_OUT_DQ/CAL-DELTAL_EXTERNAL_DQ Coherence

 

Test 5

SCRLFF1 gain = 1, MICHFF gain = 1.1

Ref 10 CAL-DELTAL_EXTERNAL_DQ Power Spectrum

Ref 11 LSC-MICH_OUT_DQ/CAL-DELTAL_EXTERNAL_DQ Coherence

Template saved in /ligo/home/ryan.short/FF_testing.xml

Old filters back in by 16:00:50 UTC

My version - corresponding to attached plots is saved in jennifer.wright/git/Feedfoward/2023-05-29_DARM_FOM_LSC_FF_check.xml.

Red measurement is the old FF filters, blue is the new with a gain of 1, yellow is with a higher gain in SRCLFF1, purple is with a lower gain in MICHFF and green is with a higher gain in MICHFF.

First image is DARM ASD, SCRL coupling, MICH coupling, second shows DARM ASD for all measurements, thirs shows DARM ASD for old filters vs. new filters with no gain changes.

Mon CP1 Fill

Mon May 29 10:07:52 2023 INFO: Fill completed in 7min 51secs

Ops Day Shift Start

TITLE: 05/29 Day Shift: 15:00-23:00 UTC (08:00-16:00 PST), all times posted in UTC
STATE of H1: Observing at 129Mpc
CURRENT ENVIRONMENT:
    SEI_ENV state: CALM
    Wind: 2mph Gusts, 1mph 5min avg
    Primary useism: 0.01 μm/s
    Secondary useism: 0.11 μm/s
QUICK SUMMARY: Taking over from Austin. H1 has been locked for 6 hours Observing at 129Mpc. We plan to start the new FF filter test now that H1 is thermalized.

• CDS, SEI, SUS all okay
• Dust monitors working and levels okay
• No alarms

 

Monday Owl Operator Summary

TITLE: 05/29 Owl Shift: 07:00-15:00 UTC (00:00-08:00 PST), all times posted in UTC
STATE of H1: Observing at 131Mpc
SHIFT SUMMARY:

- Arrived with the IFO locked and in OBSERVING (~ 1.5 hours)

- LOCKLOSS @ 7:44 - PI 29 ringup

- Lock #1:

- Acquired NLN @ 8:58, OBSERVING @ 9:00

- PI 31 ringup @ 9:20, EX saturation @ 10:48

- ITMX 12 nominal settings are still ringing up the mode, changing the gain to -2 seems to work well

Passing the IFO to Ryan locked and in OBSERVING, but since we are near thermalized, we plan on doing another ff test
LOG:

No log for this shift.

Mid Shift Owl Report

H1 is OBSERVING, currently sitting at a 2:00 lock.

Sunday EVE OPS Shift End

TITLE: 05/29 Eve Shift: 23:00-07:00 UTC (16:00-00:00 PST), all times posted in UTC
STATE of H1: Observing at 127Mpc
CURRENT ENVIRONMENT:
    SEI_ENV state: CALM
    Wind: 13mph Gusts, 11mph 5min avg
    Primary useism: 0.03 μm/s
    Secondary useism: 0.10 μm/s
QUICK SUMMARY:

X-arm green flashes are not high enough and the COmm beatnote was -15dBm, reading through the troubleshooting docs.
I should try Trending the PR2 Alignment to a point right before initial alignment was ran before the lock started yesterday. 
gpstime chosen: 1369267493
Before change PR2 P = 1600.3 After PR2 P= 1614.22 
Before change PR2 Y = 3225.8 After PR2 Y= 3234.54

Now trending PR3 to see if it has been moved. it has not.

Moved ISC_LOCK to down. 
Restoring all sliders to GPStime 1369292468
lost all light on green arms. 

Restoring to 1369267264 to hopfully get some light on the arms at least, I now have very faint light on the arms.
Restoring just the X & Y arms to 2 hours ago : 1369350813 and I have good light on the arms again.

Checked the OPlevs for PR3, the seem to be moving. 

Got appoval from Sheila that I should move PR3!!!!
PR3 Current settings : 
P -118.7
Y 151.6

Moved to PR3 
P -117.7 
Y 153.2

Got Comm Beatnote down to -4dBm! moved on to INIT Alignment, got through that and locks DRMI 1f. 

Got to DRMI_LOCKED_CHECK_ASC And ASC-SRC1_P & Y_OUT were not converging.
Tried locking again to see if it would just start converging, it did not.
Going to Manual Initial alignment to align SRC.
tried locking again and had the same issues with SRM AND ASC-SRC1P & Y not converging. 

Checking Out Oplevs for SR3 they seem to be moving a lot. 

Went Back to Manual Initial alignment watched H1:ASC-AS_A_DC_NSUM_OUT Found in Init align IR cavity scopes on Jenne's locking screen. 
ran SRC_ALIGN from ALIGN_IFO again. but this time then took ALIGN_IFO to down, and stayed there while moving SRM to increase the ASC-AS_A_DC signal.  
Before : 
SRM P = 1949.226 
SRM Y = -3107.24

After : 
SRM P = 2255.2
SRM Y = -3162.5
 

Ops Eve Shift Start

TITLE: 05/29 Owl Shift: 07:00-15:00 UTC (00:00-08:00 PST), all times posted in UTC
STATE of H1: Observing at 127Mpc
CURRENT ENVIRONMENT:
    SEI_ENV state: CALM
    Wind: 13mph Gusts, 11mph 5min avg
    Primary useism: 0.02 μm/s
    Secondary useism: 0.09 μm/s
QUICK SUMMARY:

- SEI/DMs/CDS ok

- IFO has been locked for 1:08 and in OBSERVING

Sunday EVE OPS Shift Start

TITLE: 05/28 Eve Shift: 23:00-07:00 UTC (16:00-00:00 PST), all times posted in UTC
STATE of H1: Aligning
CURRENT ENVIRONMENT:
    SEI_ENV state: CALM
    Wind: 18mph Gusts, 14mph 5min avg
    Primary useism: 0.05 μm/s
    Secondary useism: 0.09 μm/s
QUICK SUMMARY:

IFO Status: Unlocked and Aligning.
Starting Initial Alignment, noticed that the Xarm flashes are not getting very high during increase flashes taking over by hand.

Ops Day Shift Summary

TITLE: 05/28 Day Shift: 15:00-23:00 UTC (08:00-16:00 PST), all times posted in UTC
STATE of H1: Aligning
SHIFT SUMMARY:

Started the day locked, lockloss @ 18:25 with an unclear cause. The lockloss tool shows some pretty rapidly growing ETMX L3 motion about a second before the lockloss; I haven't been able to track down its source.

I haven't been able to relock H1 since then. I started doing an initial alignment since the beatnotes were poor and the ITM camera signals were far off, which ran smoothly until SRC alignment. At the SRY locking step, SRM M3 would saturate and the beam spot on the AS AIR camera would walk off the camera. I took ALIGN_IFO to DOWN and hand aligned the cavity with SRM, watching the beam spot and ASC-AS_A_DC_NSUM signal. I then proceeded to try locking normally, but the COMM beatnote was still bad (-16 dBm). After going on a wild goose chase or two, I've started initial alignment again. Handing off to Tony for the evening.

LOG:

No log for this shift.

Ops Day Mid Shift Update

State of H1: Aligning

Lockloss @ 18:25 after a 9.5 hour lock stretch, cause still under investigation (but ETMX started oscillating suddenly about 1 second before lockloss). ITM camera error signals are far off and beatnotes are poor, so I've started an initial alignment.

Sun CP1 Fill

Sun May 28 10:07:54 2023 INFO: Fill completed in 7min 53secs

Ops Day Shift Start

TITLE: 05/28 Day Shift: 15:00-23:00 UTC (08:00-16:00 PST), all times posted in UTC
STATE of H1: Observing at 134Mpc
CURRENT ENVIRONMENT:
    SEI_ENV state: CALM
    Wind: 9mph Gusts, 7mph 5min avg
    Primary useism: 0.01 μm/s
    Secondary useism: 0.09 μm/s
QUICK SUMMARY: Taking over from Austin; H1 has been Observing for 6.5 hours.

• CDS, SEI, SUS all okay
• No alarms
• Dust monitors all running and levels okay
• LVEA temps have leveled out