ETMY mode 20 had no damping settings in the Guardian and the mode was rung up. I applied the following settings and it has worked during this lock stretch. I will add it to the Guardian and accept them in the SDF once I am confident that the settings work consistently.
FM1 FM4 FM10 Gain -1.0
The above filters were already engaged, hence I only had to look for an appropriate gain and this didn't kick us out of Observing.
Also, Jenne wanted some of the higher order modes to be looked into and damped (see her alog 71212). I took high resolution spectra for modes between 1500Hz and 2000Hz and have been working on identifying (frequencies and which optic it belongs to) the top few rung up modes. Once identified, I will start looking for damping settings for the same.
8:52 UTC GRB-Short Candidate E416867
Other than that and a number of these messages that popup in DIAG -Main every few minutes:
2023-07-12_10:07:30.392076Z DIAG_MAIN [RUN_TESTS.run] USERMSG 0: PSL_ISS: Diffracted power is low
But they go away immediatley, Ndscope attached.
Rahul has been actively working on Violin Damping and seems to have found a good setting for ETMY M2.
FAMIS 19666
ITMX_ST2_CPSINF_H1 high freq noise is high!
ITMX_ST2_CPSINF_H3 high freq noise is high!
TITLE: 07/12 Owl Shift: 07:00-15:00 UTC (00:00-08:00 PST), all times posted in UTC
STATE of H1: Observing at 136Mpc
CURRENT ENVIRONMENT:
SEI_ENV state: CALM
Wind: 16mph Gusts, 14mph 5min avg
Primary useism: 0.02 μm/s
Secondary useism: 0.04 μm/s
QUICK SUMMARY:
Everything looks great and seems to be functioning properly.
Current IFO Status: NOMINAL_LOW_NOISE & OBSERVING
TITLE: 07/12 Eve Shift: 23:00-07:00 UTC (16:00-00:00 PST), all times posted in UTC
STATE of H1: Observing at 140Mpc
SHIFT SUMMARY: H1 has been locked and Observing for 6.5 hours. Quiet evening once H1 was locked and violins were damped enough.
Handing off to Tony for the rest of the night.
LOG:
No log for this shift.
FAMIS 19984
FSS TPD signal has been slightly dropping over the past week, along with the ISS diffraction average. This may correspond with a slight increase in PMC REFL power.
State of H1: Observing at 140Mpc
H1 has been locked and observing for 2.5 hours. Waited in OMC_WHITENING for an hour to damp violins; Oli and I were able to increase gains to modes that had their gains turned down by the guardian successfully to speed up the damping.
TITLE: 07/11 Eve Shift: 23:00-07:00 UTC (16:00-00:00 PST), all times posted in UTC
STATE of H1: Lock Acquisition
CURRENT ENVIRONMENT: SEI_ENV state: CALM
Wind: 12mph Gusts, 9mph 5min avg
Primary useism: 0.02 μm/s
Secondary useism: 0.05 μm/s
QUICK SUMMARY:
15:11 Unlocked detector for Tuesday maintainance
20:30 Locked and Observing
- Needed to force ALS XARM PLL Crystal Frequency
- Needed to pause at OMC_WHITENING to damp violins
22:24-22:25 Pushed out of Observing briefly
- Squeezer lost lock and then relocked without manual intervention
22:29 Lock loss
- Unknown cause In process of locking back up
- Needed to force ALS XARM PLL Crystal Frequency again
LOG:
| Start Time | System | Name | Location | Lazer_Haz | Task | Time End |
|---|---|---|---|---|---|---|
| 14:44 | FAC | Karen | VAC Prep | N | Technical cleaning | 17:36 |
| 15:09 | FAC | Cindi | FCES | n | Tech clean | 17:44 |
| 15:09 | SEI | Jim, Randy | CS | n | take down corner HEPIs | 16:29 |
| 15:12 | FAC | Kim, Karen | LVEA | n | Tech clean | 17:14 |
| 15:23 | SEI | Jim | HAM7 | n | HAM7 measurement | 17:48 |
| 15:27 | FAC | Chris, Pest ppl | LVEA, Yarm, Xarm | n | Pest control | 17:05 |
| 15:29 | VAC | Gerardo, Jordan | EX | n | Turbo pump work | 17:57 |
| 15:30 | PCAL | Rick | Ends | n | Turn off pcal lines | 18:59 |
| 15:45 | APS | APS | LVEA FCTE | n | access system | 18:40 |
| 15:46 | VAC | Janos, Travis, Richard | EX, MX | n | Turbo pump stations running | 17:46 |
| 16:06 | SYS | Camilla, Joe | LVEA, PCAL lab | n, yes | Search for parts | 16:38 |
| 16:06 | PEM | Robert, Lance, Genevieve | EX. EY, CS | n | PEM injection shaker/speaker setup | 18:40 |
| 16:15 | FAC | Christina | LVEA | n | property tag search | 17:23 |
| 16:29 | SYS | Betsy, Mitchell | LVEA | n | Searching for parts | 17:49 |
| 16:37 | CDS | Fil | LVEA | n | Tracing out accel. cable by HAM 5/6 | 19:00 |
| 17:03 | SEI | Jim, Fernando | LVEA | n | Chassis swap | 18:20 |
| 17:07 | FAC | Chris | LVEA | n | FAMIS check | 17:49 |
| 17:14 | - | SURF Group 1 | LVEA | n | LVEA tour | 18:48 |
| 17:16 | - | Amber, tour | LVEA, roof | n | Tour | 18:01 |
| 17:24 | - | Camilla, SURF 2 | Roof, LVEA | n | Tour | 18:51 |
| 17:27 | CDS | Marc | LVEA | n | Swap Baffle PD chassis in bier garten | 17:58 |
| 17:31 | ISC | Daniel | LVEA | n | Turn off sidebands | 17:34 |
| 17:36 | FAC | Karen | EY | n | Tech clean | 18:47 |
| 17:37 | FAC | Kim | EX | n | Tech clean | 18:59 |
| 17:45 | Property | Christina | Mids, Ends, FCES | n | Property search | 19:02 |
| 17:50 | FAC | Cindi | LVEA | n | garage door+mechanical room tech clean | 19:10 |
| 18:00 | - | Norco | EX | n | Tank 4380 fill | 18:51 |
| 18:01 | - | Amber, tour | EY | n | Tour | 18:59 |
| 18:23 | Access | Richard | LVEA | n | Turn off BS damp | 18:51 |
| 18:39 | VAC | Gerardo | LVEA | n | Grabbing parts | 18:59 |
| 18:40 | PEM | Robert, Lance, Genevieve | LVEA | n | PEM shaker prep | 19:13 |
| 18:50 | Access | Gerardo | Mid+End Stations | n | Check on Access | 20:14 |
| 22:06 | Travis | Mids | n | Flow meters | 22:38 | |
| 23:03 | VAC | Gerardo, Jordan | LVEA | n | Looking for parts | 23:03 |
| 23:07 | VAC | Gerardo | Filter end cavity | n | Looking for parts | 23:37 |
Tagging SQZ. Old alog. Had IFO node not okay for 1m45s as FC IR unlocked. Plot attached. Not sure why.
TITLE: 07/11 Eve Shift: 23:00-07:00 UTC (16:00-00:00 PST), all times posted in UTC
STATE of H1: Lock Acquisition
CURRENT ENVIRONMENT:
SEI_ENV state: CALM
Wind: 12mph Gusts, 9mph 5min avg
Primary useism: 0.02 μm/s
Secondary useism: 0.05 μm/s
QUICK SUMMARY: Taking over from TJ and Oli. H1 is currently relocking after recent lockloss; just reached POWER_10W.
WP11293 Increase rate of LSC and ASCIMC channels
Daniel, Dave:
Daniel created new h1lsc and h1ascimc models which increased the DAQ rate of 3 DQ channels from 2kHz to 16kHz.
h1lsc:
H1:LSC-REFL_A_RF9_I_ERR_DQ datarate change from 2048 to 16384
h1ascimc:
H1:IMC-WFS_A_DC_PIT_OUT_DQ datarate change from 2048 to 16384
H1:IMC-WFS_A_DC_YAW_OUT_DQ datarate change from 2048 to 16384
I did not restart these models to load the new DAQ configuration, instead I pressed the "DAQ LOAD" button on the models' GDS_TP screen. A DAQ restart was required.
WP11299 Restart h1isietmx to test new SDF safe.snap
Jim, TJ, EJ, Dave:
The h1isietmx model was restarted using Jim's new safe.snap file. The original safe.snap was missing some channels, which was also the case for h1isiitmx and was discovered last Sunday's model restart.
The new safe.snap was found to be good.
One point of interest is that the SDF MEDM reports 3047 set point channels, and the safe.snap file has 3506 channels in it. EJ explained that for each filtermodule, the SDF combines the two switch channels (SW1S, SW2S) into one (SWSTAT). There are 459 filter modules in this model, and the maths works out 3047+459=3506.
WP11290 h1hwinj1 revert LALAPPS back to original version
Erik, Jonathan, Dave:
This turned out to be much more involved than originally thought due to dependencies. We were not able to perform the reversion during maintenance.
I did restart psinject on h1hwinj1 during maintenance to reset the memory usage to 7%.
WP11304 Temporarily remove INJ_CW GAIN/TRAMP channels from h1calinj SDF
Dave:
As a temporary measure while we are running the memory-leaking LALPULSAR, I stopped the monitoring of the INJ_CAL_GAIN and INJ_CAL_TRAMP from h1calinj's SDF.
This will give us the ability to restart psinject and not knock H1 out of observe while doing so.
WP11291 Update tzdata on h1guardian1 to extend leapseconds officially
Jamie, Erik, Dave:
The tzdata package was updated on h1guardian1, which installed the "official" /usr/share/zoneinfo/leapseconds file and replace my hand-edited one.
The only issue was that apt-get recognized there was a local edit and did not overwrite it, but neither did it report this or give us the option to overwrite it.
The solution was to restore the original file, and then "apt-get reinstall tzdata" to force the install.
Model and DAQ restarts, model reloads
Dave:
Tue11Jul2023
LOC TIME HOSTNAME MODEL/REBOOT
09:38:28 h1seiex h1isietmx
11:24:58 h1lsc DAQ LOAD
11:25:24 h1ascimc DAQ LOAD
11:27:34 h1daqdc0 [DAQ] <<< DAQ Restart for h1lsc and h1ascimc INI changes. 0-leg
11:27:45 h1daqfw0 [DAQ]
11:27:45 h1daqtw0 [DAQ]
11:27:46 h1daqnds0 [DAQ]
11:27:54 h1daqgds0 [DAQ]
11:31:49 h1daqdc1 [DAQ] <<< 1-leg
11:31:57 h1daqfw1 [DAQ]
11:31:58 h1daqnds1 [DAQ]
11:31:58 h1daqtw1 [DAQ]
11:32:06 h1daqgds1 [DAQ]
11:32:54 h1daqgds1 [DAQ] <<< GDS1 second restart
Late restart of opslogin0
Erik, Jonathan, Dave:
We did a late restart of opslogin0 at 15:02 to clear some memory and do a minor OS upgrade.
Three items visible on the CDS Overview went down during the reboot:
1. CDS-HW IOC stopped and automatically restarted
2. WAP IOC stopped and was manually restarted
3. CDS_NOMACHINE_IOC stopped and did not get automatically restarted. We had not seen this fail before, it was manually restarted today and Erik is investigating.
2+3 caused the EDC to disconnect from 20 channels.
H1 was in observe throughout.
DAQ CHANGES:
[channame, bytes-per-sample, data-rate-Hz]
was:
H1:IMC-WFS_A_DC_PIT_OUT_DQ 4 2048
H1:IMC-WFS_A_DC_YAW_OUT_DQ 4 2048
H1:LSC-REFL_A_RF9_I_ERR_DQ 4 2048
is now:
H1:IMC-WFS_A_DC_PIT_OUT_DQ 4 16384
H1:IMC-WFS_A_DC_YAW_OUT_DQ 4 16384
H1:LSC-REFL_A_RF9_I_ERR_DQ 4 16384
Locklost tool seems to have failed on this analysis. Looking at the LSC and ASC scopes, PRCL IN maybe seems to move first, but tought to say. Other than that, I'm not seeing much.
Violins damped somewhat quickly. I applied more gain to a few modes to help them damp faster, then brought their gain back after we got to low noise.
Lock acquistion was completely automated, aside from me adding extra gain to speed things up.
HAM6 floor accelerometer reported as not working, alog 71133. Cable located in CER connected to the new LIGO accelerometer chassis, channel 12. Other end of cable located on east door of HAM6. Cable previously repaired, short found in cable by HAM6. Cable cut a few feet to eliminate the short. New cable length does not reach the HAM6 floor accelerometer. A short patch cable will be made and installed next Tuesday.
A short patch cable was installed to extend cabling to the HAM6 floor accelerometer. In the CER the accelerometer is connected to the LIGO accelerometer chassis, channel 12.
Mounting brackets for the fiber patch panel in the LY vacuum rack were reinstalled. They were removed at the start of O4 to allow the front door to close properly, see alog 70200. Modifications needed to relocate the mounting brackets. Patch panel screwed back to rack.
Maintenace has completed and Oli has already ran an initial alignment (fixed!). Jim did a LVEA sweep. We are continuing to lock now.
Almost back to low noise, but we are damping violins now.
Per WP11286 in response to ALOG70818
We installed the spare S1302233 Baffle PD Amplifier directly below the installed Baffle PD Amplifiers into SUS R5 in the Biergarten. ITMX is S1400066 and ITMY was S1400065 but we swapped functionality to the spare we just mounted below it (this rack is mostly empty).
If there are issues with the spare we can immediately swap functality back to the old unit. If the spare fixes the issues, we will recover the old unit and perform a post mortem. As there was no laser light during install we could not verify functionality while on the floor.
M. Pirello, F. Mera
We seem to see some signal on this pd now, unlike before. Interestingly, the pd seems a fair amount of light during the ISC_LOCK state of Move_Spots. Clearly we are moving through a place with high scatter, best to avoid.
I pulled the ITMY Baffle PD Amplifer S1400065 and moved the replacement S1302232 up to occupy positions 11 & 12 to the right of the ITMX Baffle PD Amplifier. Post mortem on S1400065 showed that one of the internal cables was loose, this has been fixed and all cables pull tested. S1400065 has been included in the spares inventory.
This completes WP11286