Jennie, TJ, Camilla
The Operator team has been seeing more locklosses at state 557 TRANSISITON _FROM_ETMX, more so when the wind is high. Times: 1397719797; 1397722896; 1397725803; 1397273349, 1397915077
Last night we had a lockloss from 558 LOWNOISE_ESD_ETMX with a 9Hz ITMX L3 oscillation, see attached. Compare to a successful transition (still has glitch).
Note that there is a glitch ~30s before state 558 in both cases. H1:SUS-ETMX_L3_DRIVEALIGN_L2L and _L3_LOCK_L filter changes happens here. Are ramp times finished before these changes?
The timing of the glitch is 2 m 55 seconds after we get to state 557, this is the same time as in the 4 of the last 6 state 557 locklosses.
Louis, Camilla. Investigations ongoing but the timing of this glitch is suspiciously when the H1:SUS-ETMX_L1_LOCK_L gain and filters are changed, tramp is 1secinds but FM2 and FM6 foton filters have a 3 seconds ramp. There is an INPUT to this filter bank before the gain and filters are turned on. Plot attached.
In 77640 we show that the DARM1 filter change is the cause of the glitches/locklosses.
I've added a test to Verbal Alarms that will notify when the PSL chiller is "alarming," which most likely means the chiller's water level is low. This is being added on top of the already existing DIAG_MAIN notification for the same event. When the H1:PSL-LASER_CHILLER1_ALARM channel flips to 1, Verbal Alarms will say "Check PSL chiller," then wait four hours before saying it again if the alarm channel has flipped again since then. The reasoning behind this is that the chiller can run for a while (unsure of exactly how long, but past examples have shown the alarm running for up to almost 24 hours) before it will actually turn off, taking the NPRO and amplifiers down with it.
If operators receive this warning, they can relay the message to anyone on the PSL team or refill the reservoir themselves if on a weekend, making sure to note how much water was added.
EY dust monitor pump 0715002111 failed. Replaced with 11001311. The pump that failed was left at the end station to cool down. I will retreive and fix the pump next Tuesday.
Ex and corner station pumps running smoothly and within temp range.
Nick, Robert, Mike In December of 2023, Atlas Agro, who plans on building a fertilizer production plan that is net carbon neutral on DOE land, made some test seismic noise by dropping a 1600-lb block into an excavated hole. Atlas Agro made nearly 100 test drops. I was asked to see if any of the seismic noise appeared on any of our seismometers. I have been working with Robert Schofield, and have not seen any of the seismic noise. I have attached a DCC link that contains a PDF with some of the time series of the drops and includes links to the rest of the time series. https://dcc.ligo.org/LIGO-T2400124
Jennie W, Camilla
Today Camilla and were trying to move around the IM1 and IM2 mirrors in turn and try and clip the beam going through the Faraday Isolator to see how centred we are.
Details in a log from Camilla.
As part of this we need to make a move with either IM1 or IM2 and bring the beam back onto the centre of IM4 TRANS with IM3 pitch or yaw moves.
Jenne had the idea we could use a DC centering loop to speed this up by moving IM3 for us.
We used the DC7 centering path after trending the outputs of this back to make sure it was not used during locking or in nominal low noise - checked back at least 70 days and the outputs were zero.
I checked the DC1 centering loop filters and copied over the three that are on during lock for both yaw and pitch into the DC7 foton files, putting all three filters in place of the FM2 module (previously called OFF and having a value of gain(0)) in ASC.adl DC7_P and DC7_Y.
Then we altered the ASC input and output matrices so that DC7 takes IM4 TRANS QPD as an input and moves IM3 to centre on this.
We tried different gain up to +/-50 in the yaw loop but never managed to make the yaw of IM4 TRANS converge to zero.
After talking to Sheila we realised that the DC1 loop servo will not match the plant of the IM3 suspension so to use this for IM moves we would have to put more thought into the filters.
NB: My changing and saving of the ASC.txt foton file led to some confusion with Dave B. et al. who were trying to track down a rounding error in the DHARD filter in the same fofon file. But this has been resolved.
There was an increase in space temperature at End X, which is evidenced in the trend. This increase was due to our disabling the fans for quarterly greasing. Initially, the air handlers were configured to raise their supply air set points when in Start-Up mode; this mode occurs whenever the program loses fan status, such as during unoccupied periods, so that upon start-up, the system is not overloaded trying to pull the supply air temperature down as fast as possible. Since the only time the fans are theoretically off is when we grease them, which only takes thirty seconds, there is no need to gradually reduce supply air temperature. I have changed the Start-Up supply air temperatures at EX and EY from 61 to 55, which is roughly the supply air temperature the air handlers normally produce. This should reduce any space temperature increases after quarterly greasing tasks.
Cabling between BSC3 and BSC7 now supported by a cable tray. See attached picture. Cabling previously held in place by zip ties and velcro. Concern if zip ties failed, vacuum piping on GV2 could be damaged. Good catch by the vacuum team.
During installation of cable tray, found that both SUS-R5 and SUS-R6 racks were not grounded. After discussing with Robert/Richard, we decided to ground the racks. Robert will compare before/after once we reach NLN.
If grounding of racks needs to be reverted, the 6 awg grounding cables can be disconnected at each rack.
While investigating the signal on the Y Manifold Cryo Acclerometer, we found that the power conditioner module was not functioning. We moved the signal to a spare channel and verified that the rest of the signal chain is working.
Robert wants to get the LigoCam software working before we make any other changes to the PEM system, so we are holding off on replacing the channel.
The Y Manifold Cryo Accelerometer signal input and output was moved from S2300063 Channel 15 to S2300065 Channel 15 (one chassis down)
I placed a rubber BNC cover on the bad channel to mark it for repair once we get the green are sure the LigoCam software is working correclty.
The LVEA was swept by Camilla, she will add notes.
Relocking has started.
As last week 77210, the Faro is staying plugged in. Robert still has some PEM things plugged in (speaker near +X arm and some electronics in the CER).
The SR785 Ethernet cord is plugged into the PSL rack but powered off.
I unplugged an unused extension cord and turned the lights off.
Jennie, Jenne, Keita, Camilla
Following 76883, we repeated by moving IM1 Pitch and Yaw then IM2 Pitch and Yaw in turn and recentering the beam on the IM4 TRANS QPD using IM3. Went in both directions until we either saturated the suspension or starting clipping on the Faraday.
Results: We are not close to clipping FI so reverted the alignment to the original (though TJ said these IMs can have hysteresis).
Steps taken:
Minhyo, Sheila
Changed the gain values of the RANGE BLRMS's filters (RLP_1 ~ 7) at 17:48:44 (UTC).
I referenced the accumulated BNS range in Apr.-11 and Apr.-17, to reverse calculated the additional factors for the filter gains (1/BNS = scope * factor).
The New gain values are defined as (Prev. gain) * (Avg. Factor).
Attached three screenshots are; 1) Accumulated BNS range plot, 2) Factor calculation, 3) H1OAF.diff after made all changes.
Tue Apr 23 10:11:09 2024 INFO: Fill completed in 11min 5secs
Karmeng, Camilla. H1:SQZ-SHG_FIBR_REJECTED_DC_POWERMON power was high. Adjusted the 1/2 and 1/4 waveplate to reduce rejected power from 0.3 to 0.03. Instruction
Vicky questioned if we need to realign the pump AOM /SHG fiber eg.74479.
With the OPO guardian DOWN, OPO REFL DC POWER is 2.26V, our max is around 2.9V 75270.
We should plan on realigning AOM and fiber next week.
WP11816 Add CAL GDS_HASH channel to DAQ and GDS Broadcaster
Jamie, Erik, Jonathan, Dave
A new channel, H1:CAL-CALIB_REPORT_GDS_HASH_INT, as added to the cal_hash_ioc EPICS IOC. It was added to the DAQ via EDC, and also added to the DAQ GDS-Broadcaster for transission to GDS.
The new channel is being monitored by the CDS SDF.
WP11821 New h1asc model
Jeff, Dave:
We installed Jeff's new h1asc model. DAQ restart was required for the addtion of 4 slow chanels.
WP11822 FMCS STAT upgrade
Erik, Dave:
Erik installed new FMCS STAT code. This also added new channels to the DAQ, requiring a DAQ+EDC restart.
DAQ Restart
Jonathan, Dave:
Jonathan made the recent GDS Broadcast channel additions permanent in puppet and regenerated the GDS channel lists.
We restarted the DAQ and EDC for the above changes. No issues with this restart.
One issue I found with the h1asc change is that the gain for the ASC_DHARD EC20Hz filter changed at the 15th decimal place. I followed my standard procedure of ensuring H1ASC.txt was committed to subversion, did the 'rtcds install h1asc' which modifies the filter file header block, then corrected this by running 'foton -c H1ASC.txt'. After this the only svn diff in the file is the gain change
-ASC_DHARD_Y 7 12 5 10240 0 EC20Hz 4.246651939748587456513462e-01 -1.9976820160389552 0.9977451970061935 -1.9973471518970052 0.9974295203382628
+ASC_DHARD_Y 7 12 5 10240 0 EC20Hz 4.246651939748589676959512e-01 -1.9976820160389552 0.9977451970061935 -1.9973471518970052 0.9974295203382628
Tue23Apr2024
LOC TIME HOSTNAME MODEL/REBOOT
08:00:38 h1asc0 h1asc <<< New asc model
08:05:00 h1daqdc0 [DAQ] << 0-leg restart
08:05:13 h1daqfw0 [DAQ]
08:05:13 h1daqtw0 [DAQ]
08:05:14 h1daqnds0 [DAQ]
08:05:22 h1daqgds0 [DAQ] <<< new BROADCAST ini
08:05:27 h1susauxb123 h1edc[DAQ] <<< EDC for cal_hash and fmcs_stat changes
08:11:21 h1daqdc1 [DAQ] <<< 1-leg restart
08:11:31 h1daqfw1 [DAQ]
08:11:32 h1daqtw1 [DAQ]
08:11:33 h1daqnds1 [DAQ]
08:11:59 h1daqgds1 [DAQ] <<< new BROADCAST ini
TITLE: 04/23 Day Shift: 15:00-23:00 UTC (08:00-16:00 PST), all times posted in UTC
STATE of H1: Idle
OUTGOING OPERATOR: Oli
CURRENT ENVIRONMENT:
SEI_ENV state: MAINTENNANCE
Wind: 5mph Gusts, 3mph 5min avg
Primary useism: 0.01 μm/s
Secondary useism: 0.10 μm/s
QUICK SUMMARY: IFO lost lock a few hours ago and has been losing lock around transition to ETMX even though it isn't windy. I've put it into IDLE since maintance activities have already began.
Workstations were updated and rebooted. This was an OS package update. Conda packages were to affected.