TITLE: 05/31 Eve Shift: 23:00-07:00 UTC (16:00-00:00 PST), all times posted in UTC
STATE of H1: Observing
SHIFT SUMMARY:
LOG:
Lock#1:
Lock #2:
TITLE: 05/31 Owl Shift: 07:00-15:00 UTC (00:00-08:00 PST), all times posted in UTC
STATE of H1: Observing at 130Mpc
CURRENT ENVIRONMENT:
SEI_ENV state: CALM
Wind: 6mph Gusts, 4mph 5min avg
Primary useism: 0.02 μm/s
Secondary useism: 0.12 μm/s
QUICK SUMMARY:
IFO is in NLN and OBSERVING (and has been for 2 hours)
Closes FAMIS 19660, last done in 69690.
BSC CPS:
EX ST1 noise much lower than last week.
HAM CPS:
All look nominal. Seem to have lower low freq noise and sharper 12Hz peaks comapred to lask week.
Closes FAMIS 17559, last done 69145.
Trends attached, both look normal.
After 2h44m in NLN with some violin damping changes (70020), we lost lock at 01:07UTC. Cause unknown, DCPD saturation at time of lockloss.
Went though an initial alignment, still had trouble at DMRI/PRMI locking but think I've jut tracked it down to sam SRC issue TJ/Sheila found earlier 70013, see attached to compare this afternoons successful and recent attempt.
Using to rotation for IFO locking help sheet, I contacted Jenne, who helped me see that SRM was not well aligned during initial alignment, thank you Jenne! We requested ALIGN_IFO to ALIGN_SR2, OFFLOAD_SR2_ALIGNMENT (this only moved SR2 ~3urad) and then paused in AQUCIRE_SRC and moved SRM a lot (~150urad) in Yaw to get AS_A_DC_NSUM flashes higher. This appears to be the same issue Austin found in FRS 26873.
Now have DRMI locked and moving up!
Symptoms for SRC not really being locked during INITAL_ALIGNMENT: AS_A and AS_B NSUM flashes are small see (attached LSC > LOCKING > Init align Scopes > IR Scopes of not really, and really locked), also AS_AIR camera flashes look strange, SRM saturating.
H1dmtlogin is showing some disk errors. It is older hardware, and will be replaced. Today Erik and I racked a new server up. I updated a puppet config for h1dmtlogin. It will be replaced tomorrow morning when we are allowed by the control room.
Since we've changed the ETM ring heaters, the Jitter cleaning needed to be retrained. Also, since jitter is the only one that's doing any cleaning right now, all the others also need to be retrained.
I used a time from over the weekend when the IFO had been online for ~9 hours, so plenty thermalized. With some suggestions from Gabriele, I retrained the Jitter subtraction and the Laser noise (high frequency) subtraction. I hope to try these out during the next time we have a short commissioning window (perhaps tomorrow afternoon, in coordination with LLO).
Attached are the offline results for Jitter and Laser noise.
Note to self, the Jitter noise is even better with the N_SOS=16 that Gabriele suggests, but implenting that would require a restart of the h1oaf model, so this is with N_SOS=8.
The offline subtraction of noises that come from the h1bos model is not quite working right now. This means that I cannot subtract the main LSC noises, MICH and SRCL, until that's figured out. I can (and should) train PRCL, since that one is on the h1oaf model, and not modulated. This may also be motivation to first do a linear subtraction of MICH and SRCL (in addition to PRCL), and let the bilinear h1bos model do less work.
Also, Jennie pointed out that there has recently been a big noise bump around 120 Hz, apparently since about May 27th. If you look at the offline Jitter cleaning, it's well witnessed by the jitter witnesses (IMC WFS A DC pit and yaw). Hopefully the online implementation of the cleaning does as well as the offline....we'll check tomorrow.
As Ryan C notes in alog 70003, "IX12 & IY8 damping have changed phase, a negative gain damped IX12 down (-2, max of -4) instead of the +2 its set to in lscparams. IY8 also was rising, I changed its gain sign from 0.08 to -0.08 and it started to fall".
Both these modes have been falling well since but our troublesome ITMY Mode5/6 pair have been slowly rising. See attached. I first suspected the IY8 phase change could be causing this to turned the IY8 damping off for 20 minutes. IY8 stopped damping but IY5/6 continued to rise. I've now turned off the mode5 damping, will see what effect this has as I'm worried about adjusting it's phase.
ITMX: On Sunday 28th, Tony notes IX12 is ringing up 69972. Since then, operators have changed gain from +2 to -2 by hand (69973, 69994, 70003). I've updated this in lscparams but cannot reload violin damping until we are out of observing.
ITMY: On Monday 29th, Tony notes IY5, IY6, IY8 are ringing up 69991. He turned off the IY5 gain as I did, this stabilizes them but doesn't damp the modes. I've added this into lscparams to avoid ringing these up until we find damping that works. Plot of IY5/6 today attached. Tony turned IY8 gain to 0 but Ryan C found that -0.08 damps well so I'll add that to lscparams too.
We lost lock and I reloaded VIOLIN_DAMPING guardian so these lscparams changes (IX12 +2 to -2; IY5 +0.01 to 0, IY8 +0.08 to -0.08) will be in the guardian.
Y2-8
Solar panels are mostly clear and in good condition, all cables are good.
Each battery was checked with a multimeter:
Top battery 13.21 VDC
Bottom battery 12.93 VDC
The LCD readout at the charge controller showed for both batteries 26.10 VDC, measured with clear skies.
X2-8
Solar panels are mostly clear and in good condition, all cables are good.
Each battery was checked with a multimeter:
Right battery 14.66 VDC
Left battery 14.82 VDC
The LCD readout at the charge controller showed for both batteries 29.60 VDC, measured with clear skies.
FAMIS task 22072
TITLE: 05/30 Eve Shift: 23:00-07:00 UTC (16:00-00:00 PST), all times posted in UTC
STATE of H1: Observing at 124Mpc
CURRENT ENVIRONMENT:
SEI_ENV state: CALM
Wind: 11mph Gusts, 8mph 5min avg
Primary useism: 0.03 μm/s
Secondary useism: 0.12 μm/s
QUICK SUMMARY: Locked and in Observing for 45minutes.
Ryan/TJ notes that if we loose lock it's expected we'll need to do an initial alignment (but watch SRY locking 70013), due to continuing temperature changes. Ryan has had to touch PRM, BS during PRMI locking alog70003.
TITLE: 05/30 Day Shift: 15:00-23:00 UTC (08:00-16:00 PST), all times posted in UTC
STATE of H1: Observing at 124Mpc
SHIFT SUMMARY:
Lock#1:
Started off with an initial alignment after seeing some drifting on the OPLEVS, & OSEMS (esp. SR3 pitch, which seem to drift a large amount for only 4 hours). There doesn't appear to be a clear temperature correlation?
Both arms went through increase flashes, Yarm went smoothly and locked at a high 90%, Xarm struggled a bit and took more than twice as long, I tapped ETMX in pitch 0.3 microrads and it was enough for it to catch after it finished increase flashes and was still struggling on ENABLE_WFS. Good beatnotes, -4.5 (X) & -6 (Y).
SRM was badly aligned, after lots of SRM saturations and the ASC-AS_A signal was low (~2 instead of 4/5) I paused INIT_ALIGN and brought ALIGN_IFO to offload SR2 then I went to PREP_FOR_SRY and adjusted SRM mostly in pitch to make AS_AIR more symmetrical and to get higher highs, and lower lows on the H1:ASC-AS_A_DC_NSUM_OUT16 trace. I then unpaused INIT_ALIGN and rerequested SRC_ALIGN which went smoothly the 2nd try.
Lost it at FIND_IR, Yarm looked a little glitchy then it lost it
Lock#2:
Lost it at FIND_IR again, it seems like Yarm is killing it?
Lock#3:
Lost it at LOCKING_ALS, Yarm again I think
Lock#4:
COMM IR was found pretty easily, DIFF took a while, went through PRMI got it, took a little while for it to get DRMI despite good looking flashes.
Lockloss at MOVE_SPOTS 20:57, DCPD saturation right beforehand
Lock#5:
Couldn't get DRMI went through PRMI again, I had to tap PRM in pitch to catch, then in DRMI_1F I adjusted the BS in pitch
Had to stop at OMC_WHITENING for the violins to damp, IX12 & IY8 have changed phase, a negative gain damped IX12 down (-2, max of -4) instead of the +2 its set to in lscparams. IY8 also was rising, I changed its gain sign from 0.08 to -0.08 and it started to fall - Tagging SUS
Aquired NLN at 22:25UTC, we had to wait for ADS to converge for the CAMERA_SERVO as usual and some SEI SDF diffs to be checked
In Observing at 22:39UTC
DARM was glitching out a bit around 22:55 on the FOM
LOG:
| Start Time | System | Name | Location | Lazer_Haz | Task | Time End |
|---|---|---|---|---|---|---|
| 15:02 | FAC | Tyler+Sierra | CS | N | Infloor smoke detectors | 17:10 |
| 15:08 | FAC | Chris+Contractors | LVEA | N | Vinyl work | 18:46 |
| 15:09 | FAC | Kim | EndY | N | Technical Cleaning | 16:11 |
| 15:12 | FAC | Tyler+Johnson | EndY | N | FIre alarm testing | 16:09 |
| 15:21 | VAC | Jordan | EndX | N | Set up a pump, cp8 | 16:15 |
| 15:43 | VAC | Travis | EndX | N | Purge air compressor | 17:31 |
| 15:48 | FAC | APS | CS | N | Door access, FCES, High bay | 18:45 |
| 15:48 | EE | Fill | Ends | N | HEPI cabling, rack temps | 18:51 |
| 15:58 | CDS | Erik | CS | N | ADC card work, h1seih16 | 16:42 |
| 16:10 | FAC | Tyler+Johnson | OSB, Mids | N | Fire alarm tests | 22:00 |
| 16:12 | FAC | Kim | EndX | N | Quick checks, Garb check | 16:49 |
| 16:29 | FAC | Betsy | LVEA | N | Container checks, noise checks | 16:44 |
| 16:37 | CDS | Johnathan | MSR | N | DMT work | ?? |
| 16:00 | SEI | Jim | REMOTE | N | ISI BLND work | 17:22 |
| 16:50 | FAC | Kim | LVEA | N | Technical cleaning | 19:01 |
| 16:58 | VAC | Jordan, Gerardo | LVEA HAM5 | N | FTIR sample | 17:40 |
| 17:08 | FAC | Cindi | LVEA | N | Tech clean | 18:43 |
| 17:20 | FAC | Christina | OSB | N | Recycling items | 17:40 |
| 17:44 | VAC | Gerardo | Arms, Y2-8, X2-8 | N | Solar panel checks | 18:51 |
| 18:29 | FAC | Chris | LVEA | N | Check with vinyl crew, and pest traps | 19:01 |
| 18:32 | FAC | Betsy | LVEA | N | Sweep | 18:39 |
| 18:39 | VAC | Jordan | EndX | N | Turn off pump | 19:02 |
| 18:40 | FAC | Richard | LVEA | N | Check with APS | 18:46 |
| 20:15 | VAC | Jordan & Travis | MidX | N | Set up a pump | 20:35 |
| 21:00 | EE | Fill | MidY | N | Parts | 21:38 |
I'm not fully sure that it's meaningful, and I've let Betsy and TJ know since they're doing a deeper dive into our temperatures and suspensions, but it seems that today (~5 hours ago, while we were unlocked) we had more motion around the microseism for several of our optics, including all 4 quads for some of their top mass degrees of freedom. However, the BLRMS of our microseism don't seem to have increased by the ~order of magnitude that some of these suspension degrees of freedom seem to have moved. I don't have any evidence that this is related to our locking difficulties, but it seemed worth writing down.
Arnaud just pointed out to me that several of the oplevs on the summary page (including SR3 and ITMX, for example) all see this increased motion, and it was for a finite duration of time. So, probably unrelated to our locking difficulties, and just a result of temporary excess ground motion (perhaps the road construction, as TJ conjectured?). EDIT: Arnaud again to the rescue, it's not motion seen in the ground seismometers (which is consistent with the lack of elevated motion in the BLRMS). So, some other maintenance-related activity.
So, my plots of elevated motion are just a case of a poorly chosen time of day (I was looking for a time when we were DOWN, to make an easier-to-interpret set of plots to check for rubbing). Thanks Arnaud!
We've been having issues during initial alignment with the ALIGN_IFO node falsely convinced that SRY is locked when SRM is actually very misaligned. This was due to the SRCL trigger turning on too early (see H1:LSC-SRCL_TRIG_MON). Sheila and I looked at the LSC SRCL trig thresholds and decided to bump these up to ON:0.3 OFF:0.2 (last two changes of this - alog54799 and alog63678). I also added a trigger delay of 0.5s since it seems to flash above this threshold even at times that we are very misaligned. This trigger looks at the POP A DC signal, so we aren't sure why the amount of light has changed on this PD. These settings worked for the one time we tried it with a well aligned SRM, so we should keep an eye on it the next few times we do alignments.
This second alog63678 reminds future us that we should recommission SRY to use the AS WFS rather than the REFL WFS. I'll remind future, future us the same thing.
Had this issue again. Described with symptoms in alog 70028.
I've bumped the trigger thresholds up a bit more as it still was triggering for very poor alignments. Looking back over the last week or two as a reference I changed enable threshold to 0.35 and the disable at 0.23. During an initial alignment this morning I tried it out by heavily misaligning SRM by ~70urads to check trigger values, then I brought it back. All seemed good. These values are loaded into ALIGN_IFO and committed to the svn.
I lowered the FC-ASC TRIGGER THRESHOLD's ON value from 0.8 to now 0.7, since it hadn't been triggering on during Friday's locks (trends). I noticed because the green beam spot on the FC green trans camera was clearly off from normal. This FC trans trigger was first setup in LHO:68587, where it said the trigger_on threshold was 0.6 -- but it was 0.6 for < 24 hours, then changed to 0.8, where it's been since. I have SDF'd the trigger_on threshold as 0.7.
Also, ISS tripped off again, so I reset it. From the SQZ_OPO_LR guardian, I requested "LOCKED_CLF_DUAL_NO_ISS" (which turns off ISS and resets lockloss counter), then requested "LOCKED_CLF_DUAL", so the guardian turns on ISS again. Sheila just did this a couple days ago 69890, but I didn't change the ISS setpoint this time. I think this is happening related to SHG output power drifts, we could check the on-table pump aom alignment. We shouldn't be driving the aom this marginally given the SHG power output and ISS setpoint, we used to be driving ~4-6V to maintain this trans power given even lower SHG output powers, and now we're driving often around 2-4V, so ISS is often in a marginal wayn now compared to before.
At the start of the 05:07UTC lock, Vicky realized the FC beamspot was not in the correct location on the camera so lowered FC_ASC the threshold further from 0.7 to 0.5. Accepted in sdf.
We decreased the OPO TEC temperature while maximizing CLF_REFL_RF6, see attached. We expect this needs changing more with the LVEA temperature fluctuations. Vicky noticed this needed to be done as WFS_A_Q wasn't low enough and RFL_QPD_A_SUM was lower than normal. See attached SQZ scopes at time of FC ASC turn on and OPO temperature improvement.
Jennie W, Sheila D, Jeff K
In order to get an understanding of output losses to understand why we are not getting the level of squeezing we expect I ran craig's scripts to step the DARM offset. Instead of measuring PCAL line heights on DCPD_SUM at each step we will look at these line heights on OMC REFL.
As this PD is much noisier than DCPD I had to do some tuning of the PCAL lines we use. Since we have limited measurement time and the IFO was still at MAX POWER, Sheila suggested we spend some time tuning the line heights to use in the measurement.
By this point we were waiting for violin modes to damp while in the OMC_WHITENING STATE.
original PCAL EY and EX values are first image.
I ran set_up_pcal_for_darm_offset_test.py. Originally this uses:
PCALX 255Hz 40000 counts
PCALY 410.3Hz 40000 counts
but this did not give us the correct resolution on OMC REFL for the higher frequency of the 2. Neither OFS PD was saturated.
See Ref0 (4th image attached) for the OMC REFL spectrum with these settings.
I manually stepped up the 410.3Hz line in ampltiude (on PCALY PCAL_END screen to 48 000 counts at which point the OFS PD saturated. Following Jeff's instructions I turned off the loop_enable switch on the PCAL_END screen for PCALY, changed the amplitude down to 46000 and swtiched the loop back on. OFS no longer saturated.
see Ref1 (5th image attached) for new OMC REFL spectrum. This still does not give a good SNR.
I then switched off the OSC_SUM_MATRIX (ie. the output) and changed this line to 11.5Hz at an amplitude of 40000 counts. This does not saturate the OFS PD.
See Ref 2 (6th image attached) for the OMC REFL spectrum.
The IFO moved to NLN and this did not change the PCAL settings I had on.
The third image attached shows the PCALEX and EY settings we used for the DARM offset measurement.
I then ran DARMOffsetStep.py starting at GPS 1368922456 to step the DARM offset.
Jeff reset the PCALEY and EX values using sdf.
xml from tuning measurements is in /ligo/home/jennifer.wright/git/OMC_mode_matching/2023-05-23_DARM_offset_meas.xml
Code is in /ligo/gitcommon/labutils/darm_offset_step
DARM offset results are in data/darm_offset_steps_2023_May_24_00_13_58_UTC.txt
Stay tuned for processed measurements.
Jennie W., Sheila D.
After using an adapted version of Craig and Dan's code to do the analysis I have plotted optical gain (as measured at the OMC REFL PD) while DARM offset is stepped vs. power on the OMC DCPDs, shown in first plot.
The optical gain is determined from the line height of two PCAL lines as measured on the OMC REFL PD, 11.5Hz and 255Hz, unfortunately we were trying to get the measurement done quickly and so did not notch the lower frequency one out of the DARM fb loop.
This plot can be thought of as light rejected by the OMC vs. light passing through the OMC.
We did not get the parabola we expected from this (ignore the fit line).
The second plot is the same optical gain against DARM offset in counts.
Looking at the ndscope of the time series during this measurement (first screenshot), it can be seen that there is a marked upward trend on the PD, presumably due to the fact we started this measurement during OMC whitening so we had not been locked for long and the light on the PD increases with thermalisation in the arms.
The second screenshot shows the noise spectra after the measurement.
Plots are in /ligo/gitcommon/labutils/darm_offset_step/figures/plot_OMC_REFL_vs_dcpd_sum/
data is in /ligo/gitcommon/labutils/darm_offset_step/data/darm_offset_steps_2023_May_24_00_13_58_UTC.txt & darm_offset_steps_2023_May_24_00_13_58_UTC.pkl,
code is in /ligo/gitcommon/labutils/darm_offset_step/plot_OMC_REFL_vs_dcpd_sum.py,
Screenshots are in jennie.wright/git/OMC_mode_matching.
Summary: We can't get anything useful out of this measurement without a quieter PD. Maybe we can get the same info a different method. Also why is the OMC REFL PD so noisy?