TITLE: 12/28 Day Shift: 16:00-00:00 UTC (08:00-16:00 PST), all times posted in UTC
STATE of H1: Aligning
INCOMING OPERATOR: Oli
SHIFT SUMMARY:
Today's extremely high microseism has made it very difficult to lock all day due to a storm off of our western coast.
A few earthquakes are coming in making the problem worse.
I started another Initial alignment while an earthquake rolled through.
Everytime I get to MAX_POWER there is a lockloss.
So I have been trying to pause in Check_VIOLINS, so I can damp the ITMY before moving up to MAX_POWER.
H1 has just gotten up to Check Violins before power up. I have decided to try a violin setting of FM6 + FM10 at gain of -0.1 on ITMY Mode 5
This setting was found in the VIOLINS google doc, but it has actually made the ITMY mode 5 worse for the short time that I was watching it.
ITMY is by far the single largest Violin mode.
LOG:
| Start Time | System | Name | Location | Lazer_Haz | Task | Time End |
|---|---|---|---|---|---|---|
| 16:13 | VAC | Janos, Gerardo , Roger Mech | Mechanical | N | Vendor coming to work on Vac system | 20:13 |
| 17:28 | VAC | Gerardo | N2 Fill pipe | N | Chipping Ice off the overflow spout | 20:25 |
TITLE: 12/28 Eve Shift: 00:00-08:00 UTC (16:00-00:00 PST), all times posted in UTC
STATE of H1: Aligning
OUTGOING OPERATOR: Tony
CURRENT ENVIRONMENT:
SEI_ENV state: SEISMON_ALERT
Wind: 9mph Gusts, 8mph 5min avg
Primary useism: 0.05 μm/s
Secondary useism: 1.48 μm/s
QUICK SUMMARY: Currently in CHECK_VIOLINS_BEFORE_POWERUP and trying to damp violins at 2W. useism is very high.
Rogers Machinery technician was here starting at 8:10 am. Service to the compressor, 1 year maintenance work, was done by 12:00 pm.
Compressor ran for 0.25 hours at 11:40 to test/check systems. IFO was not locked during the compressor service.
Work regarding the Kobelco unit is now complete.
TITLE: 12/27 Day Shift: 16:00-00:00 UTC (08:00-16:00 PST), all times posted in UTC
STATE of H1: Aligning
CURRENT ENVIRONMENT:
SEI_ENV state: CALM
Wind: 11mph Gusts, 7mph 5min avg
Primary useism: 0.06 μm/s
Secondary useism: 1.60 μm/s
QUICK SUMMARY:
16:11 UTC Lockloss from Power_10W.
Trying an INITIAL_ALIGNMENT
Locking Attempt #1: Lockloss from LOCKING_ALS 17:31 UTC
Locking Attempt #2: Lockloss from LOCKING_ALS 17:33 UTC
Locking Attempt #3: Lockloss from LOCKING_ALS 17:36 UTC
Locking Attempt #4:
Holding in LOCKING_ARMs_GREEN for a fe minutes to see If I can let things settle down a bit more.
LOCKLOSS from LOCKING_ALS 17:42 UTC
Locking Atttempt #6: made it to FIND IR!!! Lockloss at AQUIRE_DRMI_1F
A hand full of locks have made it up to MAX_POWER! but then LOCKLOSS.
After several attempts to Lock, and several Locklosses at MAX_POWER, I've decided that perhaps waiting in CHECK_VIOLINS and damping at 2W before going to MAX power might be the trick to succesfully get past MAX_POWER. Since the Violins are very high.
19:15 UTC lockloss from MAX_POWER
max Move Spots & MAX_POWER.
Hanford Monthly Alert system, sirewns will be activate at 1pm (21:UTC) .
Got into Check violins before power up and paused here to reduce violins before moving to max power.
Edit: Damping the Violins did not help in any noticeable way.
There are two issues with nuc5 FOM:
1. Yesterday the picket fence code was not running and was restarted. The version started did not write its output to its EPICS IOC, which caused the yellow PKT circle warning on the CDS Overview. I have restarted the code with the "--epics" argument, the IOC's values are updating now.
2. The seismic dmtviewer is not updating. It appears to have stopped working Tue 19th Dec. I'm flagging this to DMT/GDS.
Wed Dec 27 10:07:13 2023 INFO: Fill completed in 7min 9secs
Gerardo, Richard, Dave:
Gerardo confirmed a good fill curbside.
Gerardo is removing the ice ball at the end of the discharge line which was causing erroneous readings. Currently TC-B is not giving a good value (~1300C). Today's fill ran with TC-A only.
I've temporarily bypassed TC-B's cell phone alarms while Gerardo is working on it.
Bypass will expire:
Thu Dec 28 10:19:24 AM PST 2023
For channel(s):
H0:VAC-LY_CP1_TE102B_DISCHARGE_TEMP_DEGC
H0:VAC-LY_CP1_TE102B_DISCHARGE_TEMP_DEGC_ERROR
Thermocouple wire for TC-B were spliced together with wire nuts, then some e-tape was used to cover both wire nuts. TC-B is now giving good temperature readings
Filed an FRS ticket to replace thermocouple, 30032
TITLE: 12/27 Day Shift: 16:00-00:00 UTC (08:00-16:00 PST), all times posted in UTC
STATE of H1: Aligning
OUTGOING OPERATOR: Ryan S
CURRENT ENVIRONMENT:
SEI_ENV state: CALM
Wind: 14mph Gusts, 9mph 5min avg
Primary useism: 0.05 μm/s
Secondary useism: 1.57 μm/s
QUICK SUMMARY:
When I walked in the IFO was locking it's self and in POWER_10W.
uSeism is very elevated.
Roger Mechanical showed up along with Gererdo & Janos to do some VAC work in the Mechanical room.
Lockloss: from LOWNOISE_ASC
Im gonna try to relock it since there was an Initial_ Alignment done this morning already.
H1 called for assistance this morning at 13:40 UTC when initial alignment was taking too long to finish following a lockloss at 12:15 UTC. Initial alignment was able to finish on its own without intervention; I suspect green arm alignment was taking a longer time than usual due the very high microseism. Following the initial alignment, H1 was able to lock up to MAX_POWER twice before losing lock. Since then, H1 has tried several times to relock and its current attempt is up to MOVE_SPOTS. I continue to suspect the very high microsiesm is to blame for H1's instability and locking troubles. Handing off to Tony for the day shift.
TITLE: 12/27 Eve Shift: 00:00-08:00 UTC (16:00-00:00 PST), all times posted in UTC
STATE of H1: Observing at 152Mpc
INCOMING OPERATOR: Ryan S
SHIFT SUMMARY: We are Observing and have now been Locked for 15.25 hours. Super quiet shift. Wind has picked up to 15-20mph over the past couple of hours, and the secondary microseism is really high - reading an average of 1.5 um/s in the z direction!
LOG:
00:00 Detector Observing and Locked for 7hours
Observing at 150Mpc and have been Locked for 11.5 hours. Quiet night with nothing to report
TITLE: 12/26 Eve Shift: 00:00-08:00 UTC (16:00-00:00 PST), all times posted in UTC
STATE of H1: Observing at 156Mpc
OUTGOING OPERATOR: Tony
CURRENT ENVIRONMENT:
SEI_ENV state: CALM
Wind: 10mph Gusts, 7mph 5min avg
Primary useism: 0.04 μm/s
Secondary useism: 1.01 μm/s
QUICK SUMMARY:
We are Observing and the detector has been Locked for 7 hours. Microseism is still very high but looks like it might be starting to lower a bit.
TITLE: 12/26 Day Shift: 16:00-00:00 UTC (08:00-16:00 PST), all times posted in UTC
STATE of H1: Observing at 22Mpc
INCOMING OPERATOR: Oli
SHIFT SUMMARY:
Since I last posted nothing of note has happned here.
Still locked, still Observing.
LOG:
I did a site sweep through the main buildings and took some pictures of the thermostats in the VPW.
STATE of H1: Observing at 154Mpc
CURRENT ENVIRONMENT:
SEI_ENV state: CALM
Wind: 8mph Gusts, 5mph 5min avg
Primary useism: 0.04 μm/s
Secondary useism: 0.94 μm/s
QUICK SUMMARY:
InLock Sus charge measurements likely caused the lockloss this morning. Though there was a PI message at the same time. but the PI didn't seem high enough to break a lock.
https://ldas-jobs.ligo-wa.caltech.edu/~lockloss/index.cgi?event=1387641172
Relocking started before 1600UTC.
16:45 UTC NOMINAL_LOW_NOISE reached and OBSERVING at 16:51 UTC
SQZ manager dropped us into commissioning at 17:22 UTC
Back to Observing at 17:24 UTC
N2 truck arrived at Y end around 17:34.
I missed the time that the N2 truck left. I believe it was shortly after 1900 UTC
The Temps in the in the VPW ranged from 66F to 73F. Im not sure what the correct range should be, but the one that read 73 was nearest the warmed server exhaust on that side of the room.
Attached is a plot of today's noisy events related to the LN2 delivery to the tank for CP7. Since the IFO was locked flagging the respective groups.
We lost lock during the SETUP step of ESD_EXC_ETMX, plot attached. ETMX_L3_DRIVEALIGN_L2L (bottom right) had an output but I don't think it should have as the feedback is on ITMX at this point and the excitation hadn't started yet. Should check this before next Tuesday.
ESD_EXC_ETMX log before lockloss:
2023-12-26_15:52:32.263999Z ESD_EXC_ETMX [SETUP.main] ezca: H1:SUS-ETMX_L3_DRIVEALIGN_L2L_TRAMP => 1
2023-12-26_15:52:32.264996Z ESD_EXC_ETMX [SETUP.main] ezca: H1:SUS-ETMX_L3_DRIVEALIGN_L2L_GAIN => 1
2023-12-26_15:52:33.394157Z ESD_EXC_ETMX [SETUP.main] ezca: H1:SUS-ETMX_L3_DRIVEALIGN_L2L_SW1S => 0
2023-12-26_15:52:33.645345Z ESD_EXC_ETMX [SETUP.main] ezca: H1:SUS-ETMX_L3_DRIVEALIGN_L2L => ONLY ON: OUTPUT, DECIMATION
Looking at a successful ETMX SETUP state, you can see that there is still a small time where ETMX_L3_DRIVEALIGN_L2L has an output, the IFO just survives the glitch. This happens when the gain is changed from 0 to 1 (to allow excitation through) but before the INPUT is turned off. I've swapped the order of these two lines and added a 1sec sleep between them to make sure that the input is turned off before the gain is ramped to 1. Edit has been saved and will reload during next commisioning period.
Tue Dec 26 10:04:53 2023 INFO: Fill completed in 4min 49secs
Trip was -60F for this fill, TCmins -63C,-57C
TITLE: 12/26 Day Shift: 16:00-00:00 UTC (08:00-16:00 PST), all times posted in UTC
STATE of H1: Lock Acquisition
OUTGOING OPERATOR: Ryan S
CURRENT ENVIRONMENT:
SEI_ENV state: CALM
Wind: 5mph Gusts, 3mph 5min avg
Primary useism: 0.04 μm/s
Secondary useism: 0.89 μm/s
QUICK SUMMARY:
When I first arrived the IN-Lock Charge measurements were running. I was hoping that it would finish with out locking but it did unlock itself before finishing. Relocking now.
TITLE: 12/26 Eve Shift: 00:00-08:00 UTC (16:00-00:00 PST), all times posted in UTC
STATE of H1: Observing at 157Mpc
INCOMING OPERATOR: Ryan S
SHIFT SUMMARY: We are Observing and have now been Locked for 14.5 hours.
Very quiet shift, with the only thing happening was that ITMY Mode 20 (aka narrower ITMY Mode 6) had started ringing back up slowly. It seems like during the first two hours that we had been locked, the ITMY 5 gain setting had helped ITMY20 settle down to around 4.06, and then over the next four hours ITMY20 continued decreasing at a lower rate of change from 4.06 -> 3.99. However, after this, ITMY20 started slowly ringing back up, and 4.5hours later was back to being above 4.06. During all of this, ITMY 5, 6, and 10 were still decreasing. I decided to try turning the ITMY5 gain to 0 to see what that would do, but that caused mode 5 to immediately start rising at a much faster rate than mode 20 had been before, so I turned the gain back on and they've all been decreasing again the past 3.5 hours.
LOG:
00:00 Detector Observing and Locked for 6.5hours
Observing at 155Mpc and have been Locked for 10.5 hours. Nothing to report.