ibrahim.abouelfettouh@LIGO.ORG - posted 16:26, Tuesday 03 October 2023 - last comment - 16:51, Tuesday 03 October 2023(73249)
OPS Day Shift Summary
TITLE: 10/03 Day Shift: 15:00-23:00 UTC (08:00-16:00 PST), all times posted in UTC
STATE of H1: Lock Acquisition
INCOMING OPERATOR: Austin
SHIFT SUMMARY:
IFO is LOCKING (as of 22:46 UTC)
Notable Activities and Events Regarding Control Room and Tuesday Maintenance Tasks
- 15:22 UTC
- Sei Configuration to Sensor Correction Off
- 15:22 UTC
- Hepi HAM1 Watchdog tripped
- 15:35 UTC
- Turned IX to Safe
- Sei_IX to ISI_Offline_Hepi_On
- 16:18 UTC
- ISI IY Stage 1 Watchdog tripped
- ISI IY Stage 2 Watchdog tripped
- 16:30 UTC (estimate): Dust monitor breaker was flipped off due to unknown reasons.
- Observation: Temperature is oscillating in the same slightly strange way it did yesterday
- Observation: Seismon was still stuck as noted by Tony in alog 73222 (since Sept. 30)
- 16:40 UTC
- Oli and Camilla adjusting sqz SHG polarization
- 17:00-17:02 UTC
- Patrick Restarted Camera Servos
- Naoki informed of Camera Servo Restart
- 17:08: Dave restarting PSL OPC SDF with new updates
- 17:10 UTC: NO WORKING AT HEIGHT due to SQZ Table work requiring LOCAL LASER HAZARD
- 17:20: Realized that Seimon is working again (Tony’s comment in alog 73222)
- 18:04: Jonathan had to start a GC server which may affect internet access and other such activities
- 18:26 UTC
- SEI_ETMX set back to isolation in order since:
- Fil didn’t end up doing the coil driver swap (due to faulty spare).
- We wanted to confirm Jason’s successful Oplev laser swap (It was not successful - see alog 73226)
- Before we had the chance to move IX to “Aligned”, ISI IX watch dogs tripped so held it there to confirm with Fil
- SEI_ETMX set back to isolation in order since:
- 18:28 UTC
- ISI IX Stage 1 Watchdog tripped
- ISI IX Stage 2 Watchdog tripped
- 18:30 UTC
- DAQ Restart started by Dave and Jonathan (alog 73245)
- 18:33 UTC
- Jason came back from LVEA stating that the power regulator on the Oplev was drawing too much power - once Fil inspects ISI IX Coil Driver is working, we can un-trip the watchdogs and continue putting SEI_ITMX into FULLY_ISOLATED and re-aligning SUS_ITMX (alog 73226)
- 18:38 UTC
- Fil confirmed that ISI IX Coil Driver was still OFF after installation upon inspection and that he had now turned it ON
- 18:43-48 UTC
- ISI IX Stage 1 Watchdog un-tripped
- ISI IX Stage 2 Watchdog un-tripped
- SEI_ITMX is moved towards full isolation
- SUS_ITMX moved to aligned
- 18:44 UTC: WORKING AT HEIGHT MAY RESUME as SQZ WORK is DONE
- 18:47 UTC: Ryan S looked at the Oplev counts and found that they were still critically low with the chamber back to nominal. Ryan S informed Jason and he’s working on it (alog 73226)
- 18:53 UTC
- DAQ Restart successfully ended by Dave and Jonathan (alog 73245)
- 18:58-19:01 UTC
- HAM1 Hepi Watchdog un-tripped
- ISI IY Stage 1 Watchdog un-tripped
- ISI IY Stage 2 Watchdog un-tripped
- 19:01 UTC: Jason recruited Ryan S to go swap out the faulty IX DC converter and to ensure that it is properly working. (alog 73226).
- This activity is the primary reason afternoon lock acquisition was delayed
- 19:18 UTC
- DAQ Restart may have errors (FW1 had an error)
- Informed DAQ (Erik) and they are looking into it
- 19:20 UTC
- Small bull-snake found in LVEA garb room
- 19:33 UTC: Verbal Japan EQ (not an issue due to maintenance).
- 19:38 UTC: Erik got back to me (alog 73245)
- FW1 restarted due to missing 4 seconds of data - we don’t know why it restarted given that FW0 did not miss any data despite having the same connection.
- Erik posits that sometimes FW1 restarts after the DAQ restart and usually about 3-10 mins after (when it does), and that this restart might just be that same behavior, albeit delayed to 25 mins after restart.
- 20:06 UTC: Jason got back from LVEA with updates (alog 73226)
- DC Converter was successfully swapped
- Laser had to be swapped again (3rd laser)
- Still keeping an eye on whether the DC Converter compromised the newly swapped laser
- Counts back to nominal for now
- 20:17 UTC: ISI Sensor_Config turned back on
- 20:18 UTC: Initial Alignment Started
- 20:21 UTC: Mitchell + TJ suspect that the dust monitor breaker got kicked by faulty graphite veins
- Reached NLN at 21:49 UTC
- OBSERVING at 22:14 UTC
- Lockloss at 22:46 UTC correlating with an EX Saturation
LOG:
| Start Time | System | Name | Location | Lazer_Haz | Task | Time End |
|---|---|---|---|---|---|---|
| 15:09 | 15:10 | |||||
| 15:11 | FAC | Karen | EY | N | Technical Cleaning | 16:06 |
| 15:13 | FAC | Randy + Chris + Bubba | LVEA | N | Septum Plate Forklift + Move | 17:17 |
| 15:13 | FAC | Kim | EX | N | Technical Cleaning | 16:13 |
| 15:15 | FAC | Ken | LVEA | N | Mechanical Room Heaters Check | 19:41 |
| 15:16 | FAC | Cindi | FCES | N | Technical Cleaning | 16:16 |
| 15:23 | PEM | Mitchell | EX/EY | N | Dust Pump Famis Task | 16:11 |
| 15:26 | FAC | Bubba | LVEA | N | Snorkel Lift Ceiling Noise Check | 15:57 |
| 15:26 | FAC | Chris | LVEA | N | Pest Control | 15:42 |
| 15:27 | SUS | Fernando + Jason | LVEA | N | IX Oplev Laser Swap | 15:39 |
| 15:33 | VAC | Jordan + Gerardo + Travis | LVEA | N | Turbo Pumps | 17:22 |
| 15:41 | FAC | Chris | EY, MY, EX, MX | N | Pest Control | 16:42 |
| 15:46 | EE | Fil | CER | N | ISI IX Coil Driver | 16:21 |
| 15:49 | FAC | Tyler | MY | N | Looking at Fans | 19:55 |
| 16:22 | EE | Fil | CER | N | Grounding of PSL + Beckhoff Chassis | 17:00 |
| 16:43 | FAC | Chris | LVEA | N | First Aid + Eyewash Stations + First Aid (FAMIS) | 17:43 |
| 16:44 | FAC | Karen + Kim | LVEA | N | Technical Cleaning | 17:17 |
| 16:48 | VAC | Gerardo + Travis | FCES | N | Moving Cleanroom | 17:22 |
| 17:10 | SQZ | Sheila + Camilla + Naoki | LVEA | Local | Swapping homodyne at SQZ Table | 18:43 |
| 17:16 | EE | Fernando + Marc | LVEA, CER, Mezannine | N | Electrical System Testing | 18:46 |
| 17:19 | FAC | Karen + Kim | Filter Cavity Tube | N | Technical Cleaning | 19:34 |
| 17:22 | TCS | Ryan C | Mechanical Room | N | Mechanical Room Chiller Check | 17:32 |
| 17:29 | FAC | Cindi | LVEA Recieving | N | Cardboard extraction | 17:46 |
| 17:40 | ISC | Keita | LVEA | N | Ham 6 Noise Reduction Inspection on OM2 | 19:45 |
| 17:47 | 17:47 | |||||
| 17:48 | FAC | Cindi | High-Bay | N | Technical Cleaning | 18:19 |
| 18:13 | FAC | Chris | EX, EY | N | Eyewash Stations + First Aid (FAMIS) | 19:24 |
| 18:25 | SUS | Jason | LVEA | N | IX Oplev Check | 18:32 |
| 18:32 | VAC | Gerardo | LVEA | N | More Turbo Pump Work | 19:03 |
| 18:40 | EE | Fil | LVEA | N | ISI IX Coil Driver Turn On | 18:41 |
| 19:02 | SUS | Jason + Ryan S | LVEA, CER | N | Swapping DC converter power regulator | 20:07 |
| 19:51 | SAF | Ryan S + Oli | LVEA | N | Sweep | 20:15 |
| 20:08 | SUS | Jason | Optics Lab | N | Dropping off parts (Quick) | 20:09 |
| 21:33 | TCS | Camilla | LVEA | N | TCSY Laser Switch-On | 21:44 |
At 21:29UTC the CO2Y laser tripped off with RTD/IR alarm. I went into the LVEA and had to power cycle the CO2Y chassis and wobble the IR cable connector box before the laser would turn on again. The VAC team bumped the table earlier today but I doubt this has anything to do with the trip off. I checked the annular pattern on ITMY via the HWS looked as normal.