Dew point measurement taken this morning read at -43.8 oC. Measurement taken before any activity inside chambers. Soft covers were on HAM5 and HAM6, HAM7 is isolated and a bit pressurized.
Tue Jul 30 08:09:44 2024 INFO: Fill completed in 9min 40secs
FAMIS 21010
PMC REFL hasn't been rising as much over the past week, but it certainly still is. Everything else looks fairly nominal.
Workstations were updated and rebooted. This was an OS packages update. Conda packages were not updated.
TITLE: 07/30 Day Shift: 1430-2330 UTC (0730-1630 PST), all times posted in UTC
STATE of H1: Corrective Maintenance
CURRENT ENVIRONMENT:
SEI_ENV state: MAINTENANCE
Wind: 3mph Gusts, 2mph 5min avg
Primary useism: 0.01 μm/s
Secondary useism: 0.05 μm/s
QUICK SUMMARY: Continuing work today on the FS assembly swap in HAM5.
Betsy, Camilla, Sheila, Jennie W, Keita, Robert
21:30 UTC Camilla and Betsy figuring out new way to lock diwn the OFI.
22:05 Placing peak sheet to shield ofi while they unscrew bars from FS assembly.
22:40 Took mount with bar and beam dumps still attached out of HAM5. One of the bolts for the bar was stuck in the mount so they unscrewed it chamber side.
22:42 Sheila dis-assembled FS wedge mount
Sheila left at 23:00 UTC
Camilla and Betsy taking photos and videos of damage and wiping beam dumps and mounts.
We found indium foil in the top screw hole of the mount which would sit on top of the wedge.
23:00 UTC Robert came to take photos between HAM5 and 4 from outside chamber.
23:14 Keita joined.
Lots of discussion about what to do about mounts as there was lots of the black coating in the screw holes and so Betsy and I washed the holes on the FS mount with isopropanol and she tapped the holes again.
00:10 Camilla and I put beam dumps back onto OFI.
Mount and old FS wedge covered up chamberside and cover back on.
Everyone out by 00:15 UTC.
Camilla to add pics.
Some more details and photos.
Betsy and I locked the OFI suspension the correct way, following 3.1.2, 3.3.1 and 4.2.1 of E1300056-v4. We locked the -X-Y corner and then moved the small baffle to lock the -X+Y corner. Will need to reattach this baffle when done. Left +X cornered unlocked as one had osem in the way and the suspension felt very secure with only 2 corners. Photos attached: first and second.
Photos attached of:
Videos are in the OFI googledrive:
There is photos of the FS assmebly after cleaning with the new FS installed in 79363
Almost galled one of the 1/4-20 bolts which held the Beam Dump mount bar onto the FS wedge mount during removal. Once the entire subassy was out of the chamber we worked it with isopropyl in the bolt thread joint and managed to get it out. Once totally disassembled, the 4 mount holes retapped with obvious material removal. Cleaned with isopropyl flushes.
Pictures of debris on the now removed FS wedge optic attached. We didn't attempt to remove the debris, but instead put it right in to one of the suspended optic containers to stow/ship with the other optics to CIT in case a coating measurement needs to be made and compared to specs on it as well. The debris was removed from its metal mount so I don't see why First contact wouldn't remove it from this optic surface as well.
Tagging for EPO.
TITLE: 07/29 Day Shift: 1430-2330 UTC (0730-1630 PST), all times posted in UTC
STATE of H1: Corrective Maintenance
INCOMING OPERATOR: Tony
SHIFT SUMMARY:
The wind started to pick up around 1700UTC, which brought increasing dust counts in the PSL anteroom and LVEA. Smoke could be smelled inside the OSB as well from outside.
The KTP was replaced in chamber during the afternoon and the chamber work continues (FS assembly).
LOG:
Start Time | System | Name | Location | Lazer_Haz | Task | Time End |
---|---|---|---|---|---|---|
15:07 | FAC | Kim & Karen | LVEA | N | Tech clean, Kim out @ 16:35 | 16:39 |
15:26 | SQZ | Camilla, Sheila, Keita | Optics lab, LVEA | LOCAL | KTP work, then back to HAM5 | 18:33 |
15:33 | VAC | Gerardo | LVEA, OMC | N | Dew point purge air measurement | 16:21 |
15:35 | SQZ | Betsy | Optics lab | LOCAL | Find Camilla&Sheila | 16:30 |
15:57 | SQZ | Keita | Optics lab | LOCAL | Join crew | 16:23 |
16:38 | OPS | Tony | LVEA | Y | LASER HAZARD transition | 16:58 |
16:58 | OPS | LVEA IS LASER HAZARD | LVEA | Y | LVEA IS LASER HAZARD | 21:11 |
17:10 | FAC | Karen | EndY | N | Tech clean | 18:11 |
17:15 | CAL | Rick, Shingo | PCAL lab | LOCAL | PCAL measurements | 17:49 |
19:12 | VAC | Janos | LVEA | Y | Investigate GV5 which hardclosed by iteself | 19:25 |
19:43 | FAC | Karen | FCES | N | Tech clean | 19:59 |
19:59 | FAC | Dolly, Tyler, 3 contractors | MidY | N | Site walkthrough | 20:36 |
20:52 | OPS | RyanS | LVEA | Y | SAFE transition | 21:04 |
21:15 | SQZ | Camilla, Jennie, Sheila, Betsy | LVEA, HAM5 | N | KTP work, Sheila out 2300 | Ongoing |
22:15 | FAC | Richard | LVEA | Y | Check on crew | 22:33 |
22:50 | PEM | Robert | LVEA | N | Join chamber team | Ongoing |
22:53 | VAC | Travis | LVEA | N | Check out pumps, gatevalves | 23:10 |
23:07 | SQZ | Keita | LVEA | N | Check on progress | Ongoing |
23:17 | SQZ | Rahul | LVEA, HAM5 | N | Tool drop off | 23:20 |
Looking at the OFI TEC servo we noticed that the response was much slower than what one could expect from the given ugf frequency. The gain was increased fomr -1 to -15, whereas the ugf frequency was decreased from 50mHz to 10mHz. This resulted in a response time around 10s, which is about 3x faster than when we started. Increasing the ugf beyond this can make the servo unstable.
As a side note: The applied voltage at the driver was about 3x higher than the voltage readback from the TEC, indicating a rather large voltage drop in the cable.
Noticed that GV5 had hard closed on Saturday at 19:59 utc time, no human intervention. It appears as if the instrument air pressure left for soft close GV5 was enough to hard close it. According to PEM instruments near GV5 made lots of noise, see attached plot, accelerometer and microphone data.
I checked the dial on the gauge to measure the instrument air at GV5, and indeed there was only about 10 psi, this value is within the "usual" pressure used for soft clossing pneumatic gate valves and per procedure.
No interaction is required at this moment from the vacuum team.
Tagging ISC, since sensitive equipment is hanging near this gate valve, like cameras and OpLevs.
I converted this microphone DQ signal to an audio wav file. The microphone saturates at +/-32768 for a fraction of a second, but you can hear the echo fade away after this.
Here is the accelerometer as a wav audio:
(new file added at 13:52, orig file was created using the incorrect frequency of 16kHz, this is actually a 8kHz channel)
The ITMY Oplev (aligned at the time) didn't see this hard close, plot attached.
Remember GV1 is closed, this makes ITMY Oplev blind, Sum on trend above is very small.
After discussing with Jenne this morning, I have flipped the sign of the ETMX ESD lock bias voltage from -450V to +410V to reduce the charge build up in the optic. I will keep this settings for a week or two and measure the charge on the optic. If the charge gets reduced, then will continue with this until we are ready for locking the IFO - will revert the settings to nominal values at that point. Attached below is a trend of the lock bias offset and ESDAMON_DC_OUT, which shows the changes I have made today.
I have made some adjustments to the L3 HV mon for ETMX after having some email discussions with Jenne. The latest settings is opposite sign and value (of high voltage) of what we have during Observing run (and not Down state - which is what I did earlier).
The first screenshot I have attached below shows the sign and value (positive 123V), when we were at Observing.
The second screenshot shows latest settings, i.e. negative 123V 450V (full negative). I will revert this once we go back to locking the IFO.
Sheila, Keita, Betsy, Camilla
In the last power measurements in 79313 we were loosing 25% through OFI and another 15% from lost through incorrect polarization through the TFP.
Today's measurements:
From the mean of these measurements Sheila and Louis calculated the rejected ratio (power sent to ZM6) is 0.17 ± 0.002%. The transmission through to HAM6 is 99.96 ± 1.45%. The sum of these is 100.13%, which is within the margin off error.
Attached is a .txt version of the .py file Sheila did this calculation in.
We realized that we overestimated the errors here so the transmission through to HAM6 is 99.96 ± 0.84%. Rejected ratio (power sent to ZM6) is 0.17 ± 0.001%. Updated code attached and more recent measurements (with swapped FS) in 79383
At 16:08 Thu 25 July 2024 the continuous wave psinject excitation on h1calinj stopped running.
After investigation, I found that this process could not restart because of an expired leapseconds file on h1hwinj1. From the end of June onwards it would not have been able to restart, but was eventually restarted on Thursday 25th July. We currently do not know why the process restarted on Thursday.
The fix was to manually edit the /usr/share/zoneinfo/leapseconds file and change the lines:
#Expires 2024 Dec 28 00:00:00
#expires 1735347600 (2024-12-28 00:00:00 UTC)
# File expires on: 28 December 2024
I had disabled monit during this investigation. After fixing the leap seconds and undid all my temp changes and performed a monit controlled restart of psinject with no problems.
Dew point measurement taken this morning read at -43.7 oC. Measurement taken before any activity inside chambers. Soft covers were on HAM5 and HAM6, HAM7 remains isolated and a bit pressurized.
FAMIS 26468 -Capture Monthly--Trend HEPI Pump Pressures and Drives
There was a number of spikes over a few days, that I expect to be associated with the venting and jumping on the HEPI platforms.
Mon Jul 29 08:11:00 2024 INFO: Fill completed in 10min 56secs
Gerardo confirmed a good fill curbside.
Keita, Sheila
Summary: We chipped the spare KTP crystal this morning, and this afternoon installed the back up spare that Rodica had shipped. We've adjusted the roll, and the pitch angle seems better than the crystal that we removed. So this should be ready to go into the chamber first thing Monday morning. We have many photos from today, which will be attached and annotated to this alog later.
Following on From Jason's alog 79319
With this placement of the damaged KTP in it's assembly, where the assembly is bolted perpendictular to the beam path, and a wave plate to mix the polarizatoins upstream of the KTP, we have 13.5mW in the p polarized beam (see first attachment which is a diagram Paul sent us this morning), 16.3mW in the s polarized beam, and 2.3 mW in the AR surface. This is not set up with the AOI that the AR coating is designed for, which is why the AR beam is large, we can take advantage of this to set the pitch by setting the AR reflection parallel to the table..
With the original KTP in place, the AR reflection isn't parallel to the table it is pitched up by 10/(530 +405 mm) about 11 mrad. The optic lab beam is hitting the KTP a little below the burned spot, which would have been on the +X side in chamber. The burned spots are on the side closer to our alignment laser.
Before taking it out of the mount we took a variety of photos showing the damage spots position. We did not find any indium foil in the mount, Paul had warned us that there might be indium between part 5 and part 9 of D2000038.
As we were placing the new crystal in the mount, we left the set screws (11) that hold the peek loose, and held the piece upsidedown while we screwed in the bolts labeled #10 to hold on the aliuminum plate. It chipped as we were tightening the bolts labeled 10 in D2000038. After some discussion with Rodica, Paul, Gabriele, we went back to the lab to take photos of the chip and try to understand how the chip happened. We have photos showing that the crystal was proud of the top of part 5, the orientation of the black metal piece. After we removed the black front plate, we could see that the KTP was firmly stuck in part #5, with the wedge stuck. Keita had to push on the back of the crystal to get it loose.
Keita made a series of measurements using calibers:
Chipped KTP: (agrees well with the drawing: E1900284)
part 5: https://dcc.ligo.org/DocDB/0171/D2000567/001/D2000567_A%2B_OFI_KTP_Wedge_Holder.pdf
peek:
total height (max): crystal + peek = 0.885+0.1105 = 0.9955 inches, smaller than 0.2mm than the height of the slot.
cratered KTP:
We then did a trial run (using the chipped KTP) of an approach that we think avoids the problem of letting the KTP get wedged in the holder. We set the KTP on several wipes on the bench, and set the peek underneath it. We then slid the holder (part #5) over this whole thing, which went smoothly, and tightened the set screws. After flipping it over, we can see that the KTP is not proud of part #5, and it sits nearly flush to the front of the holder. We could then easily attach the black front plate. We decided to do this with the final spare, which had 2 small chips on the edge.
With that spare installed in the assembly, we adjusted roll using the alignment laser that Camilla and Jason set up. We wanted to adjust roll so that the transmitted beams were level to the table, since we know that the laser bea we started with were parallel to the table. The roll adjustment was sticky, and tightneing the set screw tended to lower the transmitted beams. The beams transmitted are off in yaw compared to the ones from the cratered KTP, by about 7mm/870mm + about 8 mrad. We had difficulty seeing the AR reflected beam, but we can see a tiny beam with all the lights off (this suggest that the reason the beam was so bright before was the coating damage, not the AOI of the crystal in our set up.). At 820 mm from the KTP, the AR beam was about 1 mm too low, so it's pitched down by 1mrad.
We think this is about as good as we can do by adjusting with this mount, so we are satisfied and will leave the KTP assembly under wipes and foil to be reinstalled on Monday.
Photos showing the location of the crater damage spots, and how the crystal was mounted in the holder as found.
Photos showing the chipped crystal. The second photo shows some small chips on the back edge, we noticed these just before the crystal chipped. Rodica says those look similar to things she has seen in these crystals, so this might be something that was present before today. The front of the crystal has a large chip and damage along the bottom, those both happened while tightening the bolt on the front plate.
Photos of how the damage probably happened. The crystal was proud of the aluminum holder, visible between the aluminum and the black piece in the first photo. The next two photos show that there was space between the back of the holder and the thick part of the wedge on both the top and the bottom.
The last 4 photos are side on views from 4 sides showing how crystal was sticking out in front of aluminum holder.
The MTP was lodged tightly in the aluminum holder and wasn't easily dislodged, the last photo shows how Keita slid the peek out from under it and the crystal was still stuck tight.
When we took the cratered KTP out to measure it, a speck of black seems to have fallen out of one of the craters.
final photos for today show how the beam out of the new crystal was off in yaw compared the the crater damaged crystal. The irises were placed on the transmitted beams through the crater damaged crystal by Jason before we swapped.
Video of the installation of new KTP in the KTP holder (without breaking it) was uploaded to https://dcc.ligo.org/G2401494 as it is too big to attach to alog.
Note that the table surface (and therefore the face of the holder facing the table in the video) is NOT perpendicular to the cylindrical surface of the holder. Attached is a cartoon of the side view of the installation shown in the video. (86 deg in the cartoon is just an eyeballing, but it should be larger than 80 deg, smaller than 90).
The problem seems to be that the height (which you cannot see in the cartoon) of the KTP as well as PEEK cushon (which you cannot see in the cartoon either) combined is so close to the height of the slot in the holder that a slight rotation of KTP relative to the holder around x axis will easily wedge the KTP in place.
For posterity, below is a table of KTP wedge serial number.
S/N | Description | ICS |
3005 | The original wedge with laser damages (aka cratored one). | TBD |
3004 | The first replacement that we chipped. | https://ics.ligo-la.caltech.edu/JIRA/browse/E1900284-2-Aplus-3004 |
3001 | Pristine one that we installed in HAM6. | TBD |
S/N 3004 and 3005 will be sent to GariLynn.
Another great pic of the laser damaged KTP.
Table of KTP wedge serial number with newly made ISC links for SN3005 and 3001. Thanks Mitch for making these records!
S/N | Description | ICS |
3005 | The original wedge with laser damages (aka cratored one). | https://ics.ligo-la.caltech.edu/JIRA/browse/E1900284-2-Aplus-3005 |
3004 | The first replacement that we chipped. | https://ics.ligo-la.caltech.edu/JIRA/browse/E1900284-2-Aplus-3004 |
3001 | Pristine one that we installed in HAM6. | https://ics.ligo-la.caltech.edu/JIRA/browse/E1900284-2-Aplus-3001 |
Tagging for EPO.