TITLE: 05/26 Day Shift: 1430-2330 UTC (0730-1630 PST), all times posted in UTC
STATE of H1: Planned Engineering
INCOMING OPERATOR: None
SHIFT SUMMARY: Work continued today in HAM2 and currently there is still work going on at the test stand on the BBSS.

The LVEA is currently LASER SAFE

LOG:

Mitchell and I placed the new central beard baffle with a cutout for SPI on HAM2. It went on without issue after Mitch reminded me how to adjust the panels.

I then attached the accelerometer to the L bracket and tried hammering in various places. There wasn't much real estate, so I'm not sure how this will turn out. Data still needs to be analyzed, and I'll post pictures of hit locations then as well.

J. Kissel, J. Warner
ECR: E2400026
WPs: 13237, LHO:13238
Final Design Doc: T2400145
Relevant Systems Level Drawings:
    . Mechanical Assemblies
        :: ISIJ Reflector D2400102
        :: HAM Table Baffles D1700335
        :: HAM2 Systems Layout D0901083 (not yet-inclusive-of-SPI)
    . Electronics Wiring Diagram 
    . Cable Routing In-vac Cable Routing Plan from G2401479 (pages )
    . Flange Layout D1002873-v11

Executive summary:
    - Removed ISIJ +X-side, center, HAM2 ISI table baffle from D1700265-v4 Type 2 
        :: Bracket mounting bolts left screwed into ISI optical table for this will eventually become a D1700265-v4 Type 3 and remounted.
    - Installed ISIJ Reflector + QPD Assembly D2400102 on +X ISI side wall (D071057-v2), with its shroud (D2500030) in place
        :: We didn't weigh it, but the SW Assembly predicts a mass of 1.96 [kg], which we can likely round up to 2.0 [kg] with the shroud installed.
    - Routed and connected QPD read-out cable system to D3 flange, F10 spigot.
    - Routed and connected picomotor cable system to existing D1101515 quadrupus leg Cable #3, J4 
        :: Cable #4, J5 is connected to IO PM5 mirror, Cables #2 J3 and #1 J2 were reset in neat coil with connectors floating to avoid electrical grounding as before.
    - Nudged make-shift baffle system using D1700261 ballast mass baffle mounted vertically on the +X / +Y / Beam Height corner of the chamber wall upon entry into beamtube.
        :: the will DEFINITELY need a technically-minded reset.

In at 10:30a PT and out by 12:30a PT. It's so lovely when everything goes to plan!

Pictures and further info to follow in the comments below.

FAMIS 39862 Vibration Sensors To Gauge Health Of HVAC Fans Site Wide
 

Closes FAMIS37263

No new issues (LAB2 and LVEA5 are not connected currently), or unreasonable/concerning counts at any location.

Samantha Callos, Genevieve Connolly, Robert Schofield, Ryan Short, Carlos Campos

The detchar presentation summarizing the injection analysis can be found on the DCC at: https://dcc.ligo.org/LIGO-G2600768

A PDF of this report has also been attached to this alog along with a spreadsheet of the injections.

An earthquake tripped the SWWDs for ETMY, ITMX and ETMY at 18:30 PDT yesterday evening. I untripped these 07:40 this morning.

TITLE: 04/14 Day Shift: 1430-2330 UTC (0730-1630 PST), all times posted in UTC
STATE of H1: Planned Engineering
INCOMING OPERATOR: None
SHIFT SUMMARY:

Iluminators for HAM3 BSC1 and 2 are now on.
HEPI and ISI for BSC2 is locked out. tagging PEM. and there is now a Red H1:SYS-ETHERCAT_DEVICE_1_SLAVECOUNTACTUAL due to the iluminator Chassis device that Fil turned on between BSC1 and BSC1 in the beergarden to allow the illuminators to turn on. tagging CDS. 

PCAL troubleshooting: 
Dripta and I were trying to take FFT's of PCAL Lines for more Power budget work and we noticed that the PCAL Y laser is off with no current on H1:CAL-PCALY_LASERDIODECURRENT. I trended the channel back and compared it with some channels that I thought may link it to the IOP restarts. 
Dripta went to EY to toggle the Laser power rocker switch just in case it was just a simple issue of a turn it off and back on again.  Tagging CDS again.

I noticed that MC1 & 3 were saturating. 
IMC H1:IMC-WFS_GAIN was set to 0 and the history was cleared to solve the problem of MC1 & MC3 were being saturated.
Trending some channels that were suspected to perhaps  be the cause of the junk signal and thus the cause of the saturations.
The IMC ASC has it's own block to do power normalization, different from the LSC power normalization. The output of this block is "INNORM" used to normalize MC2 NSUM for the IMC WFS triggering.
Relavent FRS ticket: 
https://services1.ligo-la.caltech.edu/FRS/show_bug.cgi?id=9387

More IOP model restarts happening again for HAMS 7,8 then HAM 5,6, & BSCs 1,2, & 3.
Please see the attached SDF Diffs for HAMs 5, 6 and the BS: 
SUSSR3
SUSRM
SUSIFOOUT
SUSSQZOUT
SUSBS (my bad I had sort on substring selected with an old Optical Align string in the search field.)
All SDFs were accepted before the IOP restart. 
ITMS  IOPs have not been rebooted yet. Tagging SUS, SQZ & ISC

MC2_trans Beam Dump twas Twissled today, then put back into original place. 

The ITMs had their IOP's restarted after a time cable swap today as well.
All SUS were turned back to Aligned.
SEI for HAM 2,3,4  and BSC 1 & 2 still have their HEPI's and or their ISI's WD tripped or other wise in a ISI Damped Hepi offline state.

As you can see from this ITMY trend, Jim went inside to lock the ISI and tripped the ISI, then Jason went in and tripped it again, then there was an IOP restart. 

A slightly less exciting trend of ITMX.


LOG:
 

(Jordan V, Corey G)

In prep for upcoming BBSS Install, "broke" bolts (which is slang for loosened them) on:

• BSC1's +Y Door in the Beer Garden
• BSC2's Dome (to see if giving the Dome's O-Ring some time to "decompress" helps us out at all with removal next week).  

BSC1's +Y Door Bolts (mostly) Removed & Accelerometer Cable Disconnected

BSC1's door had all bolts but (4) removed.  Sadly, I removed the bottom (easy ones) bolts first and then when I got to the top bolts they were very hard to loosen because of some sag.  Additionally, their access is horrible with:  a stiffening plate for the chamber right above the rear access to these bolts, then there are cable trays also in the way, and the C3 fabric cover is draped in your face the whole time.  Jordan helped out and we were able to get the last top bolt removed.  We also loosened the (4) bolts 1-turn which is the typical procedure.

There was an accelerometer still cabled up to this door.  I disconnected the cable (labeled "PEM:BSC1_ACC_X") and stuffed the cable into the cable tray above this door.

Time lapse of me removing half the bolts in this LINK (since we only files allowed in alog have to be smaller than 15Mb.)  :(

BSC2's Dome Bolts (mostly) Removed, But Have A Galled Bolt!

BSC2's dome bolts were removed.  4-bolts were left in place (they were loosened and then tightened up a little).  One notable, is there is 1-galled dome bolt.  Jordan and I used the long wrenches to see if we could use more force to help it break loose, but no luck.  We did not try pouring some alcohol on the bolt to help as a lubricant.  The bolt is loose and has about 1-2mm of a gap on it.  So, the pros could try use even longer cheater bars, a saw cutter, or they were also chatting about a tool to cut the nut off.  At any rate, 

TITLE: 04/09 Day Shift: 1430-2330 UTC (0730-1630 PST), all times posted in UTC
STATE of H1: Planned Engineering
INCOMING OPERATOR: None
SHIFT SUMMARY:
Vacuum team has been Venting the corner station still. 

OMC's were taken to SAFE for a model reboot then taken back to aligned.

Dave and Marc  swapped some cables and restarted the following IOP's & models today. Please check your SDF's haven't been reverted.

H1IOPOMC0 
H1IOPOAF0 
H1IOPASC0
Tagging teams that may have SDF issues in the future.

SRM taken to aligned. (I have no idea Why it was misaligned.)

IMC Input Power Channel is no longer "Cray Cray" and is now reading correclty as of Jennie D's alog.

Restart ISI models BSC 1,2, & 3 
FW1 Down 19:15 UTC
DC0 down 19:20 UTC 
DC0 Re-established at 20:36 UTC  

ISI BS Stage 1&2 watchdog tripped 20:36 Likely due to Vac activities. 
ISI HAM3 WD tripped 23:33

VAC team says BSC2 annulus is vented & Dome bolts ready to be broken. 
 

LOG:

TITLE: 04/07 Day Shift: 1430-2330 UTC (0730-1630 PST), all times posted in UTC
STATE of H1: Planned Engineering
OUTGOING OPERATOR: None
CURRENT ENVIRONMENT:
    SEI_ENV state: MAINTENANCE
    Wind: 5mph Gusts, 3mph 3min avg
    Primary useism: 0.01 μm/s
    Secondary useism: 0.15 μm/s 
QUICK SUMMARY:

Things on the menu for today, HAM1's +y door, venting the corner, and a lot of prep (HAM3 doors should also be coming off this week & more prep for BBSS work!). 

h1seih7 is still down (so HAM7 SEI & SUS systems are all red). 

The Ops Overview also continues to have "IMC INPUT POWER" flashing from 0-200W (but I was assured this was not real and purely a calculation error; light pipes have been closed since last Fri morning).

OPS Note:  I will leave the con around 1045amPDT for a tour and then to attend a BBSS preparation meeting at 1pm PDT and RyanC has graciously offered to cover for me.

To test out new infrastructure for running IOCs and other services in CDS I put the MX weather station into a podman container and started it on our new service-host cluster (a high availbility cluster for services).

As part of this I created a generic container that should work for the other weather stations and the dust monitors (until those are migrated to beckhoff).

This work is part of an effort to improve our infrastructure, including how we track, monitor, and manage our IOCs.  There should not be any user visible change with this, other than the IP address that the IOC responds from is different.

Notes:

 * We run these older IOCs in the background with screen as they are iocsh shells and want a terminal.  For this setup I no longer need to run with screen, we just tell the container system (podman) to run the container with a tty in interactive mode in the background.

For FAMIS #39861: Fans look mostly flat (Corner's FAN5 looks faintly noisier the last 1.5 days).

Closes FAMIS39860, last checked in alog89375

Everything looks as it did during the last check, except MR_FAN4_170_1 looks noisier than during the last check.

Betsy wanted a look at the last few months of dust trends for BSC2.

(This is Dust Monitor LVEA10 which was moved to BSC2 in Feb [alog89137].)

Follow-up to alog88174 on the new brand of dust monitors. The colors are consistent throughout the plots, blue for the control GT521s, red for the PMS21, yellow for the PMD331 in differential, and green for the PMD331 in cumulative.

After some back and forth with the companies support, they ended up sending us 2 new devices, a PMD331 and a PMS21. I ran a few tests with the new devices, the PMD331 continues to look reasonable and similar to the GT521s. Although I have some confusion to counting methods, the company says setting the unit of CFM (cubic foot / min) sets the counting method to differential but I'm not convinced. You can't specify counting method on this devices' interface unlike the PMD331.

The first test I ran was in the front room (incorrectly labeled as MSR) with two MetOne GT521s, a PMD331, and a PMS21. The second was in the CER with both PM# and one MetOne GT521s. The TemTops had filter elements built in which the MetOnes do not, I removed these, cleaned the devices of any leftover particulate from them and ran a bunch of cycles to clear out any more of those lingering particles. The PMD331's sampling clunk which was a multi-layered mesh style, unlike the PMS21 and GT521s which is just a funnel essentially, which seemed to be increasing the counts so I swapped it out to use the same one as the GT521s. After doing these things I prepared for the test by running both the zero count and flow rate calibrations on all the devices setup side by side.

The PMS21 still seems to be showing lower counts but it's not nearly as drastic as it was before. For the first test, I applied a scale factor of 2 and 4 for the 0.3um and 0.5um particles respectively. The second test I ran which was over a much longer time span (1.5 hours vs ~20 hours) in which the PMS21 performed more as expected, the 0.3um counts were pretty much spot on with the GT521. For the larger 0.5ums the counting was low as with the last device, this time the scale factor I found to be best was 3, compared to the 40 I had with the last device. This is the model that they prefer to make a pumpless version of, so I'm curious about testing a pumpless version from them to eliminate that potential source of error.

The PMD331 still seem reasonable although I have questions about the internal counting methods. I assumed the standard counting method was cumulative so I did some bin subtraction to the counts columns to convert it to differential counting by subtracting the 0.7um from the 0.5um and the 0.5um from the 0.3ums. I assumed the raw data collection was in cumulative as if it were the opposite the counts would be far higher than the GT521. For the 0.3um particle size bin, differential counting more closely match the control but for the 0.5ums it's less clear. The control (blue) trace is in-between the two, it matches the cumulative trace a bit better.

I have also relayed this info to the support engineer I've been talking to with TemTop.

Closes FAMIS37262, last checked in alog88698.

Everything looks as expected, no new issues. There was an odd dust spike (10 minutes of >1000 cts, so 2 cycles of sampling) from the PSL102 (Anteroom) dust monitor on Sat Feb 7th around 11:30 local.

For FAMIS #39857: All fan trends look nice and flat.