Some strange readbacks in ASC-AS_B_RF42_DEMOD_LOMONCHANNLE_3/4 and LSC-REFLAIR_A_RF45_DEMOD_RFMON.
ASC-AS_B_RF42_DEMOD_LOMONCHANNEL_3/4
We traced the issue to the beckhoff terminal in H1 EtherCAT Corner 4, Slot 9 (H1 Demod M) Channel 4B looks like it has an offset and is possibly a bad terminal.
LSC-REFLAIR_A_RF45_DEMOD_RFMON
We found a 46MHz oscillation on this signal. Daniel power cycled the LSC RFPD Interface (S1200460) and the oscillation went away.
H1 SQZ 42.375MHz
This signal is good but the power ok bit is not being read. I verified that the OK bit is active, but the Beckhoff terminal is not receiving it. Will replace terminal next maintenance day. Corner 6 Slot 3, RF Amp 7.
TITLE: 01/17 Day Shift: 16:00-00:00 UTC (08:00-16:00 PST), all times posted in UTC
STATE of H1: Planned Engineering
INCOMING OPERATOR: None
SHIFT SUMMARY: MAINTENANCE DAY
LOG:
All times marked in UTC:
17:23 Bubba and Mark into LVEA for rigging in preparation for scaffold assembly
17:46 Coca-Cola on site
17:55 Bubba and Mark out
16:00 Jeff to cleaning area and LVEA
16:05 Terry out to squeezer bay
16:30 Pest control on site. Chris escorting them into LVEA.
16:40 Jeff out of LVEA
16:45 Chris escorting pest control down the Y arm to out stations
17:00 Terry out for vent meeting
17:05 Chandra out going to EY
17:15 Norco with LN2 going to vessel ending in 77
17:55 Corey out to Optics Lab
18:00 Terry back out to squeezer bay. Nutsinee, as well.
18:03 Jim and Hugh out to EY to work on HEPI pumps
18:10 Resetting BSC watchdogs tripped from recent earthquakes
18:16 Keita out to floor checking cabling on IO2TL; Sheila taking IMC open loop meaurements; Cheryl is addressing cameras
18:17 Mark and Tyler out to HAM2 to assess the newly installed catwalk and address access options
18:20 Jenne out to join Sheila Keita and Cheryl
18:22 TJ out to optics lab
18:22 Marc to CER to investigate AS WFS read-backs WP#7294
18:23 Travis out to Biergarten
18:35 Mark and Travis out
18:41 Pest control is done
18:53 Mark and Tyler to EY
19:07 Corey out of the optics lab
19:19 Jim and Hugh back from EY
19:21 Sheila out
19:39 Jenne out to IO2TL
19:40 Chandra out to LVEA
21:03 Jeff B out to both end stations - mechanical rooms
21:10 Nutsinee out to squeezer bay
21:22 Betsy and Travis out to Mid-X
21:27 Karen out to the optics lab
21:29 TJ bac out to optics lab
21:29 Jenne out to IO2TL
21:40 Betsy and Travis out to EX
22:06 Marc out
22:30 Sheila out to LVEA with Jenne
22:42 Hugh back
22:46 Chris headed back to corner from EX
23:26 Marc to MY
Monthly dust monitor vacuum pump checks: End-Y - Vacuum pump off. Restarted with no problems. Not sure if it went off due to thermal check (room is hot due to running vacuum group compressors) or due to plug being bumped during service work in the area. Will keep an eye on it while the vent work is going on. End-X - Pump OK and temps within spec. Made slight change in bypass air to adjust vacuum pressure. CS - Pump OK and temps are within spec. Made slight change in bypass to adjust vacuum pressure.
Dave, Nutsinee:
The EPICS IOC for h1hwsex stopped running at 06:53 PST this morning, related to the reboot of cdsfs0. I rebooted this machine and restarted the HWS code. The EDCU reconnected to all channels except for two: H1:TCS-ETMX_HWS_HEARTBEAT and H1:TCS-ETMX_HWS_SOFTWARE_ERROR_CODE.
These channels are not running on ETMX but are running on ETMY, I'm not sure why the end stations EPICS differ in this way.
While investigating h1hwsex's problems, I noticed that the HWS code on h1hwsey had stopped due to a full /data disk. Its EPICS IOC was running (albeit in a frozen state). I restarted the ETMY code to get it updating again.
WP7289 h1fw0 E18 raid, controller card replacement
Dan, Dave:
Dan hot swapped the primary controller card on h1fw0's raid (raid-msr-e18-0-0). The E18 correctly failed over to the secondary card, the swap-out was transparent to the frame writer.
WP7290 decommission h1ngn front end model
Dave:
I removed h1ngn from CDS following my wiki instructions (https://cdswiki.ligo-wa.caltech.edu/wiki/RemovingFrontEndModel).
Adding Ecat C1 PLC4 SDF to DAQ:
Dave:
I added the new PLC4 SDF to H1EDCU_SDF for trending.
Removing LVEA Dust monitors from DAQ
Jeff B, Dave:
LVEA dust monitors 2,3,4,30 were removed from H1EDCU_DUST.ini
Latest Squeezer Beckhoff PLC4 code:
Daniel, Dave:
I have updated ecatc1plc4 DAQ-INI and target request files after Daniel's code upgrade this morning.
DAQ Restart:
DAQ was restarted at 12:05 PST to cover the DAQ part of the above changes.
CDSFS0 (/ligo file system) Patch and Reboot
Carlos, Ryan, Jonathan:
cdsfs0 was rebooted at 06:45PST. The /ligo/apps file system had NFS export issues which were later resolved.
Note: no work on PEM (WP7291) today, we have an outstanding name changing issue.
Laser Status:
SysStat is good
Front End Power is 35.38W (should be around 30 W)
HPO Output Power is 137.1W
Front End Watch is GREEN
HPO Watch is GREEN
PMC:
It has been locked 0 days, 1 hr 18 minutes (should be days/weeks)
Reflected power = 29.59Watts
Transmitted power = 35.87Watts
PowerSum = 65.46Watts.
FSS:
It has been locked for 0 days 0 hr and 32 min (should be days/weeks)
TPD[V] = 1.559V (min 0.9V)
ISS:
The diffracted power is around 2.4% (should be 3-5%)
Last saturation event was 0 days 1 hours and 17 minutes ago (should be days/weeks)
Possible Issues:
PMC reflected power is high
Most notable: ever-declining diode power and a trip this past Saturday
J. Kissel, R. McCarthy, B. Weaver, D. Sigg FRS Ticket 9683 Furthering the investigation of H1SUSITMY's R0 noise problems revealed by vertical transfer functions at the top mass, I grabbed an amplitude spectral density of all of the top mass OSEMs on the QUAD. Attached are the results. The first two, for comparison, are all of the top mass OSEMs. While all other OSEM channels look to be as expected, the R0 RT OSEM shows a dramatically elevated noise floor with many sets of interacting frequency combs. The remainder of the attachments are just various levels of zoom around various parts of the spectrum to show details of the various combs. Note these spectra were taken with damping loops ON. Remember, while Fil was snooping around last week, he found that OSEM's LED power return had a short to ground -- but ruled out everything ex-vacuo -- so it's inside the chamber (see LHO aLOG 40099). These three chunks of evidence (the electronics checks, the transfer functions, and the raw OSEM ASDs) are indicative that we certainly have *a* problem we need to fix in chamber, WHENVENT. I'll be updating the FRS Ticket to reflect this. We have agreed that there is no need to rush vent and fix this now -- we have other priorities with the IFO -- but we *may* couple a quick-fix vent with say, the 70W laser install, or before / during the ITM discharge cycling. To be determined. However, given our past history with oscillating opamps in UK satellite amplifiers, I'm not convinced this short is the *only* problem. So, at a "medium priority" speed, Richard and the CDS crew will temporarily swap out the M0 (LF RT) / R0 (LF RT) sat amp, and/or move cables around to see if the problem goes away or follows the amp or the cable (since the problem is so easily identifiable from the ASD). I'll also grab some ASDs with the damping loops OFF, in order to rule out drive chain problems and confirm it's a sensor only issue. Stay tuned!
EY Work:
IO: HAM 2 & 3 area
Maintenance: DAQ rebooting and other work interfering with commissioning.
Squeezer: still needs cables routed to HAMs 5/6
ITM Camera install and TCS chiller work done; TCS LASER is back ON
Keita wants illuminators on HAM chambers 2 & 3
Jeff B re-configuring dust monitors prior ro any DAQ restart
CDS Computing: Security updates are ongoing
Beckhoff work: ongoing
I was working on alignment of the IMC, and the PSL just tripped off.
I was just hanging out in the control room trying to close the WFS loops, not out in the LVEA.
Of note, TVo and I were unable a few hours ago to close the ISS first loop. The ISS would oscillate any time we tried to close the loop. Rick (on site for the Saturday tour) was planning to help us out once the tours are over, so for now I just have the ISS autolocker off.
The laser tripped because the injection locking lost lock. The laser came back without any problems. I did notice that the laser power was down somewhat from what I remember the laser power to be from yesterday. I adjusted the temperatures of all 4 diode boxes to get more laser power instead of increasing the diode current. ILS3.png suggests that the injection locking lost lock when the input modecleaner was not swinging. Looking at ILS4.png, it looks like the laser frequency was oscillating for some time. My guess is that at some stage the FSS lost lock, which in turned pulled the master laser frequency beyond the range of the injection locking. That in turn caused the oscillator to lose lock to the master laser.
Sheila, Daniel, Terry, Nutsinee
35.5MHz I/Q optimization, 70.78 degree offset
We injected 105Hz excitation to SHG PZT then adjusted the phase offset while watching I/Q on the SR785. 70.78 deg offset gave a factor of 40dB in ratio and that is now the current setting.
SHG Open-loop gain TF, unity gain frequency ~ 3kHz
We adjusted the common mode board gain until the UGF is ~3kHz. When the SHG crystal was not heated (25C) this gain was 4dB.
Later we changed the crystal temperature to 35C to get green light out of the SHG. The gain since then has been 20dB.
Then we reduced the power going in to the SHG cavity. Was 400mW, now 100 mW. This didn't change the UGF by much so I didn't touch the gain setting (still 20dB).
Here's a snapshot of the final open-loop gain TF as of Friday evening. Once lowered the input power I was only able to drive the PZT at 50mV stably.
Two problems prevented acquiring the SHG fast channels:
Now fixed.
We found a loose cable inside TTFSS which prevented the readback of the LO monitor. We then tested the remote controls for the TTFSS and fixed a problem with the excitation enable logic and the gain slider calibration. The laser crystal temperature was also a factor of 5 too high, since the slow controls signal through the TTFSS implements a voltage divider. We also connected the fast channels. The only thing missing now is the HV.
Most of the DC PDs had the wrong configuration in TwinCAT. Now fixed.
We now have a guardian for the squeezer SHG locking loop which seems to be working fine. It is located in sqz/h1/guardian In order to run it Dave had to add the sqz guardian directories to the list of places where the guardian machine checks for code.
It is a very simple guardian, with 3 states, down, lock, and locked.
It currently uses the transmitted IR power through the SHG to determine if the cavity is locked. Once we have a calibrated green diode (which Terry is working on as I'm writing), we can use that instead.
There is some basic error checking but much more could be added.
It locks the cavity by toggling the state of the first boost. If this doesn't work, it starts a scan of the cavity using the slow output offset, and toggles the boost at each step of the way. The step size and speed of the scan can be adjusted, but it seems to lock the cavity within about a second with the current settings.
- Jenne, Keita, Cheryl
TITLE: 01/12 Day Shift: 16:00-00:00 UTC (08:00-16:00 PST), all times posted in UTC STATE of H1: Planned Engineering LOG: 15:27 UTC Hugh to HAM2, looking for Mark and Tyler 15:35 UTC Hugh back 15:57 UTC Hugh starting an excitation on end X HEPI 16:11 UTC Christina and Vanessa to end Y 16:43 UTC TJ to optics lab 16:43 UTC Hugh, Mark and Tyler to HAM2 to install scaffolding (WP 7281) 16:47 UTC Christina and Vanessa leaving end Y 16:57 UTC Christina and Vanessa to LVEA to clean 17:19 UTC Filiberto to mezzanine to connect TCS to Beckhoff safety interlock 17:20 UTC Robert to LVEA to look at damaged panel in IOT2L 17:25 UTC Robert back 17:30 UTC Gerardo to LVEA, isolate pump on top of HAM5 and 6 17:43 UTC TJ back 17:56 UTC Hugh to HAM2 to check on scaffolding work 18:01 UTC Chandra to mid Y and end Y 18:04 UTC Fire department through gate, touring site 18:05 UTC Gerardo back 18:10 UTC Mark and Tyler back 18:15 UTC Fire department off site 18:23 UTC Travis and Betsy to end Y 18:25 UTC Cheryl to HAM3, WP 7284 18:46 UTC Mark and Tyler back to HAM2 18:49 UTC Greg starting WP 7285 19:09 UTC Nutsinee and Daniel to squeezer bay 19:34 UTC Gerardo to mid Y to replace VEA camera 19:39 UTC Daniel and Nutsinee back 19:56 UTC Greg and TJ to LVEA to install laser enclosure panels around TCSY table 19:58 UTC Mark and Tyler back 20:07 UTC Gerardo back 20:15 UTC Betsy and Travis back 20:15 UTC TJ back 20:36 UTC Mark to HAM5 to tighten door bolts 20:36 UTC Greg done 20:39 UTC Peter to PSL racks to remove a power supply 20:44 UTC Peter done 20:56 UTC Cheryl to IOT2L to adjust cameras on table 20:56 UTC Filiberto done adding TCS laser to safety system. Going to install power supply that Peter removed in the CER. 21:04 UTC Sheila to LVEA 21:12 UTC Hugh to HAM2 to look at scaffolding 21:18 UTC Hugh back 21:35 UTC Mark done 21:40 UTC Filiberto done in CER. Going back to cabling in LVEA. 21:42 UTC Gerardo to mid Y with camera 21:45 UTC Keita to IOT2L 21:46 UTC Darkhan and Yannick to end Y, PCAL work, transitioning to laser hazard 21:57 UTC Darkhan transitioning end Y to laser hazard 22:02 UTC Gerardo back 22:03 UTC Terry to squeezer bay 22:13 UTC Marc to CER 22:57 UTC Nutsinee to squeezer bay 23:04 UTC Dave restarting h1sqz model 23:05 UTC Darkhan and Yannick back. end Y back to laser safe. 23:08 UTC Nutsinee back 23:29 UTC Sheila and Nutsinee to squeezer bay 23:47 UTC Chandra to mid and end Y
WP7287
Chandra, Dave:
The Y2 beam tube cold-cathode gauge alarms were sped up from 15 minute to 5 minute reporting. The alarm level was kept at 5.0e-09 torr. The CP4 cold-cathode gauge (PT245) was added to the alarms system with an alarm level of 1.0e-07 (it is operating around 5.8e-08 torr). This work permit was closed.
Daniel found some more ADC connection issues, which were fixed this afternoon. h1sqz model was restarted, no daq restart was needed.
Measured dew point of EY purge air for about 12 minutes this morning, with no demand (closed off metal valve to get flow through pressure relief valve). DP crept down to -25.3degC. Then found a "switching failure alarm" on at the control panel (visual only - no sound). I reset and re-measured DP. Quickly dropped to -22degC in several seconds. The two drying towers appear to be cycling between regenerating and drying.
Compressors are running between three and four units with current flow. Output pressure is 0.5-0.7 psi. Soft cover was on BSC door, but arm is in chamber.
Other vacuum site checks OK - three turbo stations in corner, corner purge air, CP4 IP. Leak checker at OMC turbo is currently running to test He background.
Checked on EY purge air again this evening. All looks good. Dryers are cycling and DP measured -25.5degC (measured through a few cycles).