TITLE: 02/04 Eve Shift: 00:00-08:00 UTC (16:00-00:00 PST), all times posted in UTC
STATE of H1: Observing at 116Mpc
OUTGOING OPERATOR: Niko
CURRENT ENVIRONMENT:
SEI_CONF state: WINDY
Wind: 22mph Gusts, 19mph 5min avg
Primary useism: 0.05 μm/s
Secondary useism: 0.50 μm/s
QUICK SUMMARY: Just got back to observing after maintenance.
00:18 UTC Accepted attached SDF differences.
TITLE: 02/04 Day Shift 16:00 – 00:00 (08:00-16:00), all times posted in UTC
STATE of H1: Locking
INCOMING OPERATOR: Patrick
SHIFT SUMMARY: Maintenance ended a little before 1. TJ tested remote re-locking, we did a little commissioning at ENGAGE_SOFT_LOOPS, and then lost lock. Went through initial alignment and are currently at LOWNOISE_ASC.
LOG:
16:00 (08:00) Karen to LVEA
16:05 (08:05) Hugh to LVEA
16:07 (08:07) Chris, Scott to EX/EY -- grease axial fans
16:26 (08:26) Chandra, Kyle to LVEA -- HAM 9&10 door removal
16:29 (08:29) Gerardo to LVEA -- assist door removal work
16:33 (08:33) Betsy to LVEA -- look for equipment
16:33 (08:33) Richard to LVEA -- talk to Kyle
16:37 (08:37) Richard out of LVEA
16:38 (08:38) Kyle to EY
16:40 (08:40) Richard, Ken to EX -- power/line hunting
16:42 (08:42) Chris, Scott back from EX/EY
16:42 (08:42) Chris, pest control to LVEA
16:48 (08:48) Chris, pest control out of LVEA
16:49 (08:49) Rahul starting charge EX measurements
16:49 (08:49) Chris, pest control to EX/EY
16:50 (08:50) Betsy out of LVEA
17:01 (09:01) Rahul starting EY charge measurements
17:02 (09:02) Kyle back from EY
17:20 (09:20) Vanessa, locksmiths to LVEA -- fix door
17:31 (09:31) Jason to enclosure anteroom -- inventory
17:31 (09:31) Christina to LVEA -- server inventory
17:43 (09:43) Jenne, Camilla to LVEA -- look for network analyzer/frequency servo TFs
17:45 (09:45) Chris back from EX/EY
17:45 (09:45) Chris to LVEA -- assist with door removal
17:53 (09:53) Sheila to LVEA -- OPO/ISS TFs
18:00 (10:00) TJ to EX/EY -- check wind fences
18:00 (10:00) Rick to LVEA -- assist with frequency servo TFs/inventory
18:15 (10:15) Charge measurements complete
18:29 (10:29) Fil back from EX
18:29 (10:29) Pest control done for the day
18:39 (10:39) Fil to LVEA -- look at temperature sensors
18:40 (10:40) Karen to EY
18:47 (10:47) Ed to EY -- pull PUM chassis
19:09 (11:09) Jenne, Camilla out of LVEA
19:12 (11:12) Ed back from EY
19:18 (11:18) Rick out of LVEA
19:37 (11:37) Karen leaving EY
19:41 (11:41) Chris out of LVEA
19:43 (11:43) Gerardo out of LVEA
19:54 (11:54) Ed to EY -- replace PUM driver
19:55 (11:55) Richard, Fil to LVEA -- pull BSC temp chassis
19:58 (11:58) Chandra, Kyle out of LVEA
19:59 (11:59) Hugh out of LVEA
20:03 (12:03) Jason out of PSL anteroom
20:20 (12:20) Richard, Fil back from LVEA
20:26 (12:26) Ed back from EY
20:27 (12:27) Camilla to LVEA -- sweep
20:30 (12:30) Fil to LVEA
20:37 (12:37) Camilla out of LVEA
20:39 (12:39) Fil out of LVEA
20:47 (12:47) Maintenance complete, beginning to re-lock
21:24 (13:24) Chris, Scott to MX -- move tractor
21:27 (13:27) Jason, Rick to diode room -- move cart
21:51 (13:51) Jason, Rick out of diode room
22:38 (14:38) Lockloss due to an ISI_CONFIG reloading mishap. Starting initial alignment
22:54 (14:54) Gerardo to LVEA -- grab sweatshirt
22:58 (14:58) Gerardo out of LVEA
I restarted the server processes for the three IO GIGE cameras this morning (cam09, cam28 and cam29). Even though cam09 runs on a different server machine than the othe two, they all three stopped running at the same time (Sunday 26 Jan 06:17 UTC) and I had the same problems restarting them. I first tried a 'restart' via the monit web page, this produced a restart error message. I then did a sequential monit 'stop' and 'start'. this appeared to work, but the uptime actually stayed the same at 18 days and the cameras were still unresponsive. I finally logged into the two servers as root user and manually issued the '/etc/init.d/h1camXX stop|start' commands to finally get the processess restarted.
Following work from alog 54798 I have set the Xarm green initial alignment setpoints, using the version of the code that should actually perform the rounding. I have also hand-rounded the Yarm setpoints from last week. I have accepted these rounded setpoints in both the Observe and Safe snap files, so I hope that we will not see SDFs diffs from this when we get to NomLowNoise.
Attached are the latest setpoints.
After this work, Niko did an initial alignment and we've almost gotten all the way to NomLowNoise, but we're past the point where intitial alignment has any effect, so I think this worked and went well.
I added some logic to LOCKING_ARMS_GREEN in ISC_LOCK to check for the middle case where an arm is locked but the WFS won't engage. If it stays like this for a minute after the timer for let it try one its own has completed, then it will do Increase Flashes again. I was able to see it work today without having to awkwardly try to force it into this middle state.
I also fixed a race condition I found that would not let Increase Flashes try two times.
Bubba has requested the corner station supply temperature cell phone alarms be bypassed for the next 24 hours:
Bypass will expire:
Wed Feb 5 14:34:39 PST 2020
For channel(s):
H0:FMC-CS_CY_H2O_SUP_DEGF
{Kyle, Gerardo, Chris, Tyler, Scott}
We deviated from the original plan of removing 84" doors per WP 8525. Instead we loosened bolts on the 68.5" flanges on both HAM 9 & 10 in preparation for HAM removal and shipment to LLO (84" doors will stay on during shipment). F2F length is 101.19" which is just under "wide load" shipping spec. Width will increase with shipping covers and bolt heads (~1.5" total), so we plan to compress bellows on HAM to keep final overall length < 102".
We had time today to separate just one flange. Purge air was flowing and dew point measured -45degC. The other three flanges are left in a state where the o-ring is touching. We temporarily covered these separated flanges with C3 covers and will fabricate a viton ring to seal shipping cover (this flange doesn't have the o-ring groove).
We will continue this operation in the next few Tuesdays and make our way to HAM 7,8. I wasn't thinking ahead and should have loosened bolts on HAM 7/8 septum plate. Will be tricky to maneuver long wrenches between fixturing that Hugh installed.
Thanks to Karen for wiping flanges and mopping floor space in response to last minute request.
Illuminator chassis at EX was moved from SUS-R1 rack to FAC-R1 rack. Part of ongoing noise hunting investigation. Unit contains two Beckhoff terminals. Will monitor to see if the noise lines we are investigating are removed or change.
F. Clara, R. McCarthy
WP 8523
The PEM power distribution chassis was modified to output ±15V that powers the temperature sensors on BSC1 and BSC3. Trending both temperatures shows temperatures randomly dropping by a few hundred counts. Higher input voltage to the sensors should hopefully clear this issue. Further investigation to be done on BSC1 (ITMY) as temperature values are still lower than expected.
D. Barker, F. Clara
This is probably not necessary now that it looks like DARM isn't adversely affected by the CPS differential controls, but I've added a couple states to the SEI_DIFF guardian to make the switching between the two states we've used the most so far easier. I changed the CORNER_CPS_DIFF state so that in engages all of the same elements as the FULL_CPS_DIFF, but CORNER doesn't engage a couple gains, so the ETMs don't get added to the final state. I then added CORNER_TO_FULL and FULL_TO_CORNER to do the wax on/ wax off between the two states. So, when switching from FULL_CPS_DIFF to CORNER_CPS_DIFF, it goes through the FULL_TO_CORNER state and all the guardian has to do is ramp down the ETM cps diff gains to 0. When going the other way, via CORNER_TO_FULL, the guardian ramps the appropriate gains to 1.
WP 8384 ScottL & HughR
Following on from last Tuesday, we got the U-Channels onto the Support Tubes and the RAdius Plates installed beween the chamber and the U-Channel of HAM7 S and HAM8 N. HAM7 is complete as far as the Transport Tooling is concerned, ready for jacking and craning. HAM8 is half finished with the North Crossbeam removed and Support Tubes fully secured to the chamber. 3 Crossbeams done, 5 to go. Photos--HAM7 Ready, HAM8 1/2 way there.
The results for this month's OPLEV charge measurements (performed on both ETMX and ETMY) is attached below.
ETMX: the effective bias voltage for the 1st quadrant for the pitch is showing to be 20V along with a massive error bar. This is a drop from 50V, however the error bar shows that this number cannot be trusted. For the Yaw it is around 60V. In the other quadrants the bias voltage is between 0-50V and is consistent with previous trends.
ETMY: The bias voltage in the first and the third quadrant is between 25-40V (both for the pitch and Yaw, except for the 1st quadrant for the pitch which is at negative 20V). However in the 2nd quadrant it is above 50V for the pitch and around 10V for the Yaw.
All the slider values were restored after the measurements were complete and SDF differences checked.
Strangely, today the terminal window and Matlab was struggling to find the data stored for 2020. After several refresh (clear all and PC re-starts, which was Dave's suggestion) it worked.
Camilla performed the post-maintenance LVEA sweep. Fil and Ed swept the end stations.
I reset both PSL power watchdogs at 20:01 UTC (12:01 PST). This completes FAMIS 10748.
Tagging PSL for future reference/search.
To follow up on the oscillations seen over the weekend, 54864 I measured OLGs of the OPO and green ISS loops, both of which seem OK. The OPO loop gain could be reduced by 2 or 3dB to be on top of the phase bubble, but it shouldn't be oscillating as it is with 50 degrees of phase margin.
In case this data is useful, SRCN0101.txt is the OPO loop amplitude, 102 is phase, SRCN0103.txt is for the ISS amplitude, 104 is ISS phase.
Sheila, Richard,
Filiberto and Richard installed new noise monitor circuits on the ETM PUMs last week, this morning I measured some transfer functions of them.
Attached are the dtt templates. Unfortunately I measured these TFs with the coil driver in state 3, which means that the low pass is on and the acq filter is off (the acq filter is after the noisemon pick off). In the digital noisemon filters I used the ANTILP filter zpk([0.4915;240.0583],[5.4697;21.8761],1,"n").
I'm also attaching the ITM measurements, which were taken in the same configuation 54614
The transfer function for ETMY LL seems significantly different from the rest. Richard and I set the test/coil enable to 0 (seting the driver into test mode, which means no input from DAC, I'm not sure what it means about terminating or floating inputs) and looked at spectra, and LL also looks different (3rd screenshot).
Richard is heading to the end station to check if there is something like a capacitor that wasn't swapped in that channel.
The EE team did find a bad solder joint in the ETMY LL channel, and repaired it before the end of maintence. Richard also re-ran the set of transfer functions for the noise monitors for EY, the attached file has his new set of measurements. The quadrants all seem to be the same now.
This ETMY measurement was taken with coil drivers in state 2, but the antiLP filter was on. That means that to compare these TFs to the others, we need to remove the filter zpk([0.4915;240.0583],[5.4697;21.8761],1,"n").
Attached are filters to calibrate the noisemon outputs in DAC counts.
They are designed by fitting the above-measured transfer functions (using IIRrational) and then inverting them. The antiLP filter was removed from the ETMY data. Poles at very low frequencies were nudged up to 1 Hz to limit the DC gain.
Attachment 1: plots of the data and fitted filters.
Attachment 2: filter install script
Thank you very much Chris.
I have just run this script and turned on the new filters, because we are out of observing for ~40 minutes of commisioning time. The new filters are turned on as of 20:22 UTC Feb 13, so the noise mon channels are all calibrated into DAC counts now.
Last week Jim pointed out to me that the SEI_CONF state drop down had the incorrect states listed. There were states in there that were no longer in the code and haven't been for some time. This is a known issue (a href="https://git.ligo.org/cds/guardian/issues/6">GRD gitlab issue 6</a>), and the current solution is to restart the node. So I did. All better for now.
