TITLE: 02/22 Day Shift: 16:00-00:00 UTC (08:00-16:00 PST), all times posted in UTC
STATE of H1: Observing at 66Mpc
INCOMING OPERATOR: Jeff
SHIFT SUMMARY: Locked the entire shift and 27+ hours in Observing.
LOG: See attached .txt file.
I made two mistakes in judgment before being reminded that we have an Acceptable/Not Acceptable activities list at the OPS station. First, I let Chris move the forklift from outside of the OSB receiving to the chemical bunker from 22:10-22:26 UTC. Second, I let Bubba and John onto the roof of the OSB for an inspection from 22:18-22:21. LLO was not in Observing at the time, so hopefully I can be forgiven. The forklift makes sense to me, but I was surprised that the Observation Deck is off limits.
I just did EX to complete the set.
Receiver was off between the times 12:32:58 and 12:41:59 PST
EX CNS-II receiver label (on bottom of unit):
model: CNSC02-C
Serial number: 404358
Options: 2
CNS-II IRIG-B output is correct except for a midnight bug also documented earlier at LLO (see T1700065). The CNS-II firmware will need to be updated when schedules make it possible. fetching 1171843188 H1:CAL-PCALX_IRIGB_OUT_DQ and plotting times around midnight Thu Feb 23 00:00:00 UTC 2017 Wed Feb 22 23:59:48 2017 Wed Feb 22 23:59:49 2017 Wed Feb 22 23:59:50 2017 Wed Feb 22 23:59:51 2017 Wed Feb 22 23:59:52 2017 Wed Feb 22 23:59:53 2017 Wed Feb 22 23:59:54 2017 Wed Feb 22 23:59:55 2017 Wed Feb 22 23:59:56 2017 Wed Feb 22 23:59:57 2017 Wed Feb 22 23:59:58 2017 Wed Feb 22 23:59:59 2017 ****Wed Feb 22 00:00:02 2017**** Thu Feb 23 00:00:01 2017 Thu Feb 23 00:00:02 2017 Thu Feb 23 00:00:03 2017 Thu Feb 23 00:00:04 2017 Thu Feb 23 00:00:05 2017
Cruising along at ~70 MPc. H1 has been locked for 29 hours and in Observing for 23.5 hours.
Starting CP3 fill. LLCV enabled. LLCV set to manual control. LLCV set to 50% open. Fill completed in 992 seconds. LLCV set back to 15.0% open. Starting CP4 fill. LLCV enabled. LLCV set to manual control. LLCV set to 70% open. Fill completed in 1298 seconds. TC A did not register fill. LLCV set back to 36.0% open.
Increased both by one percent:
CP3 now 16% open.
CP4 now 37% open.
The EE guys straightened me or the gear out, likely the former, and I was able to center the T240 at EndY today. This seismometer is currently on the floor just +X,+Y of the BRSY and wrt the ISI STS is +1mX, =Y. Anyway, if it performs okay, I'll move it into the BRS thermal housing exchanging it for the STS that I haven't gotten to do run well enough of late.
The first attachment shows the ground seismos and the BRS. Two hours show the T240 coming online around the large centering excursions; the ISI ground STS with my VEA movement; and the BRS getting rung up and now nicely quieted.
The second attachment is the current spectrum of the T240 channels and the ISI STS. The thin red and blue REF lines are the bad STS after the glitching stopped but it still was not matching the ISI STS--see 34198 for its lack of comparison. The current traces for ADC_0_ are now the T240 and you can see that it matches the ISI STS much better down to 10s of mHz. The lowest frequencies will be poor while the instrument thermalizes and we don't [care] too much about the stuff above 10Hz or so. [I can't vouch for the calibration yet for comparison to the STS but it is pretty good at the useism.]
On Tuesday if it continues to do okay, I [will] swap it in and it will likely then need a day or so to be ready for use--again further thermalizing.
I made the jumper modification inside of the CNS-II GPS receiver at EY. The jumper block J39 jumper was moved from spanning pins 3-5 (amplitude modulation) to pins 1-3 (pulse width modulation). The procedure was:
The EY unit label (located on unit bottom)
Model CNSC02-C
Serial Number: 404357
Options: 2
Using dataviewer I verified that the EY IRIG-B DQ channel is now PWM.
I'll modify EX unit at the next opportunity.
Operator notification of loss of end station GPS receiver: I verified that when the EY GPS receiver was powered down: SDF did not report any diffs (and therefore H1 was not knocked out of observation mode), the timing summary status on the CDS overview screen went RED (see attachment, a time-machine plot from 10:30:00 PST), there was no verbal alarm.
The first two of these are the expected behaviour, the lack of a verbal alarm is a fault, we will add this channel to this system.
Hugh was in the VEA at End Y between 18:05 and 18:31 UTC doing BRS STS work. At Vern's suggestion, we kept the IFO in Observing Mode and just logged the times of the incursion.
Dave B. was in the EY electronics bay for a similar period of time.
To Clarify, I deployed a T240 seismometer on the floor near the BRS. The BRS was not opened. The T240 will swap in for the non-functioning STS inside the BRS enclosure on Tuesday--if the T240 seems to perform better than the STS--we expect it will as it is brand new.
To clarify, I was in the front room, working in the computer rack. The analog signals (1PPS to the comparator, IRIG-B to the h1iscey PEM-AA Chassis) were unpowered between the times 10:23:31 - 10:38:55 PST.
Not much to see here. Measurements show that all is nominally ok.
WeeklyLaser plot shows a continuing downward trend of PMC Trans power. Also, attached is the PMC medm screen to show the ratio.
Everything else looks to be nominally ok.
| Work Permit | Date | Description | alog/status |
| 6493.html | 2017-02-20 14:21 | Restore filter settings on OAF range BLRMS. This is not going to affect the interferometer operation or DMT range calculation. | 34301 |
| 6492.html | 2017-02-17 17:25 | Removed beam dump from the FLIR camera path (both CO2X and Y). This will be the new nominal configuration. | scheduled for Feb 28 |
| 6491.html | 2017-02-17 17:21 | Upgrade h1dmtlogin (marble) to current Debian OS (8). | 34297 |
| 6490.html | 2017-02-17 11:54 | Move the IRIG-B source signal from the IRIG-B Fanout to the CNS-II GPS receiver. | 34293 |
| 6489.html | 2017-02-16 16:35 | Fix tconvert on Debian 8 workstations, as it is now, it cannot convert dates of the form "Oct 15 2016 12:34:56 UTC" when the month is Oct. Every other month works. | |
| 6488.html | 2017-02-15 10:31 | Switch HAM1 Z Sensor Correction from HAM2 STS to ITMY STS--This allows us to troubleshoot the EndY PEM STS by borrowing the STS Host Box. The TF between the HAM2 and ITMY STSs is unity w/ 0 phase below ~2Hz covering the band of the SC. | 34176 |
| 6487.html | 2017-02-15 10:30 | Duplicate of WP 6488. |
After 12min of OBSERVING, had another PSL trip.
Went to the PSL Chillers and there must have been an explosion of water in there. The Crystal Chiller cap did NOT pop off. The Crystal & Diode chillers both have Error Alarms (Crystal has Flow Sensor Alarm & Diode has F2-Error).
Will probably call Jason shortly.
In CORRECTIVE MAINTENANCE state.
As with the first trip documented here, this one also appears to be caused by an erratic flow reading in the Laser Head 2 flow sensor. As before, the flow reading from the head 2 sensor becomes erratic before the trip and begins to drop, eventually hitting the trip point and tripping the interlock. The first attachment shows the 3 flow rates from the Laser Head circuit (once again, the 4th flow sensor is forced to a specific value in Beckhoff so cannot contribute to the trip). The 2nd attachment is a zoomed in view of the Laser Head 2 flow sensor signal.
As for the F2 error on the diode chiller, this error did not cause the chiller to turn off. I remotely turned it off and asked Corey to power cycle the chiller. This cleared the error.
The plug not popping off can be a problem. When the pump stops there is a back surge of water into the reservoir, which is what blows off the plug and sends a shower of water onto the floor. If the plug is too tight to allow the pressure from the back surge to relieve, there is a chance of cracking the reservoir. I will call Technotrans to see if there is a better way to relieve this back pressure. Until I hear from them PLEASE DO NOT reef down tight on the plug. Leave it lose. Cleaning up a bit of water on the floor is a lot better than swapping out a damaged chiller.
13:01utc: H1 & the H1 PSL Front End went down.
Will make a call to Jason.
On the PSL SYSSTAT medm, we had the Oscillator/Head 1-4 flow error in a Fault/red state. Jason said this meant that we had a "glitch in laser head flow sensors". Jason brought back the PSL remotely. I topped off the PSL Chiller (the cap did NOT pop off) with 375mL of water.
13:58 Back to LOCK ACQUISITION
FRS #7460 Filed For ~1hr of CORRECTIVE_MAINTENANCE DOWN time.
Cause appears to be a trip of the Laser Head 1-4 Flow interlock, specifically Head 2. The first attachment shows the 3 laser head flow rates (the 4th is currently being forced to a value in the Beckhoff software, so cannot contribute to the trip). It is clear that head 2 became erratic and began to drop in flow, eventually passing below the trip point and tripping the laser. The 2nd attachment shows a zoomed in view of only the Head 2 flow. Possible debris passing through the flow sensor?