Displaying reports 51181-51200 of 83146.Go to page Start 2556 2557 2558 2559 2560 2561 2562 2563 2564 End
Reports until 11:06, Monday 26 December 2016
LHO VE
david.barker@LIGO.ORG - posted 11:06, Monday 26 December 2016 (32873)
CP3,4 autofill ran correctly at 11:01, 11:02

hand-off run of the CP3,4 autofill scripts completed quickly. Now waiting for robo-alog report at 12:10

Starting CP3 fill. LLCV enabled. LLCV set to manual control. LLCV set to 50% open. Fill completed in 20 seconds. LLCV set back to 20.0% open.

Starting CP4 fill. LLCV enabled. LLCV set to manual control. LLCV set to 70% open. Fill completed in 29 seconds. LLCV set back to 34.0% open.

H1 PSL
jason.oberling@LIGO.ORG - posted 18:00, Sunday 25 December 2016 (32872)
PSL Tripped, Now Recovered

The PSL tripped off this morning, interlocks indicated a loss of flow in the laser head water circuit.  After restarting the laser from home, I drove out to the site to check a chiller alarm (that turned out to be a low water level alarm), and ended up having to reset the noise eater as I recovered the PMC/FSS/ISS (as usual when recovering from a trip).  The laser is now back up and running in the same state it was left in on Thursday.

LHO VE (VE)
gerardo.moreno@LIGO.ORG - posted 13:55, Sunday 25 December 2016 (32871)
CP5 LLCV Heat Tape is not working

The whole valve stem was covered with ice, see photo, so I moved the light from CP6 to CP5 and left it on.

Images attached to this report
H1 DAQ (CDS, DAQ)
david.barker@LIGO.ORG - posted 13:15, Sunday 25 December 2016 - last comment - 13:27, Sunday 25 December 2016(32868)
h1tw0 has raid problems again, stopping its daqd for now

h1tw0 (secondary minute trend writer) started having RAID issues again beginning at 05:35 PST this morning. Its been in a start-stop-restart cycle ever since. I've turned off monit on h1tw0 to stop it respawning. We'll rely on h1tw1 for the rest of the holidays.

Comments related to this report
david.barker@LIGO.ORG - 13:27, Sunday 25 December 2016 (32869)

The DAQ EDCU is now not green (purple) because of the loss of h1tw0. To confirm, you can run the command h1dc0_edcu_list_disconnected_epics_channels.py and verify all 57 chans are from H1:DAQ-TW0

david.barker@zotws2: h1dc0_edcu_list_disconnected_epics_channels.py 

daqd> 

33796 channels

33739 connected

57 disconnected

80237 connection events processed

2220990763 value change events processed

H1:DAQ-TW0_CYCLE

H1:DAQ-TW0_TOTAL_CHANS

H1:DAQ-TW0_DATA_RATE

H1:DAQ-TW0_EDCU_CHANS

H1:DAQ-TW0_EDCU_CONN_CHANS

H1:DAQ-TW0_UPTIME_SECONDS

H1:DAQ-TW0_LOOKBACK_RAM

H1:DAQ-TW0_LOOKBACK_FULL

H1:DAQ-TW0_LOOKBACK_DIR

H1:DAQ-TW0_LOOKBACK_STREND

H1:DAQ-TW0_LOOKBACK_STREND_DIR

H1:DAQ-TW0_LOOKBACK_MTREND

H1:DAQ-TW0_LOOKBACK_MTREND_DIR

H1:DAQ-TW0_FAST_DATA_CRC

H1:DAQ-TW0_FAULT

H1:DAQ-TW0_BCAST_RETR

H1:DAQ-TW0_BCAST_FAILED_RETR

H1:DAQ-TW0_GPS

H1:DAQ-TW0_CHANS_SAVED

H1:DAQ-TW0_FRAME_SIZE

H1:DAQ-TW0_SCIENCE_FRAME_SIZE

H1:DAQ-TW0_SCIENCE_TOTAL_CHANS

H1:DAQ-TW0_SCIENCE_CHANS_SAVED

H1:DAQ-TW0_FRAME_WRITE_SEC

H1:DAQ-TW0_SCIENCE_FRAME_WRITE_SEC

H1:DAQ-TW0_SECOND_FRAME_WRITE_SEC

H1:DAQ-TW0_MINUTE_FRAME_WRITE_SEC

H1:DAQ-TW0_SECOND_FRAME_SIZE

H1:DAQ-TW0_MINUTE_FRAME_SIZE

H1:DAQ-TW0_RETRANSMIT_TOTAL

H1:DAQ-TW0_PRDCR_TIME_FULL_MEAN_MS

H1:DAQ-TW0_PRDCR_TIME_FULL_MIN_MS

H1:DAQ-TW0_PRDCR_TIME_FULL_MAX_MS

H1:DAQ-TW0_PRDCR_TIME_RECV_MEAN_MS

H1:DAQ-TW0_PRDCR_TIME_RECV_MIN_MS

H1:DAQ-TW0_PRDCR_TIME_RECV_MAX_MS

H1:DAQ-TW0_PRDCR_CRC_TIME_FULL_MEAN_MS

H1:DAQ-TW0_PRDCR_CRC_TIME_FULL_MIN_MS

H1:DAQ-TW0_PRDCR_CRC_TIME_FULL_MAX_MS

H1:DAQ-TW0_PRDCR_CRC_TIME_CRC_MEAN_MS

H1:DAQ-TW0_PRDCR_CRC_TIME_CRC_MIN_MS

H1:DAQ-TW0_PRDCR_CRC_TIME_CRC_MAX_MS

H1:DAQ-TW0_PRDCR_CRC_TIME_XFER_MEAN_MS

H1:DAQ-TW0_PRDCR_CRC_TIME_XFER_MIN_MS

H1:DAQ-TW0_PRDCR_CRC_TIME_XFER_MAX_MS

H1:DAQ-TW0_PROFILER_FREE_SEGMENTS_MAIN_BUF

H1:DAQ-TW0_RAW_FW_STATE

H1:DAQ-TW0_RAW_FW_DATA_STATE

H1:DAQ-TW0_RAW_FW_DATA_SEC

H1:DAQ-TW0_SCIENCE_FW_STATE

H1:DAQ-TW0_SCIENCE_FW_DATA_STATE

H1:DAQ-TW0_SCIENCE_FW_DATA_SEC

H1:DAQ-TW0_STREND_FW_STATE

H1:DAQ-TW0_MTREND_FW_STATE

H1:DAQ-TW0_FRAME_CHECK_SUM_TRUNC

H1:DAQ-TW0_SECOND_FRAME_CHECK_SUM_TRUNC

H1:DAQ-TW0_MINUTE_FRAME_CHECK_SUM_TRUNC

Total 57 disconnected.

LHO VE (VE)
gerardo.moreno@LIGO.ORG - posted 04:55, Sunday 25 December 2016 - last comment - 17:53, Monday 26 December 2016(32865)
CP6 Acting Up Again

It appears as if CP6 LLCV valve stem is frozen again, I'm at the site looking into it.

Comments related to this report
gerardo.moreno@LIGO.ORG - 07:32, Sunday 25 December 2016 (32866)

I think this is a different problem, the actuator does not appear to be actuating anymore.

Arrived to the site and went straight to CP6, turned flood lamp on, and went back to the corner station to pick up tools.  Arrived at CP6 for the second time, started using an EE "hair dryer", but the actuator did no show improvement.  Then removed the cap from the actuator and discovered that the whole inside was flooded, removed the water by removing the plugs at the base of the actuator, the water is getting in via the conduit (see photo CP6_actuator_conduit).  The water that was hard to remove was the one that pools by the power port via, see CP6_actuator.  Used some paper towels to soak the water from there, the shape of this location creates a great little pool.  I tried to manually actuate the valve up and down using the internal buttons but no movement was noted.  To cover all bases I went inside the MX-VEA and checked for blown fuses but no blown fuse was found, and the actuator is humming (making noise as if is trying to move thus I assume it has power).

I cleaned the cap of the actuator and installed it, with both of the plugs removed, I used the "hairdryer" to blow hot air inside the actuator via the signal port, no change noted on the behaviour of the actuator.  Then my flashlight batteries died, so I stopped work.  So I don't know if the water inside the actuator shorted or seized the motor, but the actuator is not working like it should.

Flood light remains on near the actuator, and for some reason the fill volume remained somewhat steady while working on it.

FRS ticket filed, https://services.ligo-la.caltech.edu/FRS/show_bug.cgi?id=6998

Images attached to this comment
kyle.ryan@LIGO.ORG - 07:31, Sunday 25 December 2016 (32867)
Filaberto turned off the heat lamp on Friday during his site inspection walk through.  The heat gun is either in my office or in the Mechanical shop.   

There really is a Santa Claus - only now he is based out of Grandview WA!   
gerardo.moreno@LIGO.ORG - 13:33, Sunday 25 December 2016 (32870)

Done, removed and replaced the faulty actuator, as I removed the lock-nut of the valve stem, it became clear that the valve stem was free, since I was able to move it up and down very easy.

Zeroed, and set the span for the new actuator.   Also extended the conduit a bit to fix the leak.

chandra.romel@LIGO.ORG - 17:53, Monday 26 December 2016 (32876)
Thanks, Gerardo. Looking forward to less CPs after next year.
LHO VE
kyle.ryan@LIGO.ORG - posted 14:03, Friday 23 December 2016 (32864)
More thoughts on obstructed 80K pump sensing lines
As noted previously, alternating between pressurization of the clogged line followed by applying a rough vacuum, results in gas generation on the atmospheric side (gauge side when connected to the gauge) of the obstruction results.  My initial, optimistic, interpretation was that the ice plug was getting "drawn" slowly up the sensing tube and making contact with relatively warm surfaces, thus melting the leading portion of the plug.  Considering the repeatable phenomenon of watching the gas pressure build up on the gauge only to have it fluctuate as if the accumulated gas was being released via some unknown path, I now have a new, more pessimistic, picture in my head (see attached sketch).   Maybe the ice plug is irregular in shape and not it complete contact with the large diameter aluminum tube wall such that it gets rocked, cocked, tilted etc. by the pushing and pulling of applying pressurized UHP N2 followed by vacuum pumping.  If this is happening then small amounts of LN2 can leak past and turn to gas and this is the source of the gas not the vanishing ice plug.  Since the gauge end of the sensing tube is closed, the pressure build up of GN2 can then escape past the ice obstruction back to the LN2 side.  This is consistent with the observations.  Note in the sketch that water ice is denser that LN2 and would be expected to concentrate at the bottom of the pump.  Also, once formed, it has no place to go.  It is too big to enter into the small I.D. of the SS sensing tube or make it past the "hard" 90 degree aluminum tube elbow.  

My wife thinks I'm Christmas shopping!
Non-image files attached to this report
LHO VE
logbook/robot/script0.cds.ligo-wa.caltech.edu@LIGO.ORG - posted 12:10, Friday 23 December 2016 - last comment - 12:47, Friday 23 December 2016(32861)
CP3, CP4 Autofill 2016_12_23
Starting CP3 fill. LLCV enabled. LLCV set to manual control. LLCV set to 50% open. Fill completed in 21 seconds. TC B did not register fill. LLCV set back to 20.0% open.
Starting CP4 fill. LLCV enabled. LLCV set to manual control. LLCV set to 70% open. Fill completed in 18 seconds. LLCV set back to 34.0% open.
Images attached to this report
Comments related to this report
david.barker@LIGO.ORG - 12:17, Friday 23 December 2016 (32862)

sigh, looks like the png strip tool image wasn't available at the time the roboalog posted, here it is:

Images attached to this comment
kyle.ryan@LIGO.ORG - 12:47, Friday 23 December 2016 (32863)
In order to quell the voices in my head and allow me to resume my "normal" activities, I had to manually overfill CP4 and CP3 after the automated routine ran.  Sure enough both pumps were full!  
LHO VE
kyle.ryan@LIGO.ORG - posted 12:03, Friday 23 December 2016 (32860)
CP4 economizer valve stuck?
I have noticed an excessive amount of flow exhausting out of CP4's dewar (a.k.a. vertical storage tank #8514372) this week (earlier too?).  The indicated vapor pressure between the two mechanical gauges range between 5 < vapor pressure < 10 psi which is on the "low side" of normal for this tank -> By kicking the piping in order to liberate the accumulated frost and gain access to the economizer valve's pressure adjusting screw I caused the flow to stop.  No adjustment was needed - valve was just stuck open.  This used to happen frequently during freezing weather because these valves (actually function only as adjustable pressure regulating valves) were originally installed with the adjusting screw pointing up.  Water would get inside the valve body via the screw's parallel threads and, when frozen, would lock the diaphragm and prevent it from deflecting.  However, most of these (including this one) had long ago been rotated so as to point down.  Don't know why this one was stuck.
LHO VE (CDS)
david.barker@LIGO.ORG - posted 11:07, Friday 23 December 2016 - last comment - 11:47, Friday 23 December 2016(32858)
autofill did not start

autofill of CP3 and CP4 did not start correctly, I'm investigating...

Comments related to this report
david.barker@LIGO.ORG - 11:47, Friday 23 December 2016 (32859)
I tracked down the problem to incorrect file permissions for the python script, inadvertently introduced during editing on Wednesday.
 
The original script ran as a cronjob at 11:36 for CP3 and 11:37 for CP4. Both were fast fills, here are the logs:
 
Starting CP3 fill. LLCV enabled. LLCV set to manual control. LLCV set to 50% open. Fill completed in 21 seconds. TC B did not register fill. LLCV set back to 20.0% open.
 
Starting CP4 fill. LLCV enabled. LLCV set to manual control. LLCV set to 70% open. Fill completed in 18 seconds. LLCV set back to 34.0% open.
 
 
At 12:10 a roboalog should be posted.
LHO VE
kyle.ryan@LIGO.ORG - posted 17:37, Thursday 22 December 2016 (32856)
Will resume PT180 long term pressure "drift" experiment on Tuesday, Dec. 27th


			
			
LHO VE
kyle.ryan@LIGO.ORG - posted 17:34, Thursday 22 December 2016 (32855)
Pumped on CP4's clogged level sensing line some more
Pumped for 4-5 hours today.  The time it takes to build up a positive pressure (following cracking the tube fitting and equalizing to room pressure) seems to have decreased slightly from yesterday - I should probably start recording the times and take notes!  Curiously, if I don't relief the accumulated gas by cracking the tube fitting, the pressure build up is partially reversible - meaning, if let alone, it can fluctuate between higher then lower positive values.  

Anyway, this exercise is probably worth continuing as it isn't making things worse and it almost seems to be behaving more like a poor conductance than a complete blockage now.  Of course, even if we are removing the obstructing material, it could take "a very long time" using this method!  

I am leaving the sensing line connected to the UHP N2 line (set at 0.4 LPM @ 15 psi).  

H1 General
cheryl.vorvick@LIGO.ORG - posted 15:57, Thursday 22 December 2016 (32853)
LVEA is laser safe, main beam and ALS light pipes are locked

H1 PEM
robert.schofield@LIGO.ORG - posted 12:51, Thursday 22 December 2016 - last comment - 18:10, Thursday 22 December 2016(32845)
Short HVAC shutdowns

I am beginning about 45 minutes of HVAC on/off, approved by Keita. As in O1 and previously, we will not be dropping from observation mode because we normally dont drop observation mode when chillers and turbines are changed.

Comments related to this report
robert.schofield@LIGO.ORG - 18:10, Thursday 22 December 2016 (32857)

The tests began at 21:24:00 and ended at 22:16:00. More soon.

Displaying reports 51181-51200 of 83146.Go to page Start 2556 2557 2558 2559 2560 2561 2562 2563 2564 End