PSL model changes. WP6084

Ben, Jim, Dave:

Three psl models were changed today:

h1ioppsl0: Had the new Contec 6464 binary IO card added.

h1pslpmc: Removed its grounding of the last four DAC channels, these channels will now be used by the new outerloop system

h1psliss: added the new outerloop test code for this week's chassis install and test by Ben. Current code just monitors the ADC input channels and writes them at 2kHz to the commissioning frame. I permits the four DAC channels to be driven by filter modules, it provides binary control and monitoring of the eight BIO channels.

I have created a simple MEDM and attached itto the site map (PSL -> 'ISS BEN TEST').

We anticipate more h1psliss code changes as this commissioning progresses during the week.

New GDS code

Jim:

please see Jim's alog.

Reboot h1guardian0

TJ, Dave:

h1guardian0 was rebooted after running 29 days. The loading came down a bit but starts off in the mid-20s.

New digital video camera

see today's alog for details

Wind gust meter attached to h1pemex

Jim W, Jim, Fil, Richard, Dave:

LHO's Young ultrasound 3d anemometer was attached to three spare ADC channels on h1pemex. The channels are ADC_0_12,13,14.

Frame Writer Code Testing

Jonathan:

New daqd code was tested on h1fw0. The new code has been left running.

Beckhoff C1-PLC1 code change

Daniel:

please see Daniel's alog

DAQ Restart

Daniel, Dave:

DAQ was restarted to sync to new h1psliss channels and the latest Beckhoff h1ecatc1plc1.

   After running a low battery shutdown test, dust monitor #7 has been removed from the LVEA. 

Isolated pump carts from HAM5/HAM6 annulus system but leaving carts running.  AIPs were started earlier in the day and pump currents look low enough as to not need assistance -> Will shut down 2 of 4 running pump carts in the morning if not needed.  Other pump carts will need to run until Friday morning judging from current data

TITLE: 08/16 Day Shift: 15:00-23:00 UTC (08:00-16:00 PST), all times posted in UTC
STATE of H1: Aligning
INCOMING OPERATOR: Jeff
SHIFT SUMMARY: Pretty busy mintenance day. Much more than I expected at least. TCS crew is still working on diagnosing TCSY, commissioners are trying to lock without disturbing them too much.
LOG:

• 14:00 Chris C to both ends for work in the fan rooms.
• 15:08 Bubba to LVEA t ofind 3IFO parts
• 15:13 Ed M in and out of LVEA at SUSR3 (WP#6074)
• 15:35 Christina & Karen to ends
• 15:37 Richard to LVEA table camera work
• 15:49 Fil to LVEA t odo cabling over HAM1 and HAM4 (WP#6086)
• 15:50 Corey to LVEA for ISCT1 camera work (WP#6071)
• 16:02 John, Bubba to LVEA
• 16:12 Jason, Alastair to LVEA TCSY work (WP#6083)
• 16:16 Richard to LVEA to Corey
• 16:20 Guardian reboot
• 16:46 Hugh starting HEPI WP work in CS mech room (WP#5986)
• 17:01 Joe to LVEA
• 17:02 Gerardo to LVEA starting cable pulling (WP#6089)
• 17:05 Norco at the gate
• 17:05 Corey out
• 17:12 Vern, Alastair, Jason to LVEA looking at TCS inventory
• 17:14 Joe out
• 17:52 PSL FE restart (WP#6084)
• 17:56 Joe to all out buildings
• 18:00 Marc to Ends for CPS timing update (WP#6092)
• 18:09 Rich, CJ to LVEA for PCal ITMX pictures (WP#6078)
• 18:38 Jim W, Ian to EX for annemometer work
• 18:45 Hugh to end stations for HEPI maintenance
• 18:51 Marc back from ends
• 18:57 Joe back
• 19:05 Jim W, Ian back
• 19:13 Jason, Alastair out for lunch
• 19:20 Hugh back from end stations
• 19:30 Gerardo out
• 19:47 Mike and guest into LVEA for tour
• 19:53 Richard to LVEA to Fil
• 19:54 Ben Abbot to LVEA to PSL rack
• 19:56 Richard out
• 20:10 Rick, CJ to LVEA to PCal ITMX
• 20:12 Fil out
• 20:38 PSL tripped off
• 20:46 Mike, guest out
• 21:09 Fil to CER (WP#6034)
• 21:15 Dave, Jim back from EX
• 21:24 Ben to LVEA to PSL racks
• 21:43 Jason back out to TCSY
• 22:24 Kyle to LVEA to get temps for vertex RGA
• 23:02 Fil back out to check on magnetometer near HAM2

PEM power supplies in the CER mezzanine were swapped out for Kepco model JQE supplies. This model is a 1/4 rack version, and allows for four power supplies to be mounted on one shelf. This is to make room for the ±24V power supplies that will be used to power Beckhoff/Baffle PD Amplifier/ Spool X/Y camera ect. All PEM instrumentation microphones, magnotometers, ect. were powered down from around 10:30 am to 1:00 pm. All power is now restored.

Cabling for the readbacks for the TCS RF Amp was pulled in this morning. Readbacks are connected to the slow controls concentrator in rack ISC-C3 slot U33/32, port 3. This closes out fault report 6025.

The PSL power watchdogs tripped at 20:38:13 UTC (13:38:13 PDT).  The cause appears to be the NPRO turning off.  In the attached trend the NPROOK channel, which monitors if the NPRO is working or not. goes to zero (indicating the NPRO turned off) at 20:38:08 UTC, 5 seconds before the power watchdogs trip.  The cause of the NPRO turning off is currently unknown.  I am bringing the PSL back up.

The most recent svn software version is running now on all Beckhoff computers. Changes In detail:

• Support for Twincat 3 in tcioc (should have no effect).
• AS protection: Added reset button for test and lock loss statistics.
• AS protection: The high power locking flag now requires the trigger photodiode to exceed the high level for a minimum of 1 second.
• AS protection: Aborting a test now causes the fault flag to show "Aborted".
• AS protection: Code interface documentation at E1600257.
• WFS demod: Fixed LO power calculation.
• tcioc startup: Added a 2 sec delay in End-X to prevent the tcioc to start running before TwinCAT is ready.
• Corner PLC3: Allocated more memory for constants, since we were running short.

All computers have been booted to make sure we are running a clean version.

Jim W. noted that a bleeding off of these accumulated saturation counts should be added to the HEPI models and this task depreciated. Only HAM1 had saturation counts to reset (it is not on the HEPI L4C WD SAT Monitor MEDM screen). Jim W. reset it and I did not see the number of counts.

Re WP 5986.  Currently just running three of the four pumps at the Corner Station as I have one off for cleaning.  This pump has been running from the beginning with little break and I was not always so fastidious about cleaning up the drips.  It was an mess and I think there are are a couple bearing leaks at the motor and the pump.  Being cleaned up now though will help evaluate if further action/worry is warranted.  With just three pumps running the drive out to the pumps is about 30% higher than before--may show in a periodic famis task if it is executed during this period.

It's ready to go back together and essentially it is together but some of the fasteners are just impossible to get to without disconnecting plumbing (messy.)  Going to shop for or fabricate a couple custom tools to help reassembly.  WP remains open.

(M. Pirello)

Per Richard's Work Permit #6092 I reprogrammed both CPS fanouts in the LVEA, and the ones on the X and Y end stations.  Programming was successful and the heartbeat LED's are now off.

WP 6087

The GDS software has been updated to branch 2.17.4 to address Bugzilla 897, 936, and 952.  Release notes (T1600007) document has been updated.  This affects Ubuntu 12 and Ubuntu 14 workstations.

Tues. maintenance task 

(Corey, Fil, Richard M, Sheila)

Per Fil's Work Permit #6071 (Fil took care of running/connecting the camera's shielded network cable to the table's Patch Panel earlier):

• Went inside ISCT1 to remove the POP analog camera (see drawing photo & D1201103) + the internal cables for it.  I did NOT remove the external cable.  The external cable was left connected on the outside of the Analog Video Patch Panel #3 Connector, (see photo) and this could be removed any time.
• Installed (coarsely) a new GigE Camera + internal network cable.  This camera still should have its alignment checked, but this requires a locked H1.  This camera is connected on the GigE Camera Patch Panel #2 on connector #1.  (see photo)
  • Richard fired up the camera and said it looks good.  
  • This camera will need to be added and/or labeled on the H1VID_DIGITAL_OVERVIEW.adl
  • Action Item:  Update drawing D1201103 (when I have time and also learn how to use omnigraffle).
• Side Note:  Richard replaced the #1 & #2 network cables (connected to GigE Camera Patch Panel#1) with new shielded cables.

Work Permit #6071 can now be CLOSED.

I have added a check to the LocklossShutterCheck guardian that will add to the guardian log a note whether the HAM6 GS13s saw a large kick or not.  Note that this does not in any way change the functionality of this guardian, in that it still requires an Operator to run and look at the plot, then manually reset this guardian. 

However, we should be able to look through the guardian log to ensure that each time we lose lock, the log notes that the GS13s saw a big kick.  When we are satisfied that this is a good measure of the shutter having closed at the last lockloss, we can consider using it as an automation metric in lieu of Operators manually resetting the guardian. 

I have set the threshold for "big kick" for the GS13 to be 30,000 nm/s (1nm/s / count, so 3e4 counts).  When the shutter closes fast, the GS13 sees a signal as large as 90,000 nm/s, but when the shutter closes slowly it only kicks the GS13s to about 10,000 nm/s.  The threshold of 30,000 nm/s should differentiate between a fast vs. slow closing of the shutter.  Normal GS13 signal is under 100 nm/s peak. 

Attached is the code, which is also checked into the svn.  The idea is (once we're ready to make this automated) that if we see the GS13 kick, the CheckShutter state will automatically go to the LowArmPower state, and allow the IFO to relock.  If there is any problem, including inability to fetch the data, the guardian will stay in the CheckShutter state, and will require human intervention.  One could also consider adding light level checks to this, but I think that's probably overkill given the other checks that we already have in place.

Sheila Evan Jenne Terra

The IMC length drive has large glitches when only the IMC is locked.  The first attachment shows the MC2 M2 length drive durring a quiet time on July 31st, and a glitchy time today.  There are glitches present in both traces, but they are much louder in the trace from today.  If you look back at data from late July, the glitches have intermittently been present even before we started having trouble locking, so this is probably not the main reason we can't lock. 

The second attachment shows 15 minutes around the time of the July 31st trace, when the glitches transition from being quiet to loud. 

Short version: The new shutter seems to be closing harder than before the vent. This is causing the ISI to trip. So far we have gotten around this by running the ISI in a low gain state, but this makes the table motion much worse above 1 hz.

After the shutter work, we started having problems with trips of the HAM6 ISI when the new shutter trips. This morning we put the ISI in the "Robust" isolated state, which uses low gain isolation loops with UGFs around 10hz. The normal loops have UGFs around 30-40 hz. For now this seems to have eliminated the tripping of the ISI, but the performance of the ISI is much reduced above 1 hz. First plot shows a comparison Y GS13s and ground STS for HAM6 for the two configurations. Red traces are with the high gain loops, blue traces are with the low gain loops. Below 1 hz they look roughly the same (low frequency diffs seem to be mostly in the ground for blue), but at 1 hz the high gain loop is doing ~100x better. Not surprising.

I've looked the GS13s in Z at shutter triggers before and after the vent and the shutter seems to be moving the table a lot more now. Attached plot shows a trigger from today with the 10hz loops (blue), yesterday with 30hz loops ( orange/ spiced cider) and Aug 1st with 30hz loops (red). I've looked over at least 3 events in each configuration and they look remarkably consistent, with respect to ISI configuration. Shutter triggers before the vent seem to have kicked the table less than they do now. Maybe this will reduce as the shutter breaks in?

We have some medium gain loops installed with slightly less gain that the high gain loops, tomorrow during maintenance I'll try testing those, but I doubt they'll be enough. Otherwise, we can come up with some loops with some better compromises between UGF and high frequency roll-off than the low gain loops. But the best option would be to figure out  what can be done to reduce the kick from the shutter.