The h1ecatc1 Beckhoff computer crashed again. Running with a limited number of channels does not appear to have helped.
One of the ENDY cold cathode gauges seems to have failed this morning. PT 424 (LN pump) has gone to zero and is showing RED. This will be investigated in the next few days. PT423 is only a few feet away and can be used instead.
After last nights Beckhoff crash, Patrick is not running a full IOC set of slow channels. He is testing if reducing the EPICS load on the Beckhoff will increase its stability. While we are not running these IOC channels, I have removed them from the DAQ to "green up" the EDCU. I removed H1EDCU_TIMING.ini and H1EDCU_ECATC1.ini from the h1dc0 master file and restarted the DAQ.
J. Kissel, A. Pele Arnaud and I have given the three PR suspensions a similarly good thrice-over experts check on their infrastructure, along with a few updates and adding things that weren't in place in as-yet non-critical paths: - Installing the ISI to SUS Witness Path (for PRM and PR3), - Installing and turning on the ASC ISCINF 2k to 16k AA filters - Turning on any band-limiting filters that were not already in the Watchdog paths, - Ensuring the watchdog thresholds were set consistently and appropriately, - Confirming the open light current compensation was up-to-date in the OSEMINF banks, - Confirming that the sensor calibration is turned on, - Confirming that the alignment offset calibrations were installed, - Confirming the BIO swtiches were set to State 1, - Installing the OL2EUL matrix (for PR3) - Damping loop gains and filters are as desired, identical to LLO As such, I've taken new safe snapshots, which are now committed to the userapps repo: /opt/rtcds/userapps/release/sus/h1/burtfiles/ h1susprm_safe.snap h1suspr2_safe.snap h1suspr3_safe.snap
P. Fritschel had designed better performance damping filters for the longitudinal degree of freedom for the HSTSs (see LLO aLOG 4739), which have been installed for quite some time at LLO. Further, though the performance isn't necessarily better, the gains for all other degrees of freedom have been tuned to give reasonable Qs, with a consistent set of filters between degrees of freedom (see LLO aLOG 4061). Finally, using these filters, I've reproduced their design in matlab, set them as default filters to be wrapped around the production model, and am able to reproduce closed-loop transfer functions to very good accuracy (see LLO aLOG 6041). In order to take advantage of these changes (better longitudinal performance, site-to-site symmetry, and having a accurate model of the filters in the can), I've copied over the filters and gains from LLO. All of the above refers to the HSTSs. For PR3, an HLTS, its performance has yet to be tested, but I've got a similar successful model of the LLO filters and gains. So, again, in the interest of not having many different configurations of loops scattered about, I've also copied LLO's HLTS filters and gains. So you don't have to go scouring, I'll reproduce the settings here: HSTSs: L: FM3 [resg], FM5 [normL], G = -1.0 T: FM1 [0:30,30], FM5 [normT], FM10 [ellip50], G = -2.0 V: FM1 [0:30,30], FM5 [normV], FM10 [ellip50], G = -3.0 R: FM1 [0:30,30], FM5 [normR], FM10 [ellip50], G = -0.2 P: FM1 [0:30,30], FM5 [normP], FM10 [ellip50], G = -2.0 Y: FM1 [0:30,30], FM5 [normY], FM10 [ellip50], G = -1.0 HLTSs; L: FM1 [0:15,15], FM5 [normL], FM10 [ellip50], G = -2.0 T: FM1 [0:15,15], FM5 [normL], FM10 [ellip50], G = -5.0 V: FM1 [0:15,15], FM5 [normL], FM10 [ellip50], G = -1.0 R: FM1 [0:15,15], FM5 [normL], FM10 [ellip50], G = -0.02 P: FM1 [0:15,15], FM5 [normL], FM10 [ellip50], G = -0.002 Y: FM1 [0:15,15], FM5 [normL], FM10 [ellip50], G = -0.02 Note, the repeat of normL for every degree of freedom in the HLTS is *not* a typo. The purpose of the norm filter is to compensate for the calibration of the OSEMs, and in the case of the HSTSs, to absorb some of the gain of the filter such that the visible GAIN field is of order unity. The calibration is turned on for both types of SUS, so that inversion is in place -- (1/to_um) = 43.478, but we've not yet tuned and absorbed the gains for the HLTSs, so the value is the same for each degree of freedom for that SUS type. All six filter files for H1SUSMC1, H1SUSMC2, H1SUSMC3, H1SUSPRM, H1SUSPR2, H1SUSPR3 have been copied to and committed in the userapps repository, under /opt/rtcds/userapps/release/sus/h1/filterfiles/
found that h1iopsush56 was incorrectly built against RCG2.6.1, we rebuilt against 2.6.2 and restarted. This fixed the bogus ADC bit error in the STATE_WORD.
We noticed h1susmc2 was built Tuesday against a modified RCG2.6.2 and should be rebuilt and restarted at some time.
While scouring the PR SUS screens and EPICs values to be sure they're up-to-date, I noticed that both the HLTS and HSTS overview screens (SUS_CUST_HSTS_OVERVIEW.adl and SUS_CUST_HLTS_OVERVIEW.adl) were still pointing to an old SUS_CUST_HXTS_M3_WD.adl screen which has some preliminary design of the optical lever portion of watchdog and was buggy in its parsing of the status bitword for PR3. Only PR3 has an optical lever, none of the HSTSs have one. I've now updated both overview screens to point to respective HLTS and HSTS M3 WD screens, SUS_CUST_HLTS_M3_WD.adl and SUS_CUST_HSTS_M3_WD.adl respectively. Their screen shots are attached. The updated and new screens have been committed to the userapps repository, under /opt/rtcds/userapps/release/sus/common/medm/hxts/ (Note I've also logged in and svn up'ed this directory, therefore updating the LLO screens for them since it's an noninvasive change, they also have no PR3 or SR3 optical lever yet, and haven't started using the lower stages of their HLTSs). In addition, because the optical lever on PR3 doesn't exist yet, and the band-limiting filter bank on the RMS path wasn't visible/accessible/linked from the previous WD screens, they had remained empty until now. Similar to the OSEM Band-limiting filters (), I've filled in FM1 in the SUM bank ($(IFO):SUS-$(OPTIC)_M3_WD_OPLEV_BANDLIM_SUM) with the 10 Hz low pass, dcBandLim = zpk([],[10],1,"n") (foton design string) and the P and Y paths ($(IFO):SUS-$(OPTIC)_M3_WD_OPLEV_BANDLIM_$(DOF)) with the 0.1 - 10 Hz band pass. acBandLim = zpk([0;8192;-8192],[0.1;10;10],10.1002,"n") (foton design string) Finally, for lack of experience, I've set the minimum SUM threshold to 5000 [ct] (based on half the typical light sum seen on the test mass optical lever), and the maximum RMS threshold also to 5000. (These filters still need to be installed on LLOs HLTSs).
Sanity check:
An overnight accumulation yielded the same results for the Y2 module. Conclusion - We can get reasonable results with a 4 hour accumulation. Temperature overnight 29F.
The bump in pressure at ~3:00 AM(11:00 utc) is not explained - maybe just a gauge artifact.
The h1ecatc1 Beckhoff computer just crashed about 10 minutes ago. Logging in shows a dialog box saying that 'Windows has recovered from an unexpected shutdown'. I will leave it for the night. This means the PSL environment channels are down again.
I ran the powershell script to start just the last set of IOCs (opcThird.ps1). These include the PSL environment channels.
Attached are plots of dust counts > .3 microns and > .5 microns in particles per cubic foot requested from 5 PM March 5 to 5 PM March 6. Also attached are plots of the modes to show when they were running/acquiring data. Data was taken from h1nds1. T0=13-03-06-01-00-00; Length=86400 (s) 420 seconds worth of data was unavailable on this server 1440.0 minutes of trend displayed
Guido M, Joe G, Deepak K
We restored the IMC mirror positions inside their suspension systems based on the Pitch and Yaw OSEM readings to their best lock values (02/10/13 22:20:00). The Pitch/Yaw readings and the Alignment Offsets of the three mirrors are:
MC1:
Alignment Offsets -
Pitch : 355 ct (665.661 urad)
Yaw : 497 ct (1332.258 urad)
Mirror OSEM Value -
Pitch : -2615 urad
Yaw : 46 urad
Length : 80 um
MC2:
Alignment Offsets -
Pitch : 65 ct (121.9 urad)
Yaw : 137 ct (367.8 urad)
Mirror OSEM Value -
Pitch : -21 urad
Yaw : 137 urad
Length : 5 um
MC3:
Alignment Offsets -
Pitch : 543 ct (1018.2 urad)
Yaw : 170 ct (455.7 urad)
Mirror OSEM Value -
Pitch : -855 urad
Yaw : -376 urad
Length : 66 um
I've updated the h1susmc*_safe.snap files this morning with these numbers. In addition, Arnaud noticed yesterday that the MC1 M1 (top stage) open light current compensation OFFSETs and GAINs in the OSEMINF banks were actually the *old* assembly area values instead of the values taken with production electronics from LHO aLOG 4067. I've updated the compensation to use the production electronics numbers, so this is captured in the h1susmc1_safe.snap as well. All three .snaps have been committed to the userapps repository.
Following aLOG 5671, I have started to restore the HEPI at EY this afternoon. Here are the few tasks performed:
- Large offsets were visible in corner 3. (Source of the shift (Feb 25th,2013) is unknown at the moment). I applied offset drives in the local basis to bring back the IPS within 3000 counts.
- I cancelled out IPS offsets in the Cartesian basis
- Few weeks ago, I modified the commissioning scripts such that the minus sign of the feedback loops is introduced in the isolation filters. Before the modification, I temporary put the minus signs in the Output filter bank to be able to use the "ramp up" script. I removed the minus sign from the output filters bank.
- Ramp up isolation filters
- Applied the yaw offset (-737800 counts)
STS-2 (ground instrument) looks currently off centered and signals are pretty flat. Centering the seismometer was unsuccessful.
STS-2s can be re centered either using by pushing the AZ button (front panel of the interface chassis) or using binary outputs. At this point, binary outputs are only controlled by the ISI models (the feature is not implemented in the HEPI models). I noticed that the STS-2 centering bit (at EY) was high whereas it should not (The ISI output word is right). I left the binary output cable (from BO chassis to STS2 chassis) disconnected.
The curtains closest to BSC2 were removed and rolled up for temporary. All extraneous CPStat was removed from the beam tube close to HAM3. Tomorrow, we will rig the HAM3 cleanroom and move it into place as close to BSC2 as possible using the crane.
I restarted the DAQ after the vacuum work was completed today. This added the new IOP models for h1sush56, h1susauxh56, h1seih45 to the DAQ. This closes WP3736.
I extended the H1CDS_STATE_WORD_CUSTOM.adl medm screen to include place holders for MY and EX systems and add a summary of the DAQ systems.
The Perl environment setup scripts have been modified for control room workstations to add a LIGOTOOLSBIN path, which should point to /ligo/apps/${EPICS_HOST_ARCH}/ligotools/bin/
No issues to report here. We had only 5 Apollo crew. Cleanroom was lowering at 8am and the Cartridge was TDC at 1155. Crane full payload was 9560, Cartridge weight 9130lbs (less the 430lb 3point lifter). Apollo took 30 minute lunch and back to raising the cleanroom. Landed and bolted to Support tubes and all torqued, closed up, & exited at 1445.
Thanks to Jodi for lots of prep work as well as Jim Greg & Mitchell and Apollo: Randy, Mark, Mick, Scott & Ed. Thanks to MichaelL for logistical & moral guidance.
I'm sure Dale will provide to images soon.
Results are posted here as well as earlier with the H1 accumulation. The Y2 module appears be be significantly better than Y1 - perhaps 6 times better.
https://alog.ligo-wa.caltech.edu/aLOG/index.php?callRep=5666
9:00 LVEA laser safe
10:00 Start moving the BS quad suspention
14:00 EY in laser hazard (Corey and Kiwamu)
14:15 Pooling water sample
14:20 Student at the control room and around (Dale)
14:30 Fire alarm at the Warehouse triggered by open an oven (contac Justin for more details)
14:45 BS in BSC2 completed
15:00 Safety meeting
Fire alarm activation was a result of dense steam cloud being released from an extended cycle of the Large Parts Washer---this machine is not typically used in this capacity but we will be doing similar procedures for the next few days to clean storage structures for HXTS suspensions. It is possible that the alarm may activate again. Alarm ack by VPW crew per instructions from Richard M---no contact with HFD.
Richard and Gerardo went out and shook some wires and tightened some screws. Fixed.