[Jenne, JeffK, EvanH, Travis]
On our very first lock attempt (that made it past DRMI) after today's maintenence, we lost lock during the BS coil driver switching state. Thanks to today's data saving work (see alog 25329), we now have some data to look at!
Attached are 2 figures of the same lockloss, one of which shows the whole time we were in the COIL_DRIVERS state, and the other zoomed in on the lockloss itself. On the top row of these figures, the left 3 plots are just power buildups, to indicate when the lock was actually lost. The right-most plot is the ISC guardian state - state 505 is COIL_DRIVERS. The bottom row of plots are the new FASTIMONs for each OSEM of the BS M2 stage.
These channels are plotted in units of ADC counts, but we have 40V/2^16 counts over a 40 ohm resistance, and the BS M2 actuation strength is about 1N/A. The features in the LL channel are of order 100 counts, which corresponds to about 15 microNewtons. For longitudinal, this is of order 60 nm of a kick to the BS. The rms for MICH control above 10Hz is only 1e-14 m, so this is 6 orders of magnitude above the rms. For pitch and yaw, this corresponds to about a 2 urad kick to the BS. (Newtons to meters or radians from T1200404).
This seems like plenty to explain our locklosses. Next up: what to do about it?
When you have an xml file made by older diaggui, opening that file using the latest diaggui will cause some problem.
If you do that right after launching the new duaggui, the problem is most obvious because hitting the "Start" button will raise an error message: "No measurement channel defined: Unable to setup test channels."
You need to click and reselect each and every measurement channel. It seems as if these channels are already "selected", but select manually anyway. Hit "start" and this time the measurement starts.
OTOH, once you make any measurements using the new diaggui and open an old file later, hitting "start" will not cause an error, but sometimes not all channels are measured (but sometimes all channels are measured, not sure about the condition).
FRS ticket 4333 was filed.
J. Kissel I'd found it frustrating that the ALS control system overview screens were not linked on the overall ALS overview screen, so I've added links. See attached screenshot. Changes have been committed to the userapps repo, /opt/rtcds/userapps/release/als/common/medm/ALS_CUST_MAIN.adl
In fact, the ALS overview screen already contained links to the X and Y control screens.
ACTIVITY LOG: 15:15 UTC Chris S. headed down X arm for beam tube enclosure sealing 3 doors from end X 15:24 UTC Peter transitioning LVEA to laser safe 15:34 UTC Peter done transitioning LVEA to laser safe 15:35 UTC Peter to H1 PSL to start HPO characterization 16:10 UTC Dale opening OSB receiving rollup door 16:11 UTC Hugh restarting guardian on HAM6 ISI 16:18 UTC Joe D. to LVEA to check batteries, eye wash stations, etc. 16:21 UTC Hugh done guardian update on HAM4 and HAM5, moving to HAM3 16:27 UTC Jeff B. to LVEA to get data from desiccant cabinets and work in the area between the changing room and LVEA 16:30 UTC Filiberto and Richard to LVEA to pull TCS EtherCAT cables from beer garden to mezzanine 16:32 UTC Betsy starting charge measurements 16:46 UTC Jason to H1 PSL to work with Peter 17:01 UTC Received SNEWS alarm as GRB in Verbal Alarms. No indication in GraceDB that it was a test. Arrived at time scheduled for test. 17:03 UTC Cheryl misaligning MC1 to check for light on photodiodes 17:04 UTC Jeff B. done 17:08 UTC Bubba to LVEA to work on crane shimming 17:15 UTC Joe D. done for now 17:17 UTC Hugh tripping HAM5 ISI for guardian update test 17:30 UTC LN2 delivery to mid Y 17:40 UTC Betsy done charge measurements 17:47 UTC Richard removing safety terminals from MSR Beckhoff chassis 17:53 UTC Filiberto done pulling TCS EtherCAT cables by beer garden, moving over to HAM6, Richard helping 18:05 UTC Hugh tripping ITMX for guardian update test 18:14 UTC Hugh done guardian update testing 18:14 UTC Karen and Christina to end stations to clean 18:22 UTC Kyle going to Y2-8. 18:25 UTC Hugh and Jeff B. to mid X, end X, end Y. 3IF0 inventory at mid X. HEPI maintenance at end X and end Y. 18:28 UTC Richard and Filiberto done in LVEA. Filiberto starting modification of Beckhoff Corner Chassis 4. 18:32 UTC Paradise water delivery 18:33 UTC Filiberto powering down Corner Chassis 4, removing chassis, adding terminals 18:47 UTC Corner Chassis 4 down 18:51 UTC Joe D. back to LVEA 18:57 UTC LN2 delivery to gate, Kyle directing driver to CP6 19:11 UTC Evan to CER 19:14 UTC I untripped MC2, noted that nothing was going to the DAC, was in safe mode, Cheryl put it to aligned 19:14 UTC Cheryl moving IMs 19:23 UTC Evan measuring voltage out of ITMY PUM coil driver SUSAUX123 model restarted 19:29 UTC ASC model restarted 19:31 UTC Hugh back from end/mid stations, going to mechanical room 19:31 UTC Kyle to end X to pickup part 19:34 UTC SUS ITMX RMS UL WD tripped from Evan disconnecting coil driver 19:42 UTC Jim W. recompiling end X BSC ISI model (WP 5717) 19:49 UTC Jim W. taking ETMX to damped 19:51 UTC Coca Cola delivery through gate 19:54 UTC Kyle back to CS for lunch 19:58 UTC SUSAUX ETMX/Y models restarted 20:05 UTC Richard to roof to look at GPS antennas 20:12 UTC Richard back from roof 20:23 UTC TJ reloading ISC lock guardian 20:31 UTC DAQ restart 20:54 UTC Richard removing safety terminals from MSR Beckhoff chassis 20:58 UTC Bubba to LVEA to move cleanroom, continue working on crane shimming 21:01 UTC Richard done removing safety terminals 21:02 UTC ETMX working, Jim W. taking measurements 21:09 UTC Jason and Peter breaking for lunch 21:17 UTC Dave restarting ISS model 21:20 UTC Jim W. taking down all BSC ISIs except ETMX, preparing for model restart (ETMX already done) 21:35 UTC Dave restarting all BSC ISI models except ETMX 21:45 UTC DAQ restart 21:53 UTC Filiberto replacing Corner Chassis 4 21:56 UTC LSC filter module changes applied 22:05 UTC Filiberto done. Richard and Filiberto to end Y to look at chassis 22:12 UTC Jason to H1 PSL. Peter already there. 22:23 UTC Jenne taking graduate students from Australia to measure electronics by HAM6 22:34 UTC Kyle to LVEA TJ leading tour in CR 22:46 UTC Jenne done 23:19 UTC Filiberto to LVEA to run RF cabling for ASC triplexor 23:26 UTC Dave and Jim B. running timing cable for conlog-test-master 23:30 UTC Kyle to CP3 overfill 23:31 UTC Bubba and John done crane shimming 23:55 UTC Evan redoing measurement from this morning
Today I set up the LASER_UP state which monitors the system once the locking is done. The power output and PZT voltage output are monitored and if they exceed allowed values guardian goes back to the FIND_LOCK_POINT state to try to find a new locking point.
I also added another assert class that monitors the chiller temperature setpoint throughout the locking process including the final LASER_UP state, so that the temperature set point doesn't run away to a value that can cause the chiller to trip off. When a chiller setpoint that is outside of the allowed range is detected it goes back to the DOWN state, resets the chiller setpoint and then starts moving back up through to LASER_UP.
Guardian has now also been set up for the X-arm laser, tested, and is now working.
Dave has taken a safe snap of the system in the DOWN guardian state to record new gain settings and the filter settings for when the servos are off.
Dave, Cao, Evan
We wanted to check briefly how the electronics noise of the PUM coil drivers compares to the excess noise in DARM.
With an SR785, we measured the voltage noise spectra out of the IX and IY coil driver chassises (going to the satellite boxes), and below 80 Hz we found them all to be below to the noise floor of the SR785 (40 nV/rtHz at 10 Hz, 10 nV/rtHz at 100 Hz). On the other hand, in order to explain a 1/f4 DARM noise of 1×10−19 m/rtHz at 30 Hz, this would require a white voltage noise at the coil output of 190 nV/rtHz for a single coil, or 50 nV/rtHz for 16 coils with uncorrelated noise.
If we want a good measurement (not just an upper limit) of this coil driver noise, we should use a FET-buffered preamp for reading out the signal.
While working through the SUSAUX medms (my previous entry), it became clear to many of us (Dave included) that the SUSAUX drop downs from the sitemap linked to old and unused screens. So, we removed them from the sitemap. I then reorganized the sitemap in a small way to cleanup. Most notably, IOO is now in it's seemingly more proper place under the left MAIN side of the sitemap.
Screenshot of new map. It has been committed to SVN.
Today, Kissel and I worked through completing the following (taken from ECR E1600033) for the SUSAUX QUAD and BS models. This meant recompiling and restarting h1susauxb123, h1susauxex, and h1susauxey with CDS and building new medms screens.
1) Remove SUS NOISE and VOLT MONs from all UPPER stages of SUSes, and non-globally controlled LOWEST stages, and replace with FAST_I_MONs with same data rate.
2) Remove SUS NOISE and VOLT MONs from frames of 10 SUSes under global control and replace with FAST_I MONs (or Fast LV ESD MONs where applicable) with increased data rate of 16k.
3) We will add associated filter banks for every FAST_I_MON.
Data rate calculations show that there will be a zero sum gain to the Science frames by performing the above (see supporting spreadsheet on DCC page).
New FASTIMON screens are shown below. All model and medm changes have been committed to the SVN.
Due to this change, when you try to look at LVESDAMON further back in time than this afternoon, DTT says "synchronization error".
This is where you can use the new feature of DTT.
Work continued with the install/cabling of the WFS Centering RF Triplexer electronics. - Powered up new Distribution Amp and whitening chassis - Installed some of the new RF cabling to the demod and Dist Amplifier. None of the existing cabling was disconnected - Routed the RF Monitor outputs of the I&Q Demodulator to the Demod Concentrator chassis
reported by Masayuki Nakano (I used this account because the firefox remembers it)
The new ISS second loop medm screen, '/opt/rtcds/userapps/release/psl/common/medm/ISS/PSL_CUST_SECONDLOOP.adl' has been made.
The privious screen is remained as '/opt/rtcds/userapps/release/psl/common/medm/ISS/SL.adl"
Filiberto removed Beckhoff Corner Chassis 4 from the CER. He added two EL3104 terminals at the end of the left rail and swapped the L10 EL9190 terminal for an EL9410 terminal. The two EL3014 terminals were already added to the system manager but disabled. I enabled them. I also added the EL9410 terminal and removed the EL9190 terminal. I checked that the changes matched a scan of the boxes and that an activate configuration worked. I saved the system manager file and committed it to svn (rev 2651). I then used Daniel's GUI to restart everything. I had to start PLC3 by hand. Last week I updated HartmannSensor.lib to add normalized position channels and committed it to svn (rev 2647). These channels are now available in EPICS: H1:TCS-ITMX_HWS_POSITIONDETECTOR1XNORM H1:TCS-ITMX_HWS_POSITIONDETECTOR1YNORM H1:TCS-ITMX_HWS_POSITIONDETECTOR2XNORM H1:TCS-ITMX_HWS_POSITIONDETECTOR2YNORM H1:TCS-ITMY_HWS_POSITIONDETECTOR1XNORM H1:TCS-ITMY_HWS_POSITIONDETECTOR1YNORM H1:TCS-ITMY_HWS_POSITIONDETECTOR2XNORM H1:TCS-ITMY_HWS_POSITIONDETECTOR2YNORM
Chassis S1107450 modified to wiring diagram E1101222-v2. This was to add readbacks for another AS demod chain.
Dave restarted the DAQ to add these channels to the frame.
~1535 1555 hrs. local -> To and from Y-mid Next over-fill to be Thursday, Feb. 4th before 4:00 pm
The articulating boom lift, (10,000 lbs.) is blocking the walk way at the corner near HAM 3 & 4. You could climb over the tire, however, the preferred route would be around HAM 1.
The boom lift will need to be moved several more times along the walkway it is in currently. The crane rail that is being shimmed needs to be done in steps which require multiple supports to be unbolted simultaneously. Some bolts remain in the loosened supports for safety.
DaveB rebooted the ASC model for me earlier today. I have confirmed that all of the signals go through the matrices as I expect.
I have also copied antiwhitening filters into the individual segment filter banks of the new AS 90 WFS, and loaded the whole ASC Foton file
Tomorrow morning, Elli, Cao and I will go with Rich and Fil to measure the relative phase between the I and Q channels of each segment. After that, we should be ready to start using the new AS 90 channels (setting the analog gain and whitening, digital demod phasing, etc.).
WP #5710
I have added two functions in the PSL ISS front end model. Both are related to the second loop and not to the first loop. The model has been compiled, installed and restarted. The changes I made are:
I have not yet tested these functions. Since the changes are additive to the existing model, one can still use the guardian to engage the second loop.
The attached is a half-baked and inaccurate medm which shows the new functions. Even though it is inaccurate, it is conceptually good enough to show what I implemented.
The trigger logic is shown in the right hand side of the screen. It watches the amount of the signal (i.e. SECONDLOOP_SIGNAL) which would go to the inner loop and triggers the second loop when it meets the trigger setting.
The software AC coupling function is show in the left of the screen. When one wants to keep using the manual silder to adjust the offset, one can fill the first row of the matrix which plugs the slider value to the offset point. When one wants a slow servo as the guardian has been doing, one can plug three different error signals and correct the offset point depending on the engagement steps.
Currently, Masayuki is editing the screen.