aLIGO LHO Logbook

H1 CDS

patrick.thomas@LIGO.ORG - posted 09:25, Thursday 28 August 2014 - last comment - 11:44, Friday 29 August 2014(13635)

removed 3 frequently changing channels from Conlog

These 3 channels started rapidly changing sometime around 3 or 4 this morning (I'm having trouble getting data for them from dataviewer).

H1:ALS-X_SPARE_A_DEMOD_RFMAX
H1:ALS-X_SPARE_B_DEMOD_RFMAX
H1:LSC-X_TR_A_DC_RESPONSIVITY

I ran camonitor on them. Here is a snippet of the results for H1:ALS-X_SPARE_A_DEMOD_RFMAX. The others were similar.
...
H1:ALS-X_SPARE_A_DEMOD_RFMAX   2014-08-28 09:07:40.377320 -5.47624e+66  
H1:ALS-X_SPARE_A_DEMOD_RFMAX   2014-08-28 09:07:40.387320 2.67673e-83  
H1:ALS-X_SPARE_A_DEMOD_RFMAX   2014-08-28 09:07:40.398321 7.40505e-305  
H1:ALS-X_SPARE_A_DEMOD_RFMAX   2014-08-28 09:07:40.407321 -1.97952e+288  
H1:ALS-X_SPARE_A_DEMOD_RFMAX   2014-08-28 09:07:40.417322 -4.52984e+42  
H1:ALS-X_SPARE_A_DEMOD_RFMAX   2014-08-28 09:07:40.428322 4.45211e-194  
H1:ALS-X_SPARE_A_DEMOD_RFMAX   2014-08-28 09:07:40.438323 -3.29246e+177  
H1:ALS-X_SPARE_A_DEMOD_RFMAX   2014-08-28 09:07:40.448324 4.60892e+278  
H1:ALS-X_SPARE_A_DEMOD_RFMAX   2014-08-28 09:07:40.457324 3.91205e-35  
H1:ALS-X_SPARE_A_DEMOD_RFMAX   2014-08-28 09:07:40.467325 7.40505e-305  
H1:ALS-X_SPARE_A_DEMOD_RFMAX   2014-08-28 09:07:40.478325 2.06671e+235  
...

I think they originate in Beckhoff. I have instructed Conlog to stop recording them for the time being by adding them to the exclude list and regenerating the channel list.

Comments related to this report

patrick.thomas@LIGO.ORG - 09:41, Thursday 28 August 2014 (13636)

Link

As Jim B. pointed out, the end X Beckhoff PLC 2 has gone haywire. The new medm readback of its system time is being rapidly overwritten by random numbers. From a trend of H1:SYS-ETHERCAT_X1PLC2_CURRENTTIME_WSECOND, it appears to have started around 3:18 PDT this morning.

james.batch@LIGO.ORG - 10:03, Thursday 28 August 2014 (13638)

Link

Dataviewer shows the X1_PLC2 time display going bad at 03:19 PDT Aug. 28.

patrick.thomas@LIGO.ORG - 10:49, Thursday 28 August 2014 (13641)

Link

Further information:
H1:ALS-X_LOCK_STATEREQUEST got changed to 256 at ~ 3:18.

patrick.thomas@LIGO.ORG - 10:53, Thursday 28 August 2014 (13642)

Link

Restarting the end X Beckhoff computer has not helped.

patrick.thomas@LIGO.ORG - 15:34, Thursday 28 August 2014 (13651)

Link

Upon Daniel's suggestion I did a restart of TwinCAT and then a burtrestore of PLC2 to 08:10 yesterday morning. PLC2 then crashed and I got the error in the attached screenshot. I acknowledged the error and then clicked 'Activate and run' for PLC2. This appears to have fixed it.

Images attached to this comment

patrick.thomas@LIGO.ORG - 11:44, Friday 29 August 2014 (13672)

Link

It appears that an automatic Windows update restarted the computer at 3:15:29 AM PDT.

The relevant events from the Windows system log are attached.

Non-image files attached to this comment

log.txt