Reports until 11:11, Wednesday 22 March 2017
H1 CDS (SEI)
david.barker@LIGO.ORG - posted 11:11, Wednesday 22 March 2017 - last comment - 13:32, Wednesday 22 March 2017(35001)
HEPI pump controller glitch confirmed to be due to anacron running at 04:02 daily

FRS7667. Hugh, Jim, Dave

we have tracked the daily/weekly HEPI pump controller glitches to when crond deamon runs anacron/logwatch job at 04:02 daily and 04:22 weekly on Sunday.

When the clock was fixed at EY from being 7 hours 34 minutes in the future yesterday, today's EY glitch happened at exactly 04:02 PDT (and not 20:44 PDT as it was prior).

We are investigating 1) how can a cron job cause this issue and 2) can we just turn crond off safely.

attached image shows today's EY glitch at 11:02 UTC (04:02 PDT)

Images attached to this report
Comments related to this report
david.barker@LIGO.ORG - 13:32, Wednesday 22 March 2017 (35007)
Link

I've gone through the path of what cron and anacron do each day and each week. I've culled the list down to the following on h1hpipumpctrley:

hourly : no actions (no change)

daily: only log rotate (removed 8  actions)

weekly: no actions (removed 2  actions)

Lets run the rest of the week with this EY mod to see if it reduces the glitches.