Reports until 17:03, Tuesday 18 November 2014
H1 CDS (SYS)
david.barker@LIGO.ORG - posted 17:03, Tuesday 18 November 2014 (15147)
guardians restarted to switch off log file cropping

Jamie, Dave [WP4947]

Today we reconfigured and restarted all the guardians to ensure that no log files will be deleted.

The process involved running guardctrl create --all and then stopping and restarting the entire guardian supervision. The guardian nodes did not restart, which Jamie tracked down to default settings after the re-creation. He started all the nodes, but one of the 71 nodes did not restart cleanly (SUS_MC2). A subsequent restart of this node was successful, Jamie is investigating why this happened.

We will most probably reboot the guardian machine next week for OS security patching and at that time check for any node failing to start correctly. Today we just patched bash.

We will keep WP 4947 open to cover next weeks patching.