At 16:08 Thu 25 July 2024 the continuous wave psinject excitation on h1calinj stopped running.

After investigation, I found that this process could not restart because of an expired leapseconds file on h1hwinj1. From the end of June onwards it would not have been able to restart, but was eventually restarted on Thursday 25th July. We currently do not know why the process restarted on Thursday.

The fix was to manually edit the /usr/share/zoneinfo/leapseconds file and change the lines:

#Expires 2024   Dec     28      00:00:00
#expires 1735347600 (2024-12-28 00:00:00 UTC)
#       File expires on:  28 December 2024
 

I had disabled monit during this investigation. After fixing the leap seconds and undid all my temp changes and performed a monit controlled restart of psinject with no problems.