During the day it was noticed that the two wall clocks in the control room would reset themselves, either by showing all dashes, or by showing all eights. By late afternoon we noticed that the UTC time was one second in th future while the local time agreed with the front panel of the NTP server. We power cycled the NTP server and then soft reset the UTC clock and all systems now agree with each other.
The cause of the glitching is still not clear, please email me if you notice any clock problems.