Detected a large shift this morning on the IPS readings for the ITMX HEPI.  Turns out the Pump Station Controller Servo had died this morning just before 0800pst.  This would have affected all corner station HEPIs.  The pressure data stayed locked at 80psi even though it was very obvious we lost pressure.  The servo must have stopped pushing motor speed and it just went to zero.  I'll see if Dave has any suggestions.  We'd have gotten an invalid data alarm (if we had alarms on this, like we should) and maybe that is good enough.

There was construction activity up on the Mezzinine with the TCS chillers this morning; possibly related but it certainly isn't the first time work has been going on up there.  Anyway, it has been sometime since this or any of the HEPI PS controllers have hung up.  We found the computer running but unresponsive to local or remote I/O.  So we power cycled the DC power supply and once it responded :

ssh controls@h1hpipumpctrll0  (password is not standard)

cd target-new

sudo ./run

This restarted things in a safe non-running mode.  The motor speed was manually ramped up to get near 80 psi on the supply pressure and the servo was then engaged with no problem.

Looking at the ITMX Inductive Position Sensors we see that the system did not return exactly to where it started but that is expected.  But the changes are pretty small with the largest local shift less than 1 mil and the rest all being less than 1/2mil (.0005")