Camilla, TJ

Sheila asked us to look for post vent point absorbers, but when we went to check, we found that the code hadn't been running since May 23rd.

Looking further into it, we could log into the machines and open the tmux sessions, but the code was frozen from May 23 821UTC and could not be Control C'd. I then tried a pkill on that python process, this also did not work. Trying to reboot the machines remotely aslo didn't work. I power cycled the machines from the MSR, then we were finally able to start the code up. ITMX needed the camera initialized for some reason.

We are thinking about ways to catch this in the future, maybe having DIAG_MAIN monitoring if values are updating properyly.