CO2X unlocking has kicked us out of observing 3 times in the last month 71213 each time it relocked within 1m30.
Each time this is seen, the average CO2X laser temperature has risen above 24.265degC. 1 month plot attached, look at yellow H1:TCS-ITMX_CO2_LASERTEMPERATURE channel. I seen no slow trend with the PZT but it does quickly fall down towards zero before unlock.
Solutions: We could take a average of temperature over 60 seconds (as this is +/-0.1deg) and if we are in ISC_LOCK DOWN state and if it's over this, have TCS_ITMX_CO2 relock. A better solution would be to tweak chiller setpoint slightly lower, I would do this at the start of Tuesday maintenance so we have time to see any immediate issues.
Other times we've gone out of observing in the past month is for the SQZ SHG to relock for 1m50s on 07/09 71595 and 1m45s on 07/11 for FC IR unlock 71597. Tagging GRD for Automation timers.
This morning I changed H1:TCS-ITMX_CO2_CHILLER_SET_POINT_OFFSET form 20.78 to 20.65degC, see attached. Hoping that his will keep the laser in a happier place.
The guardian does move this set point around when it cannot lock with the PZT alone, see attached, so I'm not sure how much this will help.
