Keita, Sheila, Jenne, TJ, Kiwamu,
We had one lockloss today due to an unstable behavior in the 3rd loop. Looking at the data, we figured that this was caused by the dynamic power normalization (H1:PSL-PWR_SCALE_OFFSET) which introduced glitches to the TR signals through the (discretized) normalization. These glitches then propagated to the 1st loop through the 3rd loop and eventually caused the lockloss. This is actually something Jenne and I thought we fixed two days ago by editing the LASER_PWR guardian (not aloged). We checked that the guardian code had been appropriately edited; it seems that the edition has not been effective for some reason. We restarted the node to enforce the edition. So the dynamic normalization should not happen when LASER_PWR reaches the requested stable state. Hopefully this will be the last time to talk about this issue.
The attached shows time series data, showing the glitches by the dynamic normalization.