2023-09-10_06:46:14.521179Z LOCKLOSS_SHUTTER_CHECK [HIGH_ARM_POWER.run] power went below threshold 2023-09-10_06:46:14.573989Z LOCKLOSS_SHUTTER_CHECK JUMP target: CHECK_SHUTTER 2023-09-10_06:46:14.573989Z LOCKLOSS_SHUTTER_CHECK [HIGH_ARM_POWER.exit] 2023-09-10_06:46:14.627334Z LOCKLOSS_SHUTTER_CHECK JUMP: HIGH_ARM_POWER->CHECK_SHUTTER 2023-09-10_06:46:14.627508Z LOCKLOSS_SHUTTER_CHECK calculating path: CHECK_SHUTTER->HIGH_ARM_POWER 2023-09-10_06:46:14.627711Z LOCKLOSS_SHUTTER_CHECK no path from CHECK_SHUTTER->HIGH_ARM_POWER 2023-09-10_06:46:14.628415Z LOCKLOSS_SHUTTER_CHECK executing state: CHECK_SHUTTER (20) 2023-09-10_06:46:14.633541Z LOCKLOSS_SHUTTER_CHECK [CHECK_SHUTTER.enter] 2023-09-10_06:46:14.636348Z LOCKLOSS_SHUTTER_CHECK [CHECK_SHUTTER.main] timer['datawait'] = 5 2023-09-10_06:46:14.698615Z LOCKLOSS_SHUTTER_CHECK [CHECK_SHUTTER.run] USERMSG 0: run shutter check, then manually take to low power 2023-09-10_06:46:19.638475Z LOCKLOSS_SHUTTER_CHECK [CHECK_SHUTTER.run] timer['datawait'] done 2023-09-10_08:16:24.818466Z LOCKLOSS_SHUTTER_CHECK REQUEST: CHECK_SHUTTER 2023-09-10_08:16:24.818466Z LOCKLOSS_SHUTTER_CHECK calculating path: CHECK_SHUTTER->CHECK_SHUTTER 2023-09-10_08:16:35.762037Z LOCKLOSS_SHUTTER_CHECK REQUEST: LOW_ARM_POWER 2023-09-10_08:16:35.762687Z LOCKLOSS_SHUTTER_CHECK calculating path: CHECK_SHUTTER->LOW_ARM_POWER 2023-09-10_08:16:35.762687Z LOCKLOSS_SHUTTER_CHECK no path from CHECK_SHUTTER->LOW_ARM_POWER 2023-09-10_08:17:20.562983Z LOCKLOSS_SHUTTER_CHECK MODE: MANUAL 2023-09-10_08:17:23.063921Z LOCKLOSS_SHUTTER_CHECK REQUEST: LOW_ARM_POWER 2023-09-10_08:17:23.064646Z LOCKLOSS_SHUTTER_CHECK REDIRECT requested, timeout in 1.000 seconds 2023-09-10_08:17:23.064920Z LOCKLOSS_SHUTTER_CHECK REDIRECT wait for worker completion... 2023-09-10_08:17:23.131544Z LOCKLOSS_SHUTTER_CHECK REDIRECT wait for worker completion... 2023-09-10_08:17:23.192137Z LOCKLOSS_SHUTTER_CHECK REDIRECT wait for worker completion... 2023-09-10_08:17:23.268061Z LOCKLOSS_SHUTTER_CHECK REDIRECT wait for worker completion... 2023-09-10_08:17:23.314704Z LOCKLOSS_SHUTTER_CHECK REDIRECT wait for worker completion... 2023-09-10_08:17:23.382510Z LOCKLOSS_SHUTTER_CHECK REDIRECT wait for worker completion... 2023-09-10_08:17:23.447701Z LOCKLOSS_SHUTTER_CHECK REDIRECT wait for worker completion... 2023-09-10_08:17:23.510557Z LOCKLOSS_SHUTTER_CHECK REDIRECT wait for worker completion... 2023-09-10_08:17:23.575553Z LOCKLOSS_SHUTTER_CHECK REDIRECT wait for worker completion... 2023-09-10_08:17:23.643513Z LOCKLOSS_SHUTTER_CHECK REDIRECT wait for worker completion... 2023-09-10_08:17:23.703087Z LOCKLOSS_SHUTTER_CHECK REDIRECT wait for worker completion... 2023-09-10_08:17:23.774757Z LOCKLOSS_SHUTTER_CHECK REDIRECT wait for worker completion... 2023-09-10_08:17:23.826276Z LOCKLOSS_SHUTTER_CHECK REDIRECT wait for worker completion... 2023-09-10_08:17:23.877879Z LOCKLOSS_SHUTTER_CHECK REDIRECT wait for worker completion... 2023-09-10_08:17:23.951011Z LOCKLOSS_SHUTTER_CHECK REDIRECT wait for worker completion... 2023-09-10_08:17:24.007345Z LOCKLOSS_SHUTTER_CHECK REDIRECT wait for worker completion... 2023-09-10_08:17:24.078672Z LOCKLOSS_SHUTTER_CHECK REDIRECT wait for worker completion... 2023-09-10_08:17:24.079151Z LOCKLOSS_SHUTTER_CHECK REDIRECT timeout reached. worker terminate and reset... 2023-09-10_08:17:24.085277Z LOCKLOSS_SHUTTER_CHECK worker terminated 2023-09-10_08:17:24.100801Z LOCKLOSS_SHUTTER_CHECK W: initialized 2023-09-10_08:17:24.123691Z LOCKLOSS_SHUTTER_CHECK W: EZCA v1.4.0 2023-09-10_08:17:24.124734Z LOCKLOSS_SHUTTER_CHECK W: EZCA CA prefix: H1: 2023-09-10_08:17:24.124734Z LOCKLOSS_SHUTTER_CHECK W: ready 2023-09-10_08:17:24.124999Z LOCKLOSS_SHUTTER_CHECK worker ready 2023-09-10_08:17:24.127763Z LOCKLOSS_SHUTTER_CHECK EDGE: CHECK_SHUTTER->LOW_ARM_POWER 2023-09-10_08:17:24.129082Z LOCKLOSS_SHUTTER_CHECK executing state: LOW_ARM_POWER (1) 2023-09-10_08:17:24.137014Z LOCKLOSS_SHUTTER_CHECK [LOW_ARM_POWER.enter] 2023-09-10_08:17:24.199208Z Warning: Duplicate EPICS CA Address list entry "10.101.0.255:5064" discarded 2023-09-10_08:17:24.267049Z LOCKLOSS_SHUTTER_CHECK [LOW_ARM_POWER.run] power went above threshold 2023-09-10_08:17:24.323784Z LOCKLOSS_SHUTTER_CHECK JUMP target: HIGH_ARM_POWER 2023-09-10_08:17:24.379388Z LOCKLOSS_SHUTTER_CHECK JUMP target: HIGH_ARM_POWER ... a lot of this.. ... 2023-09-10_08:17:39.883966Z LOCKLOSS_SHUTTER_CHECK JUMP target: HIGH_ARM_POWER 2023-09-10_08:17:39.945750Z LOCKLOSS_SHUTTER_CHECK JUMP target: HIGH_ARM_POWER 2023-09-10_08:17:40.007468Z LOCKLOSS_SHUTTER_CHECK MODE: MANAGED 2023-09-10_08:17:40.008208Z LOCKLOSS_SHUTTER_CHECK MANAGER: assigned: USER 2023-09-10_08:17:40.009089Z LOCKLOSS_SHUTTER_CHECK JUMP target: HIGH_ARM_POWER 2023-09-10_08:17:40.009200Z LOCKLOSS_SHUTTER_CHECK [LOW_ARM_POWER.exit] 2023-09-10_08:17:40.009371Z LOCKLOSS_SHUTTER_CHECK STALLED 2023-09-10_08:17:40.066746Z LOCKLOSS_SHUTTER_CHECK JUMP: LOW_ARM_POWER->HIGH_ARM_POWER 2023-09-10_08:17:40.066746Z LOCKLOSS_SHUTTER_CHECK calculating path: HIGH_ARM_POWER->LOW_ARM_POWER 2023-09-10_08:17:40.066746Z LOCKLOSS_SHUTTER_CHECK no path from HIGH_ARM_POWER->LOW_ARM_POWER 2023-09-10_08:17:40.066746Z LOCKLOSS_SHUTTER_CHECK executing state: HIGH_ARM_POWER (10) 2023-09-10_08:17:40.073027Z LOCKLOSS_SHUTTER_CHECK [HIGH_ARM_POWER.enter] 2023-09-10_08:18:02.571215Z LOCKLOSS_SHUTTER_CHECK MODE: AUTO 2023-09-10_08:18:02.571215Z LOCKLOSS_SHUTTER_CHECK MANAGER: removed 2023-09-10_08:18:02.574153Z LOCKLOSS_SHUTTER_CHECK STALL cleared 2023-09-10_08:20:03.447545Z LOCKLOSS_SHUTTER_CHECK REQUEST: HIGH_ARM_POWER 2023-09-10_08:20:03.451309Z LOCKLOSS_SHUTTER_CHECK calculating path: HIGH_ARM_POWER->HIGH_ARM_POWER