Reports until 22:44, Monday 20 May 2024
H1 CDS (Lockloss)
anthony.sanchez@LIGO.ORG - posted 22:44, Monday 20 May 2024 - last comment - 22:57, Monday 20 May 2024(77954)
Monday Mid Shift Update

TITLE: 05/21 Eve Shift: 2300-0800 UTC (1600-0100 PST), all times posted in UTC
STATE of H1: Lock Acquisition
OUTGOING OPERATOR: Ryan C
CURRENT ENVIRONMENT:
    SEI_ENV state: CALM
    Wind: 17mph Gusts, 13mph 5min avg
    Primary useism: 0.08 μm/s
    Secondary useism: 0.11 μm/s
QUICK SUMMARY:

Took H1 Out of Observing to do a SQZr Scan.

Incoming 5.4M Earthquake.  - Survived it.

Locklosss from Observing 02:31 UTC
Screenshots attached.

H1 made it all the way up to LOW_NOISE_LENGTH_CONTROL and was knocked out of lock by what I pessumed was wind. But looking at the scopes I dont see any extreme gusts.

On the Second locking attempt H1 also made it to LOW_NOISE_LENGTH_CONTROL, But both times i made it to that state it lasted 2 seconds and 124ms, then lost lock. which looks suspicious.

I started to try to open ISC_LOCK to stop it from getting to that state, and was greated with the following.

 

Traceback (most recent call last):
  File "/var/opt/conda/base/envs/cds/bin/guardmedm", line 11, in
    sys.exit(main())
  File "/var/opt/conda/base/envs/cds/lib/python3.10/site-packages/guardian/medm/__main__.py", line 177, in main
    system.load()
  File "/var/opt/conda/base/envs/cds/lib/python3.10/site-packages/guardian/system.py", line 400, in load
    module = self._load_module()
  File "/var/opt/conda/base/envs/cds/lib/python3.10/site-packages/guardian/system.py", line 287, in _load_module
    self._module = self._import(self._modname)
  File "/var/opt/conda/base/envs/cds/lib/python3.10/site-packages/guardian/system.py", line 159, in _import
    module = _builtin__import__(name, *args, **kwargs)
  File "", line 1129, in __import__
  File "", line 1050, in _gcd_import
  File "", line 1027, in _find_and_load
  File "", line 1006, in _find_and_load_unlocked
  File "", line 688, in _load_unlocked
  File "", line 883, in exec_module
  File "", line 241, in _call_with_frames_removed
  File "/opt/rtcds/userapps/release/isc/h1/guardian/ISC_LOCK.py", line 8, in
    import ISC_GEN_STATES
  File "/var/opt/conda/base/envs/cds/lib/python3.10/site-packages/guardian/system.py", line 159, in _import
    module = _builtin__import__(name, *args, **kwargs)
  File "", line 1129, in __import__
  File "", line 1050, in _gcd_import
  File "", line 1027, in _find_and_load
  File "", line 1006, in _find_and_load_unlocked
  File "", line 688, in _load_unlocked
  File "", line 883, in exec_module
  File "", line 241, in _call_with_frames_removed
  File "/opt/rtcds/userapps/release/isc/h1/guardian/ISC_GEN_STATES.py", line 5, in
    import ISC_library
  File "/var/opt/conda/base/envs/cds/lib/python3.10/site-packages/guardian/system.py", line 159, in _import
    module = _builtin__import__(name, *args, **kwargs)
  File "", line 1129, in __import__
  File "", line 1050, in _gcd_import
  File "", line 1027, in _find_and_load
  File "", line 1006, in _find_and_load_unlocked
  File "", line 688, in _load_unlocked
  File "", line 883, in exec_module
  File "", line 241, in _call_with_frames_removed
  File "/opt/rtcds/userapps/release/isc/h1/guardian/ISC_library.py", line 1189, in
    class DUMP_SDF_DIFFS():
  File "/opt/rtcds/userapps/release/isc/h1/guardian/ISC_library.py", line 1199, in DUMP_SDF_DIFFS
    dcuid = str(models.fec)
AttributeError: 'generator' object has no attribute 'fec'

 

Images attached to this report
Comments related to this report
david.barker@LIGO.ORG - 22:14, Monday 20 May 2024 (77955)

Tony, Dave:

We noticed that two scripts in isc/h1/guardian had been changed this afternoon around 16:22 relating to the errors being seen. I made a backup copy of ISC_library.py and ISC_LOCK.py and removed the recent changes using the subverion revert command. The immediate problem of ISC_LOCK's non-functioning ALL button was resolved.

rw-rw-r--  1 david.barker     controls  45K May 20 22:05  ISC_library.py_20may2024
-rw-rw-r--  1 david.barker     controls  39K May 20 22:05  ISC_library.py
-rw-rw-r--  1 david.barker     controls 302K May 20 22:08  ISC_LOCK.py_20may2024
-rw-rw-r--  1 david.barker     controls 300K May 20 22:08  ISC_LOCK.py
 

anthony.sanchez@LIGO.ORG - 22:57, Monday 20 May 2024 (77956)

Ok Looking more into these locklosses in LOW_NOISE_LENGTH_CONTROL logs. They both stop exicuting lines at the same time.

Using Meld I was able to find the difference between the 2 versions of ISC_lock.py within the Low_Noise_Length_control Guardian state.

It looks like line 5559 was commented out.
#ezca['LSC-PRCL1_OFFSET'] = -62 # alog 76814

Update:
Jenne wants that to stay put. Cause it needs to stay at 0.

I will walk it through line by line using the guardian command.
 

Images attached to this comment