WP 4916
Dan Moraru
The file system for writing frames on h1fw1 has been expanded by attaching a second SATABOY raid similar to h1fw0. This will provide a look back capability similar to h1fw0 as data is written over the coming weeks. The current look back capability of h1fw0 is:
Data | Hours |
---|---|
Commisioning frames | 356 |
Science Frames | 74 |
Minute Trends | 106 |
Second Trends | 851 |
8:15 Jodi and guest to LVEA
8:15 RichardM to LVEA to check ITMX HEPI L4C
9:00 Mitch to LVEA
9:15 Hugh to EX/EY hooking up HEPI Pressure sensors, back at 11:00
10:15 Betsy to LVEA
11:00 Karen to EY
13:30 Betsy back out to LVEA
14:30 JeffB and Andres to LVEA, moving 3IFO sus
15:00 Kyle to EY work wit Rai, back 16:00
I have tried to use the Guardian to isolate HAM2 ISI seven times today and it has never succeeded. Three times early ~8am, twice at 1250, and twice at 1500. Everytime I use the command script it succeeds. Another thing I've noticed the Guardian does differently from the old Command script: The Guardian loads the reference location at the intermediate points whereas the command script does all 6 dofs at the end.
Attached is the GS-13 Spectra after switching to the 100mHz Blends on X Y & Z. Again, it doesn't appear to be a better controller.
The ITMY RH is on at 4W for beam location of the HWS beam.
The default NDS server has been restored to h1nds1. This applies to all new logins, shells, or processes that use NDS, all currently running processes are unaffected and will continue to use h1nds0.
Work under permit 4919 and possible missed stuff from 4917: corner station quit IOC C:/SlowControls: svn update H1ECATC1: PLC3: 'Update from source' C:/SlowControls/Target/H1ECATC1/H1ECATC1.tsm: PLC1 rescan project, PLC3 rescan project; Actions -> Generate mappings, Check configuration; Save Copy C:/SlowControls/Target/H1ECATC1/H1ECATC1.tsm to C:/SlowControls/Scripts/Configuration/H1ECATC1/SYS/H1ECatC1.tsm. svn commit C:/SlowControls/Target/H1ECATC1/PLC3/PLC3.pro: rebuild all, save Copy C:/SlowControls/Target/H1ECATC1/PLC3/PLC3.pro to C:/SlowControls/TwinCAT/Source/Interferometer/Corner/Plc3.pro C:/SlowControls/TwinCAT/Source/Current/Interferometer/Corner/Plc3.pro: Export EXP. svn commit Plc3.pro and Plc3.exp. C:/SlowControls/Target/H1ECATC1/H1ECATC1.tsm: PLC3 rescan project; Actions -> Generate mappings, Check configuration; Save. Copy C:/SlowControls/Target/H1ECATC1/H1ECATC1.tsm to C:/SlowControls/Scripts/Configuration/H1ECATC1/SYS/H1ECatC1.tsm. svn commit H1ECATC1: SYS, PLC1, PLC3: 'Stop', 'Update from source', 'Compile': Compile failed. C:/SlowControls: svn update H1ECATC1: SYS, PLC1, PLC3: 'Stop', 'Update from source', 'Compile', 'Activate and run': TwinCAT PLC Control has stopped working Restart computer quit IOC H1ECATC1: SYS, PLC1. PLC3: 'Stop', 'Update from source', 'Compile': TwinCAT PLC Control has stopped working H1ECATC1: SYS, PLC1. PLC2. PLC3: 'Stop', 'Update from source', 'Compile': TwinCAT PLC Control has stopped working, 'Activate and run': TwinCAT PLC Control has stopped working At this point I don't know what is going on. Going into deeper investigation...
I got the corner station back, now end X is down...'mystery errors' in IOC.
All appear to be back. Burtrestores done to 6:10 am for all PLCs for the corner station, end X and end Y.
I've installed the latest packages on all of the CDS workstations. Unfortunately, this came with an update to nslcd which broke LIGO.ORG authentication when it spammed the nslcd.conf file (fixed). The /etc/apt/sources.list file on the workstations was also updated to point to the new mirror server (ubuntu-mirror).
I'm currently injecting a 50mHz, 2 micro-radian ampltiude sinusoid into ITMY YAW (via the top stage). HWSY is now within a few mm of the conjugate plane of ITMY. The HWS code is running and will measure the apparent tilt at the HWS from the injection oscillation. I will use this to calibrate the magnificiation of the HWSY optical system.
Injection stopped.
Work done under permit 4917: end X quit IOC C:/SlowControls: svn update H1ECATX1: SYS, PLC3: 'Update from source' C:/SlowControls/Target/H1ECATX1/PLC3/PLC3.pro: Project -> Rebuild all; Save C:/SlowControls/Target/H1ECATX1/H1ECATX1.tsm: PLC3 -> Rescan Project; Actions -> Generate Mappings, Check Configuration; Save Copy C:/SlowControls/Target/H1ECATX1/H1ECATX1.tsm to C:/SlowControls/Scripts/Configuration/H1ECATX1/SYS/H1ECatX1.tsm; svn commit Copy C:/SlowControls/Target/H1ECATX1/PLC3/PLC3.pro to C:/SlowControls/TwinCAT/Source/Current/Interferometer/End/PLC3.pro; Export EXP. svn commit Plc3.pro and Plc3.exp C:/SlowControls: svn update H1ECATX1: SYS, PLC3: 'Stop', 'Update from source', 'Compile', 'Activate and run', 'Restart EPICS database' end Y quit IOC C:/SlowControls: svn update H1ECATY1: SYS, PLC3: 'Update from source' C:/SlowControls/Target/H1ECATY1/H1ECATY1.tsm: PLC3 -> Rescan Project; Actions -> Generate Mappings, Check Configuration; Save Copy C:/SlowControls/Target/H1ECATY1/H1ECATY1.tsm to C:/SlowControls/Scripts/Configuration/H1ECATY1/SYS/H1ECatY1.tsm; svn commit C:/SlowControls: svn update H1ECATY1: SYS, PLC3: 'Stop', 'Update from source', 'Compile', 'Activate and run', 'Restart EPICS database' corner station quit IOC C:/SlowControls: svn udate Conflict with file C:/SlowControls/TwinCAT/Source/Current/Interferometer/Corner/Plc1.pro Copied working version out of way, updated to version in svn, made changes that were done in the working version, recommited C:/SlowControls: svn udate H1ECATC1: SYS, PLC1: 'Update from source' C:/SlowControls/Target/H1ECATC1/H1ECATC1.tsm: PLC1 -> Rescan Project; Actions -> Generate Mappings, Check Configuration; Save Copy C:/SlowControls/Target/H1ECATC1/H1ECATC1.tsm to C:/SlowControls/Scripts/Configuration/H1ECATC1/SYS/H1ECatC1.tsm; svn commit C:/SlowControls: svn update H1ECATC1: SYS, PLC1: 'Stop', 'Update from source', 'Compile', 'Activate and run', 'Restart EPICS database' controls workstation cd /ligo/cds/lho/h1/burt/2014/10/28/06:10 burtwb -f h1ecatx1plc3epics.snap burtwb -f h1ecaty1plc3epics.snap burtwb -f h1ecatc1plc1epics.snap
per Work Permit Number: 4912 A -4300 count offset observed on L4C channel. Looked like losing one leg of the differential input. After narrowing down the offset to the I/O chassis by moving input cables and the ADC cables around and checking the AA chassis. We swapped the ADC board with no change in offset. We then swapped the ADC interface board and cable this fixed the problem. I have thrown out the cable and will test the board in the test stand.
I upgraded the guardian core and cdsutils (python ezca) installs:
I restarted most of the nodes, except for the following:
jameson.rollins@opsws2:~/src/cdsutils/trunk 0$ guardctrl list | grep -v 1095
node s k m vers state message
---- - - - ---- ----- -------
ALS_COMM o - - - - -
H1ECATC1PLC2 * E 1076 INIT
H1ECATX1PLC2 * E 1076 INIT
H1ECATY1PLC2 * E 1076 INIT
H1ISCEX * E 1076 INIT
H1ISCEY * E 1076 INIT
H1LSC * E 1076 INIT
H1LSCAUX * E 1076 INIT
HPI_HAM2 * * M 1083 ROBUST_ISOLATED
IAS_INPUT o - - - - -
IAS_MICH o - - - - -
IAS_PRC o - - - - -
IAS_SRC o - - - - -
IAS_TEST o - - - - -
IAS_XARM o - - - - -
IAS_YARM o - - - - -
IFO_ALIGN o - - - - -
ISC_LOCK o - - - - -
ISI_HAM2 * P 1083 WATCHDOG_TRIPPED_FULL_SHUTDOWN WATCHDOG TRIP: FULL_SHUTDOWN (4)
LSC * E 1076 INIT
LSC_PRMI_VAR_FINESSE * E 1083 DOWN MISALIGN PRM
LSC_PRX * P 1083 FAULT check LSC input matrix, ITMY not MISALIGNED
LSC_PRY * P 1080 FAULT PRM not ALIGNED, ITMX not MISALIGNED
SEI_HAM2 * P 1083 ISOLATED
SUS_MC1 * * E 1080 ALIGNED
SUS_MC3 * * E 1080 ALIGNED
SUS_PR3 * * E 1080 ALIGNED
SUS_PRM * * M 1083 ALIGNED
The non-running nodes (s='o') had various errors on restart, so I shut them down until they can be fixed. I shut down all the IAS nodes since I was told they're not in use. The HAM2 nodes were not restarted because Hugh was in the middle of doing some SEI work on HAM2. The nodes starting with "H1" are the "CSDEF" nodes (not sure what the status of those is). I'll restart these nodes when I'm sure it's ok.
I noticed that there are a couple of "hidden" nodes, that are not listed in the Guardian overview screen:
H1ECATC1PLC2 * E 1076 INIT
H1ECATX1PLC2 * E 1076 INIT
H1ECATY1PLC2 * E 1076 INIT
H1ISCEX * E 1076 INIT
H1ISCEY * E 1076 INIT
H1LSC * E 1076 INIT
H1LSCAUX * E 1076 INIT
LSC * E 1076 INIT
LSC_PRMI_VAR_FINESSE * E 1083 DOWN MISALIGN PRM
LSC_PRX * P 1083 FAULT check LSC input matrix, ITMY not MISALIGNED
LSC_PRY * P 1080 FAULT PRM not ALIGNED, ITMX not MISALIGNED
We should be very careful about these. If they're being used, they should be on the overview. If they're not being used, they should be shut down. Do not leave running nodes off of the overview screen
I should note that a bug was fixed in the cdsutils avg function. The standard deviation calculations were bogus, off by some unknown but large factor. This new version fixes that issue so that the standard deviation calculations returned with the "stdev" option are now correct.
We have reverted the cdsutils to cdsutils-329 (the version installed here since september), we did this by changing the link in /ligo/apps/linux-x86_64
The guardians were failing when they called the new avg function, we tried using the new cds utils function from the command line but it doesn't seem to be working.
I'm currently injecting a 50mHz, 3 urad amplitude signal into the ITMY YAW to help align the HWS probe beam.
Posting some notes retroactively from an email conversation with Rana last month.
Based on https://alog.ligo-wa.caltech.edu/aLOG/index.php?callRep=14057, Rana was curious of whether the HSTS model can predict the PR2 M3 stage angle to length coupling down to the mm/rad level. My response was the following:
"The existing models don’t appear to be good enough. See the attached figure of M3 long-pitch coupling. The blue is the generic HSTS model. The black is a (very thorough) fit of the model to H1SR2 I made earlier this year, 10124 You’ll note that these models differ by quite a bit more than 0.001 m/rad.
The daqd processes that write frames and provide NDS data have been shut down for modification of the file system for frame storage. The default NDS server has been changed to h1nds0.
Alexa, Sheila, Rana, Evan, Dan, Kiwamu
Today we worked on getting DRMI locked on 3F. It took us a while to get through the inital alingment sequence for various reasons, but once we did, and sorted out the WFS DC centering (Evan and Rana made some improvements to the AS A centering loop, Dan pointed out that the output matrix was mixed up), we were able to use the ASC to bring the DRMI to a reasonable build up (POP18 at 200 cnts).
We then looked at the demod phase of our 3F sensors. We tuned both 135 and 27 to miniminize the Q signal, first exciting PRM then SRM.
The best demod phases in degrees:
PRM | SRM | |
27 | 85.5 | 101.8 |
135 | -25 |
65 |
We left 27 at 85.8 (we started at 84.8) and 135 at 65 (we started at 63). We thendouble checked the relative gain between 3F and 1F signals, they are the same as previously, and we were able to transition to 3F. (durring all of this DRMI was nice and stable, locking for up to an hour before we knocked it out with an excitation of some sort).
Since this we have made a few attempts to bring the arms in, we redid our entire inital alingment process, and after that realingned the DIFF and COMM beat notes (they haven't been realingned since the pico motor in HAM3 was moved last week). We got about 3dBm in both beatnotes.
Once we had the arms (off resonance by 1 kHz in green), we were able to lock DRMI quickly, but the build up was low. When the ASC came on, it did improve the build up but as the build up got better, we started to mode hop. This was repeated a few times. By offsetting SRCL by -800 counts, we were able to avoid this mode hopping.
We have now rung up the roll mode at 13 Hz on ETMY.
some additional info for the roll mode:
(Developing the roll mode)
In a first half an hour or so, the roll mode was not excited and therefore we could close the ALS DIFF loop relatively easily. However at some point, we saw the roll mode slowly developing on a time scale of roughly 5 or 10 minutes which eventually killed the DIFF loop supposedly due to saturation in ETM DACs. After this incident, we were never able to stably lock the DIFF loop. The loop did not stay locked for a minute. I then waited for an hour while leaving ETMY untouched with a hope that the mode settles down in the meantime. But it did not. I still had a difficulty closing the loop.
(ETMY ESD is bad)
Before we started working on the DIFF loop, we briefly checked whether the ESDs are functional or not by injecting a line in pitch at 2.13 Hz. The ETMX ESD looked fine, but the ETMY ESD was pretty bad. Even though I shook the mirror vertically in pitch, oplev showed the motion which was mostly dominated by a yaw motion. The yaw motion was bigger than the pitch one by more than a factor of 5. Apparently the situation is different from how we used to be a couple of weeks ago (see alog 14415). I did not try exciting it in the yaw direction this time. I believe that the ESD is the cause for ringing up the roll mode.
(Some efforts did not help)
I tried two things in order to mitigate the issue. But neither worked.