J. Kissel, H. Paris, A. Pele

0) Identify the source of the trip. Take a look at the SUS WD screen, and see what path tripped the watchdog. Take a look at the ISI performance matrix, be sure you don't see tons of red. Take a look at the OSEM speedometers, make sure they're not swinging wildly.

Reset and restore SUS
1) Ramp down offsets, by hitting the "Pitch and "Yaw" button after the purple "ALIGNMENT OFFSETS" box.
2) Untrip the inner most watchdog (for the QUAD, you'll need to reset the reaction chain as well!)
3) Untrip the USER DACKILL Watchdog
4) Untrip the IOP Watchdog
5) Damping loops should automatically turn on (they're never turned off, really), but turn on the alignment offsets again.

Reset ISI
1) Ramp down FF01 filters, by setting the gain to 0 (only FM2's "FF01_2" in X,Y, and Z are on during Level 2)
2) Though the green arrows, lines, and blocks may be deceiving, make sure that the FF12C and FF12 banks are also not outputting anything either.
3) Turn off GND to ST1 and ST1 to ST2 sensor correction. Open each "SENSCOR" Bank and ramp the MATCH gains to zero, and turn off the outputs.
    (It's a 60 second ramp, so be patient.)
    (These will only be on if the previous user wanted them on, don't be alarmed if they're already off).
    (I say turn off the outputs because that's what makes the lights on the overview screen go red. Obviously, you don't *need* to do both.)
4) Run ctrlDown ${OPTIC/CHAMBER} from commands window
5) Untrip "Rogue Excitations" WD under ERRMON screen linked in bottom right corner
6) Untrip ST1, ST2, and USERDACKILL Watchdogs but hitting "reset all" (if that doesn't untrip the DACKILL, open up the screen and manually hit reset")
7) Damping loops should automatically turn on (they're never turned off really).

Reset and restore HEPI
1) Ramp down MASTER Gain (or just set to 0.0, since the WDs are tripped and nothing's going out anyway)
2) Run ctrlDown from commands window
3) Untrip inner most watchdog
4) Untrip USER DACKILL Watchdog
5) Slowly (!!) ramp up offsets. I use the follow ezcastep command, in absence of a script:
ezcastep 'H1:HPI-BS_MASTER_GAIN' '+0.01,100' -s '0.5'
ezcastep 'H1:HPI-BS_MASTER_GAIN' '+0.01,100' -s 0.5

From here on, you can follow Vincent's instructions starting at step 3, which I'll repeat here and add a little myself:


3) Turn on HEPI
     ITMY: locked. Don't worry about it. 
     BS: can only be Level 2 isolated, the IPS blends are not installed, so the command script for Level 3 is unstable. Select Level 2  for BS from the command window.
     ETMY: We have only tried Level 2. It's unclear whether Level 3 works. Select Level 2 for BS from the command window. 
4) Isolate ISI
  - Ramp up ST0 to ST1 feed-forward in X,Y and Z on BSC-ISI (there's no RX, RY, or RZ FF. This is the "FF01" bank at the top).
     - Start with Gain = 0, inputs ON, outputs ON
     - It's unclear whether FM2 "FF01_2" is associated with Level 2 isolation and FM3 "FF01_3" is associated with Level 3 isolation, and we've found that FM2 "FF0_2" works for both, so for now, we'll stick to FM2 for either level of isolation. Turn it ON
     - Making sure there's a >5 sec ramp, ramp gains to 1.0 (order and speed doesn't matter).

   Turning on the isolation loops for Level 2 and 3 are a little bit rough for the highly-sensitive inertial sensors (though the motion is not that). One must increase their watchdog thresholds during the turn on process in order for the watchdog not to trip during the turn on process. Good thresholds are: 
     - T240s: 200000
     - L4Cs: 30000
     - GS13s: 40000
Such that the system is still protected, tighten the thresholds on the CPS to 15000.
   - Make sure you have blend filters set to "750 mHz" for ST1 and "250mHz" for Stage 2, using the "SWITCH ALL" button on the top middle of the blend filter screens. We were only able get ISI-ITMY to Level 3 with ST1 set to "250 mHz."
   - Hit Level 2 or Level 3. You must be very patient, and be sure you've follow all of the above instructions to a T, or one, a few, several, or all watchdogs will trip on you and it's back to step 1. Budget 20 minutes.
   - IF THE WATCHDOG TRIPS DURING THE ISOLATE PROCESS, GO BACK to "Reset ISI" Step 4).
   - After waiting some time (a few minutes), the T240s will settle down to within +/- 2000 [cts] on the input to INPUT FILTERs. 
   - Switch the ST1 blends to "T240mHz" in all DOFs.
   - Note that if you're browsing through filter banks (specifically the ISO bank, but others as well), there will be several filters that are empty that the script will turn on, raising your suspicion when things go awry. This is such that the controller turn on process can be generic, don't worry about it. 

Stop Here if you don't want/need sensor correction or green cavity offloading

6) HEPI Green Arm Locking Offload -- on H1:HPI-ETMY only
This is only necessary if you want to keep the arm locked with the green ALS on the time scale of hours. If you don't need the green for long, or if you've switched to red control of the cavity, you don't need this. However, if you do, everything in HEPI is on as it should be. The way to turn it on in the LSC screen: SITEMAP > LSC > Overview > look for "YARM" in the bottom middle of the screen. Open the bank and turn ON the output.

7) Sensor correction
It's unclear (at least) if this is commissioned well, the low frequency performance of the cavities have not really been characterized with it on (i.e. they saw it cause excess low-frequency once, via the camera, and said "don't bother" and it stuck). However, to bring it up, 
    GND to ST1 (from GND STS2s) sensor correction:
    - In the "GROUND" bank of the ST1 SENSCOR filters,
    - Make sure the "MATCH" filter is on (it's just a ~few percent gain correction filter), ever other 
    - Turn on the output of the "MATCH" bank 
    - Make sure there's a very large tramp in the MATCH bank
    - Ramp the gain to +1.0
    ST1 to ST2 (from T240s) sensor correction:
    - In the ST2 SENSCOR filters,
    - (No MATCH filter)
    - Turn on the output of the "MATCH" bank 
    - Make sure there's a very large tramp in the MATCH bank
    - Ramp the gain to +1.0