Displaying report 1-1 of 1.
Reports until 16:43, Friday 29 April 2016
H1 CAL (CAL)
craig.cahillane@LIGO.ORG - posted 16:43, Friday 29 April 2016 - last comment - 23:47, Sunday 01 May 2016(26889)
All of O1 LHO Uncertainty Budget
C. Cahillane

This aLOG should be the final uncertainty aLOG, at least for calibration between 5 Hz and 1000 Hz. I have generated many plots illustrating the uncertainty budgets, I will try to let them speak for themselves by explaining them one by one in order.
Whenever I have needed to choose a GPSTime for a plot, I have chosen 1135136350.

Plot 1: This is the classic analytic Response Function Error +- Uncertainty plot.  As usual, I have plotted R_C02/R_C03 to make the plot legible so you can see the systematic errors left uncorrected by C02.

Plot 2: This is a numerically-generated Monte Carlo uncertainty budget, as shown by the light-blue lines.  To generate the MC response functions, we sample from the posterior for each of the 14 parameters making up our response function, and then plot this "new" response as a series of light dots.  The light-blue lines represent the 68% confidence intervals of our numerical budget.  I have plotted the (dark) analytic budget on top here so we can compare the numerical and analytic uncertainty budgets.

Plot 3: I have quantified each parameter's individual contribution to our total uncertainty budget and error budget.  First we see the magnitude and phase uncertainty budgets themselves, then the uncertainty components plots, then the error components.  The error components are found by calculating the completely corrected "nominal" response function C03, then artificially removing a single component's systematic error and recalculating the response function for comparison with the nominal.

Plot 4: These spectrograms quantify our systematic error over all of O1.  The blue lines represent Sept 14, Oct 12, and Dec 26.

Plot 5: These spectrograms quantify our statistical uncertainty over all of O1.

Plot 6: These spectrograms quantify our "1 sigma maximum deviation" over all of O1.  What is 1 sigma maximum deviation?  It is the max of the absolute value of systematic error +- 1 sigma statistical uncertainty.  So if Error = -4% and Unc = +-3%, then the max deviation = max(abs(-4% +- 3%)) = 7%.  Apparently, many astro searches are incapable of correctly handling calibration error vs calibration uncertainty.  I must discourage ignoring this difference.  The green dots signify the time and frequency of maximum maximum deviation.

Plot 7: Percentile Plots.  I have taken the response error +- uncertainty spectrograms and compressed them into a convenient frequency plot illustrating the calibration spread over time.  The 68 percentile line, for instance, shows where the response error +- uncertainty lines were for 68% of the run time.  I have done this for percentiles 68%, 95%, and 99%.

For LLO, see LLO aLOG 25950
Non-image files attached to this report
Comments related to this report
craig.cahillane@LIGO.ORG - 23:47, Sunday 01 May 2016 (26908)CAL
C. Cahillane

The code to generate these plots can be found in the calibration SVN at:

aligocalibration/trunk/Runs/O1/Common/Scripts/Uncertainty/NumericalUncertaintyBudget.m

which must call

aligocalibration/trunk/Runs/O1/Common/Scripts/Uncertainty/cal_response_cc.m

cal_response_cc.m must have the following calibration data files

aligocalibration/trunk/Runs/O1/Common/Scripts/Uncertainty/LHO_Cal_Data.h5
aligocalibration/trunk/Runs/O1/Common/Scripts/Uncertainty/LLO_Cal_Data.h5

as well as the bash script 

aligocalibration/trunk/Runs/O1/Common/Scripts/Uncertainty/RotatePDF.sh

Also, please be sure to have pdftk installed on your computer to allow for the compression of saved figures.  If you do not have it, I believe the script should still run and produce your plots, you just will not end up with the convenient *_ALL_PLOTS.pdf files.

To actually generate the plots yourself, svn up the Common/Scripts/Uncertainty directory and open NumericalUncertaintyBudget.m.  
Select the IFO you want on line 9, the gpstime you want on line 10, and the calibration version (C01 or C02) on line 11. 
Set the plotting flags for the plots you want to make on lines 19 through 26.  
Set the writeTxt flag for the calibration response ratio R_C0?/R_C03 and response uncertainty on line 28.
Hit run.
Wait around anywhere between 2 and 70 seconds, depending primarily upon if you requested the spectrograms (these take time to run the data).
Displaying report 1-1 of 1.