Apologizes for the late entry. Yesterday all site supply fans were lubricated per the quarterly schedule. We also took the maintenance period opportunity to change some extremely dirty air filters which are located in the supply fan areas.
TITLE: 11/03 Owl: 8:00-16:00 UTC STATE Of H1: Observing @ ~75 MPc. SHIFT SUMMARY: SUPPORT: ACTIVITY LOG: H1 was locked when I arrived, RF45 was acting up occasionally, though. Otherwise quiet shift. 15:00 UTC Started receiving CS temp notifications, Bubba notified/working on it.
This morning about 15:00 UTC, I got a couple notifications that temps were low in the LVEA. I let Bubba know, but he was already working on it. I haven't heard any notifications since, Bubba said he will keep an eye on it.
TITLE: 11/03 [EVE Shift]: 00:00-08:00 UTC (16:00-00:00 PDT), all times posted in UTC STATE Of H1: Observing @ ~75 MPc. SHIFT SUMMARY: Initial lock impeded by bounce and roll modes. Lost lock during earthquake in East Timor. Seismic stayed abnormally high for almost 2 hours. Recovered and back to observing. SUPPORT: Evan, Jenne INCOMING OPERATOR: Jim ACTIVITY LOG: 00:13 UTC Kyle and Gerardo back from X28 (near end X) 01:25 UTC Towing truck through gate 04:36 UTC Nutsinee leaving, driving up bridge before heading out 04:40 UTC Jenne driving to end stations to turn card readers on 04:49 UTC Turned power off to speaker in control room 05:06 UTC Jenne back 05:45 UTC Restarted video2, Ops overview frozen
Seismic took about 2 hours to ring down to the point that we could relock. The 0.03 - 0.1 Hz seismic band is between ~ .02 and .1 um/s. The microseism is between ~ .1 and .2 um/s. The winds are around 10 mph. Violin mode damping for ITMX and ITMY is off. ISI blends are at Quite_90. Jenne turned the card readers on at end X, end Y and the LVEA. Range is around 78 MPc.
[Jenne, Miquel, Patrick]
The card readers providing access to the VEAs were turned off during maintenence today. Since we're unlocked due to an earthquake anyway, they have now been turned back on (EX, EY and vertex).
SUS I_T_M_Y saturating (Nov 4 04:14:41 UTC) DRMI Unlocked (Nov 4 04:14:41 UTC) Intention Bit: Commissioning (Nov 4 04:14:41 UTC) ISC_LOCK state: DOWN (Nov 4 04:14:48 UTC) From USGS: 6.3 77km WNW of Dili, East Timor 2015-11-04 03:44:15 UTC 14.3 km deep Spike to ~ .3 um/s in 0.03 - 0.1 Hz seismic band
Have remained in observing. No changes to report.
I have turned off the violin mode damping filters for IX and IY by zeroing their gains. Patrick accepted these into SDF so that we can go to observing.
This is meant to be temporary, i.e., for this one lock only.
The next time the interferometer comes into lock, the Guardian will turn on the normal violin mode damping settings. These settings will appear as SDF diffs (two on IX, and six on IY). These should be accepted into SDF.
We do not expect these modes to ring up during the course of the lock. However, if the mode height on the control room DARM spectrum around 500 Hz rises above 10−16 m/rtHz, the damping should be turned back on:
A screenshot of the nominal IY damping settings is attached (I didn't take one for IX).
ITMX:
ITMY
Thanks to Jeff, Patrick, and Jim for babysitting this.
The second lock (after the earthquake) lasted about 10 hours. Strangely, the ITM first harmonics (which range from 500 to 505 Hz) do not all seem to ring down.
An analysis of this data to measure Q of the fundamental modes for ITMX and ITMY violin modes is reported in 23331. The few modes that show an actual ringdown have a Q of about 0.3e9.
An analysis of this data to measure Q of the 2nd harmonics for ITMX and ITMY violin modes is reported in 23383.
There was some suspicion that the whitening gain for some of the ACB PDs became bad, but I have confirmed on the floor that the gain setting on the MEDM screen is reflected correctly in the diode amplifier box (D1301017) over the entire gain range for all baffle PDs for IX, IY, EX and EY.
I've followed the test procedure E1400003.
Violin mode damping for ITMX and ITMY is off. The damping gains of 0 were accepted in SDF (see attached screenshots). Evan wants to see how long they take to ring down without damping. ISI blends are at Quite_90.
During today's maintenance period I surveyed the switch configuration of the Output Configuration Switch (OCS) for each SUS oplev (WP #5588). The OCS is the small board with 4 banks of 8 switches each that attaches to the front of each oplev whitening chassis; it allows us to control the amount of whitening gain and filtering we apply to the oplev QPD signal. The results of this survey have been gathered and posted to the DCC here: T1500556. This document needs to be updated anytime the switch configuration of these OCSs changes; if anyone makes any changes to an OCS please let me know, via email or alog (preferably both), what you did so I can keep us up to date with the current OCS configuration.
TITLE: 11/03 [EVE Shift]: 00:00-08:00 UTC (16:00-00:00 PDT), all times posted in UTC STATE Of H1: Lock acquisition OUTGOING OPERATOR: Jeff QUICK SUMMARY: Lights appear off in the LVEA, PSL enclosure, end X, end Y and mid X. I can not tell from the camera if they are off at mid Y. Winds are less than 10 mph. Appear to be increasing. ISI blends are at Quite_90. Earthquake seismic band is between 0.01 and 0.02 um/s. Microseism is between 0.1 and 0.3 um/s. Jeff has been having trouble with ITMY bounce and roll modes. Has been stopping at REDUCE_CARM_OFFSET_MORE to allow Jenne and Evan to investigate.
The roll modes have been conquered. When they were too high, the DHARD loops become unstable and we lose lock. We stopped at REDUCE_CARM_OFFSET_MORE, which was the highest state that we could sit at without losing the lock.
ITMY's roll mode was the worst offender according to the monitor screen, so we only worked on damping that mode. We used the usual filter settings (which are always left in the correct state) and the usual negative sign for the gain. The usual gain that guardian leaves the ITMY roll mode damping is -40, but I was using larger gains to get the mode to go down faster. Once the roll modes were all around the "okay" level on the monitor screen, we let guardian continue the locking sequence.
We were concerned at one point that guardian had frozen on us, but it turns out that we were just being fooled. It looked like guardian was not finishing the DC_READOUT.main state, and not even starting the DC_READOUT.run state. However, it was all fine. I think I have been fooled by this before, but as a reminder (to myself especially), if an EPICS value is not going to change, guardian will not log that it tried to write the value. So, the last few steps of the main sequence were to write some gain values that were not going to change, which is why it looked like it was just stuck. Also, there was nothing in the run part of the state that was going to cause any log messages, so it didn't look like anything had happened, even though we were already getting the "return true" at the end of the state. In the end, we just requested a higher state, and guardian moved on as usual.
following Keith's LLO install, I have configured monit on h1fescript0 to automatically start the GraceDB notification system on system reboot,and to restart it if it stops running. Here are the details:
created a new exttrig account local to h1fescript0. Currently this has the standard controls password.
In the exttrig home directory, install script run_ext_alert.sh
Install a start/stop script in /etc/init.d/ext_alert
Install monit and mailx on the machine
Configure monit via /etc/monit/monitrc and /etc/monit/conf.d/monit_ext_alert
I changed the ownership of the cert files from user controls to user exttrig
Tested by killing the ext_alert process and checking monit restarted it
I have removed the obsolete startup instructions in the [[ExternalAlertNotification]] wiki page
This closes FRS3415.
I have spent about an hour today checking some basic behavior of the ISS 2nd loop servo circuits. I did the following two measurements.
No crazy thing was found in today's test. Our plan is that whenever we have issues with the ISS 2nd loop in some future, we will repeat the same type of measurements with an aim to identify what is changing.
Offset measurement
I checked how the reference signal propagates to the servo signal output by changing the reference signal. The measurement was done with the IMC intentionally unlocked. Therefore there was no light incident on the ISS PD array in HAM2. The result is shown in the first attachment. An important quantity to note here is the signal output value when zero reference voltage was requested. It was 2.76 V. Also note that zero output signal can be obtained when the reference signal is requested to be between 5 and 10 mV. This does not sound crazy to me. According to the resultant plot, the linearity seems also fine. Additionally I checked the reference monitor as well which also showed a good linearity. Later, I did a coarse version of the same test with the full power incident on IMC (~22 W). Even though the actual RIN was too high to make a precise measurement, the linear coefficient between the reference and output signals seemed consistent with what I have measurement with no light. I also attach the raw data in txt format.
Operating point measurement
Then I locked the IMC and changed the input power step by step with a step size of about 2 [W]. In each step, I manually moved the reference signal such that the output signal stays around zero [V]. This tells us how the operating point evolves as a function of the input power. I did this test from 2 [W] to 22 [W]. The result is shown in the second attachment. As you can see in the plot, the operating point evolves linearly against the input power as expected. Additionally, I recorded IM4_TRANS_SUM as well in order to check the linearity of the output power of the IMC. IM4_TRANS seems to be also linear. The data in txt format is attached as well.
Note that all the tests were done with PD1-4 as an intensity sensor. PD5-8 was not checked during the tests.
There are two things that don't make sense.
1. DC gain mismatch between the drawing/traveller and the measurement.
When Second Loop boost, integrator and additional gain are all off and the variable gain slider is set to 0dB, the gain from REF signal monitor to Second Loop Output should be -220, taking into account the modification for the second loop electronics on the floor (D1300439, https://dcc.ligo.org/S1400214): -1 for the REF summation, -10dB (or 1/3.2) instead of 0dB for the variable gain amplifier, -100 for the last stage of "whitening" path (U34), and -7 for the daughter board.
D1300439 DC gain = -1/3.2*-100*-7=-220.
From Kiwamu's plots, the measured DC gain is about -12.5V/0.04V~ -310.
2. Mystery factor of two in REFSIG DAC output.
"REFSIG" slider has a mystery factor of 2 in the filter for the DAC output. As a result, when the slider is set to -0.577V, the output of the filter reads -1889 counts instead of -0.577V/40Vpp * 2^16ctspp = -945counts.
However, REF signal monitor, which I think is a read back of the offset voltage coming out of REFSIG DAC channel, reads -940 counts and 0.574V.
Per JimW's request (alog 23032), I edited the ISC_LOCK guardian such that it throws notification messages when the ISS 2nd loop fails in the engagement. I have reloaded ISC_LOCK and checked the code into the SVN.
The notification messages will be displayed (1) if the IMC_LOCK guardian falls back to the LOCKED state (which is the programmed failure sequence) and/or (2) if the engagement process takes more than 4 minutes. The below are the new version of the ENGAGE_ISS_2ND_LOOP state. The red lines are the ones I newly added.
* * * * * * in ENGAGE_ISS_2ND_LOOP * * * * * *
def main(self):
nodes['IMC_LOCK'] = 'ISS_ON'
self.wait_iss_minutes = 4.0 # in [min]
self.timer['ISSwait'] = self.wait_iss_minutes*60 # in [sec]
@get_watchdog_IMC_check_decorator(nodes)
@nodes.checker()
def run(self):
# notify when the ISS fails. 2015-Nov-3, KI
if nodes['IMC_LOCK'] == 'LOCKED' or nodes['IMC_LOCK'] == 'OPEN_ISS':
notify('!! 2nd loop engagement failed !!')
# notify when the ISS is taking too many minutes. 2015-Nov-3, KI
if self.timer['ISSwait']:
notify('ISS spent more than %d minutes. Check ISS'%(self.wait_iss_minutes))
# if IMC arrives at the requested state, move on.
return nodes['IMC_LOCK'].arrived
Later today, we confirmed that the ISC_LOCK guardian behaved as intended -- it displayed the messages when the ISS failed in the engagement. Also there were a few minor typos which are now fixed. The guardian code is checked into the SVN.
The DTT template for showing the MICH spectrum on the control room wall is suffering from leakage, preventing us from seeing some features in the 8 to 11 Hz range. The current parameters and window are:
Window: Hanning
Start/end frequencies: 0/74444Hz
BW: 0.1Hz
Overlap: 70%
Avarages: 3
Resulting BW: 0.18Hz
After playing with the available windows (but keeping all other parameters fixed so it will refresh with the same latency), I have found that Flat-Top reduces the resulting BW to 0.24Hz but also reduces the leakage problem. This would allow us to see features over the problematic range. The first two attached figures correspond to 2015-10-28 14:48:24 ; they show how the Hanning window suffers from a real leakage problem while Flat-top maintains it’s performance. The feature over 8Hz corresponds to a problem solved by Bubba on log (22939).
I rather prefere to change the whitening filter, instead of chaging the windowing method.
Jeff and Miquel changed the DTT template displaying MICH, the new parameters and window are:
Window: Flat-Top
Start/end frequencies: 0/74444Hz
BW: 0.08Hz
Overlap: 70%
Avarages: 3
Resulting BW: 0.235628Hz
We believe that changing the whitening filter will not solve this leakege problem. The Hanning window resolves the frequency location better i.e smaller *BW but it's error in amplitude is up to 16%, whereas the FlatTop window measures better amplitude there for in this case reduses the leakege problem.
We have a few piece of evidence that suggest that anthropegenic noise (probably trucks going to ERDF) couples to DARM through scattered light which is most likely hitting something that is attached to the ground in the corner station.
On monday, Evan and I went to ISCT6 and listened to DARM and watched a spectrum while tapping and knocking on various things. We couldn't get a response in DARM by tapping around ISCT6. We tried knocking fairly hard on the table, the enclosure, tapping aggresively on all the periscope top mirrors, and several mounts on the table and nothing showed up. We did see something in DARM at around 100 Hz when I tapped loudly on the light pipe, but this seemed like an excitation that is much louder than anything that would normaly happen. Lastly we tried knocking on the chamber walls on the side of HAM6 near ISCT6, and this did make some low frequency noise in DARM. Evan has the times of our tapping.
It might be worth revisiting the fringe wrapping measurements we made in April by driving the ISI, the OMC sus, and the OMs. It may also be worth looking at some of the things done at LLO to look accoustic coupling through the HAM5 bellow (19450 and
14:31: tapping on HAM6 table
14:39: tapping on HAM6 chamber (ISCT6 side), in the region underneath AS port viewport
14:40: tapping on HAM6 chamber (ISCT6 side), near OMC REFL light pipe
14:44: with AS beam diverter open, tapping on HAM6 chamber (ISCT6 side)
14:45: with OMC REFL beam diverter open, tapping on HAM6 chamber (ISCT6 side)
14:47: beam diverters closed again, tapping on HAM6 chamber (ISCT6 side)
All times 2015-10-19 local
I've made some plots based on the tap time Evan recorded (the recorded time seems off by half a minute or so compare to what really shows up in the accelerometer and DARM). Not all taps created signals in DARM but every signal that showed up in DARM has the same feature in a spectrogram (visible at ~0-300Hz, 900Hz, 2000Hz, 3000Hz, and 5000Hz. See attachment2). Timeseries also reveal that whether or not the tap would show up in DARM does not seems to depend on the overall amplitude of the tap (seen in HAM6 accelerometer, see attachment 3). PEM spectrum during different taps times doesn't seem to give any clue why one tap shows up in DARM more than the other (attachment 4,5). Apology for the wrong conclusion I drew earlier based on the spectrum I plotted using wrong GPS time (those plots have been deleted).
I zoomed in a little closer at higher frequency and realized this pattern is similiar to the unsolved n*505 glitches. Could this be a clue to figuring out the mechanism that caused the n*505?
Summary: We had single-IFO time so I tested the new inverse actuation filter for PCALX. WP5530 Sudarshan and I believe we tracked down the factor of 2 and sign error from the initial PCALX test, see aLog 22160. We wanted to do this test to confirm that. CBC injections: The waveform file is: https://daqsvn.ligo-la.caltech.edu/svn/injection/hwinj/Details/Inspiral/H1/coherenttest1from15hz_1126257408.out The XML parameter file is: https://daqsvn.ligo-la.caltech.edu/svn/injection/hwinj/Details/Inspiral/h1l1coherenttest1from15hz_1126257408.xml.gz I did three CBC injections. The start times of the injections were: 1128303091.000000000, 1128303224.000000000, and 1128303391.000000000. The command line to do the injections is: ezcawrite H1:CAL-INJ_TINJ_TYPE 1 awgstream H1:CAL-PCALX_SWEPT_SINE_EXC 16384 coherenttest1from15hz_1126257408.out 1.0 -d -d >> 20151006_log_pcal.out awgstream H1:CAL-PCALX_SWEPT_SINE_EXC 16384 coherenttest1from15hz_1126257408.out 1.0 -d -d >> 20151006_log_pcal.out awgstream H1:CAL-PCALX_SWEPT_SINE_EXC 16384 coherenttest1from15hz_1126257408.out 1.0 -d -d >> 20151006_log_pcal.out I have attached the log. I had to change the file extension to be posted to the aLog. DetChar injection: I injected Jordan's waveform file: https://daqsvn.ligo-la.caltech.edu/svn/injection/hwinj/Details/detchar/detchar_03Oct2015_PCAL.txt The start time of the injection is: 1128303531.000000000 The command line to do the injections is: awgstream H1:CAL-PCALX_SWEPT_SINE_EXC 16384 detchar_03Oct2015_PCAL.txt 1.0 -d -d >> 20151006_log_pcal_detchar.out I have attached the log. I had to change the file extension to be posted to the aLog.
Chris Buchanan and Thomas Abbott,
Quick follow-up with omega scans. It looks like most of the power is seen in GDS-CALIB_STRAIN about eight seconds after each listed injection time, consistently for each of these three injections. Doesn't look like there are omicron triggers for these times yet, but omega scans for GDS-CALIB_STRAIN are attached.
Full omega scans generated here:
https://ldas-jobs.ligo.caltech.edu/~christopher.buchanan/Omega/Oct07_PCALX_Inj1/
https://ldas-jobs.ligo.caltech.edu/~christopher.buchanan/Omega/Oct07_PCALX_Inj2/
https://ldas-jobs.ligo.caltech.edu/~christopher.buchanan/Omega/Oct07_PCALX_Inj3/
For complete documentation of the detchar safety injections:
The injections are 12 sine-gaussians, evenly spaced from 30hz to 430hz, 3 seconds apart with a Q of 6. There are three sets with increasing SNR of 25, 50, 100 (intended). However, the SNR is limited by the PCAL acuation range at higher frequencies.
To generate the waveforms I used the script written by Peter Shawhan / Andy located here: https://daqsvn.ligo-la.caltech.edu/websvn/filedetails.php?repname=injection&path=%2Fhwinj%2FDetails%2Fdetchar%2FGenerateSGSequencePCAL.m
I tuned the injections to stay within the PCAL actuation limits referenced in Peter Fritschel's document https://dcc.ligo.org/LIGO-
The intended time (seconds from start time of injections), freqency, snr, and amplitude (in units of strain) for all injections are pasted below:
__time__ __freq__ __SNR__ __AMP__
0.50 30.0 25.0 5.14e-21
3.50 38.2 25.0 4.96e-21
6.50 48.7 25.0 2.15e-21
9.50 62.0 25.0 2.07e-21
12.50 79.0 25.0 1.75e-21
15.50 100.6 25.0 1.78e-21
18.50 128.2 25.0 1.92e-21
21.50 163.3 25.0 2.06e-21
24.50 208.0 25.0 2.39e-21
27.50 265.0 10.0 1.11e-21
30.50 337.6 5.0 8.39e-22
33.50 430.0 5.0 8.51e-22
36.50 30.0 50.0 1.03e-20
39.50 38.2 50.0 9.92e-21
42.50 48.7 50.0 4.31e-21
45.50 62.0 50.0 4.14e-21
48.50 79.0 50.0 3.51e-21
51.50 100.6 50.0 3.55e-21
54.50 128.2 50.0 3.85e-21
57.50 163.3 50.0 4.12e-21
60.50 208.0 50.0 4.77e-21
63.50 265.0 20.0 2.21e-21
66.50 337.6 10.0 1.68e-21
69.50 430.0 10.0 1.7e-21
72.50 30.0 100.0 2.06e-20
75.50 38.2 100.0 1.98e-20
78.50 48.7 100.0 8.62e-21
81.50 62.0 100.0 8.27e-21
84.50 79.0 100.0 7.01e-21
87.50 100.6 100.0 7.1e-21
90.50 128.2 100.0 7.69e-21
93.50 163.3 100.0 8.24e-21
96.50 208.0 100.0 9.54e-21
99.50 265.0 40.0 4.43e-21
102.50 337.6 20.0 3.36e-21
105.50 430.0 20.0 3.4e-21
Here are the SNR of the CBC injections using the daily BBH matching filtering settings: end time SNR chi-squared newSNR 1128303098.986 20.35 32.86 19.86 1128303231.985 22.62 32.73 22.10 1128303398.985 23.25 21.05 23.25 Expected SNR is 18.4. Though a recovered SNR of 20 (about 10% percent difference from 18.4) is comparable to some of the SNR measurements when doing injections with CALCS in aLog 21890. Note this is the same waveform injected here except in aLog 21890 it starts from 30Hz. In both cases the matched filtering starts at 30Hz. The last two have a bit higher SNR though.
I edited Peter S.'s matlab script to check the sign of these PCAL CBC injections. Looks like the have the correct sign. See attached plots. To run code on LHO cluster: eval '/ligotools/bin/use_ligotools' matlab -nosplash -nodisplay -r "checksign; exit" Also in hindsight I should have done a couple CALCS CBC injections just to compare the SNR at the time with the PCAL injections.
gwdetchar-overflow -i H1 -f H1_R -O segments -o overflow --deep 1128303500 1128303651 124
It returns an empty table, so no overflows.
A time-domain check of the recovered strain waveforms is here: https://wiki.ligo.org/Main/HWInjO1CheckSGs. I found that the sign is correct, the amplitude matches within a few percent at most frequencies, and the phases are generally consistent with having a frequency-independent time delay of 3 or 4 samples (about 0.2 ms). Details are on that wiki page.
Thomas Abbot, Chris Buchanan, Chris Biwer I've taken Thomas/Chris' table of recovered omicron triggers for the PCAL detchar injection and calculated the ratio of expected/recovered SNR and added some comments: Recovered time time since frequency recovered expected recovered/expected comments 1128303531 (s) (Hz) SNR SNR SNR 1128303531.5156 0.515599966 42.56 34.07 25 1.3628 1128303534.5078 3.5078001022 61.90 39.41 25 1.5764 1128303537.5039 6.5039000511 64.60 28.29 25 1.1316 1128303540.5039 9.5039000511 79.79 23.89 25 0.9556 1128303543.5039 12.5039000511 1978.42 21.38 25 0.8552 suspicious, the frequency is very high 1128303546.502 15.5020000935 144.05 26.24 25 1.0496 1128303549.502 18.5020000935 185.68 26.38 25 1.0552 1128303552.502 21.5020000935 229.34 26.29 25 1.0516 1128303555.501 24.5009999275 918.23 27.34 25 1.0936 1128303558.501 27.5009999275 315.97 11.05 10 1.105 1128303564.5005 33.5004999638 451.89 6.76 5 1.352 1128303567.5156 36.515599966 50.12 68.53 50 1.3706 1128303570.5078 39.5078001022 61.90 78.23 50 1.5646 1128303573.5039 42.5039000511 76.45 52.04 50 1.0408 1128303576.5039 45.5039000511 91.09 48.42 50 0.9684 1128303579.5039 48.5039000511 116.63 47.73 50 0.9546 1128303582.502 51.5020000935 144.05 52.59 50 1.0518 1128303585.502 54.5020000935 177.91 52.3 50 1.046 1128303588.502 57.5020000935 261.81 54.8 50 1.096 1128303591.501 60.5009999275 323.36 55.64 50 1.1128 1128303594.501 63.5009999275 414.01 19.67 20 0.9835 1128303597.501 66.5009999275 390.25 9.55 10 0.955 1128303600.5005 69.5004999638 481.99 9.34 10 0.934 1128303603.5156 72.515599966 48.35 136.81 100 1.3681 1128303606.5078 75.5078001022 71.56 156.91 100 1.5691 1128303609.5039 78.5039000511 76.45 102.72 100 1.0272 1128303612.5039 81.5039000511 138.03 102.85 100 1.0285 1128303615.5039 84.5039000511 134.83 95.52 100 0.9552 1128303618.502 87.5020000935 1283.14 104.17 100 1.0417 frequency seems a bit high 1128303621.502 90.5020000935 211.97 107.18 100 1.0718 1128303624.502 93.5020000935 261.81 104.53 100 1.0453 1128303627.501 96.5009999275 323.36 109.66 100 1.0966 1128303630.501 99.5009999275 414.01 42.15 40 1.05375 1128303633.5005 102.5004999638 959.39 19.11 20 0.9555 this last injection had some kind of glitch on it In most cases looks like the ratio is within 0.1 of 1. On a quick glance I see 10 injections that were not within this range.