[Eeglablist] ASR/clean_rawdata producing very inconsistent results

Wed Sep 12 08:33:13 PDT 2018

Hi Everyone,

I am using ASR to clean my datasets prior to ICA. I've been trying to
figure out what level to set each of the ASR parameters to, and in doing so
I noticed that the same input is producing massively different results each
time I run it.

More specifically, here's what I did:

1. filter, resample
2. Manually remove bad channels (I noticed ASR wasnt' catching some)
3. ASR using the following parameters:

 EEG = clean_rawdata(EEG, -1, -1, -1, -1, 24, .25);

4. Reference to average
5. Epoch

After I noticed some inconsistencies, I decided to run this exact series of
steps several times on the same dataset (i.e. starting with the raw
continuous dataset each time). On the first run, ASR inserted so many
boundary events that I could't get any full epochs out. On the second run,
I got 161 epochs (out of 200). On the third run, I it was back to zero full
epochs. On the fourth run, I got 162 epochs.

Does anyone else have this issue?? I want to apply the same settings to
multiple subject files, but if the results are this inconsistent that's a
huge issue. I'll put the command window output below. It looks like on the
runs where it inserts lots of boundary events it finishes running much
faster and is maybe not doing the cleaning?

Please help! I want to be able to use ASR.

Thanks,
Kelly

*From the run that produced no viable epochs: *

>> EEG = clean_rawdata(EEG, -1, -1, -1, -1, 24, .25);

flatchan rej disabled.
highpass disabled.
badchan rej disabled.
noise-based rej disabled.
Finding a clean section of the data...
Determining time window rejection thresholds...done.
Keeping 21.1% (475 seconds) of the data.
eeg_insertbound(): 477 boundary (break) events added.
eeg_insertbound(): event latencies recomputed and 1682 events removed.
eeg_checkset note: upper time limit (xmax) adjusted so (xmax-xmin)*srate+1
= number of frames
eeg_checkset note: value format of event field 'stimname' made uniform
eeg_checkset note: value format of event field 'answer' made uniform
eeg_insertbound(): 477 boundary (break) events added.
eeg_insertbound(): event latencies recomputed and 1686 events removed.
BUG 1971 WARNING: IF YOU ARE USING A SCRIPT WITTEN FOR A PREVIOUS VERSION OF
EEGLAB TO CALL THIS FUNCTION, BECAUSE YOU ARE REJECTING THE ONSET OF THE
DATA,
EVENTS WERE CORRUPTED. EVENT LATENCIES ARE NOW CORRECT (SEE
https://sccn.ucsd.edu/wiki/EEGLAB_bug1971);
Estimating calibration statistics; this may take a while...
Warning: A value of class "com.sun.management.UnixOperatingSystem" was
indexed with no subscripts specified. Currently the result of
this operation is the indexed value itself, but in a future release, it
will be an error.
> In asr_calibrate>hlp_memfree (line 266)
  In asr_calibrate (line 114)
  In clean_asr (line 164)
  In clean_artifacts (line 219)
  In clean_rawdata (line 83)
Determining per-component thresholds...done.
Warning: A value of class "com.sun.management.UnixOperatingSystem" was
indexed with no subscripts specified. Currently the result of
this operation is the indexed value itself, but in a future release, it
will be an error.
> In asr_process>hlp_memfree (line 232)
  In asr_process (line 105)
  In clean_asr (line 174)
  In clean_artifacts (line 219)
  In clean_rawdata (line 83)
Now doing final post-cleanup of the output.
Determining time window rejection thresholds...done.
Keeping 28.5% (642 seconds) of the data.
eeg_insertbound(): 587 boundary (break) events added.
eeg_insertbound(): event latencies recomputed and 1595 events removed.
eeg_checkset note: upper time limit (xmax) adjusted so (xmax-xmin)*srate+1
= number of frames
eeg_checkset note: value format of event field 'stimname' made uniform
eeg_checkset note: value format of event field 'answer' made uniform
eeg_insertbound(): 587 boundary (break) events added.
eeg_insertbound(): event latencies recomputed and 1599 events removed.
BUG 1971 WARNING: IF YOU ARE USING A SCRIPT WITTEN FOR A PREVIOUS VERSION OF
EEGLAB TO CALL THIS FUNCTION, BECAUSE YOU ARE REJECTING THE ONSET OF THE
DATA,
EVENTS WERE CORRUPTED. EVENT LATENCIES ARE NOW CORRECT (SEE
https://sccn.ucsd.edu/wiki/EEGLAB_bug1971);
Use vis_artifacts to compare the cleaned data to the original.
Re-referencing data
Removing 1 channel(s)...
Saving dataset...

*From the run that produced 162 epochs:*

EEG = clean_rawdata(EEG, -1, -1, -1, -1, 24, .25);

flatchan rej disabled.
highpass disabled.
badchan rej disabled.
noise-based rej disabled.
Finding a clean section of the data...
Determining time window rejection thresholds...done.
Keeping 21.1% (475 seconds) of the data.
eeg_insertbound(): 477 boundary (break) events added.
eeg_insertbound(): event latencies recomputed and 1682 events removed.
eeg_checkset note: upper time limit (xmax) adjusted so (xmax-xmin)*srate+1
= number of frames
eeg_checkset note: value format of event field 'stimname' made uniform
eeg_checkset note: value format of event field 'answer' made uniform
eeg_insertbound(): 477 boundary (break) events added.
eeg_insertbound(): event latencies recomputed and 1686 events removed.
BUG 1971 WARNING: IF YOU ARE USING A SCRIPT WITTEN FOR A PREVIOUS VERSION OF
EEGLAB TO CALL THIS FUNCTION, BECAUSE YOU ARE REJECTING THE ONSET OF THE
DATA,
EVENTS WERE CORRUPTED. EVENT LATENCIES ARE NOW CORRECT (SEE
https://sccn.ucsd.edu/wiki/EEGLAB_bug1971);
Estimating calibration statistics; this may take a while...
Warning: A value of class "com.sun.management.UnixOperatingSystem" was
indexed with no subscripts specified. Currently the result of
this operation is the indexed value itself, but in a future release, it
will be an error.
> In asr_calibrate>hlp_memfree (line 266)
  In asr_calibrate (line 114)
  In clean_asr (line 164)
  In clean_artifacts (line 219)
  In clean_rawdata (line 83)
Determining per-component thresholds...done.
Warning: A value of class "com.sun.management.UnixOperatingSystem" was
indexed with no subscripts specified. Currently the result of
this operation is the indexed value itself, but in a future release, it
will be an error.
> In asr_process>hlp_memfree (line 232)
  In asr_process (line 105)
  In clean_asr (line 174)
  In clean_artifacts (line 219)
  In clean_rawdata (line 83)
*Now cleaning data in 1268
blocks....................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................
(NOTE: missing from previous run)*
Now doing final post-cleanup of the output.
Determining time window rejection thresholds...done.
Keeping 90.5% (2035 seconds) of the data.
eeg_insertbound(): 83 boundary (break) events added.
eeg_insertbound(): event latencies recomputed and 132 events removed.
eeg_checkset note: value format of event field 'stimname' made uniform
eeg_checkset note: value format of event field 'answer' made uniform
eeg_insertbound(): 83 boundary (break) events added.
eeg_insertbound(): event latencies recomputed and 132 events removed.
BUG 1971 WARNING: IF YOU ARE USING A SCRIPT WITTEN FOR A PREVIOUS VERSION OF
EEGLAB TO CALL THIS FUNCTION, BECAUSE YOU ARE REJECTING THE ONSET OF THE
DATA,
EVENTS WERE CORRUPTED. EVENT LATENCIES ARE NOW CORRECT (SEE
https://sccn.ucsd.edu/wiki/EEGLAB_bug1971);
Use vis_artifacts to compare the cleaned data to the original.
Saving dataset...
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://sccn.ucsd.edu/pipermail/eeglablist/attachments/20180912/912664af/attachment.html>