<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=iso-8859-1">
<style type="text/css" style="display:none;"><!-- P {margin-top:0;margin-bottom:0;} --></style>
</head>
<body dir="ltr">
<div id="divtagdefaultwrapper" style="font-size:12pt;color:#000000;font-family:Calibri,Helvetica,sans-serif;" dir="ltr">
<p style="margin-top:0;margin-bottom:0">Thanks for the helpful suggestions. </p>
<p style="margin-top:0;margin-bottom:0"><br>
</p>
<p style="margin-top:0;margin-bottom:0">>Apply the cleaning mask you have in EEG.etc.clean_data_points to the data that are BEFORE applying ASR. </p>
<p style="margin-top:0;margin-bottom:0">>Now you have two data sets with the identical length, but one is before and the other is after cleaning. You can perform simple subtraction to obtain the difference waves for visual inspection, performing statistics,
etc.</p>
<p style="margin-top:0;margin-bottom:0"><br>
</p>
<p style="margin-top:0;margin-bottom:0">This is great, so I could work out channel by channel the % of identical data between the two - and from that work out how much data was interpolated. </p>
<p style="margin-top:0;margin-bottom:0"><br>
</p>
>One convenient measure I recommend you to try is percent variance accounted for (PVAF) which is computed in this way.<br>
<span style="font-family: Calibri, Helvetica, sans-serif, Helvetica, EmojiFont, "Apple Color Emoji", "Segoe UI Emoji", NotoColorEmoji, "Segoe UI Symbol", "Android Emoji", EmojiSymbols; font-size: 16px;">>PVAF = 100-100*mean(var(beforeASR-afterASR))/mean(var(beforeASR)) </span>
<div><br>
</div>
<div><span style="font-family: Calibri, Helvetica, sans-serif, Helvetica, EmojiFont, "Apple Color Emoji", "Segoe UI Emoji", NotoColorEmoji, "Segoe UI Symbol", "Android Emoji", EmojiSymbols; font-size: 16px;"></span>Thanks, this is also super helpful. I just
wondered what PVAF you would think appropriate (roughly) - its seems that from trying this approach with a few datasets (and using different parameters) the PVAF for some participants seems reasonable to me (30-40%) - whereas for others its really low (<1%)?</div>
<div><br>
</div>
<div>Best, </div>
<div><br>
</div>
<div>Abby <br>
<br>
<div style="color: rgb(0, 0, 0);">
<hr style="display:inline-block;width:98%" tabindex="-1">
<div id="divRplyFwdMsg" dir="ltr"><font face="Calibri, sans-serif" style="font-size:11pt" color="#000000"><b>From:</b> Makoto Miyakoshi <mmiyakoshi@ucsd.edu><br>
<b>Sent:</b> Wednesday, October 3, 2018 11:00 AM<br>
<b>To:</b> Dickinson, Abigail<br>
<b>Cc:</b> EEGLAB List<br>
<b>Subject:</b> Re: [Eeglablist] How much data is interpolated for ASR cleaning</font>
<div> </div>
</div>
<meta content="text/html; charset=utf-8">
<div>
<div dir="ltr">
<div dir="ltr">Dear Abby,
<div><br>
</div>
<div>
<p style="color:rgb(0,0,0); font-family:Calibri,Helvetica,sans-serif; font-size:16px; margin-top:0px; margin-bottom:0px">
> I understand how to extract how many channels/samples are kept in the cleaned dataset using EEG.etc.</p>
<br class="x_gmail-Apple-interchange-newline">
</div>
<div>Exactly... well, to be really exact, you calculate sum(EEG.etc.clean_data_points)/length(EEG.etc.clean_data_points) to compute the ratio of the rejected data points.</div>
<div><br>
</div>
<div><span style="color:rgb(0,0,0); font-family:Calibri,Helvetica,sans-serif; font-size:16px">> However, I'd like to keep track of how much data had to be interpolated while batch processing. While this information is easily accessible from the command line
(ie. </span><span style="color:rgb(0,0,0); font-family:Calibri,Helvetica,sans-serif; font-size:16px">Keeping 82.5% (132 seconds) of the data) - I'm not sure where this data is saved in the data structure?</span></div>
<div>
<ol>
<li>Apply the cleaning mask you have in EEG.etc.clean_data_points to the data that are BEFORE applying ASR. </li><li>Now you have two data sets with the identical length, but one is before and the other is after cleaning. You can perform simple subtraction to obtain the difference waves for visual inspection, performing statistics, etc.</li><li>One convenient measure I recommend you to try is percent variance accounted for (PVAF) which is computed in this way.</li></ol>
PVAF = 100-100*mean(var(beforeASR-afterASR))/mean(var(beforeASR)) <br>
</div>
<div><br>
</div>
<div>Note that the variance should be computed ACROSS CHANNELS (i.e., variance across scalp maps, for each frame!)</div>
<div>For the reference of this calculation, see <a href="https://urldefense.proofpoint.com/v2/url?u=https-3A__www.ncbi.nlm.nih.gov_pubmed_26738014&d=DwMFaQ&c=UXmaowRpu5bLSLEQRunJ2z-YIUZuUoa9Rw_x449Hd_Y&r=zgt47dO6mAzDhi4xI_zg4qBpgMHFQTErqFxzJ1dunyI&m=ybdIixh_G8wXWPQLr6jjNMBbCq_4f7XuWpezugMLL80&s=syQuegQkYG-zj1J9lbGer3t5qr88Efs7WP5pp01dfzQ&e=" id="LPlnk577684" class="OWAAutoLink" previewremoved="true">https://www.ncbi.nlm.nih.gov/pubmed/26738014</a></div>
<div><br>
</div>
<div>I have one paper under review, a collaboration with UCLA Sandra Loo, in which I calculated and reported all of the cleaning parameters and results... but it is not accepted yet.</div>
<div><br>
</div>
<div>Makoto</div>
<div><br>
</div>
<div><br>
</div>
<br>
<div class="x_gmail_quote">
<div dir="ltr">On Wed, Oct 3, 2018 at 4:23 AM Dickinson, Abigail <<a href="mailto:ADickinson@mednet.ucla.edu" id="LPlnk151546" class="OWAAutoLink" previewremoved="true">ADickinson@mednet.ucla.edu</a>> wrote:<br>
</div>
<blockquote class="x_gmail_quote" style="margin:0px 0px 0px 0.8ex; border-left:1px solid rgb(204,204,204); padding-left:1ex">
<div dir="ltr">
<div id="x_gmail-m_1097795455575698644divtagdefaultwrapper" dir="ltr" style="font-size:12pt; color:rgb(0,0,0); font-family:Calibri,Helvetica,sans-serif">
<p style="margin-top:0px; margin-bottom:0px">Hi all, </p>
<p style="margin-top:0px; margin-bottom:0px"><br>
</p>
<p style="margin-top:0px; margin-bottom:0px">I'm hoping to use ASR cleaning, but also want to quantify the amount of data that is interpolated for each participant. </p>
<p style="margin-top:0px; margin-bottom:0px"><br>
</p>
<p style="margin-top:0px; margin-bottom:0px">I understand how to extract how many channels/samples are kept in the cleaned dataset using EEG.etc.</p>
<p style="margin-top:0px; margin-bottom:0px"><br>
</p>
<p style="margin-top:0px; margin-bottom:0px">However, I'd like to keep track of how much data had to be interpolated while batch processing. While this information is easily accessible from the command line (ie. <span>Keeping 82.5% (132 seconds) of the data) -
I'm not sure where this data is saved in the data structure?</span></p>
<p style="margin-top:0px; margin-bottom:0px"><span><br>
</span></p>
<p style="margin-top:0px; margin-bottom:0px"><span>Any help would be greatly appreciated!</span></p>
<p style="margin-top:0px; margin-bottom:0px"><span><br>
</span></p>
<p style="margin-top:0px; margin-bottom:0px"><span>Thanks in advance, </span></p>
<p style="margin-top:0px; margin-bottom:0px"><span><br>
</span></p>
<p style="margin-top:0px; margin-bottom:0px"><span>Abby </span></p>
</div>
<br>
<hr>
<font face="Arial" color="Navy" size="2"><br>
UCLA HEALTH SCIENCES IMPORTANT WARNING: This email (and any attachments) is only intended for the use of the person or entity to which it is addressed, and may contain information that is privileged and confidential. You, the recipient, are obligated to maintain
it in a safe, secure and confidential manner. Unauthorized redisclosure or failure to maintain confidentiality may subject you to federal and state penalties. If you are not the intended recipient, please immediately notify us by return email, and delete this
message from your computer.<br>
</font></div>
_______________________________________________<br>
Eeglablist page: <a href="https://urldefense.proofpoint.com/v2/url?u=http-3A__sccn.ucsd.edu_eeglab_eeglabmail.html&d=DwMFaQ&c=UXmaowRpu5bLSLEQRunJ2z-YIUZuUoa9Rw_x449Hd_Y&r=zgt47dO6mAzDhi4xI_zg4qBpgMHFQTErqFxzJ1dunyI&m=ybdIixh_G8wXWPQLr6jjNMBbCq_4f7XuWpezugMLL80&s=mw7oSdmGqDL0bolRIBau3mozr5XWqGVJgMNWh3C5bDk&e=" rel="noreferrer" target="_blank" id="LPlnk814335" class="OWAAutoLink" previewremoved="true">
http://sccn.ucsd.edu/eeglab/eeglabmail.html</a><br>
To unsubscribe, send an empty email to <a href="mailto:eeglablist-unsubscribe@sccn.ucsd.edu" target="_blank" id="LPlnk378160" class="OWAAutoLink" previewremoved="true">
eeglablist-unsubscribe@sccn.ucsd.edu</a><br>
For digest mode, send an email with the subject "set digest mime" to <a href="mailto:eeglablist-request@sccn.ucsd.edu" target="_blank" id="LPlnk708345" class="OWAAutoLink" previewremoved="true">
eeglablist-request@sccn.ucsd.edu</a></blockquote>
</div>
<br clear="all">
<div><br>
</div>
-- <br>
<div dir="ltr" class="x_gmail_signature">
<div dir="ltr">Makoto Miyakoshi<br>
Swartz Center for Computational Neuroscience<br>
Institute for Neural Computation, University of California San Diego<br>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</body>
</html>