[Eeglablist] Permutation Tests for Agreement of Three or More Confusion Matrices

[Makoto Miyakoshi]

Dear Arno,

I'm not sure about these details, though I would image that EEGLAB
permutation simply shuffle labels across all conditions. Could you give us
explanations?

Makoto

2013/3/27 Aleksandra Vuckovic <Aleksandra.Vuckovic at glasgow.ac.uk>

> Hi,****
>
> Can somebody explain me how Permutation test works for ANOVA (and 2 way
> ANOVA).****
>
> This is what I found in Blair R, Karniski W.. Psychophysiology.
> 1993;30:518-524 article, we normally reference for their paper for
> Permutation statistic, but they do no explain this.****
>
> ** **
>
> *A Brief Note on Permutation Tests for Agreement of Three or More
> Confusion Matrices
>
> To this point, the matrix permutation test has been described within the
> context of comparing the agreement between two proximity matrices. Hubert
> (1979a, 1979b) extended this permutation test to three or more proximity
> matrices. The generation of the complete distribution for the [(n!).sup.Q]
> possible realizations of the index value is impractical for most n and Q,
> where Q is the number of matrices. This limitation necessitates the
> reliance on Monte Carlo sampling methods (i.e., using random number
> generators) to evaluate the significance of the index. If the statistic is
> sufficiently extreme with respect to the simulated agreement, then the null
> hypothesis of no agreement among the matrices is rejected.*
>
> ** **
>
> My question is: ****
>
> **a.     **do we check all possible options (e.g. if I have three groups
> then I’ll swap values between 1 and 2, leave 3 unchanged, then between 1
> and 3 leave 2 unchanged etc) or we do just a certain percentage of it, and
> what percentage? ****
>
> **b.     **Would bootstrapping for the same analysis be any more reliable?
> ****
>
> ** **
>
> Many thanks,****
>
> Aleksnadra****
>
> _______________________________________________
> Eeglablist page: http://sccn.ucsd.edu/eeglab/eeglabmail.html
> To unsubscribe, send an empty email to
> eeglablist-unsubscribe at sccn.ucsd.edu
> For digest mode, send an email with the subject "set digest mime" to
> eeglablist-request at sccn.ucsd.edu
>



-- 
Makoto Miyakoshi
JSPS Postdoctral Fellow for Research Abroad
Swartz Center for Computational Neuroscience
Institute for Neural Computation, University of California San Diego
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://sccn.ucsd.edu/pipermail/eeglablist/attachments/20130327/f49c40cc/attachment.html>