<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40"><head><meta http-equiv=Content-Type content="text/html; charset=us-ascii"><meta name=Generator content="Microsoft Word 14 (filtered medium)"><style><!--
/* Font Definitions */
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
@font-face
{font-family:TimesNewRomanPSMT;
panose-1:0 0 0 0 0 0 0 0 0 0;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0cm;
margin-bottom:.0001pt;
font-size:11.0pt;
font-family:"Calibri","sans-serif";
mso-fareast-language:EN-US;}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:blue;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:purple;
text-decoration:underline;}
p.MsoListParagraph, li.MsoListParagraph, div.MsoListParagraph
{mso-style-priority:34;
margin-top:0cm;
margin-right:0cm;
margin-bottom:0cm;
margin-left:36.0pt;
margin-bottom:.0001pt;
font-size:11.0pt;
font-family:"Calibri","sans-serif";
mso-fareast-language:EN-US;}
span.EmailStyle17
{mso-style-type:personal-compose;
font-family:"Calibri","sans-serif";
color:windowtext;}
.MsoChpDefault
{mso-style-type:export-only;
font-family:"Calibri","sans-serif";
mso-fareast-language:EN-US;}
@page WordSection1
{size:612.0pt 792.0pt;
margin:72.0pt 72.0pt 72.0pt 72.0pt;}
div.WordSection1
{page:WordSection1;}
/* List Definitions */
@list l0
{mso-list-id:444084541;
mso-list-type:hybrid;
mso-list-template-ids:1611031194 -1337825848 134807577 134807579 134807567 134807577 134807579 134807567 134807577 134807579;}
@list l0:level1
{mso-level-tab-stop:-7.1pt;
mso-level-number-position:left;
margin-left:-7.1pt;
text-indent:7.1pt;}
@list l0:level2
{mso-level-number-format:alpha-lower;
mso-level-tab-stop:57.8pt;
mso-level-number-position:left;
margin-left:57.8pt;
text-indent:-18.0pt;}
@list l0:level3
{mso-level-number-format:roman-lower;
mso-level-tab-stop:93.8pt;
mso-level-number-position:right;
margin-left:93.8pt;
text-indent:-9.0pt;}
@list l0:level4
{mso-level-tab-stop:129.8pt;
mso-level-number-position:left;
margin-left:129.8pt;
text-indent:-18.0pt;}
@list l0:level5
{mso-level-number-format:alpha-lower;
mso-level-tab-stop:165.8pt;
mso-level-number-position:left;
margin-left:165.8pt;
text-indent:-18.0pt;}
@list l0:level6
{mso-level-number-format:roman-lower;
mso-level-tab-stop:201.8pt;
mso-level-number-position:right;
margin-left:201.8pt;
text-indent:-9.0pt;}
@list l0:level7
{mso-level-tab-stop:237.8pt;
mso-level-number-position:left;
margin-left:237.8pt;
text-indent:-18.0pt;}
@list l0:level8
{mso-level-number-format:alpha-lower;
mso-level-tab-stop:273.8pt;
mso-level-number-position:left;
margin-left:273.8pt;
text-indent:-18.0pt;}
@list l0:level9
{mso-level-number-format:roman-lower;
mso-level-tab-stop:309.8pt;
mso-level-number-position:right;
margin-left:309.8pt;
text-indent:-9.0pt;}
ol
{margin-bottom:0cm;}
ul
{margin-bottom:0cm;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]--></head><body lang=EN-GB link=blue vlink=purple><div class=WordSection1><p class=MsoNormal>Hi,<o:p></o:p></p><p class=MsoNormal>Can somebody explain me how Permutation test works for ANOVA (and 2 way ANOVA).<o:p></o:p></p><p class=MsoNormal style='text-align:justify;text-autospace:none'>This is what I found in Blair R, Karniski W.. Psychophysiology. 1993;30:518-524 article, we normally reference for their paper for Permutation statistic, but they do no explain this.<span style='font-size:9.0pt;font-family:TimesNewRomanPSMT'><o:p></o:p></span></p><p class=MsoListParagraph style='margin-left:0cm'><o:p> </o:p></p><p class=MsoListParagraph style='margin-left:0cm'><i>A Brief Note on Permutation Tests for Agreement of Three or More Confusion Matrices<br><br>To this point, the matrix permutation test has been described within the context of comparing the agreement between two proximity matrices. Hubert (1979a, 1979b) extended this permutation test to three or more proximity matrices. The generation of the complete distribution for the [(n!).sup.Q] possible realizations of the index value is impractical for most n and Q, where Q is the number of matrices. This limitation necessitates the reliance on Monte Carlo sampling methods (i.e., using random number generators) to evaluate the significance of the index. If the statistic is sufficiently extreme with respect to the simulated agreement, then the null hypothesis of no agreement among the matrices is rejected.<o:p></o:p></i></p><p class=MsoNormal style='text-align:justify;text-autospace:none'><span style='font-size:9.0pt;font-family:TimesNewRomanPSMT'><o:p> </o:p></span></p><p class=MsoNormal style='text-align:justify;text-autospace:none'>My question is: <span style='font-size:9.0pt;font-family:TimesNewRomanPSMT'><o:p></o:p></span></p><p class=MsoNormal style='margin-left:57.8pt;text-align:justify;text-indent:-18.0pt;mso-list:l0 level2 lfo1;text-autospace:none'><![if !supportLists]><span style='font-size:9.0pt;font-family:TimesNewRomanPSMT'><span style='mso-list:Ignore'>a.<span style='font:7.0pt "Times New Roman"'> </span></span></span><![endif]>do we check all possible options (e.g. if I have three groups then I’ll swap values between 1 and 2, leave 3 unchanged, then between 1 and 3 leave 2 unchanged etc) or we do just a certain percentage of it, and what percentage? <span style='font-size:9.0pt;font-family:TimesNewRomanPSMT'><o:p></o:p></span></p><p class=MsoNormal style='margin-left:57.8pt;text-align:justify;text-indent:-18.0pt;mso-list:l0 level2 lfo1;text-autospace:none'><![if !supportLists]><span style='font-size:9.0pt;font-family:TimesNewRomanPSMT'><span style='mso-list:Ignore'>b.<span style='font:7.0pt "Times New Roman"'> </span></span></span><![endif]>Would bootstrapping for the same analysis be any more reliable?<span style='font-size:9.0pt;font-family:TimesNewRomanPSMT'><o:p></o:p></span></p><p class=MsoNormal><o:p> </o:p></p><p class=MsoNormal>Many thanks,<o:p></o:p></p><p class=MsoNormal>Aleksnadra<o:p></o:p></p></div></body></html>