Test of Distinguishability
description
Transcript of Test of Distinguishability
![Page 1: Test of Distinguishability](https://reader036.fdocuments.net/reader036/viewer/2022062519/56814fac550346895dbd687c/html5/thumbnails/1.jpg)
Test of DistinguishabilityDavid A. Kenny
March 24, 2013
![Page 2: Test of Distinguishability](https://reader036.fdocuments.net/reader036/viewer/2022062519/56814fac550346895dbd687c/html5/thumbnails/2.jpg)
You Need to Know
• Estimation method
–SEM
–MLM
2
![Page 3: Test of Distinguishability](https://reader036.fdocuments.net/reader036/viewer/2022062519/56814fac550346895dbd687c/html5/thumbnails/3.jpg)
Example
• Dataset: Acitelli dyad dataset
148 married couples• Outcome
– Satisfaction (Wife and Husband)• Predictor Variable
– Other-Positivity (Wife and Husband)• How positive the Wife views her Husband,
and how positive the Husband views his Wife
3
![Page 4: Test of Distinguishability](https://reader036.fdocuments.net/reader036/viewer/2022062519/56814fac550346895dbd687c/html5/thumbnails/4.jpg)
Distinguishability
• It is assumed that distinguishing variable matters.
• How does it matter?
• Different results for the two members.
• Test of distinguishability determines whether distinguishability empirically matters.
4
![Page 5: Test of Distinguishability](https://reader036.fdocuments.net/reader036/viewer/2022062519/56814fac550346895dbd687c/html5/thumbnails/5.jpg)
Should You Even Perform a Test of Distinguishability?
• Yes– Could simplify the model and parsimony is
valued.– Could dramatically increase power.
• No– The literature may expect separate analyses
for the two types of members.– Can present separate results but say they do
not differ.5
![Page 6: Test of Distinguishability](https://reader036.fdocuments.net/reader036/viewer/2022062519/56814fac550346895dbd687c/html5/thumbnails/6.jpg)
Specifically how does it matter?
• Actor and partner effects differ.
• Means, intercepts, and variances differ.
• If multiple variables, correlations differ.
6
![Page 7: Test of Distinguishability](https://reader036.fdocuments.net/reader036/viewer/2022062519/56814fac550346895dbd687c/html5/thumbnails/7.jpg)
Constraints
• Pairs of six parameters set equal to each other– Two actor effects– Two partner effects– Two error variances– Two Y intercepts– Two X variances– Two X means
7
![Page 8: Test of Distinguishability](https://reader036.fdocuments.net/reader036/viewer/2022062519/56814fac550346895dbd687c/html5/thumbnails/8.jpg)
8
![Page 9: Test of Distinguishability](https://reader036.fdocuments.net/reader036/viewer/2022062519/56814fac550346895dbd687c/html5/thumbnails/9.jpg)
Types of Distinguishability
• Complete Indistinguishability– All parameters equal (6)
• Y Indistinguishability– Mean and variance of X not set equal (4)– What is done in Multilevel Modeling
• Effect Indistinguishability– Only actor and partner effects set equal (2)
9
![Page 10: Test of Distinguishability](https://reader036.fdocuments.net/reader036/viewer/2022062519/56814fac550346895dbd687c/html5/thumbnails/10.jpg)
Using SEM
Tests
Complete indistinguishability: 2(6) = 9.192, p = .163
Y Indistinguishability: 2(4) = 7.228, p = .124
Effect Indistinguishability: 2(2) = 0.328, p = .849
All tests indicate that we cannot conclude members are distinguishable in terms of their gender.
If significant: Distinguishability empirically matters.
If not: No evidence distinguishability matters.
10
![Page 11: Test of Distinguishability](https://reader036.fdocuments.net/reader036/viewer/2022062519/56814fac550346895dbd687c/html5/thumbnails/11.jpg)
Using MLM• Estimate two models
– One in which members are distinguishable.– One in which members are indistinguishable.
• Use ML not REML estimation.• Subtract deviance of the more complex model
(distinguishable) from the deviance of the simpler model.
• That difference is distributed as chi square under the null hypothesis with 4 degrees of freedom.
11
![Page 12: Test of Distinguishability](https://reader036.fdocuments.net/reader036/viewer/2022062519/56814fac550346895dbd687c/html5/thumbnails/12.jpg)
12
![Page 13: Test of Distinguishability](https://reader036.fdocuments.net/reader036/viewer/2022062519/56814fac550346895dbd687c/html5/thumbnails/13.jpg)
Using MLM
• SPSS: For the deviance use -2 Log Likelihood from “Information Criteria.”
• Indistinguishable– Deviance: 282.884– Number of parameters: 5
• Distinguishable– Deviance: 275.607– Number of parameters: 9
13
![Page 14: Test of Distinguishability](https://reader036.fdocuments.net/reader036/viewer/2022062519/56814fac550346895dbd687c/html5/thumbnails/14.jpg)
MLM Result
2(9 – 5) = 282.884 - 275.607
= 7.277, p = .122
The null hypothesis is that the dyads are indistinguishable. We cannot reject the null hypothesis, so we conclude that there is no empirical evidence that dyad members should be differentiated by their gender.
14
![Page 15: Test of Distinguishability](https://reader036.fdocuments.net/reader036/viewer/2022062519/56814fac550346895dbd687c/html5/thumbnails/15.jpg)
Additional Readings
MLM: davidakenny.net/doc/indistinguishability_mlm.pdf
SEM: page 108 in Kenny, D. A., Kashy, D. A., & Cook, W. L. Dyadic data analysis. New York: Guilford Press.
15