YICHIA WANG 2011/02/22 Weekly Meeting. Mturk 10 Acor messages Correlation with expert annotation =...
-
Upload
joel-garrison -
Category
Documents
-
view
222 -
download
0
Transcript of YICHIA WANG 2011/02/22 Weekly Meeting. Mturk 10 Acor messages Correlation with expert annotation =...
![Page 1: YICHIA WANG 2011/02/22 Weekly Meeting. Mturk 10 Acor messages Correlation with expert annotation = 0.87 50 Acor messages + 50 Bambina messages](https://reader036.fdocuments.net/reader036/viewer/2022062422/56649f335503460f94c4fb6a/html5/thumbnails/1.jpg)
YICHIA WANG2011/02/22
Weekly Meeting
![Page 2: YICHIA WANG 2011/02/22 Weekly Meeting. Mturk 10 Acor messages Correlation with expert annotation = 0.87 50 Acor messages + 50 Bambina messages](https://reader036.fdocuments.net/reader036/viewer/2022062422/56649f335503460f94c4fb6a/html5/thumbnails/2.jpg)
Mturk
10 Acor messages Correlation with expert annotation = 0.87
50 Acor messages + 50 Bambina messages Correlation with expert annotation
Emotional correlation = 0.70• Acor = 0.93• Bambina = 0.43
Informational correlation = 0.76• Acor = 0.78• Bambina = 0.76
Intra-class correlation (average measurement) Emotional correlation = 0.94
• Acor = 0.96• Bambina = 0.91
Informational correlation = 0.93 • Acor = 0.91• Bambina = 0.95
![Page 3: YICHIA WANG 2011/02/22 Weekly Meeting. Mturk 10 Acor messages Correlation with expert annotation = 0.87 50 Acor messages + 50 Bambina messages](https://reader036.fdocuments.net/reader036/viewer/2022062422/56649f335503460f94c4fb6a/html5/thumbnails/3.jpg)
Breast Cancer Data - Descriptive Statistics
Thread 68,158 threads 1,562,459 posts 22.92 posts / per thread
User 90,242 users 54,580 users never logged in after registration 0.77 threads / per user 24.29 posts / per user
![Page 4: YICHIA WANG 2011/02/22 Weekly Meeting. Mturk 10 Acor messages Correlation with expert annotation = 0.87 50 Acor messages + 50 Bambina messages](https://reader036.fdocuments.net/reader036/viewer/2022062422/56649f335503460f94c4fb6a/html5/thumbnails/4.jpg)
Number of Threads by Posted Year
![Page 5: YICHIA WANG 2011/02/22 Weekly Meeting. Mturk 10 Acor messages Correlation with expert annotation = 0.87 50 Acor messages + 50 Bambina messages](https://reader036.fdocuments.net/reader036/viewer/2022062422/56649f335503460f94c4fb6a/html5/thumbnails/5.jpg)
Number of Threads by Number of Posts
Min: 1 Max: 20,008 Mean: 22.92 Median: 6 99% of threads have less than 150 posts
![Page 6: YICHIA WANG 2011/02/22 Weekly Meeting. Mturk 10 Acor messages Correlation with expert annotation = 0.87 50 Acor messages + 50 Bambina messages](https://reader036.fdocuments.net/reader036/viewer/2022062422/56649f335503460f94c4fb6a/html5/thumbnails/6.jpg)
Number of Threads by Response Time
11% of threads (7,785 threads) never got response Min: <1 (day) Max: 916 (day) Mean: 2.10 (day) Median: 1 (day) 99% of threads got response in 21 days
![Page 7: YICHIA WANG 2011/02/22 Weekly Meeting. Mturk 10 Acor messages Correlation with expert annotation = 0.87 50 Acor messages + 50 Bambina messages](https://reader036.fdocuments.net/reader036/viewer/2022062422/56649f335503460f94c4fb6a/html5/thumbnails/7.jpg)
Number of Threads by Lifespan
Min: <1 (day) Max: 2769 (day) Mean: 32.97 (day) Median: 3 (day)
![Page 8: YICHIA WANG 2011/02/22 Weekly Meeting. Mturk 10 Acor messages Correlation with expert annotation = 0.87 50 Acor messages + 50 Bambina messages](https://reader036.fdocuments.net/reader036/viewer/2022062422/56649f335503460f94c4fb6a/html5/thumbnails/8.jpg)
Number of Threads versus Number of Reply Posts by Thread Starter
55% of thread starters would post again in the same threadMin: 1Max: 1,969Mean: 4.23Median: 2
![Page 9: YICHIA WANG 2011/02/22 Weekly Meeting. Mturk 10 Acor messages Correlation with expert annotation = 0.87 50 Acor messages + 50 Bambina messages](https://reader036.fdocuments.net/reader036/viewer/2022062422/56649f335503460f94c4fb6a/html5/thumbnails/9.jpg)
Number of Users by Registered Year
![Page 10: YICHIA WANG 2011/02/22 Weekly Meeting. Mturk 10 Acor messages Correlation with expert annotation = 0.87 50 Acor messages + 50 Bambina messages](https://reader036.fdocuments.net/reader036/viewer/2022062422/56649f335503460f94c4fb6a/html5/thumbnails/10.jpg)
Number of Users by Number of Posts
51% of users (46,269 users) never posted Min: 1 Max: 21,703 Mean: 53.49 Median: 3
![Page 11: YICHIA WANG 2011/02/22 Weekly Meeting. Mturk 10 Acor messages Correlation with expert annotation = 0.87 50 Acor messages + 50 Bambina messages](https://reader036.fdocuments.net/reader036/viewer/2022062422/56649f335503460f94c4fb6a/html5/thumbnails/11.jpg)
Number of Users by Number of Thread Starters
80% of users (72,587 users) never started a thread Min: 1 Max: 1,551 Mean: 3.94 Median: 1