Expertiza: Rubric-Based Peer Assessment of Team Projects Edward F. Gehringer Dept. of Computer...
-
Upload
anne-jackson -
Category
Documents
-
view
220 -
download
0
Transcript of Expertiza: Rubric-Based Peer Assessment of Team Projects Edward F. Gehringer Dept. of Computer...
![Page 1: Expertiza: Rubric-Based Peer Assessment of Team Projects Edward F. Gehringer Dept. of Computer Science North Carolina State University Supported by NSF.](https://reader035.fdocuments.net/reader035/viewer/2022081513/56649ec05503460f94bcc3fd/html5/thumbnails/1.jpg)
Expertiza: Rubric-Based Peer Expertiza: Rubric-Based Peer Assessment of Team ProjectsAssessment of Team Projects
Edward F. GehringerDept. of Computer Science
North Carolina State University
Supported by NSF DUE under a CCLI grantNCSU Faculty Center for Teaching and Learning
NCSU STEM InitiativeCenter for Advanced Computing and Communication
![Page 2: Expertiza: Rubric-Based Peer Assessment of Team Projects Edward F. Gehringer Dept. of Computer Science North Carolina State University Supported by NSF.](https://reader035.fdocuments.net/reader035/viewer/2022081513/56649ec05503460f94bcc3fd/html5/thumbnails/2.jpg)
04/20/23 Gehringer, Rubric-based peer assessment of team projects, [email protected]
Outline Expertiza Rationale Team Assignments Expertiza “Virtual” Demo Forthcoming Features Workshop
![Page 3: Expertiza: Rubric-Based Peer Assessment of Team Projects Edward F. Gehringer Dept. of Computer Science North Carolina State University Supported by NSF.](https://reader035.fdocuments.net/reader035/viewer/2022081513/56649ec05503460f94bcc3fd/html5/thumbnails/3.jpg)
04/20/23 Gehringer, Rubric-based peer assessment of team projects, [email protected]
Introduction Expertiza began as a peer-review system for co-
production of course resources. Building resources through electronic peer
review gets students working together to improve others’
learning experiences, helps them learn, by performing tasks that are similar
to real-world responsibilities, gives them experience in writing their ideas up for an
audience of their peers, allows each cohort to “stand on the shoulders” of
students in earlier classes.
![Page 4: Expertiza: Rubric-Based Peer Assessment of Team Projects Edward F. Gehringer Dept. of Computer Science North Carolina State University Supported by NSF.](https://reader035.fdocuments.net/reader035/viewer/2022081513/56649ec05503460f94bcc3fd/html5/thumbnails/4.jpg)
04/20/23 Gehringer, Rubric-based peer assessment of team projects, [email protected]
Homework, traditionally … For students to demonstrate mastery of
the subject. Every student does the same thing—
redundant effort. Work is graded and thrown away, never
benefiting anyone but the student who did it. In Expertiza, students (or teams) sign up
for different work Now the best work can be reused, to
help others learn.
![Page 5: Expertiza: Rubric-Based Peer Assessment of Team Projects Edward F. Gehringer Dept. of Computer Science North Carolina State University Supported by NSF.](https://reader035.fdocuments.net/reader035/viewer/2022081513/56649ec05503460f94bcc3fd/html5/thumbnails/5.jpg)
04/20/23 Gehringer, Rubric-based peer assessment of team projects, [email protected]
Major advantages Expertiza discourages plagiarism
Students are not doing the same work. Their work must go through multiple review
cycles Expertiza better utilizes scarce resources
Students do most of the reviewing. Instructor/TA spend less time grading.
With Expertiza, large classes are an advantage!
![Page 6: Expertiza: Rubric-Based Peer Assessment of Team Projects Edward F. Gehringer Dept. of Computer Science North Carolina State University Supported by NSF.](https://reader035.fdocuments.net/reader035/viewer/2022081513/56649ec05503460f94bcc3fd/html5/thumbnails/6.jpg)
04/20/23 Gehringer, Rubric-based peer assessment of team projects, [email protected]
Why team assignments? Teamwork mimics the work environment Teaming skills are important to success Teams can tackle larger projects,
which diminishes the effort of integration
![Page 7: Expertiza: Rubric-Based Peer Assessment of Team Projects Edward F. Gehringer Dept. of Computer Science North Carolina State University Supported by NSF.](https://reader035.fdocuments.net/reader035/viewer/2022081513/56649ec05503460f94bcc3fd/html5/thumbnails/7.jpg)
04/20/23 Gehringer, Rubric-based peer assessment of team projects, [email protected]
How does Expertiza support teams? All team members have access to a
common submission area. Any member can revise the submission.
Individuals review teams. This simplifies reviewing, and provides for more reviews.
Teammates assess each other’s contribution to the team. This score can be factored into the student’s
grade.
![Page 8: Expertiza: Rubric-Based Peer Assessment of Team Projects Edward F. Gehringer Dept. of Computer Science North Carolina State University Supported by NSF.](https://reader035.fdocuments.net/reader035/viewer/2022081513/56649ec05503460f94bcc3fd/html5/thumbnails/8.jpg)
04/20/23 Gehringer, Rubric-based peer assessment of team projects, [email protected]
“Virtual” demo Team formation
By instructor, from the user interface By instructor, by importing a file By students, by issuing invitations
Reviewing Feedback from author to reviewer Teammate review
![Page 9: Expertiza: Rubric-Based Peer Assessment of Team Projects Edward F. Gehringer Dept. of Computer Science North Carolina State University Supported by NSF.](https://reader035.fdocuments.net/reader035/viewer/2022081513/56649ec05503460f94bcc3fd/html5/thumbnails/9.jpg)
04/20/23 Gehringer, Rubric-based peer assessment of team projects, [email protected]
The login screen
Let’s log in as an instructor …
![Page 10: Expertiza: Rubric-Based Peer Assessment of Team Projects Edward F. Gehringer Dept. of Computer Science North Carolina State University Supported by NSF.](https://reader035.fdocuments.net/reader035/viewer/2022081513/56649ec05503460f94bcc3fd/html5/thumbnails/10.jpg)
04/20/23 Gehringer, Rubric-based peer assessment of team projects, [email protected]
The instructor’s homepage
![Page 11: Expertiza: Rubric-Based Peer Assessment of Team Projects Edward F. Gehringer Dept. of Computer Science North Carolina State University Supported by NSF.](https://reader035.fdocuments.net/reader035/viewer/2022081513/56649ec05503460f94bcc3fd/html5/thumbnails/11.jpg)
04/20/23 Gehringer, Rubric-based peer assessment of team projects, [email protected]
Setting up a wiki assignment
![Page 12: Expertiza: Rubric-Based Peer Assessment of Team Projects Edward F. Gehringer Dept. of Computer Science North Carolina State University Supported by NSF.](https://reader035.fdocuments.net/reader035/viewer/2022081513/56649ec05503460f94bcc3fd/html5/thumbnails/12.jpg)
04/20/23 Gehringer, Rubric-based peer assessment of team projects, [email protected]
Let’s create some teams …
![Page 13: Expertiza: Rubric-Based Peer Assessment of Team Projects Edward F. Gehringer Dept. of Computer Science North Carolina State University Supported by NSF.](https://reader035.fdocuments.net/reader035/viewer/2022081513/56649ec05503460f94bcc3fd/html5/thumbnails/13.jpg)
04/20/23 Gehringer, Rubric-based peer assessment of team projects, [email protected]
In the beginning, there are no teams
![Page 14: Expertiza: Rubric-Based Peer Assessment of Team Projects Edward F. Gehringer Dept. of Computer Science North Carolina State University Supported by NSF.](https://reader035.fdocuments.net/reader035/viewer/2022081513/56649ec05503460f94bcc3fd/html5/thumbnails/14.jpg)
04/20/23 Gehringer, Rubric-based peer assessment of team projects, [email protected]
But let’s create one …
![Page 15: Expertiza: Rubric-Based Peer Assessment of Team Projects Edward F. Gehringer Dept. of Computer Science North Carolina State University Supported by NSF.](https://reader035.fdocuments.net/reader035/viewer/2022081513/56649ec05503460f94bcc3fd/html5/thumbnails/15.jpg)
04/20/23 Gehringer, Rubric-based peer assessment of team projects, [email protected]
Team created; let’s add members
![Page 16: Expertiza: Rubric-Based Peer Assessment of Team Projects Edward F. Gehringer Dept. of Computer Science North Carolina State University Supported by NSF.](https://reader035.fdocuments.net/reader035/viewer/2022081513/56649ec05503460f94bcc3fd/html5/thumbnails/16.jpg)
04/20/23 Gehringer, Rubric-based peer assessment of team projects, [email protected]
1st member is added; now for the 2nd …
![Page 17: Expertiza: Rubric-Based Peer Assessment of Team Projects Edward F. Gehringer Dept. of Computer Science North Carolina State University Supported by NSF.](https://reader035.fdocuments.net/reader035/viewer/2022081513/56649ec05503460f94bcc3fd/html5/thumbnails/17.jpg)
04/20/23 Gehringer, Rubric-based peer assessment of team projects, [email protected]
Team now has two members
![Page 18: Expertiza: Rubric-Based Peer Assessment of Team Projects Edward F. Gehringer Dept. of Computer Science North Carolina State University Supported by NSF.](https://reader035.fdocuments.net/reader035/viewer/2022081513/56649ec05503460f94bcc3fd/html5/thumbnails/18.jpg)
04/20/23 Gehringer, Rubric-based peer assessment of team projects, [email protected]
“Virtual” demo Team formation
By instructor, from the user interface By instructor, by importing a file By students, by issuing invitations
Reviewing Feedback from author to reviewer Teammate review
![Page 19: Expertiza: Rubric-Based Peer Assessment of Team Projects Edward F. Gehringer Dept. of Computer Science North Carolina State University Supported by NSF.](https://reader035.fdocuments.net/reader035/viewer/2022081513/56649ec05503460f94bcc3fd/html5/thumbnails/19.jpg)
04/20/23 Gehringer, Rubric-based peer assessment of team projects, [email protected]
Importing teams
![Page 20: Expertiza: Rubric-Based Peer Assessment of Team Projects Edward F. Gehringer Dept. of Computer Science North Carolina State University Supported by NSF.](https://reader035.fdocuments.net/reader035/viewer/2022081513/56649ec05503460f94bcc3fd/html5/thumbnails/20.jpg)
04/20/23 Gehringer, Rubric-based peer assessment of team projects, [email protected]
Here’s the file that’ll be imported
![Page 21: Expertiza: Rubric-Based Peer Assessment of Team Projects Edward F. Gehringer Dept. of Computer Science North Carolina State University Supported by NSF.](https://reader035.fdocuments.net/reader035/viewer/2022081513/56649ec05503460f94bcc3fd/html5/thumbnails/21.jpg)
04/20/23 Gehringer, Rubric-based peer assessment of team projects, [email protected]
Here’s how we import it
![Page 22: Expertiza: Rubric-Based Peer Assessment of Team Projects Edward F. Gehringer Dept. of Computer Science North Carolina State University Supported by NSF.](https://reader035.fdocuments.net/reader035/viewer/2022081513/56649ec05503460f94bcc3fd/html5/thumbnails/22.jpg)
04/20/23 Gehringer, Rubric-based peer assessment of team projects, [email protected]
Now there are five teams …
![Page 23: Expertiza: Rubric-Based Peer Assessment of Team Projects Edward F. Gehringer Dept. of Computer Science North Carolina State University Supported by NSF.](https://reader035.fdocuments.net/reader035/viewer/2022081513/56649ec05503460f94bcc3fd/html5/thumbnails/23.jpg)
04/20/23 Gehringer, Rubric-based peer assessment of team projects, [email protected]
“Virtual” demo Team formation
By instructor, from the user interface By instructor, by importing a file By students, by issuing invitations
Reviewing Feedback from author to reviewer Teammate review
![Page 24: Expertiza: Rubric-Based Peer Assessment of Team Projects Edward F. Gehringer Dept. of Computer Science North Carolina State University Supported by NSF.](https://reader035.fdocuments.net/reader035/viewer/2022081513/56649ec05503460f94bcc3fd/html5/thumbnails/24.jpg)
04/20/23 Gehringer, Rubric-based peer assessment of team projects, [email protected]
Students can create teams too …
![Page 25: Expertiza: Rubric-Based Peer Assessment of Team Projects Edward F. Gehringer Dept. of Computer Science North Carolina State University Supported by NSF.](https://reader035.fdocuments.net/reader035/viewer/2022081513/56649ec05503460f94bcc3fd/html5/thumbnails/25.jpg)
04/20/23 Gehringer, Rubric-based peer assessment of team projects, [email protected]
Click on this assignment, Team test 2
![Page 26: Expertiza: Rubric-Based Peer Assessment of Team Projects Edward F. Gehringer Dept. of Computer Science North Carolina State University Supported by NSF.](https://reader035.fdocuments.net/reader035/viewer/2022081513/56649ec05503460f94bcc3fd/html5/thumbnails/26.jpg)
04/20/23 Gehringer, Rubric-based peer assessment of team projects, [email protected]
Now, click on “Your team”
![Page 27: Expertiza: Rubric-Based Peer Assessment of Team Projects Edward F. Gehringer Dept. of Computer Science North Carolina State University Supported by NSF.](https://reader035.fdocuments.net/reader035/viewer/2022081513/56649ec05503460f94bcc3fd/html5/thumbnails/27.jpg)
04/20/23 Gehringer, Rubric-based peer assessment of team projects, [email protected]
This user needs to set up a team
![Page 28: Expertiza: Rubric-Based Peer Assessment of Team Projects Edward F. Gehringer Dept. of Computer Science North Carolina State University Supported by NSF.](https://reader035.fdocuments.net/reader035/viewer/2022081513/56649ec05503460f94bcc3fd/html5/thumbnails/28.jpg)
04/20/23 Gehringer, Rubric-based peer assessment of team projects, [email protected]
Let’s create a team
![Page 29: Expertiza: Rubric-Based Peer Assessment of Team Projects Edward F. Gehringer Dept. of Computer Science North Carolina State University Supported by NSF.](https://reader035.fdocuments.net/reader035/viewer/2022081513/56649ec05503460f94bcc3fd/html5/thumbnails/29.jpg)
04/20/23 Gehringer, Rubric-based peer assessment of team projects, [email protected]
Invite another member to join …
![Page 30: Expertiza: Rubric-Based Peer Assessment of Team Projects Edward F. Gehringer Dept. of Computer Science North Carolina State University Supported by NSF.](https://reader035.fdocuments.net/reader035/viewer/2022081513/56649ec05503460f94bcc3fd/html5/thumbnails/30.jpg)
04/20/23 Gehringer, Rubric-based peer assessment of team projects, [email protected]
Invitation has been sent
![Page 31: Expertiza: Rubric-Based Peer Assessment of Team Projects Edward F. Gehringer Dept. of Computer Science North Carolina State University Supported by NSF.](https://reader035.fdocuments.net/reader035/viewer/2022081513/56649ec05503460f94bcc3fd/html5/thumbnails/31.jpg)
04/20/23 Gehringer, Rubric-based peer assessment of team projects, [email protected]
Now the invited user logs in
![Page 32: Expertiza: Rubric-Based Peer Assessment of Team Projects Edward F. Gehringer Dept. of Computer Science North Carolina State University Supported by NSF.](https://reader035.fdocuments.net/reader035/viewer/2022081513/56649ec05503460f94bcc3fd/html5/thumbnails/32.jpg)
04/20/23 Gehringer, Rubric-based peer assessment of team projects, [email protected]
… and goes to Team test 2
![Page 33: Expertiza: Rubric-Based Peer Assessment of Team Projects Edward F. Gehringer Dept. of Computer Science North Carolina State University Supported by NSF.](https://reader035.fdocuments.net/reader035/viewer/2022081513/56649ec05503460f94bcc3fd/html5/thumbnails/33.jpg)
04/20/23 Gehringer, Rubric-based peer assessment of team projects, [email protected]
Then accepts the invitation
![Page 34: Expertiza: Rubric-Based Peer Assessment of Team Projects Edward F. Gehringer Dept. of Computer Science North Carolina State University Supported by NSF.](https://reader035.fdocuments.net/reader035/viewer/2022081513/56649ec05503460f94bcc3fd/html5/thumbnails/34.jpg)
04/20/23 Gehringer, Rubric-based peer assessment of team projects, [email protected]
… and is placed on the team
![Page 35: Expertiza: Rubric-Based Peer Assessment of Team Projects Edward F. Gehringer Dept. of Computer Science North Carolina State University Supported by NSF.](https://reader035.fdocuments.net/reader035/viewer/2022081513/56649ec05503460f94bcc3fd/html5/thumbnails/35.jpg)
04/20/23 Gehringer, Rubric-based peer assessment of team projects, [email protected]
Advantages of various approaches Instructor-assigned teams
using class rank using demographics
Student-selected teams Forthcoming: Schedule-based team
formation
![Page 36: Expertiza: Rubric-Based Peer Assessment of Team Projects Edward F. Gehringer Dept. of Computer Science North Carolina State University Supported by NSF.](https://reader035.fdocuments.net/reader035/viewer/2022081513/56649ec05503460f94bcc3fd/html5/thumbnails/36.jpg)
04/20/23 Gehringer, Rubric-based peer assessment of team projects, [email protected]
“Virtual” demo Team formation
By instructor, from the user interface By instructor, by importing a file By students, by issuing invitations
Reviewing Feedback from author to reviewer Teammate review
![Page 37: Expertiza: Rubric-Based Peer Assessment of Team Projects Edward F. Gehringer Dept. of Computer Science North Carolina State University Supported by NSF.](https://reader035.fdocuments.net/reader035/viewer/2022081513/56649ec05503460f94bcc3fd/html5/thumbnails/37.jpg)
04/20/23 Gehringer, Rubric-based peer assessment of team projects, [email protected]
Let’s review a wiki page
![Page 38: Expertiza: Rubric-Based Peer Assessment of Team Projects Edward F. Gehringer Dept. of Computer Science North Carolina State University Supported by NSF.](https://reader035.fdocuments.net/reader035/viewer/2022081513/56649ec05503460f94bcc3fd/html5/thumbnails/38.jpg)
04/20/23 Gehringer, Rubric-based peer assessment of team projects, [email protected]
Click on the assignment …
![Page 39: Expertiza: Rubric-Based Peer Assessment of Team Projects Edward F. Gehringer Dept. of Computer Science North Carolina State University Supported by NSF.](https://reader035.fdocuments.net/reader035/viewer/2022081513/56649ec05503460f94bcc3fd/html5/thumbnails/39.jpg)
04/20/23 Gehringer, Rubric-based peer assessment of team projects, [email protected]
… then on “Others’ work”
![Page 40: Expertiza: Rubric-Based Peer Assessment of Team Projects Edward F. Gehringer Dept. of Computer Science North Carolina State University Supported by NSF.](https://reader035.fdocuments.net/reader035/viewer/2022081513/56649ec05503460f94bcc3fd/html5/thumbnails/40.jpg)
04/20/23 Gehringer, Rubric-based peer assessment of team projects, [email protected]
Choose a review
![Page 41: Expertiza: Rubric-Based Peer Assessment of Team Projects Edward F. Gehringer Dept. of Computer Science North Carolina State University Supported by NSF.](https://reader035.fdocuments.net/reader035/viewer/2022081513/56649ec05503460f94bcc3fd/html5/thumbnails/41.jpg)
04/20/23 Gehringer, Rubric-based peer assessment of team projects, [email protected]
Read the submitted wiki page
![Page 42: Expertiza: Rubric-Based Peer Assessment of Team Projects Edward F. Gehringer Dept. of Computer Science North Carolina State University Supported by NSF.](https://reader035.fdocuments.net/reader035/viewer/2022081513/56649ec05503460f94bcc3fd/html5/thumbnails/42.jpg)
04/20/23 Gehringer, Rubric-based peer assessment of team projects, [email protected]
Then fill out the review template
![Page 43: Expertiza: Rubric-Based Peer Assessment of Team Projects Edward F. Gehringer Dept. of Computer Science North Carolina State University Supported by NSF.](https://reader035.fdocuments.net/reader035/viewer/2022081513/56649ec05503460f94bcc3fd/html5/thumbnails/43.jpg)
04/20/23 Gehringer, Rubric-based peer assessment of team projects, [email protected]
Save and view the review
![Page 44: Expertiza: Rubric-Based Peer Assessment of Team Projects Edward F. Gehringer Dept. of Computer Science North Carolina State University Supported by NSF.](https://reader035.fdocuments.net/reader035/viewer/2022081513/56649ec05503460f94bcc3fd/html5/thumbnails/44.jpg)
04/20/23 Gehringer, Rubric-based peer assessment of team projects, [email protected]/29/08 Gehringer: Expertiza: A Peer-Review System for Collaborative Learning, [email protected]
After the Initial Review
Resubmission phase. 2–7 days to revise work in response to reviewer comments.
Final review. 3–7 days to make final comments and assign scores.
Metareview phase. Students review each other’s reviews.
![Page 45: Expertiza: Rubric-Based Peer Assessment of Team Projects Edward F. Gehringer Dept. of Computer Science North Carolina State University Supported by NSF.](https://reader035.fdocuments.net/reader035/viewer/2022081513/56649ec05503460f94bcc3fd/html5/thumbnails/45.jpg)
04/20/23 Gehringer, Rubric-based peer assessment of team projects, [email protected]
“Virtual” demo Team formation
By instructor, from the user interface By instructor, by importing a file By students, by issuing invitations
Reviewing Feedback from author to reviewer Teammate review
![Page 46: Expertiza: Rubric-Based Peer Assessment of Team Projects Edward F. Gehringer Dept. of Computer Science North Carolina State University Supported by NSF.](https://reader035.fdocuments.net/reader035/viewer/2022081513/56649ec05503460f94bcc3fd/html5/thumbnails/46.jpg)
04/20/23 Gehringer, Rubric-based peer assessment of team projects, [email protected]
Now the reviewee logs in …
![Page 47: Expertiza: Rubric-Based Peer Assessment of Team Projects Edward F. Gehringer Dept. of Computer Science North Carolina State University Supported by NSF.](https://reader035.fdocuments.net/reader035/viewer/2022081513/56649ec05503460f94bcc3fd/html5/thumbnails/47.jpg)
04/20/23 Gehringer, Rubric-based peer assessment of team projects, [email protected]
… and views the scores
![Page 48: Expertiza: Rubric-Based Peer Assessment of Team Projects Edward F. Gehringer Dept. of Computer Science North Carolina State University Supported by NSF.](https://reader035.fdocuments.net/reader035/viewer/2022081513/56649ec05503460f94bcc3fd/html5/thumbnails/48.jpg)
04/20/23 Gehringer, Rubric-based peer assessment of team projects, [email protected]
Click on “View” to expand review
![Page 49: Expertiza: Rubric-Based Peer Assessment of Team Projects Edward F. Gehringer Dept. of Computer Science North Carolina State University Supported by NSF.](https://reader035.fdocuments.net/reader035/viewer/2022081513/56649ec05503460f94bcc3fd/html5/thumbnails/49.jpg)
04/20/23 Gehringer, Rubric-based peer assessment of team projects, [email protected]
Notice the link down at the bottom
![Page 50: Expertiza: Rubric-Based Peer Assessment of Team Projects Edward F. Gehringer Dept. of Computer Science North Carolina State University Supported by NSF.](https://reader035.fdocuments.net/reader035/viewer/2022081513/56649ec05503460f94bcc3fd/html5/thumbnails/50.jpg)
04/20/23 Gehringer, Rubric-based peer assessment of team projects, [email protected]
Use it to give feedback to the reviewer
![Page 51: Expertiza: Rubric-Based Peer Assessment of Team Projects Edward F. Gehringer Dept. of Computer Science North Carolina State University Supported by NSF.](https://reader035.fdocuments.net/reader035/viewer/2022081513/56649ec05503460f94bcc3fd/html5/thumbnails/51.jpg)
04/20/23 Gehringer, Rubric-based peer assessment of team projects, [email protected]
Then the reviewer can view the feedback
![Page 52: Expertiza: Rubric-Based Peer Assessment of Team Projects Edward F. Gehringer Dept. of Computer Science North Carolina State University Supported by NSF.](https://reader035.fdocuments.net/reader035/viewer/2022081513/56649ec05503460f94bcc3fd/html5/thumbnails/52.jpg)
04/20/23 Gehringer, Rubric-based peer assessment of team projects, [email protected]
“Virtual” demo Team formation
By instructor, from the user interface By instructor, by importing a file By students, by issuing invitations
Reviewing Feedback from author to reviewer Teammate review
![Page 53: Expertiza: Rubric-Based Peer Assessment of Team Projects Edward F. Gehringer Dept. of Computer Science North Carolina State University Supported by NSF.](https://reader035.fdocuments.net/reader035/viewer/2022081513/56649ec05503460f94bcc3fd/html5/thumbnails/53.jpg)
04/20/23 Gehringer, Rubric-based peer assessment of team projects, [email protected]
Review of teammates
![Page 54: Expertiza: Rubric-Based Peer Assessment of Team Projects Edward F. Gehringer Dept. of Computer Science North Carolina State University Supported by NSF.](https://reader035.fdocuments.net/reader035/viewer/2022081513/56649ec05503460f94bcc3fd/html5/thumbnails/54.jpg)
04/20/23 Gehringer, Rubric-based peer assessment of team projects, [email protected]
Answer these questions …
![Page 55: Expertiza: Rubric-Based Peer Assessment of Team Projects Edward F. Gehringer Dept. of Computer Science North Carolina State University Supported by NSF.](https://reader035.fdocuments.net/reader035/viewer/2022081513/56649ec05503460f94bcc3fd/html5/thumbnails/55.jpg)
04/20/23 Gehringer, Rubric-based peer assessment of team projects, [email protected]
Summary of feedback in Expertiza Reviews Feedback to author Teammate reviews Metareviews (x reviews y’s review of z) Surveys
All but surveys can influence the final grade
![Page 56: Expertiza: Rubric-Based Peer Assessment of Team Projects Edward F. Gehringer Dept. of Computer Science North Carolina State University Supported by NSF.](https://reader035.fdocuments.net/reader035/viewer/2022081513/56649ec05503460f94bcc3fd/html5/thumbnails/56.jpg)
04/20/23 Gehringer, Rubric-based peer assessment of team projects, [email protected]
Instructor report
![Page 57: Expertiza: Rubric-Based Peer Assessment of Team Projects Edward F. Gehringer Dept. of Computer Science North Carolina State University Supported by NSF.](https://reader035.fdocuments.net/reader035/viewer/2022081513/56649ec05503460f94bcc3fd/html5/thumbnails/57.jpg)
04/20/23 Gehringer, Rubric-based peer assessment of team projects, [email protected]
New Features Coming to Expertiza Game mechanics …
Achievements system Reputation system Leaderboards Levels
Message boards Students can ask for help; other students can
answer Microtasks/micropayments
![Page 58: Expertiza: Rubric-Based Peer Assessment of Team Projects Edward F. Gehringer Dept. of Computer Science North Carolina State University Supported by NSF.](https://reader035.fdocuments.net/reader035/viewer/2022081513/56649ec05503460f94bcc3fd/html5/thumbnails/58.jpg)
04/20/23 Gehringer, Rubric-based peer assessment of team projects, [email protected]
Forthcoming: Achievement System Like in computer games. Categories in which achievement is tracked
Quality of submitted work Quality of reviews Contribution to team Helpfulness to other students
Prompt reviews/answers are more helpful, so reward for these …
![Page 59: Expertiza: Rubric-Based Peer Assessment of Team Projects Edward F. Gehringer Dept. of Computer Science North Carolina State University Supported by NSF.](https://reader035.fdocuments.net/reader035/viewer/2022081513/56649ec05503460f94bcc3fd/html5/thumbnails/59.jpg)
04/20/23 Gehringer, Rubric-based peer assessment of team projects, [email protected]
Forthcoming: Message Boards Student a posts a question Student b responds Student a rates student b’s response Others can rate response too.
TAs can also respond Reliability …
![Page 60: Expertiza: Rubric-Based Peer Assessment of Team Projects Edward F. Gehringer Dept. of Computer Science North Carolina State University Supported by NSF.](https://reader035.fdocuments.net/reader035/viewer/2022081513/56649ec05503460f94bcc3fd/html5/thumbnails/60.jpg)
04/20/23 Gehringer, Rubric-based peer assessment of team projects, [email protected]
Forthcoming: Microtasks/micropayments Desired enhancements posted
Along with amount of “payment” Students can voluntarily perform the
task. Students can also post tasks. How students should “pay” for these
tasks
![Page 61: Expertiza: Rubric-Based Peer Assessment of Team Projects Edward F. Gehringer Dept. of Computer Science North Carolina State University Supported by NSF.](https://reader035.fdocuments.net/reader035/viewer/2022081513/56649ec05503460f94bcc3fd/html5/thumbnails/61.jpg)
04/20/23 Gehringer, Rubric-based peer assessment of team projects, [email protected]
For more info … http://research.csc.ncsu.edu/efg/expertiza Ed Gehringer, [email protected]
Now, for the hands-on demo …
![Page 62: Expertiza: Rubric-Based Peer Assessment of Team Projects Edward F. Gehringer Dept. of Computer Science North Carolina State University Supported by NSF.](https://reader035.fdocuments.net/reader035/viewer/2022081513/56649ec05503460f94bcc3fd/html5/thumbnails/62.jpg)
04/20/23 Gehringer, Rubric-based peer assessment of team projects, [email protected]
Edit a Wiki Page1. Go to [redacted]
2. You will be redirected to this page:
3. Log in with “unctlt#” and password “unctlt”.
4. Return to UNC_TLT, click on your user # and start editing.
5. Save your page.
![Page 63: Expertiza: Rubric-Based Peer Assessment of Team Projects Edward F. Gehringer Dept. of Computer Science North Carolina State University Supported by NSF.](https://reader035.fdocuments.net/reader035/viewer/2022081513/56649ec05503460f94bcc3fd/html5/thumbnails/63.jpg)
04/20/23 Gehringer, Rubric-based peer assessment of team projects, [email protected]
Review a Wiki Page
1. After you save the page you were editing, log in at http://expertiza.ncsu.edu with the same username and password.
2. Click on “Others’ work”, then on “Begin” for one of the reviews.
3. Assign scores and give text comments.