Post on 01-Jan-2016
description
NESCent Postdoc Professional Development NESCent Postdoc Professional Development Series on Effective Teaching and LearningSeries on Effective Teaching and Learning
Session 7 – Testing, Assessment and Session 7 – Testing, Assessment and GradingGrading
October 20th, 2006NESCent - Durham, NC
The ONE Thing You Should Take Away From Today’s Session…
Learning objectives should determine assessment
strategies, not vice versa!
Overview
• General philosophies of assessment and grading; testing styles
• “Teaching Goals Inventories” and their use in designing assessment strategies
• Techniques for assessing content knowledge (traditional and “alternative”)
• Potential pitfalls in grading and assessment strategies
• References and resources
Assessment: A Definition
• The collection and analysis of information used to indicate how/how much students are learning.
• Examples of assessments: tests, quizzes, assignments, projects, tasks, activities, presentations.
• It is a process, not an event.
Assessment
• Provides information about instructor(s), as well as students.
• Should be used to provide students with feedback on their progress, strengths, weaknesses, etc.
• Should be used to identify necessary changes in instructional methods, styles.
Formative vs. Summative Assessment
• Formative Assessment: Done throughout course (including very beginning). Used to improve quality of student learning. (Exs. Non-graded (or minimally graded) quizzes, “minute papers”, student comments)
• Summative Assessment: “End of Class” testing. Comprehensive, provides accountability.
Testing Styles
• Just as students have different “learning styles”, they also have different “testing styles”.
• Be aware of this, respect it, but don’t cater your course or assessment plan to a particular testing style.
• Best approach: Develop a strategy that assesses as many testing styles as possible, within reason.
“Teaching Goals Inventory”
• Identify and characterize learning goals.
• Use a TGI tool to accomplish this (www.uiowa.edu/~centeach/tgi)
• Examples of learning goals: basic knowledge, higher-order thinking, critical thinking, career prep/professional development, etc.
• Develop formative and summative assessements to evaluate learning
Techniques and Methods
• Traditional assessment and testing methods
– What are some examples?– What are some strengths/weaknesses
of these?
• “Alternative” testing methods – A case study
What Do I Want From My Students?
• Demonstrate a comprehensive understanding of topics covered in the course.
• Synthesize concepts into a “big picture”.
• Explain at a level that is appropriate for target audience.
The Idea…
Explain Immunology by writing a children’s story,
along the lines of “The Magic Schoolbus” series.
Magic School Bus: Observations
• Complex scientific concepts are addressed.
• Concepts are explained thoroughly, accurately and at a level that is appropriate for the target audience.
• The target audience knows less about the topic than the author.
The Details
• Students are given three topics from which to choose. These topics overlap and each is comprehensive.
• Exam is take-home. It is assigned with 2-3 weeks left in the semester and is due on the day of the scheduled final.
• Any books, notes, handouts may be used.• Students are required to illustrate their
story, but it is heavily emphasized that they will not be graded on artistic ability.
Grading
• Scope (40%)
• Accuracy (40%)
• Creativity (20%)
The Results…
Student Attitudes Regarding This Format
56
106
00
10
20
30
40
50
60
Like Format SomeReservations
Dislike Format Indifferent
At first I thought “Oh…a children’s book…piece of cake”. But, as I started outlining what I wanted to say, I started to really have to think about the T cell process and how to say it all effectively. It is HARD!
I think it will really help me to retain what I’ve learned in the course. I remember very little from most of my college classes because I couldn’t remember the basics. This should cement the fundamentals for me.
I like the fact that we get to take what we know and make sure we know it by explaining it to others.
It forces you to really understand the concepts while allowing room for creativity (something you rarely get to use in science courses).
I have never had a final in which we had to think like that, which was not just refreshing, but fun as well. I found a lot of gaps in what I have learned over the semester by doing this assignment, which caused me to work pretty hard…once I finished…I felt proud of what I had done.
Student Comments
I think it is a good tool to test my immunological knowledge, but it is too shallow, not testing my understanding of immunology thoroughly enough.
Not too happy with it. I think there may be some bias when it comes to grading over who’s more artistic.
The final exam is idiotic and rewards creativity and writing ability more than actual knowledge of the subject matter. I think this final is an unfair way to test students.
Student Comments
Potential Pitfalls
• Testing/assessment shapes content or learning objectives
• Testing students on content not covered• Failure to provide CLEAR expectations
and justification• Failure to develop and adhere to a rubric• Failure to give students a chance to
“practice” multiple times (with feedback!)
Some Good Resources…
• Classroom Assessment Techniques (1993), Angelo and Cross
• Effective Grading: A Tool for Learning and Assessment (1998), Walvoord and Anderson