Student assessment

Assessment toolsAH Mehrparvar,MD

Occupational Medicine departmentYazd University of Medical Sciences

Assessment tools Portfolio Log book OSCE Mini CEX DOPS 360 degrees

Powerpoint Templates

Portfolios

Introduction

Portfolio assessments require the

accumulation of evidence gathered over

time

Characteristics of Portfolio Assessments Portfolio assessments: purposeful, organized

collection of student work that can be used to describe efforts, progress, or achievement• The idea of the academic portfolio is derived

from an artist’s or writer’s portfolio• Provide a means for students to show what

they can really do; they are considered to be based on the “real world”

• Student performances or products are compiled in an effort to show accomplishments or improvement over time

Characteristics of Portfolio Assessments

Portfolio assessments (continued)• Are not simply composed of random work

samples, nor is everything included; they represent a purposeful collection of work students must be included in the process criteria for selection of work must be

identified criteria for judging value of work must be

developed evidence of student reflection must exist

Characteristics of Portfolio Assessments Portfolio assessments (continued)

• Teachers provide guidelines and work collaboratively with students to identify goals of the portfolio and work samples to be included

• Both teacher and student have continuous access to its contents (much more student-centered than other forms of classroom assessment)

• Can be adapted to meet individual instructional needs (each portfolio is treated individually)

Characteristics of Portfolio Assessments Portfolio assessments (continued)

• Different from other forms of assessment, portfolios tend to focus on student achievements, not mistakes

• Portfolios accentuate student strengths• Can be an extremely time-consuming

endeavorThe review process (continual

examination of portfolio along with meetings with individual students)

Characteristics of Portfolio Assessments Portfolio assessments (continued)

• Three main features of any form of portfolio assessment:collection of student work must have

a specific purposestudents must be actively involved in

the process of selecting work to be included

students must actively engage in self-reflection

Creating PortfoliosCreating Portfolios:

Step-by-Step ProcedureStep 1: Determine the purpose to be served by

the portfolioStep 2: Identify the content, concepts, and skills

to be assessed Step 3: Plan for an efficient review process by

developing a time frame.Step 4: Specify how and when students will be

involvedStep 5: Develop scoring rubrics Step 6: Arrange for multiple reviewers to improve

reliability

Creating Portfolios:Step-by-Step Procedure

Step 1: Determine the purpose to be served by the portfolio

Step 2: Identify the content, concepts, and skills to be assessed

Step 3: Plan for an efficient review process by developing a time frame.

Step 4: Specify how and when students will be involved

Step 5: Develop scoring rubrics Step 6: Arrange for multiple reviewers to improve

reliability

Creating Portfolios Decisions on Content

• In most situations, students hold primary responsibility for selecting the content of portfolios (often in collaboration with the teacher)

• However, the teacher must make clear the specific criteria to be met by the samples

• No real limit to what can be included in a portfolio. There must be alignment between goals,

objectives for instruction, and the student products that serve as the basis for assessment.

Validity and Reliability of Portfolio Assessments Validity

• Important concerns: Specific student capabilities to be

represented by samples must be determined in advance

Selected works must represent the entire domain of the subject area

Scoring rubric must match the work included in the portfolio

Reliability• Consistency is interpreted as interrater

agreement• Multiple raters of a sample of portfolios can

facilitate this.• Since reliability tends to be low, portfolios

should not be used as sole means of assessing student performance.

Advantages and Limitations of Portfolio Assessments Advantages

• Substantial involvement of students in the process

• Can show student growth over time, as opposed to single “snapshot”

• Foster communication between teachers and students

• Require a shift in roles for teachers and students

Limitations• Time-intensive• Labor-intensive• Logistical issues of storage