Post on 11-Jan-2016
description
Cooking Up Rubrics!
Sharon GreenCalifornia State University East Bay
Julie Marty-PearsonBakersfield College & Brandman University
Meet the Chefs
Julie Marty-Pearson, PsyD
Experience in Assessment role:❍ WASC Assessment Leadership Academy Alum❍ At both 2-yr and 4-yr colleges❍ Working with departments, schools❍ Faculty Development❍ Testing
Now as Adjunct faculty at different institutions
2
Meet the Chefs3
Meet the Chef’s
Sharon Green, PhD
30-year Faculty Member at Cal State East Bay, currently in the classroom
Experience in Assessment role:❍ Faculty Development: Faculty
Learning Communities❍ Faculty Coordinator of Learning
and Assessment
4
One Chef’s Journey5
What Is A Rubric?
A scoring tool that lays out specific expectations for performance for an assignment, a course, or a process.
Includes:❍ Task description❍ Dimensions of the assignment❍ A scale ❍ Characteristics of each level of performance ❍ Weights, points, or grades associated with each
measure (optional)
6
Advantages of Serving Rubrics
Rubrics help students understand your expectations.
Rubrics help clarify vague, fuzzy goals for students.
Rubrics can inspire better student performance.
Rubrics can help students self-monitor and self-improve.
Rubrics improve feedback to students.
7
Advantages of Serving Rubrics
Developing rubrics helps faculty members to precisely define their expectations for student learning.
Rubrics make grading complex products or behaviors faster and easier.
Using rubrics can help reduce arguments with students.
Clear, complete rubrics can be applied reliably by faculty members and others to assess performance.
Evidence from rubrics provide useful feedback for faculty and staff about achievement of learning outcomes.
8
Varieties of Rubrics
Two major types of scoring rubrics:❍ Holistic rubrics- one global, holistic score
for a product or behavior See example pages 2-4
❍ Analytic rubrics- separate, holistic scoring of specified characteristics of a product or behavior See example page 5-6
9
Rubrics, Grading, & Assessment
Faculty members retain control of decisions about:❍ what is included in rubrics;❍ how rubrics will be used for grading.
When faculty members use rubrics, the results can be used simultaneously to provide: ❍ feedback to students;❍ the basis for grades;❍ evidence for assessment.
To meet multiple objectives: precision and calibration
10
How Do You Want to Use Rubrics?
Talk with a partner about ways that you expect to integrate a rubric in to a course that you
teach.
11
Cooking Up Rubrics
Let’s get cooking!
12
Start with a good recipe!
13
How to Prepare Rubrics
Reflect & Collaborate Plan
Identify & Collect Shop
Divide & Define Chop
Measure & Weight Prep
Constitute & Combine Cook
Test & Adjust Taste
Implement Serve
14
PLAN: Reflect & Collaborate
Reflect on what your expectations of students are, why you created the assignment, what results you have seen in the past.
When possible, collaborate in reflecting with colleagues (and students) about expectations, assignments, student work.
15
PLAN: Reflection & Collaboration
What assignment(s) will you be assessing with this rubric?
What evidence can students provide in this assignment that would show that they have accomplished what you hoped they would?
What are the highest & lowest expectations that you have for student performance on this assignment?
Do colleagues in your program use comparable assignments? Can you work with them in developing a rubric?
16
PLAN: Reflect & Collaborate
Talk with a partner about the assignment that you will be using, the evidence available for assessment, and the opportunities for collaboration.
17
SHOP: Identify & Collect
To inform the development of your rubric, identify and collect foundational documents that inform learning objectives.❍ CSUEB Mission, Shared Commitments❍ CSUEB Institutional Learning Outcomes (ILOs)❍ Department’s Program Learning Outcomes (PLOs)❍ Course Student Learning Outcomes (SLOs)
18
SHOP: Identify & Collect
Shopping for ingredients: collect fresh and local?❍ Collect examples of past student
work (artifacts).❍ Identify problems, areas of
weakness among students in your course, in your program.
19
SHOP: Identify & Collect
Do I have to start from scratch?❍ Learn from others: sample
existing rubrics❍ Adapt an existing rubric (LOTS
of examples available)❍ Adopt a ready-to-serve rubric
(e.g., VALUE Rubrics)
20
Gourmet Ready-to-Serve: VALUE Rubrics
Intellectual & Practical Skills❍ Inquiry and analysis❍ Critical thinking❍ Written communication❍ Oral communication❍ Reading❍ Quantitative literacy❍ Information literacy❍ Teamwork❍ Problem solving
Personal & Social Responsibility❍ Civic knowledge and
engagement❍ Intercultural knowledge and
competence❍ Ethical reasoning❍ Foundations and skills for
lifelong learning
Integrative & Applied Learning❍ Integrative & applied learning
21
SHOP: Identify & Collect
Now you have a chance to go shopping! Spend a few minutes browsing through the various
rubrics samples we have for you today. Find 2-3 you would like to
purchase.
22
CHOP: Divide & Define
Prep work for rubrics: Specifying expected learning outcomes❍ What knowledge, skills, or
attitudes are required to complete the task?
❍ Create a core list of learning objectives for the assignment.
❍ These will become the dimensions/criteria for your rubric.
23
CHOP: Divide & Define
Label and define the criteria/dimensions that you will be using to assess the assignment.❍ Dimensions can be general labels
Dimensions of lab assignment: Materials, Procedure, Data collection, Data analysis
❍ Dimensions can be specifically defined See example of Team Contract rubric
24
CHOP: Divide & Define
Create a list of the dimensions/criteria that you will use in your rubric, write
them in the rubric worksheet, and review them with a partner.
25
PREP: Weights & Measures
You have the option of weighting different dimensions of your rubric differently.
You can also assign points to each of the dimensions.
26
COOK: Constitute & Combine
Constitute the rating scale.❍ Create at least three levels,
FOUR LEVELS is PREFERRED.❍ Label each level:
Below Expectations Needs Improvement Meets Expectations Exceeds Expectations
27
COOK: Constitute & Combine
In an analytical, descriptive rubric, fill in the boxes.❍ Best by referring to samples of student
work.❍ Start at the extremes: Lowest? Highest?❍ To get specific results, provide specific
examples, using learning from course content, assigned reading, examples.
28
COOK: Constitute and Combine
Fill in one row of the scale on the rubric worksheet, and review the contents with a partner.
29
TASTE: Test and Adjust
Apply the rubric to a sample of student work.
Ask colleagues and students to apply the rubric to student work.
Clarify language, make adjustments based on feedback.
30
Serving Rubrics in Class
Distribute rubrics with assignments.
Develop rubrics with students.
Have students apply rubrics to examples, use rubrics to self-assess, apply rubrics in giving peer feedback to classmates.
Use rubrics for grading and feedback.
Build rubrics in to the Learning Management System.
31
Serving Rubrics
32
SERVE: Implement your rubric!
33
SERVE: Implement Across Campus!
At different levels of the institution❍ Faculty Development: workshops, learning
communities❍ Assessment website for easy access❍ Program level to generate faculty dialogue
about Program Learning Outcomes❍ Orientation for students to Institutional
Learning Outcomes
34