Moderation of Overall Teacher Judgments 2011
description
Transcript of Moderation of Overall Teacher Judgments 2011
![Page 1: Moderation of Overall Teacher Judgments 2011](https://reader035.fdocuments.net/reader035/viewer/2022062518/568145b2550346895db2b545/html5/thumbnails/1.jpg)
Moderation of Overall Teacher Judgments
2011
![Page 2: Moderation of Overall Teacher Judgments 2011](https://reader035.fdocuments.net/reader035/viewer/2022062518/568145b2550346895db2b545/html5/thumbnails/2.jpg)
Purpose of the workshop: To provide support and guidance to better understand the processes and systems needed for the moderation of overall teacher judgments.
![Page 3: Moderation of Overall Teacher Judgments 2011](https://reader035.fdocuments.net/reader035/viewer/2022062518/568145b2550346895db2b545/html5/thumbnails/3.jpg)
Outline of the Day•Set the scene re: moderation•Consider the place of the OTJ in moderation•Look at systems and processes for making consistent overall teacher judgments•The process of moderation•Develop in-school systems to support moderation and especially student learning
![Page 4: Moderation of Overall Teacher Judgments 2011](https://reader035.fdocuments.net/reader035/viewer/2022062518/568145b2550346895db2b545/html5/thumbnails/4.jpg)
Standards in N.Z.Three options: - A test or range of assessments from standardised tools - A set of criteria or - To describe what you want the students to be doing at each year and illustrate them - based on Royce Sadler’s work
![Page 5: Moderation of Overall Teacher Judgments 2011](https://reader035.fdocuments.net/reader035/viewer/2022062518/568145b2550346895db2b545/html5/thumbnails/5.jpg)
Sadler (1988, p.80) Described three elements that comprise teacher judgment of student work. The elements include:
• teachers attending to the learning students produce
• appraising this work against a reference framework
• and making explicit response such as feedback or judgment on the learner’s work.
Overall teacher judgment has an added complexity in that the judgment process is applied to a range of evidence.
![Page 6: Moderation of Overall Teacher Judgments 2011](https://reader035.fdocuments.net/reader035/viewer/2022062518/568145b2550346895db2b545/html5/thumbnails/6.jpg)
Therefore in New Zealand
• The NZC Standards are not a test, they rely on skilled teachers understanding their students and their students’ learning needs.
• Forming OTJs and moderating them are high level professional skills, requiring knowledgeable skilful teachers.
• Our model needs to involve moderation
• Supports the intent of the NZC • vision + principles
![Page 7: Moderation of Overall Teacher Judgments 2011](https://reader035.fdocuments.net/reader035/viewer/2022062518/568145b2550346895db2b545/html5/thumbnails/7.jpg)
Word Burst
In pairs or threes think about the words in the pack then…….•Choose a word that interests you and say why•Choose a word that describes your classroom practice•Choose a word that describes how you work with a colleague•Park any words that you’re not sure about
![Page 8: Moderation of Overall Teacher Judgments 2011](https://reader035.fdocuments.net/reader035/viewer/2022062518/568145b2550346895db2b545/html5/thumbnails/8.jpg)
Making Overall Teacher JudgmentsKey aspects to developing consistency of OTJs:
• Understanding what constitutes an OTJ (and having systems/processes to promote consistent understanding)
• Developing common understandings of the curriculum levels, the ‘standards’ and the reference materials which help describe them
• Having clear criteria and exemplars of student work demonstrating achievement of standards
• Using moderation processes to ensure appropriate and consistent judgments are made.
![Page 9: Moderation of Overall Teacher Judgments 2011](https://reader035.fdocuments.net/reader035/viewer/2022062518/568145b2550346895db2b545/html5/thumbnails/9.jpg)
Bev’s First Video
![Page 10: Moderation of Overall Teacher Judgments 2011](https://reader035.fdocuments.net/reader035/viewer/2022062518/568145b2550346895db2b545/html5/thumbnails/10.jpg)
Use your Recording Frame and look for examples of:
•Multi-dimensionality•Cross Curricular•Student Voice•Levelling•Observations•Learning conversations
![Page 11: Moderation of Overall Teacher Judgments 2011](https://reader035.fdocuments.net/reader035/viewer/2022062518/568145b2550346895db2b545/html5/thumbnails/11.jpg)
![Page 12: Moderation of Overall Teacher Judgments 2011](https://reader035.fdocuments.net/reader035/viewer/2022062518/568145b2550346895db2b545/html5/thumbnails/12.jpg)
Making an O.T.J.•In pairs share how this process compares with what you already do.•What are the implications for your practice?•Record on the recording frame your next steps for making a sound OTJ.
![Page 13: Moderation of Overall Teacher Judgments 2011](https://reader035.fdocuments.net/reader035/viewer/2022062518/568145b2550346895db2b545/html5/thumbnails/13.jpg)
Critiquing the EvidenceLook at the pack of evidence you have brought:Is there enough evidence from a range of sources to show:
• Multi-dimensionality• Cross curricular• Student voice• Observations• Learning conversations• Does it include information from an
assessment tool?
![Page 14: Moderation of Overall Teacher Judgments 2011](https://reader035.fdocuments.net/reader035/viewer/2022062518/568145b2550346895db2b545/html5/thumbnails/14.jpg)
Making an OTJ •Using Vini’s or Sau’s evidence and the reference points previously discussed to decide if he is Above/At/Below or Well Below the Year level standard. •Record on the template provided your judgment for each piece of evidence and your overall ‘Best Fit’.
![Page 15: Moderation of Overall Teacher Judgments 2011](https://reader035.fdocuments.net/reader035/viewer/2022062518/568145b2550346895db2b545/html5/thumbnails/15.jpg)
What might this look like in reading and Mathematics?
Use the templates provided to brainstorm the forms of evidence you might gather in reading and mathematics.
![Page 16: Moderation of Overall Teacher Judgments 2011](https://reader035.fdocuments.net/reader035/viewer/2022062518/568145b2550346895db2b545/html5/thumbnails/16.jpg)
Points to note re Mathematics?
•Independently and most of the time – can do it with very little scaffolding •Language is different but it means the same as the reading and writing standards •Key point is to be looking for the application of knowledge & strategy to solve problem
eg additive thinking – Student applies their additive thinking to solve problems within the three mathematical strands and across the curriculum.
•Teachers need to provide the opportunities for students to show what they can do notice - recognise - respond
.
![Page 17: Moderation of Overall Teacher Judgments 2011](https://reader035.fdocuments.net/reader035/viewer/2022062518/568145b2550346895db2b545/html5/thumbnails/17.jpg)
Points re Mathematics?What might count as evidence:
• Gloss tool – assesses the strategy number frame work which aligns with the NS - (Use of tool needs to be moderated)
• PAT• E-asTTle• Modelling book evidence that they have done alongside the
teacher• Students books/worksheets as well as models,graphs an
diagrams.• Learning conversations
Student’s place in the process – • Ability to articulate their learning and their next steps • Teachers need to consider how their practice supports
students to discuss their learning, explain & justify their mathematical thinking.
.
![Page 18: Moderation of Overall Teacher Judgments 2011](https://reader035.fdocuments.net/reader035/viewer/2022062518/568145b2550346895db2b545/html5/thumbnails/18.jpg)
One school’s system for recording information
![Page 19: Moderation of Overall Teacher Judgments 2011](https://reader035.fdocuments.net/reader035/viewer/2022062518/568145b2550346895db2b545/html5/thumbnails/19.jpg)
Summary: Consistency is developed by… • Discussing what sources of evidence you currently collect to inform teaching
and learning decisions• Critiquing whether these sources of evidence are adequate• Developing a process/template for the school (or areas within the school –
e.g. junior and senior school) so that teachers are using similar types of evidence to inform OTJs.
![Page 20: Moderation of Overall Teacher Judgments 2011](https://reader035.fdocuments.net/reader035/viewer/2022062518/568145b2550346895db2b545/html5/thumbnails/20.jpg)
• Developing common understandings of ‘standards’ and the reference materials which help describe them.
• Having clear criteria and exemplars of student work demonstrating achievement of standards
NZC, National Standards illustrations, Literacy Learning Progressions, Number Framework,
![Page 21: Moderation of Overall Teacher Judgments 2011](https://reader035.fdocuments.net/reader035/viewer/2022062518/568145b2550346895db2b545/html5/thumbnails/21.jpg)
The big picture -Moderation Moderation is the process of teachers sharing
their expectations and understandings of standards with each other in order to improve
the consistency of their decisions about student learning and achievement.
The process where teachers compare judgments to either confirm or adjust them.
![Page 22: Moderation of Overall Teacher Judgments 2011](https://reader035.fdocuments.net/reader035/viewer/2022062518/568145b2550346895db2b545/html5/thumbnails/22.jpg)
Moderation processes require:
• Staff culture and systems for on-going professional learning
• Theoretical and content knowledge of the NZC and the standards
• Familiarity with the relevant support material
![Page 23: Moderation of Overall Teacher Judgments 2011](https://reader035.fdocuments.net/reader035/viewer/2022062518/568145b2550346895db2b545/html5/thumbnails/23.jpg)
Teachers need to be safe to:• express and clarify thinking• ask questions• explore solutions• adapt thinking after listening to informed ideas of
others• tolerate and appreciate differences in perspectives• view differences as opportunities to deepen
knowledge base
![Page 24: Moderation of Overall Teacher Judgments 2011](https://reader035.fdocuments.net/reader035/viewer/2022062518/568145b2550346895db2b545/html5/thumbnails/24.jpg)
This is what a moderation process could look
like?• Select the children whose evidence is conflicting or who sit on the cusp.
• Each teacher from the team/syndicate brings evidence of one of those
students.
• Using evidence, the National Standards and other curriculum resources,
each teacher makes an independent judgment about each student.
• Teachers discuss their judgments and use evidence, the National
Standards, and other curriculum resources to come to an agreed judgment.
• The team selects one student for whom it has reached agreement and
take to school-wide moderation.
![Page 25: Moderation of Overall Teacher Judgments 2011](https://reader035.fdocuments.net/reader035/viewer/2022062518/568145b2550346895db2b545/html5/thumbnails/25.jpg)
Each teacher from a team/syndicate
brings evidence of one of
those students
Select the children whose evidence
is conflicting or who sit on the cusp.
The team selects one student’s
results for which they have
come to agreement and take to whole-school (vertical)
moderation.
Teachers compare independent OTJs and come to an agreed judgment for each student using evidence / NS / resources.
An example of a moderation process
Each teacher uses evidence/ NS/resources to make an independent OTJ for each
student
![Page 26: Moderation of Overall Teacher Judgments 2011](https://reader035.fdocuments.net/reader035/viewer/2022062518/568145b2550346895db2b545/html5/thumbnails/26.jpg)
Moderation Listen to the following conversations and consider:•Consistency•Reliability•Validity•Bias•Teacher knowledge
![Page 27: Moderation of Overall Teacher Judgments 2011](https://reader035.fdocuments.net/reader035/viewer/2022062518/568145b2550346895db2b545/html5/thumbnails/27.jpg)
![Page 28: Moderation of Overall Teacher Judgments 2011](https://reader035.fdocuments.net/reader035/viewer/2022062518/568145b2550346895db2b545/html5/thumbnails/28.jpg)
Moderation
In your level groups use this process to explain your OTJ from Vini’s evidence or the evidence you have brought
Discuss differences and underlying reasons
Decide as a team your agreed OTJ (overall team judgment)
![Page 29: Moderation of Overall Teacher Judgments 2011](https://reader035.fdocuments.net/reader035/viewer/2022062518/568145b2550346895db2b545/html5/thumbnails/29.jpg)
Across school moderation
In vertical groups of three share your team’s explanation of their OTJ.
![Page 30: Moderation of Overall Teacher Judgments 2011](https://reader035.fdocuments.net/reader035/viewer/2022062518/568145b2550346895db2b545/html5/thumbnails/30.jpg)
Recording the consistency with which teachers are making independent OTJs
Student Expert marker Other teachers
1 = agreement0 = non
agreementS1 @ @
Tchr 1
1S2 @ B 0S3 WB WB 1S4 AS @ 0S1 @ @
Tchr 2
1S2 @ @ 1S3 WB B 0S4 AS AS 1S1 @ AS
Tchr 3
0S2 @ B 0S3 WB WB 1S4 AS AS 1
7/12
% AGREEMENT 58%
![Page 31: Moderation of Overall Teacher Judgments 2011](https://reader035.fdocuments.net/reader035/viewer/2022062518/568145b2550346895db2b545/html5/thumbnails/31.jpg)
Making EffectiveOTJs
Attending to componentsof moderation
Understanding and using moderation
High quality learning and teaching
Clear about OTJsCommon understandingsClear criteria and exemplarsUse of moderation processes
Ultimatepurposeof moderation
Interpersonal skillsTheoretical /content
knowledgeFrame of reference
Culture of professional learning
Confirm or adjust quality
judgments
A framework for Moderation
![Page 32: Moderation of Overall Teacher Judgments 2011](https://reader035.fdocuments.net/reader035/viewer/2022062518/568145b2550346895db2b545/html5/thumbnails/32.jpg)
Deepening teacher knowledge
![Page 33: Moderation of Overall Teacher Judgments 2011](https://reader035.fdocuments.net/reader035/viewer/2022062518/568145b2550346895db2b545/html5/thumbnails/33.jpg)
Action PlansUsing your Next Steps sheet develop an action plan for:
• Term 2 2011• The rest of 2011• 2012
Consider teacher/team/management processes.