COMMUNICATING ABOUT EVALUATIONS WITH STUDENT GROWTH MEASURES
description
Transcript of COMMUNICATING ABOUT EVALUATIONS WITH STUDENT GROWTH MEASURES
![Page 1: COMMUNICATING ABOUT EVALUATIONS WITH STUDENT GROWTH MEASURES](https://reader035.fdocuments.net/reader035/viewer/2022070421/56816138550346895dd0954e/html5/thumbnails/1.jpg)
COMMUNICATING ABOUT EVALUATIONS WITH STUDENT GROWTH MEASURES
CCSSO TOPICALMEETINGRALEIGH, NC
Sept. 19, 2013
![Page 2: COMMUNICATING ABOUT EVALUATIONS WITH STUDENT GROWTH MEASURES](https://reader035.fdocuments.net/reader035/viewer/2022070421/56816138550346895dd0954e/html5/thumbnails/2.jpg)
www.ksaplus.com
2
The View from 30,000 Feet
![Page 3: COMMUNICATING ABOUT EVALUATIONS WITH STUDENT GROWTH MEASURES](https://reader035.fdocuments.net/reader035/viewer/2022070421/56816138550346895dd0954e/html5/thumbnails/3.jpg)
www.ksaplus.com
Distribution
3
Content
![Page 4: COMMUNICATING ABOUT EVALUATIONS WITH STUDENT GROWTH MEASURES](https://reader035.fdocuments.net/reader035/viewer/2022070421/56816138550346895dd0954e/html5/thumbnails/4.jpg)
www.ksaplus.com
You need to translate
我們非常歡迎您的孩子在經過一夏天特別忙碌的準備之後重新回到學校。在這個夏天及過去幾天內,當我在學校視察時,看到老師和學校的主管們一直在孜孜不倦地工作著,確保您的孩子在接下來的一學年中能夠享受到充滿魅力和挑戰的課堂生
活。
“”
Estamos encantados de dar de nuevo la bienvenida a la escuela a su hijo tras un verano especialmente cargado de preparativos. Durante mis visitas a las escuelas a lo largo del verano y en los últimos días, he comprobado cómo profesores y directores trabajaban incansablemente para garantizarles un año escolar repleto de actividades interesantes y estimulantes para su hijo.
“
”
ايک پر طور خصوصی ہوئے بهرے سے تياريوںکا بچے کے ہمآپ بعد موسِمگرماکے مصروف
پُرجوش ہوئے کرتے استقبال پر واپسی ميں سکولکچهدنوں پچهلے اور موسِمگرماميں پورے ہيں۔
کو قائدين کے سکول اور اساتذہ نے ميں،ميںليے کے بنانے يہيقينی ہے ديکها کامکرتے انتهکاور مشغوليت سال تعليمی کا بچے کے کہآپ
ہو پُر سے اسباق “محرک”
![Page 5: COMMUNICATING ABOUT EVALUATIONS WITH STUDENT GROWTH MEASURES](https://reader035.fdocuments.net/reader035/viewer/2022070421/56816138550346895dd0954e/html5/thumbnails/5.jpg)
www.ksaplus.com
5
3 Key Questions
Who?
What?
Why?
![Page 6: COMMUNICATING ABOUT EVALUATIONS WITH STUDENT GROWTH MEASURES](https://reader035.fdocuments.net/reader035/viewer/2022070421/56816138550346895dd0954e/html5/thumbnails/6.jpg)
www.ksaplus.com
6
SEA colleagues (“family first”)
Teachers/Principals Legislators
Media
Who?
![Page 7: COMMUNICATING ABOUT EVALUATIONS WITH STUDENT GROWTH MEASURES](https://reader035.fdocuments.net/reader035/viewer/2022070421/56816138550346895dd0954e/html5/thumbnails/7.jpg)
www.ksaplus.com
7
New Different Better
What?
![Page 8: COMMUNICATING ABOUT EVALUATIONS WITH STUDENT GROWTH MEASURES](https://reader035.fdocuments.net/reader035/viewer/2022070421/56816138550346895dd0954e/html5/thumbnails/8.jpg)
www.ksaplus.com
8
What’s in it for me?Why
?
![Page 9: COMMUNICATING ABOUT EVALUATIONS WITH STUDENT GROWTH MEASURES](https://reader035.fdocuments.net/reader035/viewer/2022070421/56816138550346895dd0954e/html5/thumbnails/9.jpg)
www.ksaplus.com
9
Students at the Center
![Page 10: COMMUNICATING ABOUT EVALUATIONS WITH STUDENT GROWTH MEASURES](https://reader035.fdocuments.net/reader035/viewer/2022070421/56816138550346895dd0954e/html5/thumbnails/10.jpg)
www.ksaplus.com
10
All Roads Lead to Student SuccessEffective Teaching
Standards/curriculum
Tests
School leadership
Data/Accountability
![Page 11: COMMUNICATING ABOUT EVALUATIONS WITH STUDENT GROWTH MEASURES](https://reader035.fdocuments.net/reader035/viewer/2022070421/56816138550346895dd0954e/html5/thumbnails/11.jpg)
www.ksaplus.com
11
Evaluations Measures
All Roads Lead to Student Success
11
Effective Teaching
Standards/curriculumTestsSchool leadershipData/Accountability
Support
Feedback
![Page 12: COMMUNICATING ABOUT EVALUATIONS WITH STUDENT GROWTH MEASURES](https://reader035.fdocuments.net/reader035/viewer/2022070421/56816138550346895dd0954e/html5/thumbnails/12.jpg)
How to Discuss Student Growth Models
![Page 13: COMMUNICATING ABOUT EVALUATIONS WITH STUDENT GROWTH MEASURES](https://reader035.fdocuments.net/reader035/viewer/2022070421/56816138550346895dd0954e/html5/thumbnails/13.jpg)
www.ksaplus.com
13
Why are evaluations such a hot-button issue in the first place? Tying student
achievement data to evaluations embodies the fears and anxieties that many teachers have about reform and their profession.
Exacerbating factors:• Scary math• High stakes• Little perceived value• Misinformation
Concerns about
testing
Concerns about
mechanizationof teaching
Concerns aboutlack of control and input
Concerns about
data-drivenaccountability
Evals
Source: TNTP
![Page 14: COMMUNICATING ABOUT EVALUATIONS WITH STUDENT GROWTH MEASURES](https://reader035.fdocuments.net/reader035/viewer/2022070421/56816138550346895dd0954e/html5/thumbnails/14.jpg)
www.ksaplus.com
14
Value-Added Model: Lessons LearnedHold realistic
expectationsThe goal is not to make teachers diehard fans of VA, but to ensure they understand the basics and accept VA as one of multiple measures.
Emphasize function within the larger evaluation system
Emphasize that VA is just one part of the puzzle. Focus on its unique role as an objective measure of student learning that can balance more subjective measures, like principal observations.
Acknowledge shortcomings
Be honest about the limitations of value-added and have a plan for addressing them. Glossing over the challenges will only increase skepticism.
Be prepared for misinformation
Concerns often stem from misinformation about what VA is and how it will be used. Know the myths and have succinct responses ready.
Stay out of the weeds
Offer a detailed explanation for those who are interested, but stay focused on the big picture.
Plan for glitches Implementation will expose problems. Create and communicate an easy way for teachers to check for and report issues or errors.
Source: TNTP
![Page 15: COMMUNICATING ABOUT EVALUATIONS WITH STUDENT GROWTH MEASURES](https://reader035.fdocuments.net/reader035/viewer/2022070421/56816138550346895dd0954e/html5/thumbnails/15.jpg)
www.ksaplus.com
Critical Themes We’re all here to help
students learn. Of all the tools we can
use to measure a teacher’s impact on student learning, value-added is the most sophisticated.
Value-added isn’t perfect, but it doesn’t have to be perfect to be useful.
Teaching is complex and can’t possibly be captured in a single measure.
Students of teachers with high VA ratings don’t just do well on tests.
Source: TNTP
![Page 16: COMMUNICATING ABOUT EVALUATIONS WITH STUDENT GROWTH MEASURES](https://reader035.fdocuments.net/reader035/viewer/2022070421/56816138550346895dd0954e/html5/thumbnails/16.jpg)
www.ksaplus.com
16
Be Prepared
Explain the What
Explain the Why
Explain the How
Anticipate and Combat Resistance
Be Prepared for Questions
![Page 17: COMMUNICATING ABOUT EVALUATIONS WITH STUDENT GROWTH MEASURES](https://reader035.fdocuments.net/reader035/viewer/2022070421/56816138550346895dd0954e/html5/thumbnails/17.jpg)
www.ksaplus.com
17
What It IsValue-added analysis uses standardized test scores to determine a teacher’s impact on student growth per year
What It Isn’tUnlike other measures, it takes into account each student’s starting point based on background and previous performance
What It Gives Us
It allows us to better understand what impact the teacher had
1. Explain the What
![Page 18: COMMUNICATING ABOUT EVALUATIONS WITH STUDENT GROWTH MEASURES](https://reader035.fdocuments.net/reader035/viewer/2022070421/56816138550346895dd0954e/html5/thumbnails/18.jpg)
www.ksaplus.com
18
Use Visuals To Show How It Works
Source: The Los Angeles Times
![Page 19: COMMUNICATING ABOUT EVALUATIONS WITH STUDENT GROWTH MEASURES](https://reader035.fdocuments.net/reader035/viewer/2022070421/56816138550346895dd0954e/html5/thumbnails/19.jpg)
www.ksaplus.com
19
Show How It Captures Gains, Not Just Scores
While Student A meets State standards, his value-added score reveals decreasing performance.
Conversely, Student B does not meet State standards, but his
value-added score reveals improved performance.
Source: Chicago Public Schools
![Page 20: COMMUNICATING ABOUT EVALUATIONS WITH STUDENT GROWTH MEASURES](https://reader035.fdocuments.net/reader035/viewer/2022070421/56816138550346895dd0954e/html5/thumbnails/20.jpg)
www.ksaplus.com
20
Show How It Works for Students with Different Starting Points
Source: DC Public Schools
![Page 21: COMMUNICATING ABOUT EVALUATIONS WITH STUDENT GROWTH MEASURES](https://reader035.fdocuments.net/reader035/viewer/2022070421/56816138550346895dd0954e/html5/thumbnails/21.jpg)
www.ksaplus.com
21
ATTAINMENT MODELWhich gardener has the tallest tree?
Gardener AGardener B
72 in.61 in.
![Page 22: COMMUNICATING ABOUT EVALUATIONS WITH STUDENT GROWTH MEASURES](https://reader035.fdocuments.net/reader035/viewer/2022070421/56816138550346895dd0954e/html5/thumbnails/22.jpg)
www.ksaplus.com
22
GAIN MODELWhich gardener’s tree grew the most in the past year?
52 in.
2011 20122011 2012
72 in.20 in
.
47 in.
61 in.14 in.
Gardener AGardener B
![Page 23: COMMUNICATING ABOUT EVALUATIONS WITH STUDENT GROWTH MEASURES](https://reader035.fdocuments.net/reader035/viewer/2022070421/56816138550346895dd0954e/html5/thumbnails/23.jpg)
www.ksaplus.com
23
VALUE-ADDED MODELWhich gardener’s tree grew the most in the past year when accounting for conditions such as rainfall and temperature?
52 in.
72 in.
47 in.
61 in.+22 in.
+18 in.
Gardener AGardener B
2011 20122011 2012
![Page 24: COMMUNICATING ABOUT EVALUATIONS WITH STUDENT GROWTH MEASURES](https://reader035.fdocuments.net/reader035/viewer/2022070421/56816138550346895dd0954e/html5/thumbnails/24.jpg)
www.ksaplus.com
24
2. Explain the WhyThe Gates Foundation’s MET Project says:
Source: Learning about Teaching, Bill & Melinda Gates Foundation, December 2010
![Page 25: COMMUNICATING ABOUT EVALUATIONS WITH STUDENT GROWTH MEASURES](https://reader035.fdocuments.net/reader035/viewer/2022070421/56816138550346895dd0954e/html5/thumbnails/25.jpg)
www.ksaplus.com
25
Don’t Make the Perfect the Enemy of GoodTNTP says:A teacher’s value-added score is comparable to many widely accepted measures of performance in other professions. In order from most stable to least:Baseball Pitchers: Earned run averages, by yearInsurance Salespeople: Value of policies sold, by monthBaseball Hitters: Batting average, by yearElementary Teachers: Value-added student growth, by year
Middle School Teachers: Value-added student growth, by year
University Faculty: Student ratings, by semesterSecurities Analysts: Commissions, by quarter
Sources: McCaffrey and Sass, Florida State University, and The RAND Corporation, 2009
![Page 26: COMMUNICATING ABOUT EVALUATIONS WITH STUDENT GROWTH MEASURES](https://reader035.fdocuments.net/reader035/viewer/2022070421/56816138550346895dd0954e/html5/thumbnails/26.jpg)
www.ksaplus.com
26
Comparable MeasuresBrown Center/Brookings says: SAT/ACT correlations with college success Mortality rates for hospitals and surgeons Volume of home sales for realtors Returns on investment funds Output of sewing machine operators Productivity of utilities’ field-service workers
Source: Brown Center on Education Policy at Brookings
![Page 27: COMMUNICATING ABOUT EVALUATIONS WITH STUDENT GROWTH MEASURES](https://reader035.fdocuments.net/reader035/viewer/2022070421/56816138550346895dd0954e/html5/thumbnails/27.jpg)
www.ksaplus.com
27
3. Explain the HowSix key steps:1. Select a measure of student
achievement 2. Collect individual achievement scores3. Determine individual growth 4. Select the external factors5. Examine the effect of various external
factors6. Calculate individual student growth
relative to their comparison group
![Page 28: COMMUNICATING ABOUT EVALUATIONS WITH STUDENT GROWTH MEASURES](https://reader035.fdocuments.net/reader035/viewer/2022070421/56816138550346895dd0954e/html5/thumbnails/28.jpg)
www.ksaplus.com
28
For Example:
![Page 29: COMMUNICATING ABOUT EVALUATIONS WITH STUDENT GROWTH MEASURES](https://reader035.fdocuments.net/reader035/viewer/2022070421/56816138550346895dd0954e/html5/thumbnails/29.jpg)
www.ksaplus.com
29
4. Anticipate and Combat Resistance
![Page 30: COMMUNICATING ABOUT EVALUATIONS WITH STUDENT GROWTH MEASURES](https://reader035.fdocuments.net/reader035/viewer/2022070421/56816138550346895dd0954e/html5/thumbnails/30.jpg)
www.ksaplus.com
30
Reminder: It’s about the Kids
“Framing the problem in terms of false negatives places the focus almost entirely on the interests of the individual who is being evaluated rather than the students who are being served.”
—Brown Center on Education Policy at Brookings
![Page 31: COMMUNICATING ABOUT EVALUATIONS WITH STUDENT GROWTH MEASURES](https://reader035.fdocuments.net/reader035/viewer/2022070421/56816138550346895dd0954e/html5/thumbnails/31.jpg)
www.ksaplus.com
31
5. Be Prepared for Questions
Did my child make a year’s worth of progress in a year? Is my child making progress
toward state standards?
What percent of a teacher’s evaluation will be based on value-added
scores?How will we evaluate
teachers who don’t have them?
How can I be creative if student progress is based on test scores?
![Page 32: COMMUNICATING ABOUT EVALUATIONS WITH STUDENT GROWTH MEASURES](https://reader035.fdocuments.net/reader035/viewer/2022070421/56816138550346895dd0954e/html5/thumbnails/32.jpg)
www.ksaplus.com
5. Be Prepared for QuestionsTechnical questions: Are we able to connect
teachers to student test scores?
Is it possible to show progress with all groups of students?
Who will design the value-added model?
Design questions: What other measures
(observation, portfolios, etc.) will be used to evaluate teachers in concert with value-added scores?
How will this affect multiyear tenure (for instance, two-year tenure) if the accuracy of value-added scores improves with three years’ worth of data?
![Page 33: COMMUNICATING ABOUT EVALUATIONS WITH STUDENT GROWTH MEASURES](https://reader035.fdocuments.net/reader035/viewer/2022070421/56816138550346895dd0954e/html5/thumbnails/33.jpg)
www.ksaplus.com
33
Useful Resources Communicating about Evaluations Toolkithttp://www.cgcs.org/Page/265 Myths and Facts about Value-Added Analysis — TNTPhttp://tntp.org/assets/documents/TNTP_FactSheet_ValueAdded_2011.pdf Achieve NJ web site for teachershttp://www.state.nj.us/education/AchieveNJ/teacher/overview.shtml
![Page 34: COMMUNICATING ABOUT EVALUATIONS WITH STUDENT GROWTH MEASURES](https://reader035.fdocuments.net/reader035/viewer/2022070421/56816138550346895dd0954e/html5/thumbnails/34.jpg)
www.ksaplus.com
34
Final Thoughts What were your key takeaways from today? How will you use what we discussed in your state?
![Page 35: COMMUNICATING ABOUT EVALUATIONS WITH STUDENT GROWTH MEASURES](https://reader035.fdocuments.net/reader035/viewer/2022070421/56816138550346895dd0954e/html5/thumbnails/35.jpg)
www.ksaplus.com
35
Questions and Discussion
![Page 36: COMMUNICATING ABOUT EVALUATIONS WITH STUDENT GROWTH MEASURES](https://reader035.fdocuments.net/reader035/viewer/2022070421/56816138550346895dd0954e/html5/thumbnails/36.jpg)
www.ksaplus.com
36
Final Thoughts What were your key takeaways from today? How will you use what we discussed in your state?