NCME Special Conference on Classroom Assessment€¦ · • Middle and High School Mathematics...
Transcript of NCME Special Conference on Classroom Assessment€¦ · • Middle and High School Mathematics...
October 8-10, 2018The University of Kansas
Lawrence, KS
NCME Special Conference on Classroom Assessment:
Welcome- 2
General Conference Information- 3-4
Conference URL
Media Permission
Name Badges
Print Services
Lactation Room
Gender Neutral Restrooms
ReflectionRoom
Lost and Found
Local Time
Tuesday Night: Downtown Lawrence
Downtown Lawrence Passport
Learn more about Lawrence
Schedule At-A-Glance- 4
Conference Schedule- 5
KansasUnionMap-11(allmealsandsessionswillbeheldonthe5thand6thfloors)
TABLE of CONTENTS
12017 NCME Special Conference on Classroom Assessment
As president of the National Council on Measurement in Education, I’m delighted to welcome you to NCME’s second Special Conference on Classroom Assessment. I believe that NCME members have a great deal to learn, and a great deal to contribute in this area. We are appreciative of the dedication of the Classroom Assessment Task Force, established by Mark Wilson and headed by Dale Whittington and Kristen Huff, in planning the conference program and are grateful to Neal Kingston and the staff of the University of Kansas Achievement and Assessment Institute for serving as our hosts once again. Thanks, too, to all of you for joining the conference as organizers, speakers, and audience members. I look forward to attending the conference sessions and meeting as many of you as possible.
Rebecca ZwickPresident, NCME
WelcomealltothesecondNationalCouncilonMeasurementinEducation(NCME)conferenceonclassroom assessment. The theme of this year’s conference addresses is classroom assessment in the disciplines. During the next day and a half many of the sessions will either be discipline specificorfocusondifferencesorsimilaritiesofbestpracticesindifferentdisciplines.
For those of you who were here last year, welcome back to Lawrence, Kansas and the University of Kansas(Rockchalk,Jayhawk,KU!).Forfirst-timers,Ihopeyouenjoytheexperienceandcomebacksoon!EnjoyyourtimehereandIhopeyoufindtheconferenceinformativeandthoughtprovoking.
It takes a village to raise a child, but also a village to host a conference. While I am honored to have been asked organize and host this conference it would not have occurred without the efforts of many. The idea of NCME adding focus to classroom assessment was one of Mark Wilson’s presidential initiatives. Former NCME Board members Dale Whittington and Kristen Huff were asked to lead an NCME Classroom Assessment Task Force, whose members include Heidi Andrade, Alison Bailey, Susan Brookhart, Caroline Wiley, Mark Wilson, and me.
Amy Clark served as program chair and was responsible for proposal review and session scheduling. As the conference project manager, Michelle Wilson provided the logistical support, without which this conference would not have occurred.
Your host,
Neal Kingston
WELCOME
2
Conference URLhttps://aai.ku.edu/ncme17-special-conference/registration
Media PermissionBy registering for this conference, you grant permission to the National Council on Measurements inEducation(NCME)andAchievementandAssessmentInstitute(AAI)atTheUniversityofKansasto photograph, videotape, audiotape, and otherwise record images as part of the program identifiedbelow.YoureleaseNCME,AAIandtheUniversityfromanyandallliabilityresultingfrom the publication of said photos, videos, or remarks. Publications may include but are not limited to website, publications, social media, and presentations.
Name BadgesName badges are not only a distinctive fashion statement, they are an important way for conference staff to identify conference attendees. Please wear your name badge in all sessions.
Print ServicesJayhawkInkislocatedonthe2ndfloor(thetradebookstoreonthewestside)canmakecopiesandprintfromaflashdrive(seeKansasUnionMap-8).
Lactation RoomTheLactationRoomislocatedonthe5thfloorintheRegionalistRoom(seeKansasUnionMap-46).
Gender Neutral RestroomA Gender Neutral Restroom is located in the Student Involvement and Leadership area on the 4th floor.YoumayaskfordirectionsattheWelcomeDeskonthe4thfloor(seeKansasUnionMap-29a).
Reflection SpaceThereisaReflectionSpacelocatedonthe4thfloor(seeKansasUnionMap-30d).
Lost and FoundIfyoufindanitemoraremissinganitem,pleasecometotheConferenceRegistrationCheck-indesk,locatedonthe5thfloor,turninanitemorinquireaboutamissingitem.TheUnion’sLostandFoundislocatedintheHawkShopConvenienceStoreonthe4thfloor(seeKansasUnionMap-23)
Local TimeKansas time zone is: Central Time Zone
Tuesday Night: Downtown LawrenceSometimes the best kind of breakout session is the one you didn’t have to plan. After getting down to conference business Tuesday, you’ll have the opportunity to hop on a shuttle bus and experience an evening in our historic downtown, a lively, easily walkable district packed with food, fun, shopping, visual art, live music, and more.
GENERAL CONFERENCE INFORMATION
3
Monday, October 8 5:00 pm – 6:30 pm
6:00 pm – 8:00 pm
Tuesday, October 9 8:00 am – 5:00 pm
8:00 am – 9:30 am
9:00 am – 10:00 am
10:00 am – 10:30 am
10:30 am - noon
Noon – 1:00 pm
1:00 pm - 2:15 pm
2:20 pm – 3:35 pm
3:35 pm – 4:00 pm
4:00 pm – 5:15 pm
5:15 pm – 6:00 pm
Wednesday, October 10 8:00 am – 10:00 am
8:00 am – 9:30 am
8:30 am – 9:30 am
9:35 am – 10:35 am
10:35 am – 11:00 am
11:00 am – 12:15 pm
12:15 pm – 1:15 pm
1:15 pm - 2:15 pm
2:20 pm – 3:30 pm
Conference Registration Check-In at DoubleTree, Regency AB
Opening Reception with Appetizer Buffet & Cash Bar at DoubleTree,
Regency AB*
Conference Registration Check-In at Kansas Union, 5th Floor
Breakfast Buffet*
Opening keynote
Refreshment Break*
Session 1
Lunch Buffet*
Session 2
Session 3
Refreshment Break*
Session 4
Classroom Assessment Task Force Fireside Chat
Conference Registration Check-In at Kansas Union, 5th Floor
Breakfast Buffet*
Session 5
Session 6
Refreshment Break*
Session 7
Lunch Buffet*
Session8
Closing plenary session
Downtown Lawrence Passport(found in bag at conference registration check-in)• Deals and discounts at over 25 Downtown Lawrence Inc. member businesses•Presentpassportattimeofpurchase.Offersgoodthrough12/31/18&areone-timeonlyuse.
Learn more about Lawrence• Local food, arts, and entertainment: LAWRENCE.COM• Visitors guide: EXPLORELAWRENCE.COM• Local news & weather: LJWORLD.COM
SCHEDULE AT-A-GLANCE
4*meals included in registration
Monday, October 8DoubleTree by Hilton Hotel, 200 McDonald Dr, Lawrence, KS
5:00 pm – 6:30 pm | Conference Check-In
6:00 pm – 8:00 pm | Opening Reception with Appetizer Buffet & Cash Bar at DoubleTree* Location: Regency AB
Tuesday, October 9University of Kansas, Kansas Union, 1301 Jayhawk Blvd, Lawrence, KS
8:00 am – 9:30 am | Breakfast Buffet*
8:00 am – 5:00 pm | Conference Check-In Location: 5th Floor, Kansas Union
9:00 am – 10:00 am | Opening Plenary Session: Dylan Wiliam, Keynote Speaker Location: Woodruff Auditorium
Keynote Presentation: Formative and summative classroom assessment: Where we are and where we might go. Since the pioneering work of Benjamin Bloom on mastery learning in 1968, there has been increasing acceptance that teaching should be a contingent activity. What a student learns from a particular sequence of instructional activities is impossible to predict with any accuracy, and since effective instruction must begin from what the learner already knows, assessment is a central process in instruction—the bridge between teaching and learning. However, the role of assessment in guiding instruction is much less straightforward where, as they do in the United States, teachers have responsibility both for instructing their students and for certifying their achievements. In this keynote presentation, Dylan Wiliam will review developments in classroom assessment over the last 50 years, focusing in particular on what we have learned about the role of assessment in improving learning, the evidence about the impact that such practices can have on student achievement, and how teachers can be supported in using
assessment to improve their the quality of their instruction and at the same time produce useful information for key stakeholders about the extent of their students’ achievements.
CONFERENCE SCHEDULE
5
10:00 am – 10:30 am | Refreshment Break* Location: Big 12 Room
10:30 am - noon | Session 1
1A: Why Purpose and Grain-Size Matters in the Design of Learning Trajectories/Progressions- Based Classroom Assessment- Jere Confrey, Leanne Ketterlin Geller, Michele Carney, Edith Aurora Graf, & Julie Christensen Location: Malott Room
66
1B: Promoting Educator Use of Effective Formative Assessment Practice: The Michigan FAME Program- Edward Roeber, Kristy Walters, Ellen Vorenkamp, & Tara Kintz Location: Centennial Room
1C: Exploring the Relationship Between Large-Scale and Local Assessments- Ellen Forte, Daisy Rutstein, Kristen Huff, & Sara Cooper Location: Pine Room1D: Continuing the Conversation and Strengthening the Connections- Scott F. Marion, Lorrie Shepard, Mark Wilson, Heather Wheeler, Sue Brookhart, & Dylan Wiliam Location: Kansas Room
1E: Assessment 101: Narrowing the Gap Between the Assessment Industry and Your Classroom- Susan McNally & Peggy Seifert Location: English Room
Noon – 1:00 pm | Lunch Buffet* Location: Ballroom 1:00 pm - 2:15 pm | Session 2
2A: Actionable, meet Reliable. Reliable, Actionable. A new collaboration in Classroom Assessment- Laine Bradshaw, Eric Arena, Patty Bradshaw, & Jennifer White Location: Centennial Room
2B: Assessment in Maker-Centered Learning: Struggles and Opportunities- YJ Kim, Peter Wardrip, Adam Maltese, Chad Ratliff, & Stephanie Chang Location: Pine Room
2C: Classroom assessments to support individualized intervention design: Instantiated examples of data-based individualization- Leanne R. Ketterlin-Geller, Erica Lembke, Stacy Hirt, Erica Mason, & Susan Elliott Location: English Room
2D: Paper Session - Assessment Design Location: Malott Room • Evidence-centered Classroom Assessment Design- Russell Almond, Jeannine Turner, & YJ Kim • Improving Early Literacy Formative Assessments: Item Sampling and Progressive Form Difficulty- Patrick C. Kennedy • Comparing Validation Arguments for classroom assessments across different mathematics learning trajectories- Emily Toutkoushian & Jere Confrey • EdTech’s Role in Increasing Cultural Sensitivity in the Classroom- Christy Spivey, Ketsia Hamilton, Frank Clint, & Kristi Dorman
2E: Multiple Perspectives: How the Reflective Nature of Learning Progressions Can Inform Best Practices- Karin Hess, Bridget Cantrell, Linda Paulus, Stephon Bady, & Julianne Robar Location: Kansas Room
2:20 pm – 3:35 pm | Session 3
3A: Classroom Use of a Cognitive Diagnostic Reading Comprehension Assessment: MOCCA- Ben Seipel, Patrick Kennedy, & John DeFlaminis Location: Centennial Room
3B: Poster Session Location: Jayhawk Room • Middle and High School Mathematics Teachers’ Assessment Practices: Frequency and Confidence- Dorinda J. Gallant • Interim Mini-tests: A Resource for Classroom Assessment- Jie Chen & Wenhao Wang • Improving Math Teachers’ Formative Assessment Training- Tuba Gezer • Effects of Peer Assessment on Student’s Non-Cognitive Outcomes- Hongli Li, Yao Xiong, CharlesVincentHunter,XiuyanGuo,&JacquelynBialo • Evaluation of content maps to help the cause of targeted instruction and learning- Johnny Denbleyker & Ye Ma • Validating classroom assessments of multidimensional science and engineering competencies using Bayesian diagnostic models- Jonathan Templin, Brian Gane, Kerrie Douglas, Sania Zaidi, & Jim Pellegrino • Assessment in the science classroom: A professional learning community centered around assessment practice- Brian Gane, Donald Wink, Nell Kemp, Lauren Levites, & Jenny Sarna • Review of concept inventories to inform multidimensional task-level classroom assessment of electrical engineering fundamentals- David R. Waller, Kerrie A. Douglas, Maryam A. Al-Othman, John H. Cole, & Dimitrios Peroulis • Student Motivation and Grit: Using Extrinsic Motivational Techniques in the Digital Setting- Elizabeth Anderson • Using NGSA to investigate students’ three-dimensional science learning and provide opportunities for individualized instruction- Krystal Madden & Diksha Gaur • How does classroom learning impact large scale achievement testing? —a differential distractor functioning approach- Yi-Ling Cheng • Reliability with Undergraduate Graders in Large-Scale, Multi-Section Courses- Nathan M. Hicks & Kerrie A. Douglas • What Accounts For Mathematics Achievement Motivation Differences Among Various Groups of Nigerian Secondary Schools’ Students?- Oluwatoyin C. Obadare-Akpata • Validating Learning Structures Using Bayesian Inference Networks- Richard Schwarz • Procrustean Assessment: Testing in the Social Studies- Zachary Feldberg
3C: Concurrent Demonstration Session Location: Jayhawk Room • Preview the Digital NCME ITEMS module for the Classroom Assessment Standards- Caroline Wylie • Classroom Progressive Formative Assessments Aligned to State Outcomes- Jewlana Smith-Hunter
3D: NCME Diversity in Testing Committee: Promoting Equity in Classroom Assessments- Lorrie Shepard, Meagan Karvonen, Laura Wright, & Leanne R. Ketterlin-Geller Location: Kansas Room
3E: Paper Session - NGSS Location: Malott Room • Considering the Design and Role of Interim Assessments in the Context of a Next Generation Science Standards System of Assessments- Nathan Dadey & Sara Cooper • The NGSS and New Challenges for Instruction and Assessment- Mary Norris • Using a Novice-Expert Perspective to Structure State and Classroom Assessment Claims/ Interpretations of the NGSS- Brian Gong & Mary Norris
3F: Playful assessment: What is wrong with making assessment fun? - YJ Kim, Kevin Miklasz, Matt Gaydos, & Kris Schwengel Location: Pine Room
7
8
3G: Leveraging the Principles of Automatic Item Generation for Classroom Assessment Item Development- Justin Paulsen Location: English Room
3:35 pm – 4:00 pm | Refreshment Break* Location: Big 12 Room
4:00 pm – 5:15 pm | Session 4
4A: Learning map models in teaching, learning, and assessment: How can we better facilitate teachers’ use?- Lori Andersen, Russell Swinburne Romine, Cary Rogers, & Thresa Bowman Location: Pine Room
4B: A Principled Approach to Assessment Literacy- Scott F. Marion, Carla Evans, Heather Wheeler, & Ryan Lemieux Location: Malott Room
4C: Implementation of Next Generation Science Standards’ Assessments: Views from the classroom, state, and nation- Allison Greenburg, Dawn Cope, & Brian Gong Location: Divine Nine Room
4D: Paper Session - Methods Location: Centennial Room • Effects of Assessment Types on Value-Added Measurement of Educator Effectiveness- Yang Caroline Wang • Clustering Students in a State Classroom Assessment System: Exploring the Usages of Classroom Assessment- Wenhao Wang, Zhi Zheng, & Jie Chen • Reflections on Positioning Diagnostic Classification Modeling in Classroom Assessment- Justin Paulsen & Chris Andrews • Learning Sciences meets Psychometrics: A two-pronged approach to validating classroom assessments aligned to learning trajectories- Meetal Shah & Jere Confrey
4E: A Mapping Journey on the Road to Better Assessment Measurements- Shontell Stanford Location: English Room
4F: Formative Assessment from a Disciplinary Perspective- Heidi Andrade, Paul Deane, Caroline Wylie, Dylan Wiliam, & Neal Kingston Location: Kansas Room
5:15 pm – 6:00 pm | Classroom Assessment Task Force Fireside Chat- Mark Wilson, Dale Whittington, & Kristen Huff Location: Kansas Room
Wednesday, October 10University of Kansas, Kansas Union, 1301 Jayhawk Blvd, Lawrence, KS
8:00 am – 9:30 am | Breakfast Buffet*
8:00 am – 10:00 am | Conference Check-In Location: 5th Floor, Kansas Union
8:30 am – 9:30 am | Session 5
5A: Implementation and Use of Results of Needs Assessment Tools for Local Assessment Systems- Andrew Wiley, Rhonda True, & Shannon Nepple Location: Malott Room
5B: Design and use of innovative science testlets for struggling learners- Lori Andersen, Gail Tiemann, & Michelle Shipman Location: Centennial Room5C: Beyond Multiple Choice Assessments: A Large Urban School District’s Implementation of Curriculum Embedded Performance Tasks- Elizabeth Blackmon & Miranda McLaren Location: Pine Room
5D: Three Principles of Mathematics Assessments- Bryan R. Drost Location: English Room
5E: Uncovering conceptual misunderstandings that lead to short- and long-term challenges in mathematics- Pamela Paek, Sweet San Pedro, Andrew Coulson, & Anthony Claypool Location: Kansas Room
9:35 am – 10:35 am | Session 6
6A: Supporting Teacher Use of Score Reports- Leanne Ketterlin Geller, Amy Clark, Dawna Duke, & Cary Rogers Location: Malott Room
6B: Using teaching simulations to assess and develop skill with interpreting student thinking- Erin Pfaff, Meghan Shaughnessy, & Tim Boerst Location: English Room
6C: Math Assessments for All – identifying and removing barriers for students with disabilities- Anita Harvin & Audra Batson Location: Centennial Room
6D: Evidence of Impact: The Intersection between Assessment, Technology, and Thinking Routines- Bryan R. Drost Location: Pine Room
10:35 am – 11:00 am | Refreshment Break* Location: Big 12 Room
11:00 am – 12:15 pm | Session 7
7A: Invited Session: Progress on progressions (or can we find the state of the art on a map?)- Neal Kingston, Jere Conrefy, Mark Wilson, Karen Barton, Leanne Ketterlin Geller Location: Kansas Room
7B: Using Cognitive Labs to Develop Assessments for Your Advanced Placement Courses- Tia Fechter, Jennifer G. Cromley, Frank Nelson, & Ting Dai Location: Centennial Room
7C: Classroom Assessment Perspectives from Progressive Education: Panelists from Montessori, Reggio Emilia-inspired and Waldorf schools- Angela K. Murray, Bruce Frey, Jennifer Baker Powers, Eric Matthews, Polly Prendergast, & Matthew Steinle Location: Pine Room 9
7D: Paper Session - Classroom Assessment Considerations Location: English Room • Teach to the Test? : A Role of Classroom Assessment to Improve Ambitious Teaching and Students’ Opportunity to Learn- Hyeri Hong • Promoting understanding and applications of validity for teachers’ classroom assessment- Davis Gerber, Jonathan Bostic, & Matthew Lavery
7E: Using Performance Level Descriptors to Guide Development of Classroom Assessments and Rubrics- Catherine Taylor, Cindy Walker, & FengYi Hung Location: Malott Room
12:15 pm – 1:15 pm | Lunch Buffet* Location: Ballroom
1:15 pm - 2:15 pm | Session 8
8A: ELA Assessment Passages: Appropriateness, Multiculturalism, and Classroom Alignment- Brooke Palmer, Brandon Wallace, Christal N. Williams, Danie Jeans, & Tara Wenger Location: Kansas Room
8B: The Psychometrician and the English Teacher: Designing Classroom Based Assessments that Measure and Motivate- Bryan R. Drost Location: Malott Room
2:20 pm – 3:30 pm | Closing Plenary Session Keena Arbuthnot, Keynote Speaker Location: Woodruff Auditorium
10*meals included in registration
Keynote Presentation: MeasuringU.P.(UnderrepresentedPopulations):The Role of Fairness in Assessing Student LearningThe keynote address will utilize Dr. Arbuthnot’s new book, Global Perspectives on Educational Testing: Examining Fairness, High-Stakes and Policy Reform to provide a detailed understanding of the way in which different cultural groups approach and perform on tests and assessments. Dr. Arbuthnot will provide details about The Arbuthnot Assessment Fairness Framework (TAAF), which was developed as a method to evaluate differential performance patterns between test takers on international large scale assessments. Dr. Arbuthnot will show how employing the TAAF Framework can be instrumental in helping policy makers and practitioners better understand the way in which test takers from different groups perform on large scale standardized tests and classroom assessments. The research focuses primarily on The Trends in International Mathematics andScience Study (TIMSS) mathematics test data to explore these differences. Dr. Arbuthnot will challenge the audience to think more critically about cultural differences and highlight ways that practitioners can utilize this research to improve classroom assessments.
LEVEL 3
11 Human Resources
Union Business O�ces, KU Dining Administration, Union IT
12 The Market Food Court13
14 KJHK Studio 366New Dining Concept15
16 Quiet Zone
1718
Impromptu Cafe
19 KJHK 90.7 FM Studios
20 Union Square
21e
Registered Dietitian21a Alcove A
23 Hawk ShopThe CrossroadsBuilding Manager O�ce
24 25 26 Alderson Auditorium27 KU Card Center28 Commerce Bank29 Jayhawk Walk
29a Kansas Union Welcome Desk29b KU Info
30 Student Involvement & Leadership CenterWheat Room Center for Sexuality&Gender Diversity
31 Main Lobby / Traditions Lounge30c Campus Cupboard 30d Reflection Space
32 Marketing, Media & Programs/Student Union Activities33 Administration/Event Services/Catering34 Kansas Union Gallery35 Roasterie Co�ee & Smoothies36 ATM (outside)
LEVEL 1
1 The Jay2 The Cove3 4
Roll20 Esports LoungeBaumgartner Terrace
5 KU Ambassadors
LEVEL 2
6 KU Bookstore7 The Tech Shop8 Jayhawk Ink9 Jayhawk Collection
10 Textbooks
LEVEL 6
48 English Room49 Centennial Room50 Kansas Room51 Pine Room
52 Malott Room53 Divine Nine Room54 Curry Room
LEVEL 5
38 Jayhawk Room39 Parlors40 Ballroom41 Woodru� Auditorium42 International Room
43 Governors RoomMarketing, Media & Programs44
45 Women’s Hall of Fame46 Regionalist Room47 Big 12 Room
KANSAS UNION
PARKING GARAGE WALKWAY IS ON LEVEL 2
E
S
W
N
LOCATION LEVEL LOCATION LEVEL LOCATION LEVEL LOCATION LEVELAdministrationAlcovesAlderson Auditorium ATMBallroomBaumgartner Terrace Big 12 RoomBuilding Manager O�ceCatering O�ce Centennial RoomCenter for Sexuality&Gender DiversityClass Banner DisplayCommerce Bank
Curry RoomThe Crossroads
Union Square
Divine Nine Room English RoomEvent Services/ReservationsGallery Gender Inclusive RestroomGovernors Room Hawk Shop Convenience Store Human Resources Impromptu Café International RoomThe Jay Jayhawk Collection Jayhawk InkJayhawk RoomJayhawk WalkKansas Room
Kansas Union Welcome Desk/Box O�ceKJHK 90.7 FM StudiosKU BookstoreKU Card CenterKU Dining Administration O�ces
KU Women's Hall of FameKU Info
Main Lobby/Traditions Lounge Malott RoomThe Market Food CourtMarketing, Media & ProgramsParking Garage WalkwayParlors Pine RoomCampus Cupboard
Regionalist RoomRegistered DietitianRoasterie Co�ee & SmoothiesRoll20 Esports LoungeRoundtable Room The CoveStudent Union ActivitiesTech Shop
Traditions LoungeTextbooks
Union Business O�cesUnion IT DepartmentWheat RoomWoodru� AuditoriumReflection Space
LEVEL 4LOBBY
AED ATM Elevator Exit Restroom Stairs YOU ARE HERE KU Parking
434451544645,64463
6644454335122546
43243454634,52564
534131422433454
Gender InclusiveRestroom
To MulticulturalResource Center
Walkway To KU Parking Garage
ENTER HEREENTER HERE
ENTER HERE
ENTERHERE
ENTER HERE
30a
Alcove E21f Alcove F22 Roundtable Room
21d Alcove D 21b Alcove B
Patio
Tunnel BelowMiss. St.
30b
11
**
*
**
*
*
*
*