Tools and Resources to Increase Data Use Capacity
description
Transcript of Tools and Resources to Increase Data Use Capacity
![Page 1: Tools and Resources to Increase Data Use Capacity](https://reader036.fdocuments.net/reader036/viewer/2022062803/568147ce550346895db50ccf/html5/thumbnails/1.jpg)
Tools and Resources to Increase Data Use
CapacityRebecca Cohen, AACC & CRESST/UCLA
Ellen Osmundson, AACC & CRESST/UCLA
Neal Gibson, Arkansas Department of Education
CCSSO Leadership Conference
September 8, 2008
Milwaukee, Wisconsin
![Page 2: Tools and Resources to Increase Data Use Capacity](https://reader036.fdocuments.net/reader036/viewer/2022062803/568147ce550346895db50ccf/html5/thumbnails/2.jpg)
Overview
• Background
• Data Use Web Based Tools
Key Capacities Map
Inventory
Formative Assessment
Data Use Scenarios
• Collaboration with Arkansas Department of Education
![Page 3: Tools and Resources to Increase Data Use Capacity](https://reader036.fdocuments.net/reader036/viewer/2022062803/568147ce550346895db50ccf/html5/thumbnails/3.jpg)
Background
![Page 4: Tools and Resources to Increase Data Use Capacity](https://reader036.fdocuments.net/reader036/viewer/2022062803/568147ce550346895db50ccf/html5/thumbnails/4.jpg)
Assessment and Accountability Comprehensive Center
• Supports the use of data to achieve the goals of No Child Left Behind
• Offers Regional Comprehensive Centers and states a national perspective on research-based resources and access to effective models, research syntheses, toolkits, and software systems
• Operated by WestEd in partnership with CRESST/UCLA
• http://www.aacompcenter.org/
![Page 5: Tools and Resources to Increase Data Use Capacity](https://reader036.fdocuments.net/reader036/viewer/2022062803/568147ce550346895db50ccf/html5/thumbnails/5.jpg)
![Page 6: Tools and Resources to Increase Data Use Capacity](https://reader036.fdocuments.net/reader036/viewer/2022062803/568147ce550346895db50ccf/html5/thumbnails/6.jpg)
What is Data Use?
Data use involves systematically collecting, analyzing, and interpreting various types of data to guide educational decisions at the state, district, school, and classroom level for improved student achievement.
![Page 7: Tools and Resources to Increase Data Use Capacity](https://reader036.fdocuments.net/reader036/viewer/2022062803/568147ce550346895db50ccf/html5/thumbnails/7.jpg)
Data Use for Continuous Quality Improvement
• Website: http://datause.cse.ucla.edu/
• 18-month, iterative process, drawing on current educational research and consultations with expert scholars, and national and state leaders in the area of data use for school and student improvement
• Conceptually based representations, tools, and resources of the domain of data use in educational organizations (classrooms, schools, districts, states)
![Page 8: Tools and Resources to Increase Data Use Capacity](https://reader036.fdocuments.net/reader036/viewer/2022062803/568147ce550346895db50ccf/html5/thumbnails/8.jpg)
What is on the Data Use Website
• Defines a process for data use linked to foundational core capacities
• Organizes and makes available research and research-based guidance
• Presents criteria for evaluating data tools and selecting and using diagnostic tests
• Offers professional development for assessing data use in organizations, and selecting and using diagnostic tests
![Page 9: Tools and Resources to Increase Data Use Capacity](https://reader036.fdocuments.net/reader036/viewer/2022062803/568147ce550346895db50ccf/html5/thumbnails/9.jpg)
![Page 10: Tools and Resources to Increase Data Use Capacity](https://reader036.fdocuments.net/reader036/viewer/2022062803/568147ce550346895db50ccf/html5/thumbnails/10.jpg)
Data Use Process Guide
![Page 11: Tools and Resources to Increase Data Use Capacity](https://reader036.fdocuments.net/reader036/viewer/2022062803/568147ce550346895db50ccf/html5/thumbnails/11.jpg)
![Page 12: Tools and Resources to Increase Data Use Capacity](https://reader036.fdocuments.net/reader036/viewer/2022062803/568147ce550346895db50ccf/html5/thumbnails/12.jpg)
![Page 13: Tools and Resources to Increase Data Use Capacity](https://reader036.fdocuments.net/reader036/viewer/2022062803/568147ce550346895db50ccf/html5/thumbnails/13.jpg)
![Page 14: Tools and Resources to Increase Data Use Capacity](https://reader036.fdocuments.net/reader036/viewer/2022062803/568147ce550346895db50ccf/html5/thumbnails/14.jpg)
Criteria for SelectingData Tools
![Page 15: Tools and Resources to Increase Data Use Capacity](https://reader036.fdocuments.net/reader036/viewer/2022062803/568147ce550346895db50ccf/html5/thumbnails/15.jpg)
![Page 16: Tools and Resources to Increase Data Use Capacity](https://reader036.fdocuments.net/reader036/viewer/2022062803/568147ce550346895db50ccf/html5/thumbnails/16.jpg)
![Page 17: Tools and Resources to Increase Data Use Capacity](https://reader036.fdocuments.net/reader036/viewer/2022062803/568147ce550346895db50ccf/html5/thumbnails/17.jpg)
Criteria for Selecting Diagnostic Assessments
![Page 18: Tools and Resources to Increase Data Use Capacity](https://reader036.fdocuments.net/reader036/viewer/2022062803/568147ce550346895db50ccf/html5/thumbnails/18.jpg)
![Page 19: Tools and Resources to Increase Data Use Capacity](https://reader036.fdocuments.net/reader036/viewer/2022062803/568147ce550346895db50ccf/html5/thumbnails/19.jpg)
![Page 20: Tools and Resources to Increase Data Use Capacity](https://reader036.fdocuments.net/reader036/viewer/2022062803/568147ce550346895db50ccf/html5/thumbnails/20.jpg)
Professional Development Tool for Selecting
Diagnostic Assessments
![Page 21: Tools and Resources to Increase Data Use Capacity](https://reader036.fdocuments.net/reader036/viewer/2022062803/568147ce550346895db50ccf/html5/thumbnails/21.jpg)
![Page 22: Tools and Resources to Increase Data Use Capacity](https://reader036.fdocuments.net/reader036/viewer/2022062803/568147ce550346895db50ccf/html5/thumbnails/22.jpg)
Library
![Page 23: Tools and Resources to Increase Data Use Capacity](https://reader036.fdocuments.net/reader036/viewer/2022062803/568147ce550346895db50ccf/html5/thumbnails/23.jpg)
![Page 24: Tools and Resources to Increase Data Use Capacity](https://reader036.fdocuments.net/reader036/viewer/2022062803/568147ce550346895db50ccf/html5/thumbnails/24.jpg)
![Page 25: Tools and Resources to Increase Data Use Capacity](https://reader036.fdocuments.net/reader036/viewer/2022062803/568147ce550346895db50ccf/html5/thumbnails/25.jpg)
![Page 26: Tools and Resources to Increase Data Use Capacity](https://reader036.fdocuments.net/reader036/viewer/2022062803/568147ce550346895db50ccf/html5/thumbnails/26.jpg)
Map of Key Capacities for Data Use
• Multi-faceted representation of the dependent and dynamic network of capacities crucial for effective data use
• Iterative process, drawing on current educational research and consultations with expert scholars, and national and state leaders in the area of data use for school and student improvement
• Emphasizes five key concepts, and their relationships to each other and more than twenty other sub-concepts
![Page 27: Tools and Resources to Increase Data Use Capacity](https://reader036.fdocuments.net/reader036/viewer/2022062803/568147ce550346895db50ccf/html5/thumbnails/27.jpg)
![Page 28: Tools and Resources to Increase Data Use Capacity](https://reader036.fdocuments.net/reader036/viewer/2022062803/568147ce550346895db50ccf/html5/thumbnails/28.jpg)
![Page 29: Tools and Resources to Increase Data Use Capacity](https://reader036.fdocuments.net/reader036/viewer/2022062803/568147ce550346895db50ccf/html5/thumbnails/29.jpg)
![Page 30: Tools and Resources to Increase Data Use Capacity](https://reader036.fdocuments.net/reader036/viewer/2022062803/568147ce550346895db50ccf/html5/thumbnails/30.jpg)
![Page 31: Tools and Resources to Increase Data Use Capacity](https://reader036.fdocuments.net/reader036/viewer/2022062803/568147ce550346895db50ccf/html5/thumbnails/31.jpg)
Leadership
• Significance of leadership for the process of data use in educational organizations
• Essential for fostering the policies for educational improvement
• Establishes standards for learning and data quality, and assessment use and institutional capacity and improvement
• Responsible for developing a culture of inquiry and collaboration among data users, establishing expectations for data use, and building capacity to support data use
• Facilitate communication with stakeholders
![Page 32: Tools and Resources to Increase Data Use Capacity](https://reader036.fdocuments.net/reader036/viewer/2022062803/568147ce550346895db50ccf/html5/thumbnails/32.jpg)
![Page 33: Tools and Resources to Increase Data Use Capacity](https://reader036.fdocuments.net/reader036/viewer/2022062803/568147ce550346895db50ccf/html5/thumbnails/33.jpg)
Inventory
![Page 34: Tools and Resources to Increase Data Use Capacity](https://reader036.fdocuments.net/reader036/viewer/2022062803/568147ce550346895db50ccf/html5/thumbnails/34.jpg)
Inventory• Tool for Organizations to Assess Data Use Capacity
• Aligned with the 5 Key Capacities• Leadership, Data Quality Assurance, Infrastructure,
Communication, Action for Learning
• General Inventory• Provides a broad overview of each capacity
• In-depth Inventory• Provides a more detailed analysis of each capacity
• Options for individual or group scores
• Resources• Aligned with library
• Transformation Plan• Plan next steps, outline responsibilities, tasks
![Page 35: Tools and Resources to Increase Data Use Capacity](https://reader036.fdocuments.net/reader036/viewer/2022062803/568147ce550346895db50ccf/html5/thumbnails/35.jpg)
![Page 36: Tools and Resources to Increase Data Use Capacity](https://reader036.fdocuments.net/reader036/viewer/2022062803/568147ce550346895db50ccf/html5/thumbnails/36.jpg)
![Page 37: Tools and Resources to Increase Data Use Capacity](https://reader036.fdocuments.net/reader036/viewer/2022062803/568147ce550346895db50ccf/html5/thumbnails/37.jpg)
![Page 38: Tools and Resources to Increase Data Use Capacity](https://reader036.fdocuments.net/reader036/viewer/2022062803/568147ce550346895db50ccf/html5/thumbnails/38.jpg)
![Page 39: Tools and Resources to Increase Data Use Capacity](https://reader036.fdocuments.net/reader036/viewer/2022062803/568147ce550346895db50ccf/html5/thumbnails/39.jpg)
![Page 40: Tools and Resources to Increase Data Use Capacity](https://reader036.fdocuments.net/reader036/viewer/2022062803/568147ce550346895db50ccf/html5/thumbnails/40.jpg)
![Page 41: Tools and Resources to Increase Data Use Capacity](https://reader036.fdocuments.net/reader036/viewer/2022062803/568147ce550346895db50ccf/html5/thumbnails/41.jpg)
![Page 42: Tools and Resources to Increase Data Use Capacity](https://reader036.fdocuments.net/reader036/viewer/2022062803/568147ce550346895db50ccf/html5/thumbnails/42.jpg)
![Page 43: Tools and Resources to Increase Data Use Capacity](https://reader036.fdocuments.net/reader036/viewer/2022062803/568147ce550346895db50ccf/html5/thumbnails/43.jpg)
![Page 44: Tools and Resources to Increase Data Use Capacity](https://reader036.fdocuments.net/reader036/viewer/2022062803/568147ce550346895db50ccf/html5/thumbnails/44.jpg)
![Page 45: Tools and Resources to Increase Data Use Capacity](https://reader036.fdocuments.net/reader036/viewer/2022062803/568147ce550346895db50ccf/html5/thumbnails/45.jpg)
![Page 46: Tools and Resources to Increase Data Use Capacity](https://reader036.fdocuments.net/reader036/viewer/2022062803/568147ce550346895db50ccf/html5/thumbnails/46.jpg)
![Page 47: Tools and Resources to Increase Data Use Capacity](https://reader036.fdocuments.net/reader036/viewer/2022062803/568147ce550346895db50ccf/html5/thumbnails/47.jpg)
Develop Dept. of Education knowledge and skills associated with formative assessment
![Page 48: Tools and Resources to Increase Data Use Capacity](https://reader036.fdocuments.net/reader036/viewer/2022062803/568147ce550346895db50ccf/html5/thumbnails/48.jpg)
![Page 49: Tools and Resources to Increase Data Use Capacity](https://reader036.fdocuments.net/reader036/viewer/2022062803/568147ce550346895db50ccf/html5/thumbnails/49.jpg)
Formative Assessment
![Page 50: Tools and Resources to Increase Data Use Capacity](https://reader036.fdocuments.net/reader036/viewer/2022062803/568147ce550346895db50ccf/html5/thumbnails/50.jpg)
Working Definition of Formative Assessment
The following working definition of formative assessment has been derived from a review of definitions of formative assessment presented in the literature. This definition provides the framework for the assessment cycle.
Formative assessment is an ongoing process that provides feedback during the course of instruction to teachers and students to close the gap between current learning and a desired goal.
![Page 51: Tools and Resources to Increase Data Use Capacity](https://reader036.fdocuments.net/reader036/viewer/2022062803/568147ce550346895db50ccf/html5/thumbnails/51.jpg)
![Page 52: Tools and Resources to Increase Data Use Capacity](https://reader036.fdocuments.net/reader036/viewer/2022062803/568147ce550346895db50ccf/html5/thumbnails/52.jpg)
Assessment Cycle
• Outlines learning and assessment process
• Research-based
• Iterative in nature
![Page 53: Tools and Resources to Increase Data Use Capacity](https://reader036.fdocuments.net/reader036/viewer/2022062803/568147ce550346895db50ccf/html5/thumbnails/53.jpg)
![Page 54: Tools and Resources to Increase Data Use Capacity](https://reader036.fdocuments.net/reader036/viewer/2022062803/568147ce550346895db50ccf/html5/thumbnails/54.jpg)
Assessment Strategies
• Five key strategies of formative assessment
• Clarify learning goal, establish success criteria
• Illicit evidence of learning
• Provide feedback
• Activate student ownership of learning
• Establish students as instructional resources
![Page 55: Tools and Resources to Increase Data Use Capacity](https://reader036.fdocuments.net/reader036/viewer/2022062803/568147ce550346895db50ccf/html5/thumbnails/55.jpg)
![Page 56: Tools and Resources to Increase Data Use Capacity](https://reader036.fdocuments.net/reader036/viewer/2022062803/568147ce550346895db50ccf/html5/thumbnails/56.jpg)
![Page 57: Tools and Resources to Increase Data Use Capacity](https://reader036.fdocuments.net/reader036/viewer/2022062803/568147ce550346895db50ccf/html5/thumbnails/57.jpg)
![Page 58: Tools and Resources to Increase Data Use Capacity](https://reader036.fdocuments.net/reader036/viewer/2022062803/568147ce550346895db50ccf/html5/thumbnails/58.jpg)
![Page 59: Tools and Resources to Increase Data Use Capacity](https://reader036.fdocuments.net/reader036/viewer/2022062803/568147ce550346895db50ccf/html5/thumbnails/59.jpg)
Data Use Scenarios
![Page 60: Tools and Resources to Increase Data Use Capacity](https://reader036.fdocuments.net/reader036/viewer/2022062803/568147ce550346895db50ccf/html5/thumbnails/60.jpg)
Scenarios: State, District, Classroom
• Narratives about how education leaders use data to identify and address challenges of student achievement in their organizations
• Indicates where leaders are at different points in the data use process and the types of analyses appropriate to their work
• Includes a list of additional readings with suggestions for how education leaders can use resources to improve data use in their organizations
• Can be used for professional development
![Page 61: Tools and Resources to Increase Data Use Capacity](https://reader036.fdocuments.net/reader036/viewer/2022062803/568147ce550346895db50ccf/html5/thumbnails/61.jpg)
![Page 62: Tools and Resources to Increase Data Use Capacity](https://reader036.fdocuments.net/reader036/viewer/2022062803/568147ce550346895db50ccf/html5/thumbnails/62.jpg)
State Scenario NarrativeThe members of a State Board of Education in a small state are increasingly hearing from parents that the reason their children’s schools are receiving low scores on the statewide Academic Achievement Index, a general measure of student achievement in the core academic subjects, is because they have too many inexperienced and under-qualified teachers. The board members have charged the State Commissioner of Education with investigating this concern and making some policy recommendations based on the findings.
![Page 63: Tools and Resources to Increase Data Use Capacity](https://reader036.fdocuments.net/reader036/viewer/2022062803/568147ce550346895db50ccf/html5/thumbnails/63.jpg)
State Scenario Narrative (Research Questions)
Research Questions
The Commissioner has put together a team of four administrators from the State Department of Education to lead the investigation. Following considerable discussion, the team decides on the research questions that will guide their inquiry:
• What is the relationship between Academic Achievement Index scores and school percentage of experienced teachers?
• What is the relationship between Academic Achievement Index scores and school percentage of qualified teachers?
• To what extent are teacher experience and teacher qualifications associated with other school-level characteristics, including geographic location, grade-levels served, and student socioeconomic status?
![Page 64: Tools and Resources to Increase Data Use Capacity](https://reader036.fdocuments.net/reader036/viewer/2022062803/568147ce550346895db50ccf/html5/thumbnails/64.jpg)
State Scenario Narrative (Excerpt)Defining Research Terms
After identifying the research questions, the leader of the team, Mr. Dawes, notes that they need to define the variables within each research question. “For example,” he says, “we need to figure out how to define experienced and qualified teachers. We also need to be specific about how we describe and categorize school-level characteristics to ensure that our descriptors are valid and appropriate. Having clear definitions of what we are measuring will help ensure we look at the right data, conduct the appropriate analyses, and report back to stakeholders with confidence in our methods.”
Notice this section is about assessing the present state because the state leaders:
• Ask questions focused on how teacher and school-level characteristics relate to student performance
• Review the educational research literature to clarify their questions and identify appropriate data sources
![Page 65: Tools and Resources to Increase Data Use Capacity](https://reader036.fdocuments.net/reader036/viewer/2022062803/568147ce550346895db50ccf/html5/thumbnails/65.jpg)
State Scenario Resources (Example)
Assessing the Present (Process Guide for Data Use)Professional Development Resources
Citation/ISBN: [website - http://www.csrclearinghouse.com]Fashola, O. S. (2004). Being an informed consumer of quantitative educational research. Phi Delta Kappan, 85(7), pp. 532-538.
Summary:This article provides a straightforward description of various components of scientific research, including evaluation designs, measures of student academic achievement, and interpretation of statistical findings. The author also discusses factors that contribute to program effectiveness including clear goals, regular assessments, professional development, and support.
How to use:Use as a focus for discussions about conducting quality research, including considerations for research design, implementation, analysis, and reporting. Use in conjunction with Mertens’ (2005) book and Leedy and Ormrod’s (2004) book.
![Page 66: Tools and Resources to Increase Data Use Capacity](https://reader036.fdocuments.net/reader036/viewer/2022062803/568147ce550346895db50ccf/html5/thumbnails/66.jpg)
Future Plans
• Revisions to the website
• Audio-visual components
• Updates about field work
• Share research through website
• Solicit work and feedback for website
![Page 67: Tools and Resources to Increase Data Use Capacity](https://reader036.fdocuments.net/reader036/viewer/2022062803/568147ce550346895db50ccf/html5/thumbnails/67.jpg)
Data Use Website in Action
![Page 68: Tools and Resources to Increase Data Use Capacity](https://reader036.fdocuments.net/reader036/viewer/2022062803/568147ce550346895db50ccf/html5/thumbnails/68.jpg)
Collaborative Partnerships: Formative Assessment
• Iowa: Iowa SD, NCCC, AACC
Build capacity and support Iowa SD in roll out of Core Curriculum and formative assessment strategies
• Syracuse: NYSED, NYCC, AACC, SCS
Build capacity in SCSD and develop a model that can be implemented in other districts in New York and other states
• North Carolina: NCDPI, ARCC, AACC
Build support and capacity for formative assessment
• Contact: [email protected]
![Page 69: Tools and Resources to Increase Data Use Capacity](https://reader036.fdocuments.net/reader036/viewer/2022062803/568147ce550346895db50ccf/html5/thumbnails/69.jpg)
Arkansas Collaboration: AACC, MC3, ADE
• Use the statewide database as a leverage point to think about supporting states:
Disseminating data; Choosing data sources; Creating models to frame and think about data; assessing and addressing professional development needs
• Conduct pilot projects in select school districts
• Work with the state to create professional development that can be rolled out statewide
• Develop guidance for states
![Page 71: Tools and Resources to Increase Data Use Capacity](https://reader036.fdocuments.net/reader036/viewer/2022062803/568147ce550346895db50ccf/html5/thumbnails/71.jpg)
Questions/Comments
Rebecca Cohen [email protected]
Ellen Osmundson [email protected]
Neal Gibson [email protected]