Re connecting with students as essential stakeholders Early engagement and communication strategies...
-
Upload
devin-jacobs -
Category
Documents
-
view
220 -
download
1
Transcript of Re connecting with students as essential stakeholders Early engagement and communication strategies...
![Page 1: Re connecting with students as essential stakeholders Early engagement and communication strategies 1 Jennifer Hill, Ed.D. Matt Serra, Ph.D. Office of.](https://reader036.fdocuments.net/reader036/viewer/2022062511/5514c1bf55034640138b5911/html5/thumbnails/1.jpg)
rereconnecting with connecting with students as essential students as essential stakeholdersstakeholdersEarly engagement and Early engagement and communication strategiescommunication strategies
1
Jennifer Hill, Ed.D.Matt Serra, Ph.D.
Office of Assessment, Trinity CollegeDuke University
assessment.aas.duke.edu/AACU_presentation_Feb2011.htm
![Page 2: Re connecting with students as essential stakeholders Early engagement and communication strategies 1 Jennifer Hill, Ed.D. Matt Serra, Ph.D. Office of.](https://reader036.fdocuments.net/reader036/viewer/2022062511/5514c1bf55034640138b5911/html5/thumbnails/2.jpg)
2Credit: UC San Diego
![Page 3: Re connecting with students as essential stakeholders Early engagement and communication strategies 1 Jennifer Hill, Ed.D. Matt Serra, Ph.D. Office of.](https://reader036.fdocuments.net/reader036/viewer/2022062511/5514c1bf55034640138b5911/html5/thumbnails/3.jpg)
3Credit: Denison University
![Page 4: Re connecting with students as essential stakeholders Early engagement and communication strategies 1 Jennifer Hill, Ed.D. Matt Serra, Ph.D. Office of.](https://reader036.fdocuments.net/reader036/viewer/2022062511/5514c1bf55034640138b5911/html5/thumbnails/4.jpg)
4Credit: Westminster College
![Page 5: Re connecting with students as essential stakeholders Early engagement and communication strategies 1 Jennifer Hill, Ed.D. Matt Serra, Ph.D. Office of.](https://reader036.fdocuments.net/reader036/viewer/2022062511/5514c1bf55034640138b5911/html5/thumbnails/5.jpg)
5Credit: Loyola Marymount University
![Page 6: Re connecting with students as essential stakeholders Early engagement and communication strategies 1 Jennifer Hill, Ed.D. Matt Serra, Ph.D. Office of.](https://reader036.fdocuments.net/reader036/viewer/2022062511/5514c1bf55034640138b5911/html5/thumbnails/6.jpg)
6Credit: University of Idaho
![Page 7: Re connecting with students as essential stakeholders Early engagement and communication strategies 1 Jennifer Hill, Ed.D. Matt Serra, Ph.D. Office of.](https://reader036.fdocuments.net/reader036/viewer/2022062511/5514c1bf55034640138b5911/html5/thumbnails/7.jpg)
7Credit: UCLA
![Page 8: Re connecting with students as essential stakeholders Early engagement and communication strategies 1 Jennifer Hill, Ed.D. Matt Serra, Ph.D. Office of.](https://reader036.fdocuments.net/reader036/viewer/2022062511/5514c1bf55034640138b5911/html5/thumbnails/8.jpg)
8
This sessionThis session
Session objectives
Session themes
•Facilitating student engagement
•Five principles/best practices• Start conversations early• Integrate with broader learning• Minimize over-testing• Use strategic incentives and motivators• Standardize feedback methods
•Evaluation and extension
![Page 9: Re connecting with students as essential stakeholders Early engagement and communication strategies 1 Jennifer Hill, Ed.D. Matt Serra, Ph.D. Office of.](https://reader036.fdocuments.net/reader036/viewer/2022062511/5514c1bf55034640138b5911/html5/thumbnails/9.jpg)
9
General education assessment
•serve as Institutional Research office of Trinity College•provide on-going analysis and research on Duke's undergraduate curriculum, courses, departments and programs in efforts to enhance student learning•Supply data products to College leadership
Assessment at Duke, Trinity Assessment at Duke, Trinity CollegeCollege
Program consultation
•serve as a resource for departments and faculty•partner with academic and co-curricular programs to develop and answer questions about student learning•share technical expertise on assessment methods and technologies
![Page 10: Re connecting with students as essential stakeholders Early engagement and communication strategies 1 Jennifer Hill, Ed.D. Matt Serra, Ph.D. Office of.](https://reader036.fdocuments.net/reader036/viewer/2022062511/5514c1bf55034640138b5911/html5/thumbnails/10.jpg)
10
Common consensus on in-class Common consensus on in-class formative and summative formative and summative assessmentassessment
High-impact learning
practicesa (course-level)
a See also: http://www.aacu.org/leap/documents/hip_tables.pdf
University- or College-wide
programs
Student engagem
ent
![Page 11: Re connecting with students as essential stakeholders Early engagement and communication strategies 1 Jennifer Hill, Ed.D. Matt Serra, Ph.D. Office of.](https://reader036.fdocuments.net/reader036/viewer/2022062511/5514c1bf55034640138b5911/html5/thumbnails/11.jpg)
11
Common consensus on in-class Common consensus on in-class formative and summative formative and summative assessmentassessment
High-impact learning
practices1 (course-level)
1 See also: http://www.aacu.org/leap/documents/hip_tables.pdf
University- or College-wide
programs
Student engagem
ent
![Page 12: Re connecting with students as essential stakeholders Early engagement and communication strategies 1 Jennifer Hill, Ed.D. Matt Serra, Ph.D. Office of.](https://reader036.fdocuments.net/reader036/viewer/2022062511/5514c1bf55034640138b5911/html5/thumbnails/12.jpg)
12
1.Start conversations early in the students’ tenure
Purpose: To introduce to students their responsibility for program enhancement. Set expectations for their roles in the learning community. Introduce and define student learning objectives and outcomes.
How to:Use multiple media, formats, and venues for communicating with students. Emphasize voluntary participation.
Five principles of early Five principles of early engagementengagement
![Page 13: Re connecting with students as essential stakeholders Early engagement and communication strategies 1 Jennifer Hill, Ed.D. Matt Serra, Ph.D. Office of.](https://reader036.fdocuments.net/reader036/viewer/2022062511/5514c1bf55034640138b5911/html5/thumbnails/13.jpg)
13
2.Assessment should be integrated into broader learning
Purpose: To make assessment a seamless part of the overall learning experience. Connect assessment to curricular and co-curricular experiences.
How to: Use strategic partnerships to embed assessment into course or program activities. The administration and the communication of results should be contextualized for students, faculty, and other stakeholders.
Five principles of early Five principles of early engagementengagement
![Page 14: Re connecting with students as essential stakeholders Early engagement and communication strategies 1 Jennifer Hill, Ed.D. Matt Serra, Ph.D. Office of.](https://reader036.fdocuments.net/reader036/viewer/2022062511/5514c1bf55034640138b5911/html5/thumbnails/14.jpg)
14
3.Carefully minimize over-surveying, over-testing
Purpose: To reduce assessment burden on students. Increase students’ motivation and commitment to the task. Enable the collection of necessary data at the appropriate points in the students’ tenure or program lifespan.
How to: Keep comprehensive documentation of completed assessments to prevent redundancy. Develop or commit to College-wide policies or procedures for survey sampling and the timing of an administration.
Five principles of early Five principles of early engagementengagement
![Page 15: Re connecting with students as essential stakeholders Early engagement and communication strategies 1 Jennifer Hill, Ed.D. Matt Serra, Ph.D. Office of.](https://reader036.fdocuments.net/reader036/viewer/2022062511/5514c1bf55034640138b5911/html5/thumbnails/15.jpg)
15
4.Use strategic, targeted incentives
Purpose: To engender goodwill among students. To recognize students’ time and effort as valuable.
How to: Non-pecuniary incentives are preferred. Chief incentive should be detailed and contextualized results (communicated to students in a timely manner). Pecuniary incentives should be immediate and commensurate with students’ time investment.
Five principles of early Five principles of early engagementengagement
![Page 16: Re connecting with students as essential stakeholders Early engagement and communication strategies 1 Jennifer Hill, Ed.D. Matt Serra, Ph.D. Office of.](https://reader036.fdocuments.net/reader036/viewer/2022062511/5514c1bf55034640138b5911/html5/thumbnails/16.jpg)
16
5.Develop standardized, timely, accessible feedback methods
a. To student participants
• Contextualize within the College’s strategic goals, institutional mission, program objectives, and/or program student learning outcomes
• Write in accessible language and with easy to follow graphics
• Make it personalized and prompt• Deliver via a secure medium, protecting
confidentiality• Invite students for optional, confidential
discussions of their results. Include resources for further information.
Five principles of early Five principles of early engagementengagement
![Page 17: Re connecting with students as essential stakeholders Early engagement and communication strategies 1 Jennifer Hill, Ed.D. Matt Serra, Ph.D. Office of.](https://reader036.fdocuments.net/reader036/viewer/2022062511/5514c1bf55034640138b5911/html5/thumbnails/17.jpg)
17
5.Develop standardized, timely, accessible feedback methods
b. To the college community
• Online, password-protected warehouse for dissemination of assessment findings
• Results reported in the aggregate only• Includes appropriate research question
and/or study context
Other ideas include outreach through assessment blogs, student publications, and social media sites.
Five principles of early Five principles of early engagementengagement
![Page 18: Re connecting with students as essential stakeholders Early engagement and communication strategies 1 Jennifer Hill, Ed.D. Matt Serra, Ph.D. Office of.](https://reader036.fdocuments.net/reader036/viewer/2022062511/5514c1bf55034640138b5911/html5/thumbnails/18.jpg)
18
• Start conversations early• Integrate into broader learning environment• Minimize over-testing• Use strategic incentives and motivators• Standardize feedback
Compliance in most assessment studies is voluntary: students should value participation in the process and have a stake in program/course enhancement.
These points emphasize the importance of self-reflection and self-assessment.
Key points
Five principles of early Five principles of early engagementengagement
![Page 19: Re connecting with students as essential stakeholders Early engagement and communication strategies 1 Jennifer Hill, Ed.D. Matt Serra, Ph.D. Office of.](https://reader036.fdocuments.net/reader036/viewer/2022062511/5514c1bf55034640138b5911/html5/thumbnails/19.jpg)
19
Application to study designApplication to study design
Principle Project
Start conversations early • •
Integrate into broader learning • •
Minimize over-testing • •
Use strategic incentives & motivators
• •
Standardize feedback methods • •
![Page 20: Re connecting with students as essential stakeholders Early engagement and communication strategies 1 Jennifer Hill, Ed.D. Matt Serra, Ph.D. Office of.](https://reader036.fdocuments.net/reader036/viewer/2022062511/5514c1bf55034640138b5911/html5/thumbnails/20.jpg)
20
Principle Project
Start conversations early
• Statement on culture of assessment in matriculate handbook
• Summer email • Orientation meetings and social media postings
Integrate into broader learning
• Enculturation into membership in a learning community
• Project homepage provides introduction to the practice of assessment, explanation of the study, access to instruments, and resources for further reading
Minimize over-testing
• Students are excused from similar assessments over the next year
Use strategic incentives & motivators
• Variety of incentives are used, but remote administration prevents immediate distribution
Standardize feedback methods
• Email delivery of individual and group results, including explanatory summary
• Occurs within 6 weeks of project completion
Case study 1: New matriculate Case study 1: New matriculate assessment initiativeassessment initiative
![Page 21: Re connecting with students as essential stakeholders Early engagement and communication strategies 1 Jennifer Hill, Ed.D. Matt Serra, Ph.D. Office of.](https://reader036.fdocuments.net/reader036/viewer/2022062511/5514c1bf55034640138b5911/html5/thumbnails/21.jpg)
21
Principle Project
Start conversations early
• Target first-year students in a multi-course interdisciplinary program.
Integrate into broader learning
• Recruitment facilitated by program director.• Intended to be closely connected with a shared
course, and contextualized in terms of their coursework. A natural part of the course experience.
• Test itself is based on real problems that are multidisciplinary in nature
Minimize over-testing
• Students are excused from similar assessments over the next year
Use strategic incentives & motivators
• Staggered, personalized incentives used
Standardize feedback methods
• Students are emailed individual and group results and an explanatory summary within one term of project completion
Case study 2: First-year assessment Case study 2: First-year assessment of critical thinkingof critical thinking
![Page 22: Re connecting with students as essential stakeholders Early engagement and communication strategies 1 Jennifer Hill, Ed.D. Matt Serra, Ph.D. Office of.](https://reader036.fdocuments.net/reader036/viewer/2022062511/5514c1bf55034640138b5911/html5/thumbnails/22.jpg)
22
Principle Project
Start conversations early
• Primer email from Director of Academic Advising Center
Integrate into broader learning
• Survey items ask students to reflect on multiple curricular and co-curricular learning opportunities, present and future• Second-year survey is embedded in the long-range planner required of the declaration process
Minimize over-testing
• Each survey is a full census of first-year and sophomore students• Reminders are limited and sent only to non-respondents
Use strategic incentives & motivators
•No incentives provided
Standardize feedback methods
• Students can opt-in to receive a copy of their survey submission via email• Aggregate report posted on Assessment website
Case study 3: Advising surveysCase study 3: Advising surveys
![Page 23: Re connecting with students as essential stakeholders Early engagement and communication strategies 1 Jennifer Hill, Ed.D. Matt Serra, Ph.D. Office of.](https://reader036.fdocuments.net/reader036/viewer/2022062511/5514c1bf55034640138b5911/html5/thumbnails/23.jpg)
23
Principle Project
Start conversations early
• Regular, personal communication with program director emphasizing the process of reflection and self-assessment
Integrate into broader learning
• Artifacts presented to and evaluated within the ePortfolio are drawn from curricular and co-curricular experiences• Assessors include program faculty and academic advisors affiliated with the program
Minimize over-testing
• Students are excused from similar assessments over the next year
Use strategic incentives & motivators
•No incentives provided
Standardize feedback methods
• Students receive immediate feedback from assessors within the ePortfolio
Case study 4: ePortfolios in four-year Case study 4: ePortfolios in four-year professional school preparation professional school preparation programprogram
![Page 24: Re connecting with students as essential stakeholders Early engagement and communication strategies 1 Jennifer Hill, Ed.D. Matt Serra, Ph.D. Office of.](https://reader036.fdocuments.net/reader036/viewer/2022062511/5514c1bf55034640138b5911/html5/thumbnails/24.jpg)
24
Please gather in small groups to discuss one or two example assessment projects or ideas from your home institutions.
•Your goal is to deconstruct the project(s) into the five components of engagement.
•Identify opportunities to expand or enhance the project. Work through anticipated challenges.
•Document your discussion (worksheet)
Exercise: Small group discussionExercise: Small group discussion
![Page 25: Re connecting with students as essential stakeholders Early engagement and communication strategies 1 Jennifer Hill, Ed.D. Matt Serra, Ph.D. Office of.](https://reader036.fdocuments.net/reader036/viewer/2022062511/5514c1bf55034640138b5911/html5/thumbnails/25.jpg)
25
Return to the large groupReturn to the large group
What opportunities do we have in common? Common challenges?
Would anyone like to “show-and-tell” their assessment project or plan, broken down by the five principles?
![Page 26: Re connecting with students as essential stakeholders Early engagement and communication strategies 1 Jennifer Hill, Ed.D. Matt Serra, Ph.D. Office of.](https://reader036.fdocuments.net/reader036/viewer/2022062511/5514c1bf55034640138b5911/html5/thumbnails/26.jpg)
26
Current issues, common challenges, & good opportunities
•Apathy, especially among graduating students and faculty
•Study incentives, limitations of tangible incentives
•Survey and assessment fatigue
•Mobile devices in assessment
•Spread of effect: Measuring the community-wide impact of a course or program
•Assessing decision-makers’ use of assessment information
SummarySummary
![Page 27: Re connecting with students as essential stakeholders Early engagement and communication strategies 1 Jennifer Hill, Ed.D. Matt Serra, Ph.D. Office of.](https://reader036.fdocuments.net/reader036/viewer/2022062511/5514c1bf55034640138b5911/html5/thumbnails/27.jpg)
27
Jennifer HillAssociate Dir., Office of Assessment
Trinity [email protected]
Matt SerraDirector, Office of Assessment
Trinity [email protected]
assessment.aas.duke.edu
Thank you for joining us!Thank you for joining us!