Developing Learning Outcomes for Student …...Developing Learning Outcomes for Student Employees...
Transcript of Developing Learning Outcomes for Student …...Developing Learning Outcomes for Student Employees...
![Page 1: Developing Learning Outcomes for Student …...Developing Learning Outcomes for Student Employees Aligning assessment practice with student learning outcomes Office of Assessment,](https://reader036.fdocuments.net/reader036/viewer/2022062506/5f2277bfeba4943b90646a2e/html5/thumbnails/1.jpg)
Developing Learning
Outcomes for Student Employees
Aligning assessment practice with student learning outcomes
Office of Assessment, Trinity College
Duke University
![Page 2: Developing Learning Outcomes for Student …...Developing Learning Outcomes for Student Employees Aligning assessment practice with student learning outcomes Office of Assessment,](https://reader036.fdocuments.net/reader036/viewer/2022062506/5f2277bfeba4943b90646a2e/html5/thumbnails/2.jpg)
Presentation overview
Background - What are our commitments?
How are our commitments aligned?
Setting up the student employee experience
to support these commitments.
Assessing student employee movement
towards established learning outcomes.
![Page 3: Developing Learning Outcomes for Student …...Developing Learning Outcomes for Student Employees Aligning assessment practice with student learning outcomes Office of Assessment,](https://reader036.fdocuments.net/reader036/viewer/2022062506/5f2277bfeba4943b90646a2e/html5/thumbnails/3.jpg)
Our commitments
To the Trinity College of Arts & Sciences
mission:
Supporting students as they
“learn to communicate persuasively,
bring meaning to information,
discern competing claims, and
develop capacity for reasoning,
analysis, and empathy”.
https://trinity.duke.edu/academic-affairs
![Page 4: Developing Learning Outcomes for Student …...Developing Learning Outcomes for Student Employees Aligning assessment practice with student learning outcomes Office of Assessment,](https://reader036.fdocuments.net/reader036/viewer/2022062506/5f2277bfeba4943b90646a2e/html5/thumbnails/4.jpg)
The practice of assessment
The Office of Assessment’s objectives
include
Providing on-going analysis and research on Duke's
undergraduate curriculum to improve student learning.
Consulting with, guiding academic programs to
practice quality assessment locally.
Developing assessment technologies, enterprise
platforms, measuring instruments to support
assessment.
Participating in regional and national dialogue about the practice of assessment
![Page 5: Developing Learning Outcomes for Student …...Developing Learning Outcomes for Student Employees Aligning assessment practice with student learning outcomes Office of Assessment,](https://reader036.fdocuments.net/reader036/viewer/2022062506/5f2277bfeba4943b90646a2e/html5/thumbnails/5.jpg)
The practice of assessment
The Office of Assessment’s objectives
include
Providing on-going analysis and research on Duke's
undergraduate curriculum to improve student learning.
Consulting with, guiding academic programs to
practice quality assessment locally.
Developing assessment technologies, enterprise
platforms, measuring instruments to support
assessment.
Participating in regional and national dialogue about the practice of assessment
![Page 6: Developing Learning Outcomes for Student …...Developing Learning Outcomes for Student Employees Aligning assessment practice with student learning outcomes Office of Assessment,](https://reader036.fdocuments.net/reader036/viewer/2022062506/5f2277bfeba4943b90646a2e/html5/thumbnails/6.jpg)
High Impact Practices in
Education
Undergraduate Research:
is in-depth, and complements or extends
previous learning
Is conducted under the guidance of
faculty or institutional mentor and typically
integrated into or related to the mentor's
work
asks and addresses relevant questions
using the methodologies of the discipline
![Page 7: Developing Learning Outcomes for Student …...Developing Learning Outcomes for Student Employees Aligning assessment practice with student learning outcomes Office of Assessment,](https://reader036.fdocuments.net/reader036/viewer/2022062506/5f2277bfeba4943b90646a2e/html5/thumbnails/7.jpg)
Aligning these commitments
Institutional mission
Undergrad. research
[high impact practice]
The practice of assessment
![Page 8: Developing Learning Outcomes for Student …...Developing Learning Outcomes for Student Employees Aligning assessment practice with student learning outcomes Office of Assessment,](https://reader036.fdocuments.net/reader036/viewer/2022062506/5f2277bfeba4943b90646a2e/html5/thumbnails/8.jpg)
Institutional mission
Undergrad. research
[high impact practice]
The practice of assessment
What student
employment
opportunities
can be
created at this
intersection?
Aligning these commitments
![Page 9: Developing Learning Outcomes for Student …...Developing Learning Outcomes for Student Employees Aligning assessment practice with student learning outcomes Office of Assessment,](https://reader036.fdocuments.net/reader036/viewer/2022062506/5f2277bfeba4943b90646a2e/html5/thumbnails/9.jpg)
Our commitment
Bentrim, E., Sousa-Peoples, K., Kachellek, G., and Powers, W. (Mar/Apr 2013). Learning Outcome Domains and Related Skills/Variables. Diagram. About Campus, Vol. 18 Issue 1, p30.
Student Development Through Employment
![Page 10: Developing Learning Outcomes for Student …...Developing Learning Outcomes for Student Employees Aligning assessment practice with student learning outcomes Office of Assessment,](https://reader036.fdocuments.net/reader036/viewer/2022062506/5f2277bfeba4943b90646a2e/html5/thumbnails/10.jpg)
Our commitment
Bentrim, E., Sousa-Peoples, K., Kachellek, G., and Powers, W. (Mar/Apr 2013). Learning Outcome Domains and Related Skills/Variables. Diagram. About Campus, Vol. 18 Issue 1, p30.
Student Development Through Employment
![Page 11: Developing Learning Outcomes for Student …...Developing Learning Outcomes for Student Employees Aligning assessment practice with student learning outcomes Office of Assessment,](https://reader036.fdocuments.net/reader036/viewer/2022062506/5f2277bfeba4943b90646a2e/html5/thumbnails/11.jpg)
Our commitment
Bentrim, E., Sousa-Peoples, K., Kachellek, G., and Powers, W. (Mar/Apr 2013). Learning Outcome Domains and Related Skills/Variables. Diagram. About Campus, Vol. 18 Issue 1, p30.
Student Development Through Employment
![Page 12: Developing Learning Outcomes for Student …...Developing Learning Outcomes for Student Employees Aligning assessment practice with student learning outcomes Office of Assessment,](https://reader036.fdocuments.net/reader036/viewer/2022062506/5f2277bfeba4943b90646a2e/html5/thumbnails/12.jpg)
Our commitment
Bentrim, E., Sousa-Peoples, K., Kachellek, G., and Powers, W. (Mar/Apr 2013). Learning Outcome Domains and Related Skills/Variables. Diagram. About Campus, Vol. 18 Issue 1, p30.
Student Development Through Employment
![Page 13: Developing Learning Outcomes for Student …...Developing Learning Outcomes for Student Employees Aligning assessment practice with student learning outcomes Office of Assessment,](https://reader036.fdocuments.net/reader036/viewer/2022062506/5f2277bfeba4943b90646a2e/html5/thumbnails/13.jpg)
Our commitment
Bentrim, E., Sousa-Peoples, K., Kachellek, G., and Powers, W. (Mar/Apr 2013). Learning Outcome Domains and Related Skills/Variables. Diagram. About Campus, Vol. 18 Issue 1, p30.
Student Development Through Employment
![Page 14: Developing Learning Outcomes for Student …...Developing Learning Outcomes for Student Employees Aligning assessment practice with student learning outcomes Office of Assessment,](https://reader036.fdocuments.net/reader036/viewer/2022062506/5f2277bfeba4943b90646a2e/html5/thumbnails/14.jpg)
Our commitment
Bentrim, E., Sousa-Peoples, K., Kachellek, G., and Powers, W. (Mar/Apr 2013). Learning Outcome Domains and Related Skills/Variables. Diagram. About Campus, Vol. 18 Issue 1, p30.
Student Development Through Employment
![Page 15: Developing Learning Outcomes for Student …...Developing Learning Outcomes for Student Employees Aligning assessment practice with student learning outcomes Office of Assessment,](https://reader036.fdocuments.net/reader036/viewer/2022062506/5f2277bfeba4943b90646a2e/html5/thumbnails/15.jpg)
Institutional mission
Undergrad. research
[high impact practice]
The practice of assessment
What student
employment
opportunities
can be
created at this
intersection?
Aligning these commitments
![Page 16: Developing Learning Outcomes for Student …...Developing Learning Outcomes for Student Employees Aligning assessment practice with student learning outcomes Office of Assessment,](https://reader036.fdocuments.net/reader036/viewer/2022062506/5f2277bfeba4943b90646a2e/html5/thumbnails/16.jpg)
Guiding principles for the
OATC RA Experience
Exposes undergraduate student researchers to basic research methods in education
Provides structured educational opportunities outside the classroom
Challenges undergraduates to identify learning outcomes important to their intellectual and professional interests, and develop artifacts that demonstrate learning
![Page 17: Developing Learning Outcomes for Student …...Developing Learning Outcomes for Student Employees Aligning assessment practice with student learning outcomes Office of Assessment,](https://reader036.fdocuments.net/reader036/viewer/2022062506/5f2277bfeba4943b90646a2e/html5/thumbnails/17.jpg)
Guiding principles for the
OATC RA Experience
Promotes understanding of evidence-based
decision-making
Builds awareness and appreciation for the
assessment community in higher education
Intentional
![Page 18: Developing Learning Outcomes for Student …...Developing Learning Outcomes for Student Employees Aligning assessment practice with student learning outcomes Office of Assessment,](https://reader036.fdocuments.net/reader036/viewer/2022062506/5f2277bfeba4943b90646a2e/html5/thumbnails/18.jpg)
Guiding principles for the
OATC RA Experience
Promotes understanding of evidence-based
decision-making
Builds awareness and appreciation for the
assessment community in higher education
Intentional
![Page 19: Developing Learning Outcomes for Student …...Developing Learning Outcomes for Student Employees Aligning assessment practice with student learning outcomes Office of Assessment,](https://reader036.fdocuments.net/reader036/viewer/2022062506/5f2277bfeba4943b90646a2e/html5/thumbnails/19.jpg)
Setting up the Experience
1. Learning Objectives
Define big picture concepts and goals for the research assistant and the office
2. Competencies
Clarify the skills research assistants will develop in pursuit of those goals
3. Outcomes
Students will demonstrate those skills in observable and meaningful ways
![Page 20: Developing Learning Outcomes for Student …...Developing Learning Outcomes for Student Employees Aligning assessment practice with student learning outcomes Office of Assessment,](https://reader036.fdocuments.net/reader036/viewer/2022062506/5f2277bfeba4943b90646a2e/html5/thumbnails/20.jpg)
1. Defining learning objectives
Examples of objectives defined by Office of
Assessment
• Be able to organize and make sense out of large data
sets
• Be able to use appropriate software packages to
analyze and report on relevant data
Examples of objectives defined by undergraduate
RA
• Develop skills and experiences in data analysis that support future job placement
• Apply knowledge learned in the classroom to answer
real world questions
![Page 21: Developing Learning Outcomes for Student …...Developing Learning Outcomes for Student Employees Aligning assessment practice with student learning outcomes Office of Assessment,](https://reader036.fdocuments.net/reader036/viewer/2022062506/5f2277bfeba4943b90646a2e/html5/thumbnails/21.jpg)
2. Clarifying competencies
What skills will the RA demonstrate as a result
of their work with the OATC? Examples:
• the ability to construct surveys using enterprise
survey software (Qualtrics)
• the ability to manage and manipulate large data
sets using Excel and SAS analytic software
• the ability to discuss patterns and trends observed
within the reports they produce
![Page 22: Developing Learning Outcomes for Student …...Developing Learning Outcomes for Student Employees Aligning assessment practice with student learning outcomes Office of Assessment,](https://reader036.fdocuments.net/reader036/viewer/2022062506/5f2277bfeba4943b90646a2e/html5/thumbnails/22.jpg)
3. Articulating learning outcomes
Specifically, how will the RA demonstrate movement towards their expected learning objectives and competencies? Examples:
• The RA will accurately update the pre and post program surveys for “Program A”
• The RA will produce a summary of bio-demographic data on “Program A” participants by sorting and merging “Program A” participant roster and aggregate student data files in SAS.
![Page 23: Developing Learning Outcomes for Student …...Developing Learning Outcomes for Student Employees Aligning assessment practice with student learning outcomes Office of Assessment,](https://reader036.fdocuments.net/reader036/viewer/2022062506/5f2277bfeba4943b90646a2e/html5/thumbnails/23.jpg)
Outcomes aligned with our
commitments
Institutional mission
Undergrad. research
[high impact practice]
The practice of assessment
![Page 24: Developing Learning Outcomes for Student …...Developing Learning Outcomes for Student Employees Aligning assessment practice with student learning outcomes Office of Assessment,](https://reader036.fdocuments.net/reader036/viewer/2022062506/5f2277bfeba4943b90646a2e/html5/thumbnails/24.jpg)
Organizing the learning
experience
How do we organize, scaffold,
and evaluate the RA learning
experience?
![Page 25: Developing Learning Outcomes for Student …...Developing Learning Outcomes for Student Employees Aligning assessment practice with student learning outcomes Office of Assessment,](https://reader036.fdocuments.net/reader036/viewer/2022062506/5f2277bfeba4943b90646a2e/html5/thumbnails/25.jpg)
Organizing the learning
experience
Vanderbilt University Center for Teaching
![Page 26: Developing Learning Outcomes for Student …...Developing Learning Outcomes for Student Employees Aligning assessment practice with student learning outcomes Office of Assessment,](https://reader036.fdocuments.net/reader036/viewer/2022062506/5f2277bfeba4943b90646a2e/html5/thumbnails/26.jpg)
Organizing the learning
experience
https://www.emporia.edu/studentlife/learning-and-assessment/guide/domains.html
![Page 27: Developing Learning Outcomes for Student …...Developing Learning Outcomes for Student Employees Aligning assessment practice with student learning outcomes Office of Assessment,](https://reader036.fdocuments.net/reader036/viewer/2022062506/5f2277bfeba4943b90646a2e/html5/thumbnails/27.jpg)
Organizing the learning
experience
Outcome Remember Understand Apply Analyze Evaluate Create
Outcome 1End of
trainingEnd of year
1End of year 2
Outcome 2End of
trainingEnd of year
1End of year 2
Outcome 3 End of term 2 End of term 2
![Page 28: Developing Learning Outcomes for Student …...Developing Learning Outcomes for Student Employees Aligning assessment practice with student learning outcomes Office of Assessment,](https://reader036.fdocuments.net/reader036/viewer/2022062506/5f2277bfeba4943b90646a2e/html5/thumbnails/28.jpg)
Organizing the learning
experience
Project 1 Project 2 Project 3 Project 4
Outcome 1 Remember Understand Analyze Evaluate
Outcome 2 Remember N/A Apply Analyze
Outcome 3 N/A Understand N/A Analyze
Outcome 4 N/A Apply Evaluate N/A
![Page 29: Developing Learning Outcomes for Student …...Developing Learning Outcomes for Student Employees Aligning assessment practice with student learning outcomes Office of Assessment,](https://reader036.fdocuments.net/reader036/viewer/2022062506/5f2277bfeba4943b90646a2e/html5/thumbnails/29.jpg)
Organizing the learning
experience
Project 1 Project 2 Project 3 Project 4
Outcome 1 Knowledge Application Analysis Synthesis
Outcome 2 Knowledge N/A Comprehension Analysis
Outcome 3 N/A Application N/A Analysis
Outcome 4 N/A Comprehension Synthesis N/A
Using a curriculum map:
1. Encourages alignment of RA
learning outcomes with specific
work opportunities
2. Provides structure for scaffolded
training and support
3. Provides structure for
developmental performance
evaluations
![Page 30: Developing Learning Outcomes for Student …...Developing Learning Outcomes for Student Employees Aligning assessment practice with student learning outcomes Office of Assessment,](https://reader036.fdocuments.net/reader036/viewer/2022062506/5f2277bfeba4943b90646a2e/html5/thumbnails/30.jpg)
Our RA employment model
Mentorship
Hiring and evaluation
Training
Project management
Required resources
![Page 31: Developing Learning Outcomes for Student …...Developing Learning Outcomes for Student Employees Aligning assessment practice with student learning outcomes Office of Assessment,](https://reader036.fdocuments.net/reader036/viewer/2022062506/5f2277bfeba4943b90646a2e/html5/thumbnails/31.jpg)
Our RA employment model
Mentorship
Hiring and evaluation
Training
Project management
Required resources
This is a learning experience –
be ready to discuss
challenges, provide insight,
develop solutions. We:
1. Provide clear descriptions
of work (background,
context, technical
requirements, expected
outcomes)
2. Provide regular,
constructive feedback
3. Expose RA to progressively
more challenging work
opportunities
![Page 32: Developing Learning Outcomes for Student …...Developing Learning Outcomes for Student Employees Aligning assessment practice with student learning outcomes Office of Assessment,](https://reader036.fdocuments.net/reader036/viewer/2022062506/5f2277bfeba4943b90646a2e/html5/thumbnails/32.jpg)
Our RA employment model
Mentorship
Hiring and evaluation
Training
Project management
Required resources
• Advertise at the
beginning of Fall term
• Primarily target 2nd year
students• Encourage 2 year
commitment
• Provide opportunity to
develop marketable skills
and gain specialized work
experience moving into
4th year
• Priority of specific skills and
qualifications may
depend on expected
projects. Majors vary.
![Page 33: Developing Learning Outcomes for Student …...Developing Learning Outcomes for Student Employees Aligning assessment practice with student learning outcomes Office of Assessment,](https://reader036.fdocuments.net/reader036/viewer/2022062506/5f2277bfeba4943b90646a2e/html5/thumbnails/33.jpg)
Our RA employment model
Mentorship
Hiring and evaluation
Training
Project management
Required resources
Develop foundational skills
for our work.
Expect resourcefulness, effective help-seeking,
creative problem-solving.
Develop training modules
and readings for key
applications, including:
• Qualtrics
• SAS
• Excel
![Page 34: Developing Learning Outcomes for Student …...Developing Learning Outcomes for Student Employees Aligning assessment practice with student learning outcomes Office of Assessment,](https://reader036.fdocuments.net/reader036/viewer/2022062506/5f2277bfeba4943b90646a2e/html5/thumbnails/34.jpg)
Our RA employment model
Mentorship
Hiring and evaluation
Training
Project management
Required resources
Start small and prioritize.
Approach supervision as a
teaching/learning
experience (not sink or
swim).
Assign projects and tasks in
an intentional way.
Put projects into context.
Provide follow-up.
![Page 35: Developing Learning Outcomes for Student …...Developing Learning Outcomes for Student Employees Aligning assessment practice with student learning outcomes Office of Assessment,](https://reader036.fdocuments.net/reader036/viewer/2022062506/5f2277bfeba4943b90646a2e/html5/thumbnails/35.jpg)
Our RA employment model
Mentorship
Hiring and evaluation
Training
Project management
Required resources
Time for quality mentorship
• Project planning
• Effective feedback
Salaries
• $10/hour in year 1
• Possibility of increases over
time as responsibilities
increase
Space
• Dedicated computer and
reasonable office space
![Page 36: Developing Learning Outcomes for Student …...Developing Learning Outcomes for Student Employees Aligning assessment practice with student learning outcomes Office of Assessment,](https://reader036.fdocuments.net/reader036/viewer/2022062506/5f2277bfeba4943b90646a2e/html5/thumbnails/36.jpg)
Institutional mission
Undergrad. research
[high impact practice]
The practice of assessment
What learning
outcomes can
we develop at
this
intersection?
Our Commitments Aligned
![Page 37: Developing Learning Outcomes for Student …...Developing Learning Outcomes for Student Employees Aligning assessment practice with student learning outcomes Office of Assessment,](https://reader036.fdocuments.net/reader036/viewer/2022062506/5f2277bfeba4943b90646a2e/html5/thumbnails/37.jpg)
Institutional mission
Undergrad. research
[high impact practice]
The practice of assessment
Sound like a lot
of work! What
benefits do we
see?
Our Commitments Aligned
![Page 38: Developing Learning Outcomes for Student …...Developing Learning Outcomes for Student Employees Aligning assessment practice with student learning outcomes Office of Assessment,](https://reader036.fdocuments.net/reader036/viewer/2022062506/5f2277bfeba4943b90646a2e/html5/thumbnails/38.jpg)
Benefits for our office:
InnovationRAs bring a variety of novel skills (e.g., Visual Basic) and
experiences (e.g., social networking platforms) which inform our
work and expand our overall capabilities.
InsightRAs have lent important student-level perspectives to research
design and execution.
Highly skilled workSmart, hard-working, ambitious, autonomous workers and thinkers.
Bottom-line:
We can get more done with fewer full time staff by providing
learning and professional development opportunities for RAs
– for whom our work is a compelling intellectual challenge.
![Page 39: Developing Learning Outcomes for Student …...Developing Learning Outcomes for Student Employees Aligning assessment practice with student learning outcomes Office of Assessment,](https://reader036.fdocuments.net/reader036/viewer/2022062506/5f2277bfeba4943b90646a2e/html5/thumbnails/39.jpg)
For discussion:
How might an undergraduate RA or student employment model fit in your office/organization? What challenges might you face?
What 2-3 actionable steps could you take on your campus to promote a similar model?
What are some additional ways to promote the mission and culture of your institution in conjunction with the work you’re currently doing?