Cutting the Commute: Assess Authentically and Still Arrive on Time Toni Carter Juliet Rumble Auburn...
-
Upload
teresa-holland -
Category
Documents
-
view
213 -
download
0
Transcript of Cutting the Commute: Assess Authentically and Still Arrive on Time Toni Carter Juliet Rumble Auburn...
![Page 1: Cutting the Commute: Assess Authentically and Still Arrive on Time Toni Carter Juliet Rumble Auburn University Libraries LOEX of the West, June 2012.](https://reader036.fdocuments.net/reader036/viewer/2022070409/56649e915503460f94b9638d/html5/thumbnails/1.jpg)
Cutting the Commute: Assess Authentically and Still
Arrive on Time
Toni Carter
Juliet RumbleAuburn University Libraries
LOEX of the West, June 2012
![Page 2: Cutting the Commute: Assess Authentically and Still Arrive on Time Toni Carter Juliet Rumble Auburn University Libraries LOEX of the West, June 2012.](https://reader036.fdocuments.net/reader036/viewer/2022070409/56649e915503460f94b9638d/html5/thumbnails/2.jpg)
Attribution: The Brain ToadLicense Plate Maphttp://creativecommons.org/licenses/by-nc-sa/2.0/http://www.flickr.com/photos/braintoad/2372419513/
• Authentic assessment…it’s not “extra”
• Examples of what we’ve done & what you can do
• “Closing the loop”
• Lessons learned
• Practical tools for collecting assessment data
• Questions?
Roadmap for Today
![Page 3: Cutting the Commute: Assess Authentically and Still Arrive on Time Toni Carter Juliet Rumble Auburn University Libraries LOEX of the West, June 2012.](https://reader036.fdocuments.net/reader036/viewer/2022070409/56649e915503460f94b9638d/html5/thumbnails/3.jpg)
Fra
mew
ork
![Page 4: Cutting the Commute: Assess Authentically and Still Arrive on Time Toni Carter Juliet Rumble Auburn University Libraries LOEX of the West, June 2012.](https://reader036.fdocuments.net/reader036/viewer/2022070409/56649e915503460f94b9638d/html5/thumbnails/4.jpg)
AU Libraries Instruction Program
Library sessions of all types and at all levels:
• Library tours & orientations
• Freshman Year Experience
• Core Curriculum classes --English Composition--Communication
• Upper-division and graduate level sessions
• For-credit course (Chemical Literature)
• 642 sessions taught in 2011
![Page 5: Cutting the Commute: Assess Authentically and Still Arrive on Time Toni Carter Juliet Rumble Auburn University Libraries LOEX of the West, June 2012.](https://reader036.fdocuments.net/reader036/viewer/2022070409/56649e915503460f94b9638d/html5/thumbnails/5.jpg)
Student centered learning
Our focus on student learning drives instructional design:
• What do you want the student to be able to do? (learning outcome)
• What does the student need to know in order to do this well? (curriculum)
• What activity will facilitate student learning? (pedagogy)
• How will the student demonstrate the learning? (assessment)
• How will I know the student has done this well? (evaluation criteria)
(from Gilchrist, Debra. Outcomes assessment from the inside out. LMDC of Washington,1999.)
![Page 6: Cutting the Commute: Assess Authentically and Still Arrive on Time Toni Carter Juliet Rumble Auburn University Libraries LOEX of the West, June 2012.](https://reader036.fdocuments.net/reader036/viewer/2022070409/56649e915503460f94b9638d/html5/thumbnails/6.jpg)
The assessment cycle
5 questions for Assessment DesignAdapted from Deb Gilchrist
What do you want the student to be able to do?
What does the student need to know in order to do this well?
What activities will facilitate student learning?
How will the student demonstrate the learning?
How will I know the student has done this well?
![Page 7: Cutting the Commute: Assess Authentically and Still Arrive on Time Toni Carter Juliet Rumble Auburn University Libraries LOEX of the West, June 2012.](https://reader036.fdocuments.net/reader036/viewer/2022070409/56649e915503460f94b9638d/html5/thumbnails/7.jpg)
Building a culture of assessment
We gather data from a variety of different assessment tools:
• Institutional level: Project SAILS
• Program Level: --English Department: random sampling of essays and works cited lists--School of Nursing: (Theoretical Concepts of Professional Nursing) Review of work cited lists
• Individual classes: --Peer evaluations--Student evaluation of teaching--Informal assessments: e.g., one minute papers, muddiest point
![Page 8: Cutting the Commute: Assess Authentically and Still Arrive on Time Toni Carter Juliet Rumble Auburn University Libraries LOEX of the West, June 2012.](https://reader036.fdocuments.net/reader036/viewer/2022070409/56649e915503460f94b9638d/html5/thumbnails/8.jpg)
Designing IL Assessment
Key considerations:
• The information literate person can DO things;determine the nature and scope of the information need
access information effectively
evaluate information
use information to accomplish a specific purpose
• These activities involve higher order thinking that goes beyond mere recall of facts and concepts
![Page 9: Cutting the Commute: Assess Authentically and Still Arrive on Time Toni Carter Juliet Rumble Auburn University Libraries LOEX of the West, June 2012.](https://reader036.fdocuments.net/reader036/viewer/2022070409/56649e915503460f94b9638d/html5/thumbnails/9.jpg)
Show us what you can do…
• Active learning pedagogies ask students to DO something.
• We are asking our students to interact with information by:
-- defining their research project
-- applying a search strategy
-- evaluating the sources they retrieve
![Page 10: Cutting the Commute: Assess Authentically and Still Arrive on Time Toni Carter Juliet Rumble Auburn University Libraries LOEX of the West, June 2012.](https://reader036.fdocuments.net/reader036/viewer/2022070409/56649e915503460f94b9638d/html5/thumbnails/10.jpg)
Our “aha!” moment
• Why not assess student performance of these active learning tasks?
• This type of assessment is part of the teaching and learning process--not something extra
![Page 11: Cutting the Commute: Assess Authentically and Still Arrive on Time Toni Carter Juliet Rumble Auburn University Libraries LOEX of the West, June 2012.](https://reader036.fdocuments.net/reader036/viewer/2022070409/56649e915503460f94b9638d/html5/thumbnails/11.jpg)
Traditional Assessment–VS– Authentic Assessment
• Selecting a response
-vs-
Performing a task
• Contrived test environment
-vs-
Real world problem-solving
• Recall of concepts
-vs–
Applying knowledge
![Page 12: Cutting the Commute: Assess Authentically and Still Arrive on Time Toni Carter Juliet Rumble Auburn University Libraries LOEX of the West, June 2012.](https://reader036.fdocuments.net/reader036/viewer/2022070409/56649e915503460f94b9638d/html5/thumbnails/12.jpg)
Student Drivers
Attribution: teamstickergiantNew Drivershttp://creativecommons.org/licenses/by/2.0/http://www.flickr.com/photos/stickergiant/5204700407/
![Page 13: Cutting the Commute: Assess Authentically and Still Arrive on Time Toni Carter Juliet Rumble Auburn University Libraries LOEX of the West, June 2012.](https://reader036.fdocuments.net/reader036/viewer/2022070409/56649e915503460f94b9638d/html5/thumbnails/13.jpg)
• ENGL1120 – 3 visits to the library
• Assessments have focused on specific learning outcomes central to seeking and using information: Two we will discuss today:
--Identifying keywords that describe a research topic--Evaluating sources of information
• Students record their thought process on worksheets which we collect --We encourage students to treat worksheets as working
documents to revisit and revise-- “Carbonless” carbon paper allows students to share a copy of
their work with us
• Student performance is evaluated according to criteria set out in a rubric
What are we doing and How are we doing it?
![Page 14: Cutting the Commute: Assess Authentically and Still Arrive on Time Toni Carter Juliet Rumble Auburn University Libraries LOEX of the West, June 2012.](https://reader036.fdocuments.net/reader036/viewer/2022070409/56649e915503460f94b9638d/html5/thumbnails/14.jpg)
Keywording
Keywording worksheets address ACRL IL Standard 2
The information literate student accesses needed information effectively and efficiently.
Performance Indicator 2: 2.: The information literate student constructs and
implements effectively-designed search strategies.
Outcome : Identifies keywords, synonyms and related terms for the information needed
![Page 15: Cutting the Commute: Assess Authentically and Still Arrive on Time Toni Carter Juliet Rumble Auburn University Libraries LOEX of the West, June 2012.](https://reader036.fdocuments.net/reader036/viewer/2022070409/56649e915503460f94b9638d/html5/thumbnails/15.jpg)
![Page 16: Cutting the Commute: Assess Authentically and Still Arrive on Time Toni Carter Juliet Rumble Auburn University Libraries LOEX of the West, June 2012.](https://reader036.fdocuments.net/reader036/viewer/2022070409/56649e915503460f94b9638d/html5/thumbnails/16.jpg)
Evaluating Sources
Evaluating sources worksheets address ACRL IL Standard 1The information literate student determines the nature and extent of the information needed.
Performance Indicator 2:2.: The information literate student identifies a variety of
types and formats of potential sources for information. Outcome : Identifies the purpose and
audience of potential resources (e.g., popular vs. scholarly, current vs. historical)
![Page 17: Cutting the Commute: Assess Authentically and Still Arrive on Time Toni Carter Juliet Rumble Auburn University Libraries LOEX of the West, June 2012.](https://reader036.fdocuments.net/reader036/viewer/2022070409/56649e915503460f94b9638d/html5/thumbnails/17.jpg)
![Page 18: Cutting the Commute: Assess Authentically and Still Arrive on Time Toni Carter Juliet Rumble Auburn University Libraries LOEX of the West, June 2012.](https://reader036.fdocuments.net/reader036/viewer/2022070409/56649e915503460f94b9638d/html5/thumbnails/18.jpg)
Closing the loop
Attribution: mnapoleonRace_start_1http://www.flickr.com/photos/cusegoyle/2045457261/http://creativecommons.org/licenses/by/2.0/
![Page 19: Cutting the Commute: Assess Authentically and Still Arrive on Time Toni Carter Juliet Rumble Auburn University Libraries LOEX of the West, June 2012.](https://reader036.fdocuments.net/reader036/viewer/2022070409/56649e915503460f94b9638d/html5/thumbnails/19.jpg)
Not choosing
the correct
keywords
![Page 20: Cutting the Commute: Assess Authentically and Still Arrive on Time Toni Carter Juliet Rumble Auburn University Libraries LOEX of the West, June 2012.](https://reader036.fdocuments.net/reader036/viewer/2022070409/56649e915503460f94b9638d/html5/thumbnails/20.jpg)
![Page 21: Cutting the Commute: Assess Authentically and Still Arrive on Time Toni Carter Juliet Rumble Auburn University Libraries LOEX of the West, June 2012.](https://reader036.fdocuments.net/reader036/viewer/2022070409/56649e915503460f94b9638d/html5/thumbnails/21.jpg)
![Page 22: Cutting the Commute: Assess Authentically and Still Arrive on Time Toni Carter Juliet Rumble Auburn University Libraries LOEX of the West, June 2012.](https://reader036.fdocuments.net/reader036/viewer/2022070409/56649e915503460f94b9638d/html5/thumbnails/22.jpg)
Omitting crucial
keywords
![Page 23: Cutting the Commute: Assess Authentically and Still Arrive on Time Toni Carter Juliet Rumble Auburn University Libraries LOEX of the West, June 2012.](https://reader036.fdocuments.net/reader036/viewer/2022070409/56649e915503460f94b9638d/html5/thumbnails/23.jpg)
![Page 24: Cutting the Commute: Assess Authentically and Still Arrive on Time Toni Carter Juliet Rumble Auburn University Libraries LOEX of the West, June 2012.](https://reader036.fdocuments.net/reader036/viewer/2022070409/56649e915503460f94b9638d/html5/thumbnails/24.jpg)
![Page 25: Cutting the Commute: Assess Authentically and Still Arrive on Time Toni Carter Juliet Rumble Auburn University Libraries LOEX of the West, June 2012.](https://reader036.fdocuments.net/reader036/viewer/2022070409/56649e915503460f94b9638d/html5/thumbnails/25.jpg)
Scr
atch
es &
Den
ts
Attribution: net_efektDented carhttp://www.flickr.com/photos/wheatfields/326048477/http://creativecommons.org/licenses/by-nc-sa/2.0/
RUBRICS
![Page 26: Cutting the Commute: Assess Authentically and Still Arrive on Time Toni Carter Juliet Rumble Auburn University Libraries LOEX of the West, June 2012.](https://reader036.fdocuments.net/reader036/viewer/2022070409/56649e915503460f94b9638d/html5/thumbnails/26.jpg)
• Analytic/Task-specific
• Keywords/Synonyms : 5-point scale• Evaluating Sources: 3-point scale
• Defined level of performance expected at each point of the scale – good for the majority of papers, but…
Some student work didn’t quite fit into any of the levels
Common challenge!
Expect trial and error
So what about the rubrics?
![Page 27: Cutting the Commute: Assess Authentically and Still Arrive on Time Toni Carter Juliet Rumble Auburn University Libraries LOEX of the West, June 2012.](https://reader036.fdocuments.net/reader036/viewer/2022070409/56649e915503460f94b9638d/html5/thumbnails/27.jpg)
Keyw
ords/Synonym
s
Rubric #1
![Page 28: Cutting the Commute: Assess Authentically and Still Arrive on Time Toni Carter Juliet Rumble Auburn University Libraries LOEX of the West, June 2012.](https://reader036.fdocuments.net/reader036/viewer/2022070409/56649e915503460f94b9638d/html5/thumbnails/28.jpg)
Keyw
ords/Synonym
s
Rubric # 2
![Page 29: Cutting the Commute: Assess Authentically and Still Arrive on Time Toni Carter Juliet Rumble Auburn University Libraries LOEX of the West, June 2012.](https://reader036.fdocuments.net/reader036/viewer/2022070409/56649e915503460f94b9638d/html5/thumbnails/29.jpg)
Keyw
ords/Synonym
s
Ideas for Rubric # 3
![Page 30: Cutting the Commute: Assess Authentically and Still Arrive on Time Toni Carter Juliet Rumble Auburn University Libraries LOEX of the West, June 2012.](https://reader036.fdocuments.net/reader036/viewer/2022070409/56649e915503460f94b9638d/html5/thumbnails/30.jpg)
![Page 31: Cutting the Commute: Assess Authentically and Still Arrive on Time Toni Carter Juliet Rumble Auburn University Libraries LOEX of the West, June 2012.](https://reader036.fdocuments.net/reader036/viewer/2022070409/56649e915503460f94b9638d/html5/thumbnails/31.jpg)
Tools in the Glovebox
Attribution: jrhodeToolbox full of toolshttp://www.flickr.com/photos/jrhode/4632887921/http://creativecommons.org/licenses/by-nc-sa/2.0/
![Page 32: Cutting the Commute: Assess Authentically and Still Arrive on Time Toni Carter Juliet Rumble Auburn University Libraries LOEX of the West, June 2012.](https://reader036.fdocuments.net/reader036/viewer/2022070409/56649e915503460f94b9638d/html5/thumbnails/32.jpg)
Assessment Toolbox• Carbonless paper to capture student responses
• iClickers
• Google forms for assessment data entry
• Assessment resources LibGuide (http://libguides.auburn.edu/studentlearningassessment)
![Page 33: Cutting the Commute: Assess Authentically and Still Arrive on Time Toni Carter Juliet Rumble Auburn University Libraries LOEX of the West, June 2012.](https://reader036.fdocuments.net/reader036/viewer/2022070409/56649e915503460f94b9638d/html5/thumbnails/33.jpg)
In conclusion…• Strategy working well
• More activities
• Doesn’t need to be perfect
• Doesn’t need to be complicated
![Page 34: Cutting the Commute: Assess Authentically and Still Arrive on Time Toni Carter Juliet Rumble Auburn University Libraries LOEX of the West, June 2012.](https://reader036.fdocuments.net/reader036/viewer/2022070409/56649e915503460f94b9638d/html5/thumbnails/34.jpg)
Thank You! Questions??
Toni Carter
Juliet Rumble