Analyzing and Improving College Teaching: Here’s an IDEA
-
Upload
oprah-stafford -
Category
Documents
-
view
27 -
download
2
description
Transcript of Analyzing and Improving College Teaching: Here’s an IDEA
![Page 1: Analyzing and Improving College Teaching: Here’s an IDEA](https://reader036.fdocuments.net/reader036/viewer/2022062421/56812a43550346895d8d6e7c/html5/thumbnails/1.jpg)
Analyzing and Improving Analyzing and Improving College Teaching: Here’s College Teaching: Here’s an IDEAan IDEA
Alan C. Lacy, Associate DeanCollege of Applied Science and TechnologyIllinois State University
![Page 2: Analyzing and Improving College Teaching: Here’s an IDEA](https://reader036.fdocuments.net/reader036/viewer/2022062421/56812a43550346895d8d6e7c/html5/thumbnails/2.jpg)
OverviewOverviewAssessment of Teaching
◦Components of Teaching◦Sources of Evaluation
The IDEA Student Rating System◦Mission of IDEA◦Administration of IDEA◦Using the results from IDEA
![Page 3: Analyzing and Improving College Teaching: Here’s an IDEA](https://reader036.fdocuments.net/reader036/viewer/2022062421/56812a43550346895d8d6e7c/html5/thumbnails/3.jpg)
ASSESSMENT OF ASSESSMENT OF TEACHINGTEACHING
![Page 4: Analyzing and Improving College Teaching: Here’s an IDEA](https://reader036.fdocuments.net/reader036/viewer/2022062421/56812a43550346895d8d6e7c/html5/thumbnails/4.jpg)
![Page 5: Analyzing and Improving College Teaching: Here’s an IDEA](https://reader036.fdocuments.net/reader036/viewer/2022062421/56812a43550346895d8d6e7c/html5/thumbnails/5.jpg)
How well did I teach it?How well did I teach it?What are the components of effective teaching?
Who should assess these components?
![Page 6: Analyzing and Improving College Teaching: Here’s an IDEA](https://reader036.fdocuments.net/reader036/viewer/2022062421/56812a43550346895d8d6e7c/html5/thumbnails/6.jpg)
Components of TeachingComponents of TeachingContent ExpertiseCourse DesignInstructional DeliveryCourse Management
![Page 7: Analyzing and Improving College Teaching: Here’s an IDEA](https://reader036.fdocuments.net/reader036/viewer/2022062421/56812a43550346895d8d6e7c/html5/thumbnails/7.jpg)
Sources of AssessmentSources of AssessmentStudentsPeersAdministratorsSelf
![Page 8: Analyzing and Improving College Teaching: Here’s an IDEA](https://reader036.fdocuments.net/reader036/viewer/2022062421/56812a43550346895d8d6e7c/html5/thumbnails/8.jpg)
1 = not important 1 = not important 2 = of minor importance2 = of minor importance3 = somewhat important 3 = somewhat important 4 = very important 4 = very important CJ- Cannot judgeCJ- Cannot judge The appropriateness of an
instructors course objectives Faculty member’s contributions to
course/curriculum development Severity, laxness, and consistency
of grading standards
![Page 9: Analyzing and Improving College Teaching: Here’s an IDEA](https://reader036.fdocuments.net/reader036/viewer/2022062421/56812a43550346895d8d6e7c/html5/thumbnails/9.jpg)
1 = not important 1 = not important 2 = of minor importance2 = of minor importance3 = somewhat important 3 = somewhat important 4 = very important 4 = very important CJ- Cannot judgeCJ- Cannot judge The degree to which subject
matter presented is balanced and current
Relevance and quality of assessment and testing methods
Faculty member’s disciplinary knowledge/skills
![Page 10: Analyzing and Improving College Teaching: Here’s an IDEA](https://reader036.fdocuments.net/reader036/viewer/2022062421/56812a43550346895d8d6e7c/html5/thumbnails/10.jpg)
Students are not qualified to Students are not qualified to assess:assess:Faculty expertiseAppropriateness of goals,
content, and organization of course
Materials used in deliveryHow student work is evaluated,
including grading practices
![Page 11: Analyzing and Improving College Teaching: Here’s an IDEA](https://reader036.fdocuments.net/reader036/viewer/2022062421/56812a43550346895d8d6e7c/html5/thumbnails/11.jpg)
Nor are students qualified to Nor are students qualified to assess:assess:Support for departmental effortsAssistance to colleaguesContributing to a positive
atmosphere
![Page 12: Analyzing and Improving College Teaching: Here’s an IDEA](https://reader036.fdocuments.net/reader036/viewer/2022062421/56812a43550346895d8d6e7c/html5/thumbnails/12.jpg)
Student are qualified to Student are qualified to assess:assess:Instructional DeliveryCourse DesignInstructor AvailabilityProgress To Course Objectives
![Page 13: Analyzing and Improving College Teaching: Here’s an IDEA](https://reader036.fdocuments.net/reader036/viewer/2022062421/56812a43550346895d8d6e7c/html5/thumbnails/13.jpg)
SOURCES
COMPONENTS
Students Peers Chair Self
Content Expertise
No Yes/No Yes Yes
CourseDesign
Yes Yes No Yes
Instructional Delivery
Yes No No Yes
Course Management
No No Yes Yes
Assessment MatrixAssessment Matrix
![Page 14: Analyzing and Improving College Teaching: Here’s an IDEA](https://reader036.fdocuments.net/reader036/viewer/2022062421/56812a43550346895d8d6e7c/html5/thumbnails/14.jpg)
THE IDEA STUDENT THE IDEA STUDENT RATING SYSTEM RATING SYSTEM
![Page 15: Analyzing and Improving College Teaching: Here’s an IDEA](https://reader036.fdocuments.net/reader036/viewer/2022062421/56812a43550346895d8d6e7c/html5/thumbnails/15.jpg)
What is IDEA?What is IDEA?Individual Development &
Educational Assessment (IDEA) Student Rating System
The IDEA CenterKansas State UniversityManhattan, Kansas http://www.idea.ksu.edu/
![Page 16: Analyzing and Improving College Teaching: Here’s an IDEA](https://reader036.fdocuments.net/reader036/viewer/2022062421/56812a43550346895d8d6e7c/html5/thumbnails/16.jpg)
Mission of the IDEA CenterMission of the IDEA CenterTo serve colleges and universities
committed to improving learning, teaching, and leadership performance
![Page 17: Analyzing and Improving College Teaching: Here’s an IDEA](https://reader036.fdocuments.net/reader036/viewer/2022062421/56812a43550346895d8d6e7c/html5/thumbnails/17.jpg)
IDEA Formal Student IDEA Formal Student EvaluationEvaluationDeveloped at Kansas State
UniversityBased on research on teachingHas national normsIs tailored to instructor and courseVery detailed and helpful reports
(Formative/Summative)Currently utilized at 275 institutions
◦(8 years ago – 110)
![Page 18: Analyzing and Improving College Teaching: Here’s an IDEA](https://reader036.fdocuments.net/reader036/viewer/2022062421/56812a43550346895d8d6e7c/html5/thumbnails/18.jpg)
IDEA – Improvement of IDEA – Improvement of Student LearningStudent Learning
Diagnostic tool to guide improvement
Evaluative tool to assess teaching effectiveness
![Page 19: Analyzing and Improving College Teaching: Here’s an IDEA](https://reader036.fdocuments.net/reader036/viewer/2022062421/56812a43550346895d8d6e7c/html5/thumbnails/19.jpg)
Improvement of Student Improvement of Student LearningLearningStudent ratings have positive
impact if….◦The instrument:
Is learning focused Provides a diagnostic
◦Emphasis on summative evaluation is appropriate 30-50% of overall evaluation of teaching 6-8 representative classes (more if n<10)
◦Faculty trust the process
![Page 20: Analyzing and Improving College Teaching: Here’s an IDEA](https://reader036.fdocuments.net/reader036/viewer/2022062421/56812a43550346895d8d6e7c/html5/thumbnails/20.jpg)
Improvement of Student Improvement of Student LearningLearningCampus and college culture has
great impact.◦Is teaching excellence a top priority?◦Are student ratings given an
appropriate weight in overall evaluation of teaching?
◦Does the institution provide resources to aid those seeking to improve instruction?
◦Is credible support for improvement available?
![Page 21: Analyzing and Improving College Teaching: Here’s an IDEA](https://reader036.fdocuments.net/reader036/viewer/2022062421/56812a43550346895d8d6e7c/html5/thumbnails/21.jpg)
Other Teaching ActivitiesOther Teaching ActivitiesTeaching Lab ClassesCurriculum DevelopmentMentoring StudentsSupervising Field Experiences
![Page 22: Analyzing and Improving College Teaching: Here’s an IDEA](https://reader036.fdocuments.net/reader036/viewer/2022062421/56812a43550346895d8d6e7c/html5/thumbnails/22.jpg)
Student Learning Model Student Learning Model AssumptionsAssumptionsTypes of learning must reflect
instructor’s purposeEffectiveness determined by
student progress on objectives stressed by the instructor
Specific teaching behaviors influence certain types of student progress under certain circumstances
![Page 23: Analyzing and Improving College Teaching: Here’s an IDEA](https://reader036.fdocuments.net/reader036/viewer/2022062421/56812a43550346895d8d6e7c/html5/thumbnails/23.jpg)
IDEA – Assessment of IDEA – Assessment of TeachingTeaching
Pilot tested at ISU in 2001-200240 Tenure/Tenure track Faculty975 studentsFully implemented now
![Page 24: Analyzing and Improving College Teaching: Here’s an IDEA](https://reader036.fdocuments.net/reader036/viewer/2022062421/56812a43550346895d8d6e7c/html5/thumbnails/24.jpg)
Administration of the IDEA Administration of the IDEA SystemSystemComplete Faculty Information
Forms (FIF)Administering Student Course
EvaluationsShip Evaluations to IDEADistribute IDEA Results to
Departments
![Page 25: Analyzing and Improving College Teaching: Here’s an IDEA](https://reader036.fdocuments.net/reader036/viewer/2022062421/56812a43550346895d8d6e7c/html5/thumbnails/25.jpg)
Costs for IDEACosts for IDEAStaff timeMonetary
◦$0.13 per course evaluation form◦Shipping costs◦$6 per class◦Small charges for reports
![Page 26: Analyzing and Improving College Teaching: Here’s an IDEA](https://reader036.fdocuments.net/reader036/viewer/2022062421/56812a43550346895d8d6e7c/html5/thumbnails/26.jpg)
Fall 2008 AdministrationFall 2008 Administration
Assessed 400 classes in 7 departments
11,500 student response forms$3,224 total cost
◦Purchase of forms ◦Processing fees
![Page 27: Analyzing and Improving College Teaching: Here’s an IDEA](https://reader036.fdocuments.net/reader036/viewer/2022062421/56812a43550346895d8d6e7c/html5/thumbnails/27.jpg)
Rationale for UseRationale for UseShows commitment to teachingProvides validated course
evaluation instrument based on research
Provides consistency across the College
Summative aspects aid personnel decisions
Formative aspects aid professional development
![Page 28: Analyzing and Improving College Teaching: Here’s an IDEA](https://reader036.fdocuments.net/reader036/viewer/2022062421/56812a43550346895d8d6e7c/html5/thumbnails/28.jpg)
![Page 29: Analyzing and Improving College Teaching: Here’s an IDEA](https://reader036.fdocuments.net/reader036/viewer/2022062421/56812a43550346895d8d6e7c/html5/thumbnails/29.jpg)
![Page 30: Analyzing and Improving College Teaching: Here’s an IDEA](https://reader036.fdocuments.net/reader036/viewer/2022062421/56812a43550346895d8d6e7c/html5/thumbnails/30.jpg)
Using the IDEA Results Using the IDEA Results Fall 2008 College Data Compared
to the IDEA Database
December 2008
![Page 31: Analyzing and Improving College Teaching: Here’s an IDEA](https://reader036.fdocuments.net/reader036/viewer/2022062421/56812a43550346895d8d6e7c/html5/thumbnails/31.jpg)
Adjusted ScoresAdjusted ScoresAccounts for factors beyond
instructor’s controlUses regression equation
◦Student work habits (#43)◦Student motivation (#39)◦Class size (enrollment, FIF)◦Student effort (multiple items)◦Course difficulty (multiple items)Nothing like this in homegrown instruments
![Page 32: Analyzing and Improving College Teaching: Here’s an IDEA](https://reader036.fdocuments.net/reader036/viewer/2022062421/56812a43550346895d8d6e7c/html5/thumbnails/32.jpg)
Using the ResultsUsing the ResultsOutcomes
◦Student LearningProcess
◦Teaching Methods◦Instructional Approach◦Course and Curriculum Emphasis
Program Assessment Inputs◦Student Background◦Student Characteristics
![Page 33: Analyzing and Improving College Teaching: Here’s an IDEA](https://reader036.fdocuments.net/reader036/viewer/2022062421/56812a43550346895d8d6e7c/html5/thumbnails/33.jpg)
Guiding Principles to Formal Guiding Principles to Formal Evaluation DecisionsEvaluation DecisionsComprehensive and systematicValid, summative informationFormative information for
improvementConsider teaching componentsMultiple sources of assessmentConsider scholarship on best
practicesFair and equitable
![Page 34: Analyzing and Improving College Teaching: Here’s an IDEA](https://reader036.fdocuments.net/reader036/viewer/2022062421/56812a43550346895d8d6e7c/html5/thumbnails/34.jpg)
Thank you for your Thank you for your attention!attention!
Any Questions?