Final Report. Dev/Prototype Fall 2011 System Testing (Early) Spring 2012 Pilot Test w/ Selected...

15
Student Evaluation of Instruction Final Report

Transcript of Final Report. Dev/Prototype Fall 2011 System Testing (Early) Spring 2012 Pilot Test w/ Selected...

Page 1: Final Report. Dev/Prototype Fall 2011 System Testing (Early) Spring 2012 Pilot Test w/ Selected Departments Spring 2012 Trainings for Academic Chairs.

Student Evaluation of Instruction

Final Report

Page 2: Final Report. Dev/Prototype Fall 2011 System Testing (Early) Spring 2012 Pilot Test w/ Selected Departments Spring 2012 Trainings for Academic Chairs.

Dev/Prototype

Fall 2011

System Testing

(Early) Spring 2012

Pilot Test w/ Selected

Departments

Spring 2012

Trainings for Academic Chairs

and ADA's

August 15, 2012

September 19, 2012

Project Timeline

Page 3: Final Report. Dev/Prototype Fall 2011 System Testing (Early) Spring 2012 Pilot Test w/ Selected Departments Spring 2012 Trainings for Academic Chairs.

292 class sections (from various departments that participated: Econ, Math, Psych, Sociology, etc.)

5,016 students 9,710 evaluations were sent out and 6,855

were submitted by students (~71% response rate)

Spring 2012 Pilot Outcome

Page 4: Final Report. Dev/Prototype Fall 2011 System Testing (Early) Spring 2012 Pilot Test w/ Selected Departments Spring 2012 Trainings for Academic Chairs.

Similar to the original format Same scoring method (fractional median). Reports are broken down by

◦ Instructor/class/section◦ Ranked faculty aggregate◦ IAS aggregate◦ Department overall

PDF format◦ Departments can choose to email or print

SEI Reports Format

Page 5: Final Report. Dev/Prototype Fall 2011 System Testing (Early) Spring 2012 Pilot Test w/ Selected Departments Spring 2012 Trainings for Academic Chairs.

An email will be sent to all enrolled students for each class.

Notify Student

Page 6: Final Report. Dev/Prototype Fall 2011 System Testing (Early) Spring 2012 Pilot Test w/ Selected Departments Spring 2012 Trainings for Academic Chairs.

Once logged in, the student will see a summary of all classes awaiting evaluation.

Course Evaluations

Page 7: Final Report. Dev/Prototype Fall 2011 System Testing (Early) Spring 2012 Pilot Test w/ Selected Departments Spring 2012 Trainings for Academic Chairs.

Students will receive the first email prompt at the start of the 13th week for 14 week courses◦ Class End Date is used when calculating SEI

start/end dates for 7 week classes.◦ Dynamic session class dates are set manually.

Two reminders will be sent. The process will occur over 10 days.

Timing?

Page 8: Final Report. Dev/Prototype Fall 2011 System Testing (Early) Spring 2012 Pilot Test w/ Selected Departments Spring 2012 Trainings for Academic Chairs.

What the student will see after clicking on an individual course

Page 9: Final Report. Dev/Prototype Fall 2011 System Testing (Early) Spring 2012 Pilot Test w/ Selected Departments Spring 2012 Trainings for Academic Chairs.

The standard set of six questions approved by Faculty Senate is fixed for all questionnaires.

Setup & Administration

Page 10: Final Report. Dev/Prototype Fall 2011 System Testing (Early) Spring 2012 Pilot Test w/ Selected Departments Spring 2012 Trainings for Academic Chairs.

Additional “evaluation” templates can be created.

Department chairs can create a questionnaire that incorporates the standard questions + additional questions defined by the department.

Setup & Administration

Page 11: Final Report. Dev/Prototype Fall 2011 System Testing (Early) Spring 2012 Pilot Test w/ Selected Departments Spring 2012 Trainings for Academic Chairs.
Page 12: Final Report. Dev/Prototype Fall 2011 System Testing (Early) Spring 2012 Pilot Test w/ Selected Departments Spring 2012 Trainings for Academic Chairs.

Adding a question to the repository Supported question types:

◦ 5 point rating (Strongly Agree Strongly Disagree)

◦ Open ended◦ Multiple Choice

Setup & Administration

Page 13: Final Report. Dev/Prototype Fall 2011 System Testing (Early) Spring 2012 Pilot Test w/ Selected Departments Spring 2012 Trainings for Academic Chairs.

The standard SEI will automatically be generated for each course.

Chairs will be able to assign a different questionnaire template◦ If the department has additional questions they

ask of each class◦ If the department has a subsection of classes that

receive a different questionnaire (e.g., lab courses) Chairs may also remove the SEI from

courses that should not be assessed (e.g. independent studies).

Setup & Administration

Page 14: Final Report. Dev/Prototype Fall 2011 System Testing (Early) Spring 2012 Pilot Test w/ Selected Departments Spring 2012 Trainings for Academic Chairs.
Page 15: Final Report. Dev/Prototype Fall 2011 System Testing (Early) Spring 2012 Pilot Test w/ Selected Departments Spring 2012 Trainings for Academic Chairs.

ITS needs a documented guideline that will outline how often the SEI data should be purged from the university system

ITS will need to have an SEI user group possibly made up of ADAs and Department Chairs :◦ Ongoing training and knowledge sharing ◦ Works with ITS to improve the SEI system, if

needed

Moving Forward