Listen First, Then Make it Count:Reviewing a Model of Assessment to Meet Professional Development Needs of Faculty

Erin WhiteDavid Pratt

Office of Learning and TechnologyPurdue University North Central

Assessment InstituteIndianapolis, IN: 2011

Overview of SessionWho we areWhy was our PD plan re-designed?Briefly identify your PD strengths/weaknesses Purdue University North Central Model

Identification of Problem(s) with our PD Program

Design & Develop offerings (or Redesign)

Implement & AssessIdentify elements of the PNC model for use at your campus

Objectives of SessionIdentify Strengths & Weaknesses of YOUR PD planCompare your plan with the PNC ModelDetermine which strategies you could implement to re-invent your current program

Who are we?

David Pratt- Director of Learning and Technology, Associate Professor of Education

Erin White- Coordinator of Learning and Technology, Continuing Lecturer in Education

We identified our problems

Administered a faculty–needs survey to obtain a base line of where to startInterviewed faculty, students, administrators, and staffTook inventory of current supporting infrastructure

Web resourcesTech supportTraining (workshops, consultations, etc.)

Identify PD Strengths & WeaknessesCritical Factors Weakness Strength

Faculty Motivation 1 2 3 4 5

Administrative Support

1 2 3 4 5

Technology Support 1 2 3 4 5

Pedagogical Support 1 2 3 4 5

Budget/Incentives (Stipends, Release time)

1 2 3 4 5

Faculty

Motivation

Budget/ Incentives

Technology Support

Pedagogical Support

Administrative Support

Identify Problem(s)

Design & Develop a

Program (Redesign)

Implement & Assess

Pre AssessmentFaculty-Needs Survey- to establish a baseline we assessed:

•Faculty & Contextual Characteristics

•Technology Needs

•Pedagogy Needs

•Preferred format of delivery

Faculty Characteristics

Availability variesAvailability varies

Time preferences Time preferences

Instructional DeliveryInstructional Delivery

How often are you on campus?

Mornings/lunches

What works for you?

One-to-one Web-based tutorials Workshops/Seminars

Knowledge in designing online course materials (best practices and pedagogy)

Students need organized instruction in the online education process

63% did NOT feel competent in designing and developing online course materials

Faculty concerns

I am comfortable using the following:

I would like to learn more about the following:

Pedagogy Concerns

• Student cheating/plagiarism

• Not enough face-to-face or collaboration

• Not knowing how to design (iterative process)

Faculty

Motivation

Budget/ Incentives

Technology Support

Pedagogical Support

Administrative Support

Identify Problem(s)

Design & Develop a

Program (Redesign)

Implement & Assess

What did we design and develop?

Upon the survey analysis, the following were developed:

•Web-based video tutorials for Blackboard and Technology

•Hands-on Workshops, Seminars, and an Online Academy in Course Design

•Course Design website with pedagogical and technological tips and interactive readiness quiz

•Individual Consultations/Professional Development Plan

Faculty

Motivation

Budget/ Incentives

Technology Support

Pedagogical Support

Administrative Support

Identify Problem(s)

Design & Develop a

Program (Redesign)

Implement & Assess

Implementation & Formative AssessmentWorkshops/Seminars

brief anonymous surveys (post-training) & consultants recorded anecdotal notes of participants

Individual Consultations Follow-up emails from supervisorsChecklist completed (pre & post training)Anecdotal notes

Online AcademyWeekly check-insPre & post assessmentsProduct Review (online course quality rubric)

Assessing Workshops & Seminars

Assessing Individual Consultations

Assessing at Department Level

Self Assessment/ Peer Review Tool

Taskforce created an evaluative tool- PNC Recommendations for Online Courses

SyllabusCourse DesignInstructional Materials

Available via the web- faculty can privately self-assessPeer review provided upon faculty request

How did you rate your PD?Critical Factors Weakness Strength

Faculty Motivation 1 2 3 4 5

Administrative Support

1 2 3 4 5

Technology Support 1 2 3 4 5

Pedagogical Support 1 2 3 4 5

Budget/Incentives (Stipends, Release time)

1 2 3 4 5

Commercials, faculty testimonials, chair’s support,

promote increase in enrollment/ graduation rates

Stipend, Letter of Recognition, Publicity, VCAA & Chancellor’s

endorsement

Expanded support via web resources, work study & currently

seeking to train helpdesk personnel to expand their role

Increased training via faculty mentors, graduate

practicums, work study

Visit our wiki for additional resources

http://pdassessmentpnc.wikispaces.com/

Thank you!

Faculty

Motivation

Budget/ Incentives

Technology Support

Pedagogical Support

Administrative Support

Identify Problem(s)

Design & Develop a

Program (Redesign)

Implement & Assess