INtopFORM Assessment Plan · Template Clarify ... Collected during 2016-2017 academic year ......

34
INtopFORM Assessment Plan INtopFORM Summer Workshop August 5, 2016 Allison Heming, Assessment Coordinator

Transcript of INtopFORM Assessment Plan · Template Clarify ... Collected during 2016-2017 academic year ......

Page 1: INtopFORM Assessment Plan · Template Clarify ... Collected during 2016-2017 academic year ... responsible parties, and calendars. Assessment Calendar for INtopFORM. Year 3: 2018-2019

INtopFORM Assessment Plan

INtopFORM Summer WorkshopAugust 5, 2016

Allison Heming, Assessment Coordinator

Page 2: INtopFORM Assessment Plan · Template Clarify ... Collected during 2016-2017 academic year ... responsible parties, and calendars. Assessment Calendar for INtopFORM. Year 3: 2018-2019

Goals for Today

Discuss the basics of student learning outcomes assessment

Describe each part of the Assessment Plan Template

Clarify responsibilities of ITF faculty members

Summarize important dates and timelines

Page 3: INtopFORM Assessment Plan · Template Clarify ... Collected during 2016-2017 academic year ... responsible parties, and calendars. Assessment Calendar for INtopFORM. Year 3: 2018-2019

What is assessment?

Page 4: INtopFORM Assessment Plan · Template Clarify ... Collected during 2016-2017 academic year ... responsible parties, and calendars. Assessment Calendar for INtopFORM. Year 3: 2018-2019

What is assessment?

Decide what we want our students to learn…… make sure they learn it

A useful teaching & learning tool

Page 5: INtopFORM Assessment Plan · Template Clarify ... Collected during 2016-2017 academic year ... responsible parties, and calendars. Assessment Calendar for INtopFORM. Year 3: 2018-2019

Assessment CycleEstablish Learning

Goals

Provide Learning

Opportunities

Assess Student Learning

Use the Results

Page 6: INtopFORM Assessment Plan · Template Clarify ... Collected during 2016-2017 academic year ... responsible parties, and calendars. Assessment Calendar for INtopFORM. Year 3: 2018-2019

Program-Level

Assessment for

INtopFORM

Page 7: INtopFORM Assessment Plan · Template Clarify ... Collected during 2016-2017 academic year ... responsible parties, and calendars. Assessment Calendar for INtopFORM. Year 3: 2018-2019

Assessment Template

Outcomes: six discipline-specific ITF Learning Outcomes

Opportunities: where students practice Measurement Sites: course/assessment Sampling: if used Baseline Data: when, where, how Sharing: who can enact improvement from

results

Page 8: INtopFORM Assessment Plan · Template Clarify ... Collected during 2016-2017 academic year ... responsible parties, and calendars. Assessment Calendar for INtopFORM. Year 3: 2018-2019

A. Outcomes

Establish six INtopFORM Learning Outcomes

What do they mean for YOUR discipline?

Record a draft of ITF LOs for your program in Column A of the Assessment Plan Template

Page 9: INtopFORM Assessment Plan · Template Clarify ... Collected during 2016-2017 academic year ... responsible parties, and calendars. Assessment Calendar for INtopFORM. Year 3: 2018-2019

Six INtopFORM Learning Outcomes

QuestioningSeeking

EvaluatingUsing

Communicating Recognizing

Page 10: INtopFORM Assessment Plan · Template Clarify ... Collected during 2016-2017 academic year ... responsible parties, and calendars. Assessment Calendar for INtopFORM. Year 3: 2018-2019

B. Opportunities

MUST allow students to practice and develop the six INtopFORM Learning Outcomes

Where will this take place in your curriculum?

What methods might you use? (teaching ideas)

Record ideas in Column B of Assessment Plan Template Be Specific!!

Page 11: INtopFORM Assessment Plan · Template Clarify ... Collected during 2016-2017 academic year ... responsible parties, and calendars. Assessment Calendar for INtopFORM. Year 3: 2018-2019

C. Measurement Sites

Where will you measure learning?

MUST be measurable or observable

The data does NOT need to be publishable data, just “reasonably accurate, truthful evidence” Good enough to use with confidence

Page 12: INtopFORM Assessment Plan · Template Clarify ... Collected during 2016-2017 academic year ... responsible parties, and calendars. Assessment Calendar for INtopFORM. Year 3: 2018-2019

C. Measurement Sites

What course(s)? 4000-level courses; capstone course

Gain information on as many students as possible

Record possible courses in Column C of Assessment Plan Template

Page 13: INtopFORM Assessment Plan · Template Clarify ... Collected during 2016-2017 academic year ... responsible parties, and calendars. Assessment Calendar for INtopFORM. Year 3: 2018-2019

D. Assessment Measures

What assessment(s)?

Two options: Modify an existing

assessment OR

Create a new assessment

Page 14: INtopFORM Assessment Plan · Template Clarify ... Collected during 2016-2017 academic year ... responsible parties, and calendars. Assessment Calendar for INtopFORM. Year 3: 2018-2019

D. Assessment Measures

Single assignments

Project/paper

Exam items

Culminating assessments

Record possible assessment(s) in Column D of Assessment Plan Template

Page 15: INtopFORM Assessment Plan · Template Clarify ... Collected during 2016-2017 academic year ... responsible parties, and calendars. Assessment Calendar for INtopFORM. Year 3: 2018-2019

E. Sampling

More evidence collected means higher confidence in conclusions

If you sample, adequately represent your student populations

Record the sampling information in Column E of Assessment Plan Template

Page 16: INtopFORM Assessment Plan · Template Clarify ... Collected during 2016-2017 academic year ... responsible parties, and calendars. Assessment Calendar for INtopFORM. Year 3: 2018-2019

F. Baseline Data

Collected during 2016-2017 academic year

Overall assessment for each of the six outcomes

Record ideas of how your program might collect baseline data in Column F of the Assessment Plan Template

Page 17: INtopFORM Assessment Plan · Template Clarify ... Collected during 2016-2017 academic year ... responsible parties, and calendars. Assessment Calendar for INtopFORM. Year 3: 2018-2019

G. Results and Improvements

Meaningless assessment provides worthless data

How will results be analyzed? Who will analyze them and make improvements?

When will the results be shared?

Discuss how your program might use the assessment information and record in Column G of the Assessment Plan Template

Page 18: INtopFORM Assessment Plan · Template Clarify ... Collected during 2016-2017 academic year ... responsible parties, and calendars. Assessment Calendar for INtopFORM. Year 3: 2018-2019

Assessment

Guidelines

Of INtopFORM

Page 19: INtopFORM Assessment Plan · Template Clarify ... Collected during 2016-2017 academic year ... responsible parties, and calendars. Assessment Calendar for INtopFORM. Year 3: 2018-2019

Assessment Guidelines

Must evaluate all six INtopFORM Learning Outcomes

Must occur annually Must provide data on the culminating skills

and abilities of students Must yield findings applicable to all students

in the program

Page 20: INtopFORM Assessment Plan · Template Clarify ... Collected during 2016-2017 academic year ... responsible parties, and calendars. Assessment Calendar for INtopFORM. Year 3: 2018-2019

Assessment Guidelines

Must be on a three point scaleNumber and percent students rated:

3=Excellent2=Satisfactory1=Unsatisfactory

Whether each student was rated satisfactory or better on all outcomes

Page 21: INtopFORM Assessment Plan · Template Clarify ... Collected during 2016-2017 academic year ... responsible parties, and calendars. Assessment Calendar for INtopFORM. Year 3: 2018-2019
Page 22: INtopFORM Assessment Plan · Template Clarify ... Collected during 2016-2017 academic year ... responsible parties, and calendars. Assessment Calendar for INtopFORM. Year 3: 2018-2019

Program Goals

of INtopFORM

Page 23: INtopFORM Assessment Plan · Template Clarify ... Collected during 2016-2017 academic year ... responsible parties, and calendars. Assessment Calendar for INtopFORM. Year 3: 2018-2019

Program goals are for…

Each program to improve in years 2-5 compared to baseline data

>=30% of students score “excellent” on each ITF Learning Outcome

>=90% of students score “satisfactory” or above on each ITF Learning Outcome

>=90% of program majors demonstrate at least “satisfactory” or above on ALL ITF LOs

Page 24: INtopFORM Assessment Plan · Template Clarify ... Collected during 2016-2017 academic year ... responsible parties, and calendars. Assessment Calendar for INtopFORM. Year 3: 2018-2019

Annual Assessment and

Improvement Meetings

Page 25: INtopFORM Assessment Plan · Template Clarify ... Collected during 2016-2017 academic year ... responsible parties, and calendars. Assessment Calendar for INtopFORM. Year 3: 2018-2019

Assessment and Improvement Meetings

Each fall in years 3-5 Includes: Assessment Coordinator, QEP

Director, Instructional Design Consultant, program leaders, and other interested faculty

Annual assessment and improvement report drafted by ITF staff and approved by program faculty

Page 26: INtopFORM Assessment Plan · Template Clarify ... Collected during 2016-2017 academic year ... responsible parties, and calendars. Assessment Calendar for INtopFORM. Year 3: 2018-2019

Assessment and Improvement Meetings

Review previous year’s assessment data Use results to refine plan for enhancing

information fluency As needed, define improvement actions,

responsible parties, and calendars

Page 27: INtopFORM Assessment Plan · Template Clarify ... Collected during 2016-2017 academic year ... responsible parties, and calendars. Assessment Calendar for INtopFORM. Year 3: 2018-2019

Assessment Calendar

for INtopFORM

Page 28: INtopFORM Assessment Plan · Template Clarify ... Collected during 2016-2017 academic year ... responsible parties, and calendars. Assessment Calendar for INtopFORM. Year 3: 2018-2019

Year 3: 2018-2019 Year 4: 2019-2020

Su Fa Sp Su Fa Sp

Develop program assessment plan

Collect baseline data

Collect and analyze results, refine plan, make improvements

X X X X X X

Assessment Calendar: OverviewYear 1: 2016-2017 Year 2: 2017-2018

Su Fa Sp Su Fa Sp

Develop program assessment plan X X X (refine)

Collect baseline data X

Collect and analyze results, refine plan, make improvements

X X X

Page 29: INtopFORM Assessment Plan · Template Clarify ... Collected during 2016-2017 academic year ... responsible parties, and calendars. Assessment Calendar for INtopFORM. Year 3: 2018-2019

Assessment Calendar: Year One

Page 30: INtopFORM Assessment Plan · Template Clarify ... Collected during 2016-2017 academic year ... responsible parties, and calendars. Assessment Calendar for INtopFORM. Year 3: 2018-2019

Assessment Calendar: Year Two

Page 31: INtopFORM Assessment Plan · Template Clarify ... Collected during 2016-2017 academic year ... responsible parties, and calendars. Assessment Calendar for INtopFORM. Year 3: 2018-2019

Assessment Calendar: Years 3-5

Page 32: INtopFORM Assessment Plan · Template Clarify ... Collected during 2016-2017 academic year ... responsible parties, and calendars. Assessment Calendar for INtopFORM. Year 3: 2018-2019

Support throughout

Participation

Page 33: INtopFORM Assessment Plan · Template Clarify ... Collected during 2016-2017 academic year ... responsible parties, and calendars. Assessment Calendar for INtopFORM. Year 3: 2018-2019

Support Services

INtopFORM provides support during Faculty Learning Communities

ITF Staff will hold meetings with each program to discuss assessment and implementation plans

The Assessment Coordinator (with QEP director) assists with designing assessments and approves each programs’ assessment

Page 34: INtopFORM Assessment Plan · Template Clarify ... Collected during 2016-2017 academic year ... responsible parties, and calendars. Assessment Calendar for INtopFORM. Year 3: 2018-2019

All pictures are public domain or ETSU owned

Allison [email protected]

(423) 439-6712135 Sherrod Library