IT State Conference Update

Eau Claire, March 1, 2012

Hal Zenisek

WIDS Learning Design System

WTCS Foundation, Waunakee, WI

Today’s Topics…

• Overview Technical Skill Attainment

• Review WTCS process and procedures

• Update on Business & IT division TSA

• Panel discussion on TSA assessment

• Prepare for next steps for IT TSAs

• Review resources available

• Answer questions and hear concerns

Carl Perkins IV

Technical Skills Attainment• An assessment that objectively measures a

student's attainment of industry recognized skills.

System Level Guiding Principles• The “System” has been assessing student

performance for 100 years• TSA formalizes the assessment and creates

a common and shared reporting process• Used to meet the federal Carl D Perkins

Grant 2006 reporting requirement• At some point, a college’s funding status

could be effected by their engagement in TSA reporting

Guiding Principles (cont.)

• Minimally, each aid code 10, 31, 32 and 50 program will use “course completion” as their measure of students’ Technical Skill Attainment – this has been done for many years

• Over time the number of programs that move to using WTCS Assessment (TSA) or a 3rd Party assessment should increase

• Demonstrate a shift to measuring evidence of direct student learning with WTCS approved assessment

2008-2013

External A

ssessment

WTC

S Assessm

ent

**Some programs will continue to use Course Completion, and never move to another type of assessment

*3rd party assessment is hard to implement; a limited # of programs will use this

WTCS Three Phase Approach

Phase I Recap• The Goal is to identify:

– Common Program Outcomes to be assessed on a summative basis

• validated by business & industry– Common Type of Assessment that will be used

• WTCS Assessment and/or 3rd Party– Common Assessment Criteria (i.e., rubric)– Artifacts used for assessment at colleges

• For programs at more than 1 college:– Work is done collaboratively with all colleges

holding State Board Program Approval• For Unique programs:

– Work is done by the college holding State Board Program Approval

Program Outcomes are Valid

Sample

Program Outcome

s

Program Outcomes

Related rating criteria

Related rating criteria

Program Outcomes Threaded

Phase I Approval Request Form• Posted on WTCS

CurriculumBank when the project is complete

• Sent to the State Office by the Lead district (in collaboration w/WIDS)

• Reviewed for approval by the WTCS Education Director and Assoc. Vice President

Phase I: Planning

• ISA reps for all participating colleges notified by WTCS of Phase I approval (via letter)

• “Invited" to move to phase II• Documents moved on

WTCS curriculum bank from WIP to TSA Assessment.

Phase II Recap•Planning for the use of common program outcomes, assessment criteria & assessment type developed under phase I

•Each college creates a TSA Local Implementation Plan1.Link between Program Outcomes, Program Curriculum & Assessment Criteria2.Assessment strategy* that will be done

– portfolio, skill demonstration, capstone course project, licensure exam …

– mechanism to complete the assessment• Who does it

– Faculty, an Assessment Committee, etc.• When it happens

– 1st semester, throughout the program, end of program, etc.

• How it happens– Part of an existing course, a stand alone

“course”, etc.• The exact process to get student level assessment

data (i.e., passed, not passed, not assessed) into the college’s course management system.

3.Phase 2 plan submitting to WTCS & approved *Note: Identification of Assessment Strategy is applicable for WTCS Assessment Type only.

The Assessment Strategy for 3rd Party is identified by the 3rd party.

Phase II: Implementation• Phase 1 complete• Final documents now available under the TSA

Assessment tab on CurriculumBank

Organized by Career Clusters

Phase II: Implementation

Download Phase II

Documents

Phase II: Implementation

Each College Completes TSA Phase II Request Form as applicable to

their own district (use the Completion Guide to help

you)

View Samples

Phase II: Implementation

Your College’s Plan for

Implementing the TSA

Phase II Plan

• Show how the program outcomes link to the courses in your program

• Complete the Analyzer report in WIDS or provide documentation referencing the exit learning outcomes with the program courses

WIDS Analyzer Report

Courses

Program Outcomes

Phase II Plan

• What’s your strategy?

• Each college may define its own

• How will you use the rubric?

Assessment Strategies– Portfolio– Capstone– Internship Rubric with program outcomes and

criteria– Reflective paper in course 10-150-1xx– Outcomes/performance standards with each

formative assessment

– Align outcomes assessment to external standards

Phase II: Implementation• Colleges complete the Phase II form

• Colleges submit the form through programs@wtcsystem.edu as a SINGLE DOCUMENT (attach all files)

• Routed thru the WTCS approval process– Review– Complete Checklist– Make Recommendation

Phase III Recap• With approved Phase II assessment• Colleges begin reporting student data

– 1 = Assessed, passed– 2= Assessed, not passed– 9= Not assessed

» Client Guide 3.1.10

TSA Reporting• Once Phase II is approved by the state the

program will begin reporting TSA on all program students

• In the Phase II documentation you will identify when you will start the TSA, until then all students will be reported as “not assessed” or 9 in client reporting

• Projected dates are estimates, if colleges have data to report earlier, they can

TSA Current Status-Next Steps• 69 programs have received Phase I approval

– Duplicated count = 421 programs• 10 programs have received Phase II approval

• 2012 Goals:– Significantly increase Significantly increase the number of

programs achieving Phase II approval– Continue to support programs entering

Phase I

Business & IT Division Phase I Complete

•Business Management•Accounting•Paralegal•Marketing•Administrative Professional•Office Assistant•IT-CSS & IT-NS (in process)

Business & IT Division Phase II

• Accounting – NATC, MSTC, BTC, NWTC• Curriculum Bank:

http://www.curriculumbank.org/curriculumbank/index.pl?id=14189&isa=Category&op=show

• Resources for TSA – Overview, Resources, Sample College Plans– Scoring Guides, Program Outcomes, Criteria– WIDS files and documents

Phase 1 – IT Computer Support• Non-aligned, multi-college program

under 10-154-3• Common program outcomes, criteria,

scoring standard, and scoring guide• Individual college plans @ Phase 2• Under review: one-year and two-year

related diploma programs

Phase 1 – IT Computer Support• Scoring Guide Review (Team Reps)

– Program Outcomes– Outcome Criteria– Scoring Scale– Scoring Standard– Common assessment for AAS degree

programs

Phase 1 – IT Computer SupportIT Computer Support Specialist TSA Vetting Date: February 29, 2012 Location: Face-to-Face Meeting #2

Holiday Inn – Eau Claire, WI Kim Vosicky, Facilitator

Time: 9:00 am – 3:00 pm

Decisions and Activities 1. The faculty reviewed the Advisory Committee Survey results and agreed with the comments to remove one program outcome and its performance criteria. Two other program outcomes were combined into one and criteria overall were reviewed and edited as necessary. The TSA reduced its common program outcomes from eight to six.

2. The week of 2/9/12, an Advisory Committee email was sent to all deans and associated deans with an attached sample letter and link to the electronic survey of program outcomes. A review of the Advisory Committee feedback showed that several colleges did not have representation. They were: Gateway Technical College, Mid-State Technical College, Moraine Park Technical College, Northcentral Technical Co llege, Northeast Wisconsin Technical College, Southwest Technical College and Wisconsin Indianhead Technical College.

3. The Phase 2 Implementation was discussed and began with a brainstorm on what types of assessment strategies colleges use or could use to assess the program outcomes and criteria of the TSA. The strategies included were:

a. SWTC – Internship and a Help Desk Practicum b. GTC – Capstone Project to include 13 assignments c. Western – Portfolio and Capstone Course d. Madison – through successful completion of four courses e. MPTC – portfolio f. MATC – ½ in courses and ½ through a Capstone Course g. FVTC – through successful completion of five courses h. WCTC – Portfolio in a Capstone Course that requires successful completion of all prerequisite courses in program I. LTC - Portfolio

College Name Dean/Assoc Dean WIDS Kim Vosicky

Hal Zenisek

FVTC Steve Ebben NWTC n/a WCTC Melissa Seamonson LTC Nadine C. Schreiter Western Dawn Fread SWTC Dave Birkelo GTC Paul Nelson GTC Linda Spaulding Nicolet n/a WITC n/a MPTC Lisa Pollard Madison Nina Milbauer MATC Jim Stark WTCS Moira Lafayette

Phase 1 – IT Network Specialist• Non-aligned, multi-college program under 10-

150-2• Common agreed upon program outcomes,

criteria, scoring standard, and scoring guide• Individual college plans @ Phase 2• External standards identified• Under consideration: 31-150-5 & others

Phase 1 – IT Network Specialist• Scoring Guide Review (Team Reps)

– Program Outcomes

– Outcome Criteria

– Scoring Scale

– Scoring Standard

– Reference to External Standards

– Common assessment for AAS degree programs

Phase 1 – IT Network SpecialistIT-Network Specialist AAS

Program Summative Assessment Draft 2-29-12 Wisconsin Technical College System

Directions

This Technical Skill Attainment (TSA) scoring guide will be used to document your attainment of technical skills at the end of the IT Network Specialist program. To meet the requirements on the scoring guide, you will be asked to draw upon the skills and concepts that have been developed throughout the program, and are necessary for successful employment in your field. Results will be used to inspire continual improvement of teaching and learning across the Wisconsin Technical College System. In addition, this assessment will provide feedback to you about your performance as a learner, student, and future employee in the field. This scoring guide will use assessed work you have already completed within the context of an existing course, across multiple courses, in a capstone project, internship, program portfolio, or with any other format designated by [INSERT NAME] Technical College. Your instructor will provide detailed instructions on the tool(s) used. After your instructor completes this scoring guide, you will receive feedback on your performance including your areas of accomplishment and areas that need improvement.

Program Outcomes

PO 1. Implement computer networks. PO 2. Implement client systems. PO 3. Implement server operating systems. PO 4. Implement network security components. PO 5. Develop technical documentation. PO 6. Troubleshoot network systems.

Rating Scale

MET Learner completed the skill and has met the requirements to pass the outcome.

NOT MET

Learner did not complete the skill and does not meet the requirements to pass the outcome.

Scoring Standard

You must achieve a rating of MET on all program outcomes to demonstrate competence (passing) on performance assessments. A rating of NOT MET on any criterion results in a NOT MET score for that program outcome and not passing the TSA Assessment.

IT TSA Next Steps - Current Projects• Dean review webinar (CSS and NS)

– March 2012

• Final review webinar– April 2012

• TSA documentation finalized and submitted to WTCS– May/June 2012

• Phase 1 approval – summer 2012• Phase 2 plans from colleges to WTCS -fall/spring 2012-13• Phase 2 assessment – new student cohorts in 2013 who

complete programs 2-3 years (2015-2016) • Phase 3 reporting - December 2016

IT Phase 1 Questions & Comments

IT Related TSA Opportunities• IT-Computer Support Specialist (10-154-3 )

– Work on Phase 2 local plans

• IT-Network Specialist (10-150-2)– Work on Phase 2 local plans

• Identify other 150, 152, 154 associate degrees– Consider Phase 1 planning efforts

• Identify other IT 1- and 2-year diploma programs– Consider Phase 1 planning

• 25+ IT state-approved programs (Phase 1)

Future TSA Strategies• Coordinate plans with Ed Director

• Adapt the phase 1 process for your college and/or other colleges with the same IT program– IT-Security (BTC and MILW)?– IT-Network Systems Administration (WTC and

FVTC)? Others?

• Checklists for Phase 1 and Phase 2

• WIDS staff can help

TSA in Review

Phase II: Implementation

Where are my programs?

Thank-you!

Hal Zenisek

WIDS Learning Design Consultant

zenisekh@wids.org

(800) 677-437