ASSESSING ENTREPRENEURSHIP PROGRAMS: A CONTINUED DIALOG ON HOW TO PUSH THE ENVELOPE

Alex F. DeNoble, Ph.D. and Gangaram Singh, Ph.D.

San Diego State UniversityA PRE-CONFERENCE WORKSHOP:

USASBE ANNUAL CONFERENCEHILTON HEAD SOUTH CAROLINA

JANUARY 13, 2011

Workshop Objectives

Create a dialog on assessment of Entrepreneurship programs.

Formulate a set of best practices and tools that can be shared

Transform assessment beliefs and attitudes to a culture aspiring towards continuous improvement

We all need to learn from each other!

Workshop Agenda

1:00 – 1:45: Overview of assessment process – what is expected of us? – Alex

DeNoble

1:45 – 2:15 Assessment challenges – Facilitated discussion

2:15 – 2:30 Break

2:30 – 3:45 Competencies, metrics and best practices – Mike Morris

3:45 – 4:00 Break

4:00 – 4:45 Simulation as an assessment tool – Ernie Cadotte

4:45 – 5:00 Wrap-up – Where do we go from here?

Outcomes Assessment Process

The systematic collection, review, and use of information about educational programs undertaken for the purpose

of improving student learning and development (Palomba and Banta,

1999).

Course level versus Program level assessment?

What is the difference?

Course vs. Program Assessment

Course Level Assessment

Each faculty member’s responsibility

Should be tied to the goals of the program

Not the focus of AACSB’s assurance of learning standards!

Program Level Assessment

A holistic approach

Reflects broad expectations for each program

Competencies, knowledge and behaviors that program graduates should acquire

Is the focus of AACSB’s assurance of learning standards!

Outcomes Assessment

Significant flexibility in assessment processes

Reliance on indirect assessment measures: Surveys of alumni Graduating students employers

Need for improved accountability measures

Emphasized direct assessments of student learning

Requires formulation of learning goals

Focus on improving curricula

1991 Expectations 2003 Expectations

Source: AACSB Assurance of Learning Standards: White Paper – November 20, 2007

Outcome Assessment Process

Definition of student learning objectives (SLOs)

Alignment of curricula with the adopted SLOs

Identification of tools and measures to assess learning

Collection, analyzing, and dissemination of assessment information

Using assessment for continuous improvement “Closing the Loop”

Source: AACSB Assurance of Learning Standards: White Paper – November 20, 2007

Learning Goals & Objectives

•Communication•Problem solving•Ethical reasoning

•Financial principles•Marketing principles•Managerial principles

•Opportunity recognition•Opportunity analysis•Concept development

•Opportunity recognition•Opportunity analysis•Concept development

Competencies Knowledge

General

Entrepreneur - specific

Tools to Assess Learning

Test questions (M/C, T/F, short answer) – basic knowledge

Case analysis – knowledge, problem solving, reasoning & decision making competencies

Opportunity identification assignment – some entrepreneurial competencies

Simulation – analytical and decision making skills

360 Assessments – designed around competencies

Kuratko’s “spine sweat” business plan presentations – comprehensive assessment!

Other?

Kirkpatrick’s Four Levels of Assessment (Evaluation)

Developing an Assessment Framework

Levels 1 and 2Reaction and

Learning

Reaction: Did they like it? Necessary because can

affect higher levels Learning: Take measure

of competencies (as before the program) Compare before/after

scores Compare before/after

with comparison (or control) group

Developing an Assessment Framework

Levels 3 and 4 Transfer and Results

Transfer: Did they transfer learning to practice?

Results: Did it result in organizational success

NOTE: For these levels, you need a tracking system Webportals with automatic

trigger to complete

Closing the Loop

Use data to: Inform faculty about effectiveness of

programs. Take corrective action Focus on continuous improvement of curricula

Our goal is to “make a difference”

Closing the Loop Activities

Requiring course pre-requisites

Better sequencing of courses in a program

Developing remedial modules

Changing course content

Incorporating extra-curricula activities

Instituting a mentor program

Other?

Update from 2010

Program Goal: “Display knowledge of the key elements of the entrepreneurial process including opportunity recognition and evaluation, concept development, resource procurement, and implementation leading to the creation and capture of value.”

 SLO #5.1: Identify possible sources and characteristics of viable business opportunities. SLO #5.2: Develop alternative business concepts for pursuing viable opportunities. SLO #5.3: Identify the types of human, information, and financial resources required for launching and managing a new venture. SLO #5.4: Identify alternative strategies for capturing the accumulated value of a business venture.