CWRA NTAC12 Handouts

64
stop counting #CWRA | @cla_beat

description

Handouts from the New Tech Annual Conference CWRA session: "Stop Counting Fish!"

Transcript of CWRA NTAC12 Handouts

Page 1: CWRA NTAC12 Handouts

stop counting

#CWRA | @cla_beat

Page 2: CWRA NTAC12 Handouts

better aligning teaching, learning,

and assessment for college and

career readiness#CWRA | @cla_beat

Page 3: CWRA NTAC12 Handouts

chris jackson212.217.0845

[email protected]@cla_beat

collegiatelearningassessment.org/cwrapresentations

Page 4: CWRA NTAC12 Handouts
Page 5: CWRA NTAC12 Handouts

employers

sociologists

colleges

high schools

policy makers

test designers

Page 6: CWRA NTAC12 Handouts

employers

sociologists

colleges

high schools

policy makers

test designers

Page 7: CWRA NTAC12 Handouts

pushingdown

Page 8: CWRA NTAC12 Handouts

employers

Page 9: CWRA NTAC12 Handouts

Proportion of employers who say colleges should place MORE emphasis than they do on selected

learning outcomes

•The ability to effectively communicate orally and in writing

•Critical thinking and analytic reasoning skills

•The ability to apply knowledge and skills to real-world settings

•The ability to analyze and solve complex problems

89%

81%

79%

75%

AAC&U | 2008 | aacu.org/leap/public_opinion_research.cfm

Page 10: CWRA NTAC12 Handouts

sociologists

Page 11: CWRA NTAC12 Handouts

SO WHAT?

sociologists

Page 12: CWRA NTAC12 Handouts

SO WHAT?

sociologists

Page 13: CWRA NTAC12 Handouts

Academically adriftLimited learning on college campusessociologists

Page 14: CWRA NTAC12 Handouts

pushingup

Page 15: CWRA NTAC12 Handouts

policy makers

Page 16: CWRA NTAC12 Handouts

policy makers

Page 17: CWRA NTAC12 Handouts

test developers

Page 18: CWRA NTAC12 Handouts

test developers

Page 19: CWRA NTAC12 Handouts

test developers

Page 20: CWRA NTAC12 Handouts

is this aproblem?

Page 21: CWRA NTAC12 Handouts

High school

freshmen

High school seniors

College freshmen

College seniors

Page 22: CWRA NTAC12 Handouts

High school

freshmen

High school seniors

College freshmen

College seniors

Page 23: CWRA NTAC12 Handouts

employers

colleges

high schools

sociologists

policy makers

test designers

the future

Page 24: CWRA NTAC12 Handouts
Page 25: CWRA NTAC12 Handouts
Page 26: CWRA NTAC12 Handouts
Page 27: CWRA NTAC12 Handouts
Page 28: CWRA NTAC12 Handouts
Page 29: CWRA NTAC12 Handouts

The provision of transferrable skills

is as important asthe provision of

content.

Page 30: CWRA NTAC12 Handouts

The provision of transferrable skills

may replacethe provision of

content.

Page 31: CWRA NTAC12 Handouts
Page 32: CWRA NTAC12 Handouts

(a) William Shakespeare(b) John Updike

(c) Ernest Hemingway(d) None of the above

Rewards content regurgitationFails to gauge transferability

Page 33: CWRA NTAC12 Handouts

Contentknowledge

Contentskills

Generalknowledge

Generalskills

Page 34: CWRA NTAC12 Handouts

Contentknowledge

Page 35: CWRA NTAC12 Handouts

Contentknowledge

Contentskills

Generalknowledge

Generalskills

Page 36: CWRA NTAC12 Handouts

the need for adifferent

assessment

Page 37: CWRA NTAC12 Handouts
Page 38: CWRA NTAC12 Handouts

“Bad…”

Page 39: CWRA NTAC12 Handouts

We ask our students,

quite simply, to count fish.

Page 40: CWRA NTAC12 Handouts

Institutions are equipped toimprove higher-order skills

when they connectteaching, learning, and assessment

through authentic, performance-based practices.

Page 41: CWRA NTAC12 Handouts

The top ten in-demand jobs in 2010 did not exist in 2004. We

are currently preparing students for jobs that don’t yet exist,

using technologies that have not yet been invented in order

to solve problems that we don’t even know are problems yet.

Page 42: CWRA NTAC12 Handouts

How does the[cwra]

do this?

Page 43: CWRA NTAC12 Handouts

aligning teaching,learning &

assessment:measuring higher

order skills

Page 44: CWRA NTAC12 Handouts

bias

Page 45: CWRA NTAC12 Handouts

small sample

Page 46: CWRA NTAC12 Handouts

quantitative reasoning

Page 47: CWRA NTAC12 Handouts

appropriate comparison

group

Page 48: CWRA NTAC12 Handouts

correlation vs. causation

Page 49: CWRA NTAC12 Handouts

incorrect (improper?) use of data

Page 50: CWRA NTAC12 Handouts

ability to filter

Page 51: CWRA NTAC12 Handouts

aligning teaching,learning &

assessment:faculty development

Page 52: CWRA NTAC12 Handouts
Page 53: CWRA NTAC12 Handouts

What is authentic assessment?

How does effective teaching support that (and vice versa)?

What are the higher-order skills we value? Why?

How are those skills demonstrated in student responses?

Page 54: CWRA NTAC12 Handouts

What are the components of a Performance Task?

How do we effectively build them?

Working | Sharing | Feedback

Page 55: CWRA NTAC12 Handouts
Page 56: CWRA NTAC12 Handouts
Page 57: CWRA NTAC12 Handouts

aligningteaching &

assessment

Page 58: CWRA NTAC12 Handouts
Page 59: CWRA NTAC12 Handouts
Page 60: CWRA NTAC12 Handouts
Page 61: CWRA NTAC12 Handouts

48% 52% 40% 60% 32% 67% 48% 53%

Page 62: CWRA NTAC12 Handouts

chris jackson212.217.0845

[email protected]@cla_beat

collegiatelearningassessment.org/cwrapresentations

Page 63: CWRA NTAC12 Handouts

The top ten in-demand jobs in 2010 did not exist in 2004. We

are currently preparing students jobs that don’t yet exist, using

technologies that have not yet been invented in order to solve

problems that we don’t even know are problems yet.Fact or Fiction | Retail Industry Leaders Association (RILA)

http://bit.ly/aOiIcE | April 6, 2009

1. Registered Nurses2. General and operations managers

3. Physicians and surgeons4. Elementary school teachers

5. Accountants and auditors6. Computer software engineers

7. Sales representatives and managers8. Computer systems analysts

9. Management analysts10.Secondary school teachers

Page 64: CWRA NTAC12 Handouts

The provision of transferrable skills

is as important as the provision of

content.