Critical Thinking Rubrics

David Hunter, Ph.D.Associate Professor, Chair

Philosophy and HumanitiesBuffalo State College, SUNY

November 4, 2005

Today’s Plan

1. What is Critical Thinking?Fleshing out the SUNY Critical Thinking Learning outcomes.

2. Designing a Rubric.3. The Rubric in Action.4. Q&A

What is Critical Thinking?

Students will1 Identify, analyze and evaluate

arguments as they occur in their own and others’ work; and

2 Develop well-reasoned arguments.

First Task

Flesh out the key elements: Identifying arguments Analyzing arguments Evaluating arguments Developing well-reasoned arguments

Identify Arguments

What is an argument?

Identify Arguments

What is an argument?

A connected series of statements intended to establish a proposition.

Monty Python’s Flying Circus

Identify ArgumentsThe Logic 101 Model:

All men are mortal. Premises Are they true?

Socrates is a man. Socrates is mortal. Conclusion Does it

follow?

All As are Bs.X is an A. Logical Form Is it X is a B. valid?

Identify Arguments

Can this model apply across the curriculum?

What about reasoning in biology, sociology, history or fine arts?

Identify Arguments

These should count as arguments:

Designing an experiment to test an hypothesis.

Predicting the outcome of some process. Deciding on the best measurement

technique. Explaining the causes of some historical

event. Evaluating a work of art or performance.

Identify Arguments

A better conception of argument:

Any reasoning aimed at deciding what to believe or to do.

Students should be able to identify the characteristic features of such

reasoning. evaluate instances of it.

Analyze Arguments

1. Identify an argument’s premises, definitions and assumptions

What evidence is put forward?

What results are reported?

Analyze Arguments

1. Identify an argument’s premises, definitions and assumptions

What do the key words and terms mean?

How might we define them?What methods can we use to define?

Analyze Arguments

1. Identify an argument’s premises, definitions and assumptions

What is being left unsaid?

Can we make it explicit?What methods can we use to make

themexplicit?

Analyze Arguments

2. Identify the argument’s conclusion

What is the take home message?What is the report’s recommendation?What is the experiment designed to show?

Isolate it from the premises.

Evaluate Arguments

1. Judge whether an argument’s premises support the conclusion, independently of whether they are true.

Evaluate Arguments

1. Judge whether an argument’s premises support the conclusion, independently of whether they are true.

If the premises were true, would that be sufficient reason to believe the conclusion?

Evaluate Arguments

2. Judge whether an argument’s premises are reasonable to believe, independently of whether they support the conclusion

Evaluate Arguments

2. Judge whether an argument’s premises are reasonable to believe, independently of whether they support the conclusion

Even if they support the conclusion, they might be unacceptable.

Evaluate Arguments

What is the source of the premises and is it credible?

When is an experiment well-designed? When is measurement accurate and

precise? When is testimony trustworthy?

When can we trust observation?

Develop Well-Reasoned Arguments

Develop an argument for some conclusion.

e.g.,

Proposing an experiment to test some hypothesis

Evaluating a work of art Predicting the impact of some public policy Explaining the decline of rust-belt cities Arguing that we have no free will

Develop Well-Reasoned Arguments

Students should identify

Relevant qualifications and distinctions

Questions about source credibility Objections and respond to them Alternative conclusions and address

them

Develop Well-Reasoned Arguments

Describe the broader context

Why does it matter whether the conclusion is true?

What follows from it? What would its truth show?

Develop Well-Reasoned Arguments

Apply similar reasoning in another case

Where else can we use this Experimental design Measuring instrument

How can we generalize the lessons of this case?

Designing a Rubric

We established levels of competence for each outcome.

Students will identify, analyze, and evaluate arguments as they occur in their own and others’ work:

Exceeding: The student’s work

1. Identifies the target argument and clearly distinguishes it from any extraneous elements such as expressions of mere opinion and descriptions of events.

Students will identify, analyze, and evaluate arguments as they occur in their own and others’ work:

Exceeding: The student’s work

2. Carefully articulates the argument’s conclusion, clearly distinguishes it from its premises and identifies most relevant definitions and/or hidden assumptions.

Students will identify, analyze, and evaluate arguments as they occur in their own and others’ work:

Exceeding: The student’s work

3. Clearly and correctly assesses whether the argument’s premises provide sufficient logical support for the conclusion, independently of whether the premises are true.

Students will identify, analyze, and evaluate arguments as they occur in their own and others’ work:

Exceeding: The student’s work

4. Clearly and correctly assesses the reasonableness of the premises, including the credibility of their sources, independently of whether the premises support the conclusion.

Students will develop well-reasoned arguments:

Exceeding: The student’s work

1. Develops a clearly articulated argument, using evidence and/or systematic logical reasoning in support of a conclusion or point of view.

Students will develop well-reasoned arguments:

Exceeding: The student’s work

2. Identifies relevant qualifications or objections or alternative points of view and prioritizes evidence and/or reasons in support of the conclusion.

Students will develop well-reasoned arguments:

Exceeding: The student’s work

3. Describes the broader relevance, significance or context of the issue and/or applies it to a novel problem.

The Rubric in Action

No history of designing student assignments to assess CT competency.

unlike writing and math

The Rubric in Action

Some questions:

1. Have we captured Critical Thinking across the curriculum?

Skills or kinds of arguments left out?

The Rubric in Action

Some questions:

2. Have we correctly identified the standards of competence?

Are we expecting too much/little?

The Rubric in Action

Some questions:

3. How can we use the rubric to design assessment instruments?

Does it require student essay(s)?Embedded in course content?

What about the “in-betweens”?

The Rubric in Action

Some questions:

1.Have we captured Critical Thinking across the curriculum?

2.Have we correctly identified the standards of competence?

3.How can we use the rubric to design assessment instruments?

Only time and trial will tell.

The Rubric in Action

An Important Distinction

CT Competencies.Do students know how to think critically?

CT Dispositions.Are the students inclined to think

critically?

The Rubric in Action

Lots of guidance.

In his essay “The Ethics of Belief”, William Clifford claims that the ship owner he describes had no right to believe on the basis of the evidence he had before him that his ship was safe. What does Clifford mean by that? What reasons does he offer in support of it? Are these reasons good? Why/ why not? What, in your view, is the strongest reason against his view? How do you think he might reply to it?

Good for assessing competence, but not dispositions.

The Rubric in Action

No guidance at all.

Should Articles 23, 24 and 25 of the UN Declaration of Human Rights be added as amendments to the US Constitution?

Lack of disposition might mask strong competence.

The Rubric in Action

Middle Ground.

incorporate the rubric into course content.

distribute the rubric with the assignment.

Q: isn’t this teaching to the rubric?

The Rubric in Action

Anchor Essays

www.cortland.edu/gear/CTAnchors.final.pdf

Q&A

David Hunter, Ph.D.Associate Professor, ChairPhilosophy and HumanitiesBuffalo State College, SUNY hunterda@buffalostate.edu