New A Typology of Research Activities and Attributes to Inform …cpo.noaa.gov/sites/cpo/RISA/Usable...

30
A Typology of Research Activities and Attributes to Inform Research (Adjective) Elizabeth McNie (WWA/CIRES/Univ of Colorado, Boulder) Adam Parris (CPO/NOAA/Jamaica Bay…) Dan Sarewitz (CSPO/Arizona State Univ.) January 14, 2015

Transcript of New A Typology of Research Activities and Attributes to Inform …cpo.noaa.gov/sites/cpo/RISA/Usable...

Page 1: New A Typology of Research Activities and Attributes to Inform …cpo.noaa.gov/sites/cpo/RISA/Usable Science_McNie.pdf · 2015. 3. 18. · Science Serving Society •Called upon to

A Typology of Research Activities and Attributes to Inform Research

(Adjective)

Elizabeth McNie (WWA/CIRES/Univ of Colorado, Boulder)

Adam Parris (CPO/NOAA/Jamaica Bay…)

Dan Sarewitz (CSPO/Arizona State Univ.)

January 14, 2015

Page 2: New A Typology of Research Activities and Attributes to Inform …cpo.noaa.gov/sites/cpo/RISA/Usable Science_McNie.pdf · 2015. 3. 18. · Science Serving Society •Called upon to

Value of Typology

• Analytical tool to characterize science

• Provide framework to compare and contrast different forms of science

• Guide deliberation about goals and expectations of research

• Inform the design, implementation and evaluation of research

Page 3: New A Typology of Research Activities and Attributes to Inform …cpo.noaa.gov/sites/cpo/RISA/Usable Science_McNie.pdf · 2015. 3. 18. · Science Serving Society •Called upon to

Science Serving Society • Called upon to provide

relevant information • Raise awareness,

expand alternatives, clarify choices and inform decisions

• Linking science and decision making is difficult – Cultural, epistemic – Not the ‘right’

science

Page 4: New A Typology of Research Activities and Attributes to Inform …cpo.noaa.gov/sites/cpo/RISA/Usable Science_McNie.pdf · 2015. 3. 18. · Science Serving Society •Called upon to

Types of Research

Ad hoc Applied Background Baconian Basic Clinical Committed Curiosity-Driven Curiosity-Oriented Development Directed Experimental Free Basic Fundamental

Criteria:

• Motivation for research (fundamental discovery vs. application of knowledge)

• Temporal Delay to application

Jeffersonian Mode 1 Mission-Oriented Newtonian Normal Science Oriented-Basic Pure Pure-Basic Purposive-Basic Strategic Tactical Uncommitted Use-Inspired

Page 5: New A Typology of Research Activities and Attributes to Inform …cpo.noaa.gov/sites/cpo/RISA/Usable Science_McNie.pdf · 2015. 3. 18. · Science Serving Society •Called upon to

Types of Research

Ad hoc Applied Background Baconian Basic Clinical Committed Curiosity-Driven Curiosity-Oriented Development Directed Experimental Free Basic Fundamental

Jeffersonian Mode 1 Mission-Oriented Newtonian Normal Science Oriented-Basic Pure Pure-Basic Purposive-Basic Strategic Tactical Uncommitted Use-Inspired

No Explicit Role for Users

Page 6: New A Typology of Research Activities and Attributes to Inform …cpo.noaa.gov/sites/cpo/RISA/Usable Science_McNie.pdf · 2015. 3. 18. · Science Serving Society •Called upon to

Values Informing Research

• Science values

– Knowledge

• User values

– Knowledge

– Understanding

– Information decisions

– Solving problems

Page 7: New A Typology of Research Activities and Attributes to Inform …cpo.noaa.gov/sites/cpo/RISA/Usable Science_McNie.pdf · 2015. 3. 18. · Science Serving Society •Called upon to

Values Informing Research

• Science values

– Knowledge

• User values

– Knowledge

– Understanding

– Information decisions

– Solving problems

Reinforced by: • Culture • Epistemology • Languages • Participants…

Page 8: New A Typology of Research Activities and Attributes to Inform …cpo.noaa.gov/sites/cpo/RISA/Usable Science_McNie.pdf · 2015. 3. 18. · Science Serving Society •Called upon to

Policy for Science

Knowledge

Science Policy

Most science-policy deliberation looks at all aspects of knowledge production including content, expertise, dissemination, credibility, quality etc. Misses other important

variables that provide a more comprehensive assessment of research

Page 9: New A Typology of Research Activities and Attributes to Inform …cpo.noaa.gov/sites/cpo/RISA/Usable Science_McNie.pdf · 2015. 3. 18. · Science Serving Society •Called upon to

Policy for Science

Science Policy

Knowledge

Learning & Engagement

Power & Politics

Institutional & Organizational

Design

Page 10: New A Typology of Research Activities and Attributes to Inform …cpo.noaa.gov/sites/cpo/RISA/Usable Science_McNie.pdf · 2015. 3. 18. · Science Serving Society •Called upon to

Introducing the Typology

• Derived from:

– Exhaustive literature

– Experience and expertise of scientists & science managers working with users

• Four activities with multiple attributes

• Represented in spectrum of value criteria

– Science values

– User values

• Variables and criteria are idealized and not weighted equally

Page 11: New A Typology of Research Activities and Attributes to Inform …cpo.noaa.gov/sites/cpo/RISA/Usable Science_McNie.pdf · 2015. 3. 18. · Science Serving Society •Called upon to

Activity

Attribute

Spectra of Research Criteria

Science Values User Values

Knowledge

Production

Expertise Epistemic Experiential

Relevance General Contextual

Disciplinary Focus Singular, Narrow Transdisciplinary, Diverse

Uncertainty Reduce Uncertainty Manage Uncertainty

Goals for Research Exploratory Outcome Oriented

Learning &

Engagement

Processes

Learning Theoretical Social, Practical

Knowledge Exchange Narrow Iterative, Influential

Network Participation Homogeneous Heterogeneous

Social Capital Negligible Significant

Organizational

& Institutional

Dynamics

Accessibility Constrained High

Outputs Narrow Diverse

Evaluation &

Effectiveness

Science-Centric Public-Value Oriented

Flexibility Constrained Responsive

Human Capital Narrow Broad

Boundary Management Limited Broad

Page 12: New A Typology of Research Activities and Attributes to Inform …cpo.noaa.gov/sites/cpo/RISA/Usable Science_McNie.pdf · 2015. 3. 18. · Science Serving Society •Called upon to

Activity

Attribute

Spectra of Research Criteria

Science Values User Values

Knowledge

Production

Expertise

Epistemic Experiential

Relevance

General Contextual

Disciplinary

Focus

Singular, Narrow Transdisciplinary, Diverse

Uncertainty

Reduce Uncertainty Manage Uncertainty

Goals for

Research

Exploratory Outcome Oriented

Page 13: New A Typology of Research Activities and Attributes to Inform …cpo.noaa.gov/sites/cpo/RISA/Usable Science_McNie.pdf · 2015. 3. 18. · Science Serving Society •Called upon to

Activity

Attribute

Spectra of Research Criteria

Science Values User Values

Knowledge

Production

Expertise

Epistemic Experiential

Relevance

General Contextual

Disciplinary

Focus

Singular, Narrow Transdisciplinary, Diverse

Uncertainty

Reduce Uncertainty Manage Uncertainty

Goals for

Research

Exploratory Outcome Oriented

Page 14: New A Typology of Research Activities and Attributes to Inform …cpo.noaa.gov/sites/cpo/RISA/Usable Science_McNie.pdf · 2015. 3. 18. · Science Serving Society •Called upon to

Activity

Attribute

Spectra of Research Criteria

Science Values User Values

Knowledge

Production

Expertise

Epistemic Experiential

Relevance

General Contextual

Disciplinary

Focus

Singular, Narrow Transdisciplinary, Diverse

Uncertainty

Reduce Uncertainty Manage Uncertainty

Goals for

Research

Exploratory Outcome Oriented

Page 15: New A Typology of Research Activities and Attributes to Inform …cpo.noaa.gov/sites/cpo/RISA/Usable Science_McNie.pdf · 2015. 3. 18. · Science Serving Society •Called upon to

Activity

Attribute

Spectra of Research Criteria

Science Values User Values

Knowledge

Production

Expertise

Epistemic Experiential

Relevance

General Contextual

Disciplinary

Focus

Singular, Narrow Transdisciplinary, Diverse

Uncertainty

Reduce Uncertainty Manage Uncertainty

Goals for

Research

Exploratory Outcome Oriented

Page 16: New A Typology of Research Activities and Attributes to Inform …cpo.noaa.gov/sites/cpo/RISA/Usable Science_McNie.pdf · 2015. 3. 18. · Science Serving Society •Called upon to

Activity

Attribute

Spectra of Research Criteria

Science Values User Values

Knowledge

Production

Expertise

Epistemic Experiential

Relevance

General Contextual

Disciplinary

Focus

Singular, Narrow Transdisciplinary, Diverse

Uncertainty

Reduce Uncertainty Manage Uncertainty

Goals for

Research

Exploratory Outcome Oriented

Page 17: New A Typology of Research Activities and Attributes to Inform …cpo.noaa.gov/sites/cpo/RISA/Usable Science_McNie.pdf · 2015. 3. 18. · Science Serving Society •Called upon to

Learning &

Engagement

Processes

Learning

Theoretical Social, Practical

Knowledge

Exchange

Narrow Iterative, Influential

Network

Participation

Homogeneous Heterogeneous

Social

Capital

Negligible Significant

Activity

Attribute

Spectra of Research Criteria

Science Values User Values

Page 18: New A Typology of Research Activities and Attributes to Inform …cpo.noaa.gov/sites/cpo/RISA/Usable Science_McNie.pdf · 2015. 3. 18. · Science Serving Society •Called upon to

Learning &

Engagement

Processes

Learning

Theoretical Social, Practical

Knowledge

Exchange

Narrow Iterative, Influential

Network

Participation

Homogeneous Heterogeneous

Social

Capital

Negligible Significant

Activity

Attribute

Spectra of Research Criteria

Science Values User Values

Page 19: New A Typology of Research Activities and Attributes to Inform …cpo.noaa.gov/sites/cpo/RISA/Usable Science_McNie.pdf · 2015. 3. 18. · Science Serving Society •Called upon to

Learning &

Engagement

Processes

Learning

Theoretical Social, Practical

Knowledge

Exchange

Narrow Iterative, Influential

Network

Participation

Homogeneous Heterogeneous

Social

Capital

Negligible Significant

Activity

Attribute

Spectra of Research Criteria

Science Values User Values

Page 20: New A Typology of Research Activities and Attributes to Inform …cpo.noaa.gov/sites/cpo/RISA/Usable Science_McNie.pdf · 2015. 3. 18. · Science Serving Society •Called upon to

Learning &

Engagement

Processes

Learning

Theoretical Social, Practical

Knowledge

Exchange

Narrow Iterative, Influential

Network

Participation

Homogeneous Heterogeneous

Social

Capital

Negligible Significant

Activity

Attribute

Spectra of Research Criteria

Science Values User Values

Page 21: New A Typology of Research Activities and Attributes to Inform …cpo.noaa.gov/sites/cpo/RISA/Usable Science_McNie.pdf · 2015. 3. 18. · Science Serving Society •Called upon to

Activity

Attribute

Spectra of Research Criteria

Science Values User Values

Organizational

& Institutional

Dynamics

Accessibility

Constrained High

Outputs

Narrow Diverse

Evaluation &

Effectiveness

Science-Centric Public-Value Oriented

Flexibility

Constrained Responsive

Human

Capital

Narrow Broad

Boundary

Management

Limited Broad

Page 22: New A Typology of Research Activities and Attributes to Inform …cpo.noaa.gov/sites/cpo/RISA/Usable Science_McNie.pdf · 2015. 3. 18. · Science Serving Society •Called upon to

Activity

Attribute

Spectra of Research Criteria

Science Values User Values

Organizational

& Institutional

Dynamics

Accessibility

Constrained High

Outputs

Narrow Diverse

Evaluation &

Effectiveness

Science-Centric Public-Value Oriented

Flexibility

Constrained Responsive

Human

Capital

Narrow Broad

Boundary

Management

Limited Broad

Page 23: New A Typology of Research Activities and Attributes to Inform …cpo.noaa.gov/sites/cpo/RISA/Usable Science_McNie.pdf · 2015. 3. 18. · Science Serving Society •Called upon to

Activity

Attribute

Spectra of Research Criteria

Science Values User Values

Organizational

& Institutional

Dynamics

Accessibility

Constrained High

Outputs

Narrow Diverse

Evaluation &

Effectiveness

Science-Centric Public-Value Oriented

Flexibility

Constrained Responsive

Human

Capital

Narrow Broad

Boundary

Management

Limited Broad

Page 24: New A Typology of Research Activities and Attributes to Inform …cpo.noaa.gov/sites/cpo/RISA/Usable Science_McNie.pdf · 2015. 3. 18. · Science Serving Society •Called upon to

Activity

Attribute

Spectra of Research Criteria

Science Values User Values

Organizational

& Institutional

Dynamics

Accessibility

Constrained High

Outputs

Narrow Diverse

Evaluation &

Effectiveness

Science-Centric Public-Value Oriented

Flexibility

Constrained Responsive

Human

Capital

Narrow Broad

Boundary

Management

Limited Broad

Page 25: New A Typology of Research Activities and Attributes to Inform …cpo.noaa.gov/sites/cpo/RISA/Usable Science_McNie.pdf · 2015. 3. 18. · Science Serving Society •Called upon to

Activity

Attribute

Spectra of Research Criteria

Science Values User Values

Organizational

& Institutional

Dynamics

Accessibility

Constrained High

Outputs

Narrow Diverse

Evaluation &

Effectiveness

Science-Centric Public-Value Oriented

Flexibility

Constrained Responsive

Human

Capital

Narrow Broad

Boundary

Management

Limited Broad

Page 26: New A Typology of Research Activities and Attributes to Inform …cpo.noaa.gov/sites/cpo/RISA/Usable Science_McNie.pdf · 2015. 3. 18. · Science Serving Society •Called upon to

Activity

Attribute

Spectra of Research Criteria

Science Values User Values

Organizational

& Institutional

Dynamics

Accessibility

Constrained High

Outputs

Narrow Diverse

Evaluation &

Effectiveness

Science-Centric Public-Value Oriented

Flexibility

Constrained Responsive

Human

Capital

Narrow Broad

Boundary

Management

Limited Broad

Page 27: New A Typology of Research Activities and Attributes to Inform …cpo.noaa.gov/sites/cpo/RISA/Usable Science_McNie.pdf · 2015. 3. 18. · Science Serving Society •Called upon to

Example: Is a Coffee Tree a Tree?

• Sumberjaya Indonesia • Government mandated

‘Protection Forests’ • Coffee trees not considered

‘trees’ • Limited opportunities for

livelihoods • Research question: Do coffee

trees provide similar services as timber trees?

• Answer: yes

Page 28: New A Typology of Research Activities and Attributes to Inform …cpo.noaa.gov/sites/cpo/RISA/Usable Science_McNie.pdf · 2015. 3. 18. · Science Serving Society •Called upon to

Activity

Attribute

Spectra of Research Criteria

Science Values User Values

1 2 3 4 5

Knowledge

Production

Expertise Epistemic Experiential

Relevance General Contextual

Disciplinary Focus Singular, Narrow Transdisciplinary, Diverse

Uncertainty Reduce Uncertainty Manage Uncertainty

Goals for Research Exploratory Outcome Oriented

Learning &

Engagement

Processes

Learning Theoretical Social, Practical

Knowledge Exchange Narrow Iterative, Influential

Network Participation Homogeneous Heterogeneous

Social Capital Negligible Significant

Organizational

& Institutional

Dynamics

Accessibility Constrained High

Outputs Narrow Diverse

Evaluation &

Effectiveness Science-Centric Public-Value Oriented

Flexibility Constrained Responsive

Human Capital Narrow Broad

Boundary Management Limited Broad

Page 29: New A Typology of Research Activities and Attributes to Inform …cpo.noaa.gov/sites/cpo/RISA/Usable Science_McNie.pdf · 2015. 3. 18. · Science Serving Society •Called upon to

0

0.5

1

1.5

2

2.5

3

3.5

4

4.5

5

Expertise

Relevance

Disciplinary Focus

Uncertainty

Goals for Research

Learning

Knowledge Exchange

Network Participation

Social Capital

Power

Brokering

Accessibility

Outputs

Evaluation

Flexibility

Human Capital

Series1

Page 30: New A Typology of Research Activities and Attributes to Inform …cpo.noaa.gov/sites/cpo/RISA/Usable Science_McNie.pdf · 2015. 3. 18. · Science Serving Society •Called upon to

Future Directions of Typology

• Test assumptions

• Hold workshops on how to use

• Identify and collaborate with programs to use typology