AIR Conference Presentation

AGENDA Background / Introduction

Implications for Research Planning

o Funding

o Collaboration

o Talent Allocation

Summary

4

• Crosses national boundaries

• Overarches multi-jurisdictional regulation

• Networks energetically in real and virtual space and time

• Straddles between competition and collaboration

• Exhibits high mobility of resources, people, ideas, technologies and infrastructure

• Responds and reacts to public and private pressures

THE NEW REALITY OF RESEARCH TODAY

MEASURING RESEARCH PERFORMANCE

Challenges Approach

Understanding interidisciplinary

research activities

• Currently, rely on the journal-

level subject classifications

Article-level classification

• To understand interdisciplinary

research activities

Understanding research activities

conducted at a granular level

• Subject areas defined too broadly

Co-citation clusters represent specific

research problems

• To identify research activity

at a granular level

Need to understand strategic

implications for research planning

• Research environment is

increasingly competitive

Visualized research strengths at

national and/or institutional level

• Comprehensive and strategic

understanding

VARIOUS DATA AVAILABLE TO IDENTIFY OVERALL RESEARCH ACTIVITY

Source: Scopus, Analysis

Number of Publications

2004-2008 Subject Areas

AAGR

9.48%

Total

40,102

Papers

(2004-2008)

CONFIRM UNIQUE RESEARCH STRENGTHS

MULTI-DISCIPLINARY

RESEARCH AREAS

MEDICAL SPECIALTIES BIOTECHNOLOGY

INFECTIOUS

DISEASES

BIOLOGY

EARTH SCIENCES

ENGINEERING

CHEMISTRY

MATH & PHYSICS COMPUTER SCIENCE

SOCIAL SCIENCES

BRAIN RESEARCH

HEALTH SCIENCES

GLOBAL RESEARCH COMPETENCY

Source: SciVal Spotlight 2008

HUMANITIES

UNDERSTAND RESEARCH POTENTIAL


GR

OW

TH

RELATIVE PUBLICATION SHARE

HIGH

LOW HIGH LOW

NATIONAL AND INSTITUTIONAL ANALYSES

National Level Institutional Level

“Looking at the map is good … but can’t we do anything more using the data?”


Implications for Research Planning

o Funding

o Collaboration

o Talent Allocation

Summary

IMPLICATIONS: FUNDING

Challenges faced

by research executives

“We need to gain more competitive funding from the government, but how?”

“Are we making use of all the opportunities we have to gain funds?”

“What objective reasons can we provide when requesting funding?”

Methodology

Research Competencies

Award data


STEP 1: IDENTIFY RESEARCH COMPETENCIES

Researcher Keywords

43

22

4 7

24

46

16

55 12

35

47

11

#

11 Life Science-related Competencies Details for each competency


# Fund

2006-7 Fund

2008-9 Who What When ¥

STEP 2: IDENTIFY FUNDING PER COMPETENCY

4

7

11

12

16

22

24

43

46

47

55

37.8

18.9

16.6

6.8

21.3

41.5

0

3.2

18.7

0

0

6.6

17.3

0

3.8

6.6

0

0

8.8

84.6

0

0

－

－

－

Per Top Researcher Per Competency

⊿

Source: SciVal Spotlight 2007, Japanese Funding Database

SIX UNDERFUNDED RESEARCH AREAS IDENTIFIED Change in amount of funds

gained between 06/07 and 08/09

Positioning of research area

within strength portfolio

Strengths in Life science related subject areas

n=11

Underfunded strength areas

n=6

3

3

5

0

10

20

30

40

50

60

70

80

90

100

Increase in funds or

ongoing project

Decrease in funds from

06/07 to 08/09

No funds gained in 2008/9

3 High growth area,

however low publication share

Relatively low growth area, however high

publication share 3

Source: SciVal Spotlight 2007, analysis

(%)

TAKE AWAY: MAXIMIZE AWARD POTENTIAL

Gaps between areas of research strength and well-funded

research areas were identified from analysis

Underfunded research areas where funding is decreasing or

getting little funding also had good objective reason (high growth

or high publication share) to apply for further funding

Manual analysis using SciVal Spotlight data can provide various

insight to further increase funding

“Gaining research funding is getting competitive year by year.

We need to utilize any information available to maintain and

further increase our competitiveness.” (Vice President, Japanese University)


Implications to Research Planning

o Funding

o Collaboration

o Talent Allocation

Summary

IMPLICATIONS: COLLABORATION Challenges faced


“How can we identify our interdisciplinary strengths and the faculty that are contributing to these research areas?”

“Are there different approaches to

interdisciplinary research that we are supporting?”

“How can we scale these contributions as

‘best practices’ across our institution?”

Methodology


COMPARE COMPETENCY DISTRIBUTION


INTERDISCIPLINARY RESEARCH APPROACHES


Collaboration leaders

•Active, influential, and innovative

•Strong network across campus –

“super-connectors”

•Two distinct approaches to

interdisciplinary research

TAKE AWAY: SUPPORT CONNECTIVITY

•Funding agencies like the National Institutes of Health encourage

“interdisciplinary and multidisciplinary research”,* so supporting cross-

disciplinary initiatives may benefit a university by way of increased funding and

publication success.

Manual analysis using SciVal Spotlight data can provide insight into:

Understanding overall collaboration activities within an institution and

with external research partners

Status of research areas where collaboration is happening today

Identify opportunities for future collaboration

Monitoring these results over time can provide university management

further insight into strategic research planning

Source: In reference to Research Project Grants (RO1) from http://grants.nih.gov/



o Funding

o Collaboration

o Talent Allocation

Summary

IMPLICATIONS: TALENT ALLOCATION Challenges faced


“Do we have the right researcher in the right team? How can we figure that out?”

“Which talent are we lacking in each of the research teams?”

“Which researcher should be the leader of a new multi-disciplinary research team?”

Methodology


“FIND”

SEARCH FOR PRESENCE OF FACULTY

Find authors, keywords, or disciplines Result

OVERALL RESULT

62

24 44

14

4

0

20

40

60

80

100 Five Areas

(1 researcher)

Four Areas (1 researcher)

Three Areas (4 researchers)

Two Areas (14 researchers)

One Area (24 researchers)

(%)

Researcher present in map

Not found from search

Overall search result

(n=106)

Source: SciVal Spotlight 2007, Analysis

Number of competencies

each researcher contributes to (n=44)

ALLOCATION OF STRENGTHS

1 2 6 13 40 43 45 48 49 52 61 64 74 77 80 102 104 107

Competency Number

Group

A

Group

B

Group A: Researcher with same/similar strength

Group B: How to allocate talent for multi-disciplinary group

Source: SciVal Spotlight 2007, Analysis

TAKE AWAY: ORGANIZATIONAL EFFECTIVENESS

Search function in SciVal Spotlight can help identify “which” competency and

“how many” competencies each individual researcher is involved in

A researcher involved in multiple competencies might be

a good candidate to lead interdisciplinary research groups

Result from these analysis and internal discussion with research managers can

provide insight into how to further improve talent allocation

“I am quite amazed that the result is reflecting the reality of our organization! This evidence can help us to facilitate discussion with each research group.” (Director General, Government research institution)



o Funding

o Collaboration

o Talent Allocation

Summary

SUMMARY

Measuring research performance is inherently challenging

Emerging areas of research

Interdisciplinary activity

Transnational initiatives

Manual analysis using data from Spotlight can help with objective and

informed decision-making

Funding: Identify underfunded research competencies and use

information in Spotlight in future grant applications

Collaboration: Monitor collaboration activities within and outside of an

institution and identify future collaboration areas with global leaders

Talent Allocation: Identify interdisciplinary talent and reflect to

strategic allocation of talent to facilitate HR discussions

…. and many more

THANK YOU

Brie Betz A&G Products [email protected]

mailto:[email protected]

AIR Conference Presentation

Documents

Transcript of AIR Conference Presentation