Tracking PSM Grads via Social MediaSheila Tobias

NPSMA-Denver 2012

Early Measures of “Success”

• Willingness of faculty/deans to mount program

• Willingness of students to enroll, pay tuition• Availability of local business/industry

government professionals to provide program advice, internships; assist in

students’ job search; hire grads

Tracking Grads Local/Haphazard

• With the exception of a few programs, from 2002 when first grads went onto job market until now, alumni tracking was haphazard, inadequate to maintain a data base

• Exceptions: Rice, Oregon State, MSU-Math.• Overall, program directors had strong

indications that graduates got jobs. Where? Doing what? Tracking was not yet a priority

What Program Directors did know

• Names of their own Graduates• When and how many they produced• 2011 estimated total: 4,600 PSM graduates

“Tracking Grads Project”begins early spring 2011

• Overall goals:• To get base line information on a selection of

PSM grads; to test social media system(s) for locating them; to cost-out the process; to provide information (not data, not findings) to program directors who were not tracking their own grads; and to selected outsiders.

A Probe, not a Study

• Our work is a Probe, not a Study, certainly not an Evaluation:

• Where grads are working; Employers• What grads are doing; Job titles• Whether they’ve remained in the state where

they got their PSM- of particular interest to university chancellors; business leaders; governors; other stakeholders

Selection Criteria

• Older programs- grads out 4+years• Focus on Job titles for “workforce

enhancement”, ”jobs creation”• Deselected: grads whose companies

sponsored them (expecting them to stay in the company); interesting for later probes

• Most Bioinformatics – which have different “flavor” – fewer “plus” courses

Size of Sampling

• Overall 44 campus programs with single or multi-track programs

• 2,463 graduates named• 1,840 (76%) graduates located using multiple

on-line search strategies• Late-appearing in our study: 372 KGI MBS

graduates• Total 2,212

Overview of Programs Analyzed

Forensic

Name Biot

echn

olog

y/Bi

oscie

nce

MS

Biot

ech/

MBA

Mol

ecul

ar

Biol

ogy/

Gene

tics

Mar

ine

Biol

ogy

Appl

ied

Syst

emati

cs in

Bo

tany

Phys

ics /

Nan

osca

le

Subs

urfa

ce

Geos

cienc

e

Chem

istry

Envi

ronm

enta

l Sc

ienc

es

Envi

ronm

enta

l An

alys

is an

d De

cisio

n M

akin

g

Fin

ancia

l M

athe

mati

cs

Appl

ied

Indu

stria

l M

athe

mati

cs

Fore

nsic

Scie

nce

Anal

ytics

/ Ap

plie

d St

atisti

cs

Bios

tatis

tics/

Bi

oinf

orm

atics

Geos

patia

l In

form

ation

Sc

ienc

e an

d Te

chno

logy

Hum

an C

ompu

ter

Inte

racti

on

Heal

th C

are

Info

rmati

cs

Pros

theti

cs a

nd

Ort

hotic

s

Tota

l Pro

gram

s

CSUCI 2007 2008 2CWRU 2005 2002 2005 3Dayton 2006 1GT 2000 2000 1998 2004 4MSU 2002 1MTSU 2007 2006 2008 3NCSU 2005 2007 2008 2010 4NEU 2004 2005 2004 3NT 2010 2009 2OSU 2005 2005 2006 2003 4Penn St 2001 2008 2002 3Rice 2004 2005 2004 3San Jose 2004 2010 2Texas A&M 2001 1UA 2001 1UConn 2000 2006 2UNI 2007 1UT EP 2003 1UT SA 2005 1WPI 2002 2003 2

44

Health Bio Physical Sciences Environment Math Analytics

Reporting

• Only program directors who provide names get full picture of grads including names; outsiders, get sanitized lists of summaries without names of grads, names of companies, only aggregated findings

• State retention data of particular salience to system heads, state economic development entities.

Geographical Distribution of PSM Graduates

Example of Program-Specific Data Rice University

Id Institution Year ProgramIn

State Job Placement (Last Known) Type Job Title

690 Rice 2004 Environmental Analysis and Decision Making N PBS&J LC Associate Project Manager

691 Rice 2004 Environmental Analysis and Decision Making N Delta Institute Non-profit Senior Director

692 Rice 2004 Environmental Analysis and Decision Making N Thompson Strategy Consulting SC Principal

693 Rice 2004 Nanoscale Physics N ISG Interests SC Management Consultant

694 Rice 2004 Nanoscale Physics Y Rice University Edu PhD student

695 Rice 2005 Environmental Analysis and Decision Making N Ziebel SC Field Service Manager

696 Rice 2005 Environmental Analysis and Decision Making N Weston Solutions INC LC Data Manager

697 Rice 2005 Environmental Analysis and Decision Making Y Sage Environmental Consulting MC Environmental Specialist

698 Rice 2005 Environmental Analysis and Decision Making Y Rice University Edu PhD student

699 Rice 2005 Subsurface Geoscience Y Halliburton LC Geophysicist

700 Rice 2006 Environmental Analysis and Decision Making Y Trinity Consultants MC Environmental Consultant

701 Rice 2006 Environmental Analysis and Decision Making U U

702 Rice 2006 Environmental Analysis and Decision Making N Tetra Tech LC Environmental Services Professional

North Carolina State University

Id Year Program In State Employer Type Title

1461 5/9/2009 Analytics Y Bank of America LC VP, Market Information Manager

1462 5/9/2009 Analytics Y SAS LC Analytical Engineer

1463 5/9/2009 Analytics Y Targetbase MC Senior Analyst

1464 5/9/2009 Analytics N Recall LC SQL DBA

1542 5/9/2009 Financial Mathematics Y North Carolina Solar Center SC Analyst

1543 5/9/2009 Financial Mathematics N Southern California Gas Company LC Financial & Strategic Analysis Project Manager

1544 5/9/2009 Financial Mathematics Y Duke University Edu PhD Student

1545 5/9/2009 Financial Mathematics Y NCSU Edu Graduate Student

1593 5/9/2009 Microbial Biotechnology Y The Hamner Institutes for Health Sciences Non-profit Marketing and Communications Coordinator

1594 5/9/2009 Microbial Biotechnology Y Dartmouth College Edu Graduate Student

1595 5/9/2009 Microbial Biotechnology U U

1596 5/9/2009 Microbial Biotechnology Y Xanofi, SC VP Product Development

Georgia TechId Year Program In State Employer Type Title

329 2010 Prosthetics and Orthotics Y Atlanta Prosthetics & Orthotics, Inc SC Residency

330 2010 Prosthetics and Orthotics U U

331 2010 Prosthetics and Orthotics N OPERF Non-profit Residency

332 2010 Prosthetics and Orthotics N University of Michigan Edu Residency

348 2010 Human Computer Interaction N U

355 2010 Human Computer Interaction N Department of Homeland Security Gov Intern

371 2010 Human Computer Interaction U U

376 2010 Human Computer Interaction Y Georgia Institute of Technology Edu PhD Student

394 2010 Human Computer Interaction N USTRANSCOM Gov Chief Engineer

411 2010 Human Computer Interaction Y Georgia Institute of Technology Edu Masters Student

421 2010 Human Computer Interaction N Nokia LC Computational Media Designer

428 2010 Human Computer Interaction N Nokia LC User Experience Specialist

University of Connecticut

Id Year Program In State Employer Type Title

1269 Spring 2010 Applied Genetics Y Illumnia LC Staff

1270 Spring 2008 Applied Genetics Y Genomas SC Clinical Research Scientist

1271 Fall 2009 Applied Genetics Y Illumnia LC Staff

1272 Spring 2009 Applied Genetics Y Private company LC ?

1273 Spring 2007 Applied Genetics Y ? Gov ?

1274 Spring 2010 Applied Genetics N Yale School of Medicine Edu Staff

1331 Summer 2006 Applied Mathematics Y Caldwell Funding Corporation SC Financial Analyst

1332 Summer 2006 Applied Mathematics N Texas Tech University Edu Assistant Professor

1337 Spring 2008 Applied Mathematics Y University of Connecticut Edu Student

1338 Fall 2008 Applied Mathematics N OpenLink Financial MC Risk Analyst

1339 Summer 2004 Applied Mathematics N Bank of America LC Strategic Analyst

1340 Spring 2008 Applied Mathematics N Endurance MC Analyst

Worcester Polytechnic Institute

Id Year Program In State Employer Type Title

1107 2003 Financial Mathematics Y Fidelity Investments LC Manager

1108 2003 Financial Mathematics Y Putnam LC Portfolio Manager

1109 2003 Financial Mathematics N BB&T Corporation LC VP / ALM Forecast Coordinator

1113 2004 Financial Mathematics Y Mechanics Cooperative Bank MC Vice President & Controller

1115 2004 Financial Mathematics Y Sun Life Financial LC Actuarial Officer

1122 2005 Financial Mathematics N Cidel Financial Group MC Investment Analyst

1123 2005 Financial Mathematics N Federal Communications Commission Gov Data Analyst

1124 2005 Financial Mathematics N JP Morgan Chase LC Associate

1125 2005 Financial Mathematics N Aflac LC Investment Risk management consultant

1110 2003 Industrial Mathematics N Applied Mathematics, Incorporated SC Mathematician

1111 2003 Industrial Mathematics N University of Utah Edu Assistant Professor

1118 2004 Industrial Mathematics Y Kiva Systems SC Simulation Analyst

San Jose State Univesity

Id Year Program In State Employer Type Title

1777 2010 Medical Product Devices Y Abbott LC Manager

1778 2010 Medical Product Devices Y BD Bioscience LC Lead Scientist

1779 2010 Medical Product Devices Y Acclarent MC Senior Data Manager

1780 2010 Medical Product Devices Y Abbott LC Sr. CRA

1781 2010 Medical Product Devices Y Genentech LC Formulations Scientist

1782 2011 Medical Product Devices Y JP Morgan Chase LC Senior Consultant

1783 2011 Medical Product Devices Y Abbott LC Project Manager

1784 2011 Medical Product Devices Y unemployed U Intern

1785 2011 Medical Product Devices Y Elan Pharmaceutical LC Senior Associate

1786 2011 Medical Product Devices Y Janssen Alzheimer’s Unit MC Clinical Records Assoc

1787 2011 Medical Product Devices Y Protrials Clinical CRO MC Clinical Research Assistant

1788 2011 Medical Product Devices Y Abbott LC Statistical Analyst

1789 2011 Medical Product Devices Y Entrovita SC Clinical Scientist

1790 2011 Medical Product Devices Y Access Closure SC Clinical Research Associate

Case Western

Id Year Program In State Employer Type Title

127 2006 Biotechnology N ChinaBio Capital Partners SC Life Science Entrepreneur and Investor

130 2006 Chemistry N Polteco Inc. SC Research Services

131 2006 Physics N juwi Wind SC Associate Project Manager

133 2006 Physics Y Tau Zero Foundation Non-profit Interstellar Propulsion Pioneer

134 2007 Biotechnology Y Arteriocyte, Inc SC Senior Manager

135 2007 Physics Y Case Western Reserve University Edu Student

137 2007 Physics N University of Arizona Edu Licensing Associate

139 2008 Chemistry Y PolyOne Corporation LC Senior Product Manager

140 2008 Physics Y Phycal LLC SC Business Development Specialist141 2009 Biotechnology Y Arteriocyte Inc SC Project Scientist

144 2010 Biotechnology N Strategic Analysis India MC Consultant

146 2010 Biotechnology Y Case Western Reserve University Edu Research Assistant

152 2010 Biotechnology N Medtronic LC Associate Sales Representative

Keck Graduate Institute

Id Year Program In State Employer Type TitleK 2009 MBS CA Abbott Medical Optics LC Regulatory Affairs Data CoordinatorK 2009 MBS PA Amgen LC CI AnalystK 2009 MBS CA Amgen LC Senior Associate Regulatory AffairsK 2009 MBS CA Baxter Healthcare Corporation LC ODP AssociateK 2009 MBS CA Baxter Healthcare Corporation LC ODP AssociateK 2009 MBS CA Baxter Healthcare Corporation LC ODP AssociateK 2009 MBS CA Beckman Coulter, Inc. LC Account Sales ConsultantK 2009 MBS CA Cobalt Biofuels SC Bioprocessing Research AssociateK 2009 MBS CA Fluidigm MC Research Associate IIK 2009 MBS CA Genentech, Inc. LC Engineering Track PlannerK 2009 MBS CA Genentech, Inc. LC Research AssistantK 2009 MBS IN Indiana State University Edu PhD CandidateK 2009 MBS CA Keck Graduate Institute of Applied Life Sciences Edu -K 2009 MBS CA Larta Institute Non-Profit Program Manager

Where are They Living?

Location of 79% of Grads found

Where are They Working?

Employment type for 75% of Grads found

Private Sector Employment for Programs and Institutions

Top 10 Employers for each Field

Employer Type Analytics

SAS LC 38

Deloitte LC 9

Roundarch MC 7

Bank of America LC 6

Novartis LC 6

Centers for Disease Control & Prevention Gov 5

Google LC 5

SapientNitro LC 4

Verizon LC 4

AT&T Mobility LC 3

Employer Type Bio

Amgen LC 24

Novartis LC 12

Biogen Idec LC 9

Genzyme Corporation LC 8

Life Technologies LC 8

Merck LC 7

Abbott LC 6

Pfizer LC 6

Self-employed SC 6

Walter Reed Army Institute of Research Gov 6

Employer Type Applied MathBank of America LC 19

Sun Trust Bank LC 11

SAS LC 7

Credit Suisse LC 6

ING LC 6

JP Morgan Chase LC 6

UBS LC 6

WatsonWyatt & Company LC 6

Barclays Capital LC 5

Progress Energy LC 5

Top Employers for KGI Graduates

Sample contains 346 employers

Employer Type Count PercentageAmgen LC 34 10%Genentech LC 18 5%Baxter LC 14 4%Campbell Alliance MC 10 3%Regeneron LC 7 2%Beckman Coulter LC 6 2%City of Hope Non-profit 6 2%Gilead LC 6 2%L.E.K. Consulting MC 6 2%Novartis LC 5 1%

More Details - Top Employers for the “Bio” Program Sample

849 Records 79% completeness (Missing information for 186 graduates)

More Details - Top Employers for the “Applied Math” Program Sample

Bank of America Sun Trust Bank

SAS

Credit Suisse

ING

JP Morgan Chase

UBS

WatsonWyatt & Company

Barclays Capital Progress Energy

Citigroup

Federal Home Loan Bank HSBC Bank North America

KPMG LLPMorgan Stanley

BB&T Deloitte

Deutsche Bank Ernst & YoungFidelity Investments

HSBC

..McKinley Capital Manageme

MSCI Inc

Royal Bank of ScotlandSun Life Financial

0

5

10

15

20

Number of Records

Type of Employer

Large Company > 1000

Medium Company 100 - 1000

Small Company < 100

641 Records 73% completeness (Missing information for 173 graduates)

More Details - Top Employers for the “Analytics” Program Sample

723 Records 76% completeness (Missing information for 169 graduates)

Continued - Employers

Environmental and Forensic programs set too small to show as each employer has only hired only one PSM graduate

Employer Type Health

Abbott LC 4

Atlanta Prosthetics & Orthotics, Inc SC 3

BlueCross BlueShield of Tennessee LC 3

Hanger Orthopedic Group LC 2

NOPCO SC 2

Health: generally small sized employers Small set of graduates – limited

number of employers

Broad Categories of Job Titles

Percentage given for all records (count of 2464 individuals)62% of Graduates had clearly identifiable job titles

Job Titles Telling a Story

With time PSM leading to senior positions in employment

Conclusions in re PSMs

• PSM programs lead mainly to private sector employment in both large and small companies.

• Fewer grads in government (7%) though undercounting probable since gov’t professionals may not be on social media

• Foreigners returning to their home country are hardest to track.

What about Reliability of Self -reporting on Social Media

Cornell study showed that resumes submitted to LinkedIn are more reliable due to public vetting that self-reporting by interviews

A local U of Arizona effort to track graduate teachers showed <15% on standard professional sites. Different jobs-finding strategies; more standard career trajectories

Other uses for Graduates’ Tracking

Data on graduates’ career development by program, by field.

Attracting nation-wide employer advisory boards based on graduates’ placement

Grouping PSM Alumni as Ambassadors Gaining Higher National Profile (Media

Coverage and Long-term Financing)