Creating a Culture of Shared Knowledge Democratizing Your ......Creating a Culture of Shared...

34
Creating a Culture of Shared Knowledge Democratizing Your Organization’s Data via Dynamic Reporting Matt Stevens and Geoffrey Kip Benefits Data Trust

Transcript of Creating a Culture of Shared Knowledge Democratizing Your ......Creating a Culture of Shared...

Page 1: Creating a Culture of Shared Knowledge Democratizing Your ......Creating a Culture of Shared Knowledge – Democratizing Your Organization’s Data via Dynamic Reporting Matt Stevens

Creating a Culture of Shared Knowledge –

Democratizing Your Organization’s Data via

Dynamic Reporting Matt Stevens and Geoffrey Kip

Benefits Data Trust

Page 2: Creating a Culture of Shared Knowledge Democratizing Your ......Creating a Culture of Shared Knowledge – Democratizing Your Organization’s Data via Dynamic Reporting Matt Stevens

Agenda

• Background

• Data and Reporting Key Concepts

• Best Practices

• Case Studies

• Additional Resources

• Q & A

Creating a Culture of Shared Knowledge –

Democratizing Your Organization’s Data via Dynamic Reporting

Matt Stevens and Geoffrey Kip

Benefits Data Trust

Page 3: Creating a Culture of Shared Knowledge Democratizing Your ......Creating a Culture of Shared Knowledge – Democratizing Your Organization’s Data via Dynamic Reporting Matt Stevens

Learning Objectives

• How services agencies can utilize client data

for outreach

• The benefits of dynamic reporting for your

organization

• Examples of dynamic reports and reporting

best

practices

• Publicly available resources to help building

your own dynamic reports

Creating a Culture of Shared Knowledge –

Democratizing Your Organization’s Data via Dynamic Reporting

Matt Stevens and Geoffrey Kip

Benefits Data Trust

Page 4: Creating a Culture of Shared Knowledge Democratizing Your ......Creating a Culture of Shared Knowledge – Democratizing Your Organization’s Data via Dynamic Reporting Matt Stevens

Creating a Culture of Shared Knowledge –

Democratizing Your Organization’s Data via Dynamic Reporting

Matt Stevens and Geoffrey Kip

Benefits Data Trust

About BDT

Benefits Data Trust is a

not-for-profit social

change organization

committed to

transforming how

individuals in need

access public

benefits and

services.

Page 5: Creating a Culture of Shared Knowledge Democratizing Your ......Creating a Culture of Shared Knowledge – Democratizing Your Organization’s Data via Dynamic Reporting Matt Stevens

Creating a Culture of Shared Knowledge –

Democratizing Your Organization’s Data via Dynamic Reporting

Matt Stevens and Geoffrey Kip

Benefits Data Trust

Data Science for Individual

Impact • Targeted Identification

– Import lists of clients provided by partner agencies

– Match against current outreach pool to understand what benefits clients are already receiving and estimate what they may be eligible for

• Effective Outreach – Weekly batches of mail outreach to eligible individuals

– Forecast anticipated responses, applications

• Continual Analysis and Evaluation – Internal and External Reporting

Page 6: Creating a Culture of Shared Knowledge Democratizing Your ......Creating a Culture of Shared Knowledge – Democratizing Your Organization’s Data via Dynamic Reporting Matt Stevens

Creating a Culture of Shared Knowledge –

Democratizing Your Organization’s Data via Dynamic Reporting

Matt Stevens and Geoffrey Kip

Benefits Data Trust

Data Science for Systems Impact

• Internal Research – Work with contact center to understand how we can

better serve our clients

• What challenges do they face with the application process?

– Analyze data on enrollment outcomes

• What challenges do clients face after application submission?

• Data for Good

Page 7: Creating a Culture of Shared Knowledge Democratizing Your ......Creating a Culture of Shared Knowledge – Democratizing Your Organization’s Data via Dynamic Reporting Matt Stevens

Creating a Culture of Shared Knowledge –

Democratizing Your Organization’s Data via Dynamic Reporting

Matt Stevens and Geoffrey Kip

Benefits Data Trust

Data Science for Social Impact

• External Research to Understand Impact of

Benefits on Health Outcomes – MD Duals Research – Johns Hopkins / Hilltop Institute

– MIT Random Control Trial – J-PAL North America

Page 8: Creating a Culture of Shared Knowledge Democratizing Your ......Creating a Culture of Shared Knowledge – Democratizing Your Organization’s Data via Dynamic Reporting Matt Stevens

Creating a Culture of Shared Knowledge –

Democratizing Your Organization’s Data via Dynamic Reporting

Matt Stevens and Geoffrey Kip

Benefits Data Trust

Data Driven Strategies

Uses benefit

enrollment data to

identify, outreach

and apply likely

eligible seniors and

individuals into

benefit programs like

SNAP and Medicaid

Page 9: Creating a Culture of Shared Knowledge Democratizing Your ......Creating a Culture of Shared Knowledge – Democratizing Your Organization’s Data via Dynamic Reporting Matt Stevens

Creating a Culture of Shared Knowledge –

Democratizing Your Organization’s Data via Dynamic Reporting

Matt Stevens and Geoffrey Kip

Benefits Data Trust

The Challenge:

Scaling Your Data Team

Pennsylvania : submitted 500,000 applications

since 2005

Analyst

Page 10: Creating a Culture of Shared Knowledge Democratizing Your ......Creating a Culture of Shared Knowledge – Democratizing Your Organization’s Data via Dynamic Reporting Matt Stevens

Creating a Culture of Shared Knowledge –

Democratizing Your Organization’s Data via Dynamic Reporting

Matt Stevens and Geoffrey Kip

Benefits Data Trust

The Challenge:

Scaling Your Data Team Pennsylvania

Analyst

Analyst

Maryland

Submitted 45k

applications since 2012

Page 11: Creating a Culture of Shared Knowledge Democratizing Your ......Creating a Culture of Shared Knowledge – Democratizing Your Organization’s Data via Dynamic Reporting Matt Stevens

Creating a Culture of Shared Knowledge –

Democratizing Your Organization’s Data via Dynamic Reporting

Matt Stevens and Geoffrey Kip

Benefits Data Trust

The Challenge:

Scaling Your Data Team

Pennsylvania

Maryland

Analyst

New York City

Submitted 22k

applications

since 2014

Analyst

Analyst

Page 12: Creating a Culture of Shared Knowledge Democratizing Your ......Creating a Culture of Shared Knowledge – Democratizing Your Organization’s Data via Dynamic Reporting Matt Stevens

Creating a Culture of Shared Knowledge –

Democratizing Your Organization’s Data via Dynamic Reporting

Matt Stevens and Geoffrey Kip

Benefits Data Trust

The Challenge:

Scaling Your Data Team

Pennsylvania

Maryland

Analyst

New York City

Analyst

Analyst

Analyst

SC

9k

Since

2015

CO

5k

Since

2015

Page 13: Creating a Culture of Shared Knowledge Democratizing Your ......Creating a Culture of Shared Knowledge – Democratizing Your Organization’s Data via Dynamic Reporting Matt Stevens

Creating a Culture of Shared Knowledge –

Democratizing Your Organization’s Data via Dynamic Reporting

Matt Stevens and Geoffrey Kip

Benefits Data Trust

The Opportunity

• In a growing organization, the demand for

data out paces the analytics team’s ability

to provide answers

• As data availability spreads, an

organization’s decision making becomes

decentralized

– Empower your teams by putting meaningful

data at their fingertips

Page 14: Creating a Culture of Shared Knowledge Democratizing Your ......Creating a Culture of Shared Knowledge – Democratizing Your Organization’s Data via Dynamic Reporting Matt Stevens

Creating a Culture of Shared Knowledge –

Democratizing Your Organization’s Data via Dynamic Reporting

Matt Stevens and Geoffrey Kip

Benefits Data Trust

Core Concepts:

Data Democratization

• Breaking down silos to give everyone a

better understanding of the org’s data

Page 15: Creating a Culture of Shared Knowledge Democratizing Your ......Creating a Culture of Shared Knowledge – Democratizing Your Organization’s Data via Dynamic Reporting Matt Stevens

Creating a Culture of Shared Knowledge –

Democratizing Your Organization’s Data via Dynamic Reporting

Matt Stevens and Geoffrey Kip

Benefits Data Trust

The Opportunity:

Self-Service Reporting

Infrastructure

Data Science

Team

Targeted

Identification

Effective Outreach

Comprehensive

Application

Assistance

Continual Analysis

and Evaluation

Strategic Systems

Change

Proactive Thought

Leadership

Page 16: Creating a Culture of Shared Knowledge Democratizing Your ......Creating a Culture of Shared Knowledge – Democratizing Your Organization’s Data via Dynamic Reporting Matt Stevens

Creating a Culture of Shared Knowledge –

Democratizing Your Organization’s Data via Dynamic Reporting

Matt Stevens and Geoffrey Kip

Benefits Data Trust

Core Concepts:

Data Literacy • Data literate teammates1

– know the different kinds of data that exist and which kind of data to use for which decisions

– Evaluate the accuracy and sufficiency of each kind of data they will use

– Transform data from a variety of sources into actionable information to guide decisions

– Hold themselves accountable for ethical generation, interpretation, and application of data

1 -‘Data Literacy – What it is and How it Differs from Assessment Literacy’ – Kathy

Dyer nwea.org

Page 17: Creating a Culture of Shared Knowledge Democratizing Your ......Creating a Culture of Shared Knowledge – Democratizing Your Organization’s Data via Dynamic Reporting Matt Stevens

Creating a Culture of Shared Knowledge –

Democratizing Your Organization’s Data via Dynamic Reporting

Matt Stevens and Geoffrey Kip

Benefits Data Trust

Core Concepts:

• Dynamic Reporting

• Insight Democratization

• Data Literacy

• Data Democratization

Page 18: Creating a Culture of Shared Knowledge Democratizing Your ......Creating a Culture of Shared Knowledge – Democratizing Your Organization’s Data via Dynamic Reporting Matt Stevens

Creating a Culture of Shared Knowledge –

Democratizing Your Organization’s Data via Dynamic Reporting

Matt Stevens and Geoffrey Kip

Benefits Data Trust

Case Studies

• Goal Progress Report

• Outcome Reporting

• Human Centered Design Workshop

Page 19: Creating a Culture of Shared Knowledge Democratizing Your ......Creating a Culture of Shared Knowledge – Democratizing Your Organization’s Data via Dynamic Reporting Matt Stevens

Creating a Culture of Shared Knowledge –

Democratizing Your Organization’s Data via Dynamic Reporting

Matt Stevens and Geoffrey Kip

Benefits Data Trust

Goals Progress Report 04/10/2017 Summary of Goal Progress by Project

Contract Contract Period

Applications

to Date

Contract

Goal

Progress to

Goal

Percent of

Contract period

Completed Goal 1 October 1, 2016 - September 30, 2017 14,711 45,000 33% 52%

Goal 2 October 1, 2016 - September 30, 2017 17,268 25,000 69% 52%

Goal 3 October 1, 2016 - September 30, 2017 5,496 11,000 50% 52%

Goal 4 July 1, 2016 - June 30, 2017 8,188 11,000 74% 78%

Goal 5 July 1, 2016 - June 30, 2017 4,583 7,000 65% 78%

Goal 6 September 16, 2016 - September 15, 2017 1,840 1,700 100% 57%

Goal 7 July 1, 2016 - June 30, 2017 1,287 1,000 100% 78%

Goal 8 October 1, 2016 - September 30, 2017 3,368 6,000 56% 52%

Goal 9 October 1, 2016 - September 30, 2017 1,610 7,150 23% 52%

Goal 10 August 1, 2016 - June 30, 2017 5,728 6,500 88% 76%

Goal 11 July 1, 2016 - June 30, 2017 4,560 5,000 91% 78%

Goal 12 July 1, 2016 - June 30, 2017 1,888 2,500 76% 78%

Goal 13 July 1, 2016 - June 30, 2017 2,672 2,500 100% 78%

Goal 14 October 1, 2016 - September 30, 2017 1,805 2,800 64% 52%

Page 20: Creating a Culture of Shared Knowledge Democratizing Your ......Creating a Culture of Shared Knowledge – Democratizing Your Organization’s Data via Dynamic Reporting Matt Stevens

Creating a Culture of Shared Knowledge –

Democratizing Your Organization’s Data via Dynamic Reporting

Matt Stevens and Geoffrey Kip

Benefits Data Trust

Zipcode Screenings Applications

Submitted 18041 8 6 18054 8 6 18070 1 1 18073 10 8 18074 10 8 18076 12 9 18915 4 3 18936 1 1 18964 21 16 18969 22 17 19001 30 23 19002 37 28 19003 31 23 19004 12 9 19006 35 26 19009 2 2 19010 7 5 19012 8 6 19025 5 4 19027 32 24 19031 11 8 19034 6 5

313 235

Philadelphia Outcome Report 1/1/16 –

12/31/16

Page 21: Creating a Culture of Shared Knowledge Democratizing Your ......Creating a Culture of Shared Knowledge – Democratizing Your Organization’s Data via Dynamic Reporting Matt Stevens

Creating a Culture of Shared Knowledge –

Democratizing Your Organization’s Data via Dynamic Reporting

Matt Stevens and Geoffrey Kip

Benefits Data Trust

Human Centered Design

Workshop What is Human-Centered Design?

Human-centered design is a creative

approach to problem solving starts with the

people you're designing for and ends with

new solutions that are tailor made to suit

their needs.

Page 22: Creating a Culture of Shared Knowledge Democratizing Your ......Creating a Culture of Shared Knowledge – Democratizing Your Organization’s Data via Dynamic Reporting Matt Stevens

Creating a Culture of Shared Knowledge –

Democratizing Your Organization’s Data via Dynamic Reporting

Matt Stevens and Geoffrey Kip

Benefits Data Trust

Human Centered Design

Workshop

Page 23: Creating a Culture of Shared Knowledge Democratizing Your ......Creating a Culture of Shared Knowledge – Democratizing Your Organization’s Data via Dynamic Reporting Matt Stevens

Creating a Culture of Shared Knowledge –

Democratizing Your Organization’s Data via Dynamic Reporting

Matt Stevens and Geoffrey Kip

Benefits Data Trust

Recap: Key Points

• Dynamic Reporting

• Insight Democratization

• Data Literacy

• Data Democratization

Page 24: Creating a Culture of Shared Knowledge Democratizing Your ......Creating a Culture of Shared Knowledge – Democratizing Your Organization’s Data via Dynamic Reporting Matt Stevens

Creating a Culture of Shared Knowledge –

Democratizing Your Organization’s Data via Dynamic Reporting

Matt Stevens and Geoffrey Kip

Benefits Data Trust

Introduction to R

• R is a programming language and environment for statistical

computing.

• Open Source software: free and users can contribute to modify

• R can be modified to meet your needs and increase functionality.

• Can be used for different purposes such as data management,

statistical analysis, producing visualizations, maps, dynamic

dashboards and for machine learning.

Creating a Culture of Shared Knowledge –

Democratizing Your Organization’s Data via Dynamic Reporting

Matt Stevens and Geoffrey Kip

Benefits Data Trust

Page 25: Creating a Culture of Shared Knowledge Democratizing Your ......Creating a Culture of Shared Knowledge – Democratizing Your Organization’s Data via Dynamic Reporting Matt Stevens

R studio IDE

R studio is an add- on to R that provides a nice user interface and

Integrated Development Environment (IDE) for R.

Creating a Culture of Shared Knowledge –

Democratizing Your Organization’s Data via Dynamic Reporting

Matt Stevens and Geoffrey Kip

Benefits Data Trust

Page 26: Creating a Culture of Shared Knowledge Democratizing Your ......Creating a Culture of Shared Knowledge – Democratizing Your Organization’s Data via Dynamic Reporting Matt Stevens

What is Shiny?

• Interactive web applications great for visualizing

R data

• No web development skills (HTML+CSS,

JavaScript) needed but can customize further if

you do have them

• Ability to use R language and all R packages

• Shiny is a package available in R studio

(https://www.rstudio.com/)

Creating a Culture of Shared Knowledge –

Democratizing Your Organization’s Data via Dynamic Reporting

Matt Stevens and Geoffrey Kip

Benefits Data Trust

Page 27: Creating a Culture of Shared Knowledge Democratizing Your ......Creating a Culture of Shared Knowledge – Democratizing Your Organization’s Data via Dynamic Reporting Matt Stevens

Why use Shiny?

• Many customization options (access to R and all

packages)

• Ability to deploy and host apps on Shiny server

• Many users can view the apps at the same

time

• Affordable

• Good alternative or addition to other

BI/dashboard tools eg. Qlik, Tableau, Looker

Creating a Culture of Shared Knowledge –

Democratizing Your Organization’s Data via Dynamic Reporting

Matt Stevens and Geoffrey Kip

Benefits Data Trust

Page 28: Creating a Culture of Shared Knowledge Democratizing Your ......Creating a Culture of Shared Knowledge – Democratizing Your Organization’s Data via Dynamic Reporting Matt Stevens

Examples

https://geoffkip.shinyapps.io/Goal_Progress/

Creating a Culture of Shared Knowledge –

Democratizing Your Organization’s Data via Dynamic Reporting

Matt Stevens and Geoffrey Kip

Benefits Data Trust

Page 29: Creating a Culture of Shared Knowledge Democratizing Your ......Creating a Culture of Shared Knowledge – Democratizing Your Organization’s Data via Dynamic Reporting Matt Stevens

Creating a Culture of Shared Knowledge –

Democratizing Your Organization’s Data via Dynamic Reporting

Matt Stevens and Geoffrey Kip

Benefits Data Trust

https://geoffkip.shinyapps.io/benephilly_map_gk/

Page 30: Creating a Culture of Shared Knowledge Democratizing Your ......Creating a Culture of Shared Knowledge – Democratizing Your Organization’s Data via Dynamic Reporting Matt Stevens

Examples

https://xavierign.shinyapps.io/BDT-Scorecard/

Creating a Culture of Shared Knowledge –

Democratizing Your Organization’s Data via Dynamic Reporting

Matt Stevens and Geoffrey Kip

Benefits Data Trust

Page 31: Creating a Culture of Shared Knowledge Democratizing Your ......Creating a Culture of Shared Knowledge – Democratizing Your Organization’s Data via Dynamic Reporting Matt Stevens

Examples

https://www.rstudio.com/products/shiny/shiny-user-showcase/

Creating a Culture of Shared Knowledge –

Democratizing Your Organization’s Data via Dynamic Reporting

Matt Stevens and Geoffrey Kip

Benefits Data Trust

Page 32: Creating a Culture of Shared Knowledge Democratizing Your ......Creating a Culture of Shared Knowledge – Democratizing Your Organization’s Data via Dynamic Reporting Matt Stevens

Resources to start using R and Shiny

• R Online Learning:

• https://www.rstudio.com/online-learning/

• Shiny Webinar Series:

• http://shiny.rstudio.com/tutorial/video/

• Websites like EDX, Coursera, Udemy all

provide free courses and certifications

Creating a Culture of Shared Knowledge –

Democratizing Your Organization’s Data via Dynamic Reporting

Matt Stevens and Geoffrey Kip

Benefits Data Trust

Page 33: Creating a Culture of Shared Knowledge Democratizing Your ......Creating a Culture of Shared Knowledge – Democratizing Your Organization’s Data via Dynamic Reporting Matt Stevens

Hands on with R and Shiny

• We have prepared an Interactive document in R

that will help you get started with Shiny

• https://geoffkip.shinyapps.io/Markdown_goal_progress/

Creating a Culture of Shared Knowledge –

Democratizing Your Organization’s Data via Dynamic Reporting

Matt Stevens and Geoffrey Kip

Benefits Data Trust

Page 34: Creating a Culture of Shared Knowledge Democratizing Your ......Creating a Culture of Shared Knowledge – Democratizing Your Organization’s Data via Dynamic Reporting Matt Stevens

Creating a Culture of Shared Knowledge –

Democratizing Your Organization’s Data via Dynamic Reporting

Matt Stevens and Geoffrey Kip

Benefits Data Trust

Questions?

• Matt Stevens – Director of Data Science

[email protected]

– @mttstvns

• Geoffrey Kip– Data Analyst

[email protected]

– @gjerome1991