DevSci: Improving Software Through Data ScienceSkill 2016 Change Skill 2016 Change. What’s the...
Transcript of DevSci: Improving Software Through Data ScienceSkill 2016 Change Skill 2016 Change. What’s the...
![Page 1: DevSci: Improving Software Through Data ScienceSkill 2016 Change Skill 2016 Change. What’s the problem? What’s the problem? ... O’Reilly 2015 Data Science Salary Survey Data](https://reader035.fdocuments.net/reader035/viewer/2022070723/5f0206d97e708231d402366c/html5/thumbnails/1.jpg)
Data Science:Becoming a Data-driven Organization
@MatthewRenze
#MicrosoftUAE
![Page 2: DevSci: Improving Software Through Data ScienceSkill 2016 Change Skill 2016 Change. What’s the problem? What’s the problem? ... O’Reilly 2015 Data Science Salary Survey Data](https://reader035.fdocuments.net/reader035/viewer/2022070723/5f0206d97e708231d402366c/html5/thumbnails/2.jpg)
![Page 3: DevSci: Improving Software Through Data ScienceSkill 2016 Change Skill 2016 Change. What’s the problem? What’s the problem? ... O’Reilly 2015 Data Science Salary Survey Data](https://reader035.fdocuments.net/reader035/viewer/2022070723/5f0206d97e708231d402366c/html5/thumbnails/3.jpg)
Are you a decision maker?
![Page 4: DevSci: Improving Software Through Data ScienceSkill 2016 Change Skill 2016 Change. What’s the problem? What’s the problem? ... O’Reilly 2015 Data Science Salary Survey Data](https://reader035.fdocuments.net/reader035/viewer/2022070723/5f0206d97e708231d402366c/html5/thumbnails/4.jpg)
Are you flooded with data?
Are you a decision maker?
![Page 5: DevSci: Improving Software Through Data ScienceSkill 2016 Change Skill 2016 Change. What’s the problem? What’s the problem? ... O’Reilly 2015 Data Science Salary Survey Data](https://reader035.fdocuments.net/reader035/viewer/2022070723/5f0206d97e708231d402366c/html5/thumbnails/5.jpg)
Are you flooded with data?
Are you a decision maker?
Are you using data science?
![Page 6: DevSci: Improving Software Through Data ScienceSkill 2016 Change Skill 2016 Change. What’s the problem? What’s the problem? ... O’Reilly 2015 Data Science Salary Survey Data](https://reader035.fdocuments.net/reader035/viewer/2022070723/5f0206d97e708231d402366c/html5/thumbnails/6.jpg)
Why is it important?
What is data science?
How do I get started?
![Page 7: DevSci: Improving Software Through Data ScienceSkill 2016 Change Skill 2016 Change. What’s the problem? What’s the problem? ... O’Reilly 2015 Data Science Salary Survey Data](https://reader035.fdocuments.net/reader035/viewer/2022070723/5f0206d97e708231d402366c/html5/thumbnails/7.jpg)
What is data science?
Why is it important?
How do I get started?
![Page 8: DevSci: Improving Software Through Data ScienceSkill 2016 Change Skill 2016 Change. What’s the problem? What’s the problem? ... O’Reilly 2015 Data Science Salary Survey Data](https://reader035.fdocuments.net/reader035/viewer/2022070723/5f0206d97e708231d402366c/html5/thumbnails/8.jpg)
Why is data science important?
![Page 9: DevSci: Improving Software Through Data ScienceSkill 2016 Change Skill 2016 Change. What’s the problem? What’s the problem? ... O’Reilly 2015 Data Science Salary Survey Data](https://reader035.fdocuments.net/reader035/viewer/2022070723/5f0206d97e708231d402366c/html5/thumbnails/9.jpg)
![Page 10: DevSci: Improving Software Through Data ScienceSkill 2016 Change Skill 2016 Change. What’s the problem? What’s the problem? ... O’Reilly 2015 Data Science Salary Survey Data](https://reader035.fdocuments.net/reader035/viewer/2022070723/5f0206d97e708231d402366c/html5/thumbnails/10.jpg)
![Page 11: DevSci: Improving Software Through Data ScienceSkill 2016 Change Skill 2016 Change. What’s the problem? What’s the problem? ... O’Reilly 2015 Data Science Salary Survey Data](https://reader035.fdocuments.net/reader035/viewer/2022070723/5f0206d97e708231d402366c/html5/thumbnails/11.jpg)
![Page 12: DevSci: Improving Software Through Data ScienceSkill 2016 Change Skill 2016 Change. What’s the problem? What’s the problem? ... O’Reilly 2015 Data Science Salary Survey Data](https://reader035.fdocuments.net/reader035/viewer/2022070723/5f0206d97e708231d402366c/html5/thumbnails/12.jpg)
![Page 13: DevSci: Improving Software Through Data ScienceSkill 2016 Change Skill 2016 Change. What’s the problem? What’s the problem? ... O’Reilly 2015 Data Science Salary Survey Data](https://reader035.fdocuments.net/reader035/viewer/2022070723/5f0206d97e708231d402366c/html5/thumbnails/13.jpg)
Job Postings for Data Scientists
![Page 14: DevSci: Improving Software Through Data ScienceSkill 2016 Change Skill 2016 Change. What’s the problem? What’s the problem? ... O’Reilly 2015 Data Science Salary Survey Data](https://reader035.fdocuments.net/reader035/viewer/2022070723/5f0206d97e708231d402366c/html5/thumbnails/14.jpg)
Source: Dice Salary Survey 2017
Top-paying Tech SkillsSkill 2016 Change Skill 2016 Change
![Page 15: DevSci: Improving Software Through Data ScienceSkill 2016 Change Skill 2016 Change. What’s the problem? What’s the problem? ... O’Reilly 2015 Data Science Salary Survey Data](https://reader035.fdocuments.net/reader035/viewer/2022070723/5f0206d97e708231d402366c/html5/thumbnails/15.jpg)
![Page 16: DevSci: Improving Software Through Data ScienceSkill 2016 Change Skill 2016 Change. What’s the problem? What’s the problem? ... O’Reilly 2015 Data Science Salary Survey Data](https://reader035.fdocuments.net/reader035/viewer/2022070723/5f0206d97e708231d402366c/html5/thumbnails/16.jpg)
![Page 17: DevSci: Improving Software Through Data ScienceSkill 2016 Change Skill 2016 Change. What’s the problem? What’s the problem? ... O’Reilly 2015 Data Science Salary Survey Data](https://reader035.fdocuments.net/reader035/viewer/2022070723/5f0206d97e708231d402366c/html5/thumbnails/17.jpg)
![Page 18: DevSci: Improving Software Through Data ScienceSkill 2016 Change Skill 2016 Change. What’s the problem? What’s the problem? ... O’Reilly 2015 Data Science Salary Survey Data](https://reader035.fdocuments.net/reader035/viewer/2022070723/5f0206d97e708231d402366c/html5/thumbnails/18.jpg)
What’s the problem?
![Page 19: DevSci: Improving Software Through Data ScienceSkill 2016 Change Skill 2016 Change. What’s the problem? What’s the problem? ... O’Reilly 2015 Data Science Salary Survey Data](https://reader035.fdocuments.net/reader035/viewer/2022070723/5f0206d97e708231d402366c/html5/thumbnails/19.jpg)
What’s the problem?
![Page 20: DevSci: Improving Software Through Data ScienceSkill 2016 Change Skill 2016 Change. What’s the problem? What’s the problem? ... O’Reilly 2015 Data Science Salary Survey Data](https://reader035.fdocuments.net/reader035/viewer/2022070723/5f0206d97e708231d402366c/html5/thumbnails/20.jpg)
![Page 21: DevSci: Improving Software Through Data ScienceSkill 2016 Change Skill 2016 Change. What’s the problem? What’s the problem? ... O’Reilly 2015 Data Science Salary Survey Data](https://reader035.fdocuments.net/reader035/viewer/2022070723/5f0206d97e708231d402366c/html5/thumbnails/21.jpg)
![Page 22: DevSci: Improving Software Through Data ScienceSkill 2016 Change Skill 2016 Change. What’s the problem? What’s the problem? ... O’Reilly 2015 Data Science Salary Survey Data](https://reader035.fdocuments.net/reader035/viewer/2022070723/5f0206d97e708231d402366c/html5/thumbnails/22.jpg)
![Page 23: DevSci: Improving Software Through Data ScienceSkill 2016 Change Skill 2016 Change. What’s the problem? What’s the problem? ... O’Reilly 2015 Data Science Salary Survey Data](https://reader035.fdocuments.net/reader035/viewer/2022070723/5f0206d97e708231d402366c/html5/thumbnails/23.jpg)
![Page 24: DevSci: Improving Software Through Data ScienceSkill 2016 Change Skill 2016 Change. What’s the problem? What’s the problem? ... O’Reilly 2015 Data Science Salary Survey Data](https://reader035.fdocuments.net/reader035/viewer/2022070723/5f0206d97e708231d402366c/html5/thumbnails/24.jpg)
![Page 25: DevSci: Improving Software Through Data ScienceSkill 2016 Change Skill 2016 Change. What’s the problem? What’s the problem? ... O’Reilly 2015 Data Science Salary Survey Data](https://reader035.fdocuments.net/reader035/viewer/2022070723/5f0206d97e708231d402366c/html5/thumbnails/25.jpg)
![Page 26: DevSci: Improving Software Through Data ScienceSkill 2016 Change Skill 2016 Change. What’s the problem? What’s the problem? ... O’Reilly 2015 Data Science Salary Survey Data](https://reader035.fdocuments.net/reader035/viewer/2022070723/5f0206d97e708231d402366c/html5/thumbnails/26.jpg)
![Page 27: DevSci: Improving Software Through Data ScienceSkill 2016 Change Skill 2016 Change. What’s the problem? What’s the problem? ... O’Reilly 2015 Data Science Salary Survey Data](https://reader035.fdocuments.net/reader035/viewer/2022070723/5f0206d97e708231d402366c/html5/thumbnails/27.jpg)
![Page 28: DevSci: Improving Software Through Data ScienceSkill 2016 Change Skill 2016 Change. What’s the problem? What’s the problem? ... O’Reilly 2015 Data Science Salary Survey Data](https://reader035.fdocuments.net/reader035/viewer/2022070723/5f0206d97e708231d402366c/html5/thumbnails/28.jpg)
The Current State of Business
Don’t understand customersLack of product-market fit
Unused / low-value features
Missed market opportunities
Human biases
Guesswork
Cost of labor
Human errors
![Page 29: DevSci: Improving Software Through Data ScienceSkill 2016 Change Skill 2016 Change. What’s the problem? What’s the problem? ... O’Reilly 2015 Data Science Salary Survey Data](https://reader035.fdocuments.net/reader035/viewer/2022070723/5f0206d97e708231d402366c/html5/thumbnails/29.jpg)
![Page 30: DevSci: Improving Software Through Data ScienceSkill 2016 Change Skill 2016 Change. What’s the problem? What’s the problem? ... O’Reilly 2015 Data Science Salary Survey Data](https://reader035.fdocuments.net/reader035/viewer/2022070723/5f0206d97e708231d402366c/html5/thumbnails/30.jpg)
Three Main Approaches
Createbetter
products
Makesmarter
decisions
Reduce laborcosts
![Page 31: DevSci: Improving Software Through Data ScienceSkill 2016 Change Skill 2016 Change. What’s the problem? What’s the problem? ... O’Reilly 2015 Data Science Salary Survey Data](https://reader035.fdocuments.net/reader035/viewer/2022070723/5f0206d97e708231d402366c/html5/thumbnails/31.jpg)
Three Main Approaches
Createbetter
products
![Page 32: DevSci: Improving Software Through Data ScienceSkill 2016 Change Skill 2016 Change. What’s the problem? What’s the problem? ... O’Reilly 2015 Data Science Salary Survey Data](https://reader035.fdocuments.net/reader035/viewer/2022070723/5f0206d97e708231d402366c/html5/thumbnails/32.jpg)
Three Main Approaches
Makesmarter
decisions
![Page 33: DevSci: Improving Software Through Data ScienceSkill 2016 Change Skill 2016 Change. What’s the problem? What’s the problem? ... O’Reilly 2015 Data Science Salary Survey Data](https://reader035.fdocuments.net/reader035/viewer/2022070723/5f0206d97e708231d402366c/html5/thumbnails/33.jpg)
Three Main Approaches
Reduce laborcosts
![Page 34: DevSci: Improving Software Through Data ScienceSkill 2016 Change Skill 2016 Change. What’s the problem? What’s the problem? ... O’Reilly 2015 Data Science Salary Survey Data](https://reader035.fdocuments.net/reader035/viewer/2022070723/5f0206d97e708231d402366c/html5/thumbnails/34.jpg)
Three Main Approaches
Createbetter
products
Makesmarter
decisions
Reduce laborcosts
![Page 35: DevSci: Improving Software Through Data ScienceSkill 2016 Change Skill 2016 Change. What’s the problem? What’s the problem? ... O’Reilly 2015 Data Science Salary Survey Data](https://reader035.fdocuments.net/reader035/viewer/2022070723/5f0206d97e708231d402366c/html5/thumbnails/35.jpg)
What is data science?
![Page 36: DevSci: Improving Software Through Data ScienceSkill 2016 Change Skill 2016 Change. What’s the problem? What’s the problem? ... O’Reilly 2015 Data Science Salary Survey Data](https://reader035.fdocuments.net/reader035/viewer/2022070723/5f0206d97e708231d402366c/html5/thumbnails/36.jpg)
Computer
science
Math and
statistics
Domain
knowledge
Data
science
![Page 37: DevSci: Improving Software Through Data ScienceSkill 2016 Change Skill 2016 Change. What’s the problem? What’s the problem? ... O’Reilly 2015 Data Science Salary Survey Data](https://reader035.fdocuments.net/reader035/viewer/2022070723/5f0206d97e708231d402366c/html5/thumbnails/37.jpg)
Data
engineering
Scientific
method
Data
science
![Page 38: DevSci: Improving Software Through Data ScienceSkill 2016 Change Skill 2016 Change. What’s the problem? What’s the problem? ... O’Reilly 2015 Data Science Salary Survey Data](https://reader035.fdocuments.net/reader035/viewer/2022070723/5f0206d97e708231d402366c/html5/thumbnails/38.jpg)
Data Knowledge Decision Action
![Page 39: DevSci: Improving Software Through Data ScienceSkill 2016 Change Skill 2016 Change. What’s the problem? What’s the problem? ... O’Reilly 2015 Data Science Salary Survey Data](https://reader035.fdocuments.net/reader035/viewer/2022070723/5f0206d97e708231d402366c/html5/thumbnails/39.jpg)
What Is a Data Scientist?
Performs data science
More than a scientist
More than an analyst
More than a developer
![Page 40: DevSci: Improving Software Through Data ScienceSkill 2016 Change Skill 2016 Change. What’s the problem? What’s the problem? ... O’Reilly 2015 Data Science Salary Survey Data](https://reader035.fdocuments.net/reader035/viewer/2022070723/5f0206d97e708231d402366c/html5/thumbnails/40.jpg)
What skills are necessary?
![Page 41: DevSci: Improving Software Through Data ScienceSkill 2016 Change Skill 2016 Change. What’s the problem? What’s the problem? ... O’Reilly 2015 Data Science Salary Survey Data](https://reader035.fdocuments.net/reader035/viewer/2022070723/5f0206d97e708231d402366c/html5/thumbnails/41.jpg)
Data Science Skills
Programming
Working with data
Descriptive statistics
Data visualization
![Page 42: DevSci: Improving Software Through Data ScienceSkill 2016 Change Skill 2016 Change. What’s the problem? What’s the problem? ... O’Reilly 2015 Data Science Salary Survey Data](https://reader035.fdocuments.net/reader035/viewer/2022070723/5f0206d97e708231d402366c/html5/thumbnails/42.jpg)
Data Science Skills
Programming
Working with data
Descriptive statistics
Data visualization
Statistical modeling
Handling Big Data
Machine learning
Deploying to production
![Page 43: DevSci: Improving Software Through Data ScienceSkill 2016 Change Skill 2016 Change. What’s the problem? What’s the problem? ... O’Reilly 2015 Data Science Salary Survey Data](https://reader035.fdocuments.net/reader035/viewer/2022070723/5f0206d97e708231d402366c/html5/thumbnails/43.jpg)
What tools are used?
![Page 44: DevSci: Improving Software Through Data ScienceSkill 2016 Change Skill 2016 Change. What’s the problem? What’s the problem? ... O’Reilly 2015 Data Science Salary Survey Data](https://reader035.fdocuments.net/reader035/viewer/2022070723/5f0206d97e708231d402366c/html5/thumbnails/44.jpg)
70%
60%
40%
30%
20%
10%
0%
50%
SQ
L
Exc
el
Pyt
ho
n
MyS
QLR
Pyt
ho
n t
oo
ls
gg
plo
t
SQ
L Serv
er
Tab
leau
Java
Scr
ipt
Matp
lotl
ib
Java
Po
stg
reSQ
L
Ora
cle
D3
Ho
meg
row
n
Hiv
e
Sp
ark
Clo
ud
era
Vis
ual B
asi
c
Mo
ng
oD
B
Had
oo
p
SA
S
C+
+
Sca
la
Po
werP
ivo
t
SQ
Lite C
Pig
Red
Sh
ift
Weka
Hb
ase
(EM
R)
Perl
SP
SS
Tera
data
Tool: language, platform, analytics
Sh
are
of
Resp
on
den
ts
Source: O’Reilly 2015 Data Science Salary Survey
Data Science Tools
![Page 45: DevSci: Improving Software Through Data ScienceSkill 2016 Change Skill 2016 Change. What’s the problem? What’s the problem? ... O’Reilly 2015 Data Science Salary Survey Data](https://reader035.fdocuments.net/reader035/viewer/2022070723/5f0206d97e708231d402366c/html5/thumbnails/45.jpg)
70%
60%
40%
30%
20%
10%
0%
50%
SQ
L
Exc
el
Pyt
ho
n
MyS
QLR
Pyt
ho
n t
oo
ls
gg
plo
t
SQ
L Serv
er
Tab
leau
Java
Scr
ipt
Matp
lotl
ib
Java
Po
stg
reSQ
L
Ora
cle
D3
Ho
meg
row
n
Hiv
e
Sp
ark
Clo
ud
era
Vis
ual B
asi
c
Mo
ng
oD
B
Had
oo
p
SA
S
C+
+
Sca
la
Po
werP
ivo
t
SQ
Lite C
Pig
Red
Sh
ift
Weka
Hb
ase
(EM
R)
Perl
SP
SS
Tera
data
Tool: language, platform, analytics
Sh
are
of
Resp
on
den
ts
Source: O’Reilly 2015 Data Science Salary Survey
Data Science Tools
![Page 46: DevSci: Improving Software Through Data ScienceSkill 2016 Change Skill 2016 Change. What’s the problem? What’s the problem? ... O’Reilly 2015 Data Science Salary Survey Data](https://reader035.fdocuments.net/reader035/viewer/2022070723/5f0206d97e708231d402366c/html5/thumbnails/46.jpg)
70%
60%
40%
30%
20%
10%
0%
50%
SQ
L
Exc
el
Pyt
ho
n
MyS
QLR
Pyt
ho
n t
oo
ls
gg
plo
t
SQ
L Serv
er
Tab
leau
Java
Scr
ipt
Matp
lotl
ib
Java
Po
stg
reSQ
L
Ora
cle
D3
Ho
meg
row
n
Hiv
e
Sp
ark
Clo
ud
era
Vis
ual B
asi
c
Mo
ng
oD
B
Had
oo
p
SA
S
C+
+
Sca
la
Po
werP
ivo
t
SQ
Lite C
Pig
Red
Sh
ift
Weka
Hb
ase
(EM
R)
Perl
SP
SS
Tera
data
Tool: language, platform, analytics
Sh
are
of
Resp
on
den
ts
Source: O’Reilly 2015 Data Science Salary Survey
Data Science Tools
![Page 47: DevSci: Improving Software Through Data ScienceSkill 2016 Change Skill 2016 Change. What’s the problem? What’s the problem? ... O’Reilly 2015 Data Science Salary Survey Data](https://reader035.fdocuments.net/reader035/viewer/2022070723/5f0206d97e708231d402366c/html5/thumbnails/47.jpg)
70%
60%
40%
30%
20%
10%
0%
50%
SQ
L
Exc
el
Pyt
ho
n
MyS
QLR
Pyt
ho
n t
oo
ls
gg
plo
t
SQ
L Serv
er
Tab
leau
Java
Scr
ipt
Matp
lotl
ib
Java
Po
stg
reSQ
L
Ora
cle
D3
Ho
meg
row
n
Hiv
e
Sp
ark
Clo
ud
era
Vis
ual B
asi
c
Mo
ng
oD
B
Had
oo
p
SA
S
C+
+
Sca
la
Po
werP
ivo
t
SQ
Lite C
Pig
Red
Sh
ift
Weka
Hb
ase
(EM
R)
Perl
SP
SS
Tera
data
Tool: language, platform, analytics
Sh
are
of
Resp
on
den
ts
Source: O’Reilly 2015 Data Science Salary Survey
Data Science Tools
![Page 48: DevSci: Improving Software Through Data ScienceSkill 2016 Change Skill 2016 Change. What’s the problem? What’s the problem? ... O’Reilly 2015 Data Science Salary Survey Data](https://reader035.fdocuments.net/reader035/viewer/2022070723/5f0206d97e708231d402366c/html5/thumbnails/48.jpg)
70%
60%
40%
30%
20%
10%
0%
50%
SQ
L
Exc
el
Pyt
ho
n
MyS
QLR
Pyt
ho
n t
oo
ls
gg
plo
t
SQ
L Serv
er
Tab
leau
Java
Scr
ipt
Matp
lotl
ib
Java
Po
stg
reSQ
L
Ora
cle
D3
Ho
meg
row
n
Hiv
e
Sp
ark
Clo
ud
era
Vis
ual B
asi
c
Mo
ng
oD
B
Had
oo
p
SA
S
C+
+
Sca
la
Po
werP
ivo
t
SQ
Lite C
Pig
Red
Sh
ift
Weka
Hb
ase
(EM
R)
Perl
SP
SS
Tera
data
Tool: language, platform, analytics
Sh
are
of
Resp
on
den
ts
Source: O’Reilly 2015 Data Science Salary Survey
Data Science Tools
![Page 49: DevSci: Improving Software Through Data ScienceSkill 2016 Change Skill 2016 Change. What’s the problem? What’s the problem? ... O’Reilly 2015 Data Science Salary Survey Data](https://reader035.fdocuments.net/reader035/viewer/2022070723/5f0206d97e708231d402366c/html5/thumbnails/49.jpg)
How is data science performed?
![Page 50: DevSci: Improving Software Through Data ScienceSkill 2016 Change Skill 2016 Change. What’s the problem? What’s the problem? ... O’Reilly 2015 Data Science Salary Survey Data](https://reader035.fdocuments.net/reader035/viewer/2022070723/5f0206d97e708231d402366c/html5/thumbnails/50.jpg)
The Data Science Process
Data
![Page 51: DevSci: Improving Software Through Data ScienceSkill 2016 Change Skill 2016 Change. What’s the problem? What’s the problem? ... O’Reilly 2015 Data Science Salary Survey Data](https://reader035.fdocuments.net/reader035/viewer/2022070723/5f0206d97e708231d402366c/html5/thumbnails/51.jpg)
The Data Science Process
Find a question
Data
![Page 52: DevSci: Improving Software Through Data ScienceSkill 2016 Change Skill 2016 Change. What’s the problem? What’s the problem? ... O’Reilly 2015 Data Science Salary Survey Data](https://reader035.fdocuments.net/reader035/viewer/2022070723/5f0206d97e708231d402366c/html5/thumbnails/52.jpg)
The Data Science Process
Find a question
Collectthe data
Data
![Page 53: DevSci: Improving Software Through Data ScienceSkill 2016 Change Skill 2016 Change. What’s the problem? What’s the problem? ... O’Reilly 2015 Data Science Salary Survey Data](https://reader035.fdocuments.net/reader035/viewer/2022070723/5f0206d97e708231d402366c/html5/thumbnails/53.jpg)
The Data Science Process
Find a question
Collectthe data
Preparethe data
Data
![Page 54: DevSci: Improving Software Through Data ScienceSkill 2016 Change Skill 2016 Change. What’s the problem? What’s the problem? ... O’Reilly 2015 Data Science Salary Survey Data](https://reader035.fdocuments.net/reader035/viewer/2022070723/5f0206d97e708231d402366c/html5/thumbnails/54.jpg)
The Data Science Process
Find a question
Collectthe data
Preparethe data
Create a model
Data
![Page 55: DevSci: Improving Software Through Data ScienceSkill 2016 Change Skill 2016 Change. What’s the problem? What’s the problem? ... O’Reilly 2015 Data Science Salary Survey Data](https://reader035.fdocuments.net/reader035/viewer/2022070723/5f0206d97e708231d402366c/html5/thumbnails/55.jpg)
The Data Science Process
Find a question
Collectthe data
Preparethe data
Create a model
Evaluatethe model
Data
![Page 56: DevSci: Improving Software Through Data ScienceSkill 2016 Change Skill 2016 Change. What’s the problem? What’s the problem? ... O’Reilly 2015 Data Science Salary Survey Data](https://reader035.fdocuments.net/reader035/viewer/2022070723/5f0206d97e708231d402366c/html5/thumbnails/56.jpg)
The Data Science Process
Find a question
Collectthe data
Preparethe data
Create a model
Evaluatethe model
Deploythe model
Data
![Page 57: DevSci: Improving Software Through Data ScienceSkill 2016 Change Skill 2016 Change. What’s the problem? What’s the problem? ... O’Reilly 2015 Data Science Salary Survey Data](https://reader035.fdocuments.net/reader035/viewer/2022070723/5f0206d97e708231d402366c/html5/thumbnails/57.jpg)
The Data Science Process
Find a question
Collectthe data
Preparethe data
Createa model
Evaluatethe model
Deploythe model
Data
![Page 58: DevSci: Improving Software Through Data ScienceSkill 2016 Change Skill 2016 Change. What’s the problem? What’s the problem? ... O’Reilly 2015 Data Science Salary Survey Data](https://reader035.fdocuments.net/reader035/viewer/2022070723/5f0206d97e708231d402366c/html5/thumbnails/58.jpg)
The Data Science Process
Iterative process
Find a question
Explore the data
Prepare the data
Create a model
Evaluate the
model
Deploy the
model
Data
![Page 59: DevSci: Improving Software Through Data ScienceSkill 2016 Change Skill 2016 Change. What’s the problem? What’s the problem? ... O’Reilly 2015 Data Science Salary Survey Data](https://reader035.fdocuments.net/reader035/viewer/2022070723/5f0206d97e708231d402366c/html5/thumbnails/59.jpg)
The Data Science Process
Iterative process
Non-sequential
Find a question
Explore the data
Prepare the data
Create a model
Evaluate the
model
Deploy the
model
Data
![Page 60: DevSci: Improving Software Through Data ScienceSkill 2016 Change Skill 2016 Change. What’s the problem? What’s the problem? ... O’Reilly 2015 Data Science Salary Survey Data](https://reader035.fdocuments.net/reader035/viewer/2022070723/5f0206d97e708231d402366c/html5/thumbnails/60.jpg)
The Data Science Process
Iterative process
Non-sequential
Early termination
Find a question
Explore the data
Prepare the data
Create a model
Evaluate the
model
Deploy the
model
Data
![Page 61: DevSci: Improving Software Through Data ScienceSkill 2016 Change Skill 2016 Change. What’s the problem? What’s the problem? ... O’Reilly 2015 Data Science Salary Survey Data](https://reader035.fdocuments.net/reader035/viewer/2022070723/5f0206d97e708231d402366c/html5/thumbnails/61.jpg)
How do I get started?
![Page 62: DevSci: Improving Software Through Data ScienceSkill 2016 Change Skill 2016 Change. What’s the problem? What’s the problem? ... O’Reilly 2015 Data Science Salary Survey Data](https://reader035.fdocuments.net/reader035/viewer/2022070723/5f0206d97e708231d402366c/html5/thumbnails/62.jpg)
What are the ingredients ofa data-driven enterprise?
![Page 63: DevSci: Improving Software Through Data ScienceSkill 2016 Change Skill 2016 Change. What’s the problem? What’s the problem? ... O’Reilly 2015 Data Science Salary Survey Data](https://reader035.fdocuments.net/reader035/viewer/2022070723/5f0206d97e708231d402366c/html5/thumbnails/63.jpg)
Strategy
People
DataTechnology
Culture
![Page 64: DevSci: Improving Software Through Data ScienceSkill 2016 Change Skill 2016 Change. What’s the problem? What’s the problem? ... O’Reilly 2015 Data Science Salary Survey Data](https://reader035.fdocuments.net/reader035/viewer/2022070723/5f0206d97e708231d402366c/html5/thumbnails/64.jpg)
Strategy
![Page 65: DevSci: Improving Software Through Data ScienceSkill 2016 Change Skill 2016 Change. What’s the problem? What’s the problem? ... O’Reilly 2015 Data Science Salary Survey Data](https://reader035.fdocuments.net/reader035/viewer/2022070723/5f0206d97e708231d402366c/html5/thumbnails/65.jpg)
![Page 66: DevSci: Improving Software Through Data ScienceSkill 2016 Change Skill 2016 Change. What’s the problem? What’s the problem? ... O’Reilly 2015 Data Science Salary Survey Data](https://reader035.fdocuments.net/reader035/viewer/2022070723/5f0206d97e708231d402366c/html5/thumbnails/66.jpg)
People
![Page 67: DevSci: Improving Software Through Data ScienceSkill 2016 Change Skill 2016 Change. What’s the problem? What’s the problem? ... O’Reilly 2015 Data Science Salary Survey Data](https://reader035.fdocuments.net/reader035/viewer/2022070723/5f0206d97e708231d402366c/html5/thumbnails/67.jpg)
![Page 68: DevSci: Improving Software Through Data ScienceSkill 2016 Change Skill 2016 Change. What’s the problem? What’s the problem? ... O’Reilly 2015 Data Science Salary Survey Data](https://reader035.fdocuments.net/reader035/viewer/2022070723/5f0206d97e708231d402366c/html5/thumbnails/68.jpg)
Data
![Page 69: DevSci: Improving Software Through Data ScienceSkill 2016 Change Skill 2016 Change. What’s the problem? What’s the problem? ... O’Reilly 2015 Data Science Salary Survey Data](https://reader035.fdocuments.net/reader035/viewer/2022070723/5f0206d97e708231d402366c/html5/thumbnails/69.jpg)
![Page 70: DevSci: Improving Software Through Data ScienceSkill 2016 Change Skill 2016 Change. What’s the problem? What’s the problem? ... O’Reilly 2015 Data Science Salary Survey Data](https://reader035.fdocuments.net/reader035/viewer/2022070723/5f0206d97e708231d402366c/html5/thumbnails/70.jpg)
Technology
![Page 71: DevSci: Improving Software Through Data ScienceSkill 2016 Change Skill 2016 Change. What’s the problem? What’s the problem? ... O’Reilly 2015 Data Science Salary Survey Data](https://reader035.fdocuments.net/reader035/viewer/2022070723/5f0206d97e708231d402366c/html5/thumbnails/71.jpg)
![Page 72: DevSci: Improving Software Through Data ScienceSkill 2016 Change Skill 2016 Change. What’s the problem? What’s the problem? ... O’Reilly 2015 Data Science Salary Survey Data](https://reader035.fdocuments.net/reader035/viewer/2022070723/5f0206d97e708231d402366c/html5/thumbnails/72.jpg)
Culture
![Page 73: DevSci: Improving Software Through Data ScienceSkill 2016 Change Skill 2016 Change. What’s the problem? What’s the problem? ... O’Reilly 2015 Data Science Salary Survey Data](https://reader035.fdocuments.net/reader035/viewer/2022070723/5f0206d97e708231d402366c/html5/thumbnails/73.jpg)
![Page 74: DevSci: Improving Software Through Data ScienceSkill 2016 Change Skill 2016 Change. What’s the problem? What’s the problem? ... O’Reilly 2015 Data Science Salary Survey Data](https://reader035.fdocuments.net/reader035/viewer/2022070723/5f0206d97e708231d402366c/html5/thumbnails/74.jpg)
What is the process of becominga data-driven enterprise?
![Page 75: DevSci: Improving Software Through Data ScienceSkill 2016 Change Skill 2016 Change. What’s the problem? What’s the problem? ... O’Reilly 2015 Data Science Salary Survey Data](https://reader035.fdocuments.net/reader035/viewer/2022070723/5f0206d97e708231d402366c/html5/thumbnails/75.jpg)
AI
Predict
Analyze
Organize
Collect
![Page 76: DevSci: Improving Software Through Data ScienceSkill 2016 Change Skill 2016 Change. What’s the problem? What’s the problem? ... O’Reilly 2015 Data Science Salary Survey Data](https://reader035.fdocuments.net/reader035/viewer/2022070723/5f0206d97e708231d402366c/html5/thumbnails/76.jpg)
AI
Predict
Analyze
Organize
Collect
Need
s
![Page 77: DevSci: Improving Software Through Data ScienceSkill 2016 Change Skill 2016 Change. What’s the problem? What’s the problem? ... O’Reilly 2015 Data Science Salary Survey Data](https://reader035.fdocuments.net/reader035/viewer/2022070723/5f0206d97e708231d402366c/html5/thumbnails/77.jpg)
1. Collect
Collect
![Page 78: DevSci: Improving Software Through Data ScienceSkill 2016 Change Skill 2016 Change. What’s the problem? What’s the problem? ... O’Reilly 2015 Data Science Salary Survey Data](https://reader035.fdocuments.net/reader035/viewer/2022070723/5f0206d97e708231d402366c/html5/thumbnails/78.jpg)
1. Collect
Transactions
Logging
Digitization
Collect
![Page 79: DevSci: Improving Software Through Data ScienceSkill 2016 Change Skill 2016 Change. What’s the problem? What’s the problem? ... O’Reilly 2015 Data Science Salary Survey Data](https://reader035.fdocuments.net/reader035/viewer/2022070723/5f0206d97e708231d402366c/html5/thumbnails/79.jpg)
1. Collect
Transactions
Logging
Digitization
Telemetry
Experiments
External dataCollect
![Page 80: DevSci: Improving Software Through Data ScienceSkill 2016 Change Skill 2016 Change. What’s the problem? What’s the problem? ... O’Reilly 2015 Data Science Salary Survey Data](https://reader035.fdocuments.net/reader035/viewer/2022070723/5f0206d97e708231d402366c/html5/thumbnails/80.jpg)
2. Organize
Organize
Collect
![Page 81: DevSci: Improving Software Through Data ScienceSkill 2016 Change Skill 2016 Change. What’s the problem? What’s the problem? ... O’Reilly 2015 Data Science Salary Survey Data](https://reader035.fdocuments.net/reader035/viewer/2022070723/5f0206d97e708231d402366c/html5/thumbnails/81.jpg)
2. Organize
Transform
Clean
Store
Organize
Collect
![Page 82: DevSci: Improving Software Through Data ScienceSkill 2016 Change Skill 2016 Change. What’s the problem? What’s the problem? ... O’Reilly 2015 Data Science Salary Survey Data](https://reader035.fdocuments.net/reader035/viewer/2022070723/5f0206d97e708231d402366c/html5/thumbnails/82.jpg)
2. Organize
Transform
Clean
Store
Data ETL
Data Warehouse
Data Lake
Organize
Collect
![Page 83: DevSci: Improving Software Through Data ScienceSkill 2016 Change Skill 2016 Change. What’s the problem? What’s the problem? ... O’Reilly 2015 Data Science Salary Survey Data](https://reader035.fdocuments.net/reader035/viewer/2022070723/5f0206d97e708231d402366c/html5/thumbnails/83.jpg)
3. Analyze
Analyze
Organize
Collect
![Page 84: DevSci: Improving Software Through Data ScienceSkill 2016 Change Skill 2016 Change. What’s the problem? What’s the problem? ... O’Reilly 2015 Data Science Salary Survey Data](https://reader035.fdocuments.net/reader035/viewer/2022070723/5f0206d97e708231d402366c/html5/thumbnails/84.jpg)
3. Analyze
Reports
Dashboards
KPI monitors
Analyze
Organize
Collect
![Page 85: DevSci: Improving Software Through Data ScienceSkill 2016 Change Skill 2016 Change. What’s the problem? What’s the problem? ... O’Reilly 2015 Data Science Salary Survey Data](https://reader035.fdocuments.net/reader035/viewer/2022070723/5f0206d97e708231d402366c/html5/thumbnails/85.jpg)
3. Analyze
Reports
Dashboards
KPI monitors
Data mining
Descriptive analytics
Diagnostic analytics
Analyze
Organize
Collect
![Page 86: DevSci: Improving Software Through Data ScienceSkill 2016 Change Skill 2016 Change. What’s the problem? What’s the problem? ... O’Reilly 2015 Data Science Salary Survey Data](https://reader035.fdocuments.net/reader035/viewer/2022070723/5f0206d97e708231d402366c/html5/thumbnails/86.jpg)
4. Predict
Predict
Analyze
Organize
Collect
![Page 87: DevSci: Improving Software Through Data ScienceSkill 2016 Change Skill 2016 Change. What’s the problem? What’s the problem? ... O’Reilly 2015 Data Science Salary Survey Data](https://reader035.fdocuments.net/reader035/viewer/2022070723/5f0206d97e708231d402366c/html5/thumbnails/87.jpg)
4. Predict
Predictive analytics
Prescriptive analytics
Machine learning
Predict
Analyze
Organize
Collect
![Page 88: DevSci: Improving Software Through Data ScienceSkill 2016 Change Skill 2016 Change. What’s the problem? What’s the problem? ... O’Reilly 2015 Data Science Salary Survey Data](https://reader035.fdocuments.net/reader035/viewer/2022070723/5f0206d97e708231d402366c/html5/thumbnails/88.jpg)
5. Automate AI
Predict
Analyze
Organize
Collect
![Page 89: DevSci: Improving Software Through Data ScienceSkill 2016 Change Skill 2016 Change. What’s the problem? What’s the problem? ... O’Reilly 2015 Data Science Salary Survey Data](https://reader035.fdocuments.net/reader035/viewer/2022070723/5f0206d97e708231d402366c/html5/thumbnails/89.jpg)
5. Automate
Artificial intelligence
Reinforcement learning
Deep learning
AI
Predict
Analyze
Organize
Collect
![Page 90: DevSci: Improving Software Through Data ScienceSkill 2016 Change Skill 2016 Change. What’s the problem? What’s the problem? ... O’Reilly 2015 Data Science Salary Survey Data](https://reader035.fdocuments.net/reader035/viewer/2022070723/5f0206d97e708231d402366c/html5/thumbnails/90.jpg)
AI
Predict
Analyze
Organize
Collect
![Page 91: DevSci: Improving Software Through Data ScienceSkill 2016 Change Skill 2016 Change. What’s the problem? What’s the problem? ... O’Reilly 2015 Data Science Salary Survey Data](https://reader035.fdocuments.net/reader035/viewer/2022070723/5f0206d97e708231d402366c/html5/thumbnails/91.jpg)
AI
Predict
Analyze
Organize
Collect
![Page 92: DevSci: Improving Software Through Data ScienceSkill 2016 Change Skill 2016 Change. What’s the problem? What’s the problem? ... O’Reilly 2015 Data Science Salary Survey Data](https://reader035.fdocuments.net/reader035/viewer/2022070723/5f0206d97e708231d402366c/html5/thumbnails/92.jpg)
Advice for Success
Get buy-in from leadership
Focus on low-hanging fruit
Don’t silo data science teamsDemocratize your data
![Page 93: DevSci: Improving Software Through Data ScienceSkill 2016 Change Skill 2016 Change. What’s the problem? What’s the problem? ... O’Reilly 2015 Data Science Salary Survey Data](https://reader035.fdocuments.net/reader035/viewer/2022070723/5f0206d97e708231d402366c/html5/thumbnails/93.jpg)
Advice for Success
Get buy-in from leadership
Focus on low-hanging fruit
Don’t silo data science teamsDemocratize your data
Embrace smart failure
Focus on feedback
Embed data collection
Avoid the Observer Effect
![Page 94: DevSci: Improving Software Through Data ScienceSkill 2016 Change Skill 2016 Change. What’s the problem? What’s the problem? ... O’Reilly 2015 Data Science Salary Survey Data](https://reader035.fdocuments.net/reader035/viewer/2022070723/5f0206d97e708231d402366c/html5/thumbnails/94.jpg)
Where to Go Next?
![Page 95: DevSci: Improving Software Through Data ScienceSkill 2016 Change Skill 2016 Change. What’s the problem? What’s the problem? ... O’Reilly 2015 Data Science Salary Survey Data](https://reader035.fdocuments.net/reader035/viewer/2022070723/5f0206d97e708231d402366c/html5/thumbnails/95.jpg)
Where to Go Next
Data Camp: https://www.datacamp.com
Pluralsight: https://www.pluralsight.com
Coursera: https://www.coursera.org
![Page 96: DevSci: Improving Software Through Data ScienceSkill 2016 Change Skill 2016 Change. What’s the problem? What’s the problem? ... O’Reilly 2015 Data Science Salary Survey Data](https://reader035.fdocuments.net/reader035/viewer/2022070723/5f0206d97e708231d402366c/html5/thumbnails/96.jpg)
www.pluralsight.com/authors/matthew-renze
Pluralsight Courses
Data Science: The Big Picture
Data Science with R
Exploratory Data Analysis with R
Data Visualization with R (3-part)
Deep Learning: The Big Picture
https://www.pluralsight.com/authors/matthew-renze
![Page 97: DevSci: Improving Software Through Data ScienceSkill 2016 Change Skill 2016 Change. What’s the problem? What’s the problem? ... O’Reilly 2015 Data Science Salary Survey Data](https://reader035.fdocuments.net/reader035/viewer/2022070723/5f0206d97e708231d402366c/html5/thumbnails/97.jpg)
www.matthewrenze.com
![Page 98: DevSci: Improving Software Through Data ScienceSkill 2016 Change Skill 2016 Change. What’s the problem? What’s the problem? ... O’Reilly 2015 Data Science Salary Survey Data](https://reader035.fdocuments.net/reader035/viewer/2022070723/5f0206d97e708231d402366c/html5/thumbnails/98.jpg)
Feedback
Very important to me!
What did you like?
What could I improve?
![Page 99: DevSci: Improving Software Through Data ScienceSkill 2016 Change Skill 2016 Change. What’s the problem? What’s the problem? ... O’Reilly 2015 Data Science Salary Survey Data](https://reader035.fdocuments.net/reader035/viewer/2022070723/5f0206d97e708231d402366c/html5/thumbnails/99.jpg)
Conclusion
![Page 100: DevSci: Improving Software Through Data ScienceSkill 2016 Change Skill 2016 Change. What’s the problem? What’s the problem? ... O’Reilly 2015 Data Science Salary Survey Data](https://reader035.fdocuments.net/reader035/viewer/2022070723/5f0206d97e708231d402366c/html5/thumbnails/100.jpg)
Why is it important?
What is data science?
How do I get started?
![Page 101: DevSci: Improving Software Through Data ScienceSkill 2016 Change Skill 2016 Change. What’s the problem? What’s the problem? ... O’Reilly 2015 Data Science Salary Survey Data](https://reader035.fdocuments.net/reader035/viewer/2022070723/5f0206d97e708231d402366c/html5/thumbnails/101.jpg)
![Page 102: DevSci: Improving Software Through Data ScienceSkill 2016 Change Skill 2016 Change. What’s the problem? What’s the problem? ... O’Reilly 2015 Data Science Salary Survey Data](https://reader035.fdocuments.net/reader035/viewer/2022070723/5f0206d97e708231d402366c/html5/thumbnails/102.jpg)
Is your organization?
Are you prepared?
Is our world prepared?
![Page 103: DevSci: Improving Software Through Data ScienceSkill 2016 Change Skill 2016 Change. What’s the problem? What’s the problem? ... O’Reilly 2015 Data Science Salary Survey Data](https://reader035.fdocuments.net/reader035/viewer/2022070723/5f0206d97e708231d402366c/html5/thumbnails/103.jpg)
![Page 104: DevSci: Improving Software Through Data ScienceSkill 2016 Change Skill 2016 Change. What’s the problem? What’s the problem? ... O’Reilly 2015 Data Science Salary Survey Data](https://reader035.fdocuments.net/reader035/viewer/2022070723/5f0206d97e708231d402366c/html5/thumbnails/104.jpg)
Thank You!
Matthew Renze
Data Science Consultant
Renze Consulting
Twitter: @matthewrenze
Email: [email protected]
Website: www.matthewrenze.com