Five Mindsets to Succeed as a Data Scientist IRL€¦ · anecdote is not data) • understand how...

72
Five Mindsets to Succeed as a Data Scientist IRL Pallav Agrawal, Director, Data Science Levi Strauss & Co.

Transcript of Five Mindsets to Succeed as a Data Scientist IRL€¦ · anecdote is not data) • understand how...

Page 1: Five Mindsets to Succeed as a Data Scientist IRL€¦ · anecdote is not data) • understand how the data were collected (sampling is essential) • weight the data thoughtfully

Five Mindsets to Succeed as a Data Scientist IRL

Pallav Agrawal,Director, Data Science

Levi Strauss & Co.

Page 2: Five Mindsets to Succeed as a Data Scientist IRL€¦ · anecdote is not data) • understand how the data were collected (sampling is essential) • weight the data thoughtfully

I WANT TO KNOW YOU

Page 3: Five Mindsets to Succeed as a Data Scientist IRL€¦ · anecdote is not data) • understand how the data were collected (sampling is essential) • weight the data thoughtfully

What do Data Scientists Create?

Page 4: Five Mindsets to Succeed as a Data Scientist IRL€¦ · anecdote is not data) • understand how the data were collected (sampling is essential) • weight the data thoughtfully

Create Concise Generalizations

Page 5: Five Mindsets to Succeed as a Data Scientist IRL€¦ · anecdote is not data) • understand how the data were collected (sampling is essential) • weight the data thoughtfully

“90 percent of the data in the world today has beencreated in the last two years alone”- IBM Marketing Study

Page 6: Five Mindsets to Succeed as a Data Scientist IRL€¦ · anecdote is not data) • understand how the data were collected (sampling is essential) • weight the data thoughtfully

https://twitter.com/Johnny_Uzan/status/1031742658048352257

Page 8: Five Mindsets to Succeed as a Data Scientist IRL€¦ · anecdote is not data) • understand how the data were collected (sampling is essential) • weight the data thoughtfully

Data Science is a lot like Observational Astronomy

Page 9: Five Mindsets to Succeed as a Data Scientist IRL€¦ · anecdote is not data) • understand how the data were collected (sampling is essential) • weight the data thoughtfully
Page 10: Five Mindsets to Succeed as a Data Scientist IRL€¦ · anecdote is not data) • understand how the data were collected (sampling is essential) • weight the data thoughtfully
Page 11: Five Mindsets to Succeed as a Data Scientist IRL€¦ · anecdote is not data) • understand how the data were collected (sampling is essential) • weight the data thoughtfully
Page 12: Five Mindsets to Succeed as a Data Scientist IRL€¦ · anecdote is not data) • understand how the data were collected (sampling is essential) • weight the data thoughtfully
Page 13: Five Mindsets to Succeed as a Data Scientist IRL€¦ · anecdote is not data) • understand how the data were collected (sampling is essential) • weight the data thoughtfully

-- Occam’s razor

Page 14: Five Mindsets to Succeed as a Data Scientist IRL€¦ · anecdote is not data) • understand how the data were collected (sampling is essential) • weight the data thoughtfully
Page 15: Five Mindsets to Succeed as a Data Scientist IRL€¦ · anecdote is not data) • understand how the data were collected (sampling is essential) • weight the data thoughtfully

Develop a really good BS Filter

Page 16: Five Mindsets to Succeed as a Data Scientist IRL€¦ · anecdote is not data) • understand how the data were collected (sampling is essential) • weight the data thoughtfully
Page 18: Five Mindsets to Succeed as a Data Scientist IRL€¦ · anecdote is not data) • understand how the data were collected (sampling is essential) • weight the data thoughtfully

https://www.facebook.com/dan.ariely/posts/904383595868

Page 19: Five Mindsets to Succeed as a Data Scientist IRL€¦ · anecdote is not data) • understand how the data were collected (sampling is essential) • weight the data thoughtfully

Companies with ‘.ai’ domains raise 3.5x more money

source

source

Page 20: Five Mindsets to Succeed as a Data Scientist IRL€¦ · anecdote is not data) • understand how the data were collected (sampling is essential) • weight the data thoughtfully

https://twitter.com/xaprb/status/930674776317849600

Page 23: Five Mindsets to Succeed as a Data Scientist IRL€¦ · anecdote is not data) • understand how the data were collected (sampling is essential) • weight the data thoughtfully

source

“First build this pyramid you must…”

Page 24: Five Mindsets to Succeed as a Data Scientist IRL€¦ · anecdote is not data) • understand how the data were collected (sampling is essential) • weight the data thoughtfully
Page 25: Five Mindsets to Succeed as a Data Scientist IRL€¦ · anecdote is not data) • understand how the data were collected (sampling is essential) • weight the data thoughtfully

AI StartupsExecutives

The Dunning-Kruger Effect

Page 26: Five Mindsets to Succeed as a Data Scientist IRL€¦ · anecdote is not data) • understand how the data were collected (sampling is essential) • weight the data thoughtfully

‘AI’ as a Service powers the Flywheel….

Page 27: Five Mindsets to Succeed as a Data Scientist IRL€¦ · anecdote is not data) • understand how the data were collected (sampling is essential) • weight the data thoughtfully

https://callingbullshit.org/

“Bullshit involves language, statistical figures, data graphics, and other forms of presentation intended to persuade by impressing and overwhelming a reader or listener, with a blatant disregard for truth and logical coherence.”

Page 28: Five Mindsets to Succeed as a Data Scientist IRL€¦ · anecdote is not data) • understand how the data were collected (sampling is essential) • weight the data thoughtfully
Page 29: Five Mindsets to Succeed as a Data Scientist IRL€¦ · anecdote is not data) • understand how the data were collected (sampling is essential) • weight the data thoughtfully

Learn to Think Like a Lawyer

Page 30: Five Mindsets to Succeed as a Data Scientist IRL€¦ · anecdote is not data) • understand how the data were collected (sampling is essential) • weight the data thoughtfully

What is a Sandwich?

Page 31: Five Mindsets to Succeed as a Data Scientist IRL€¦ · anecdote is not data) • understand how the data were collected (sampling is essential) • weight the data thoughtfully

Is this a Sandwich?

Page 32: Five Mindsets to Succeed as a Data Scientist IRL€¦ · anecdote is not data) • understand how the data were collected (sampling is essential) • weight the data thoughtfully

Is this a Sandwich?

Page 33: Five Mindsets to Succeed as a Data Scientist IRL€¦ · anecdote is not data) • understand how the data were collected (sampling is essential) • weight the data thoughtfully

Is this a Sandwich?

Page 34: Five Mindsets to Succeed as a Data Scientist IRL€¦ · anecdote is not data) • understand how the data were collected (sampling is essential) • weight the data thoughtfully

Is this a Sandwich?

Page 35: Five Mindsets to Succeed as a Data Scientist IRL€¦ · anecdote is not data) • understand how the data were collected (sampling is essential) • weight the data thoughtfully

Is this a Sandwich?

Page 36: Five Mindsets to Succeed as a Data Scientist IRL€¦ · anecdote is not data) • understand how the data were collected (sampling is essential) • weight the data thoughtfully

Are any of these a Sandwich?

Page 37: Five Mindsets to Succeed as a Data Scientist IRL€¦ · anecdote is not data) • understand how the data were collected (sampling is essential) • weight the data thoughtfully

“SANDWICHES” AS USED IN ARTICLES 47 AND 48 OF TITLE 12, C.R.S. ARE DEFINED AS SINGLE SERVING ITEMS SUCH AS HAMBURGERS, HOT DOGS, FROZEN PIZZAS, BURRITOS, CHICKEN WINGS, ETC.”

- Colorado Department of Revenue, Liquor Enforcement Division

source

Page 38: Five Mindsets to Succeed as a Data Scientist IRL€¦ · anecdote is not data) • understand how the data were collected (sampling is essential) • weight the data thoughtfully

“I know it, when I see it”

Page 39: Five Mindsets to Succeed as a Data Scientist IRL€¦ · anecdote is not data) • understand how the data were collected (sampling is essential) • weight the data thoughtfully

What about Fraud Detection?

Page 40: Five Mindsets to Succeed as a Data Scientist IRL€¦ · anecdote is not data) • understand how the data were collected (sampling is essential) • weight the data thoughtfully

Or Predicting CLTV?

Page 41: Five Mindsets to Succeed as a Data Scientist IRL€¦ · anecdote is not data) • understand how the data were collected (sampling is essential) • weight the data thoughtfully

It often helps to frame a problem statement like a Legal Contract

Page 42: Five Mindsets to Succeed as a Data Scientist IRL€¦ · anecdote is not data) • understand how the data were collected (sampling is essential) • weight the data thoughtfully

Kozyrkov’s Razor“When decision-makers don’t realize

that thinking deeply is their job, remind them.”

source

Page 43: Five Mindsets to Succeed as a Data Scientist IRL€¦ · anecdote is not data) • understand how the data were collected (sampling is essential) • weight the data thoughtfully

Utilize UI/UX to Improve CX

Page 44: Five Mindsets to Succeed as a Data Scientist IRL€¦ · anecdote is not data) • understand how the data were collected (sampling is essential) • weight the data thoughtfully
Page 45: Five Mindsets to Succeed as a Data Scientist IRL€¦ · anecdote is not data) • understand how the data were collected (sampling is essential) • weight the data thoughtfully

“FB Messenger Bot was unable to understand 70% of customer queries”- Motley Fool

Page 46: Five Mindsets to Succeed as a Data Scientist IRL€¦ · anecdote is not data) • understand how the data were collected (sampling is essential) • weight the data thoughtfully

“41% of consumers say they stopped shopping with a company because of “poor personalization.”-Accenture

Page 47: Five Mindsets to Succeed as a Data Scientist IRL€¦ · anecdote is not data) • understand how the data were collected (sampling is essential) • weight the data thoughtfully

Design for Trust

Page 48: Five Mindsets to Succeed as a Data Scientist IRL€¦ · anecdote is not data) • understand how the data were collected (sampling is essential) • weight the data thoughtfully

Encourage User Feedback

Page 49: Five Mindsets to Succeed as a Data Scientist IRL€¦ · anecdote is not data) • understand how the data were collected (sampling is essential) • weight the data thoughtfully

Show, Don’t Tell

Wizard of Oz Testing Start with an MVP

Page 50: Five Mindsets to Succeed as a Data Scientist IRL€¦ · anecdote is not data) • understand how the data were collected (sampling is essential) • weight the data thoughtfully

“You have to start with the customer experience and work backwards to the

technology”Steve Jobs

Page 51: Five Mindsets to Succeed as a Data Scientist IRL€¦ · anecdote is not data) • understand how the data were collected (sampling is essential) • weight the data thoughtfully

Three (timeless) books to get you started

Page 52: Five Mindsets to Succeed as a Data Scientist IRL€¦ · anecdote is not data) • understand how the data were collected (sampling is essential) • weight the data thoughtfully

Data Science is a Team Sport

Page 53: Five Mindsets to Succeed as a Data Scientist IRL€¦ · anecdote is not data) • understand how the data were collected (sampling is essential) • weight the data thoughtfully

Types of Data Science Practiced Today:

Marketing/PR Centric: Where the hype around ‘AI’ is used to improve perception of an aging company among Wall Street Analysts

Page 54: Five Mindsets to Succeed as a Data Scientist IRL€¦ · anecdote is not data) • understand how the data were collected (sampling is essential) • weight the data thoughtfully

Types of Data Science Practiced Today:

Marketing/PR Centric: Where the hype around ‘AI’ is used to improve perception of an aging company among Wall Street Analysts

Research Centric: Where the discovery of new algorithms is central to maintain the company’s competitive advantage

Page 55: Five Mindsets to Succeed as a Data Scientist IRL€¦ · anecdote is not data) • understand how the data were collected (sampling is essential) • weight the data thoughtfully

Types of Data Science Practiced Today:

Marketing/PR Centric: Where the hype around ‘AI’ is used to improve perception of an aging company among Wall Street Analysts

Research Centric: Where the discovery of new algorithms is central to maintain the company’s competitive advantage

Recruiting Centric: Where the only way the company can attract the best minds is through “look at all this cool AI we are doing!”

Page 56: Five Mindsets to Succeed as a Data Scientist IRL€¦ · anecdote is not data) • understand how the data were collected (sampling is essential) • weight the data thoughtfully

Types of Data Science Practiced Today:

Marketing/PR Centric: Where the hype around ‘AI’ is used to improve perception of an aging company among Wall Street Analysts

Research Centric: Where the discovery of new algorithms is central to maintain the company’s competitive advantage

Recruiting Centric: Where the only way the company can attract the best minds is through “look at all this cool AI we are doing!”

Ego-Centric: Where the CEO wants to appear a visionary at Techcrunch Disrupt by unloading a bunch of Singularity references

Page 57: Five Mindsets to Succeed as a Data Scientist IRL€¦ · anecdote is not data) • understand how the data were collected (sampling is essential) • weight the data thoughtfully

Types of Data Science Practiced Today:

Marketing/PR Centric: Where the hype around ‘AI’ is used to improve perception of an aging company among Wall Street Analysts

Research Centric: Where the discovery of new algorithms is central to maintain the company’s competitive advantage

Recruiting Centric: Where the only way the company can attract the best minds is through “look at all this cool AI we are doing!”

Ego-Centric: Where the CEO wants to appear a visionary at Techcrunch Disrupt by unloading a bunch of Singularity references

Business Centric: Where the most important business decisions are made using insights derived from the scientific use of data

Page 58: Five Mindsets to Succeed as a Data Scientist IRL€¦ · anecdote is not data) • understand how the data were collected (sampling is essential) • weight the data thoughtfully

Types of Data Science Practiced Today:

Marketing/PR Centric: Where the hype around ‘AI’ is used to improve perception of an aging company among Wall Street Analysts

Research Centric: Where the discovery of new algorithms is central to maintain the company’s competitive advantage

Recruiting Centric: Where the only way the company can attract the best minds is through “look at all this cool AI we are doing!”

Ego-Centric: Where the CEO wants to appear a visionary at Techcrunch Disrupt by unloading a bunch of Singularity references

Business Centric: Where the most important business decisions are made using insights derived from the scientific use of data

Data Science as a

Team Sport

Page 59: Five Mindsets to Succeed as a Data Scientist IRL€¦ · anecdote is not data) • understand how the data were collected (sampling is essential) • weight the data thoughtfully

Business-Centric Data Science is a Team Sport

Cheerleader

Business Stakeholder

Customer Insights

DevOps

Project Manager

Technical Product Manager

Data Scientist

Data Engineer

UI/UX

Data Analyst

Subject Matter Expert

Page 60: Five Mindsets to Succeed as a Data Scientist IRL€¦ · anecdote is not data) • understand how the data were collected (sampling is essential) • weight the data thoughtfully

Roadmap DevelopmentCustomer

Business Technology

Page 61: Five Mindsets to Succeed as a Data Scientist IRL€¦ · anecdote is not data) • understand how the data were collected (sampling is essential) • weight the data thoughtfully

Roadmap DevelopmentCustomer

Business Technology

Desirability

I want:

● Free 1-hour delivery on orders● Beyonce’s look from Coachella● To experience the feel of the

garment virtually

Page 62: Five Mindsets to Succeed as a Data Scientist IRL€¦ · anecdote is not data) • understand how the data were collected (sampling is essential) • weight the data thoughtfully

Roadmap DevelopmentCustomer

Business Technology

Desirability

I want:

● Free 1-hour delivery on orders● Beyonce’s look from Coachella● To experience the feel of the

garment virtually

Viability

Page 63: Five Mindsets to Succeed as a Data Scientist IRL€¦ · anecdote is not data) • understand how the data were collected (sampling is essential) • weight the data thoughtfully

Roadmap DevelopmentCustomer

Business Technology

Desirability

I want:

● Free 1-hour delivery on orders● Beyonce’s look from Coachella● To experience the feel of the

garment virtually

Viability Feasibility

Page 64: Five Mindsets to Succeed as a Data Scientist IRL€¦ · anecdote is not data) • understand how the data were collected (sampling is essential) • weight the data thoughtfully

Roadmap DevelopmentCustomer

Business Technology

Desirability

FeasibilityViability

I want:

● Free 1-hour delivery on orders● Beyonce’s look from Coachella● To experience the feel of the

garment virtually

Page 65: Five Mindsets to Succeed as a Data Scientist IRL€¦ · anecdote is not data) • understand how the data were collected (sampling is essential) • weight the data thoughtfully

Ideation Uncovering Automation Opportunities:

If I could identify/recognize/interpet _____________________________________________

in __________________________________________,

I could _____________________________________.

Hint: sources could include anything from images, video, audio, text or a mix of these.

http://milkandhoney.ai/

Page 66: Five Mindsets to Succeed as a Data Scientist IRL€¦ · anecdote is not data) • understand how the data were collected (sampling is essential) • weight the data thoughtfully

Ideation Uncovering Prediction Opportunities:

If I could predict precisely how much/many _____________________________________________ at any given moment, I could _____________________________________________.

Hint: identify places where you currently rely on estimates and averages to make decisions.

If I could predict the fastest way to _____________________________________________ at any given moment, I could _____________________________________________.

Hint: identify processes that require moving something from point A to point B with multiple paths to choose from.

http://milkandhoney.ai/

Page 67: Five Mindsets to Succeed as a Data Scientist IRL€¦ · anecdote is not data) • understand how the data were collected (sampling is essential) • weight the data thoughtfully
Page 68: Five Mindsets to Succeed as a Data Scientist IRL€¦ · anecdote is not data) • understand how the data were collected (sampling is essential) • weight the data thoughtfully

RECAP

Data Science is the process of extracting concise and actionable insights from data through scientific rigor

Practice healthy skepticism towards most remarkable claims, and cautious optimism towards the applicability of positive results

Before executing, first craft a precise problem statement developed with decision makers using data and subject matter expertise

Focus on improving the customer experience by making the customer journey intuitive and frictionless

Learn to communicate and collaborate within interdisciplinary teams to build products that lie at the intersection of desirability, viability and feasibility

Page 69: Five Mindsets to Succeed as a Data Scientist IRL€¦ · anecdote is not data) • understand how the data were collected (sampling is essential) • weight the data thoughtfully

Questions?

Page 70: Five Mindsets to Succeed as a Data Scientist IRL€¦ · anecdote is not data) • understand how the data were collected (sampling is essential) • weight the data thoughtfully

Are you doing analytics or statistics? Cargo Cult science?Some Key Principles • use many data sources (the plural of anecdote is not data) • understand how the data were collected (sampling is essential) • weight the data thoughtfully (not all polls are equally good) • use statistical models (not just hacking around in Excel) • understand correlations (e.g., states that trend similarly) • think like a Bayesian, check like a frequentist (reconciliation) • have good communication skills (What does a 60% probability even mean? How can we visualize, validate, and understand the conclusions?)

Page 71: Five Mindsets to Succeed as a Data Scientist IRL€¦ · anecdote is not data) • understand how the data were collected (sampling is essential) • weight the data thoughtfully

Data science produces insights about people

Machine learning produces predictions for people to use

Artificial intelligence produces actions to help people

- David Robinson, Chief Data Scientist at DataCamp

Page 72: Five Mindsets to Succeed as a Data Scientist IRL€¦ · anecdote is not data) • understand how the data were collected (sampling is essential) • weight the data thoughtfully

What the team depends on a Technical Product Manager for:- Vision and Roadmap Development- Customer Needs and Wants- Ideation and Solutioning- Goal Setting: KPI’s, OKR’s- Domain Knowledge- Technical Fluency- Cross-Functional Communication

In the absence of whom, these responsibilities are delegated to the most willing, or remain unfulfilled.

TPM

Data Science

Data Eng.

UI/UX

Project Manager.

Biz

Customer Insights