Predictive Analytics for the Business Analystdownload.101com.com/pub/tdwi/Files/Actuate...
Transcript of Predictive Analytics for the Business Analystdownload.101com.com/pub/tdwi/Files/Actuate...
![Page 1: Predictive Analytics for the Business Analystdownload.101com.com/pub/tdwi/Files/Actuate 070814.pdf · 14/08/2007 · Predictive Analytics for the Business Analyst Fern Halper July](https://reader034.fdocuments.net/reader034/viewer/2022051410/602ab43d239ff87a8c069671/html5/thumbnails/1.jpg)
Predictive Analytics for the Business Analyst
Fern Halper
July 8, 2014
@fhalper
![Page 2: Predictive Analytics for the Business Analystdownload.101com.com/pub/tdwi/Files/Actuate 070814.pdf · 14/08/2007 · Predictive Analytics for the Business Analyst Fern Halper July](https://reader034.fdocuments.net/reader034/viewer/2022051410/602ab43d239ff87a8c069671/html5/thumbnails/2.jpg)
Sponsor
![Page 3: Predictive Analytics for the Business Analystdownload.101com.com/pub/tdwi/Files/Actuate 070814.pdf · 14/08/2007 · Predictive Analytics for the Business Analyst Fern Halper July](https://reader034.fdocuments.net/reader034/viewer/2022051410/602ab43d239ff87a8c069671/html5/thumbnails/3.jpg)
3
Speakers
Fern Halper Research Director for
Advanced Analytics,
TDWI
Allen Bonde VP, Product Marketing
and Innovation,
Actuate
![Page 4: Predictive Analytics for the Business Analystdownload.101com.com/pub/tdwi/Files/Actuate 070814.pdf · 14/08/2007 · Predictive Analytics for the Business Analyst Fern Halper July](https://reader034.fdocuments.net/reader034/viewer/2022051410/602ab43d239ff87a8c069671/html5/thumbnails/4.jpg)
• Brief overview of predictive analytics
• Predictive analytics trends
• Skills required
• Getting started
Agenda
4
![Page 5: Predictive Analytics for the Business Analystdownload.101com.com/pub/tdwi/Files/Actuate 070814.pdf · 14/08/2007 · Predictive Analytics for the Business Analyst Fern Halper July](https://reader034.fdocuments.net/reader034/viewer/2022051410/602ab43d239ff87a8c069671/html5/thumbnails/5.jpg)
The Analytics Spectrum
5
Excel
Dashboards and reports
Other BI
Visualization
Advanced Analytics
Often becomes more algorithmic
![Page 6: Predictive Analytics for the Business Analystdownload.101com.com/pub/tdwi/Files/Actuate 070814.pdf · 14/08/2007 · Predictive Analytics for the Business Analyst Fern Halper July](https://reader034.fdocuments.net/reader034/viewer/2022051410/602ab43d239ff87a8c069671/html5/thumbnails/6.jpg)
Predictive Analytics
6
A statistical or data mining solution
consisting of algorithms
and techniques that can be used
on both structured
and unstructured data to determine outcomes.
![Page 7: Predictive Analytics for the Business Analystdownload.101com.com/pub/tdwi/Files/Actuate 070814.pdf · 14/08/2007 · Predictive Analytics for the Business Analyst Fern Halper July](https://reader034.fdocuments.net/reader034/viewer/2022051410/602ab43d239ff87a8c069671/html5/thumbnails/7.jpg)
• Marketing and sales**
• Healthcare
• Fraud detection
• Human resources
• Operations maintenance
• And many, many more!
Some Use Cases
![Page 8: Predictive Analytics for the Business Analystdownload.101com.com/pub/tdwi/Files/Actuate 070814.pdf · 14/08/2007 · Predictive Analytics for the Business Analyst Fern Halper July](https://reader034.fdocuments.net/reader034/viewer/2022051410/602ab43d239ff87a8c069671/html5/thumbnails/8.jpg)
Popular Methods
• Decision Trees
• Regression
• Cluster Analysis
8
Total
Monthly bill
> 2 yr
>$100
Length of time
customer
Call center
calls No
< 2 yr
<$100
No. of phones
on account
90% probability
Etc…
![Page 9: Predictive Analytics for the Business Analystdownload.101com.com/pub/tdwi/Files/Actuate 070814.pdf · 14/08/2007 · Predictive Analytics for the Business Analyst Fern Halper July](https://reader034.fdocuments.net/reader034/viewer/2022051410/602ab43d239ff87a8c069671/html5/thumbnails/9.jpg)
Trends
• Ease of use
• Disparate data types
• Operationalizing and
embedding advanced analytics
• Prescriptive
9
![Page 10: Predictive Analytics for the Business Analystdownload.101com.com/pub/tdwi/Files/Actuate 070814.pdf · 14/08/2007 · Predictive Analytics for the Business Analyst Fern Halper July](https://reader034.fdocuments.net/reader034/viewer/2022051410/602ab43d239ff87a8c069671/html5/thumbnails/10.jpg)
1. Ease of Use
• Graphical UI
• Automation
• Solutions
10
![Page 11: Predictive Analytics for the Business Analystdownload.101com.com/pub/tdwi/Files/Actuate 070814.pdf · 14/08/2007 · Predictive Analytics for the Business Analyst Fern Halper July](https://reader034.fdocuments.net/reader034/viewer/2022051410/602ab43d239ff87a8c069671/html5/thumbnails/11.jpg)
Ease of Use
Predictive
Analytics
New builders
11
![Page 12: Predictive Analytics for the Business Analystdownload.101com.com/pub/tdwi/Files/Actuate 070814.pdf · 14/08/2007 · Predictive Analytics for the Business Analyst Fern Halper July](https://reader034.fdocuments.net/reader034/viewer/2022051410/602ab43d239ff87a8c069671/html5/thumbnails/12.jpg)
New Users are Emerging
Statistician/Modeler Moving towards critical
thinker with knowledge of
the business -- e.g. a
business analyst
![Page 13: Predictive Analytics for the Business Analystdownload.101com.com/pub/tdwi/Files/Actuate 070814.pdf · 14/08/2007 · Predictive Analytics for the Business Analyst Fern Halper July](https://reader034.fdocuments.net/reader034/viewer/2022051410/602ab43d239ff87a8c069671/html5/thumbnails/13.jpg)
The Business Analyst Rules
13
(source: TDWI Best Practices Report Predictive Analytics for Business Advantage, 2014)
![Page 14: Predictive Analytics for the Business Analystdownload.101com.com/pub/tdwi/Files/Actuate 070814.pdf · 14/08/2007 · Predictive Analytics for the Business Analyst Fern Halper July](https://reader034.fdocuments.net/reader034/viewer/2022051410/602ab43d239ff87a8c069671/html5/thumbnails/14.jpg)
With an Evolving Skill Set
14
This ranks low
![Page 15: Predictive Analytics for the Business Analystdownload.101com.com/pub/tdwi/Files/Actuate 070814.pdf · 14/08/2007 · Predictive Analytics for the Business Analyst Fern Halper July](https://reader034.fdocuments.net/reader034/viewer/2022051410/602ab43d239ff87a8c069671/html5/thumbnails/15.jpg)
2. Data, Data
Predictive
Analytics
New Data
Types
15
![Page 16: Predictive Analytics for the Business Analystdownload.101com.com/pub/tdwi/Files/Actuate 070814.pdf · 14/08/2007 · Predictive Analytics for the Business Analyst Fern Halper July](https://reader034.fdocuments.net/reader034/viewer/2022051410/602ab43d239ff87a8c069671/html5/thumbnails/16.jpg)
New and “Big” Data Types for Analysis
16
Disparate
data sources
![Page 17: Predictive Analytics for the Business Analystdownload.101com.com/pub/tdwi/Files/Actuate 070814.pdf · 14/08/2007 · Predictive Analytics for the Business Analyst Fern Halper July](https://reader034.fdocuments.net/reader034/viewer/2022051410/602ab43d239ff87a8c069671/html5/thumbnails/17.jpg)
3. New Deployment Models
Predictive
Analytics
Operationalizing
Embedding
17
![Page 18: Predictive Analytics for the Business Analystdownload.101com.com/pub/tdwi/Files/Actuate 070814.pdf · 14/08/2007 · Predictive Analytics for the Business Analyst Fern Halper July](https://reader034.fdocuments.net/reader034/viewer/2022051410/602ab43d239ff87a8c069671/html5/thumbnails/18.jpg)
Embedded Analytics
18
An example:
![Page 19: Predictive Analytics for the Business Analystdownload.101com.com/pub/tdwi/Files/Actuate 070814.pdf · 14/08/2007 · Predictive Analytics for the Business Analyst Fern Halper July](https://reader034.fdocuments.net/reader034/viewer/2022051410/602ab43d239ff87a8c069671/html5/thumbnails/19.jpg)
Example: Fraud
• Objectives:
– Reduce fraud
– Improve customer experience
• Benefits
– Speed up process
– Reduce false alerts
– Save money
19
![Page 20: Predictive Analytics for the Business Analystdownload.101com.com/pub/tdwi/Files/Actuate 070814.pdf · 14/08/2007 · Predictive Analytics for the Business Analyst Fern Halper July](https://reader034.fdocuments.net/reader034/viewer/2022051410/602ab43d239ff87a8c069671/html5/thumbnails/20.jpg)
4. Prescriptive Analytics
Whereas predictive analytics helps to determine
what might happen, prescriptive analytics takes
this further to either suggest or automatically
initiate a subsequent action based on this
output.
20
![Page 21: Predictive Analytics for the Business Analystdownload.101com.com/pub/tdwi/Files/Actuate 070814.pdf · 14/08/2007 · Predictive Analytics for the Business Analyst Fern Halper July](https://reader034.fdocuments.net/reader034/viewer/2022051410/602ab43d239ff87a8c069671/html5/thumbnails/21.jpg)
Skills Needed (1)
21
Framing the problem
2. Data Sense
3. Domain
Expertise
1. Critical Thinking
![Page 22: Predictive Analytics for the Business Analystdownload.101com.com/pub/tdwi/Files/Actuate 070814.pdf · 14/08/2007 · Predictive Analytics for the Business Analyst Fern Halper July](https://reader034.fdocuments.net/reader034/viewer/2022051410/602ab43d239ff87a8c069671/html5/thumbnails/22.jpg)
1. Critical Thinking
• Ability to formulate a question
• Comfortable creatively thinking in numbers
and attributes
• Interpretation skills
• Inference
Above all: Questioning
22
![Page 23: Predictive Analytics for the Business Analystdownload.101com.com/pub/tdwi/Files/Actuate 070814.pdf · 14/08/2007 · Predictive Analytics for the Business Analyst Fern Halper July](https://reader034.fdocuments.net/reader034/viewer/2022051410/602ab43d239ff87a8c069671/html5/thumbnails/23.jpg)
2. Domain Expertise
• Helps in:
– formulating good questions
– understanding objectives
– assessing the model and taking action on it
• Understanding relevant data
– Dealing with data – outliers, missing data, etc.
23
![Page 24: Predictive Analytics for the Business Analystdownload.101com.com/pub/tdwi/Files/Actuate 070814.pdf · 14/08/2007 · Predictive Analytics for the Business Analyst Fern Halper July](https://reader034.fdocuments.net/reader034/viewer/2022051410/602ab43d239ff87a8c069671/html5/thumbnails/24.jpg)
3. Understanding data
• Target vs. explanatory variables
• Derived variables
• Lots of new data types
– Documents, graph, location
– May require parsing, geocoding
24
![Page 25: Predictive Analytics for the Business Analystdownload.101com.com/pub/tdwi/Files/Actuate 070814.pdf · 14/08/2007 · Predictive Analytics for the Business Analyst Fern Halper July](https://reader034.fdocuments.net/reader034/viewer/2022051410/602ab43d239ff87a8c069671/html5/thumbnails/25.jpg)
Skills Needed (2)
25
Explain/Defend
5. Techniques
4. Tools
![Page 26: Predictive Analytics for the Business Analystdownload.101com.com/pub/tdwi/Files/Actuate 070814.pdf · 14/08/2007 · Predictive Analytics for the Business Analyst Fern Halper July](https://reader034.fdocuments.net/reader034/viewer/2022051410/602ab43d239ff87a8c069671/html5/thumbnails/26.jpg)
4. Understanding the tools!
26
![Page 27: Predictive Analytics for the Business Analystdownload.101com.com/pub/tdwi/Files/Actuate 070814.pdf · 14/08/2007 · Predictive Analytics for the Business Analyst Fern Halper July](https://reader034.fdocuments.net/reader034/viewer/2022051410/602ab43d239ff87a8c069671/html5/thumbnails/27.jpg)
5. Understanding the techniques
• A basic understanding is necessary
27
![Page 28: Predictive Analytics for the Business Analystdownload.101com.com/pub/tdwi/Files/Actuate 070814.pdf · 14/08/2007 · Predictive Analytics for the Business Analyst Fern Halper July](https://reader034.fdocuments.net/reader034/viewer/2022051410/602ab43d239ff87a8c069671/html5/thumbnails/28.jpg)
6. Storytelling
• Don’t start with the techniques
• Begin with the business problem and the
outcome.
28
(source: vitualspeechcoach.com)
![Page 29: Predictive Analytics for the Business Analystdownload.101com.com/pub/tdwi/Files/Actuate 070814.pdf · 14/08/2007 · Predictive Analytics for the Business Analyst Fern Halper July](https://reader034.fdocuments.net/reader034/viewer/2022051410/602ab43d239ff87a8c069671/html5/thumbnails/29.jpg)
Getting started
• An analytics program does take time
• But you can get started quickly
29
Not necessarily sequential!
![Page 30: Predictive Analytics for the Business Analystdownload.101com.com/pub/tdwi/Files/Actuate 070814.pdf · 14/08/2007 · Predictive Analytics for the Business Analyst Fern Halper July](https://reader034.fdocuments.net/reader034/viewer/2022051410/602ab43d239ff87a8c069671/html5/thumbnails/30.jpg)
Getting started
• Pick a problem
• Experiment and involve business/IT
• POV/POC tied to metrics
• Decide beforehand how to integrate it into
a process
• Balance cost of model with model building
solutions
30
![Page 31: Predictive Analytics for the Business Analystdownload.101com.com/pub/tdwi/Files/Actuate 070814.pdf · 14/08/2007 · Predictive Analytics for the Business Analyst Fern Halper July](https://reader034.fdocuments.net/reader034/viewer/2022051410/602ab43d239ff87a8c069671/html5/thumbnails/31.jpg)
31
![Page 32: Predictive Analytics for the Business Analystdownload.101com.com/pub/tdwi/Files/Actuate 070814.pdf · 14/08/2007 · Predictive Analytics for the Business Analyst Fern Halper July](https://reader034.fdocuments.net/reader034/viewer/2022051410/602ab43d239ff87a8c069671/html5/thumbnails/32.jpg)
Actuate Corporation © 2014
Fast is the new Big!
32
![Page 33: Predictive Analytics for the Business Analystdownload.101com.com/pub/tdwi/Files/Actuate 070814.pdf · 14/08/2007 · Predictive Analytics for the Business Analyst Fern Halper July](https://reader034.fdocuments.net/reader034/viewer/2022051410/602ab43d239ff87a8c069671/html5/thumbnails/33.jpg)
“Fast analytics” enables…
Iterative process employ A/B testing, chunk down problem
Better questions “what do I ask next?”
Instant feedback “what can I adjust?”
33
![Page 34: Predictive Analytics for the Business Analystdownload.101com.com/pub/tdwi/Files/Actuate 070814.pdf · 14/08/2007 · Predictive Analytics for the Business Analyst Fern Halper July](https://reader034.fdocuments.net/reader034/viewer/2022051410/602ab43d239ff87a8c069671/html5/thumbnails/34.jpg)
Actuate Corporation © 2014 34
Staying Focused is Key
![Page 35: Predictive Analytics for the Business Analystdownload.101com.com/pub/tdwi/Files/Actuate 070814.pdf · 14/08/2007 · Predictive Analytics for the Business Analyst Fern Halper July](https://reader034.fdocuments.net/reader034/viewer/2022051410/602ab43d239ff87a8c069671/html5/thumbnails/35.jpg)
Improved cross-sell?
Getting all data together
Pricing optimization
What’s the business case?
Better customer understanding
Risk management
35
![Page 36: Predictive Analytics for the Business Analystdownload.101com.com/pub/tdwi/Files/Actuate 070814.pdf · 14/08/2007 · Predictive Analytics for the Business Analyst Fern Halper July](https://reader034.fdocuments.net/reader034/viewer/2022051410/602ab43d239ff87a8c069671/html5/thumbnails/36.jpg)
Actuate Corporation © 2014 36
Picking the Right Tool
![Page 37: Predictive Analytics for the Business Analystdownload.101com.com/pub/tdwi/Files/Actuate 070814.pdf · 14/08/2007 · Predictive Analytics for the Business Analyst Fern Halper July](https://reader034.fdocuments.net/reader034/viewer/2022051410/602ab43d239ff87a8c069671/html5/thumbnails/37.jpg)
Key Challenges…
Disparate sources, billions of records
Complexity of loading, cleaning
Need all data in one view
Easily profile and segment
Look for trends, relationships
37
Access data Understand Patterns
Deliver Insights
Explore, visualize…with no
coding!
Enable non-technical business users
Support iterative, collaborative work
Integrate with operational systems
Insights in minutes vs. days
![Page 38: Predictive Analytics for the Business Analystdownload.101com.com/pub/tdwi/Files/Actuate 070814.pdf · 14/08/2007 · Predictive Analytics for the Business Analyst Fern Halper July](https://reader034.fdocuments.net/reader034/viewer/2022051410/602ab43d239ff87a8c069671/html5/thumbnails/38.jpg)
CRM/ERP
Web
Social
“To create a complete picture of customers, we need to combine insights from social channels and campaigns with Web and transactional data”
10 Reasons 2014 will be the Year of Small Data, ZDNet, Dec 2013
Other sources
Columnar
DB
APPROACH: Make it easy to access and integrate data…
38
![Page 39: Predictive Analytics for the Business Analystdownload.101com.com/pub/tdwi/Files/Actuate 070814.pdf · 14/08/2007 · Predictive Analytics for the Business Analyst Fern Halper July](https://reader034.fdocuments.net/reader034/viewer/2022051410/602ab43d239ff87a8c069671/html5/thumbnails/39.jpg)
Exploration &
Visualization
“Many vendors are trying to (make predictive analytics available to an end user in a consumable form) but in our view BIRT Analytics comes closest to getting it right, by …
not requiring the user to select algorithms” IDC, Feb 2013
Profile
Forecast
Decision Tree
Cluster
Analytics &
Data Mining
Segmentation
Campaign
Workflow
Columnar
DB
…and shorten time-to-value by using pre-built analytics
39
![Page 40: Predictive Analytics for the Business Analystdownload.101com.com/pub/tdwi/Files/Actuate 070814.pdf · 14/08/2007 · Predictive Analytics for the Business Analyst Fern Halper July](https://reader034.fdocuments.net/reader034/viewer/2022051410/602ab43d239ff87a8c069671/html5/thumbnails/40.jpg)
40
![Page 41: Predictive Analytics for the Business Analystdownload.101com.com/pub/tdwi/Files/Actuate 070814.pdf · 14/08/2007 · Predictive Analytics for the Business Analyst Fern Halper July](https://reader034.fdocuments.net/reader034/viewer/2022051410/602ab43d239ff87a8c069671/html5/thumbnails/41.jpg)
visit www.actuate.com/BIRTanalytics
my blog: www.smalldatagroup.com follow @actuate, @abonde
![Page 42: Predictive Analytics for the Business Analystdownload.101com.com/pub/tdwi/Files/Actuate 070814.pdf · 14/08/2007 · Predictive Analytics for the Business Analyst Fern Halper July](https://reader034.fdocuments.net/reader034/viewer/2022051410/602ab43d239ff87a8c069671/html5/thumbnails/42.jpg)
42
Questions?
![Page 43: Predictive Analytics for the Business Analystdownload.101com.com/pub/tdwi/Files/Actuate 070814.pdf · 14/08/2007 · Predictive Analytics for the Business Analyst Fern Halper July](https://reader034.fdocuments.net/reader034/viewer/2022051410/602ab43d239ff87a8c069671/html5/thumbnails/43.jpg)
43
Contact Information
If you have further questions or comments:
Fern Halper, TDWI [email protected]
Allen Bonde, Actuate [email protected]