Analytic Maturity: Bringing Predictive into the Mainstream
-
Upload
inside-analysis -
Category
Technology
-
view
145 -
download
1
description
Transcript of Analytic Maturity: Bringing Predictive into the Mainstream
Grab some coffee and enjoy the pre-show banter before the top of the hour!
The Briefing Room
Analytic Maturity: Bringing Predictive into the Mainstream
Twitter Tag: #briefr
The Briefing Room
! Reveal the essential characteristics of enterprise software, good and bad
! Provide a forum for detailed analysis of today’s innovative technologies
! Give vendors a chance to explain their product to savvy analysts
! Allow audience members to pose serious questions... and get answers!
Mission
Twitter Tag: #briefr
The Briefing Room
Topics
This Month: ANALYTICS & MACHINE LEARNING
July: INNOVATIVE TECHNOLOGY
August: BIG DATA ECOSYSTEM
2014 Editorial Calendar at www.insideanalysis.com/webcasts/the-briefing-room
Twitter Tag: #briefr
The Briefing Room
Database
Twitter Tag: #briefr
The Briefing Room
Analyst: Dean Abbott
Dean Abbott is President of Abbott Analytics, Inc. Dean has more than 21 years of experience applying advanced data mining, data preparation and data visualization methods in real-world data-intensive problems, including fraud detection, response modeling, survey analysis, planned giving, predictive toxicology, signal process and missile guidance. He has developed and evaluated algorithms for use in commercial data mining and pattern recognition products, including polynomial networks, neural networks, radial basis functions and clustering algorithms. He is a seasoned instructor, having taught a wide range of data mining tutorials and seminars.
Twitter Tag: #briefr
The Briefing Room
TIBCO Spotfire
! TIBCO Spotfire is a BI and analytics platform known for its robust visualizations and data analysis capabilities
! The platform offers predictive analytics, and includes Statistics Services, Enterprise Runtime for R and predictive modeling tools
! The TIBCO platform applies real-time, event-driven analytics against streams of data, and it provides workflow guidance and automation
Twitter Tag: #briefr
The Briefing Room
Guest: Lou Bajuk-Yorgan
Lou Bajuk-Yorgan leads Predictive Analytics product strategy at TIBCO Spotfire, including the development of TIBCO Enterprise Runtime for R (TERR), an enterprise deployment platform for R-language analytics. With a background in Physics and Atmospheric Sciences, Lou was a Research Scientist at NASA JPL before focusing on Advanced Analytics and Business Intelligence software. Since then, Lou has worked with scores of customers across many industries to understand their analytic goals and challenges, and helped them to attain strong results through the use of Predictive Analytics. An avid runner and gamer, Lou frequently speaks and tweets (@LouBajuk) about the value of Predictive Analytics.
© Copyright 2000-2014 TIBCO Software Inc.!
As Simple as Possible !Put Advanced Analytics into the Hands of Business! Lou Bajuk-Yorgan!Sr. Director Product Management!TIBCO Software!
© Copyright 2000-2014 TIBCO Software Inc.!-11-!
E V E R Y T H I N G S H O U L D B E M A D E A S S I M P L E A S
P O S S I B L E …
But no simpler. Albert Einstein!
© Copyright 2000-2014 TIBCO Software Inc.!-12-!
• Quick Overview of the Spotfire Analytics Approach!• Advanced Analytics for Business Users !
– As Simple As Possible!– But No Simpler !
• Benefits !• Demonstration !
Today’s Discussion!
© Copyright 2000-2014 TIBCO Software Inc.!-13-!
Everyone looks at data. Inevitably, you see something unexpected, maybe one bar in a bar graph is higher than anticipated; or some points on plot are in the far corner.! !Naturally, you want to learn more and understand why. !
The Fundamental Challenge!
© Copyright 2000-2014 TIBCO Software Inc.!-14-!
TIBCO Spotfire is the easiest and simplest tool for understanding why.!!Unlike other approaches, Spotfire was created to help users quickly drill into information and gain insight. !
Spotfire Solution
The TIBCO Spotfire Solution !
© Copyright 2000-2014 TIBCO Software Inc.!-15-!
!
All Users!Business ♦ Analysts ♦ Data Scientists ♦ App Developers ♦ Sys Admins!
!
Analytics Platform!Empowers You Every Step of Your
Analytics Journey"!
All Data !Historical & Real-Time ♦ Internal & External ♦ Structured Unstructured!
!
Visual Data Discovery ♦ Analytic Applications & Dashboards !Predictive Analytics ♦ Real-Time Analytics ♦ Location Analytics!
!Governed Data Discovery !
Cloud and On-Premises Deployment!
© Copyright 2000-2014 TIBCO Software Inc.!-16-!
Discover Value At Every Step!
Measure!
Diagnose!
Predict &Optimize!
Operationalize!
Automate!
Transform!
ANALYTICS MATURITY!
CO
MPE
TITI
VE A
DVA
NTA
GE!
Descriptive!
Exploratory!
Proactive!
Repeatable!
Real-Time!
Continuous!
© Copyright 2000-2014 TIBCO Software Inc.!-17-!
Value With Predictive Analytics!
Measure!
Diagnose!
Predict & Optimize!
Operationalize!
Automate!
Transform!
ANALYTICS MATURITY!
CO
MPE
TITI
VE A
DVA
NTA
GE!
Descriptive!
Exploratory!
Proactive!
Repeatable!
Real-Time!
Continuous!
© Copyright 2000-2014 TIBCO Software Inc.!-18-!
Advanced Analytics for
Business Users?!
© Copyright 2000-2014 TIBCO Software Inc.!-19-!
Yes!!!!
Everything Should Be Made As Simple As Possible.!
!But no Simpler.!
© Copyright 2000-2014 TIBCO Software Inc.!-20-!
Advanced Analytics for Business!
Easy for Business Users…!• Improve decision-making, increase competitiveness!
– Powerful, advanced analytics embedded “under the hood” to discover meaningful patterns and trends!
– Integrated within the analytics decision-making process, side-by-side with descriptive analytics & visualizations!
• Get the answers you need, when you need them !– Self-service, easily discovered and shared!– Targeted and relevant!
© Copyright 2000-2014 TIBCO Software Inc.!-21-!
Advanced Analytics for Business!
Flexible for Business Analyst / Analysis Author…!• Easy to create analytics dashboards & applications !
– Support rich, multi-step analytic workflows!– Intuitive tools for predictive modeling and forecasting!
• Secure usage !– Ensure compliance & proper usage of analytics & models!– Incorporate & share best practices and consistent workflows !– Control access to applications and data with standard enterprise
security!
© Copyright 2000-2014 TIBCO Software Inc.!-22-!
Does “Simple” Mean
Simplified Analytics?!
© Copyright 2000-2014 TIBCO Software Inc.!-23-!
No!!
Everything Should Be Made As Simple As
Possible.!!
But no Simpler!
© Copyright 2000-2014 TIBCO Software Inc.!-24-!
The Power of Advanced Analytics!
TIBCO Spotfire!S+!
Open Source R!
TIBCO Enterprise
Runtime for R (TERR)!
SAS®!
MATLAB®!
Teradata Aster!
Powerful for Statisticians…!• Full breadth of Advanced
Analytics native within Spotfire!– Find the best analytic approach for a
given problem!– Develop cutting-edge & proprietary
analytics in the popular R language!• Enterprise Class Engine for
R Language (TERR)!– Agile development & iteration!– Enterprise-ready deployment to
applications, real-time system, and cloud services!
• Leverage existing Predictive Analytic investments!
– Rich Advanced Analytic ecosystem!• SAS®, MATLAB®, R, S+, Teradata
Aster!
© Copyright 2000-2014 TIBCO Software Inc.!-25-!
Value with Spotfire Advanced Analytics!
Increase market competitiveness !• Put advanced analytics into the hands of
business decision makers, you increase confidence & effectiveness of decisions across the organization!
Take advantage of market opportunity and threats!
• Anticipate and react to emerging trends!• Identify and respond to potential threats!
Reduce uncertainty & manage risk!• Scenario planning, forecasting, fraud
detection!• Aggregate and evaluate risk!
Proactively act on analysis…!• Segment customers into distinct markets !• Identify opportunities to cross-sell & upsell
products/services!• Forecast unhappy customers and turn
them into fans !
© Copyright 2000-2014 TIBCO Software Inc.!-26-!
Demo!
© Copyright 2000-2014 TIBCO Software Inc.!-27-!
E V E R Y T H I N G S H O U L D B E M A D E A S S I M P L E A S
P O S S I B L E …
But no simpler. Albert Einstein!
© Copyright 2000-2014 TIBCO Software Inc.!-28-!
Analy9cs on Any Device
Empower All Users
Re-‐Usable Enterprise & Applica9on Objects
Fastest Data Processing Engine
Broadest Integra9on of Data Sources
Enterprise Analytics Architecture !
Twitter Tag: #briefr
The Briefing Room
Perceptions & Questions
Analyst: Dean Abbott
What is Analytic Maturity?
• Sophistication
• Usability
• Automation
© Abbott Analytics, Inc. 2001-201430
What Do We Mean by Predictive Analytics?
• Algorithms?
• or Process?
© Abbott Analytics, Inc. 2001-201431
• CRISP-DM
Algorithms and Maturity • Linear Regression: 1890s
• K-Means: 50s / 60s
• K-NN: 50s / 60s
• Decision trees: 60s / 70s
• Neural networks: 60s (70s) 80s
• Support Vector Machines: 90s
• Ensembles: • Bagging and Boosting: 90s • Heterogeneous ensembles: 2000s
© Abbott Analytics, Inc. 2001-201432
Who’s Going to do this?
The Most In-Demand Skill Today
"If you are looking for a career where your services will be in high demand, you should find something where you provide a scarce, complementary service to something that is getting ubiquitous and cheap. So what’s getting ubiquitous and cheap? Data. And what is complementary to data? Analysis. So my recommendation is to take lots of courses about how to manipulate and analyze data..."
- Hal Varian, Chief Economist at Google
© Abbott Analytics, Inc. 2001-201433
From http://www.teamleada.com
Where are these Analytics Coming From?
© Abbott Analytics, Inc. 2001-201434
Degrees in 2011-2102 Humanities
Social and behavioral science
Natural sciences and mathematics
Computer sciences and engi-neering
Education
Business
Other fields
But do these analysts need to know the math?
• Can software overcome the gulf between the mathematics and the use of the mathematics?
• Can the mathematics be a tool without knowing why it works?
© Abbott Analytics, Inc. 2001-201435
But we use software! • In the 70s and 80s, analysis / statistics software was
commandline. • SAS, SPSS, S • Others: specified “control files” or “command line options”
and run the Unix or DOS executable
• In the 90s, GUIs emerged for pattern recognition and data mining • Most often, Windows, drop-down interfaces • Some workflow
• Late 2000s and currently, workflow interfaces have won the day for commercial and most open source tools
• Now: are we really back to commandline interfaces? • R, Python
© Abbott Analytics, Inc. 2001-201436
Automation
• What gets automated -- development • Data preparation—80%+ of time spent here
• Building predictive models
• Assessing predictive models
• What gets automated – deployment • Data preparation – reproduce what one did
during model building
• Decisioning from model predictions
• A/B testing of model performance
© Abbott Analytics, Inc. 2001-201437
Questions
• What is simplified by Spotfire? Which parts of the CRISP-DM process…
• For Predictive Analytics, what is the expectation placed on the modelers? • R, SAS, Matlab are all programming languages. S+ is
both language and GUI. Spotfire Miner?
• How does Spotfire integrate with back-end deployment of models (operational or visualization)?
© Abbott Analytics, Inc. 2001-201438
Twitter Tag: #briefr
The Briefing Room
Twitter Tag: #briefr
The Briefing Room
Upcoming Topics
www.insideanalysis.com
2014 Editorial Calendar at www.insideanalysis.com/webcasts/the-briefing-room
This Month: ANALYTICS & MACHINE LEARNING
July: INNOVATIVE TECHNOLOGY
August: BIG DATA ECOSYSTEM
Twitter Tag: #briefr
The Briefing Room
THANK YOU for your
ATTENTION!