2015: Where The Rubber Meets The Road For Big...
Transcript of 2015: Where The Rubber Meets The Road For Big...
![Page 1: 2015: Where The Rubber Meets The Road For Big Datafiles.messe.de/abstracts/62050_CGC2015_WANdisco_Richards.pdf · 2015: Where The Rubber Meets The Road For Big Data Wednesday, 18th](https://reader031.fdocuments.net/reader031/viewer/2022011909/5f7192fbad5c3a41853a93c2/html5/thumbnails/1.jpg)
2015: Where The
Rubber Meets The
Road For Big Data
Wednesday, 18th March 2015
WANDISCO.COM
![Page 2: 2015: Where The Rubber Meets The Road For Big Datafiles.messe.de/abstracts/62050_CGC2015_WANdisco_Richards.pdf · 2015: Where The Rubber Meets The Road For Big Data Wednesday, 18th](https://reader031.fdocuments.net/reader031/viewer/2022011909/5f7192fbad5c3a41853a93c2/html5/thumbnails/2.jpg)
WANdisco: Who we are
WANdisco: Wide Area Network Distributed Computing
• Leader in tools for software engineers
• Highly successful IPO, London Stock Exchange, June 2012 (LSE:WAND)
• US patented active-active replication technology granted, November 2012
• Global locations o San Ramon (CA), Sheffield (UK), Belfast (UK)
o Chengdu (China)
o Tokyo (Japan)
o Boston (MA)
o Chennai (India)
![Page 3: 2015: Where The Rubber Meets The Road For Big Datafiles.messe.de/abstracts/62050_CGC2015_WANdisco_Richards.pdf · 2015: Where The Rubber Meets The Road For Big Data Wednesday, 18th](https://reader031.fdocuments.net/reader031/viewer/2022011909/5f7192fbad5c3a41853a93c2/html5/thumbnails/3.jpg)
WANdisco: Who we work with
![Page 4: 2015: Where The Rubber Meets The Road For Big Datafiles.messe.de/abstracts/62050_CGC2015_WANdisco_Richards.pdf · 2015: Where The Rubber Meets The Road For Big Data Wednesday, 18th](https://reader031.fdocuments.net/reader031/viewer/2022011909/5f7192fbad5c3a41853a93c2/html5/thumbnails/4.jpg)
“Go ahead – make my day, punk. Tell me again about Big Data”
![Page 5: 2015: Where The Rubber Meets The Road For Big Datafiles.messe.de/abstracts/62050_CGC2015_WANdisco_Richards.pdf · 2015: Where The Rubber Meets The Road For Big Data Wednesday, 18th](https://reader031.fdocuments.net/reader031/viewer/2022011909/5f7192fbad5c3a41853a93c2/html5/thumbnails/5.jpg)
“I'm Big Data and so's my
wife”
![Page 6: 2015: Where The Rubber Meets The Road For Big Datafiles.messe.de/abstracts/62050_CGC2015_WANdisco_Richards.pdf · 2015: Where The Rubber Meets The Road For Big Data Wednesday, 18th](https://reader031.fdocuments.net/reader031/viewer/2022011909/5f7192fbad5c3a41853a93c2/html5/thumbnails/6.jpg)
Big Data: Technology Moves in Dog Years
Sheikh Zayed Road, Dubai – 1990
![Page 7: 2015: Where The Rubber Meets The Road For Big Datafiles.messe.de/abstracts/62050_CGC2015_WANdisco_Richards.pdf · 2015: Where The Rubber Meets The Road For Big Data Wednesday, 18th](https://reader031.fdocuments.net/reader031/viewer/2022011909/5f7192fbad5c3a41853a93c2/html5/thumbnails/7.jpg)
Big Data: Technology Moves in Dog Years
Sheikh Zayed Road, Dubai – 2013
![Page 8: 2015: Where The Rubber Meets The Road For Big Datafiles.messe.de/abstracts/62050_CGC2015_WANdisco_Richards.pdf · 2015: Where The Rubber Meets The Road For Big Data Wednesday, 18th](https://reader031.fdocuments.net/reader031/viewer/2022011909/5f7192fbad5c3a41853a93c2/html5/thumbnails/8.jpg)
2006 2008 2009 2010 2011 2012 Present
Core Hadoop
Hbase
Zoo Keeper
Hive
Pig
Whirr
Avro
Flume
Big Top
Solr
Spark
Parquet
Sentry
Fact: Hadoop Isn‘t Just Hadoop Anymore
The stack is continually growing and evolving,
with new layers added every year
![Page 9: 2015: Where The Rubber Meets The Road For Big Datafiles.messe.de/abstracts/62050_CGC2015_WANdisco_Richards.pdf · 2015: Where The Rubber Meets The Road For Big Data Wednesday, 18th](https://reader031.fdocuments.net/reader031/viewer/2022011909/5f7192fbad5c3a41853a93c2/html5/thumbnails/9.jpg)
Driver for Big Data is the business (not IT)
2012 2013 2014 2015 2016 2017
Digital Storage:
Annual Growth 60%
IT Budget:
Annual Growth 5%
![Page 10: 2015: Where The Rubber Meets The Road For Big Datafiles.messe.de/abstracts/62050_CGC2015_WANdisco_Richards.pdf · 2015: Where The Rubber Meets The Road For Big Data Wednesday, 18th](https://reader031.fdocuments.net/reader031/viewer/2022011909/5f7192fbad5c3a41853a93c2/html5/thumbnails/10.jpg)
2014 Year of the Proof of Concept
![Page 11: 2015: Where The Rubber Meets The Road For Big Datafiles.messe.de/abstracts/62050_CGC2015_WANdisco_Richards.pdf · 2015: Where The Rubber Meets The Road For Big Data Wednesday, 18th](https://reader031.fdocuments.net/reader031/viewer/2022011909/5f7192fbad5c3a41853a93c2/html5/thumbnails/11.jpg)
2015 Year of Production Deployment
![Page 12: 2015: Where The Rubber Meets The Road For Big Datafiles.messe.de/abstracts/62050_CGC2015_WANdisco_Richards.pdf · 2015: Where The Rubber Meets The Road For Big Data Wednesday, 18th](https://reader031.fdocuments.net/reader031/viewer/2022011909/5f7192fbad5c3a41853a93c2/html5/thumbnails/12.jpg)
2015: Year of Production Deployment
“Build it and they will come?”
![Page 13: 2015: Where The Rubber Meets The Road For Big Datafiles.messe.de/abstracts/62050_CGC2015_WANdisco_Richards.pdf · 2015: Where The Rubber Meets The Road For Big Data Wednesday, 18th](https://reader031.fdocuments.net/reader031/viewer/2022011909/5f7192fbad5c3a41853a93c2/html5/thumbnails/13.jpg)
Big Data: Build it and they will come?
Maybe not…
![Page 14: 2015: Where The Rubber Meets The Road For Big Datafiles.messe.de/abstracts/62050_CGC2015_WANdisco_Richards.pdf · 2015: Where The Rubber Meets The Road For Big Data Wednesday, 18th](https://reader031.fdocuments.net/reader031/viewer/2022011909/5f7192fbad5c3a41853a93c2/html5/thumbnails/14.jpg)
2015: Year of Production Deployment
“Are we making money
in China?”
“Are my actuarial risk
assumptions correct?”
“Can we do better at
stopping credit card
fraud?”
“Can I wish my
customers happy
birthday?”
![Page 15: 2015: Where The Rubber Meets The Road For Big Datafiles.messe.de/abstracts/62050_CGC2015_WANdisco_Richards.pdf · 2015: Where The Rubber Meets The Road For Big Data Wednesday, 18th](https://reader031.fdocuments.net/reader031/viewer/2022011909/5f7192fbad5c3a41853a93c2/html5/thumbnails/15.jpg)
UCI Health: Saving lives with big data
Challenge: In medical emergencies data
must be entered in real-time and available
for immediate retrieval and analysis
Hadoop ensures: Real-time access to
patient data in virtually any format and
elimantion of unecessary downtime
WANdisco brings: Virtual around the clock
doctor. All types of data can be stored,
retrieved and analysed at a low cost
![Page 16: 2015: Where The Rubber Meets The Road For Big Datafiles.messe.de/abstracts/62050_CGC2015_WANdisco_Richards.pdf · 2015: Where The Rubber Meets The Road For Big Data Wednesday, 18th](https://reader031.fdocuments.net/reader031/viewer/2022011909/5f7192fbad5c3a41853a93c2/html5/thumbnails/16.jpg)
International Bank: Understanding customers, protecting customers
Challenge: Targeting of financial products
using more complete customer intelligence.
Real-time risk management including fraud
prevention
Hadoop ensures: Consolidating
unstructured customer data – 50% of all
data. Cost of ownership 90% lower than
legacy platform
WANdisco brings: No more redundant
data storage. Analysis run time down from
hours to minutes
![Page 17: 2015: Where The Rubber Meets The Road For Big Datafiles.messe.de/abstracts/62050_CGC2015_WANdisco_Richards.pdf · 2015: Where The Rubber Meets The Road For Big Data Wednesday, 18th](https://reader031.fdocuments.net/reader031/viewer/2022011909/5f7192fbad5c3a41853a93c2/html5/thumbnails/17.jpg)
2015: Year of Production Deployment
Big Data in Numbers
• Roughly 1,400 customers now subscribing to Hadoop distributions
• Hortonworks customers rose from 54 to 292 in 2014
• Oracle 2015 predictions: “Hadoop will graduate from experimental pilots to standard
enterprise data management
• $3.0bn invested in Hadoop technologies last year
![Page 18: 2015: Where The Rubber Meets The Road For Big Datafiles.messe.de/abstracts/62050_CGC2015_WANdisco_Richards.pdf · 2015: Where The Rubber Meets The Road For Big Data Wednesday, 18th](https://reader031.fdocuments.net/reader031/viewer/2022011909/5f7192fbad5c3a41853a93c2/html5/thumbnails/18.jpg)
2015: Year of Production Deployment
Hadoop is now at the point where the
rubber meets the road
• Operational Tooling
• Security
• Reliability
![Page 19: 2015: Where The Rubber Meets The Road For Big Datafiles.messe.de/abstracts/62050_CGC2015_WANdisco_Richards.pdf · 2015: Where The Rubber Meets The Road For Big Data Wednesday, 18th](https://reader031.fdocuments.net/reader031/viewer/2022011909/5f7192fbad5c3a41853a93c2/html5/thumbnails/19.jpg)
2015: Year of Production Deployment
Hadoop is now at the point where the
rubber meets the road
• Operational Tooling
• Security
• Reliability
“Twice before over the past 50 years,
information technology radically reshaped
competition and strategy; we now stand at the
brink of a third transformation.”
Michael E. Porter, HBR Nov 2014
[http://hbr.org/2014/11/how-smart-connected-products-are-transforming-
competition/ar/1]