Navigating the big data landscape
10
a d v i s o r mwd helping you create business improvement from IT inves Navigating the Big Data landscape Craig Wentworth Principal Analyst
-
Upload
mwd-advisors -
Category
Technology
-
view
240 -
download
5
description
Transcript of Navigating the big data landscape
a d v i s o r smwd
helping you create business improvement from IT investment
Navigating the Big Data landscape
Craig WentworthPrincipal Analyst
Big Data’s moonshot program
© MWD Advisors 2014 www.mwdadvisors.com 2
Growth of Google, Facebook, etc
Cost of memory, hardware, etc
TimePb
Amount of data
Time to value
$
$bn Number of users
ms
How Hadoop’s march has dominated Big Data market development
© MWD Advisors 2014 www.mwdadvisors.com 3
2004Google’s MapReduce research paper
2005Yahoo! develops Hadoop
2013Hadoop 2 goes GA
2007Hadoop goes open source at Apache
2011Hadoop 1 goes GA
Hadoop
NoSQL
StreamingData warehouse
Specialist sources
Big Data’s open source army is about much more than Hadoop, in fact
© MWD Advisors 2014 www.mwdadvisors.com 4
PostgreSQLMySQL
Drill SparkStorm
Samza
Accumulo
HBaseCassandra
CouchbaseMongoDB
Redis
Different use cases have dramatically different requirements
© MWD Advisors 2014 www.mwdadvisors.com 5Ex
trem
e Sc
ale
Extreme Speed
“Everything else”
National security, Fraud detection
Transport, Utilities management
Customer analytics for
next best action
Predictive maintenance
Speed
Scal
e
Different capability clusters are most suited to different use cases
© MWD Advisors 2014 www.mwdadvisors.com 6
CEP, Real-time, Streaming databases
Hadoop 1 (MapReduce)
EDW, Data Marts
NoSQLWide
Column
Key- Value
Document
Graph
Specialised sources
Hadoop 2and OSS
ecosystem
Extr
eme
Scal
e
Extreme Speed
“Everything else”
Speed
Scal
e
Four aspects of delivery models you need to consider
© MWD Advisors 2014 www.mwdadvisors.com 7
Licensing model Physical data storage model
Operational model
Analytics architecture
Things you need to do
© MWD Advisors 2014 www.mwdadvisors.com 8
Watch Hadoop Be aware of the shifting boundaries
Make sure you can hold it all together
a d v i s o r smwd
helping you create business improvement from IT investment
Thank youAny questions?
Craig [email protected]@craigwentworth
Check out our free reports:Big Data for analytics: Vendor landscapehttp://goo.gl/CJ2YRVHadoop: A driving force in the Big Data technology landscapehttp://goo.gl/nf0lY1Big Data: What is it and why should I care?http://goo.gl/Sckh2v
Neil [email protected]@neilwd
Hadoop logo (Slides 3, 8) – Intel Free Press (http://commons.wikimedia.org/wiki/File:Apache_Hadoop_Elephant.jpg) CC-BY-SA-2.0
Apache Software Foundation logo (Slide 7) – José Carlos Gallego (http://commons.wikimedia.org/wiki/File:The_Apache_Software_Foundation.jpg) CC-BY-SA-3.0
Locker metal security closed steel key hold (Slide 7) – Nemo (http://pixabay.com/en/locker-metal-security-closed-steel-310533/) CC0
Intel SS4000-E Entry Storage Systems, excerpt (Slide 7) – Axel Schwenke (https://www.flickr.com/photos/schwenke/1016958982/) CC-BY-SA-2.0
Clouds (Slide 7) – Clue (http://openclipart.org/detail/4112/simple-clouds-by-clue) PD
Plus disks (Slide 7) – Open storage pod (http://www.flickr.com/photos/openstoragepod/4392476653/) CC-BY-2.0
RAM-Not22233 (Slide 7) – mateusz (http://de.wikipedia.org/wiki/Arbeitsspeicher#mediaviewer/Datei:Ram-not22233.jpg) CC-BY-SA-3.0
Database symbol (Slide 7) – rg1024 (http://openclipart.org/image/300px/svg_to_png/94723/db.png) PD
Signpost (Slide 8) – Succo (http://pixabay.com/en/directory-signposts-shield-note-230724/) CC0
Piecing it together (Slide 8) – Hans (http://pixabay.com/en/puzzle-play-share-piecing-together-318110/) CC0
Photo credits
© MWD Advisors 2014 (Except images, where indicated)
www.mwdadvisors.com 10
