Big Data - Are You Ready · Today’s Challenge New Data What’s Possible Healthcare Expensive...
Transcript of Big Data - Are You Ready · Today’s Challenge New Data What’s Possible Healthcare Expensive...
![Page 1: Big Data - Are You Ready · Today’s Challenge New Data What’s Possible Healthcare Expensive office visits Remote patient monitoring Preventive care, reduced ... Hadoop Distributed](https://reader033.fdocuments.net/reader033/viewer/2022050200/5f53ac776e5605581f044d64/html5/thumbnails/1.jpg)
![Page 2: Big Data - Are You Ready · Today’s Challenge New Data What’s Possible Healthcare Expensive office visits Remote patient monitoring Preventive care, reduced ... Hadoop Distributed](https://reader033.fdocuments.net/reader033/viewer/2022050200/5f53ac776e5605581f044d64/html5/thumbnails/2.jpg)
Big Data – Are You Ready?
Michał Jerzy Kostrzewa ([email protected])
ECE Business Development Manager
![Page 3: Big Data - Are You Ready · Today’s Challenge New Data What’s Possible Healthcare Expensive office visits Remote patient monitoring Preventive care, reduced ... Hadoop Distributed](https://reader033.fdocuments.net/reader033/viewer/2022050200/5f53ac776e5605581f044d64/html5/thumbnails/3.jpg)
The following is intended to outline our general product direction.
It is intended for information purposes only, and may not be
incorporated into any contract. It is not a commitment to deliver
any material, code, or functionality, and should not be relied upon
in making purchasing decisions. The development, release, and
timing of any features or functionality described for Oracle’s
products remains at the sole discretion of Oracle.
![Page 4: Big Data - Are You Ready · Today’s Challenge New Data What’s Possible Healthcare Expensive office visits Remote patient monitoring Preventive care, reduced ... Hadoop Distributed](https://reader033.fdocuments.net/reader033/viewer/2022050200/5f53ac776e5605581f044d64/html5/thumbnails/4.jpg)
Big Data Use Cases
Today’s Challenge New Data What’s Possible
Healthcare
Expensive office visits Remote patient monitoring
Preventive care, reduced
hospitalization
Manufacturing
In-person support Product sensors Automated diagnosis, support
Location-Based Services
Based on home zip code Real time location data
Geo-advertising, traffic, local
search
Public Sector
Standardized services Citizen surveys
Tailored services,
cost reductions
Retail
One size fits all marketing Social media
Sentiment analysis
segmentation
![Page 5: Big Data - Are You Ready · Today’s Challenge New Data What’s Possible Healthcare Expensive office visits Remote patient monitoring Preventive care, reduced ... Hadoop Distributed](https://reader033.fdocuments.net/reader033/viewer/2022050200/5f53ac776e5605581f044d64/html5/thumbnails/5.jpg)
What Makes it Big Data?
VOLUME VELOCITY VARIETY VALUE
SOCIAL
BLOG
SMART
METER
101100101001
001001101010
101011100101
010100100101
![Page 6: Big Data - Are You Ready · Today’s Challenge New Data What’s Possible Healthcare Expensive office visits Remote patient monitoring Preventive care, reduced ... Hadoop Distributed](https://reader033.fdocuments.net/reader033/viewer/2022050200/5f53ac776e5605581f044d64/html5/thumbnails/6.jpg)
Why Is Big Data Important?
Source: * McKinsey Global Institute: Big Data – The next frontier for innovation, competition and productivity (May 2011)
US HEALTH CARE
$300 B
Increase industry
value per year by
US RETAIL
60+%
Increase net
margin by
MANUFACTURING
–50%
Decrease dev.,
assembly costs by
GLOBAL PERSONAL
LOCATION DATA
$100 B
Increase service
provider revenue by
EUROPE PUBLIC
SECTOR ADMIN
€250 B
Increase industry
value per year by
![Page 7: Big Data - Are You Ready · Today’s Challenge New Data What’s Possible Healthcare Expensive office visits Remote patient monitoring Preventive care, reduced ... Hadoop Distributed](https://reader033.fdocuments.net/reader033/viewer/2022050200/5f53ac776e5605581f044d64/html5/thumbnails/7.jpg)
Make Better Decisions Using Big Data
Big Data in Action
ANALYZE
DECIDE ACQUIRE
ORGANIZE
![Page 8: Big Data - Are You Ready · Today’s Challenge New Data What’s Possible Healthcare Expensive office visits Remote patient monitoring Preventive care, reduced ... Hadoop Distributed](https://reader033.fdocuments.net/reader033/viewer/2022050200/5f53ac776e5605581f044d64/html5/thumbnails/8.jpg)
Acquire all available data
Big Data in Action
ANALYZE
DECIDE
ORGANIZE
ACQUIRE
![Page 9: Big Data - Are You Ready · Today’s Challenge New Data What’s Possible Healthcare Expensive office visits Remote patient monitoring Preventive care, reduced ... Hadoop Distributed](https://reader033.fdocuments.net/reader033/viewer/2022050200/5f53ac776e5605581f044d64/html5/thumbnails/9.jpg)
Acquiring Big Data Challenge
Application will need
to change
frequently
Need to process
high volume, low-
density information
Must scale out to
meet aggressive
roll out plan
![Page 10: Big Data - Are You Ready · Today’s Challenge New Data What’s Possible Healthcare Expensive office visits Remote patient monitoring Preventive care, reduced ... Hadoop Distributed](https://reader033.fdocuments.net/reader033/viewer/2022050200/5f53ac776e5605581f044d64/html5/thumbnails/10.jpg)
Oracle NoSQL Database
Key value pair database Dynamic data model Highly scalable, available Transparent load balancing Built using BerkeleyDB
Nodes East
Nodes West
Nodes Central
Nodes
NoSQL Driver
Application
NoSQL Driver
Application
… Nodes
…
Re
ad
De
lete
Re
ad
Up
da
te
![Page 11: Big Data - Are You Ready · Today’s Challenge New Data What’s Possible Healthcare Expensive office visits Remote patient monitoring Preventive care, reduced ... Hadoop Distributed](https://reader033.fdocuments.net/reader033/viewer/2022050200/5f53ac776e5605581f044d64/html5/thumbnails/11.jpg)
Big Data in Action
ANALYZE
DECIDE
ORGANIZE
ACQUIRE Oracle NoSQL Database
![Page 12: Big Data - Are You Ready · Today’s Challenge New Data What’s Possible Healthcare Expensive office visits Remote patient monitoring Preventive care, reduced ... Hadoop Distributed](https://reader033.fdocuments.net/reader033/viewer/2022050200/5f53ac776e5605581f044d64/html5/thumbnails/12.jpg)
Organize and distill big data using massive parallelism
Big Data in Action
ANALYZE
DECIDE ACQUIRE
ORGANIZE
![Page 13: Big Data - Are You Ready · Today’s Challenge New Data What’s Possible Healthcare Expensive office visits Remote patient monitoring Preventive care, reduced ... Hadoop Distributed](https://reader033.fdocuments.net/reader033/viewer/2022050200/5f53ac776e5605581f044d64/html5/thumbnails/13.jpg)
Organizing Big Data Challenge
Also want to
perform analysis
on big data
Have existing
Oracle data
warehouse
Can’t negatively
impact data
warehouse SLAs
![Page 14: Big Data - Are You Ready · Today’s Challenge New Data What’s Possible Healthcare Expensive office visits Remote patient monitoring Preventive care, reduced ... Hadoop Distributed](https://reader033.fdocuments.net/reader033/viewer/2022050200/5f53ac776e5605581f044d64/html5/thumbnails/14.jpg)
Analysis Sandbox
Provides analysis workspace Controlled access to resources and data Doesn’t impact production system
![Page 15: Big Data - Are You Ready · Today’s Challenge New Data What’s Possible Healthcare Expensive office visits Remote patient monitoring Preventive care, reduced ... Hadoop Distributed](https://reader033.fdocuments.net/reader033/viewer/2022050200/5f53ac776e5605581f044d64/html5/thumbnails/15.jpg)
Sandboxing with Oracle Enterprise Manager
Simple to set up Efficient server utilization Secure and scalable Accountable via charge back Ideal for Oracle Exadata
![Page 16: Big Data - Are You Ready · Today’s Challenge New Data What’s Possible Healthcare Expensive office visits Remote patient monitoring Preventive care, reduced ... Hadoop Distributed](https://reader033.fdocuments.net/reader033/viewer/2022050200/5f53ac776e5605581f044d64/html5/thumbnails/16.jpg)
Organizing and Distilling Big Data Challenge
Want to avoid writing lots of Hadoop code
Must transform big data into something
easily analyzed
Need to load data quickly into Oracle Data Warehouse
![Page 17: Big Data - Are You Ready · Today’s Challenge New Data What’s Possible Healthcare Expensive office visits Remote patient monitoring Preventive care, reduced ... Hadoop Distributed](https://reader033.fdocuments.net/reader033/viewer/2022050200/5f53ac776e5605581f044d64/html5/thumbnails/17.jpg)
Hadoop Architecture
Management/Monitoring
Hadoop Distributed File System (HDFS)
MapReduce
Distributed file system with redundant storage Map/Reduce programming paradigm Highly scalable data processing Cost-effective model for high volume, low density data
![Page 18: Big Data - Are You Ready · Today’s Challenge New Data What’s Possible Healthcare Expensive office visits Remote patient monitoring Preventive care, reduced ... Hadoop Distributed](https://reader033.fdocuments.net/reader033/viewer/2022050200/5f53ac776e5605581f044d64/html5/thumbnails/18.jpg)
A Map/Reduce Pipeline
SHUFFLE
/SORT
SHUFFLE
/SORT
MAP
MAP
MAP
MAP
SHUFFLE
/SORT
REDUCE
REDUCE
SHUFFLE
/SORT
SHUFFLE
/SORT
REDUCE
REDUCE
REDUCE
INPUT 2
INPUT 1
OUTPUT 2
OUTPUT 1
MAP
MAP
MAP
MAP
MAP
REDUCE
REDUCE
REDUCE
MAP
MAP
MAP
MAP
MAP
MAP
REDUCE
REDUCE
MAP
MAP
MAP
MAP
MAP
REDUCE
REDUCE
REDUCE
![Page 19: Big Data - Are You Ready · Today’s Challenge New Data What’s Possible Healthcare Expensive office visits Remote patient monitoring Preventive care, reduced ... Hadoop Distributed](https://reader033.fdocuments.net/reader033/viewer/2022050200/5f53ac776e5605581f044d64/html5/thumbnails/19.jpg)
Oracle Loader for Hadoop
SHUFFLE
/SORT
SHUFFLE
/SORT
MAP
MAP
MAP
MAP
SHUFFLE
/SORT
REDUCE
REDUCE
SHUFFLE
/SORT
SHUFFLE
/SORT
REDUCE
REDUCE
REDUCE
INPUT 2
INPUT 1
MAP
MAP
MAP
MAP
MAP
REDUCE
REDUCE
REDUCE
MAP
MAP
MAP
MAP
MAP
MAP
REDUCE
REDUCE
MAP
MAP
MAP
MAP
MAP
REDUCE
REDUCE
REDUCE
Reduces Hadoop complexities through graphical tooling (ODI)
![Page 20: Big Data - Are You Ready · Today’s Challenge New Data What’s Possible Healthcare Expensive office visits Remote patient monitoring Preventive care, reduced ... Hadoop Distributed](https://reader033.fdocuments.net/reader033/viewer/2022050200/5f53ac776e5605581f044d64/html5/thumbnails/20.jpg)
Big Data in Action
ANALYZE
DECIDE ACQUIRE
ORGANIZE
Oracle NoSQL Database Oracle Enterprise Manager Oracle Data Integrator Oracle Loader for Hadoop
![Page 21: Big Data - Are You Ready · Today’s Challenge New Data What’s Possible Healthcare Expensive office visits Remote patient monitoring Preventive care, reduced ... Hadoop Distributed](https://reader033.fdocuments.net/reader033/viewer/2022050200/5f53ac776e5605581f044d64/html5/thumbnails/21.jpg)
Analyze all your data, at once
Big Data in Action
ANALYZE
DECIDE ACQUIRE
ORGANIZE ANALYZE
![Page 22: Big Data - Are You Ready · Today’s Challenge New Data What’s Possible Healthcare Expensive office visits Remote patient monitoring Preventive care, reduced ... Hadoop Distributed](https://reader033.fdocuments.net/reader033/viewer/2022050200/5f53ac776e5605581f044d64/html5/thumbnails/22.jpg)
Analyzing Big Data Challenge
Want to perform statistical analysis
using R
Require access to all data
Doing analysis on a laptop is slow and
not secure
![Page 23: Big Data - Are You Ready · Today’s Challenge New Data What’s Possible Healthcare Expensive office visits Remote patient monitoring Preventive care, reduced ... Hadoop Distributed](https://reader033.fdocuments.net/reader033/viewer/2022050200/5f53ac776e5605581f044d64/html5/thumbnails/23.jpg)
R Statistical Programming Language
Open source language and environment Used for statistical computing and graphics Strength in easily producing publication-quality graphs Highly extensible
![Page 24: Big Data - Are You Ready · Today’s Challenge New Data What’s Possible Healthcare Expensive office visits Remote patient monitoring Preventive care, reduced ... Hadoop Distributed](https://reader033.fdocuments.net/reader033/viewer/2022050200/5f53ac776e5605581f044d64/html5/thumbnails/24.jpg)
Oracle R Enterprise Approach
Models run in-database Processes large data sets Uses the power of Oracle Database 11g and Exadata Same code, much faster
![Page 25: Big Data - Are You Ready · Today’s Challenge New Data What’s Possible Healthcare Expensive office visits Remote patient monitoring Preventive care, reduced ... Hadoop Distributed](https://reader033.fdocuments.net/reader033/viewer/2022050200/5f53ac776e5605581f044d64/html5/thumbnails/25.jpg)
Big Data in Action
ANALYZE
DECIDE ACQUIRE
ORGANIZE ANALYZE
Oracle NoSQL Database Oracle Enterprise Manager Oracle Data Integrator Oracle Loader for Hadoop Oracle R Enterprise
![Page 26: Big Data - Are You Ready · Today’s Challenge New Data What’s Possible Healthcare Expensive office visits Remote patient monitoring Preventive care, reduced ... Hadoop Distributed](https://reader033.fdocuments.net/reader033/viewer/2022050200/5f53ac776e5605581f044d64/html5/thumbnails/26.jpg)
Decide based on real-time big data
Big Data in Action
ANALYZE
ACQUIRE
ORGANIZE
DECIDE
![Page 27: Big Data - Are You Ready · Today’s Challenge New Data What’s Possible Healthcare Expensive office visits Remote patient monitoring Preventive care, reduced ... Hadoop Distributed](https://reader033.fdocuments.net/reader033/viewer/2022050200/5f53ac776e5605581f044d64/html5/thumbnails/27.jpg)
Making Decisions Based on Big Data Challenge
Want to add new insights into BI
dashboard
Big data has been transformed into actionable insight
How do we quickly integrate R analytics
into dashboard?
![Page 28: Big Data - Are You Ready · Today’s Challenge New Data What’s Possible Healthcare Expensive office visits Remote patient monitoring Preventive care, reduced ... Hadoop Distributed](https://reader033.fdocuments.net/reader033/viewer/2022050200/5f53ac776e5605581f044d64/html5/thumbnails/28.jpg)
Dashboard Analytics
•Oracle Business Intelligence Enterprise Edition
‒Advanced dashboard visualization
‒Runs BI and EPM applications
• Integrating R Analytics
‒Embed R script’s web interface in BI dashboard
‒Graphics will stream to BI dashboard
![Page 29: Big Data - Are You Ready · Today’s Challenge New Data What’s Possible Healthcare Expensive office visits Remote patient monitoring Preventive care, reduced ... Hadoop Distributed](https://reader033.fdocuments.net/reader033/viewer/2022050200/5f53ac776e5605581f044d64/html5/thumbnails/29.jpg)
Oracle Integrated Solution Stack for Big Data
ACQUIRE
Oracle NoSQL
Database
HDFS
Enterprise
Applications
ORGANIZE
Hadoop (MapReduce)
Oracle Loader for Hadoop
Oracle Data Integrator
DECIDE
Analytic
Applications
ANALYZE
In-D
ata
base
Analy
tics
Data
Warehouse
![Page 30: Big Data - Are You Ready · Today’s Challenge New Data What’s Possible Healthcare Expensive office visits Remote patient monitoring Preventive care, reduced ... Hadoop Distributed](https://reader033.fdocuments.net/reader033/viewer/2022050200/5f53ac776e5605581f044d64/html5/thumbnails/30.jpg)
Oracle Integrated Solution Stack Oracle Engineered Systems
ACQUIRE ORGANIZE ANALYZE DECIDE
![Page 31: Big Data - Are You Ready · Today’s Challenge New Data What’s Possible Healthcare Expensive office visits Remote patient monitoring Preventive care, reduced ... Hadoop Distributed](https://reader033.fdocuments.net/reader033/viewer/2022050200/5f53ac776e5605581f044d64/html5/thumbnails/31.jpg)
•18 Sun X4270 M2 Servers
–48 GB memory per node = 864 GB memory
–12 Intel cores per node = 216 cores
–24 TB storage per node = 432 TB storage
•40 Gb p/sec InfiniBand
•10 Gb p/sec Ethernet
Oracle Engineered Systems Oracle Big Data Appliance Hardware
![Page 32: Big Data - Are You Ready · Today’s Challenge New Data What’s Possible Healthcare Expensive office visits Remote patient monitoring Preventive care, reduced ... Hadoop Distributed](https://reader033.fdocuments.net/reader033/viewer/2022050200/5f53ac776e5605581f044d64/html5/thumbnails/32.jpg)
•Oracle Linux
•Java Hotspot VM
•Apache Hadoop Distribution
•R Distribution
•Oracle NoSQL Database
•Oracle Data Integrator for Hadoop
•Oracle Loader for Hadoop
Oracle Big Data Appliance Software
![Page 33: Big Data - Are You Ready · Today’s Challenge New Data What’s Possible Healthcare Expensive office visits Remote patient monitoring Preventive care, reduced ... Hadoop Distributed](https://reader033.fdocuments.net/reader033/viewer/2022050200/5f53ac776e5605581f044d64/html5/thumbnails/33.jpg)
Oracle Exalytics Hardware
Engineered for extreme analytics
•40 Intel processor cores
•1 Terabyte main memory
•40 Gb InfiniBand connection to Oracle Exadata
![Page 34: Big Data - Are You Ready · Today’s Challenge New Data What’s Possible Healthcare Expensive office visits Remote patient monitoring Preventive care, reduced ... Hadoop Distributed](https://reader033.fdocuments.net/reader033/viewer/2022050200/5f53ac776e5605581f044d64/html5/thumbnails/34.jpg)
Oracle Exalytics Software
•Oracle TimesTen In-Memory Database
‒Adaptive in-memory caching of analytics
‒In-memory columnar compression
‒Tightly integrated with Oracle Exadata
‒Enables speed-of-thought visualization
•Oracle Business Intelligence Foundation Suite
![Page 35: Big Data - Are You Ready · Today’s Challenge New Data What’s Possible Healthcare Expensive office visits Remote patient monitoring Preventive care, reduced ... Hadoop Distributed](https://reader033.fdocuments.net/reader033/viewer/2022050200/5f53ac776e5605581f044d64/html5/thumbnails/35.jpg)
Maximizing the Value of Enterprise Big Data
•Hardware and software for Big Data
•Integrates all enterprise data
–Structured and unstructured
–SQL and NoSQL
•Fastest time-to-market
•Single vendor support
![Page 36: Big Data - Are You Ready · Today’s Challenge New Data What’s Possible Healthcare Expensive office visits Remote patient monitoring Preventive care, reduced ... Hadoop Distributed](https://reader033.fdocuments.net/reader033/viewer/2022050200/5f53ac776e5605581f044d64/html5/thumbnails/36.jpg)
The preceding is intended to outline our general product
direction. It is intended for information purposes only, and may
not be incorporated into any contract. It is not a commitment to
deliver any material, code, or functionality, and should not be
relied upon in making purchasing decisions. The development,
release, and timing of any features or functionality described for
Oracle’s products remains at the sole discretion of Oracle.
![Page 37: Big Data - Are You Ready · Today’s Challenge New Data What’s Possible Healthcare Expensive office visits Remote patient monitoring Preventive care, reduced ... Hadoop Distributed](https://reader033.fdocuments.net/reader033/viewer/2022050200/5f53ac776e5605581f044d64/html5/thumbnails/37.jpg)
![Page 38: Big Data - Are You Ready · Today’s Challenge New Data What’s Possible Healthcare Expensive office visits Remote patient monitoring Preventive care, reduced ... Hadoop Distributed](https://reader033.fdocuments.net/reader033/viewer/2022050200/5f53ac776e5605581f044d64/html5/thumbnails/38.jpg)