Big Data for Smart City
34
Big Data for Smart City Furqonuddin Ramdhani www.icion - leadership . com
Transcript of Big Data for Smart City
Big Data for Smart CityFurqonuddin Ramdhani
www.icion-leadership.com
22
Smart CityDefinition, objectives, Big Data Use Cases for Smart City
Big DataDefinition, Landscape, Ecosystem, Hadoop, Life Cycle
Big Data Use CaseRecommendation Engine, Risk Management, Data Warehouse Optimization
�
�
�
Outline
3
Smart City
Smart City
44
In Smart Cities, d ig ital technologies translate into better public services for cit izens, better use of resources and less impact on the environment.
5
Big Data Use Cases for Smart City
• Social Media Analysis / Sentiment Analysis, aims to analyze and study of people’s opinions, attitudes and emotions toward an entity in text of specific subjects.• Retail Analytics, recommendation engine to predict next best offers of products to
customers.
6
Introduction to Big Data
7
What is Big Data ?
8
Big data enabled by five ‘Digital Economy’ drivers
www.slideproject.com 9
10
Hadoop
• “Scalable”, “Fault Tolerant” platform for large amount data storage & processing, distributed across machines.
• Based on Google File System (GFS) & MapReduce
11
12
MapR Hadoop Ecosystem
13
Hadoop
1414
Big Data Life Cycle
15
Copy Files in HDFS
16
Import RDBMS Data
17
Stream data into Hadoop using Flume
18
Streams using Kafka
19
Process Data
20
Data Processing
• Transform the data• Enrich the data
• Examples :• Store data in multiple formats• Aggregate data• Build recommendations• …
21
MapReduce Processing Model
• Define mappers• Shuffling is automatic
• Define reducers
22
Apache Spark : Fast Big Data
• Fast to Run• General execution graphs• In-memory storage• Rich APIs in Java, Scala, Python
23
Apache Drill
24
Use Case 1 Financial Services : Recommendation Engine &
Realtime Targeting
25
Financial Services : Recommendation Engine & Realtime TargetingMaking personalized real-time offers to credit card customers
26
Making personalized real-time offers to credit card customersFinancial Services : Recommendation Engine & Realtime Targeting
27
Use Case 2 Security & Risk Management
28
Security & Risk ManagementHigh Performance machine-learning to detect fraud patterns
29
Security & Risk Management
30
Use Case 3 Data Warehouse Optimization
31
TDWI : Evolving Data Warehouse Architectures
32
Data Warehouse OptimizationImprove data services to customers while reducing enterprise architecture costs
33
Data Warehouse Optimization
ThankyouSupportourCISSPCLASSFROM25TO29APRIL2016
• www.icion-leadership.com• LOOK FORWARD TO YOUR SUPPORT IN 2017
• CISSP COMMUNITY EVENT FEB IN PONDOK INDAH• https://www.youtube.com/watch?v=fqUjXIlCcfM
