CeBIT Global Conferences

FusionInsight: HUAWEI Big Data Solution and Practice

www.cebit.de/en/cgc

2

•Industry Trends

•Industry Actions and Our Practice

•HUAWEI Big Data Solution

Outline

3

Mobile Internet Era Coming with 3G and LTE

Data Flood is Coming: The large variety of

data influence the whole society, including

Enterprise, Government and Person.

CSP under Strategic Transformation: From

scale operation to data traffic operation,

more care value.

Big Challenge: Share and efficient use

data in a more safe and efficient way.

4

80% of all storage capacity

sold now is for file-based data

Digital universe will

reach 40 ZB by 2020

0

20

40

60

80

100

2011 2012 2013 2014

Exa

byt

es

File based: 61.8% CAGR

Block based: 23.7% CAGR

IDC research shows that

about 60% of investments

on big data are infrastructure-

related.

Big Data Market and Technology Trends

5

Big Data Triggers Commercial Reform

Finance Medical

AliFinance uses big data in

lending, which changes the

banking industry.

More than RMB 30 billion is lent

with the charge-off rate of only

03%, and the daily interest

reaches RMB 1 billion.

Google forecasts the flu

tendency based on flu

keywords.

This method outruns the

traditional method by 2

weeks, which has been

published in the Nature

magazine.

E

Netflix presented House of

Cards using big data, which

changes the movie and TV

industry.

20 days after the TV series

were first presented, they are

watched for more than 3.4

million times.

Entertainment

Big data is used in analyzing

weather forecast, crop growth,

and soil data.

In this case, crop harvest can be

forecasted comprehensively,

which helps providing

personalized insurance services

for peasants.

This is an era with both opportunities and challenges

Agriculture

Mary Meeker (Queen of the Net): I think people's lives are better because they have access to all

this information at a very low cost. Entertainment is cheaper, it's easy to get help, it's easier to

stay out of trouble.

6

VS

Data mining and predictive analysis

Efficiency and accuracy improved

VS

Customer self-service

Cost down and convenience

VS

Distributed and Automatic

Scalability and maintenance

VS

Quick response

Agile development cycle

Change is Happening around us

7

Gartner: CSP(Telco) Big Data TOP 8 Use Cases

According to research of current and potential application of big data,

Gartner identified TOP 8 Use Cases for CSPs.

1. Top-Level key performance

indicators（KPIs）

2. Marketing-Customer experience

3. Networks-Customer experience

4. Product/device management

5. Customer services

6. Marketing

7. Third-party uses

8. Vertical uses

8

Servers Networks Storage Security Engineering

Payment info Location info Relationship Warnings

Services Contents

Partners Inhouse Call SMS video

…… ……

Network Data

Operation Data

Business Data

To C：End-User

To B：Enterprise

To Self：CSP

Personalized，Intelligent，Long-tail

product/services

Data openness, Smart

Business

Assist decision，Targeted marketing

Public Information

(Government, Transport, Jobs)

Social Information

(Sports, Entertainment, SNS)

1

2

3

Data Ingestion

Data Storage

Data Analysis

Data Decision

Business Value Chain of CSP

9

CSP Big Data Trends:

Federation, Business-Driven, Openness

Business Domain

Operation Domain

Network Domain

Unified Modeling

logic unification, Physical

dispersion

Open API Vision: Open Data Service

Business Case Apps for market and customer insight

Data Federation Centralized Customer

Data Management

Customer info, Business contract info, Historical service data

Customer contract and behavior data from self or mobile internet

Real-time network user behavior data

10

App Server

DB

Tape

Structure Data

NAS

Non-Structure Data

Before: Traditional Solution

HDFS Cluster

HBase Cluster

MapReduce /

Hive Cluster

After: Big Data Solution

Non-Structure Data

Structure Data

Traditional Data Solution vs. Big Data Solution

11

Precise Marketing

Improve Efficiency

Experience Enhancement

Innovative Business

Big Data Business Scenarios

Real-time Decision

12

BI Analysis

network signaling

analysis

CRM historical data

Inquiry

Data Collection

Real time data

ERP Stru

ctu

red D

ata

CRM

Other

System

……

Web

log

Unstru

ctu

red d

ata

DPI

……

Internet

Data Backward

Web crawler

IDE & OM

precision marketing

Multi-tenant

Parallel Data Mining

（Customer Profile）

Streaming

Big Data Platform

(FusionInsight)

Map Reduce

…… …… Scale-out NAS

detailed statement

inquiry

third party Data

Service

Data App

…… ……

Customer

Service

FusionInsight Solution in CSP

X86 Server Cluster

Data Warehouse (IOE)

13

HUAWEI Case in CSP

DC1

Hadoop Cluster

X86 Server

DC2

Hadoop Cluster

X86 Server

6 month CDR, on-line

inquiry platform Backup Long term for analytics

and statistics for

Operation \ Network\

Business Domain

Distributed CDR center

SQL Engine

User Behavior

Analysis

Third party

Data Service Gateway

Big data Gateway

On-line

inquiry

CDR

statistics

CDR

analytics

Big Data (Distributed Database)

Event-Triggered Campaign

Execution Platform

Environmental

Monitoring

Intelligent

Medical

Public Safety Intelligent

Transportation

Manufacturing

and Logistics

Financial Anti-

Fraud Risk

14

Business area precise marketing activity

after the credit card consumption near

Shenzhen coastalcity, a shopping mall

HUAWEI Case in Financial Service

Social

Index

Historic

Breakdown

Online

Credit

Transaction

Context

Online

Marketing DB / DW

FusionInsight

Easy to Use

HA & Secure

POS

ATM

On-site

Telephone

Internet

Possible

Financial Asset

Financial

Networking

Real time

Batch load Internet

Real-time Precise Marketing

15

Data Service

Storage

High-capacity X86 Server

X86 Server Converged Infrastructure (FusionCube)

Complex Relational Data (Data Warehouse)

Relational Database（MPP/Oracle） Distributed Computing Framework

(FusionInsight Hadoop)

Large-scale data processing

Third-party App Carrier

Internal IT Carrier Network

Optimization

Enterprise-level Big Data Platform

Scale-out NAS OceanStor 9000

16

FusionInsight Hadoop, Enterprise-level best practice

Fu

sion

Insig

ht H

ad

oo

p

Data Loader

Apache Hadoop

HDFS

HBase ZooKeeper Oozie

Hive

YARN

FusionInsight Hadoop Manager

Linux Patch and enhancement for Hadoop

MapReduce

FusionInsight Hadoop Enhancement

Spatio-

temporal

DB

Deep user

modeling

SQL

Engine R

Data Service

Concurrency control

Dynamic schedule

Dev Tool

Authorization Mgt.

HA Encryption

Northbound interface

Log tool

Monitor and alert

Deployment and Upgrade

Configuration management

Audit log

User Management

Backup & DR solution

Continue to contribute to open source community, and release Hadoop Distribution for enterprise customer

17

Scale-out NAS

NFS/CIFS/HDFS SQL HTTP/S3 MR/HBase

MPP DB

ENGINE

HADOOP

ENGINE

OBJECT

ENGINE

NATIVE

INTERFACE NATIVE

INTERFACE

NATIVE

HDFS

Multi-Workload Scale-Out Storage

Platform

Leading Storage Efficiency and

Scalability

End-To-End Data Protection

Enterprise-Level Hadoop Model

Native Integrated Hadoop/ MPP-

DB/Object

Unified Management

DISTRIBUTED

RAID

LOAD

BALANCE

QUOTA

MGMT

STORAGE

TIERING

Scale-out NAS: HUAWEI OceanStor 9000 big data storage

Copyright©2012 Huawei Technologies Co., Ltd. All Rights Reserved.

The information in this document may contain predictive statements including, without limitation, statements regarding the future financial and operating results, future product

portfolio, new technology, etc. There are a number of factors that could cause actual results and developments to differ materially from those expressed or implied in the predictive

statements. Therefore, such information is provided for reference purpose only and constitutes neither an offer nor an acceptance. Huawei may change the information at any time

without notice.

HUAWEI ENTERPRISE ICT SOLUTIONS A BETTER WAY