Take the Big Data Challenge - Take Advantage of ALL of Your Data 16 Sept 2014

© Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.

Take the Big Data Challenge: Exploit ALL of your dataPieter van ZeeProduct Manager, IDOLOnDemand.comHP Big Data Business Group

© Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.2

By Using ALL of Your Data

Better User and Business Results

Take the Big Data Challenge

http://www.actionnewsjax.com/news/news/local/430-take-ice-bucket-challenge-world-record-attempt/ng7t3/


Look Beyond Structured Data …

Machinedata

Humaninformation

Structureddata

ConnectedIntelligence


Big Data impacts all of us …

How do I use data toimprove service for all IT users?

How do I filter all these log files to isolate problems faster?

How do I decide what to archive, what to delete, and how do I manage it?

With today’s loads and complexities, how do I performance test my app?

How are end users experiencing my mobile apps on all platforms and carriers?

How do I analyze ALL of the relevant data?

In a world of cloud, mobility, and big data, how do I filter through and protect myself against new security threats – both inside & outside my network and across my applications?


New! HP IDOL OnDemandEasy-to-use web service to power the next generation of apps using human info analytics

www.idolondemand.com

Powered by


IDOL OnDemand unlocking the “dark data” within SalesForceIndex and search unstructured, untagged, case-chatter/emails/comments/attachments

IDOL OnDemand

Index of cases and

attachments

Search chatter

Search emails

Search comments

Search attachments

Case sentiment

Find similar cases

Explore related

concepts


ExpireSocial.com – Reputation management with IDOL OnDemand

Days of cold rain and snow. We're looking forward to our vacation with the kids to Hawaii. Got to love the picture we got from the Johnstons, who just got back.

User enters text and photos

IOD analyzes faces and

demographics

Remove posts after they expire

Recommend expiration times

Show post screen

IOD analyzes text content and

categories

IOD analyzes info about

geolocationPost

For: People who post to social networksWho: Want to take control of the personal info they shareSolution: Mobile app that recommends how long to leave a post in place

based on its content and then takes it down for you after it expiresUnlike: Typical social media sharing, which has no expiration date


Level 0No Big Data

Level 1Structured -Internal

Level 2Structured –Internal & External

Level 3Structured –Internal & ExternalUnstructured -Internal

Level 4Structured –Internal & ExternalUnstructured –Internal & External

Level 5Fully Optimized and Using All Relevant Data

Where are you on the Big Data continuum?Solution Complexity

Big Data is not used

All data sources are fully integrated and optimized

Minimal use of structured internal data e.g., from ERP, CRM systems

Include use of unstructured data, e.g., text, graphic

Valu

e / B

enef

it

Data Types

Present Future

Supplement with structured external data, e.g., paid subscriptions

Add use of external unstructured data, e.g., search, social media

48%*

7%*

8%*

8%*

Source: Gartner Research Survey, March 2012* Percentage of Gartner survey respondents who indicated high usage of that particular class of data

“Over 90% of executives reported that in the next three years their organization plans to incorporate unstructured data into their enterprise insights, processes, and strategy.”

Source: Coleman Parkes Survey, Nov. 2012


Business Intelligence evolution

Hindsight Insight Foresight

Dataunstructured; business & social

Process prediction and actionpatterns and trendswhat happened yesterday

People operations staffreport writers

Technology analytics databases data warehouse, KPI dashboards

prediction, optimization & simulation systems

highly structured

Advanced Analytics Domain

data scientists business professionals


HP Big Data Platform: HAVEn

HAVEn

Catalogue massive volumes of distributed data

Hadoop/HDFS

Process and index all information

AutonomyIDOL

Analyze at extreme scale in real-time

Vertica

Collect & unify machine data

Enterprise Security

Powering HP Software+ your apps

nApps

hp.com/Haven

Social media IT/OT ImagesAudioVideo Transactional data

Mobile Search engineEmail Texts Documents

© Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.11HP Confidential

Hadoop With Deeply Integrated Analytics CapabilitiesBig Data Lakes

Enable business users to explore and interact with massive data lakes aggregated with Hadoop without advanced programming skills

• Complete Enterprise Solution

• Deep Hadoop Integration

• MPP M/R Architecture

• Enterprise Class Security

• Enable Self-Service Analytics

• 500+ Advanced Information Analysis Functions

• REST based APIs• Developer tools for custom apps

Hadoop Cluster

HDFS

Map/Reduce Slots

Compute Node

HDFS Sync

Hadoop Services

Edge Node

Distributed Action

Handler

Hadoop Services

Edge Node

Map/Reduce Slots

Map/Reduce Slots

Compute Nodes …Compute Nodes …

Map/Reduce Slots

Compute Nodes …

Map/Reduce Slots

Compute Node

IDOL Community

IDOL Admin


Big Data Info Analytics with Context, Scale & Speed

Core technology : Information platform for processing free text, audio, video, image and structured data

How it works: Probabilistic modeling and pattern-matching to understand concepts in information

Illustrative use case:Voice of the Customer

Key advantage: Analyze diverse forms of unstructured information to probe and explore data

Spectrum of use cases: Information governance, eDiscovery, knowledge management, video surveillance

HP IDOL

Core technology : Purpose-built analytics platform to manage petabytes of data at massive scale with blazing-fast analytics

How it works: Columnar architecture with intelligent data compression, built-in analytic functions, and open integration to meet analytic use cases

Illustrative use case: Clickstream analytics

Key advantage: Manage and analyze massive volumes of data in seconds, not weeks

Spectrum of use cases: Operations analytics. sensor data analytics, patient analytics, customer analytics

HP Vertica

Analyze100% of your information

with context, speed and

scale

Blazing fast exploration & analysis of semi-structured + “dark” data

Powering the next generation of human information applications


Big Data Security Analytics with HP ArcSight ESM 6.5

AnalyzeCollect/correlate Searchup to 100,000 events/ second from 350+ connectors

Up to 2 million events per second

a breach in 4 hours with quick forensic investigation


HP HAVEn Business-driven Big Data use cases

• Fraud detection• Anti-money

laundering• Risk management

• Broadcast monitoring

• Churn prevention• Advertising

optimization

• Supply chain optimization

• Defect tracking• RFID Correlation

• Weather forecasting• Natural resource

exploration

• Drug development• Clinical Data

Analytics• Evidence-based

medicine

• Law enforcement• Counter terrorism• Traffic flow

optimization

• Marketing effectiveness

• Brand awareness and advocates

• Integrated customer experience

• Support analysis

• Demand-supply planning

• Procurement analytics

• Systemic fraud models

• Compliance and risk

• Workforce optimization

• IT performance management

• Social lead generation

• Sales optimization

Func

tion

Indu

stry

Finance Telecom Manufacturing Energy HealthcareGovernment

Marketing Customer Supply chain Risk management HR, ITSales


Imagine better products and services

NASCAR



Imagine optimized processes and superior outcomes

Lucile Packard Children’s HospitalStanford, CA



Imagine real-time risk management and governance

Morgan Stanley



Imagine finding and fixing problems, before your customers even notice

Vodafone Ireland



Game ShowNetwork

Your RankYour Score

Solitaire RushYOU ARE PLAYING

0 1278

Lizzie47

Imagine deeply understanding your customer


Thank you

hp.com/go/bigdata

Wednesday9:40-10:00amSakura A

Wednesday1:45-3:20pmSakura B

Combining Human Information and APIs to Tap Into the Full Potential of the Internet Of Things.Martin Zerbib

Human Information API Platform: Index, Analyze, and Search All of Your Unstructured Data Using HP IDOLOnDemandRemko de Knikker

Tuesday & Wednesday

Visit the HP Booth in the Expo Area, #B2

Take the Big Data Challenge - Take Advantage of ALL of Your Data 16 Sept 2014

Data & Analytics

Transcript of Take the Big Data Challenge - Take Advantage of ALL of Your Data 16 Sept 2014