Smarter Analytics: Big Data and Predictive Governance

© 2010 IBM Corporation

Steven AdlerIBM Information Governance Solutions

Predictive GovernanceBig Data, Social Media, Systemic Models, and Governance


Predictive Governance

1. Crises – Always a surprise

2. Big Data – We Anticipate the Future

3. Systems – We understand how things work

4. Predictive Governance – We take control


When the Financial Crisis hit in October 2008

...why were its causes and effects a surprise?


When Greece couldn't make its debt payments in 2009

...Why didn't we foresee the impact on interest rates?


When 57% of American Farmland is ruined by Drought...

...How will that effect the global economy?


Making Predictions is Difficult...

...When we aren't paying attention to what's happening


Even when we are paying attention

...there is a lag between event and information


But there are ways

To know what's happening right now,

and combine it with historical experience.

To detect evidence of dysfunction,

And monitor its development.

To predict the likelihood of crises,

And anticipate its direct and tertiary

consequences.

...And we have to do it now


Because the world is too important

...To just keep muddling along

© 2010 IBM Corporation10101010

Extracting insight from an immense volume, variety and

velocity of data, in context, beyond what was previously

possible.

Big Data = Volume, Variety and Velocity

Manage the complexity of

multiple relational and

unstructured data types and

schemas

Streaming data and large

volume data movement

Scale from terabytes to

zettabytes

Variety:

Velocity:

Volume:

11 © 2010 IBM Corporation

Example: A Massive Earthquake in Australia...

Will have a ripple effect across South East Asia

Gold Mine

Perth


In the old days, markets priced the effects...

But Today, you use Big Data to monitor the impact


Combining Satellite Images

...with logistics data

We can know:

� where every ship is in port and en route

� What they carry, and their destination

� Speed and Course

� Maintenance Record and Personnel

� Buyers and Sellers

� Logistical Supply Chain

� Industrial Dependencies

� Markets and Makers


Using Local Reporting of damage

...and historical data we can assess economic impact

Smartphone Images

Uploaded with geotags

Image recognition of

Damaged facilities

Compared to port data on

Goods volume per day


Meanwhile Employees scour media reports

...and post articles that are indexed and researched

Each report is a

lead that a search

engine uses to find

more of the same.

Employees

comment on the

reports adding

experience and

interpretation. In

real time, you build

rich understanding

of what's

happening.


They attend meetings and conferences

...and send photos, ideas, and updates

Their metadata allows you to

Perform federated search

On the meeting or conference

They attended and index the larger

Contextual information to magnify

Their experience and provide

Richer context.


Your Data Governance Ontology

...allows you to validate Data Quality in Real Time

Using the same Big Data

Solutions, you tag data as it

Is analyzed, research its lineage

Verify its provenance, and assign

Obligations to its onward use.


With verified data, you generate systemic models

...to simulate potential outcomes and make new plans


This vision combines data from human and computer

...Sensors with Big Data Actuators


Every day we are confronted with crises big and small

...that we want to master with information


Big Data is the way to master our information

1. Business and IT

Identifyinformation sources available. 2. IT Delivers Platform

that enables creative

exploration of all available data

and content.

3. Business explores data

and relationships creating

and testing hypotheses.

4. New insights drive

integration with

traditional technology.

+

...and turn challenges into opportunities


Big Data allows us to analyze anything and...

...add rich layers of context and meaning

You can tell where your information came from

- when it was last updated

- how many people touched and altered it

- what it means and how you should use it

- when you should trust it

- whether it is fact or dangerous fiction

- what it means and what it is related to

- to create ecosystems of information


IBM Vision for Big Data Integration

Application Framework

StreamsComputing

Internet ScaleComputing

Analytics

ContentDiscovery

Public/PrivateCloud


Big data is a hot topic because technology makes it possible to analyze ALL available data

Cost effectively manage and analyze all available data, in its

native form – unstructured, structured, streaming

ERPCRM RFID

Website

Network Switches

Social Media

Billing

25

Vestas optimizes capital

investments

• Model the weather to optimize

placement of turbines, maximizing

power generation and longevity.

• 3 weeks to 3hrs.

Reduce time required to identify

placement of turbine from weeks

to hours.

• 2.5 PB of structured and semi-

structured data.

Growing to 16PB 2015

Capabilities:

Hadoop System

Data Warehousing

26

Beacon Institute Detects

Environmental Changes to

Water Resources in Real-time

• Collecting and processing multiple streams of

physical, chemical, and biological data from

sensors deployed in Hudson Bay

• Sensor data is analyzed against larger

meteorological data and aggregated

• Real-time environmental data delivered in

standard format to scientists, engineers, policy

makers, and educators

Significant benefits:

• Better understanding of dynamic interactions

within local river and estuaries

• Fosters increased collaboration by making real-

world data available to outside systems,

researchers, policy makers

• Helps resource management respond more

effectively to changes to local water resources

26

Capabilities Utilized:

Stream Computing

“More effective

response to

chemical,

physical,

biological

changes”

27

TerraEchos Turns to IBM

Big Data for Low Latency

Surveillance Data Analysis

• Deployed security surveillance system to detect,

classify, locate, and track potential threats at

highly sensitive national lab

• Stream computing collects and analyzes acoustic

data from fiber-optic sensor arrays

• Analyzed acoustic data fed into TerraEchos

intelligence platform for threat detection,

classification, prediction & communication


• Enables Terraechos solution to analyze and

classify streaming acoustic data in real-time

• Provides lab & security staff with holistic view of

potential threats & non-issues

• Enables a faster and more intelligent response to

any threat

27


Stream Computing

“Identifies and

classifies potential

security threats –

miles away”

28

KTH Swedish Royal Institute

of Technology Reducing

Traffic Congestion

• Deployed real-time Smarter Traffic system to

predict and improve traffic flow.

• Analyzes streaming real-time data gathered from

cameras at entry/exit to city, GPS data from taxis

and trucks, and weather information.

• Predicts best time and method to travel such as

when to leave to catch a flight at the airport


• Enables ability to analyze and predict traffic

faster and more accurately than ever before

• Provides new insight into mechanisms that affect

a complex traffic system

• Smarter, more efficient, and more

environmentally friendly traffic

28


Stream Computing

Proctor & Gamble increases

employee productivity thru

improved enterprise search

Need

• Robust search and discovery system to help

employees more effectively & efficiently

leverage company data & content in more

than 30 strategic repositories

• Help employees find content they need,

people they should talk to, and places to look

for relevant info.

Benefits

• Reduced employee time spent searching for

info, increased time to make productive

connections, and enable action


IBM Vivisimo Velocity


Closing Remarks

1. Big Data will integrate all information types

2. Federated Search and Indexing

3. Automated Research and Discovery

4. Live Data Verification and Classification

5. Systemic Models and Simulations

6. All of this is available today

Smarter Analytics: Big Data and Predictive Governance

Business

Transcript of Smarter Analytics: Big Data and Predictive Governance