The Big Picture: Understanding the Many Roles of HadoopExploratory Webcast | January 28, 2015

SPONSORED BY

The Internet of Things

Robin Bloor, Ph D

The Internet of Things

Topics

Part 1 – The IOT in Prospect

Part 2 – The Architectural Problems

Part 3 – The IoT as Disruption

The IOT in

Prospect

1

Projections (or Hype)

• IoE (Internet of Everything) creates $19 trillion of value at

Stake for companies and industries – Cisco

• Global IoT market expected to grow at CAGR of 31.72% 2014-

2019

• “Industrial Internet” has the potential to add $10 to $15

trillion to global GDP over next 20 years

• GE estimates that convergence of machines, data and

analytics will become a $200 billion global industry over the

next three years

• Today 14 billion objects connect to the internet. Industry

analysts estimate the number to be between 20 and 100

billion by 2020 – UK Government Report

IoT Size Estimates

Source: Iron Paper

An IOT Trend Graph

Adoption

Source: Iron Paper

Computer

Online

PC

Internet

Mobile

Internet of Things

(IoT)

Batch

Centralized

Client/server

Multi-tier

Service orientation

Event driven/big

data/parallel/distrib

uted

Tech Revolution Architecture

You Say You Want a Revolution…

Architectural

Challenges

2

IOT Architecture - Periphery

Compress the data

Bring the processing

to the data

Aggregate

Establish resilient

depots

Process at the depots

Send derived data to

“the center”

IOT Architecture - Periphery

The pulse and the

alert

Some of this involves

distributed processing

There are known apps

and unknown apps

Hence analytical

exploration will need

to be enabled

Only aggregations will

migrate

DepotDepot

CentralHub

SourceProc.

DepotProc.

CentralProc.

Sensors, controllers, CPUs

Data Data

Data

Event Data

Time

Geographic location

Virtual/logical

location

Source device

Device ID

Data

Event Based Architecture

Immediate Analytics & the Rest

MetaData Discovery

MetaData Management

Data Cleansing

Data Lineage

Immediate AnalyticsData Sources

Analytics

ServiceMgt

Life CycleMgt

MetaDataDiscovery

MDM

MetaDataMgt

DataCleansing

DataLineage

ROUND|

UP

WRANGLING

Staging Area(Hadoop)

Data Warehouseor other location

Data Streams

ETL

ETL

MDM

Service Mgt

Life Cycle Mgt

ETL

Downstream

Everthing is “Real Time”

Events are created in streams

Hence, in time, they will be processed

in streams

The IoT as

Disruption

2

IoT and Change Factors

SPEED

TIMETAKEN

EFFORT

FIT

VALUE

Speed of Process

Speed of Action

Compatible

Incompatible

TimetoDeploy

TimetoEmploy

CostReduction

Competitiveness

AcquisitionCost

TCOCOST

EfforttoDeploy

EfforttoDevelop

Hexagon ofChange Factors

Plus Capacity

Speed Speed of action

Speed of business process

Cost Cost of acquisition

Cost of ownership

Time Time to deploy

Time to employ

Business Value By competitiveness

By cost reduction

Effort Effort to develop

Effort to deploy

Fit Compatible

Incompatible

USDH and the IoT

The change is at the human

level and the organizational

level and the personal level

I.e., change to personal

processes, and business

processes and societal

processes

The changes to software and

data are considerable

Suddenly everything became

computer hardware

Four Fundamental (IT) Factors

Hardware

Users

Software Data

BusinessInformationB

usinessProcess

HumanActivity A

llInformation

Staff

Facility

People

Civilization

TIME

IoT and the Technology Layers

Note that the stack is

distributed

This will naturally strain

the lower three layers of

the stack

Commodity hardware is

likely to be pervasive in

this

There is no OS which

can guarantee service

levels at this moment

The data layer is

immature for this

The BuyingImpulse Goes

Down

TechnologyChange Rises Up

The TechnologyLayers

The Inversion

Instrument existing infrastructure

Analyze

Improve instrumentation

Analyze

Review fundamental design

Design with feedback mechanisms

built in

Rebuild

Summary

Part 1 – The IOT in Prospect

Part 2 – The Architectural Problems

Part 3 – The IoT as Disruption