2013-12-13 Lightning talk Streaming Analytics @ Munich Big Data Meetup

4
© 2013 IBM Corporation It's not just the size, it's the motion - Streaming analytics for real time big data with Infosphere Streams Stephan Reimann – IT Specialist Big Data - [email protected] @stereimann de.linkedin.com/in/stephanreimann/ www.xing.com/profiles/Stephan_Reimann2

Transcript of 2013-12-13 Lightning talk Streaming Analytics @ Munich Big Data Meetup

Page 1: 2013-12-13 Lightning talk Streaming Analytics @ Munich Big Data Meetup

© 2013 IBM Corporation

It's not just the size, it's the motion - Streaming analytics for real time big data with Infosphere Streams Stephan Reimann – IT Specialist Big Data - [email protected]

@stereimann de.linkedin.com/in/stephanreimann/ www.xing.com/profiles/Stephan_Reimann2

Page 2: 2013-12-13 Lightning talk Streaming Analytics @ Munich Big Data Meetup

© 2013 IBM Corporation

Traditional approach

– Historical fact finding

– Analyze persisted data

–  (Micro-) Batch philosophy

– PULL approach

Streaming analytics

– Analyze the current moment / the now

– Analyze data directly “in Motion” – without storing it

– Analyze data at the speed it is created

– PUSH approach

Streaming analytics is a paradigm shift from pull to push analytics in real time, directly „on the wire“, data does not need to be persisted

Repository Insight Analysis Data Insight Analysis Data

Page 3: 2013-12-13 Lightning talk Streaming Analytics @ Munich Big Data Meetup

© 2013 IBM Corporation

InfoSphere Streams is the result of an IBM research project, designed for high-throughput, low latency and to make streaming analytics easy

Volume Millions of Events per Second

Variety All kinds of data Complex analytics: Everything you can express via an algorithm

Velocity Analyzes data at the speed it is created

Latencies down to µs

Immediate action in real time

+ +

In

foSp

here

Str

eam

s

Cap

abili

ties

How

it w

orks

–  Define apps as flow graphs consisting of sources (inputs), operators & sinks (outputs)

–  Extend the functionality with your code if required for full flexibility

–  The clustered, distributed runtime on commodity HW scales nearly limitless

–  GUIs for rapid development and operations make streaming analytics easy

Page 4: 2013-12-13 Lightning talk Streaming Analytics @ Munich Big Data Meetup

© 2013 IBM Corporation

Free Quickstart Edition

Developer Community

Streaming analytics is about analyzing all the data, continously, just in time, it enables a completely new generation of big data apps

www.ibmdw.net/streamsdev/ www.ibm.com/software/data/infosphere/streams/quick-start/

Stop just dreaming of real time big data Start with streaming analytics!!!

Star

t her

e!! +

Radio astronomy Healthcare TelCo Transport Smart Grid IoT

Streaming Analytics is already reality ... and is a key component of many innovations

... ...

Tutorials, Labs, Forum, ...