The Rise of the Streaming Platform - Big Data Paris …...Stream Processing (Kafka Streams / KSQL)...
22
The Rise of the Streaming Platform Ben Stopford, Technologist, Office of the CTO
Transcript of The Rise of the Streaming Platform - Big Data Paris …...Stream Processing (Kafka Streams / KSQL)...
The Rise of the Streaming PlatformBen Stopford, Technologist, Office of the CTO
Relational Database
Management Systems
DataWarehousing
Infrastructure Technology
?
New Data has move Value than
Old Data
Databases are Retrospective
The Streaming Platform
Kafka
Applications
Stream Processing(Kafka Streams / KSQL)
Source DB Sink DB
3 Blind Men
Three Lenses
Messaging done right.
Lens 01
Way More Than Message QueueLens 01
Messaging done right.
Way More Than Message QueueLens 01
True StorageReal-time
ProcessingScalability
Hadoop made fast.
Lens 02
Lens 02
Applications are different
Sunday
May 7th 2017Hadoop made fast.
Lens 02
Applications are different
Sunday
May 7th 2017
ETL and Data Integration as a platform.
Lens 03
Lens 03
Stream Processing is for more than data pipelines
Lens 03
Stream Processing is for more than data pipelines
What Does The Future Hold?
17
The rise of
Managed services
18
of Kafka users are in the cloud52%
19
CREATE STREAM crashes_per_day ASSELECT app_id, COUNT(*) FROM app_crashesWINDOW TUMBLING (1 day) GROUP BY app_id
An open streaming platform around Kafka and it’s ecosystem
Management
Representing Data
Connectors
Support
Apps
RDBMS
K/V
Monitoring
Search
DWH
HADOOP
Stream Processing
Real-Time Analytics
Thank you!
