A little about Message Queues

Matt BrenderDeveloper Advocate at Basho

1

tweet me @mjbrender 2

tweet me @mjbrender 3

tweet me @mjbrender 4

tweet me @mjbrender

A common pattern

5

tweet me @mjbrender 6

tweet me @mjbrender 7

tweet me @mjbrender 8

tweet me @mjbrender 9

tweet me @mjbrender 10

tweet me @mjbrender 11

tweet me @mjbrender

Can’t I just…

12

tweet me @mjbrender 13

tweet me @mjbrender 14

tweet me @mjbrender 15

tweet me @mjbrender 16

tweet me @mjbrender 17

tweet me @mjbrender 18

tweet me @mjbrender 19

tweet me @mjbrender

I just want..

20

tweet me @mjbrender

Consistent Indexes

21

tweet me @mjbrender

Asychronous

22

tweet me @mjbrender 23

One Example from Kafka:

tweet me @mjbrender

The Choices

24

tweet me @mjbrender

This or That

• NoSQL• Types

• Key/Value• Document• Columnar • Graph

• “Message Queues”• Pub/Sub• Commit Log

25

• Hadoop • HDFS • Map/Reduce• YARN

• Storm• Real-time Stream

processing

• Spark • Successor to

Map/Reduce

tweet me @mjbrender

Apache ActiveMQ

26

tweet me @mjbrender

RabbitMQ

27

tweet me @mjbrender

Apache Kafka

28

tweet me @mjbrender

Apache Zookeeper

29

and requires

tweet me @mjbrender

From here..

30

tweet me @mjbrender

Read, a lot

31

tweet me @mjbrender 32

Rabbit vs Kafka in detailExploring Message Brokers

RabbitMQ tutorialsIntro to SQS

queues.io/

tweet me @mjbrender

Get Hands-on

33

tweet me @mjbrender 34

Matt Brender@mjbrender

Thank You