Get queued

DON’T MAKE ME WAIT

Let’s get queued up

Chad Windnagle - @drmmr763

INTRODUCTION• Recovering Joomla Addict

(Clean 2yrs)• Joomla GSoC Admin (2012-

2015)• Joomla Resource Team Editor• Joomla!Day, JWC, & JAB

Speaker• JWC 2014 Keynote Speaker


JOOMLA WAS MY PLAYGROUND


JOOMLA INSPIRED ME

AUDIENCE INTRODUCTION


WHAT ARE QUEUES ANYWAY?


SYNCHRONOUS FLOWUser Sends

RequestServer Sends

ResponseResponseRendered


A-SYNCHRONOUS FLOW

User SendsRequest

Server SendsResponse

ResponseRendered

Background TaskInitialized

Background TaskExecuted

Notify UserTask Complete


WHAT SHOULD WE QUEUE?•Notifications (Email /

SMS)•Statistical Calculations

•Data Matching Algorithms

•Regularly Scheduled Tasks

• Image / Video Processing

•Data Indexing

•Traditional Page Requests

•User File Uploads•Login / Logout Functions

•File Downloads•Add to Cart Functions

•REST API Endpoints

Use Queues: Don’t Use Queues:

COMPONENTS OF A QUEUE SYSTEM


THE MESSAGE

A message is string-based content which informs the application which task to

perform, and encapsulates any data needed to perform that task.


{ "messageType" : "sendEmail", "email" : { "to" : "[email protected]", "from" : "[email protected]", "subject": "Hello speakers!", "body" : "Can't wait to see you all." }}

MESSAGE EXAMPLE


THE QUEUE / TUBE

The message queue, or tube, contains a collection of messages that need to be

processed by the queue system.


Newest OldestTypical Processing Order

SERVICE WORKER

The service worker is code that is responsible for executing the tasks on the queue.


Newest OldestTypical Processing Order

EXECUTION CYCLE


User RequestsQueueable Task

Message with DataGenerated

Message AddedTo Queue

Server BootsService Worker

Service WorkerPerforms Task

Message RemovedFrom Queue

QUEUE SYSTEM VENDORS

VARIOUS VENDORS

Beanstalkd

Laravel

Redis

Gearman

RabbitMQ

AmazonSQS

IronMQ

Symfony


Beanstalkd

BEANSTALKD BENEFITS


RAM Based Data Storage - High Performance!

HTTP Protocol - Allows Multi-Server Set Up

PHP Composer Library Available - Fast DevelopmentCommunity Resources (Blogs, Documentation, Etc.)


STACK OVERVIEWPHP Application

(Joomla!)

PHP Library (Pheanstalk)

Beanstalkd Service

Queue Jobs

Queue / Execute Job


apt-get install beanstalkd

INSTALLING BEANSTALKD


php composer.phar require pda/pheanstalk

INSTALL PHEANSTALK

RUNNING BEANSTALKD


./beanstalkd -l 127.0.0.1 -p 11300

Options:

-l Specify the address to listen on-p specify the port to listen on

CURRENT STATUS?


Beanstalkd is running:

- It can add jobs to a queue- Returns job details to service worker- Jobs can be removed from the queue

ADD MESSAGE TO QUEUE


<?php

use Pheanstalk\Pheanstalk;

// connect to Beanstalkd Service$pheanstalk = new Pheanstalk(‘127.0.0.1');

// add the job to the queue$pheanstalk->put(‘a special message’);

GET MESSAGE FROM QUEUE


<?php

use Pheanstalk\Pheanstalk;

// connect to Beanstalkd Service$pheanstalk = new Pheanstalk(‘127.0.0.1');

// get next available job from queue$job = $pheanstalk ->watch(‘default’) // specific tube ->reserve(); // job in progress

EXECUTE A TASK


<?php

// get the message from the queued job$jobData = $job->getData();

// prints “a special message”print $jobData;

// remove job from queue$job->delete();

MORE USEFUL EXAMPLE


$message = [ ‘messageType => ‘sendEmail’, ‘email’ => [ ‘to’ => ‘[email protected]’, ‘from’ => ‘[email protected]’, ‘subject => ‘Hello speakers!’, ‘body’ => ‘Please come to my session!’]];

mailto:[email protected]?subject=

mailto:[email protected]

MORE USEFUL EXAMPLE


<?php

// add the job to the queue$pheanstalk->put(json_encode($message));

Application code would add tasks to the queue

MORE USEFUL EXAMPLE


// get the message from the queued job$jobData = json_decode($job->getData());

$messageType = $jobData[‘messageType’];

if ($messageType == ‘sendEmail’ { // “to”, “from”, “subject”, & “body”$this->sendEmail($jobData[‘email’]);}

Service worker executes based on message type

TRIGGERING SERVICE WORKER


php ./service-worker.php


github.com/drmmr763/jdayfloridaPHP ProjectComposer BasedUses PheanstalkUses BeanstalkdCommand Line

UtilitiesPHP Class Message

Types

EXAMPLE GITHUB CODE

http://github.com/drmmr763/jdayflorida

ANY QUESTIONS?


ICON CREDITS

Kirby WuSchmidt Sergey

IconSphere

Carl Holdnerss

ProSymbols

Above icons licensed via Creative Commons, sourced from TheNounProject.com

GregorCresna

rOliviaStoian

RudolfHoraczek

ProSymbols icon 54

ChangHoon

BaekDaniel Baker

http://thenounproject.com/


THANK YOU!Code: github.com/drmmr763/jdayflorida

Follow Me: @drmmr763

Slides available on slideshare

https://github.com/drmmr763/jdayflorida

https://github.com/drmmr763/jdayflorida

Get queued

Technology

Transcript of Get queued