Erlang for video delivery

Erlangfor video delivery platforms

Friday, October 19, 12

About me

Worked for Delta, Bellsouth, Sun Microsystems, Weather Channel

Love realtime, high volume systems

Sr. Director Engineering EricssonN2 Broadband -> Tandberg TV -> Ericsson

hwatkins @ github


Media Delivery Management SystemErlang (of course!)

Realtime processing

Protocol specific pieces

Ruby on Rails

Front end and some API’s


Media Delivery Management SystemMongoDB

Persistence layer

Geo redundant

RabbitMQ (AMQP)

Messaging Bus


VOD ecosystem


Async processing


Sync to Async


Dynamic RoutingAbility to add components on the fly

Apply components to different profiles

In harmony with multiple VM’s


Competing Consumer


Clients

HTTP DSM-CCISO/IEC 13818-6


Java binary protocol

Class per section

Lots of code

Lots of objects

Lots of GC


Binary Data


Pattern Matching


Memory Management

Java

Shared memory with reference count

Erlang

per thread heap

single assignment


Memory Footprint

Identical functionality developed in Java and Erlang

AMQP workers and connected to MongoDB

Java averaged 1 GB memory

Erlang averaged 200 MB memory


Threading ModelThreading is ideal for things like http requests

Java

Threads heavyweight - thread pools

Erlang

Lightweight - spawn on demand

Think linear


Clustering

Java

Memory - Terracotta

Erlang

Built in netadm:ping

Mnesia - disk or memory


Runtime Debugging

REPL (Read-Eval-Print-Loop)

Cookie

Remote Shell

Issue commands


OTP

Built for the real world - Use it!

application, gen_server and supervisor

Use alot!

gen_fsm and gen_event

Not as much but still useful


OTP Custom Behavior


Packagingreltool

rebar generate

start, stop, console, attach

runtime vm and libraries

small ~29M release


Useful Libraries


Rebar

De facto build system

Wrap in simple makefile for ease

Make dependancies easy to manage


folsom

Github boundary/folsom

Metrics and counters during runtime

Expose through mochiweb


https://github.com/boundary/folsom




Others

Mochiweb - Web Server

Webmachine - Rest


Erlang for video delivery

Technology

Transcript of Erlang for video delivery