WebRTC Infrastructure the Hard Parts: Media

COMPANY CONFIDENTIAL © COPYRIGHT 2015 DIALOGIC CORPORATION. ALL RIGHTS RESERVED. 1

COMPANY CONFIDENTIAL © COPYRIGHT 2015 DIALOGIC CORPORATION. ALL RIGHTS RESERVED.

WebRTC Infrastructure: THE HARD PARTS

WebRTC Global Summit


Why Terminate Media?

NAT Traversal: TURN Gateway Media Server




TURN Server

TURN for NAT Traversal




Gateway for Interworking

Web signaling

WebRTC media

SIP

VoIP media

GW SIP




Media Servers for…


Many Reasons for a Media Server

Conferencing Interworking Transcoding

Stream processing Recording Person-‐to-‐machine


Why process media server-‐side?


Many Reasons for a Media Server Conferencing

Conferencing


Mesh model does not scale

Distributed peer-‐to-‐peer mesh Centralized with media server


Many Reasons for a Media Server Transcoding

Transcoding

Transcoding: because we live in an imperfect world


Many Reasons for a Media Server Server Side Media-‐Processing

Server-‐side media handling for: ¥  ApplicaYon work-‐flows ¥  Security ¥  Compliance ¥  Performance ¥  Reliability

Stream processing Recording Person-‐to-‐machine


Add value to terminated media

+ Today •  Audio & video conferencing •  MulY-‐camera switching •  Compliance recording •  Speech detecYon •  Audio/video inserYon •  Speech recogniYon •  Automated IVR navigaYon •  Speaker CDR analyYcs

Not too far away •  Live RTC stream distribuYon •  Facial recogniYon •  Voice fingerprinYng •  Health biometrics •  Object detecYon •  Machine vision •  SenYment analysis •  Augmented reality


Many Reasons for a Media Server Conferencing

Conferencing


TradiOonal MCU Resource Usage

Worst-‐case process: 1.  Each stream

decoded at the MCU 2.  MCU mixes each

conferee 3.  MCU encodes

individual mix for each conferee

MCU

1 1 2

2 3 3

4 4 5

5 6 6

Ingress streams 6

Egress streams 6

MCU decodes 6

MCU encodes 6


Efficient MCU Resource Usage

Efficient process: 1.  Each stream

decoded at the MCU 2.  MCU mixes each

conferee 3.  MCU shares same

encoder for all conferees

MCU

1 2

3

4 5

6

Ingress streams 6

Egress streams 6

MCU decodes 6

MCU encodes 1

1

30%-‐50% reducYon in compute resources


Newer Approach: SFU

SFU

SelecOve Forwarding Unit (SFU) rouOng   Clients send one & receive

many   Client can instruct SFU

which streams to send   High throughput   Can be lots of downlink

bandwidth   Low latency

n = number of conferees in a conference

PerspecOve Streams

Client

Server (SFU)

Network


New WebRTC Approach: Simulcast

SFU High bitrate

Low bitrate

SelecOve Forwarding Unit (SFU) with Simulcast   Clients send mulYple

streams to SFU   one high-‐bit rate   one or more lower-‐bit

  Client directs SFU which streams to receive

  Reduces bandwidth vs. SFU   Simulcast in WebRTC

coming


Future Approach with VP9 – SVC?

SFU

Medium High Low Layered bitrates:

SelecOve Forwarding Unit (SFU) with Scalable Video Coding (SVC)   Clients send layered

stream to SFU   Layers have varying bitrates –

Yme, size, quality

  SFU directs who gets what   Coming to WebRTC

eventually


Media server network model

Load Balancer MRB

Client Client Client Client Client Client

App Server App Server App Server

Media Server

Media Resource Broker: Intelligent load balancer & orchestraYon for media servers


Pseudo Call-‐flow with a media server

AS MRB MS1 MS2 Client

Call signaling

Media control

MS1 status MS2 status

Media control Media


Pseudo Call-‐flow – tradiOonal fail-‐over with RE-‐INVITE


Call signaling – REINVITE with new addresses

Media control


Media control + call states

Media


Pseudo Call-‐flow – fail-‐over the cloud/NFV way


Media control


New container

Media

Memcache & Virtual IP Address


Conclusions

¥  TerminaYng media isn’t cheap, so avoid it if you can

¥  Like it or not, you will probably need server-‐side media someYmes

¥  If you need server-‐side media, maximize the value you get from it

¥  Architectures are evolving to make media-‐processing more efficient & scalable

WebRTC Infrastructure the Hard Parts: Media

Technology

Transcript of WebRTC Infrastructure the Hard Parts: Media