Designing Triple-Play Apps Using DSP Resource BoardsDesigning Triple-Play Apps Using DSP Resource Boards

Amir ZmoraVP Marketing & Product

ManagementSurf Communication Solutions

Amir ZmoraVP Marketing & Product

ManagementSurf Communication Solutions

Agenda

• Voice and Video Market Trends• Operators Needs• Triple-Play in Action• Optimal Hardware System Architecture• Optimal Software System Architecture• Summary

Voice and Video Market Trends

Triple-Play Overview

• Currently different systems are used for each media type

o Telephone for voice (VoIP or PSTN)o Video system for video callso Data collaboration applications for data sharing

• In Triple-Play all 3 media types are combinedo Right-click on an e-mail to open a session (voice/video) with

sendero Seamlessly switch between voice-only and voice + videoo Share desktop and applications in same session o TVoIP/TVoDSL, VoD, PVR, DVR a single CPE box that will

handle all communication applications

The Drivers of Video Deployment

• Technology improvementso Better video codecs – H.263, MPEG4, H.264o Cheaper components – LCD screens, memoryo Processors are cheaper, better and require less powero Longer battery life for handheld devices

• Different networks that can now be convergedo Cellular – 3G (3G-324M)o Wireless – WiFi & WiMAX (SIP)o Wireline IP (SIP & H.323)o Wireline PSTN (H.324)

Cellular – 3G Services

• 3G is now in mass deploymento 156 commercial 3G operators in 70 countrieso 187M subscribers (CDMA & WCDMA)

• Source www.3gtoday.com July 2005

• Video streamingo V-Live of NTT DoCoMo – Real-Time TVo Video on demando Home/Business/Homeland security – Video surveillance

• Messaging & Presenceo IM, MMS, Video mail, PoCo Presence – Online/offline plus available for service X with

person Y

Cellular – 3G Services

• Conversational Multimediao Video Telephonyo PoC – Half-duplex communication

(Push-to-Talk, Show, View)

• Online multi-participant gameso Combine with Video to other partieso Combine with PoC

Wireless IP - WiFi & WiMAX

• WiFi (and WiMAX, in the future) will be integrated into mobile devices

• A mobile device will roam seamlessly between networkso In the office – Use WiFi as a terminal in office PBXo In the city – Use WiMAX if available for higher

bandwidth at lower priceo On the go – Use 3G cellular network

• Hence all services in cellular network will need to be available also in Wireless

Wireline IP

• Video is mainly used today in room systems with H.323 or ISDN BUT…

• Video is getting into the home and on the desktopo MSN Messengero Many SIP Video clientso STB (Set-top Boxes) with Video clients

• Both Siemens and Samsung showed this direction at Supercomm 2004

• D-Link i2eye has this product for more than a year - http://www.dlink.com/products/?pid=293

• Leadtek has IP, ISDN & PSTN Video phones http://www.leadtek.com/videophone.html

Wireline PSTN

• PSTN Video phones using H.324 have existed for years

o They had low Video qualityo They were expensive

• With the technology improvements these 2 issues have been solved

• Amstrad announced in September availability of its PSTN E3 Video Phone

• Service experiencing rapid deployment in Italy (HiTel and other phones)

Voice and Video Market Trends• Current deployment of Video is mainly in the

Enterprise & 3G Mobile segments• Deployment of Video over broadband and PSTN is

ramping up • Deployment facts

o NTT DoCoMo: Over 12.8M subscribers (May 2005)o Hutchison 3G: Over 8M subscribers (March 2005)o Skype to add Video (announced Oct 2004)o Vonage to add Video (announced Dec 2004)o 8x8 already provides Video (since June 2004)o VoicePulse to add Video (planned for H2/2005)o Video over PSTN in Italy, UK and other countries

Operators Needs

Operators Needs

• Connectivity between the different networks• Cross-networks services

o Voice/Video mailo Video portalo Multimedia servero Recording

• All applications must support packet-to-packet, TDM-to-packet, TDM-to-TDM

Operators Needs cont’d

• Since Video deployment demands are still relatively small compared to Voice deployment, flexible channel type assignment is required

• Price, Price, Price!o Smooth and flexible migration from Voice

systems to Voice and Video systemso Simple, synchronized, and balanced systems

DSP Farms:Moving from PTMC to AMC

PTMC AMC

PCI PCI Express

MII GB Ethernet

TDM Rapid I/O

Non hot swap Hot swap

Up to 15 Watt Up to 30 Watt

No defined control mechanism

Well-defined control mechanism in spec

Megs of traffic

10s of Megs in back plane

Gigs of traffic

10 Gig per AMC in back plane

Not ready for

new powerful

DSPs

Ready for

new powerful

DSPs

Voice & Video Gateway

DSPC64x

Host

Video Processing:Resolution Frame Rate

Bit Rate

RTP/RTCP Jitter

ECAN Tones

Detection/ Generation

Video Encode/ Decode

Voice Encode/ Decode

Media Processing-V.17/ V.34HD

Fax-T.32/ T.38

Modem-V.92/ V.34

Transport

Signaling

TDM H.223/ H.221 IP/ UDP

H.323 SIP3G-324MPRI/ BRI CAS

Applications

Voice & Video Gateway

DSPC64x

Host

Video Processing:Resolution Frame Rate

Bit Rate

RTP/RTCP Jitter

ECAN Tones

Detection/ Generation

Video Encode/ Decode

Voice Encode/ Decode

Media Processing-V.17/ V.34HD

Fax-T.32/ T.38

Modem-V.92/ V.34

Transport

Signaling

TDM H.223/ H.221 IP/ UDP

H.323 SIP3G-324MPRI/ BRI CAS

Applications

With Partners

Triple-Play in Action

Voice & Video Gateway

IP

Mobile PSTN

H.324 Video Phone

3G-324M Video Phone

Voice & Video GW

Media processing

board

SIP Video Phone

SIP Video Phone

1. Call starts from the SIP Video Phone

H.26430 FPS

4CIF

Voice & Video Gateway

IP

Mobile PSTN

H.324 Video Phone

3G-324M Video Phone

Voice & Video GW

Media processing

board

SIP Video Phone

SIP Video Phone

2. GW application configures Media Gateway according to destination and codec properties

H.26430 FPS

4CIF

Control

Voice & Video Gateway

IP

Mobile PSTN

H.324 Video Phone

3G-324M Video Phone

Voice & Video GW

Media processing

board

SIP Video Phone

SIP Video Phone

3. Media goes directly to Media Gateway avoiding Host-DSP bottleneck

H.26430 FPS

4CIF

H.26310 FPS

CIF

MPEG410 FPSQCIF

Control

Voice/Video Gateway Application Requirements

• Interfaceso Simultaneous interfaces required: IP-IP, TDM-IP, TDM-TDMo C64x has native interfaces to IP, TDMo Each DSP has an Ethernet I/F requiring aggregation to one

IP address

• High Densityo Powerful DSPo Separate control and media patho Network aggregation is done using an IP switcho H.223 runs on DSP

• Media Processingo H.263, H.264, MPEG4o G.729, G.723, AMR…o All voice/video/fax/data media processing and stack performed on the

DSP

Voice & Video Mail – Record/Play

IP

Mobile PSTN

H.324 Video Phone

3G-324M Video Phone

Voice & Video GW

Media processing

board

SIP Video Phone

SIP Video Phone

1. SIP phone initiates a call to PSTN Video Phone. Call is routed to Voice/Video Mail.

H.26310 FPS

CIF

Voice & Video Mail – Record/Play

IP

Mobile PSTN

H.324 Video Phone

3G-324M Video Phone

Voice & Video GW

Media processing

board

SIP Video Phone

SIP Video Phone

2. Media is buffered in DSP external memory to avoid host interrupts in 10/20 ms interval, then stored on host.

H.26310 FPS

CIF

Control

H.26430 FPS

4CIF

Voice & Video Mail – Record/Play

IP

Mobile PSTN

H.324 Video Phone

3G-324M Video Phone

Voice & Video GW

Media processing

board

SIP Video Phone

SIP Video Phone

3. Voice/Video mail retrieved from mobile. Media is processed in DSP.

H.26310 FPS

CIF

Control

H.26430 FPS

4CIF

MPEG410 FPSQCIF

Messaging Application Requirements

• Interfaceso Disk Host DSP Network (Simultaneous IP/PSTN)o C64x has native interfaces to IP, TDMo Each DSP has an Ethernet I/F requiring aggregation to one

IP address• Temporary Storage

o Allows keeping commonly-used messages in memory (IVR)o Allows buffering to avoid host interrupts in 10/20ms

intervals (voice block size)• High Density

o Powerful DSPo Separate control and media patho Network aggregation is done using an IP switcho H.223 runs on DSP

Messaging Application Requirements

• Media Processingo H.263, H.264, MPEG4o G.729, G.723, AMR…o All voice/video/fax/data media processing and

stack performed on the DSP

• Transporto Reliable Host-DSP over UDP (“TCP light”)

Voice & Video Conferencing

IP

Mobile PSTN

H.324 Video Phone

3G-324M Video Phone

Voice & Video GW

Media processing

board

SIP Video Phone

SIP Video Phone

1. Each party in the conference calls in. Different protocols and media properties are supported.

H.26310 FPS

CIF

H.26430 FPS

4CIF

MPEG410 FPSQCIF

Voice & Video Conferencing

IP

Mobile PSTN

H.324 Video Phone

3G-324M Video Phone

Voice & Video GW

Media processing

board

SIP Video Phone

SIP Video Phone

2. DSP is configured to create a channel for each voice/video party.

H.26310 FPS

CIF

Control

H.26430 FPS

4CIF

MPEG410 FPSQCIF

Voice & Video Conferencing

IP

Mobile PSTN

H.324 Video Phone

3G-324M Video Phone

Voice & Video GW

Media processing

board

SIP Video Phone

SIP Video Phone

3. An output channel is created for each party that requires voice/video/H.223/RTP processing.

H.26310 FPS

CIF

Control

H.26430 FPS

4CIF

MPEG410 FPSQCIF

Voice/Video Conferencing Application Requirements

• Interfaceso Simultaneous interfaces required: IP-IP, TDM-IP, TDM-TDMo C64x has native interfaces to IP, TDMo Each DSP has an Ethernet I/F requiring aggregation to one

IP address

• High Densityo Powerful DSPo Separate control and media patho Network aggregation is done using an IP switcho H.223 runs on DSP

Voice/Video Conferencing Application Requirements

• Media Processingo H.263, H.264, MPEG4o G.729, G.723, AMR…o All voice/video/fax/data media processing and

stack performed on the DSPo Voice/Video should be transmitted to each party

according to its:• Voice codec properties• Video codec properties• Transport & interface – IP/TDM (H.223)

Optimal Hardware System Architecture

Definition of Terms

• Hardware Frameworko DSPo Routing deviceo Aggregation deviceo System controller

• Software Frameworko DSP algorithmso DSP frameworko Diagnostics systemo Expert analysis system

DSP Requirements

Prerequisites:• External SD-RAM• Packet interface• High enough performance to enable video

processing• Wide range of reliable software vendors

C6412, New C64xxC6412, New C64xx

Interface between DSP and Network Aggregation Unit

• With a Host Port Interface (HPI, PCI…), all the DSPs are connected to the same bus. A slow retrieval from one DSP can cause delay in other DSPs (the butterfly effect).

• Using an Ethernet interface, the DSPs have independent communication routes.

DSP2

DSP3

DSP1

DSP2

DSP3

DSP1

Interface between DSP and Network Aggregation Unit

Interface between Host and DSP

• A DSP with small memory needs to send/receive small chunks of data to/from the Host at a high rate. This inflicts severe stress on the Host and is particularly important for messaging solutions.

• Use DSPs with large external memory. The external memory can be used as temporary storage, enabling the Host to send/receive larger chunks of data less frequently.

Aggregation Unit Bottleneck:

Payload and Control Handling

• Network aggregation and control application compete for the same resources.

• Separate control and media paths. For example: Use IP interconnections between DSPs, Host and Network.

Optimal Software System Architecture

Optimizing the Software Framework

• Interoperability/Testing

• Open Framework

• Flexible APIs

• Remote diagnostics

Interoperability and Testing

• Solution components must be field-hardened & interoperable (signaling interop is not enough)

o Voice Codecso Video Codecso H.223/H.221o T.38o Echo Cancellero Modem

• Critical components need constant supporto Echo Cancellero Modem

• Tools needed for diagnostics extraction from deployed systems

What is an Open Framework?

• A solution that enables manufacturers to add media processing algorithms to their platforms simply and quickly o A few basic APIs to “hook” the third party algorithmo Algorithm can be

• Proprietary Voice/Video codecs• New transport protocols

• Density, performance and cost should not be compromised in order to provide an open solution.

Why Move to an Open Framework on Your DSP?

• Be ready for the “killer application”• Support for new features • Allow multiple vendors to interface with your

product technology• Differentiate your product • Reduce DSP maintenance and support fees

from your software vendor

Flexible APIs

•Full control over ALL media type parameters•Pre-set defaults•Video example

o User defined screen layouto Logo insertiono Background/Foreground manipulationo Multiple layer pictureo Any resolution supporto Cropping & resizingo Same stream can be encoded in different formats/bit

rates/resolutions simultaneously

Remote Diagnostics

• 75% of cost of solving issues in the field is related to the extraction of diagnostics

• Need to be able to extract all the necessary diagnostics

• Diagnostics should be part of the release version• Diagnostics should be enabled/disabled on a per-

service/per-DSP/per-port basis• Minimize load on network interface by sending large

packets• Predictable impact, of enabling diagnostics, on

system performance

Summary

Technical Requirements

• One media processing system for all media typeso Same HW (board & DSP) must run all media typeso Easier synchronization between Voice and Videoo More balanced systemo Less load on system bus

• Must include a robust Voice solution• Powerful DSP that can handle Voice + Video.

And: o External SD-RAMo Packet interface

Technical Requirements cont’d

• Separate media and control patho Requires TDM and IP DSP interfaceso Eliminates Host-DSP bottlenecko Reduces load on host processor

• Open Frameworko Allows legacy/proprietary algorithms to be

“plugged-in” to DSP

• High capacity DSP farm• Support latest form factors

o PTMC (cPCI) AMC (ATCA/MicroTCA)

Thank You

amir@surf-com.com