ClearSight Video and Audio Quality Evaluation Seminar

--Triple Play Analysis--

ClearSight Networks, Inc.

ClearSight Networks, Inc.

Sehedule

10:00 - 10:20 　 ClearSight Analyzer ・ ClearSight Networks Overview・ 　 Product Overview

10:20 – 10:45 Audio and Video quality measurement　・ Audio quality measurement　・　 Video quality measurement　・ MDI and VQFactor　

10:45 - 11:30 Audio/Video in actual environment 　　　　　　　

　　　　　　　 ClearSight Analyzer measures audio/video quality when connection fault (delay, packet loss) occurs.

11:30 - 11:45 　 IPTV analysis method11:45 - 12:00 Question and Answer

At the Seminar Start (background)

You have not established the method to evaluate video quality

Video service has begun IPTV, VOD and TV meeting, [sekiyuriitei] supervisory camera

......

It is necessary to analyze audio and video simultaneously. Video data record needs large storage HDD Long time monitor is needed when there is intermittent fault.

It is difficult to troubleshooting

ClearSight Networks and Analyzer

ClearSight Introduction

ClearSight Networks, Inc.

Start 　　 2002Location 　　 Fremont, CA, US

Media and Awards

Customer (in US)

Top to down Analysis Process ofClearSight Analyzer

STEP1. Classify Application

・ Top to down analysis process of ClearSight Analyzer

The number of servers, flows, problems, issues and throughput in each application

STEP2. Ladder View

・ It shows application flow ladder view between server and client.

It will show fault in red or yellow when communication error occurs.

STEP3. Decode Screen

Only the packet in ladder view will be filtered to show in Decode screen

Protocol Decode Details

STEP4. Application Content Placyback

HTTP reassemble

Audio/Video Playback

User activity and content of FTP, Telnet, E-mail, Database, VoIP application etc. can be played back.

・ Triple-Play Distribution

Step5. Report

Ration of application data, audio and video is shown in this graph. When troubleshooting, you can grasp the change of respective application distribution at a glance.

・ HTTP Report

ClearSight Product Line

ClearSight Analyzer Product Line with Triple-play

ClearSightClearSight Analyzer SeriesAnalyzer Series 10/100M10/100M Software AnalyzerSoftware Analyzer 10/100M10/100M Full Duplex Laptop AnalyzerFull Duplex Laptop Analyzer 10/100/Gigabit10/100/Gigabit Portable PC AnalyzerPortable PC Analyzer 10G10G Portable PC AnalyzerPortable PC Analyzer

ClearSight Network Time MachineClearSight Network Time Machine Ser Seriesies Rack-mountedRack-mounted PortablePortable

ClearSightClearSight Analyzer SeriesAnalyzer Series 10/100M10/100M Software VersionSoftware Version

　　 Application Drill-down Analysis

　　 Ladder view 　

　　　 Real time application flow analysis

　　 Japanese support!! 　

　　　 The user interface is intuitive and easy to know

　　 Playback 　

　　 Playing back application content from packet

　　 Sniffer, Ethereal trace file compatibility

10/100/Gigabit10/100/Gigabit Portable PC versionPortable PC version

The traffic on duplex gigabit ethernet will be separated into ChA/ChB to analyze.

Real time application flow analysis (Ladder view) can be used

10 nsec time stamp resolution

10/100M10/100M Full Duplex Laptop VersionFull Duplex Laptop Version

Bidirectional traffic on 10/100M full duplex ethernet will be separated when flowing over TAP with 2 NIC monitoring simultaneously.

The bidirectional application traffic which is taken from 2 NICs dividing into ChA/ChB can be integrated to display and analyze.

ClearSight individual real time application flow analysis (ladder view) can be used

ClearSightClearSight Analyzer SeriesAnalyzer Series10Gb Analyzer10Gb Analyzer

■Full wire-rate capture　 2GB capture capacity is available at full wire rate by using analyzer exclusive onboard memory for NIC.

■Filter Trigger　 The onboard filter trigger can be used in wire-rate environment. The trigger can be defined as Mac address, IP address or Pattern match.

■Statistic　 Number of frames, number of bytes, various environment error data, VLAN and other statistics are offered.

■The powerful ClearSight analysis function　 You can analyze captured data with ClearSight Analyzer.　 ClearSight individual Ladder view, Application playback and Triple-play analysis functions can be used.

New

ClearSight Network Time MachineClearSight Network Time Machine SeriesSeriesRack-mounted VersionRack-mounted Version

Product Name Economy(CSR-4420) Standard(CSR-4430) Premium(CSR-4431)

CPU Single 3.0 GHz Xeon Dual 3.0 GHz Xeon Dual 3.0 GHz Xeon

Memory 4 GB RAM 4 GB RAM 4 GB RAM

OS Windows Server 2003 Windows Server 2003 Windows Server 2003

Capture Filter × ○ ○

Slicing × ○ ○

Analysis Function

Post analysisPost analysis/Real-time an

alysisPost analysis/Real-time an

alysis

HDD Capacity0.7 TB （ OS and packet sto

rage 、 meta data * storage ）1.5 TB （ OS and packet stor

age 、 meta data * storage ）

3.3 TB （ packet storage ）

300 GB （ meta data * storage ）

HDD Sstructure RAID 0 RAID 0 RAID 50

Expandability - - Up to 9.9 TB

Image

ClearSight Network Time MachineClearSight Network Time Machine Series SeriesPortable VersionPortable Version

Product Name Network Time Machine Portable (CSR-4530HR)

CPU Dual-Core AMD Opteron™ Processor 2.2GHz

Memory 4 GB RAM

OS Microsoft Windows XP Professional SP2

Capture Filter ○

Slicing ○

Analysis Function Post analysis / Real time analysis

HDD Capacity・ Capture capacity: 370GB

・ OS/Statistic capacity: 100GB

HDD Structure RAID 0

Monitor port ・ 10/100/1000Base-T ×2

・ SFP connector (multi mode/single mode) ×2

Size/Weight42.7cm(W) x 29.1cm(H) x 11.2cm(D) 、 8.8Kg 　

(with tote case)

New

VoIP Audio Quality Evaluation

VoIP Ladder View

・ Ladder View Screen

Major cause audio quality decreased・ Packet loss・ Out of sequence・ Jitter・ Delay and so on

Audio quality evaluation method・ R-Value （ Max ： 93.2 ）・ MOS （ Max ： 5 ）

Audio Quality Measurement

Statistics・ RTP Statistic Screen

Alert

・ RTP related threshold

・ Alarm Indication

Call Log Browser

Report ItemCall Status

Number of Calls

Call Duration

MOS Summary

MOS Distribution

R-Value Distribution

・ Call Information

Report (Quality Report)・ Audio Quality Report for each

Call

Report (History Report)・ History Report

・ MOS Summary History Report

Audio Playback

・ ClearSight support Codecs

Video Quality Evaluation

Video Data

・ TV Meeting・ IPTV　 - IP Broadcast Service　 - VOD Service

・ Internet TV and so on

・ Packet loss-RTP-IPv6 fragment packet

・ Out of sequence・ Jitter・ Delay

Video Quality Measurement

Video Quality Measurement Statistics

・ Statisitics 　

Video Quality Measurement Methods

R-value and MOS are for Audio, what is for Video…?

• MDI （ Media Delivery Index ）　 - Stipulated by RFC4445

• VQFactor　 - ClearSight specific factor

MDI （ Media Delivery Index ）

• DF （ Delay Factor ） buffer estimationDF （ per unit time ）＝（ max （ X ） -

min （ X ）） /Media rate X=byte media rate=byte/second

• MLR （ Media Loss Rate ）MLR （ per unit time ） = （ packet loss + out

of sequence ） /elapse time

VQFactor

The VQFactor, whose highest value is 5, considers the following causes of quality deterioration.

・ Bandwidth （ Depend on Codec ）

E.g. H.263 　 Low ： 20kbps High ： 192kbpsH.264 　 Low ： 20kbps High ：

768kbpsMPEG4 Low ：　 28kbps High ：

1024kbpsMPEG2 　 Low ： 1Mbps High ：

12Mbps

・ Packet loss・ Network delay・ Jitter

Technology Comparison

VQ-Factor MDI

Passive Video Quality Y Y

Packet loss reference Y Y

Codec reference Y N

Video MOS Value Y N

Accuracy （ consideration ）

High Low

Video Quality MeasurementVQFactor and MDI Statistics 　

・ Statistics

MPEG Statistics

• MPEG Statistics– ３ -type frames

• I-frame –Image the whole screen is included • P–frame – It is estimated from the last I frame or th

e P frame • B–frame – It is estimated from the last and the nex

t I frame or the P frame

MPEG Stats

I-Frame Stat

P-Frame Stat

B-Frame Stat

Video Codec

• Codecs

– To encode and decode video steam– Individual stream bandwidth is decided by th

e using codec – Sensitivity of Jitter and Packet loss is decide

d by the codec

Video Codec

• ClearSight playback supports codecs :– H.264 (Baseline, Main, Extend)– MPEG2-TS – MPEG2 layer II – MPEG4– iLBC (internet Low Bit Rate Codec)– JPEG (411, 422, 111)– H.263 (Mode A Mode B)– ASF (Windows Media Advanced System format)

Video Quality Alarm

• Alarm– Several deterioration

causes can be set• RTP packet loss

• IPv6 fragment loss

• Out of sequence

• Jitter

• VQFactor

• MDI and so on

・ Alarm threshold setting

・ Alarm Screen

Video Quality Report• Video Quality Report

– IPTV video steam report can be editted just like VoIP quality report.

– The report is useful although faults classification is specified

・ Jitter Report・ VQFactor Report

Move connecting point

Demo Environment

Delay Generating Device Summary

■ 　 Features * Even in the emulate environment (64byte 100%), it can en

sure full wire rate capture. * Delay can be set by 1 bit （ 0.1ns ＠ 10Gbps ） * Usually we support delay from 250ms to 1s, and additional

delay can be optional. * Support various error types (Bit Error, Packet Loss, Fluctu

ation (Jitter), Order Replacement, Data Rewriting, LOS, Link Down and so on)

■ Application * Network device efficiency and function evaluation * Video transport quality verification (IPTV and streaming) * Quality verification for VoIP delay, fluctuation and packet lo

ss.

ANUE circuit fault device(Packet loss, Delay ）

SIP Server192.168.6.1

Demo Environment

Client192.168.7.2Telephone　

111

Client192.168.7.3

Telephone222ClearSight Analyzer

HUB HUB

ClearSight Measurement

Video quality problem solving steps

1. The normal standard VQFactor measured such as measuring result in lab environment

2. Measuring VQFactor at user’s place

3. Jitter, Packet loss, Delay verification• It can separate network data other than above

4. Problem Reason Investigation• Network• Video • Receive device

ClearSight Best Solution

Thank You!