22

AgendaAgenda

System OverviewSystem Overview

Management FoundationManagement Foundation

Software ArchitectureSoftware Architecture

Testing with Network Measurement SystemTesting with Network Measurement System

Summary and Future WorkSummary and Future Work

33

System OverviewSystem Overview

Measurement Measurement ApplicationsApplications

Vendor specific applications Vendor specific applications for specific platformsfor specific platforms

Not all applications are QoS Not all applications are QoS capablecapable

Some require complex Some require complex commands, scripts, commands, scripts, procedural stepsprocedural steps

Manual measurement control Manual measurement control (especially on different tools)(especially on different tools)

Additional software and Additional software and computations to obtain computations to obtain targeted resultstargeted results

Tested NetworkTested Network

44

Tested NetworkTested Network

System OverviewSystem OverviewOur SolutionOur Solution Two Linux-based Two Linux-based

ApplicationsApplications

Network Network Measurement Measurement SystemSystem

Management Management ConsoleConsole

Measurement Measurement AgentsAgents

Straight-forward user Straight-forward user interfaceinterface

InfrastructureInfrastructure

ConsoleConsole

User focuses on scenarios, User focuses on scenarios, topology, test objectivestopology, test objectives

Management StationManagement Station

Runtime operations Runtime operations performed by the computerperformed by the computer

Measured QoS parameters Measured QoS parameters available automaticallyavailable automatically

Software module used by Software module used by both applicationsboth applications

Measurement information Measurement information communicationcommunication

Accomplish the task using Accomplish the task using a management protocola management protocol

55

Management FoundationManagement Foundation

NMS NMS ManagementManagement

Structural LogicStructural Logic

The user interacts with these The user interacts with these items to perform a items to perform a measurementmeasurement

Organizes measurement Organizes measurement operations as a set of operations as a set of abstract itemsabstract items

SessionsSessions

GroupsGroups

TasksTasks

Management MessagesManagement MessagesIdentification messages relay information about Identification messages relay information about agents’ capabilitiesagents’ capabilitiesTask control messages request agents to start a Task control messages request agents to start a measurement taskmeasurement taskData messages are used to collect QoS results Data messages are used to collect QoS results from a set of agentsfrom a set of agents

66

Structural LogicStructural LogicThe fundamental QoS measurement scenarioThe fundamental QoS measurement scenario

A data structure comprising the agents and A data structure comprising the agents and parameters used in the QoS testparameters used in the QoS test

Reusability: can be saved and later loadedReusability: can be saved and later loaded

Several sessions mapped with one referenceSeveral sessions mapped with one reference

Contain unrelated sessions distributed in timeContain unrelated sessions distributed in time

Based on a single session with a variable Based on a single session with a variable parameterparameter

A session or a group to be executedA session or a group to be executed

The start time can be user-definedThe start time can be user-defined

The execution process done entirely by the The execution process done entirely by the management softwaremanagement software

77

Defining SessionsDefining SessionsDefining SessionsDefining Sessions

Structural LogicStructural LogicAgent (s) involvedAgent (s) involvedGeneration / AnalysisGeneration / AnalysisTraffic typeTraffic typePacket distributionPacket distributionProtocol specificProtocol specificDesired resultsDesired results

Session 1Session 1Agent 1 Agent 1 ►► Agent 3 Agent 3

Session 2Session 2Agent 2 Agent 2 ►► Agent 4 Agent 4

Agent 1Agent 1

Agent 2Agent 2Agent 3Agent 3

Agent 4Agent 4

Task 1Task 1Session 2Session 2 @ 1 o’clock @ 1 o’clock

Task 2Task 2

Session 1Session 1 @ 3 o’clock @ 3 o’clock

(pending)(pending)

(pending)(pending)

(running)(running)(finished)(finished)

(running)(running)

QoS

Par

amet

erQ

oS P

aram

eter

TimeTime

Management StationManagement Station

Scheduling and Running TasksScheduling and Running TasksScheduling and Running TasksScheduling and Running Tasks

CollectingCollectingResultsResultsCollectingCollectingResultsResults

88

Management MessagesManagement Messages

Access ProceduresAccess Procedures

Set RequestSet Request

Request ResponseRequest Response

Get RequestGet Request

Request ResponseRequest Response

Get RequestGet Request

ResponseResponse

Structure of Management Structure of Management InformationInformation

isoisoisoiso

orgorgorgorg

doddoddoddod

internetinternetinternetinternet

experimentalexperimentalexperimentalexperimental

11

33

66

11

33

connectionconnectionconnectionconnection

systemsystemsystemsystem

traffictraffictraffictraffic

advancedadvancedadvancedadvanced

11

22

33

44

Object ClassesObject Classes

The management infrastructure uses the The management infrastructure uses the Simple Network Management ProtocolSimple Network Management Protocol

Management Management StationStation AgentAgent

99

Software ArchitectureSoftware ArchitectureMeasurement Measurement ServicesServices

Communication Communication ServicesServices

Management Management ConsoleConsole

Management Management ConsoleConsole

Measurement Measurement AgentAgent

User User InterfaceInterface

User User InterfaceInterface

Session Session ManagerManager

Queuing Queuing ServiceService

SNMP SNMP ServiceServiceSNMP SNMP ServiceService

Management Management ServiceService

Management console’s QoS Management console’s QoS measurement intelligencemeasurement intelligence

Enables user control through various Enables user control through various windows and dialogswindows and dialogsAllows creation of measurement Allows creation of measurement sessions, groups and taskssessions, groups and tasks

Runs the measurement task; collects Runs the measurement task; collects and stores resultsand stores results

Synchronous service for asynchronous Synchronous service for asynchronous messagesmessagesMessage retransmissions, duplicates Message retransmissions, duplicates deletion, timeoutdeletion, timeout

Encapsulation of messages to SNMP Encapsulation of messages to SNMP PDUsPDUsSNMP data verification, buffer overflow SNMP data verification, buffer overflow checking checking

A thread for each assigned local A thread for each assigned local network interfacenetwork interfaceSocket I/O operations with SNMP dataSocket I/O operations with SNMP data

1010

Session ManagerSession ManagerSession ManagerSession Manager

Management ConsoleManagement ConsoleThe primary application that enables the users The primary application that enables the users

to perform QoS measurementsto perform QoS measurements

GUIGUIGUIGUITask SchedulingTask SchedulingTask SchedulingTask Scheduling

Queuing ServiceQueuing ServiceQueuing ServiceQueuing Service

SNMP ServiceSNMP ServiceSNMP ServiceSNMP Service Management Management ServiceService

Management Management ServiceService

Service Control ManagerService Control ManagerService Control ManagerService Control Manager

Configuration ServiceConfiguration ServiceConfiguration ServiceConfiguration Service

Har

dwar

e M

anag

erH

ardw

are

Man

ager

Har

dwar

e M

anag

erH

ardw

are

Man

ager

Message Message WrapperWrapperMessage Message WrapperWrapper

1111

Running Core ServicesRunning Core Services

I want to schedule my I want to schedule my first measurement first measurement task using task using Agent 1Agent 1

I want to schedule my I want to schedule my first measurement first measurement task using task using Agent 1Agent 1

GUIGUI Session ManagerSession Manager

TaskTask

PendingPendingRunningRunning

OutboundOutbound

InboundInbound

Level 1Level 2

Level 3Level 4

Level 1Level 2

Level 3Level 4

MessageMessage MessageMessageMessageMessageMessageMessage MessageMessage

ACKACK

MessageMessageMessageMessage

Queuing ServiceQueuing Service

Management ServiceManagement Service

MessageMessage

SNMP ServiceSNMP Service

222200001111

SNMPSNMP

1212

Testing with NMSTesting with NMS

Installation & Installation & ConfigurationConfiguration WizardsWizardsWizardsWizards

DialogsDialogsDialogsDialogs

StartupStartupStartupStartup

AdvancedAdvancedAdvancedAdvanced

ConfigurationConfigurationServiceServiceConfigurationConfigurationServiceService

TopologyTopologyTopologyTopology

IdentificationIdentificationIdentificationIdentification

NetworkNetworkNetworkNetwork

ManagementManagementManagementManagement

SecuritySecuritySecuritySecurity

FilesFilesFilesFiles

ResponsivenessResponsivenessResponsivenessResponsiveness

Queuing PoliciesQueuing PoliciesQueuing PoliciesQueuing Policies

TimeoutsTimeoutsTimeoutsTimeouts

Agent Registration Agent Registration Agent Registration Agent Registration

Agent ReleaseAgent ReleaseAgent ReleaseAgent Release

1313

New Scheduled Task DialogNew Scheduled Task Dialog

New Session Group DialogNew Session Group Dialog

Create New Session WizardCreate New Session Wizard

Setting Up MeasurementsSetting Up Measurements

PrerequisitesPrerequisites

Startup configuration setStartup configuration setAt least one agent registeredAt least one agent registeredDefault or custom advanced Default or custom advanced configurationconfiguration

Create a measurement sessionCreate a measurement sessionSpecify session parametersSpecify session parameters

Session is saved but not executedSession is saved but not executed

Running multiple session at onceRunning multiple session at onceGroup of independent sessionsGroup of independent sessions

Parametric groupParametric groupCreate a new pending taskCreate a new pending taskSession Manager is now in chargeSession Manager is now in charge

Task may be deleted while pendingTask may be deleted while pending

1414

Data AvailabilityData AvailabilityD

epen

denc

ies

Dep

ende

ncie

s

Task TypeTask TypeTask TypeTask Type

Session Session TypeType

Session Session TypeType

SingleSingleSingleSingle

GroupGroupGroupGroup

GenerateGenerateGenerateGenerate

AnalyzeAnalyzeAnalyzeAnalyze

BothBothBothBoth

SummarySummarySummarySummary

Last DataLast DataLast DataLast Data

At a glanceAt a glanceAt a glanceAt a glance

TimeTimeTimeTime

Dat

a F

orm

attin

gD

ata

For

mat

ting

ParametricParametricParametricParametric

TableTableTableTable

PlotPlotPlotPlot

1515

Custom ScenarioCustom Scenario

Management Management StationStation

Cisco Catalyst Cisco Catalyst 29502950

AgentAgent

1Gpbs 1Gpbs SysKonnect SysKonnect

Measurement Measurement Endace DAGEndace DAG

AgentAgent

ObjectivesObjectivesSysKonnect system performanceSysKonnect system performance

ThroughputThroughput

Packet delay variationPacket delay variation

Packet lossPacket loss

1000 Base SX1000 Base SX

ParametersParametersFrame rate: 200 to 100,000 ppsFrame rate: 200 to 100,000 pps

Frame size: 1500 bytesFrame size: 1500 bytes

Test duration: 100 secondsTest duration: 100 seconds

Packet distribution: periodicPacket distribution: periodic

1616

Scenario ResultsScenario ResultsSeries of tests vs. packet rate at 1500 byte framesSeries of tests vs. packet rate at 1500 byte frames

0

1

2

3

4

5

6

7

0 20 40 60 80 100Packet Rate [103 pps]

Num

ber

of P

acke

ts [1

06 p

acke

ts]

Tx Packets

Rx Packets

0

1

2

3

4

5

6

7

0 20 40 60 80 100Packet Rate [103 pps]

Num

ber

of P

acke

ts [1

06 p

acke

ts]

Tx Packets

Rx Packets

Packet countPacket count

ThroughputThroughput

Delay variationDelay variation

Packet loss ratioPacket loss ratio

6 million packets 6 million packets per 100 seconds per 100 seconds testtest

0

100

200

300

400

500

600

700

800

0 20 40 60 80 100Packet Rate [103 pps]

Th

rou

ghpu

t [M

bps]

Throughput (Mbps)0

100

200

300

400

500

600

700

800

0 20 40 60 80 100Packet Rate [103 pps]

Th

rou

ghpu

t [M

bps]

Throughput (Mbps)

Almost 700 Almost 700 MbpsMbps

-5

-4

-3

-2

-1

0

1

2

3

4

5

0 20 40 60 80 100

Packet Rate [103 pps]

De

lay

[ms]

Avg Delay Variation (ms)

Min Delay Variation (ms)

Max Delay Variation (ms)

-5

-4

-3

-2

-1

0

1

2

3

4

5

0 20 40 60 80 100

Packet Rate [103 pps]

De

lay

[ms]

Avg Delay Variation (ms)

Min Delay Variation (ms)

Max Delay Variation (ms)

Up to 4 Up to 4 millisecondsmilliseconds

-1

0

1

2

3

4

5

6

7

0 20 40 60 80 100

Packet rate [103 pps]

Pa

cke

t Lo

ss R

atio

[%]

Packet Loss Ratio (%)

-1

0

1

2

3

4

5

6

7

0 20 40 60 80 100

Packet rate [103 pps]

Pa

cke

t Lo

ss R

atio

[%]

Packet Loss Ratio (%)

Up to 6.5 percentUp to 6.5 percent

Real-time failureReal-time failure

-1

0

1

2

3

4

5

6

0 20 40 60 80 100

Packet Rate [106 pps]

Re

al-t

ime

Fa

ilure

s [1

06 tim

es]

Real-time Failure(times)

-1

0

1

2

3

4

5

6

0 20 40 60 80 100

Packet Rate [106 pps]

Re

al-t

ime

Fa

ilure

s [1

06 tim

es]

Real-time Failure(times)

1717

Summary and Future WorkSummary and Future Work

Faster experiment setup and results processingFaster experiment setup and results processingAdvantagesAdvantages

No human attendance during testing requiredNo human attendance during testing required

Extra features to make network testing easier to performExtra features to make network testing easier to perform

User focuses on experiment target rather on implementationUser focuses on experiment target rather on implementation

Greater availability of data after a test is completedGreater availability of data after a test is completed

Not fully portable on all existing Linux-based platformsNot fully portable on all existing Linux-based platforms

Not optimized for local resources usageNot optimized for local resources usage

Does not implement a fine-grained analysis to conserve Does not implement a fine-grained analysis to conserve management bandwidthmanagement bandwidth

DrawbacksDrawbacks

Future WorkFuture Work

Extend support for other management protocolsExtend support for other management protocols

Improve communication control procedures Improve communication control procedures between management console and agentsbetween management console and agents

Include support for other networking technologiesInclude support for other networking technologies

1818

Thank YouThank You

© MMVI Alex Bikfalvi© MMVI Alex BikfalviThis presentation is for informational purposes only. There are no warranties, expressed or implied, in this summary.This presentation is for informational purposes only. There are no warranties, expressed or implied, in this summary.