Avici TSR – An overview “True scalable routing ”

Avici Company ConfidentialArchitecture for the 21st Century Network

Avici TSR – An overview

“True scalable routing”

Avici TSR – An overview

“True scalable routing”

Ides Vanneuville

Systems Engineer - EMEA

Best generation networking

AgendaAgenda

Introduction Next (best) generation networking Software features Hardware features Summary


Who is Avici ?Who is Avici ?

M$

2 M$

4 M$

6 M$

8 M$

10 M$

12 M$

14 M$

16 M$

Q1 00 Q2 00 Q3 00 Q4 00 Q1 01

Founded: 1996 Billerica, MA

Mission: To market scalable core routers that delivers service

providers reduced capital and operational expenditures and simplified

operations without service disruptions

Public Company (Nasdaq AVCI), $ 240 million raised

400 + employees worldwide, 11 in Europe

Gained market share (in last 12 months)

2% in core router market (+1G links)

6.5% in core router market (10G links)


Customer Premise Equipment (CE)

Provider Edge (PE)

Next generation network Next generation network

Provider IP Core (P)

Optical Core

Avici

Avici

Avici

Avici


Software featuresSoftware features


About IPrioriAbout IPriori

Unicast Routing Fully featured BGP-4 Implementation

– Confederates, Route Reflectors, damping, policy, Route Redistribution, Aggregation, dynamic configuration, peer security

IGP Support IS-IS

– Level 1 and 2 support, Route Redistribution, Database overflow support, passive interface support

OSPF– Stub Area support, Virtual links, Router Summarization, Passive

Interface support, Route Redistribution

Multicast Routing PIM Sparse Intermediate Point PIM Dense/Sparse, Auto-RP, MSDP, MBGP for mcast NLRI


server-id 2 upper

hostname bay_TWO_UPPER_server

system-password 7 S9bQQdb9Sd

interface Loopback 0

ip address 6.6.6.1 255.255.255.0

no shutdown

interface Ethernet 0

ip address 10.5.222.1 255.255.0.0

no shutdown

module 1/15 4xoc3c

no shutdown

interface pos 1/15/1

ip address 1.1.1.1 255.255.255.0

crc 16

no keepalive

sonet scramble-atm

no shutdown

module 1/17 1xoc48c

no shutdown

interface pos 1/17/1

clock source internal

ip address 10.6.222.7.1 255.255.0.0

no keepalive

sonet scramble-atm

no shutdown

router ospf 100

network 10.10.10.0 0.0.0.255 area 0.0.0.0

ip route 5.5.5.0 255.255.255.0 null0ip community-list 1 deny 45940756ip community-list 1 deny 46071828ip community-list 1 deny 46006292ip as-path access-list 1 permit ^$ip as-path access-list 100 deny _1_ip as-path access-list 101 permit _65010_ip as-path access-list 286 permit _286_ip as-path access-list 286 permit _3561_ip as-path access-list 286 permit _701_route-map EBGPMAP permit 10 set local-preference 25 set metric 150route-map IBGPMAP deny 10 match as-path 100 286 route-map IBGPMAP permit 20 set community 45940837 set local-preference 80 set metric 10route-map connected-bgp permit 10 set community 45940847 set origin igproute-map static-bgp permit 10 set community 45940848 set origin igpbay 1/1logging console platform all system bgpend

router bgp 4293 bgp router-id 1.1.1.1 bgp dampening route-map 1 redistribute connected route-map connected-bgp redistribute static route-map static-bgp neighbor ebgp peer-group neighbor ebgp send-community neighbor 3.1.1.2 remote-as 200 neighbor 3.1.1.2 peer-group ebgp neighbor 3.1.1.2 timers 6 neighbor ibgp peer-group neighbor ibgp remote-as 4293 neighbor ibgp send-community neighbor ibgp route-map IBGPMAP out neighbor 1.1.1.2 remote-as 4293 neighbor 1.1.1.2 next-hop-self neighbor 1.1.1.2 route-reflector-client neighbor 1.1.1.2 timers 180 neighbor 2.1.1.2 remote-as 4293 neighbor 2.1.1.2 next-hop-self neighbor 2.1.1.2 route-reflector-client neighbor 2.1.1.2 send-community neighbor 2.1.1.2 timers 180 neighbor 2.1.1.2 route-map IBGPMAP out neighbor 10.10.10.2 remote-as 100 neighbor 10.10.10.2 timers 180

Easy Migration - Industry CLIEasy Migration - Industry CLI


Management and SecurityManagement and Security

SNMP Standard and vendor-specific MIBS RMON Events and Alarms Group 64bit counters

System event log for all events Protocol activity (tracing) Local and remote SYSLOG Log all CLI commands

Standby Route Servers Dual Servers can be deployed for additional redundancy

Traffic separation All ForMe traffic is classified into 24 application-specific queues serviced by

WRR to avoid starvation of control traffic and ensure against DoS attack Configurable for ForMe Traffic Filters Security

TACACS+ Secure Shell


Network and Traffic EngineeringNetwork and Traffic Engineering

Leverage emerging D-WDM Technology Get ahead of the serial bandwidth curve Stabilize topology Enable Rapid Provisioning Simplify the IP routing mesh Provide Protection options Provide TE network for the transport of Diff-serv traffic Enable Circuit Emulation/Private Line Service Enable 45ms restoration


OC-48c

OC-48c

OC-48c

OC-48c

10G

vOC192

!interface pos 2/29/1 no ip address no keepalive sonet scramble-atm no shutdown!interface composite-link TSR1_CL ip address 100.100.100.1 255.255.255.0 peer default ip address 100.100.100.2 member-link POS 1/22/1 member-link POS 1/37/1 member-link POS 1/39/1 member-link POS 2/29/1 no shutdown

Composite Links Composite Links

Combines up to 64 physical connections to a single logical connection

Removes serial bandwidth limitations

Granular bandwidth scaling 4-1 speed mismatch Preserves packet sequence Add/remove trunks

dynamically Recovery in 45ms Compartmentalizes link failure Routing table stability


Composite Link3 λ

Composite Link4 λ

Optical Switches

Label Switch Router

Composite Link4 λ

Composite Link3 λ

Optical Switches

Label Switch Router

TSR monitors load on composite links

If total premium traffic exceeds a limit, shifts ports from other links

• TSR signals optical switch to reassign wavelength to high traffic link

• Dynamic reallocation of total network

Composite Links & intelligent opticsComposite Links & intelligent optics

Demonstrated interoperabilityDemonstrated interoperability


SuperCOM 2001 demoSuperCOM 2001 demo


MPLS Traffic EngineeringMPLS Traffic Engineering

Ingress, Midpoint, and Egress Penultimate Hop Popping is NOT mandatory

Ingress behavior allows unparalleled tunnel scaling

Constraint Based Routing with Avici enhancements

Enhanced RSVP signaling for Label Distribution Enhanced OSPF and IS-IS to support TE LDP End to end TE instrumentation for network mngt Tight Integration with Composite Links Hardware label switching on OC-3, OC-12, OC-48,

OC-192 and Gigabit Ethernet


Traffic EngineeringTraffic Engineering

BGPSubscriber

ISP 3

SubscriberISP 2

D F

Incoming TransitTraffic

BGP

BGP

BGP

SubscriberISP 1

G

BackboneProvider

Short Cut Tunnel 2

H

I

J

Router G's Next HopFor Routes in ISP 3

Router K's NextHop For Routes inISP 1

Router E's Next HopFor Routes in ISP 2

E

B

K

C

Short Cut Tunnel 1

A

Shortest Path toISPs 1, 2, 3, and 4

INGRESSLSR

SubscriberISP 4

MRouter G's Next HopFor Routes in ISP 4

EGRESSLSR

EGRESSLSR


Optimized Path LayoutOptimized Path Layout

Intelligent MPLS Reflood Timing Improve responsiveness of Ingress path layout

Resilience Optimization Recover from MPLS failures with minimal impact to core

topology Adaptivity Optimization

Take full advantage of positive changes in the core topology Rebuild LSPs, ordered by required bandwidth

1 99% loaded, 3 sec

3 90% loaded, 20sec

4 50% loaded, 180sec

5 0% loaded, 600sec

5 sec

15 sec

100 sec

200 sec

Percentage of link loadingT = 0

2 95% loaded, 10sec

D

C

B

A

TE Reflood Timing


Integration with Composite TrunksIntegration with Composite Trunks

Subnet 1

Subnet 2

Subnet 1

Subnet 2

Compose Trunk

Higher Pre-emption value affects tunnel reroute

Re-route time affected by reservable bandwidth attribute


MPLS Fast-Reroute ProtectionMPLS Fast-Reroute Protection

A B C D E

I H G F

Router switches traffic to pre-configured backup

Allows identification of which traffic to protect

Traffic switched to backup and traffic normally on link contend for resources

using QoS – no traffic is discarded if link is not over-utilized

Works for POS and gigabit Ethernet


MPLS Fast-Reroute DraftsMPLS Fast-Reroute Drafts

draft-atlas-rsvp-local-protect-interop-01.txt (Avici) draft-swallow-rsvp-bypass-label-01.txt (Cisco) draft-gan-fast-reroute-00.txt (Juniper)

Draft Manageability Control Scalability Interoperability

Interop Local Protect Info (Availableand In-Use) & Label Info atIngress. Make-Before-Breakon Backup Assures ProtectionAlways Available.

Control Backup Paths& LSPs viaAdministrative-Colors, BW, Priorities,& Hop-Limit

Merging on Backups.Share Bandwidth withBackups. Bypass TunnelsPossible for Many Tunnels

Creates Backups withany type of Ingress.As Ingress, supportssignalling required inall drafts.

Bypass Local Protect Info (Availableand In-Use) & Label Info atIngress. Make-Before-Breakon Bypass Tunnels Only

None Bypass Tunnels Used forMany Tunnels. ShareBandwidth on SimpleBackups. Backup MergingUnspecified

Only interoperateswith itself (or Interop,depending onimplementation)

Detour None Control Backup Paths& LSPs viaAdministrative-Colors, BW, Priorities,& Hop-Limit

Merging on Backups. NoBandwidth Sharing. NoBypass Tunnels

Only interoperateswith itself (or Interop,depending onimplementation)


VPN Support: RFC 2547VPN Support: RFC 2547

VPN-P Support Support for Multi-Protocol Extensions to BGP-4 to support

route-distinguisher Compatible with Cisco, Juniper, Unisphere, Riverstone,

Alcatel, etc. Traffic Engineering/VPN tunnel integration

Provide a TE core for Virtual Private Networks

AviciTSR

PENode

PENode

OpticalSwitch

AviciTSR

OpticalSwitch

AviciTSR

AviciTSR

OpticalSwitch

OpticalSwitch

PeeringNode

PeeringNode

PeeringNode

PeeringNode

Customer Customer

Customer

Customer

Customer


QoS Functional SummaryQoS Functional Summary

Combination of WFQ, WRR, WRED and GPRA (CBR)

Programmable ASIC Pipeline Multiple hierarchy of Algorithms Many iterations per algorithm implemented Minimum packet data handling Functionality increased for Multiservice module Counters maintained per interface,VC,class traffic

management and accounting information


REG

CTL

PR

BE

Group Policer

8 Class Policer

Classifier

Fabric Queues

Direct C

onnect Fabric

8 Class RED

512 Class Shaper

Group Shaper

Group Policer CIR, limit, non-conform actions (drop, flag)

Class Policer CIR, limit, non-conform actions (drop, flag)

Classifier DS Map

Class RED minQ, drop probability, non-conform, maxQ

Class Shaper CIR, limit, weight

Group Shaper CIR

QoS Treatment per node QoS Treatment per node


MPLS TE/Composite Trunks/QoSMPLS TE/Composite Trunks/QoS

Subnet 1

Subnet 2

Subnet 1

Subnet 2

Compose Trunk

QoS operates on Diff-serv inferred MPLS exp marking

WRED discardstunnel two or

hop-by-hop trafficduring tunnel reroute


Traffic Engineering with QoSTraffic Engineering with QoS

Enables no-loss, low delay variance, low latency services

Virtual Leased Line Voice over IP Storage Area Networks

Add new properties to Service Level Agreements Improve reliability at reduced cost Deliver protection appropriate for each service, up-to

SONET APS levels Improve utilization in network backbone


Hardware featuresHardware features


The Avici Systems TSRThe Avici Systems TSR

• Carrier class features • Carrier class design• Unprecedented scaling• Future proof


Patent-pending Velociti™ FabricPatent-pending Velociti™ Fabric

Toroidal direct connect fabric Scales to 560 active modules Each element adds switching & forwarding capacity

Generation 1 - 60 Gbps Generation 2 - 240 Gbps

Each module connects to6 other modules

Path diversity through fabric Resilient Non-blocking


Growing the TSR SystemGrowing the TSR System

Expanding the interconnect Two physical backplanes in each bay

Connected top-to-bottom Connected side-to-side Connected over-the-top

Power Distribution -48VDC 60A per shelf redundant feed

Environment Controllers Two per bay interconnected between

bays


Avici Product ScalabilityAvici Product Scalability

6 TSR Bay2.4 Tbps

4 TSR Bay1600 Gbps

2 SSR 400 Gbps

SSR/TSR 600 Gbps

1 SSR 200 Gbps

1 TSR 400 Gbps

2 TSR 800 Gbps


TSR™ Interface ModulesTSR™ Interface Modules

Packet over SONET/SDH Concurrent IP and MPLS 1 port OC-192c/STM-64 1 port OC48c/STM-16 2 port OC48c/STM-16 4 port OC12c/STM-4 4 port OC3c/STM-1 16 port OC3c/STM-1

Ethernet 2 port GbE 8 port GbE Q2/02 10GbE 2H/02


O/EConversion

O/EConversion

SONETTermination

SONETTermination

PacketQoS

PacketQoS

MulticastExpander &

PacketScheduler

MulticastExpander &

PacketScheduler

ForwardingEngine

ForwardingEngine

Control ProcessorFE Interface


PPP/MPLSProcessingPPP/MPLSProcessing

E/OConversion

E/OConversion

SONETTermination

SONETTermination


Sw

itch

Fab

ric

BA

CK

PL

AN

E

O/EConversion

O/EConversion

Packet Memory

64 MB

Module I/O ArchitectureModule I/O Architecture


PCMCIAPCMCIA

PowerPCProcessorPowerPCProcessor

ConsoleConsole

Fast Ethernet

Fast EthernetFast

EthernetFast

Ethernet

HDD

Server Memory 320Mb

OSPF BGP4 IS-IS

MBGP PIMMSDP

RSVP CLI

SNMP

FTP



SONETTermination

SONETTermination

PacketQoS

PacketQoS

MulticastExpander &

PacketScheduler

MulticastExpander &

PacketScheduler

ForwardingEngine

ForwardingEngine




E/OConversion

E/OConversion

SONETTermination

SONETTermination


Sw

itch

Fab

ric

O/EConversion

O/EConversion SONET

TerminationSONET

Termination

PacketQoS

PacketQoS

MulticastExpander &

PacketScheduler

MulticastExpander &

PacketScheduler

ForwardingEngine

ForwardingEngine




E/OConversion

E/OConversion

SONETTermination

SONETTermination


Sw

itch

Fab

ric

O/EConversion

O/EConversion SONET

TerminationSONET

Termination

PacketQoS

PacketQoS

MulticastExpander &

PacketScheduler

MulticastExpander &

PacketScheduler

ForwardingEngine

ForwardingEngine




E/OConversion

E/OConversion

SONETTermination

SONETTermination


Sw

itch

Fab

ric

O/EConversion

O/EConversion

Bay & Environment Controller

Bay & Environment Controller

Routing and Configuration

tasks

Forwarding and Fabric

Routing tasks

PCMCIAPCMCIA

PowerPCProcessorPowerPCProcessor

ConsoleConsole

Fast Ethernet

Fast EthernetFast

EthernetFast

Ethernet

SSD

Server Memory 580Mb

OSPF BGP4 IS-IS

MBGP PIMMSDP

RSVP CLI

SNMP

FTP



SONETTermination

SONETTermination

PacketQoS

PacketQoS

MulticastExpander &

PacketScheduler

MulticastExpander &

PacketScheduler

ForwardingEngine

ForwardingEngine

Control ProcessorServer InterconnectControl Processor

Server Interconnect


E/OConversion

E/OConversion

SONETTermination

SONETTermination


Sw

itch

Fab

ric

O/EConversion

O/EConversion

Packet Memory

64 Mb

ModuleControl Software

Software & System ArchitectureSoftware & System Architecture


Field proven operationField proven operation

First systems deployed in NTON (DARPA Supercomputer research network)

Operational in the Internet in May 1999 (BGP)

Currently deployed in one of the worlds largest carrier IP networks

Support OC-192 links Operating as BGP Route Reflector in one of the

worlds largest RR configurations


AT&T networkAT&T network


SummarySummary


Summary - Carrier imperativesSummary - Carrier imperatives

Cost Lower the cost of building and operating the network

Velocity Decrease the time to add or change services

Profit Deliver value added services and quality of service

enhancements


Lower Operational CostsLower Operational Costs

Backbone Interfaces

Customer Facing Interfaces

Low Speed (electrical) High Speed(Optical)

Backbone Interfaces

Customer Facing Interfaces

Low Speed (electrical)

IP VPN / Low Speed Transit

High Speed(Optical)

IP Transit

VS.VS.

Current best practiceCurrent best practice Avici alternativeAvici alternative


Provisioning - Months to MinutesProvisioning - Months to Minutes

Backbone capacity increased without truck-rolls Market share not impacted by provisioning Immediate provisioning for all bandwidth products up-to

physical network capacity

10λ

6λ

14λ

Immediate fulfillment of customer demandsImmediate fulfillment of customer demands


Velocity – Composite LinksVelocity – Composite Links

Avoid hitting the transmission capacity wall Backbone links with 64 times the capacity of our

competitor on the same transmission network No impact to customer or network stability

Backbone Capacity added in days not months Backbone Capacity added in days not months


ProfitProfit

Use IP core for converging all services Scale services past competitors offerings Spend your time creating new services…

Make €€€€ at the edge of the network Save €€€€ at the core of the network


ConclusionConclusion

Next generation public network switch Scalability Non-stop system and software architecture Quality of Service Network and Traffic Engineering

Benefits Reduce capital costs Stable service velocity Increased equipment life cycle

Faster, stable network expansion & dramatic reduction in cost per bit delivered


Thank YouThank You

Avici TSR – An overview “True scalable routing ”

Documents

Transcript of Avici TSR – An overview “True scalable routing ”