Trellis - Open Networking Foundation · What is Trellis? Production-ready multi-purpose leaf-spine...
Transcript of Trellis - Open Networking Foundation · What is Trellis? Production-ready multi-purpose leaf-spine...
![Page 1: Trellis - Open Networking Foundation · What is Trellis? Production-ready multi-purpose leaf-spine fabric designed for NFV White Box Hardware Open Source Software SDN Based. Trellis](https://reader030.fdocuments.net/reader030/viewer/2022041023/5ed4880f7b07fd02f03509b4/html5/thumbnails/1.jpg)
TrellisAnOpen-Source,White-Box,SDNBasedLeaf-SpineFabric
CharlesChan,Ph.D.
![Page 2: Trellis - Open Networking Foundation · What is Trellis? Production-ready multi-purpose leaf-spine fabric designed for NFV White Box Hardware Open Source Software SDN Based. Trellis](https://reader030.fdocuments.net/reader030/viewer/2022041023/5ed4880f7b07fd02f03509b4/html5/thumbnails/2.jpg)
Outline
• WhatisTrellis?• Trellisfeatures• WhyTrellis?• Recentactivities(in2018)• Deployments&usecases• Ecosystem&roadmap
![Page 3: Trellis - Open Networking Foundation · What is Trellis? Production-ready multi-purpose leaf-spine fabric designed for NFV White Box Hardware Open Source Software SDN Based. Trellis](https://reader030.fdocuments.net/reader030/viewer/2022041023/5ed4880f7b07fd02f03509b4/html5/thumbnails/3.jpg)
WhatisTrellis?Production-readymulti-purposeleaf-spinefabricdesignedforNFV WhiteBox
Hardware
OpenSource Software
SDNBased
![Page 4: Trellis - Open Networking Foundation · What is Trellis? Production-ready multi-purpose leaf-spine fabric designed for NFV White Box Hardware Open Source Software SDN Based. Trellis](https://reader030.fdocuments.net/reader030/viewer/2022041023/5ed4880f7b07fd02f03509b4/html5/thumbnails/4.jpg)
TrellisFullTopology
FieldOffice(2ndstage) CentralOffice(1ststage)
Spine
Leaf
Spine
PairedLeaves
Quagga
UpstreamRouter
AccessDevice
DHCPServerSinglehomedhosts
DualhomedhostsMetroNetwork
![Page 5: Trellis - Open Networking Foundation · What is Trellis? Production-ready multi-purpose leaf-spine fabric designed for NFV White Box Hardware Open Source Software SDN Based. Trellis](https://reader030.fdocuments.net/reader030/viewer/2022041023/5ed4880f7b07fd02f03509b4/html5/thumbnails/5.jpg)
WayTooComplicated?
Trellissupportssimplerconfigurationstoo!
![Page 6: Trellis - Open Networking Foundation · What is Trellis? Production-ready multi-purpose leaf-spine fabric designed for NFV White Box Hardware Open Source Software SDN Based. Trellis](https://reader030.fdocuments.net/reader030/viewer/2022041023/5ed4880f7b07fd02f03509b4/html5/thumbnails/6.jpg)
SingleLeaf
![Page 7: Trellis - Open Networking Foundation · What is Trellis? Production-ready multi-purpose leaf-spine fabric designed for NFV White Box Hardware Open Source Software SDN Based. Trellis](https://reader030.fdocuments.net/reader030/viewer/2022041023/5ed4880f7b07fd02f03509b4/html5/thumbnails/7.jpg)
SingleLeafPair
![Page 8: Trellis - Open Networking Foundation · What is Trellis? Production-ready multi-purpose leaf-spine fabric designed for NFV White Box Hardware Open Source Software SDN Based. Trellis](https://reader030.fdocuments.net/reader030/viewer/2022041023/5ed4880f7b07fd02f03509b4/html5/thumbnails/8.jpg)
SingleLeafPairwithUpstream
![Page 9: Trellis - Open Networking Foundation · What is Trellis? Production-ready multi-purpose leaf-spine fabric designed for NFV White Box Hardware Open Source Software SDN Based. Trellis](https://reader030.fdocuments.net/reader030/viewer/2022041023/5ed4880f7b07fd02f03509b4/html5/thumbnails/9.jpg)
SingleStage
![Page 10: Trellis - Open Networking Foundation · What is Trellis? Production-ready multi-purpose leaf-spine fabric designed for NFV White Box Hardware Open Source Software SDN Based. Trellis](https://reader030.fdocuments.net/reader030/viewer/2022041023/5ed4880f7b07fd02f03509b4/html5/thumbnails/10.jpg)
SingleStagewithLeafPairs&Upstream
![Page 11: Trellis - Open Networking Foundation · What is Trellis? Production-ready multi-purpose leaf-spine fabric designed for NFV White Box Hardware Open Source Software SDN Based. Trellis](https://reader030.fdocuments.net/reader030/viewer/2022041023/5ed4880f7b07fd02f03509b4/html5/thumbnails/11.jpg)
TrellisinProduction
![Page 12: Trellis - Open Networking Foundation · What is Trellis? Production-ready multi-purpose leaf-spine fabric designed for NFV White Box Hardware Open Source Software SDN Based. Trellis](https://reader030.fdocuments.net/reader030/viewer/2022041023/5ed4880f7b07fd02f03509b4/html5/thumbnails/12.jpg)
TrellisFeatures● BridgingwithAccess&TrunkVLANs(withinarack)● Routing(inter-rack)
○ IPv4&IPv6UnicastroutingwithMPLSSegment-Routing○ IPv4&IPv6Multicastrouting
● Dual-homingforcompute-nodesandexternalrouters● Multi-stagefabrics(2layersofspines)● vRouter-entirefabricbehavesasasinglerouter
○ BGP(v4/v6)supportforexternalconnectivity○ Staticroutes,routeblackholing
● DHCPL3relay(v4/v6)● MPLSPseudowire● Q-in-Qtermination● T3(TrellisTroubleshootingTool),onos-diags
![Page 13: Trellis - Open Networking Foundation · What is Trellis? Production-ready multi-purpose leaf-spine fabric designed for NFV White Box Hardware Open Source Software SDN Based. Trellis](https://reader030.fdocuments.net/reader030/viewer/2022041023/5ed4880f7b07fd02f03509b4/html5/thumbnails/13.jpg)
TrellisFeatures/Bridging&Routing
Bridging
Routing
PopMPLSLabel
PushMPLSLabel
![Page 14: Trellis - Open Networking Foundation · What is Trellis? Production-ready multi-purpose leaf-spine fabric designed for NFV White Box Hardware Open Source Software SDN Based. Trellis](https://reader030.fdocuments.net/reader030/viewer/2022041023/5ed4880f7b07fd02f03509b4/html5/thumbnails/14.jpg)
TrellisFeatures/Multicast(1/3)
Single-homedsource,single-homedsink
![Page 15: Trellis - Open Networking Foundation · What is Trellis? Production-ready multi-purpose leaf-spine fabric designed for NFV White Box Hardware Open Source Software SDN Based. Trellis](https://reader030.fdocuments.net/reader030/viewer/2022041023/5ed4880f7b07fd02f03509b4/html5/thumbnails/15.jpg)
TrellisFeatures/Multicast(2/3)
Single-homedsource,dual-homedsink
![Page 16: Trellis - Open Networking Foundation · What is Trellis? Production-ready multi-purpose leaf-spine fabric designed for NFV White Box Hardware Open Source Software SDN Based. Trellis](https://reader030.fdocuments.net/reader030/viewer/2022041023/5ed4880f7b07fd02f03509b4/html5/thumbnails/16.jpg)
TrellisFeatures/Multicast(3/3)
Dual-homedsource,dual-homedsink
![Page 17: Trellis - Open Networking Foundation · What is Trellis? Production-ready multi-purpose leaf-spine fabric designed for NFV White Box Hardware Open Source Software SDN Based. Trellis](https://reader030.fdocuments.net/reader030/viewer/2022041023/5ed4880f7b07fd02f03509b4/html5/thumbnails/17.jpg)
TrellisFeatures/Dual-Homing
![Page 18: Trellis - Open Networking Foundation · What is Trellis? Production-ready multi-purpose leaf-spine fabric designed for NFV White Box Hardware Open Source Software SDN Based. Trellis](https://reader030.fdocuments.net/reader030/viewer/2022041023/5ed4880f7b07fd02f03509b4/html5/thumbnails/18.jpg)
TrellisFeatures/Dual-Homing/Failure(1/2)
Pairlinkisonlyusedtorecoverlocalfailure
![Page 19: Trellis - Open Networking Foundation · What is Trellis? Production-ready multi-purpose leaf-spine fabric designed for NFV White Box Hardware Open Source Software SDN Based. Trellis](https://reader030.fdocuments.net/reader030/viewer/2022041023/5ed4880f7b07fd02f03509b4/html5/thumbnails/19.jpg)
TrellisFeatures/Dual-Homing/Failure(2/2)
![Page 20: Trellis - Open Networking Foundation · What is Trellis? Production-ready multi-purpose leaf-spine fabric designed for NFV White Box Hardware Open Source Software SDN Based. Trellis](https://reader030.fdocuments.net/reader030/viewer/2022041023/5ed4880f7b07fd02f03509b4/html5/thumbnails/20.jpg)
TrellisFeatures/Multi-Stage
RetainMPLSLabel
PopMPLSLabel
PushMPLSLabel
![Page 21: Trellis - Open Networking Foundation · What is Trellis? Production-ready multi-purpose leaf-spine fabric designed for NFV White Box Hardware Open Source Software SDN Based. Trellis](https://reader030.fdocuments.net/reader030/viewer/2022041023/5ed4880f7b07fd02f03509b4/html5/thumbnails/21.jpg)
TrellisFeatures/vRouter
BGPv4/v6session
Dataplanetraffic
FPMOF/P4RT
![Page 22: Trellis - Open Networking Foundation · What is Trellis? Production-ready multi-purpose leaf-spine fabric designed for NFV White Box Hardware Open Source Software SDN Based. Trellis](https://reader030.fdocuments.net/reader030/viewer/2022041023/5ed4880f7b07fd02f03509b4/html5/thumbnails/22.jpg)
vRouter• Control/dataseparation• Entirefabricasabigrouter• Alsosupportsstaticroutesandrouteblackholing
![Page 23: Trellis - Open Networking Foundation · What is Trellis? Production-ready multi-purpose leaf-spine fabric designed for NFV White Box Hardware Open Source Software SDN Based. Trellis](https://reader030.fdocuments.net/reader030/viewer/2022041023/5ed4880f7b07fd02f03509b4/html5/thumbnails/23.jpg)
TrellisFeatures/DHCPL3Relay
![Page 24: Trellis - Open Networking Foundation · What is Trellis? Production-ready multi-purpose leaf-spine fabric designed for NFV White Box Hardware Open Source Software SDN Based. Trellis](https://reader030.fdocuments.net/reader030/viewer/2022041023/5ed4880f7b07fd02f03509b4/html5/thumbnails/24.jpg)
TrellisFeatures/Pseudowire
![Page 25: Trellis - Open Networking Foundation · What is Trellis? Production-ready multi-purpose leaf-spine fabric designed for NFV White Box Hardware Open Source Software SDN Based. Trellis](https://reader030.fdocuments.net/reader030/viewer/2022041023/5ed4880f7b07fd02f03509b4/html5/thumbnails/25.jpg)
TrellisFeatures/Q-in-QTermination
Double-taggedpacket
Untaggedpacket
Push/popdouble-tag
Workswithsingleswitchtoo
![Page 26: Trellis - Open Networking Foundation · What is Trellis? Production-ready multi-purpose leaf-spine fabric designed for NFV White Box Hardware Open Source Software SDN Based. Trellis](https://reader030.fdocuments.net/reader030/viewer/2022041023/5ed4880f7b07fd02f03509b4/html5/thumbnails/26.jpg)
VariousASIC/VendorSupport● BroadcomQumran,Tomahawk,Trident2switchesfromEdgeCore,QCT,
Delta,Inventec(WIP)● PreliminarysupportP4-basedTofinoswitchesfromEdgeCore,Delta,
Inventec● PreliminarysupportforMellanoxSpectrumswitches● PreliminarysupportforCaviumXpliantswitches
![Page 27: Trellis - Open Networking Foundation · What is Trellis? Production-ready multi-purpose leaf-spine fabric designed for NFV White Box Hardware Open Source Software SDN Based. Trellis](https://reader030.fdocuments.net/reader030/viewer/2022041023/5ed4880f7b07fd02f03509b4/html5/thumbnails/27.jpg)
Deployments&UseCases
• TrellisinComcast- UtilizesalmostallTrellisfeatures- TrellisisinstalledandmonitoredbyKubernetes- Integrateswithin-houseVNFs,logging,
telemetryandalarmsystems• TrellisinCORD/SEBA
- Utilizesbridging,routing,multicast,crossconnect,dualhoming
- L2loadbalance(WIP)
![Page 28: Trellis - Open Networking Foundation · What is Trellis? Production-ready multi-purpose leaf-spine fabric designed for NFV White Box Hardware Open Source Software SDN Based. Trellis](https://reader030.fdocuments.net/reader030/viewer/2022041023/5ed4880f7b07fd02f03509b4/html5/thumbnails/28.jpg)
WhyTrellis?
• TrellisisdesignedforServiceProviders&NFV
• SDNallowssimpler/easier/optimizedfeatures
• SDN+Programmablepipelines->Newfeatures
• Open-source->SPownership&customizability
![Page 29: Trellis - Open Networking Foundation · What is Trellis? Production-ready multi-purpose leaf-spine fabric designed for NFV White Box Hardware Open Source Software SDN Based. Trellis](https://reader030.fdocuments.net/reader030/viewer/2022041023/5ed4880f7b07fd02f03509b4/html5/thumbnails/29.jpg)
RecentActivities(in2018)
![Page 30: Trellis - Open Networking Foundation · What is Trellis? Production-ready multi-purpose leaf-spine fabric designed for NFV White Box Hardware Open Source Software SDN Based. Trellis](https://reader030.fdocuments.net/reader030/viewer/2022041023/5ed4880f7b07fd02f03509b4/html5/thumbnails/30.jpg)
ProductionReadiness
• SupportComcastdesign/dev/QA/opsteams-issueanalysis;root-cause;
• Recommendbest-practices/training
• Designdiscussionsfornewfeatures&architecturalimprovements
• Dailyscrum(-May‘18)• Documentation
SupportComcast
Support Otherteams
• Broadcom• Nokia• Harmonic
Deliver New
Features • Pseudowiresforin-
bandcontrol• RoutinginH-Agg
basedtopologies• Multicast
improvements• Dual-homing
improvements• DHCPv4/v6Relay• IPv6RouterAdv.• ISSUarchitectural
discussions/progress• Othersmallfeatures
ONOSStability&
Scale • Focusonstabilityof
ONOSdistributedstores(9releasesofAtomixin4months)
• Scaleinvestigationongoing
Tooling
• T3-TrellisTroubleshootingTool
• onos-diags-Diagnosticscollectiontool
• Mininetscripts-Software-emulatedtestenvironment
QA&BugFixes
• Developingautomatedfeaturetests(220newtestsinthe4months)
• Extendingframeworkforhardwarebasedtests
• 180ticketsresolved
December2017-November2018
![Page 31: Trellis - Open Networking Foundation · What is Trellis? Production-ready multi-purpose leaf-spine fabric designed for NFV White Box Hardware Open Source Software SDN Based. Trellis](https://reader030.fdocuments.net/reader030/viewer/2022041023/5ed4880f7b07fd02f03509b4/html5/thumbnails/31.jpg)
Stratum/P4Integration
Trellis
Stratum
ASIC
OFagent
ASIC
OpenFlow(OF-DPA)
ONOSNBAPI
ThinSwitch
Stratum
ASIC
ONOS
LocalCtrl
P4RuntimegNMI,gNOI
Hybrid
VNFs
VNF VNF
Server
Network Config
Pipeline Config
Controller
Switch
![Page 32: Trellis - Open Networking Foundation · What is Trellis? Production-ready multi-purpose leaf-spine fabric designed for NFV White Box Hardware Open Source Software SDN Based. Trellis](https://reader030.fdocuments.net/reader030/viewer/2022041023/5ed4880f7b07fd02f03509b4/html5/thumbnails/32.jpg)
Ecosystem&Roadmap
![Page 33: Trellis - Open Networking Foundation · What is Trellis? Production-ready multi-purpose leaf-spine fabric designed for NFV White Box Hardware Open Source Software SDN Based. Trellis](https://reader030.fdocuments.net/reader030/viewer/2022041023/5ed4880f7b07fd02f03509b4/html5/thumbnails/33.jpg)
DistributedDevOpsModel
• Reportissuesfound;~75cases• Createautomatedteststoreproduce• Validatefixes/releases• Helpwithissuesintheirsetup• Designdiscussionsfornewfeatures• Dailyscrum
• Deliverfeatures;meetopsneeds• Deliverstability,scale,perf,tools• SupportComcastdesign/dev/QAteams–issue
analysis;root-cause;recommendbest-practices/training
• Designdiscussionsfornewfeatures• Dailyscrum• Documentation
• AnalyzeissuesreportedbyHarmonicintheirsetups
• CodereviewpatchestheysubmittoONOS• Designdiscussionsfornewfeatures• BringingupONFpodhousedinSanJose
• BringingupONFpodhostedbyFlex• QAcollaboration
• Reportissuesfoundinhw• ValidateT2versionsofswitch
softwareEdgeCorebuildsforus
• Designdiscussionsforapps/featurescreatedbyNokia
• Codereviewsubmittedpatches(40changesets;4-5patchsets/change)
• Validatesomefeatures;reportissues
![Page 34: Trellis - Open Networking Foundation · What is Trellis? Production-ready multi-purpose leaf-spine fabric designed for NFV White Box Hardware Open Source Software SDN Based. Trellis](https://reader030.fdocuments.net/reader030/viewer/2022041023/5ed4880f7b07fd02f03509b4/html5/thumbnails/34.jpg)
andmore…
![Page 35: Trellis - Open Networking Foundation · What is Trellis? Production-ready multi-purpose leaf-spine fabric designed for NFV White Box Hardware Open Source Software SDN Based. Trellis](https://reader030.fdocuments.net/reader030/viewer/2022041023/5ed4880f7b07fd02f03509b4/html5/thumbnails/35.jpg)
Roadmap• Scale&Performanceimprovements• DualhomingforAccessnodes(likeOLTs)• InServiceSoftwareUpgrades(ISSU)
• Stratum/P4integration• BNGfeatures(e.g.PPPoEtermination,hierachicalQoS)• 5Guserplanefeatures
![Page 36: Trellis - Open Networking Foundation · What is Trellis? Production-ready multi-purpose leaf-spine fabric designed for NFV White Box Hardware Open Source Software SDN Based. Trellis](https://reader030.fdocuments.net/reader030/viewer/2022041023/5ed4880f7b07fd02f03509b4/html5/thumbnails/36.jpg)
Next-GenSDNDemo
OF-DPA
Stratum Stratum
Stratum
End hosts GTP traffic
Field office
Base station (emulated)
OF-DPA OF-DPA
Stratum OF-DPA
Multicast video source
Central office
Stratum OF-DPA
Trellis (Segment routing, multicast, vRouter, etc)
In-band Network Telemetry (INT)
VNF Offloading Control (S/PGW)
ONOS
P4Runtime OpenFlow
Internet
Upstream BGP routers
Mixed P4/OpenFlow multi-vendor white-
box switches Broadcom, Barefoot, Edge-
Core, Inventec, Delta
P4 SmartNIC Netcope
INT collector
Telemetry collector Barefoot DeepInsight
INT+S/PGW
INT INT
INT
INT
INT
INT reports
fabric.p4 - L2/L3/MPLS - INT - GTP termination
P4 program
netcfg - Devices - Ports - DHCP relay