Fusion Applications Bare Metal Provisioning - Lessons Learned
DESIGN OF BARE METAL FABRICS - Built with SDN, Bare Metal Switches, and Merchant Silicon
20
-
Upload
open-networking-summits -
Category
Technology
-
view
105 -
download
2
Transcript of DESIGN OF BARE METAL FABRICS - Built with SDN, Bare Metal Switches, and Merchant Silicon
Built with SDN, Bare Metal Switches, and
Merchant Silicon
DESIGN OF BARE METAL FABRICS
Rob Sherwood Open Networking Summit 2014
Application Plane
Control Plane
Data Plane
Switch Light for Linux Switch Light for Broadcom
Big Virtual Switch
Big Network Controller
THIS YEAR: SDN FABRICS ON BARE METAL
• Big Switch’s Core Technologies
• SDN: control separated from data plane: centralized, automated
• Switch Light: own both the Controller and Switch software stacks
• Commodity Hardware: low-cost hardware and merchant silicon
• Open: APIs, source, protocols
• Fabric data plane: unified L2/L3 multipath, active/active design
• Live Demonstration:
• Resilient under systemic failure
© 2 0 1 4 B I G S W I T C H N E T W ORK S , I N C . W W W . BI G S W I T C H . C OM 3
New
WHAT’S INSIDE A SWITCH?
© 2 0 1 3 B I G S W I T C H N E T W ORK S , I N C . W W W . BI G S W I T C H . C OM 4
Application
Network OS
Hardware Driver
Box
Silicon
COMPONENT ECOSYSTEM AND BARE METAL
© 2 0 1 3 B I G S W I T C H N E T W ORK S , I N C . W W W . BI G S W I T C H . C OM 5
Application
Network OS
Driver
Box
Silicon
Single Vendor Closed
Product
Traditional Networking
(past)
Single Vendor Closed
Product
Traditional Networking
(today)
ODM Chip
ODM Box
SDN Controller
Vendor
OpenFlow Model
SDN Hardware
Vendor
OpenFlow
Traditional Network Stack/OS
Vendor
ODM Chip
Bare Metal Vision
ODM Box
SWITCH LIGHT IS SDN ON BARE METAL
• The OpenFlow Ecosystem Model didn’t work for us
• Hard: one OF agent that is all things to all people
• OF Wire protocol is (mostly) fine, but needs work for existing hardware
• Economic incentives are backwards for SDN hardware vendors
• Out-of-phase release cycles caused low feature velocity
• Switch Light Model: download OS image and OF agent from Controller
• Easy : Customize switch software to application and controller version
• Add extensions to wire protocol to validate before standardization
• Perfect economic incentives
• One engineering team high feature velocity
© 2 0 1 3 B I G S W I T C H N E T W ORK S , I N C . W W W . BI G S W I T C H . C OM 6
BARE METAL + MERCHANT SI: LOWERS FABRIC COSTS
• Brand name network vendors are using the same components
• “Bare metal” is more than “white box”
• Name brand vs. no-name vendors
• Buy your network hardware just like servers
• Vendors already successful in the server model have advantage
© 2 0 1 4 B I G S W I T C H N E T W ORK S , I N C . W W W . BI G S W I T C H . C OM 7
Business Agility is
Increased Revenue
Financial Benefit of
SDN Reduced
OpEx Reduced CapEx
CapEx Savings is Not Trivial
ARCHITECTURE IS OPEN FROM THE DATA PLANE UP
• Open data plane
• Re-use existing virtualization formats: no proprietary protocols/new hardware
• Compatible: deployed firewalls, IDS, WAN accelerators, Server offload NICs
• Open control plane
• OF1.3: All extensions are open source and will be taken to ONF
• Open REST APIs is primary interface: CLI is just a REST client
• Integration with OpenStack/Quantum and custom BSS/OSS systems
• Open source components: software engineering best practice
• Accelerates adoption, eases porting
• Open Network Linux: bare metal Linux distribution in OCP
• Indigo Open Flow agent: many 3rd parties have ported to their hardware
© 2 0 1 4 B I G S W I T C H N E T W ORK S , I N C . W W W . BI G S W I T C H . C OM 8
THIS YEAR: SDN FABRICS ON BARE METAL
• Big Switch’s Core Technologies
• SDN: control separated from data plane: centralized, automated
• Switch Light: own both the Controller and Switch software stacks
• Commodity Hardware: low-cost hardware and merchant silicon
• Open: APIs, source, protocols
• Fabric data plane: unified L2/L3 multipath, active/active design
• Live Demonstration:
• Resilient under systemic failure
© 2 0 1 4 B I G S W I T C H N E T W ORK S , I N C . W W W . BI G S W I T C H . C OM 9
New
1
2
3
4
5
6
1 2 3 4 5 6
WHAT’S A FABRIC?
© 2 0 1 4 B I G S W I T C H N E T W ORK S , I N C . W W W . BI G S W I T C H . C OM 10
Chassis-based Fabric
Fab
ric
Bac
kpla
ne
Supervisor 2
Line Card
Line Card
Line Card
Line Card
Line Card
Supervisor 1
Spin
e Le
af
Spin
e
Spin
e
Leaf
Le
af
Leaf
Leaf-Spine Fabric
Controller 2
Controller 1
FABRIC USE-CASE (1/3): CONNECTIVITY, POLICY
© 2 0 1 4 B I G S W I T C H N E T W ORK S , I N C . W W W . BI G S W I T C H . C OM 11
Spin
e Le
af
Spin
e
Spin
e
Leaf
Le
af
Leaf
Server
Server
Server
Server
Server
Server
Router
Router
• Most common fabric use-case
• Policy: connectivity, ACLs, QoS • Optional VM orchestration
• e.g., OpenStack, HyperV
Existing Production
Network
FABRIC USE-CASE (2/3): MONITORING
© 2 0 1 4 B I G S W I T C H N E T W ORK S , I N C . W W W . BI G S W I T C H . C OM 12
Spin
e Le
af
Spin
e
Spin
e
Leaf
Le
af
Leaf
IDS
VoIP QoS Tool
• BigTap: Scale-out monitoring • Monitoring “as a Service”
• Programmable via REST • RBAC • Overlapping policy support
• Physically isolated from prod • In/out heavily over-subscribed
• Load balance across tools • “My first SDN App”
Tap Traffic
FABRIC USE-CASE (3/3): PATCH PANEL
© 2 0 1 4 B I G S W I T C H N E T W ORK S , I N C . W W W . BI G S W I T C H . C OM 13
Spin
e Le
af
Spin
e
Spin
e
Leaf
Le
af
Leaf
Packet Generator
Packet Generator
• Programmatically create large virtual L1 topologies
• Automate complex tests without rewiring
• Blindly forward packets by port • Similar to Pseudo-wire • Even CRC failures, runts, etc.
• Non-product: in our Q/A labs
DUT
DUT
DUT
DUT
DUT
DUT
*DUT: Device Under Test
THIS YEAR: SDN FABRICS ON BARE METAL
• Big Switch’s Core Technologies
• SDN: control separated from data plane: centralized, automated
• Switch Light: own both the Controller and Switch software stacks
• Commodity Hardware: low-cost hardware and merchant silicon
• Open: APIs, source, protocols
• Fabric data plane: unified L2/L3 multipath, active/active design
• Live Demonstration:
• Resilient under systemic failure
© 2 0 1 4 B I G S W I T C H N E T W ORK S , I N C . W W W . BI G S W I T C H . C OM 14
New
DEMO: RESILIENCY UNDER SYSTEMIC FAILURES
© 2 0 1 4 B I G S W I T C H N E T W ORK S , I N C . W W W . BI G S W I T C H . C OM 15
Leaf 1 Leaf 2
Spine 1 Spine 2
Traffic Generator
Primary Controller
Backup Controller
1
2
3 4
5
CONCLUSION
• Big Switch has a common architecture for its products
• Based on SDN, Switch Light, Open, and Merchant Silicon
• Fabric technology common across applications
• Stepping back a bit: Industry is maturing
• Storage+Network+Compute convergence means new players
• Bare metal means less vertical integration, more competition
• Reality: hardware has already commoditized
• Every major vendor is shipping products on Broadcom Trident+/Trident2
• Price war has already started: seeing less than $100/10G port
• Claim: Value will move up the stack in to software
© 2 0 1 4 B I G S W I T C H N E T W ORK S , I N C . W W W . BI G S W I T C H . C OM 16
THANKS!
© 2 0 1 4 B I G S W I T C H N E T W ORK S , I N C . W W W . BI G S W I T C H . C OM 17
CLAIM: SDN SCALES BETTER THAN DISTRIBUTED NETWORKS
History teaches us that hierarchies solve scaling problems
• LAN: OSPF OSPF Areas
• WAN: BGP BGP Route Reflectors
• Edge: Enterprise Wireless Enterprise Wireless controllers
So of course adding SDN controllers makes data center fabrics scale better
• Faster bring up time, no route convergence
• Global knowledge global optimization
Almost all commercial fabrics have “controllers”
• Different choices for who is “master of state”
© 2 0 1 3 B I G S W I T C H N E T W ORK S , I N C . W W W . BI G S W I T C H . C OM 18
