Understanding the Evolving Internet · 2020. 1. 10. · Dark fiber Lit fiber Conduit. 3 Level of...
Transcript of Understanding the Evolving Internet · 2020. 1. 10. · Dark fiber Lit fiber Conduit. 3 Level of...
UnderstandingtheEvolvingInternet
RamDurairajan
0
Assistant Professor, Computer and Information ScienceCo-director, Oregon Networking Research Group
University of Oregon
1PhysicalInternet
Users, Apps and Data
Datacenters and CDNs
Cloud Services
Mobile Devices
SDNs and NFVs
Internet of Things
Internetisacomplexsystem
PhysicalInternet
2
PointofPresence(POP)
Fiberopticslink
DatacenterColocationfacility…
Submarinecable
ToLondon
LitfiberDarkfiberConduit
3
LevelofRobustness
ExistingMechanisms(e.g.,trafficengineering)
Perfe
ctCon
nectivity
NoCo
nnectivity
Problem
• GiventheclaimthatInternet’sdesignisrobust,whydowehaveoutages?Performanceissues?Bandwidthondemand?
(Robustness:abilityofthephysicalInternettocopewithevolution)
NoonehasacompleteviewoftheInternet
4Source:Lumeta Source:Peer1
Router-levelTopology
AutonomousSystems-levelTopology
5
LevelofRobustness
ExistingMechanisms(e.g.,trafficengineering)
Perfe
ctCon
nectivity
NoCo
nnectivity
Problem
• GiventheclaimthatInternet’sdesignisrobust,whydowehaveoutages?Performanceissues?Bandwidthondemand?
• HowdowetranscendthisrobustnessgaptobuildabetterInternet?
(Robustness:abilityofthephysicalInternettocopewithevolution)
• Whataboutevolvingcomponents?IoTs?Privateinterconnects?
Outline
IntroductionandMotivationUnravellingtheStructuralComplexity
- MappingtheInternetEcosystemProvidingFlexibleDecisionSupport
6
MappingtheInternetecosystem
• XConnects,CloudconnectsandPrivateInterconnects• InternetofThings• Long-haulandMetro
7
MappingtheInternetecosystem
• XConnects,CloudconnectsandPrivateInterconnects• InternetofThings• Long-haulandMetro
8
MappingtheInternetofThings
• MapandCharacterizetheIoT devicesanddeployments• Anactivemeasurements-basedapproach• SpecificfocusonIPv6-enabledIoT devices
• Challenges• IPv6addressspaceislarge.HowtoefficientlyscanIPv6prefixes?• HowtodifferentiateIoT vs.non-IoT devices?
• Applythistoproblemsofinterest• Securityandprivacy,censusandsurvey,businessintelligence,etc.
9
Mappinglong-haulandmetro
• InternetAtlas:acomprehensiverepositoryofthePhysicalInternet• Search-baseddata• Mapsnodes,links,fiberstrands,etc.• Repositoryhasover1,400maps
• Applythistoproblemsofinterest• Robustness,performance,security,resilience,etc.
• PopularScience• BestofWhat’sNew,SecurityCategory,2017• Oneofthe100GreatestInnovationsof2017
10
MapofUSlong-haulfiber
11
Assessinginfrastructuresharing
• Strikingcharacteristicofconstructedmapsisconduitsharing• 20-yearfiberIRUtoreducecosts
12
Connectivity-onlysharedrisk• HowmanyISPsshareaconduit?
13
0
100
200
300
400
500
600
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20
Rawnum
ber
NumberofISPssharingaconduit
542conduits89.67%
63.28%53.50%
12criticalchokepoints
Physical connectivity lacks much diversity that is a hallmark of commonly-known models.
Keyobservation
• ThereisalotofsharingintheInternet• Risksandoutages
• Opticalconnectionscannotbereconfigured• Inflexibility
• Risks+outages+inflexibility=NOTrobust!
14
Outline
IntroductionandMotivationUnravellingtheStructuralComplexityProvidingFlexibleDecisionSupport
- BuildingsystemstocreateabetterInternet
15
Needforflexibledecisionsupport• Flexibledecisionsupportisimportant• Enhancerobustness,resilience,security
• Resilience:removetheinflexibleleasingmodel(andreducesharedrisk)• Security:connectivity/bandwidthondemandtocountervolumetricDDoSattacks
• GiventheunderstandingofthephysicalInternet,whatradicalchangecanweintroducetobuildabetterInternet?• Wide-areaConnectivityasaService
• AgilitymeetstheInternet• E.g.,DeployNFVsinthewild
16
• Objective:asystem(calledGreyFiber)forcloudification ofthephysicalInternet• Cloud:Rentcycles,useresources,andrelease• GreyFiber:Rentconnectivity,transferdata,andreleaseconnectivity
• Systemconsiders• Infrastructureabundance(e.g.,unusedfiber)• Marketeconomics(e.g.,CAPEX,OPEX)• Technologytrends(e.g.,fastremotereconfigurationsinrouters)
• Flexibleaccesstofiber-opticpathsbetweenendpoints(e.g.,IXP)overarangeofusescenarios
17
Wide-areaConnectivityasaService
• GreyFiber consistsofthreecomponents• Globalcontrol,localsitecontrolandphysicalinfrastructuresubstrate
18
GreyFiber systemdesign
FiberExchange
BuyersSellers
GlobalController
GreyFiberGlobalControl
• Controlandcommandcenter• Sellers aremajorfiber/majorcableproviders
• Buyers arethecustomers(e.g.,CDNs,enterprisenetworks)
• Fiberexchange toenableeconomicviability• RunsGSPauctions
• Globalcontroller• Trafficengineering• Time-basedcircuitprovisioning• Networkmanagement• Backuprestoration
SiteALocal
ControllerSiteBLocal
Controller
SiteCLocal
Controller
FiberExchange
BuyersSellers
GlobalController
GreyFiberGlobalControl
GreyFiberLocalSiteControl
• Localcontrolovermarkedgeographicregion(e.g.,IXP)
• Mimicsminimalfunctionalitiesfromglobalcontrol• Configure links• Monitor connectivity• Report statisticstoglobalcontrol
SiteALocal
ControllerSiteBLocal
Controller
SiteCLocal
Controller
FiberExchange
BuyersSellers
GlobalController
GreyFiberGlobalControl
GreyFiberLocalSiteControl
PhysicalInfrastructure
• Composedoftraditionalnodesandlinks(e.g.,fiberpaths)
• Assumption• Fiberisalreadylit
• GreyFiber consistsofthreecomponents• Globalcontrol,localsitecontrolandphysicalinfrastructuresubstrate
• Supportsarangeofusescenarios• Small(secondstominutes),medium(hours),large(daystomonths)andextra-large(years)• Shortlifetimetoaddressunexpectedoutagesanddemands• Medium-to-largetoserviceunexpecteddemandswithoutdeadlines• Extra-largetosupporttraditionallease
22
GreyFiber systemdesign
GreyFiber implementationandevaluation
• Implementedin~22KlinesofPythoncode
• EvaluatedinGENIandCloudLab testbeds
23
Keyresults
• PerformancebenefitsofGreyFiber?
24
1GonGENI 10GonCloudLab
Questions?
25
ThankstoRezaRejaie,PaulBarford,JoelSommers,WalterWillinger and“great”students!