Understanding the Evolving Internet · 2020. 1. 10. · Dark fiber Lit fiber Conduit. 3 Level of...

26
Understanding the Evolving Internet Ram Durairajan 0 Assistant Professor, Computer and Information Science Co-director, Oregon Networking Research Group University of Oregon

Transcript of Understanding the Evolving Internet · 2020. 1. 10. · Dark fiber Lit fiber Conduit. 3 Level of...

Page 1: Understanding the Evolving Internet · 2020. 1. 10. · Dark fiber Lit fiber Conduit. 3 Level of Robustness Existing Mechanisms (e.g., traffic y engineering) y ... •Security: connectivity/bandwidth

UnderstandingtheEvolvingInternet

RamDurairajan

0

Assistant Professor, Computer and Information ScienceCo-director, Oregon Networking Research Group

University of Oregon

Page 2: Understanding the Evolving Internet · 2020. 1. 10. · Dark fiber Lit fiber Conduit. 3 Level of Robustness Existing Mechanisms (e.g., traffic y engineering) y ... •Security: connectivity/bandwidth

1PhysicalInternet

Users, Apps and Data

Datacenters and CDNs

Cloud Services

Mobile Devices

SDNs and NFVs

Internet of Things

Internetisacomplexsystem

Page 3: Understanding the Evolving Internet · 2020. 1. 10. · Dark fiber Lit fiber Conduit. 3 Level of Robustness Existing Mechanisms (e.g., traffic y engineering) y ... •Security: connectivity/bandwidth

PhysicalInternet

2

PointofPresence(POP)

Fiberopticslink

DatacenterColocationfacility…

Submarinecable

ToLondon

LitfiberDarkfiberConduit

Page 4: Understanding the Evolving Internet · 2020. 1. 10. · Dark fiber Lit fiber Conduit. 3 Level of Robustness Existing Mechanisms (e.g., traffic y engineering) y ... •Security: connectivity/bandwidth

3

LevelofRobustness

ExistingMechanisms(e.g.,trafficengineering)

Perfe

ctCon

nectivity

NoCo

nnectivity

Problem

• GiventheclaimthatInternet’sdesignisrobust,whydowehaveoutages?Performanceissues?Bandwidthondemand?

(Robustness:abilityofthephysicalInternettocopewithevolution)

Page 5: Understanding the Evolving Internet · 2020. 1. 10. · Dark fiber Lit fiber Conduit. 3 Level of Robustness Existing Mechanisms (e.g., traffic y engineering) y ... •Security: connectivity/bandwidth

NoonehasacompleteviewoftheInternet

4Source:Lumeta Source:Peer1

Router-levelTopology

AutonomousSystems-levelTopology

Page 6: Understanding the Evolving Internet · 2020. 1. 10. · Dark fiber Lit fiber Conduit. 3 Level of Robustness Existing Mechanisms (e.g., traffic y engineering) y ... •Security: connectivity/bandwidth

5

LevelofRobustness

ExistingMechanisms(e.g.,trafficengineering)

Perfe

ctCon

nectivity

NoCo

nnectivity

Problem

• GiventheclaimthatInternet’sdesignisrobust,whydowehaveoutages?Performanceissues?Bandwidthondemand?

• HowdowetranscendthisrobustnessgaptobuildabetterInternet?

(Robustness:abilityofthephysicalInternettocopewithevolution)

• Whataboutevolvingcomponents?IoTs?Privateinterconnects?

Page 7: Understanding the Evolving Internet · 2020. 1. 10. · Dark fiber Lit fiber Conduit. 3 Level of Robustness Existing Mechanisms (e.g., traffic y engineering) y ... •Security: connectivity/bandwidth

Outline

IntroductionandMotivationUnravellingtheStructuralComplexity

- MappingtheInternetEcosystemProvidingFlexibleDecisionSupport

6

Page 8: Understanding the Evolving Internet · 2020. 1. 10. · Dark fiber Lit fiber Conduit. 3 Level of Robustness Existing Mechanisms (e.g., traffic y engineering) y ... •Security: connectivity/bandwidth

MappingtheInternetecosystem

• XConnects,CloudconnectsandPrivateInterconnects• InternetofThings• Long-haulandMetro

7

Page 9: Understanding the Evolving Internet · 2020. 1. 10. · Dark fiber Lit fiber Conduit. 3 Level of Robustness Existing Mechanisms (e.g., traffic y engineering) y ... •Security: connectivity/bandwidth

MappingtheInternetecosystem

• XConnects,CloudconnectsandPrivateInterconnects• InternetofThings• Long-haulandMetro

8

Page 10: Understanding the Evolving Internet · 2020. 1. 10. · Dark fiber Lit fiber Conduit. 3 Level of Robustness Existing Mechanisms (e.g., traffic y engineering) y ... •Security: connectivity/bandwidth

MappingtheInternetofThings

• MapandCharacterizetheIoT devicesanddeployments• Anactivemeasurements-basedapproach• SpecificfocusonIPv6-enabledIoT devices

• Challenges• IPv6addressspaceislarge.HowtoefficientlyscanIPv6prefixes?• HowtodifferentiateIoT vs.non-IoT devices?

• Applythistoproblemsofinterest• Securityandprivacy,censusandsurvey,businessintelligence,etc.

9

Page 11: Understanding the Evolving Internet · 2020. 1. 10. · Dark fiber Lit fiber Conduit. 3 Level of Robustness Existing Mechanisms (e.g., traffic y engineering) y ... •Security: connectivity/bandwidth

Mappinglong-haulandmetro

• InternetAtlas:acomprehensiverepositoryofthePhysicalInternet• Search-baseddata• Mapsnodes,links,fiberstrands,etc.• Repositoryhasover1,400maps

• Applythistoproblemsofinterest• Robustness,performance,security,resilience,etc.

• PopularScience• BestofWhat’sNew,SecurityCategory,2017• Oneofthe100GreatestInnovationsof2017

10

Page 12: Understanding the Evolving Internet · 2020. 1. 10. · Dark fiber Lit fiber Conduit. 3 Level of Robustness Existing Mechanisms (e.g., traffic y engineering) y ... •Security: connectivity/bandwidth

MapofUSlong-haulfiber

11

Page 13: Understanding the Evolving Internet · 2020. 1. 10. · Dark fiber Lit fiber Conduit. 3 Level of Robustness Existing Mechanisms (e.g., traffic y engineering) y ... •Security: connectivity/bandwidth

Assessinginfrastructuresharing

• Strikingcharacteristicofconstructedmapsisconduitsharing• 20-yearfiberIRUtoreducecosts

12

Page 14: Understanding the Evolving Internet · 2020. 1. 10. · Dark fiber Lit fiber Conduit. 3 Level of Robustness Existing Mechanisms (e.g., traffic y engineering) y ... •Security: connectivity/bandwidth

Connectivity-onlysharedrisk• HowmanyISPsshareaconduit?

13

0

100

200

300

400

500

600

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20

Rawnum

ber

NumberofISPssharingaconduit

542conduits89.67%

63.28%53.50%

12criticalchokepoints

Physical connectivity lacks much diversity that is a hallmark of commonly-known models.

Page 15: Understanding the Evolving Internet · 2020. 1. 10. · Dark fiber Lit fiber Conduit. 3 Level of Robustness Existing Mechanisms (e.g., traffic y engineering) y ... •Security: connectivity/bandwidth

Keyobservation

• ThereisalotofsharingintheInternet• Risksandoutages

• Opticalconnectionscannotbereconfigured• Inflexibility

• Risks+outages+inflexibility=NOTrobust!

14

Page 16: Understanding the Evolving Internet · 2020. 1. 10. · Dark fiber Lit fiber Conduit. 3 Level of Robustness Existing Mechanisms (e.g., traffic y engineering) y ... •Security: connectivity/bandwidth

Outline

IntroductionandMotivationUnravellingtheStructuralComplexityProvidingFlexibleDecisionSupport

- BuildingsystemstocreateabetterInternet

15

Page 17: Understanding the Evolving Internet · 2020. 1. 10. · Dark fiber Lit fiber Conduit. 3 Level of Robustness Existing Mechanisms (e.g., traffic y engineering) y ... •Security: connectivity/bandwidth

Needforflexibledecisionsupport• Flexibledecisionsupportisimportant• Enhancerobustness,resilience,security

• Resilience:removetheinflexibleleasingmodel(andreducesharedrisk)• Security:connectivity/bandwidthondemandtocountervolumetricDDoSattacks

• GiventheunderstandingofthephysicalInternet,whatradicalchangecanweintroducetobuildabetterInternet?• Wide-areaConnectivityasaService

• AgilitymeetstheInternet• E.g.,DeployNFVsinthewild

16

Page 18: Understanding the Evolving Internet · 2020. 1. 10. · Dark fiber Lit fiber Conduit. 3 Level of Robustness Existing Mechanisms (e.g., traffic y engineering) y ... •Security: connectivity/bandwidth

• Objective:asystem(calledGreyFiber)forcloudification ofthephysicalInternet• Cloud:Rentcycles,useresources,andrelease• GreyFiber:Rentconnectivity,transferdata,andreleaseconnectivity

• Systemconsiders• Infrastructureabundance(e.g.,unusedfiber)• Marketeconomics(e.g.,CAPEX,OPEX)• Technologytrends(e.g.,fastremotereconfigurationsinrouters)

• Flexibleaccesstofiber-opticpathsbetweenendpoints(e.g.,IXP)overarangeofusescenarios

17

Wide-areaConnectivityasaService

Page 19: Understanding the Evolving Internet · 2020. 1. 10. · Dark fiber Lit fiber Conduit. 3 Level of Robustness Existing Mechanisms (e.g., traffic y engineering) y ... •Security: connectivity/bandwidth

• GreyFiber consistsofthreecomponents• Globalcontrol,localsitecontrolandphysicalinfrastructuresubstrate

18

GreyFiber systemdesign

Page 20: Understanding the Evolving Internet · 2020. 1. 10. · Dark fiber Lit fiber Conduit. 3 Level of Robustness Existing Mechanisms (e.g., traffic y engineering) y ... •Security: connectivity/bandwidth

FiberExchange

BuyersSellers

GlobalController

GreyFiberGlobalControl

• Controlandcommandcenter• Sellers aremajorfiber/majorcableproviders

• Buyers arethecustomers(e.g.,CDNs,enterprisenetworks)

• Fiberexchange toenableeconomicviability• RunsGSPauctions

• Globalcontroller• Trafficengineering• Time-basedcircuitprovisioning• Networkmanagement• Backuprestoration

Page 21: Understanding the Evolving Internet · 2020. 1. 10. · Dark fiber Lit fiber Conduit. 3 Level of Robustness Existing Mechanisms (e.g., traffic y engineering) y ... •Security: connectivity/bandwidth

SiteALocal

ControllerSiteBLocal

Controller

SiteCLocal

Controller

FiberExchange

BuyersSellers

GlobalController

GreyFiberGlobalControl

GreyFiberLocalSiteControl

• Localcontrolovermarkedgeographicregion(e.g.,IXP)

• Mimicsminimalfunctionalitiesfromglobalcontrol• Configure links• Monitor connectivity• Report statisticstoglobalcontrol

Page 22: Understanding the Evolving Internet · 2020. 1. 10. · Dark fiber Lit fiber Conduit. 3 Level of Robustness Existing Mechanisms (e.g., traffic y engineering) y ... •Security: connectivity/bandwidth

SiteALocal

ControllerSiteBLocal

Controller

SiteCLocal

Controller

FiberExchange

BuyersSellers

GlobalController

GreyFiberGlobalControl

GreyFiberLocalSiteControl

PhysicalInfrastructure

• Composedoftraditionalnodesandlinks(e.g.,fiberpaths)

• Assumption• Fiberisalreadylit

Page 23: Understanding the Evolving Internet · 2020. 1. 10. · Dark fiber Lit fiber Conduit. 3 Level of Robustness Existing Mechanisms (e.g., traffic y engineering) y ... •Security: connectivity/bandwidth

• GreyFiber consistsofthreecomponents• Globalcontrol,localsitecontrolandphysicalinfrastructuresubstrate

• Supportsarangeofusescenarios• Small(secondstominutes),medium(hours),large(daystomonths)andextra-large(years)• Shortlifetimetoaddressunexpectedoutagesanddemands• Medium-to-largetoserviceunexpecteddemandswithoutdeadlines• Extra-largetosupporttraditionallease

22

GreyFiber systemdesign

Page 24: Understanding the Evolving Internet · 2020. 1. 10. · Dark fiber Lit fiber Conduit. 3 Level of Robustness Existing Mechanisms (e.g., traffic y engineering) y ... •Security: connectivity/bandwidth

GreyFiber implementationandevaluation

• Implementedin~22KlinesofPythoncode

• EvaluatedinGENIandCloudLab testbeds

23

Page 25: Understanding the Evolving Internet · 2020. 1. 10. · Dark fiber Lit fiber Conduit. 3 Level of Robustness Existing Mechanisms (e.g., traffic y engineering) y ... •Security: connectivity/bandwidth

Keyresults

• PerformancebenefitsofGreyFiber?

24

1GonGENI 10GonCloudLab

Page 26: Understanding the Evolving Internet · 2020. 1. 10. · Dark fiber Lit fiber Conduit. 3 Level of Robustness Existing Mechanisms (e.g., traffic y engineering) y ... •Security: connectivity/bandwidth

Questions?

25

[email protected]

ThankstoRezaRejaie,PaulBarford,JoelSommers,WalterWillinger and“great”students!