Making Middleboxes Someone Else’s Problem: Network Processing as a Cloud Service

52
Making Middleboxes Someone Else’s Problem: Network Processing as a Cloud Service Justine Sherry*, Shaddi Hasan*, Colin Scott*, Arvind Krishnamurthy, Sylvia Ratnasamy*, and Vyas Sekar*

description

Making Middleboxes Someone Else’s Problem: Network Processing as a Cloud Service. Justine Sherry*, Shaddi Hasan * , Colin Scott * , Arvind Krishnamurthy † , Sylvia Ratnasamy * , and Vyas Sekar ‡. *. ‡. †. Typical Enterprise Networks. Internet. Typical Enterprise Networks. - PowerPoint PPT Presentation

Transcript of Making Middleboxes Someone Else’s Problem: Network Processing as a Cloud Service

Page 1: Making Middleboxes Someone Else’s Problem: Network Processing as a Cloud Service

Making Middleboxes Someone Else’s Problem: Network Processing as a

Cloud Service

Justine Sherry*, Shaddi Hasan*, Colin Scott*, Arvind Krishnamurthy†, Sylvia Ratnasamy*, and Vyas Sekar‡

‡* †

Page 2: Making Middleboxes Someone Else’s Problem: Network Processing as a Cloud Service

Typical Enterprise Networks

Internet

Page 3: Making Middleboxes Someone Else’s Problem: Network Processing as a Cloud Service

Typical Enterprise Networks

Internet

Page 4: Making Middleboxes Someone Else’s Problem: Network Processing as a Cloud Service

A Survey• 57 enterprise network administrators

• Small (< 1k hosts) to XL ( >100k hosts)

• Asked about deployment size, expenses, complexity, and failures.

Page 5: Making Middleboxes Someone Else’s Problem: Network Processing as a Cloud Service

How many middleboxes do you deploy?

Typically on par with # routers and switches.

Page 6: Making Middleboxes Someone Else’s Problem: Network Processing as a Cloud Service

What kinds of middleboxes do you deploy?

Many kinds of devices, all with different functions and management expertise required.

Page 7: Making Middleboxes Someone Else’s Problem: Network Processing as a Cloud Service

How many networking personnel are there?

Average salary for a network engineer - $60-80k USD

Page 8: Making Middleboxes Someone Else’s Problem: Network Processing as a Cloud Service

How do administrators spend their time?

Misconfig. Overload Physical/Electrical

Firewalls 67.3% 16.3% 16.3%Proxies 63.2% 15.7% 21.1%

IDS 54.45% 11.4% 34%

Most administrators spent 1-5 hrs/week dealing with failures; 9% spent 6-10 hrs/week.

Page 9: Making Middleboxes Someone Else’s Problem: Network Processing as a Cloud Service

Recap• High Capital and Operating Expenses

• Time Consuming and Error-Prone

• Physical and Overload Failures

Page 10: Making Middleboxes Someone Else’s Problem: Network Processing as a Cloud Service

How can we improve this?

Page 11: Making Middleboxes Someone Else’s Problem: Network Processing as a Cloud Service

Our Proposal

Internet

Page 12: Making Middleboxes Someone Else’s Problem: Network Processing as a Cloud Service

Our Proposal

Internet

Cloud Provider

Page 13: Making Middleboxes Someone Else’s Problem: Network Processing as a Cloud Service

• High Capital and Operating Expenses

• Time Consuming and Error Prone

• Physical and Overload Failures

• Economies of scale and pay-per use

• Simplifies configuration and deployment

• Redundant resources for failover

A move to the cloud

Page 14: Making Middleboxes Someone Else’s Problem: Network Processing as a Cloud Service

Our Design

Page 15: Making Middleboxes Someone Else’s Problem: Network Processing as a Cloud Service

Challenges• Minimal Complexity at the Enterprise

• Functional Equivalence

• Low Performance Overhead

Page 16: Making Middleboxes Someone Else’s Problem: Network Processing as a Cloud Service

APLOMB“Appliance for Outsourcing Middleboxes”

Page 17: Making Middleboxes Someone Else’s Problem: Network Processing as a Cloud Service

Outsourcing Middleboxes with APLOMB

Internet

Cloud Provider

APLOMBGateway

NAT

Page 18: Making Middleboxes Someone Else’s Problem: Network Processing as a Cloud Service

Inbound Traffic

Internet

Cloud Provider

Web Server: www.enterprise.com 192.168.1.100

EnterpriseNetwork Admin.

Register:www.enterprise.com192.168.1.100

Page 19: Making Middleboxes Someone Else’s Problem: Network Processing as a Cloud Service

Inbound Traffic

Internet

Cloud Provider

DNSRegister:enterprise.com98.76.54.32

98.76.54.32

Page 20: Making Middleboxes Someone Else’s Problem: Network Processing as a Cloud Service

External Client

Choosing a Datacenter

Cloud Provider East

Cloud Provider West

Enterprise

Route through cloud datacenter that minimizes end to end latency.

APLOMB Gateway keeps a “routing table” to select best tunnel for every Internet prefix.External

Client

Page 21: Making Middleboxes Someone Else’s Problem: Network Processing as a Cloud Service

Caches and “Terminal Services”

Traffic destined to services like caches should be redirected to the nearest node.

Cloud Provider West

Page 22: Making Middleboxes Someone Else’s Problem: Network Processing as a Cloud Service

APLOMB“Appliance for Outsourcing Middleboxes”

• Place middleboxes in the cloud.• Use APLOMB devices and DNS to

redirect traffic to and from the cloud.• That’s it.

Page 23: Making Middleboxes Someone Else’s Problem: Network Processing as a Cloud Service

Can we outsource all middleboxes?

FirewallsIDSesLoad BalancersVPNsProxy/CachesWAN Optimizers

✔✔✔✔✗ Bandwidth?✗ Compression?

Page 24: Making Middleboxes Someone Else’s Problem: Network Processing as a Cloud Service

I

APLOMB+ for CompressionAdd generic compression to APLOMB gateway to reduce bandwidth consumption.

Cloud Provider

Internet

Page 25: Making Middleboxes Someone Else’s Problem: Network Processing as a Cloud Service

Can we outsource all middleboxes?

FirewallsIDSesLoad BalancersVPNsProxy/CachesWAN Optimizers

✔✔✔✔✗ Bandwidth?✗ Compression?✔✔

Page 26: Making Middleboxes Someone Else’s Problem: Network Processing as a Cloud Service

Does it work?

Page 27: Making Middleboxes Someone Else’s Problem: Network Processing as a Cloud Service

Our Deployment• Cloud provider: EC2 – 7 Datacenters

• OpenVPN for tunneling, Vyatta for middlebox services

• Two Types of Clients:– Software VPN client on laptops– Tunneling software router for wired hosts

Page 28: Making Middleboxes Someone Else’s Problem: Network Processing as a Cloud Service

Three Part EvaluationImplementation & Deployment

• Performance metrics

Case Study of a Large Enterprise• Impact in a real usage scenario

Wide-Area Measurements• Network latency

Page 29: Making Middleboxes Someone Else’s Problem: Network Processing as a Cloud Service

Does APLOMB inflate latency?

Page 30: Making Middleboxes Someone Else’s Problem: Network Processing as a Cloud Service

For PlanetLab nodes, 60% of pairs’ latency improves with redirection through EC2.

Page 31: Making Middleboxes Someone Else’s Problem: Network Processing as a Cloud Service

Latency at a Large EnterpriseMeasured redirection latency between enterprise sites.

• Median latency inflation: 1.13 ms• Sites experiencing inflation were

primarily in areas where EC2 does not have a wide footprint.

Page 32: Making Middleboxes Someone Else’s Problem: Network Processing as a Cloud Service

How does APLOMB impact other quality metrics, like bandwidth and jitter?

Page 33: Making Middleboxes Someone Else’s Problem: Network Processing as a Cloud Service

• Bandwidth: download times with BitTorrent increased on average 2.3%

• Jitter: consistently within industry standard bounds of 30ms

Page 34: Making Middleboxes Someone Else’s Problem: Network Processing as a Cloud Service

Does APLOMB negate the benefits of bandwidth-saving devices?

Page 35: Making Middleboxes Someone Else’s Problem: Network Processing as a Cloud Service

APLOMB+ incurs a median penalty of 3.8% bandwidth inflation over traditional WAN

Optimizers.

Page 36: Making Middleboxes Someone Else’s Problem: Network Processing as a Cloud Service

Does “elastic scaling” at the cloud provide real benefits?

Page 37: Making Middleboxes Someone Else’s Problem: Network Processing as a Cloud Service

Some sites generate as much as 13x traffic more than average at peak hours.

Page 38: Making Middleboxes Someone Else’s Problem: Network Processing as a Cloud Service

Recap• Good application performance–Latency median inflation 1.1ms–Download times increased only

2.3%• Generic redundancy elimination

saves bandwidth costs• Strong benefits from elasticity

Page 39: Making Middleboxes Someone Else’s Problem: Network Processing as a Cloud Service

ConclusionMoving middleboxes to the cloud is a practical and feasible solution to the complexity of enterprise networks.

Page 40: Making Middleboxes Someone Else’s Problem: Network Processing as a Cloud Service
Page 41: Making Middleboxes Someone Else’s Problem: Network Processing as a Cloud Service

What does it mean to “manage” middleboxes?

• Upgrades and Vendor Interaction• Monitoring and Diagnostics• Configuration– Appliance Configuration – Policy Configuration

• Training

Page 42: Making Middleboxes Someone Else’s Problem: Network Processing as a Cloud Service

Internal Firewalls

Cloud Provider

Internet

Page 43: Making Middleboxes Someone Else’s Problem: Network Processing as a Cloud Service

How many middleboxes can APLOMB outsource?

Page 44: Making Middleboxes Someone Else’s Problem: Network Processing as a Cloud Service

How much do middleboxes cost?

Thousands to millions of dollars / 5 years

Page 45: Making Middleboxes Someone Else’s Problem: Network Processing as a Cloud Service

Is maintaining multiple tunnels at the APLOMB gateway useful?

Page 46: Making Middleboxes Someone Else’s Problem: Network Processing as a Cloud Service

With multiple tunnels, the fraction of pairs with 0 inflation or better moves from 40% to 60%

Page 47: Making Middleboxes Someone Else’s Problem: Network Processing as a Cloud Service

How large must a provider’s datacenter footprint be to support middlebox services?

Page 48: Making Middleboxes Someone Else’s Problem: Network Processing as a Cloud Service

Minimal Improvement to E2E Latency with Larger Footprint.

Page 49: Making Middleboxes Someone Else’s Problem: Network Processing as a Cloud Service

How does APLOMB redirection impact web page load times?

Page 50: Making Middleboxes Someone Else’s Problem: Network Processing as a Cloud Service

Median: slightly worse; 90%-ile: slightly better.

Page 51: Making Middleboxes Someone Else’s Problem: Network Processing as a Cloud Service

Caches may require a larger footprint to provide nationwide service.

Page 52: Making Middleboxes Someone Else’s Problem: Network Processing as a Cloud Service