Ming-Chen Zhao, Paarijaat Aditya, Yin Lin Andreas Haeberlen, Peter Druschel, Bruce Maggs, and...
-
Upload
sheena-small -
Category
Documents
-
view
218 -
download
1
Transcript of Ming-Chen Zhao, Paarijaat Aditya, Yin Lin Andreas Haeberlen, Peter Druschel, Bruce Maggs, and...
![Page 1: Ming-Chen Zhao, Paarijaat Aditya, Yin Lin Andreas Haeberlen, Peter Druschel, Bruce Maggs, and William Wishon A First Look at a Hybrid Content Delivery.](https://reader031.fdocuments.net/reader031/viewer/2022032605/56649e7c5503460f94b7ee27/html5/thumbnails/1.jpg)
Ming-Chen Zhao, Paarijaat Aditya, Yin LinAndreas Haeberlen, Peter Druschel, Bruce Maggs, and William Wishon
A First Look at a Hybrid Content Delivery System
![Page 2: Ming-Chen Zhao, Paarijaat Aditya, Yin Lin Andreas Haeberlen, Peter Druschel, Bruce Maggs, and William Wishon A First Look at a Hybrid Content Delivery.](https://reader031.fdocuments.net/reader031/viewer/2022032605/56649e7c5503460f94b7ee27/html5/thumbnails/2.jpg)
Powering a Better Internet © 2011 Akamai
Akamai Network Deployment
160000+Servers
1000+Networks
79+Countries
2500+POPs
![Page 3: Ming-Chen Zhao, Paarijaat Aditya, Yin Lin Andreas Haeberlen, Peter Druschel, Bruce Maggs, and William Wishon A First Look at a Hybrid Content Delivery.](https://reader031.fdocuments.net/reader031/viewer/2022032605/56649e7c5503460f94b7ee27/html5/thumbnails/3.jpg)
Powering a Better Internet © 2011 Akamai
Akamai Peak Instant and Daily Statistics
• Bit rate (01/09/11): 4.8 Tbps• Request rate (02/21/11): 16.7 million hits/sec
• Bytes delivered (12/27/10): 42.3 Pbytes• HTTP requests received (02/21/11): 961.5 billion• Unique client IPs (02/16/11): 471.5 million
![Page 4: Ming-Chen Zhao, Paarijaat Aditya, Yin Lin Andreas Haeberlen, Peter Druschel, Bruce Maggs, and William Wishon A First Look at a Hybrid Content Delivery.](https://reader031.fdocuments.net/reader031/viewer/2022032605/56649e7c5503460f94b7ee27/html5/thumbnails/4.jpg)
Powering a Better Internet © 2011 Akamai
Download Manager Product/Service
• Hybrid between a fixed-infrastructure CDN and a pure peer-to-peer delivery system
• Based on technology developed by Red Swoosh (acquired by Akamai in 2007)• Goal is to deliver large files at lower cost
![Page 5: Ming-Chen Zhao, Paarijaat Aditya, Yin Lin Andreas Haeberlen, Peter Druschel, Bruce Maggs, and William Wishon A First Look at a Hybrid Content Delivery.](https://reader031.fdocuments.net/reader031/viewer/2022032605/56649e7c5503460f94b7ee27/html5/thumbnails/5.jpg)
Powering a Better Internet © 2011 Akamai
NetSession Interface
• client-side software• runs as a service on Windows or MacOS• provides an API to installation software or
browser• stays connected to an Akamai Control Node• each installation is supposed to have a
unique GUID
![Page 6: Ming-Chen Zhao, Paarijaat Aditya, Yin Lin Andreas Haeberlen, Peter Druschel, Bruce Maggs, and William Wishon A First Look at a Hybrid Content Delivery.](https://reader031.fdocuments.net/reader031/viewer/2022032605/56649e7c5503460f94b7ee27/html5/thumbnails/6.jpg)
Powering a Better Internet © 2011 Akamai
Growth in Number of Installations
Full product roll-out expected summer 2011.
![Page 7: Ming-Chen Zhao, Paarijaat Aditya, Yin Lin Andreas Haeberlen, Peter Druschel, Bruce Maggs, and William Wishon A First Look at a Hybrid Content Delivery.](https://reader031.fdocuments.net/reader031/viewer/2022032605/56649e7c5503460f94b7ee27/html5/thumbnails/7.jpg)
Powering a Better Internet © 2011 Akamai
Architecture
• BitTorrent-like protocol with control nodes serving as “trackers” and assigning peers
• CDN acts as a backstop
Akamai Control Nodes Akamai Edge Servers
Peers
![Page 8: Ming-Chen Zhao, Paarijaat Aditya, Yin Lin Andreas Haeberlen, Peter Druschel, Bruce Maggs, and William Wishon A First Look at a Hybrid Content Delivery.](https://reader031.fdocuments.net/reader031/viewer/2022032605/56649e7c5503460f94b7ee27/html5/thumbnails/8.jpg)
Powering a Better Internet © 2011 Akamai
Logging
• Content providers want all downloads to be logged
• Peers must report P2P downloads to control nodes as they occur
• Akamai Edge Servers also log downloads from peers
![Page 9: Ming-Chen Zhao, Paarijaat Aditya, Yin Lin Andreas Haeberlen, Peter Druschel, Bruce Maggs, and William Wishon A First Look at a Hybrid Content Delivery.](https://reader031.fdocuments.net/reader031/viewer/2022032605/56649e7c5503460f94b7ee27/html5/thumbnails/9.jpg)
Powering a Better Internet © 2011 Akamai
Statistics from December 2010 Logs
![Page 10: Ming-Chen Zhao, Paarijaat Aditya, Yin Lin Andreas Haeberlen, Peter Druschel, Bruce Maggs, and William Wishon A First Look at a Hybrid Content Delivery.](https://reader031.fdocuments.net/reader031/viewer/2022032605/56649e7c5503460f94b7ee27/html5/thumbnails/10.jpg)
Powering a Better Internet © 2011 Akamai
Locations of Clients per EdgeScape
Granularity of predictions varies by continent.
![Page 11: Ming-Chen Zhao, Paarijaat Aditya, Yin Lin Andreas Haeberlen, Peter Druschel, Bruce Maggs, and William Wishon A First Look at a Hybrid Content Delivery.](https://reader031.fdocuments.net/reader031/viewer/2022032605/56649e7c5503460f94b7ee27/html5/thumbnails/11.jpg)
Powering a Better Internet © 2011 Akamai
December Client Logins
What happened December 8?
![Page 12: Ming-Chen Zhao, Paarijaat Aditya, Yin Lin Andreas Haeberlen, Peter Druschel, Bruce Maggs, and William Wishon A First Look at a Hybrid Content Delivery.](https://reader031.fdocuments.net/reader031/viewer/2022032605/56649e7c5503460f94b7ee27/html5/thumbnails/12.jpg)
Powering a Better Internet © 2011 Akamai
IP Addresses per GUID in December
Category 3 (flagged) look like multiple installations with the same GUID.
![Page 13: Ming-Chen Zhao, Paarijaat Aditya, Yin Lin Andreas Haeberlen, Peter Druschel, Bruce Maggs, and William Wishon A First Look at a Hybrid Content Delivery.](https://reader031.fdocuments.net/reader031/viewer/2022032605/56649e7c5503460f94b7ee27/html5/thumbnails/13.jpg)
Powering a Better Internet © 2011 Akamai
Clients Leave P2P Setting Unchanged
Content provider decides on initial setting.
![Page 14: Ming-Chen Zhao, Paarijaat Aditya, Yin Lin Andreas Haeberlen, Peter Druschel, Bruce Maggs, and William Wishon A First Look at a Hybrid Content Delivery.](https://reader031.fdocuments.net/reader031/viewer/2022032605/56649e7c5503460f94b7ee27/html5/thumbnails/14.jpg)
Powering a Better Internet © 2011 Akamai
File Size Distribution
For customers other than J and F, median file size was 872MB.
![Page 15: Ming-Chen Zhao, Paarijaat Aditya, Yin Lin Andreas Haeberlen, Peter Druschel, Bruce Maggs, and William Wishon A First Look at a Hybrid Content Delivery.](https://reader031.fdocuments.net/reader031/viewer/2022032605/56649e7c5503460f94b7ee27/html5/thumbnails/15.jpg)
Powering a Better Internet © 2011 Akamai
P2P Efficiency for Largest Enabled Customers
Matches or exceeds earlier predictions.
![Page 16: Ming-Chen Zhao, Paarijaat Aditya, Yin Lin Andreas Haeberlen, Peter Druschel, Bruce Maggs, and William Wishon A First Look at a Hybrid Content Delivery.](https://reader031.fdocuments.net/reader031/viewer/2022032605/56649e7c5503460f94b7ee27/html5/thumbnails/16.jpg)
Powering a Better Internet © 2011 Akamai
Efficiency versus Number of Peers
![Page 17: Ming-Chen Zhao, Paarijaat Aditya, Yin Lin Andreas Haeberlen, Peter Druschel, Bruce Maggs, and William Wishon A First Look at a Hybrid Content Delivery.](https://reader031.fdocuments.net/reader031/viewer/2022032605/56649e7c5503460f94b7ee27/html5/thumbnails/17.jpg)
Powering a Better Internet © 2011 Akamai
Success Rates, All Downloads
Over 86% success rate in December 2010.
![Page 18: Ming-Chen Zhao, Paarijaat Aditya, Yin Lin Andreas Haeberlen, Peter Druschel, Bruce Maggs, and William Wishon A First Look at a Hybrid Content Delivery.](https://reader031.fdocuments.net/reader031/viewer/2022032605/56649e7c5503460f94b7ee27/html5/thumbnails/18.jpg)
Powering a Better Internet © 2011 Akamai
Terminations and Failures Occur Early
![Page 19: Ming-Chen Zhao, Paarijaat Aditya, Yin Lin Andreas Haeberlen, Peter Druschel, Bruce Maggs, and William Wishon A First Look at a Hybrid Content Delivery.](https://reader031.fdocuments.net/reader031/viewer/2022032605/56649e7c5503460f94b7ee27/html5/thumbnails/19.jpg)
Powering a Better Internet © 2011 Akamai
Performance
Majority P2P downloads average several Mbps.
![Page 20: Ming-Chen Zhao, Paarijaat Aditya, Yin Lin Andreas Haeberlen, Peter Druschel, Bruce Maggs, and William Wishon A First Look at a Hybrid Content Delivery.](https://reader031.fdocuments.net/reader031/viewer/2022032605/56649e7c5503460f94b7ee27/html5/thumbnails/20.jpg)
Powering a Better Internet © 2011 Akamai
Content Popularity
Typical?
![Page 21: Ming-Chen Zhao, Paarijaat Aditya, Yin Lin Andreas Haeberlen, Peter Druschel, Bruce Maggs, and William Wishon A First Look at a Hybrid Content Delivery.](https://reader031.fdocuments.net/reader031/viewer/2022032605/56649e7c5503460f94b7ee27/html5/thumbnails/21.jpg)
Powering a Better Internet © 2011 Akamai
NetSession Versions Observed in Field
NetSession should excel at downloading itself.
![Page 22: Ming-Chen Zhao, Paarijaat Aditya, Yin Lin Andreas Haeberlen, Peter Druschel, Bruce Maggs, and William Wishon A First Look at a Hybrid Content Delivery.](https://reader031.fdocuments.net/reader031/viewer/2022032605/56649e7c5503460f94b7ee27/html5/thumbnails/22.jpg)
Powering a Better Internet © 2011 Akamai
Ongoing Work
• Designing mechanisms to protect the logging system against attacks
• (Successfully attacked it ourselves.)