Radiology Renovation: How to Make Your Practice Appeal to Patients (and Referrers), Steve Forthuber
Flash Crowds in an Open CDN - Princeton University · stumbleupon.com 15 google.com 11 facebook.com...
Transcript of Flash Crowds in an Open CDN - Princeton University · stumbleupon.com 15 google.com 11 facebook.com...
![Page 1: Flash Crowds in an Open CDN - Princeton University · stumbleupon.com 15 google.com 11 facebook.com 10 dugmirror.com 8 duggback.com 4 twitter.com 4 . Common Referrers 12 Referrer](https://reader033.fdocuments.net/reader033/viewer/2022051806/5ffae616f3845158887af3e2/html5/thumbnails/1.jpg)
Going Viral:
Flash Crowds in an Open CDN
Patrick Wendell, U.C. Berkeley
Michael J. Freedman, Princeton University
IMC 2011 (Short Paper)
1
![Page 2: Flash Crowds in an Open CDN - Princeton University · stumbleupon.com 15 google.com 11 facebook.com 10 dugmirror.com 8 duggback.com 4 twitter.com 4 . Common Referrers 12 Referrer](https://reader033.fdocuments.net/reader033/viewer/2022051806/5ffae616f3845158887af3e2/html5/thumbnails/2.jpg)
What is a Flash Crowd?
• “Slashdot Effect”, “Going Viral”
• Exponential surge in request rate
(precisely defined in paper)
2
![Page 3: Flash Crowds in an Open CDN - Princeton University · stumbleupon.com 15 google.com 11 facebook.com 10 dugmirror.com 8 duggback.com 4 twitter.com 4 . Common Referrers 12 Referrer](https://reader033.fdocuments.net/reader033/viewer/2022051806/5ffae616f3845158887af3e2/html5/thumbnails/3.jpg)
Key Questions
• What are primary drivers of flash crowds?
• How effective is cache cooperation
during crowds against CDNs?
• How quickly do we need to provision
resources to meet crowd traffic?
3
![Page 4: Flash Crowds in an Open CDN - Princeton University · stumbleupon.com 15 google.com 11 facebook.com 10 dugmirror.com 8 duggback.com 4 twitter.com 4 . Common Referrers 12 Referrer](https://reader033.fdocuments.net/reader033/viewer/2022051806/5ffae616f3845158887af3e2/html5/thumbnails/4.jpg)
CoralCDN
• Network of ~300 distributed caching proxies
Origin Server HTTP Clients 4 CoralCDN Proxies
![Page 5: Flash Crowds in an Open CDN - Princeton University · stumbleupon.com 15 google.com 11 facebook.com 10 dugmirror.com 8 duggback.com 4 twitter.com 4 . Common Referrers 12 Referrer](https://reader033.fdocuments.net/reader033/viewer/2022051806/5ffae616f3845158887af3e2/html5/thumbnails/5.jpg)
CoralCDN
• Network of ~300 distributed caching proxies
Origin Server HTTP Clients 5 CoralCDN Proxies
1. Local cache 2. Peer cache
3. Origin fetch
![Page 6: Flash Crowds in an Open CDN - Princeton University · stumbleupon.com 15 google.com 11 facebook.com 10 dugmirror.com 8 duggback.com 4 twitter.com 4 . Common Referrers 12 Referrer](https://reader033.fdocuments.net/reader033/viewer/2022051806/5ffae616f3845158887af3e2/html5/thumbnails/6.jpg)
The Data
• Complete CoralCDN trace over 4 years
• 33 Billion HTTP requests
• Per-request logging
– <Time, URL, client IP, proxy IP, content cached?, ...>
![Page 7: Flash Crowds in an Open CDN - Princeton University · stumbleupon.com 15 google.com 11 facebook.com 10 dugmirror.com 8 duggback.com 4 twitter.com 4 . Common Referrers 12 Referrer](https://reader033.fdocuments.net/reader033/viewer/2022051806/5ffae616f3845158887af3e2/html5/thumbnails/7.jpg)
Source Data
Finding Crowds
Pruning Misuse
2,501 Crowds
Crowd Detection
3,553 Crowds
33 Billion HTTP Requests
7
![Page 8: Flash Crowds in an Open CDN - Princeton University · stumbleupon.com 15 google.com 11 facebook.com 10 dugmirror.com 8 duggback.com 4 twitter.com 4 . Common Referrers 12 Referrer](https://reader033.fdocuments.net/reader033/viewer/2022051806/5ffae616f3845158887af3e2/html5/thumbnails/8.jpg)
Crowd Sources
8
![Page 9: Flash Crowds in an Open CDN - Princeton University · stumbleupon.com 15 google.com 11 facebook.com 10 dugmirror.com 8 duggback.com 4 twitter.com 4 . Common Referrers 12 Referrer](https://reader033.fdocuments.net/reader033/viewer/2022051806/5ffae616f3845158887af3e2/html5/thumbnails/9.jpg)
Common Referrers
9
Referrer # Crowds
digg.com 123
reddit.com 20
stumbleupon.com 15
google.com 11
facebook.com 10
dugmirror.com 8
duggback.com 4
twitter.com 4
![Page 10: Flash Crowds in an Open CDN - Princeton University · stumbleupon.com 15 google.com 11 facebook.com 10 dugmirror.com 8 duggback.com 4 twitter.com 4 . Common Referrers 12 Referrer](https://reader033.fdocuments.net/reader033/viewer/2022051806/5ffae616f3845158887af3e2/html5/thumbnails/10.jpg)
Common Referrers
10
Referrer # Crowds
digg.com 123
reddit.com 20
stumbleupon.com 15
google.com 11
facebook.com 10
dugmirror.com 8
duggback.com 4
twitter.com 4
![Page 11: Flash Crowds in an Open CDN - Princeton University · stumbleupon.com 15 google.com 11 facebook.com 10 dugmirror.com 8 duggback.com 4 twitter.com 4 . Common Referrers 12 Referrer](https://reader033.fdocuments.net/reader033/viewer/2022051806/5ffae616f3845158887af3e2/html5/thumbnails/11.jpg)
Common Referrers
11
Referrer # Crowds
digg.com 123
reddit.com 20
stumbleupon.com 15
google.com 11
facebook.com 10
dugmirror.com 8
duggback.com 4
twitter.com 4
![Page 12: Flash Crowds in an Open CDN - Princeton University · stumbleupon.com 15 google.com 11 facebook.com 10 dugmirror.com 8 duggback.com 4 twitter.com 4 . Common Referrers 12 Referrer](https://reader033.fdocuments.net/reader033/viewer/2022051806/5ffae616f3845158887af3e2/html5/thumbnails/12.jpg)
Common Referrers
12
Referrer # Crowds
digg.com 123
reddit.com 20
stumbleupon.com 15
google.com 11
facebook.com 10
dugmirror.com 8
duggback.com 4
twitter.com 4
![Page 13: Flash Crowds in an Open CDN - Princeton University · stumbleupon.com 15 google.com 11 facebook.com 10 dugmirror.com 8 duggback.com 4 twitter.com 4 . Common Referrers 12 Referrer](https://reader033.fdocuments.net/reader033/viewer/2022051806/5ffae616f3845158887af3e2/html5/thumbnails/13.jpg)
CDN Caching Strategies
13
![Page 14: Flash Crowds in an Open CDN - Princeton University · stumbleupon.com 15 google.com 11 facebook.com 10 dugmirror.com 8 duggback.com 4 twitter.com 4 . Common Referrers 12 Referrer](https://reader033.fdocuments.net/reader033/viewer/2022051806/5ffae616f3845158887af3e2/html5/thumbnails/14.jpg)
Fully Cooperative Caching Greedy Caching
Cooperation in Caching
14
![Page 15: Flash Crowds in an Open CDN - Princeton University · stumbleupon.com 15 google.com 11 facebook.com 10 dugmirror.com 8 duggback.com 4 twitter.com 4 . Common Referrers 12 Referrer](https://reader033.fdocuments.net/reader033/viewer/2022051806/5ffae616f3845158887af3e2/html5/thumbnails/15.jpg)
• Depends how clients distribute over proxies
• Depends how many objects a crowd contains
Benefits of Cooperation?
15
vs.
GET A
GET A vs.
GET A
GET B
GET A
GET B
![Page 16: Flash Crowds in an Open CDN - Princeton University · stumbleupon.com 15 google.com 11 facebook.com 10 dugmirror.com 8 duggback.com 4 twitter.com 4 . Common Referrers 12 Referrer](https://reader033.fdocuments.net/reader033/viewer/2022051806/5ffae616f3845158887af3e2/html5/thumbnails/16.jpg)
Clients Use Many Proxies
• Clients globally distributed, even during crowds
• Most caches participate in most crowds
16
Very few large,
concentrated crowds
![Page 17: Flash Crowds in an Open CDN - Princeton University · stumbleupon.com 15 google.com 11 facebook.com 10 dugmirror.com 8 duggback.com 4 twitter.com 4 . Common Referrers 12 Referrer](https://reader033.fdocuments.net/reader033/viewer/2022051806/5ffae616f3845158887af3e2/html5/thumbnails/17.jpg)
Crowds Contain Many Objects
348
708 766
548
131
[0,10) [10,100) [100,1000) [1,000,10,000) 10,000+
17 URLs Per Crowd
![Page 18: Flash Crowds in an Open CDN - Princeton University · stumbleupon.com 15 google.com 11 facebook.com 10 dugmirror.com 8 duggback.com 4 twitter.com 4 . Common Referrers 12 Referrer](https://reader033.fdocuments.net/reader033/viewer/2022051806/5ffae616f3845158887af3e2/html5/thumbnails/18.jpg)
Benefits from Cooperation
18
4%
40%
16%
9% 8% 8% 8%
4% 2%
0% 0%
56% of crowds:
some improvement
40% of crowds:
major improvement
Absolute Hit Rate Improvement
![Page 19: Flash Crowds in an Open CDN - Princeton University · stumbleupon.com 15 google.com 11 facebook.com 10 dugmirror.com 8 duggback.com 4 twitter.com 4 . Common Referrers 12 Referrer](https://reader033.fdocuments.net/reader033/viewer/2022051806/5ffae616f3845158887af3e2/html5/thumbnails/19.jpg)
Provisioning Resources For Crowds
19
![Page 20: Flash Crowds in an Open CDN - Princeton University · stumbleupon.com 15 google.com 11 facebook.com 10 dugmirror.com 8 duggback.com 4 twitter.com 4 . Common Referrers 12 Referrer](https://reader033.fdocuments.net/reader033/viewer/2022051806/5ffae616f3845158887af3e2/html5/thumbnails/20.jpg)
Examples of Resource Provisioning
• CDN: static content – Expand cache set for particular domain
– Ω(Seconds)
• Cloud Computing Platform: dynamic service – Spin up new VM instances
– Ω(Minutes)
• If you squint, these are similar problems
20
![Page 21: Flash Crowds in an Open CDN - Princeton University · stumbleupon.com 15 google.com 11 facebook.com 10 dugmirror.com 8 duggback.com 4 twitter.com 4 . Common Referrers 12 Referrer](https://reader033.fdocuments.net/reader033/viewer/2022051806/5ffae616f3845158887af3e2/html5/thumbnails/21.jpg)
Required Resource Spin-up Time
21
Spin-up % Crowds Underprovisioned
10 Minutes 75%
1 Minute 50%
10 Seconds 10% 1-2 Minutes
on EC2
![Page 22: Flash Crowds in an Open CDN - Princeton University · stumbleupon.com 15 google.com 11 facebook.com 10 dugmirror.com 8 duggback.com 4 twitter.com 4 . Common Referrers 12 Referrer](https://reader033.fdocuments.net/reader033/viewer/2022051806/5ffae616f3845158887af3e2/html5/thumbnails/22.jpg)
Conclusions
• What are primary drivers of flash crowds? – Aggregators and portals, but also social/search
• How effective is cache cooperation during crowds against CDNs? – Large benefit for 40% of crowds
• How fast do we need to provision resources during crowds? – Likely require sub-minute responsiveness
22
![Page 23: Flash Crowds in an Open CDN - Princeton University · stumbleupon.com 15 google.com 11 facebook.com 10 dugmirror.com 8 duggback.com 4 twitter.com 4 . Common Referrers 12 Referrer](https://reader033.fdocuments.net/reader033/viewer/2022051806/5ffae616f3845158887af3e2/html5/thumbnails/23.jpg)
Questions?
cs.berkeley.edu/~pwendell
23
![Page 24: Flash Crowds in an Open CDN - Princeton University · stumbleupon.com 15 google.com 11 facebook.com 10 dugmirror.com 8 duggback.com 4 twitter.com 4 . Common Referrers 12 Referrer](https://reader033.fdocuments.net/reader033/viewer/2022051806/5ffae616f3845158887af3e2/html5/thumbnails/24.jpg)
Extra Slides / Charts
24
![Page 25: Flash Crowds in an Open CDN - Princeton University · stumbleupon.com 15 google.com 11 facebook.com 10 dugmirror.com 8 duggback.com 4 twitter.com 4 . Common Referrers 12 Referrer](https://reader033.fdocuments.net/reader033/viewer/2022051806/5ffae616f3845158887af3e2/html5/thumbnails/25.jpg)
Actual Spin-up Times on EC2
25
![Page 26: Flash Crowds in an Open CDN - Princeton University · stumbleupon.com 15 google.com 11 facebook.com 10 dugmirror.com 8 duggback.com 4 twitter.com 4 . Common Referrers 12 Referrer](https://reader033.fdocuments.net/reader033/viewer/2022051806/5ffae616f3845158887af3e2/html5/thumbnails/26.jpg)
How Fast is Fast?
26
![Page 27: Flash Crowds in an Open CDN - Princeton University · stumbleupon.com 15 google.com 11 facebook.com 10 dugmirror.com 8 duggback.com 4 twitter.com 4 . Common Referrers 12 Referrer](https://reader033.fdocuments.net/reader033/viewer/2022051806/5ffae616f3845158887af3e2/html5/thumbnails/27.jpg)
Origin Hits Saved by Cooperation
27
![Page 28: Flash Crowds in an Open CDN - Princeton University · stumbleupon.com 15 google.com 11 facebook.com 10 dugmirror.com 8 duggback.com 4 twitter.com 4 . Common Referrers 12 Referrer](https://reader033.fdocuments.net/reader033/viewer/2022051806/5ffae616f3845158887af3e2/html5/thumbnails/28.jpg)
Bursty Redirection
28
![Page 29: Flash Crowds in an Open CDN - Princeton University · stumbleupon.com 15 google.com 11 facebook.com 10 dugmirror.com 8 duggback.com 4 twitter.com 4 . Common Referrers 12 Referrer](https://reader033.fdocuments.net/reader033/viewer/2022051806/5ffae616f3845158887af3e2/html5/thumbnails/29.jpg)
Clients Distributed Widely
29
![Page 30: Flash Crowds in an Open CDN - Princeton University · stumbleupon.com 15 google.com 11 facebook.com 10 dugmirror.com 8 duggback.com 4 twitter.com 4 . Common Referrers 12 Referrer](https://reader033.fdocuments.net/reader033/viewer/2022051806/5ffae616f3845158887af3e2/html5/thumbnails/30.jpg)
Detecting Crowds
1. Rapid surge in request rate
ri+1 > 2ri for several i
2. High rate of traffic relative to
inferred capacity
rmax > ravg * 20
30
![Page 31: Flash Crowds in an Open CDN - Princeton University · stumbleupon.com 15 google.com 11 facebook.com 10 dugmirror.com 8 duggback.com 4 twitter.com 4 . Common Referrers 12 Referrer](https://reader033.fdocuments.net/reader033/viewer/2022051806/5ffae616f3845158887af3e2/html5/thumbnails/31.jpg)
Crowd Mitigation/Insurance
Content Mostly Static Content Mostly Dynamic
Caching CDNs
Scalable Storage
and Computation
31