Building Web 2.0: Next-Generation Data Centers
description
Transcript of Building Web 2.0: Next-Generation Data Centers
![Page 1: Building Web 2.0: Next-Generation Data Centers](https://reader033.fdocuments.net/reader033/viewer/2022051611/54b869b34a7959e9418b48f3/html5/thumbnails/1.jpg)
Dr. Werner Vogels
Chief Technology Officer
Amazon.com
Web‐Scale ComputingCompete on Ideas, Not Resources
![Page 2: Building Web 2.0: Next-Generation Data Centers](https://reader033.fdocuments.net/reader033/viewer/2022051611/54b869b34a7959e9418b48f3/html5/thumbnails/2.jpg)
Online Retail Business• Over 72 million active customer accounts• Seven countries: US, UK, Germany, Japan, France, Canada, China• World‐Class Logistics – Multiple national fulfillment centers: Over 10
million ft2
Merchant Business• Over 1.2 million active seller accounts• Fulfillment by Amazon & Web Store by Amazon• Amazon Enterprise Services
Developer Business• Hundreds of thousands of Amazon Associates• Over 290,000 software developers registered to use Amazon Web
Services
What is Amazon.com?
![Page 3: Building Web 2.0: Next-Generation Data Centers](https://reader033.fdocuments.net/reader033/viewer/2022051611/54b869b34a7959e9418b48f3/html5/thumbnails/3.jpg)
• Amazon Web Services
• 290,000 registered developers
• 10 different web service offerings, including:– Amazon Simple Storage Service (Amazon S3)
– Amazon Elastic Compute Cloud (Amazon EC2)
– Amazon Flexible Payments Service (Amazon FPS)
Amazon’s Developer Business
![Page 4: Building Web 2.0: Next-Generation Data Centers](https://reader033.fdocuments.net/reader033/viewer/2022051611/54b869b34a7959e9418b48f3/html5/thumbnails/4.jpg)
![Page 5: Building Web 2.0: Next-Generation Data Centers](https://reader033.fdocuments.net/reader033/viewer/2022051611/54b869b34a7959e9418b48f3/html5/thumbnails/5.jpg)
![Page 6: Building Web 2.0: Next-Generation Data Centers](https://reader033.fdocuments.net/reader033/viewer/2022051611/54b869b34a7959e9418b48f3/html5/thumbnails/6.jpg)
![Page 7: Building Web 2.0: Next-Generation Data Centers](https://reader033.fdocuments.net/reader033/viewer/2022051611/54b869b34a7959e9418b48f3/html5/thumbnails/7.jpg)
![Page 8: Building Web 2.0: Next-Generation Data Centers](https://reader033.fdocuments.net/reader033/viewer/2022051611/54b869b34a7959e9418b48f3/html5/thumbnails/8.jpg)
![Page 9: Building Web 2.0: Next-Generation Data Centers](https://reader033.fdocuments.net/reader033/viewer/2022051611/54b869b34a7959e9418b48f3/html5/thumbnails/9.jpg)
![Page 10: Building Web 2.0: Next-Generation Data Centers](https://reader033.fdocuments.net/reader033/viewer/2022051611/54b869b34a7959e9418b48f3/html5/thumbnails/10.jpg)
Who said oneDatacenteris enough …
![Page 11: Building Web 2.0: Next-Generation Data Centers](https://reader033.fdocuments.net/reader033/viewer/2022051611/54b869b34a7959e9418b48f3/html5/thumbnails/11.jpg)
![Page 12: Building Web 2.0: Next-Generation Data Centers](https://reader033.fdocuments.net/reader033/viewer/2022051611/54b869b34a7959e9418b48f3/html5/thumbnails/12.jpg)
![Page 13: Building Web 2.0: Next-Generation Data Centers](https://reader033.fdocuments.net/reader033/viewer/2022051611/54b869b34a7959e9418b48f3/html5/thumbnails/13.jpg)
The Reliability of Hard Disks
Failure Trends in a Large Disk Drive PopulationEduardo Pinheiro, Wolf-Dietrich Weber and Luiz André Barroso
![Page 14: Building Web 2.0: Next-Generation Data Centers](https://reader033.fdocuments.net/reader033/viewer/2022051611/54b869b34a7959e9418b48f3/html5/thumbnails/14.jpg)
Dream or Nightmare?
• Scale to 100% ‐ 1000% increase popularity?• Provide 4 nines uptime?• Survive a complete datacenter failure?• Survive a router flapping?• While keeping cost low at the same time?
![Page 15: Building Web 2.0: Next-Generation Data Centers](https://reader033.fdocuments.net/reader033/viewer/2022051611/54b869b34a7959e9418b48f3/html5/thumbnails/15.jpg)
Chapter 4: Priorities – Scale Later – It is too hard to get right Chapter 4: Priorities – Scale Later – It is too hard to get right
![Page 16: Building Web 2.0: Next-Generation Data Centers](https://reader033.fdocuments.net/reader033/viewer/2022051611/54b869b34a7959e9418b48f3/html5/thumbnails/16.jpg)
![Page 17: Building Web 2.0: Next-Generation Data Centers](https://reader033.fdocuments.net/reader033/viewer/2022051611/54b869b34a7959e9418b48f3/html5/thumbnails/17.jpg)
![Page 18: Building Web 2.0: Next-Generation Data Centers](https://reader033.fdocuments.net/reader033/viewer/2022051611/54b869b34a7959e9418b48f3/html5/thumbnails/18.jpg)
The 70/30 SwitchThe 70/30 Switch
![Page 19: Building Web 2.0: Next-Generation Data Centers](https://reader033.fdocuments.net/reader033/viewer/2022051611/54b869b34a7959e9418b48f3/html5/thumbnails/19.jpg)
Scalable Infrastructure that allows your applications to meet infinite demand, cheaply and reliably
Scalable Infrastructure that allows your applications to meet infinite demand, cheaply and reliably
![Page 20: Building Web 2.0: Next-Generation Data Centers](https://reader033.fdocuments.net/reader033/viewer/2022051611/54b869b34a7959e9418b48f3/html5/thumbnails/20.jpg)
![Page 21: Building Web 2.0: Next-Generation Data Centers](https://reader033.fdocuments.net/reader033/viewer/2022051611/54b869b34a7959e9418b48f3/html5/thumbnails/21.jpg)
![Page 22: Building Web 2.0: Next-Generation Data Centers](https://reader033.fdocuments.net/reader033/viewer/2022051611/54b869b34a7959e9418b48f3/html5/thumbnails/22.jpg)
Amazon Web Services
22222222
![Page 23: Building Web 2.0: Next-Generation Data Centers](https://reader033.fdocuments.net/reader033/viewer/2022051611/54b869b34a7959e9418b48f3/html5/thumbnails/23.jpg)
Amazon Simple Storage ServiceAmazon S3 is Storage for the Internet
• Scalable– Can store an unlimited number of objects
• Reliable– Redundant across multiple datacenters– Availability SLA
• Fast– Low‐latency access and delivery
• Simple– Easy web services interface for developers
• Inexpensive– Uses Amazon’s cost‐efficient infrastructure
![Page 24: Building Web 2.0: Next-Generation Data Centers](https://reader033.fdocuments.net/reader033/viewer/2022051611/54b869b34a7959e9418b48f3/html5/thumbnails/24.jpg)
Objects Stored in Amazon S3
5,000,000,000
April 2007
10,000,000,000
October 2007
800,000,000
July 2006
![Page 25: Building Web 2.0: Next-Generation Data Centers](https://reader033.fdocuments.net/reader033/viewer/2022051611/54b869b34a7959e9418b48f3/html5/thumbnails/25.jpg)
Amazon S3 now in Europe!
• Developers can now choose storage in Europe
• Low latency access and delivery to Europe at a very low price
![Page 26: Building Web 2.0: Next-Generation Data Centers](https://reader033.fdocuments.net/reader033/viewer/2022051611/54b869b34a7959e9418b48f3/html5/thumbnails/26.jpg)
Creating a Storage Bucket in EuropePUT / HTTP/1.1Host: mybucket.s3.amazonaws.comContent-Length: 111Date: Mon, 05 Nov 2007 12:00:00 GMTAuthorization: AWS
15B4D3461F177624206A:xQE0diMbLRepdf3YB+FIEXAMPLE=
<CreateBucketConfiguration><LocationConstraint>
EU</LocationConstraint>
</CreateBucketConfiguration>
![Page 27: Building Web 2.0: Next-Generation Data Centers](https://reader033.fdocuments.net/reader033/viewer/2022051611/54b869b34a7959e9418b48f3/html5/thumbnails/27.jpg)
Amazon S3 European Pricing
• StorageUS$ 0.18 per GB‐Month of storage used
• Data TransferUS$ 0.10 per GB ‐ all data transfer inUS$ 0.18 per GB ‐ first 10 TB / month data transfer outUS$ 0.16 per GB ‐ next 40 TB / month data transfer outUS$ 0.13 per GB ‐ data transfer out / month over 50 TB
• RequestsUS$ 0.012 per 1,000 PUT or LIST requestsUS$ 0.012 per 10,000 GET and all other requests
![Page 28: Building Web 2.0: Next-Generation Data Centers](https://reader033.fdocuments.net/reader033/viewer/2022051611/54b869b34a7959e9418b48f3/html5/thumbnails/28.jpg)
![Page 29: Building Web 2.0: Next-Generation Data Centers](https://reader033.fdocuments.net/reader033/viewer/2022051611/54b869b34a7959e9418b48f3/html5/thumbnails/29.jpg)
http://aws.amazon.com
![Page 30: Building Web 2.0: Next-Generation Data Centers](https://reader033.fdocuments.net/reader033/viewer/2022051611/54b869b34a7959e9418b48f3/html5/thumbnails/30.jpg)
Web‐scale Computing