AWS Summit 2011: Customer Presentation - NYTimes
-
Upload
amazon-web-services -
Category
Technology
-
view
1.086 -
download
3
description
Transcript of AWS Summit 2011: Customer Presentation - NYTimes
![Page 1: AWS Summit 2011: Customer Presentation - NYTimes](https://reader034.fdocuments.net/reader034/viewer/2022051411/5456190baf79592b448b4cc5/html5/thumbnails/1.jpg)
NYTimes.com
Vadim Jelezniakov
AWS Summit 2011
![Page 2: AWS Summit 2011: Customer Presentation - NYTimes](https://reader034.fdocuments.net/reader034/viewer/2022051411/5456190baf79592b448b4cc5/html5/thumbnails/2.jpg)
Next 10 min
The Company
Why Cloud
The App Examples
Progress So Far
What’s Next
![Page 3: AWS Summit 2011: Customer Presentation - NYTimes](https://reader034.fdocuments.net/reader034/viewer/2022051411/5456190baf79592b448b4cc5/html5/thumbnails/3.jpg)
The New York TimesThe International Herald Tribune
The Boston Globe15 daily newspapers
50 Web sitesNYTimes.comBoston.comAbout.com
The New York Times
Company
![Page 4: AWS Summit 2011: Customer Presentation - NYTimes](https://reader034.fdocuments.net/reader034/viewer/2022051411/5456190baf79592b448b4cc5/html5/thumbnails/4.jpg)
NYTimes.com’s
Stats
In the US:38.1 mil unique users /
month810 mil page views / month
Worldwide:62 mil unique users /
month984 mil page views / month#1
individual newspaper site#2 media
site bloggers link to the most*#4 news
and information Web site
comScore Report, April 2011
*Technorati's index
![Page 5: AWS Summit 2011: Customer Presentation - NYTimes](https://reader034.fdocuments.net/reader034/viewer/2022051411/5456190baf79592b448b4cc5/html5/thumbnails/5.jpg)
Why Cloud?
On Demand Availability
Scalability
Rapid Deployment
Why AWS?
Cost-Effective
IaaS = Flexible
Comprehensive
![Page 6: AWS Summit 2011: Customer Presentation - NYTimes](https://reader034.fdocuments.net/reader034/viewer/2022051411/5456190baf79592b448b4cc5/html5/thumbnails/6.jpg)
Why Cloud?
On Demand Availability
Scalability
Rapid Deployment
Why AWS?
Cost-Effective
IaaS = Flexible
Comprehensive
![Page 7: AWS Summit 2011: Customer Presentation - NYTimes](https://reader034.fdocuments.net/reader034/viewer/2022051411/5456190baf79592b448b4cc5/html5/thumbnails/7.jpg)
Why Cloud?
On Demand Availability
Scalability
Rapid Deployment
Why AWS?
Cost-Effective
IaaS = Flexible
Comprehensive
![Page 8: AWS Summit 2011: Customer Presentation - NYTimes](https://reader034.fdocuments.net/reader034/viewer/2022051411/5456190baf79592b448b4cc5/html5/thumbnails/8.jpg)
On Demand Capacity -
TimesMachine
Flexibility - Times Skimmer
Scalability - User Generated
Content (Comments)
Examples
![Page 9: AWS Summit 2011: Customer Presentation - NYTimes](https://reader034.fdocuments.net/reader034/viewer/2022051411/5456190baf79592b448b4cc5/html5/thumbnails/9.jpg)
TimesMachine (2007, 2008)
130 years of archives in 36 hours
400K objects, 4T of data
S3, EC2, Hadoop
http://timesmachine.nytimes.com
![Page 10: AWS Summit 2011: Customer Presentation - NYTimes](https://reader034.fdocuments.net/reader034/viewer/2022051411/5456190baf79592b448b4cc5/html5/thumbnails/10.jpg)
Skimmer Private Beta (Feb 14th, 2009)
http://www.nytimes.com/skimmer/
![Page 11: AWS Summit 2011: Customer Presentation - NYTimes](https://reader034.fdocuments.net/reader034/viewer/2022051411/5456190baf79592b448b4cc5/html5/thumbnails/11.jpg)
11:00 News leaks to TechCrunch, Google Finance11:10 Average load on the instance is 4011:15 Snapshotting the instance, configuring the LB, testing12:00 Four Skimmer instances load balanced, quality is restored1 hour - from prototype to production
“SkimmerGate”
![Page 12: AWS Summit 2011: Customer Presentation - NYTimes](https://reader034.fdocuments.net/reader034/viewer/2022051411/5456190baf79592b448b4cc5/html5/thumbnails/12.jpg)
Comments on Articles and Blogs
![Page 13: AWS Summit 2011: Customer Presentation - NYTimes](https://reader034.fdocuments.net/reader034/viewer/2022051411/5456190baf79592b448b4cc5/html5/thumbnails/13.jpg)
Rate and Review for Movies,
Theater, Dining and Travel
![Page 14: AWS Summit 2011: Customer Presentation - NYTimes](https://reader034.fdocuments.net/reader034/viewer/2022051411/5456190baf79592b448b4cc5/html5/thumbnails/14.jpg)
We like
To be able to scalequickly on demand
We don’t like
calls from Systems teamat 6PM on Fridays
![Page 15: AWS Summit 2011: Customer Presentation - NYTimes](https://reader034.fdocuments.net/reader034/viewer/2022051411/5456190baf79592b448b4cc5/html5/thumbnails/15.jpg)
Traffic Spikes - Add Capacity
![Page 16: AWS Summit 2011: Customer Presentation - NYTimes](https://reader034.fdocuments.net/reader034/viewer/2022051411/5456190baf79592b448b4cc5/html5/thumbnails/16.jpg)
Load Balancing / Security View
![Page 17: AWS Summit 2011: Customer Presentation - NYTimes](https://reader034.fdocuments.net/reader034/viewer/2022051411/5456190baf79592b448b4cc5/html5/thumbnails/17.jpg)
Everyone’s Favorites:
Development Instances!
![Page 18: AWS Summit 2011: Customer Presentation - NYTimes](https://reader034.fdocuments.net/reader034/viewer/2022051411/5456190baf79592b448b4cc5/html5/thumbnails/18.jpg)
Gap Analysis
• Load Balancing
• Communication between instances
• Talking back to existing Datacenter
• Scaling up and back
• Securing the instances
![Page 19: AWS Summit 2011: Customer Presentation - NYTimes](https://reader034.fdocuments.net/reader034/viewer/2022051411/5456190baf79592b448b4cc5/html5/thumbnails/19.jpg)
![Page 20: AWS Summit 2011: Customer Presentation - NYTimes](https://reader034.fdocuments.net/reader034/viewer/2022051411/5456190baf79592b448b4cc5/html5/thumbnails/20.jpg)
![Page 21: AWS Summit 2011: Customer Presentation - NYTimes](https://reader034.fdocuments.net/reader034/viewer/2022051411/5456190baf79592b448b4cc5/html5/thumbnails/21.jpg)
![Page 22: AWS Summit 2011: Customer Presentation - NYTimes](https://reader034.fdocuments.net/reader034/viewer/2022051411/5456190baf79592b448b4cc5/html5/thumbnails/22.jpg)
![Page 23: AWS Summit 2011: Customer Presentation - NYTimes](https://reader034.fdocuments.net/reader034/viewer/2022051411/5456190baf79592b448b4cc5/html5/thumbnails/23.jpg)
![Page 24: AWS Summit 2011: Customer Presentation - NYTimes](https://reader034.fdocuments.net/reader034/viewer/2022051411/5456190baf79592b448b4cc5/html5/thumbnails/24.jpg)
![Page 25: AWS Summit 2011: Customer Presentation - NYTimes](https://reader034.fdocuments.net/reader034/viewer/2022051411/5456190baf79592b448b4cc5/html5/thumbnails/25.jpg)
![Page 26: AWS Summit 2011: Customer Presentation - NYTimes](https://reader034.fdocuments.net/reader034/viewer/2022051411/5456190baf79592b448b4cc5/html5/thumbnails/26.jpg)
Nimbul
Light Cloud Manager
http://github.com/nimbul/nimbul
CloudSource
Simple SVN Deployment
http://github.com/nimbul/cloudsourc
ebased on ServerMattic developed by WordPress
Emissary
Fast AMQP Messaging
http://github.com/nimbul/emissar
y
Tools Developed for the
Cloud
![Page 27: AWS Summit 2011: Customer Presentation - NYTimes](https://reader034.fdocuments.net/reader034/viewer/2022051411/5456190baf79592b448b4cc5/html5/thumbnails/27.jpg)
Progress So Far
![Page 28: AWS Summit 2011: Customer Presentation - NYTimes](https://reader034.fdocuments.net/reader034/viewer/2022051411/5456190baf79592b448b4cc5/html5/thumbnails/28.jpg)
NYTimes.com EC2
Expansion
Clusters: from 2 to 100. Instances: from 30 to 400.
![Page 29: AWS Summit 2011: Customer Presentation - NYTimes](https://reader034.fdocuments.net/reader034/viewer/2022051411/5456190baf79592b448b4cc5/html5/thumbnails/29.jpg)
NYTimes.com EC2
Expansion
EC2 DC in comparison with other DCs
from 5% to 40% (VMs/instances count)
2009 2011
![Page 30: AWS Summit 2011: Customer Presentation - NYTimes](https://reader034.fdocuments.net/reader034/viewer/2022051411/5456190baf79592b448b4cc5/html5/thumbnails/30.jpg)
NYTimes.com EC2
Expansion
EC2 contributes ~26% of total operational cost across DCs
(space, power, bandwidth)
![Page 31: AWS Summit 2011: Customer Presentation - NYTimes](https://reader034.fdocuments.net/reader034/viewer/2022051411/5456190baf79592b448b4cc5/html5/thumbnails/31.jpg)
What’s Next
Multi-AZ and Multi-Region
SNS, SNS2SQS - in Dev
Multi-AZ MySQL RDS
Need 'smarter' ELBNeed
multi-AZ support in VPC
![Page 32: AWS Summit 2011: Customer Presentation - NYTimes](https://reader034.fdocuments.net/reader034/viewer/2022051411/5456190baf79592b448b4cc5/html5/thumbnails/32.jpg)
email: [email protected]: @vadimj
http://www.nytimes.com
http://www.nytimes.com/skimmer/http://timesmachine.nytimes.com
http://open.nytimes.com
http://github.com/nimbul/
images licensed fromhttp://www.dreamstime.com/