Post on 15-Jan-2015
description
rockingmongoDBon the cloud
@MilesWard – AWS Solutions Architect
SimpleStableScalable
Simple:Whitepaper - - - >MarketplaceCloudformation
media.amazonwebservices.com/AWS_NoSQL_MongoDB.pdf
Simple:Whitepaper - - - >MarketplaceCloudformation
media.amazonwebservices.com/AWS_NoSQL_MongoDB.pdf
UPDATE COMING SOON
Easy to start a single nodeNo extra cost
Amazon Linux for Premium Support
bit.ly/MZa8Rz
Easy to start a single node?No extra cost
Amazon Linux for Premium Support
bit.ly/MZa8Rz
Easy to start a single node?No extra cost
Amazon Linux for Premium Support
bit.ly/MZa8Rz
single node?
Easy to start a single node?No extra cost
Amazon Linux for Premium Support
bit.ly/MZa8Rz
single node?single node?
Simple:Whitepaper - - - >MarketplaceCloudformation
media.amazonwebservices.com/AWS_NoSQL_MongoDB.pdf
mongodb.org/display/DOCS/Automating+Deployment+with+CloudFormation
Nested
Nodes + Storage
Configurable
Cloudformation: Infrastructure belongs in your source control
Stable:Memory + Storage
3.757.51517.134.268.460.5
< - - -Where you should be
3.75 m1.medium7.5 m1.large15 m1.xlarge17.1 m2.xlarge34.2 m2.2xlarge68.4 m2.4xlarge60.5 cc2.4xlarge
…In Memory!
New Storage Options
• EBS – Provisioned IOPS volumes• Deliver predictable, high performance for I/O intensive workloads• Specify IOPS required upfront, and EBS provisions for lifetime of volume– 1000 IOPS per volume, can stripe to get thousands of IOPS to EC2
instance
• High IO Instances – hi1.4xlarge• For applications that require 10s of thousands of IOPS• Eliminates network latency as a performance constraint to storage
• EBS Optimized Instances• Enables instances to fully utilize IOPS provisioned on an EBS volume• Dedicated instance throughput to EBS – 500 Mbps and 1000 Mbps
EBSPIOPS
SSD
+
Test: random 4k reads
EBS
SSD
One Volume: ~200 MongoOPS with some variability, <1mb/sLoaded instance: ~ 1000 MongoOPS with some variability <10mb/s
One Volume: 1010 MongoOPS with <1% variability, 3mb/sLoaded Instance: 10004 MongoOPS with <1% variability, 30mb/s
Hi1.4xlarge ephemeral: ~64,000 MongoOPS with low variability, ~245mb/s
PIOPS+
Test: random 4k readsSSD
PIOPS+
EBS
random 4k readsSSD
PIOPS+
EBS
Stab
le
Stability TipsSt
able
Ext4 or XFS, nodiratime, noatime
Raise file descriptor limits
Set disk read-ahead
No large virtual memory pages
SNAPSHOT SNAPSHOT SNAPSHOT
Scalable
Scalable:Get Big Fast and shrink quickly too
10 Million records44 GB collection2,000 ops1000% expected growth
1000% expected growth
1000% expected growth
replicate
1000% expected growth
shard
shard
shard
1000% expected growth
shard
shard
shard
1000% expected growth
shard
shard
shard
Scale Both Ways
SSD Scale
SSD SSD SSD
SSD SSD SSD
SSD SSD SSD
Shrink quickly too
Go from m2.4xlarge to m1.medium in
Shrink quickly too
Go from m2.4xlarge to m1.medium in
Three easy steps so that you can save
Shrink quickly too
Go from m2.4xlarge to m1.medium in
Three easy steps so that you can save
90% of the compute cost when you don’t need it…
THANKS!
Miles Ward – AWS Solutions Architect