Rocking mongo db on the cloud

33
rocking mongoDB on the cloud @MilesWard – AWS Solutions Archi

description

 

Transcript of Rocking mongo db on the cloud

Page 1: Rocking mongo db on the cloud

rockingmongoDBon the cloud

@MilesWard – AWS Solutions Architect

Page 2: Rocking mongo db on the cloud
Page 3: Rocking mongo db on the cloud

SimpleStableScalable

Page 4: Rocking mongo db on the cloud

Simple:Whitepaper - - - >MarketplaceCloudformation

media.amazonwebservices.com/AWS_NoSQL_MongoDB.pdf

Page 5: Rocking mongo db on the cloud

Simple:Whitepaper - - - >MarketplaceCloudformation

media.amazonwebservices.com/AWS_NoSQL_MongoDB.pdf

UPDATE COMING SOON

Page 6: Rocking mongo db on the cloud

Easy to start a single nodeNo extra cost

Amazon Linux for Premium Support

bit.ly/MZa8Rz

Page 7: Rocking mongo db on the cloud

Easy to start a single node?No extra cost

Amazon Linux for Premium Support

bit.ly/MZa8Rz

Page 8: Rocking mongo db on the cloud

Easy to start a single node?No extra cost

Amazon Linux for Premium Support

bit.ly/MZa8Rz

single node?

Page 9: Rocking mongo db on the cloud

Easy to start a single node?No extra cost

Amazon Linux for Premium Support

bit.ly/MZa8Rz

single node?single node?

Page 10: Rocking mongo db on the cloud

Simple:Whitepaper - - - >MarketplaceCloudformation

media.amazonwebservices.com/AWS_NoSQL_MongoDB.pdf

Page 11: Rocking mongo db on the cloud

mongodb.org/display/DOCS/Automating+Deployment+with+CloudFormation

Nested

Nodes + Storage

Configurable

Cloudformation: Infrastructure belongs in your source control

Page 12: Rocking mongo db on the cloud

Stable:Memory + Storage

Page 13: Rocking mongo db on the cloud

3.757.51517.134.268.460.5

< - - -Where you should be

Page 14: Rocking mongo db on the cloud

3.75 m1.medium7.5 m1.large15 m1.xlarge17.1 m2.xlarge34.2 m2.2xlarge68.4 m2.4xlarge60.5 cc2.4xlarge

…In Memory!

Page 15: Rocking mongo db on the cloud

New Storage Options

• EBS – Provisioned IOPS volumes• Deliver predictable, high performance for I/O intensive workloads• Specify IOPS required upfront, and EBS provisions for lifetime of volume– 1000 IOPS per volume, can stripe to get thousands of IOPS to EC2

instance

• High IO Instances – hi1.4xlarge• For applications that require 10s of thousands of IOPS• Eliminates network latency as a performance constraint to storage

• EBS Optimized Instances• Enables instances to fully utilize IOPS provisioned on an EBS volume• Dedicated instance throughput to EBS – 500 Mbps and 1000 Mbps

EBSPIOPS

SSD

+

Page 16: Rocking mongo db on the cloud

Test: random 4k reads

EBS

SSD

One Volume: ~200 MongoOPS with some variability, <1mb/sLoaded instance: ~ 1000 MongoOPS with some variability <10mb/s

One Volume: 1010 MongoOPS with <1% variability, 3mb/sLoaded Instance: 10004 MongoOPS with <1% variability, 30mb/s

Hi1.4xlarge ephemeral: ~64,000 MongoOPS with low variability, ~245mb/s

PIOPS+

Page 17: Rocking mongo db on the cloud

Test: random 4k readsSSD

PIOPS+

EBS

Page 18: Rocking mongo db on the cloud

random 4k readsSSD

PIOPS+

EBS

Stab

le

Page 19: Rocking mongo db on the cloud

Stability TipsSt

able

Ext4 or XFS, nodiratime, noatime

Raise file descriptor limits

Set disk read-ahead

No large virtual memory pages

SNAPSHOT SNAPSHOT SNAPSHOT

Page 20: Rocking mongo db on the cloud

Scalable

Page 21: Rocking mongo db on the cloud

Scalable:Get Big Fast and shrink quickly too

Page 22: Rocking mongo db on the cloud

10 Million records44 GB collection2,000 ops1000% expected growth

Page 23: Rocking mongo db on the cloud

1000% expected growth

Page 24: Rocking mongo db on the cloud

1000% expected growth

replicate

Page 25: Rocking mongo db on the cloud

1000% expected growth

shard

shard

shard

Page 26: Rocking mongo db on the cloud

1000% expected growth

shard

shard

shard

Page 27: Rocking mongo db on the cloud

1000% expected growth

shard

shard

shard

Page 28: Rocking mongo db on the cloud

Scale Both Ways

Page 29: Rocking mongo db on the cloud

SSD Scale

SSD SSD SSD

SSD SSD SSD

SSD SSD SSD

Page 30: Rocking mongo db on the cloud

Shrink quickly too

Go from m2.4xlarge to m1.medium in

Page 31: Rocking mongo db on the cloud

Shrink quickly too

Go from m2.4xlarge to m1.medium in

Three easy steps so that you can save

Page 32: Rocking mongo db on the cloud

Shrink quickly too

Go from m2.4xlarge to m1.medium in

Three easy steps so that you can save

90% of the compute cost when you don’t need it…

Page 33: Rocking mongo db on the cloud

THANKS!

Miles Ward – AWS Solutions Architect