Rocking mongo db on the cloud

Post on 15-Jan-2015

2.595 views 0 download

Tags:

description

 

Transcript of Rocking mongo db on the cloud

rockingmongoDBon the cloud

@MilesWard – AWS Solutions Architect

SimpleStableScalable

Simple:Whitepaper - - - >MarketplaceCloudformation

media.amazonwebservices.com/AWS_NoSQL_MongoDB.pdf

Simple:Whitepaper - - - >MarketplaceCloudformation

media.amazonwebservices.com/AWS_NoSQL_MongoDB.pdf

UPDATE COMING SOON

Easy to start a single nodeNo extra cost

Amazon Linux for Premium Support

bit.ly/MZa8Rz

Easy to start a single node?No extra cost

Amazon Linux for Premium Support

bit.ly/MZa8Rz

Easy to start a single node?No extra cost

Amazon Linux for Premium Support

bit.ly/MZa8Rz

single node?

Easy to start a single node?No extra cost

Amazon Linux for Premium Support

bit.ly/MZa8Rz

single node?single node?

Simple:Whitepaper - - - >MarketplaceCloudformation

media.amazonwebservices.com/AWS_NoSQL_MongoDB.pdf

mongodb.org/display/DOCS/Automating+Deployment+with+CloudFormation

Nested

Nodes + Storage

Configurable

Cloudformation: Infrastructure belongs in your source control

Stable:Memory + Storage

3.757.51517.134.268.460.5

< - - -Where you should be

3.75 m1.medium7.5 m1.large15 m1.xlarge17.1 m2.xlarge34.2 m2.2xlarge68.4 m2.4xlarge60.5 cc2.4xlarge

…In Memory!

New Storage Options

• EBS – Provisioned IOPS volumes• Deliver predictable, high performance for I/O intensive workloads• Specify IOPS required upfront, and EBS provisions for lifetime of volume– 1000 IOPS per volume, can stripe to get thousands of IOPS to EC2

instance

• High IO Instances – hi1.4xlarge• For applications that require 10s of thousands of IOPS• Eliminates network latency as a performance constraint to storage

• EBS Optimized Instances• Enables instances to fully utilize IOPS provisioned on an EBS volume• Dedicated instance throughput to EBS – 500 Mbps and 1000 Mbps

EBSPIOPS

SSD

+

Test: random 4k reads

EBS

SSD

One Volume: ~200 MongoOPS with some variability, <1mb/sLoaded instance: ~ 1000 MongoOPS with some variability <10mb/s

One Volume: 1010 MongoOPS with <1% variability, 3mb/sLoaded Instance: 10004 MongoOPS with <1% variability, 30mb/s

Hi1.4xlarge ephemeral: ~64,000 MongoOPS with low variability, ~245mb/s

PIOPS+

Test: random 4k readsSSD

PIOPS+

EBS

random 4k readsSSD

PIOPS+

EBS

Stab

le

Stability TipsSt

able

Ext4 or XFS, nodiratime, noatime

Raise file descriptor limits

Set disk read-ahead

No large virtual memory pages

SNAPSHOT SNAPSHOT SNAPSHOT

Scalable

Scalable:Get Big Fast and shrink quickly too

10 Million records44 GB collection2,000 ops1000% expected growth

1000% expected growth

1000% expected growth

replicate

1000% expected growth

shard

shard

shard

1000% expected growth

shard

shard

shard

1000% expected growth

shard

shard

shard

Scale Both Ways

SSD Scale

SSD SSD SSD

SSD SSD SSD

SSD SSD SSD

Shrink quickly too

Go from m2.4xlarge to m1.medium in

Shrink quickly too

Go from m2.4xlarge to m1.medium in

Three easy steps so that you can save

Shrink quickly too

Go from m2.4xlarge to m1.medium in

Three easy steps so that you can save

90% of the compute cost when you don’t need it…

THANKS!

Miles Ward – AWS Solutions Architect