MongoDB on Public Clouds : Architecture and Options · Title: 10 questions to ask (and answer) when...

MongoDB on Public Clouds :

Architecture and Options

Dharshan RangegowdaFounder, ScaleGrid.io

@dharshanrg

Copyright © ScaleGrid.io

Cluster Configuration

• Standalone

• Dev & test

• Replica set

• Read scaling

• Typically 2+1 or 3 nodes

• Shards

• Read and write scaling


High Availability

• Standalone vs. Replica set

• No SLA for standalone

instances• Availability zones (AZ)

• Multiple regions

• Availability set

• Multiple regions


Disaster Readiness

• Do you need to handle a

“datacenter down” scenario?

• Entire AWS/Azure region down

• Automatic or manual?

• Distribute replicas across

datacenters

• Security concerns

• Latency concerns


Backups

• Multiple ways to backup

• Mongodump & Mongorestore

• Volume/LVM snapshots

• MongoDB MMS

• EBS snapshots

• S3 upload

• Mongodump & restore

• Storage blob snapshots


Performance

• Choose the right

instance type & size

(R3, I2)

• Enable EBS

optimization

• EBS (magnetic or SSD)

• Provisioned IOPS

• Local SSD (not a

permanent store)


Performance

• Choose “Standard” over “Basic” instance type

• “D_v2 series” usually a good fit – memory optimized

• Disk• Standard disks (upto 500 IOPS)

• RAID for better performance!

• Local SSD (not a permanent store)

• Premium storage


Network

• Classic shared LAN

• SDN (Software defined network)

• Azure App Service Environment (ASE)


Security

• Firewall

• Who has access to the DB?

• AWS

• Security groups

• Azure

• VNET network security groups


Security

• SSL

• Use SSL to encrypt on wire data

• Important for geo distribution

• Disk encryption

• Encryption “at rest”

• Encryption for backups

• AWS

• Native support for encrypted EBS volumes


Scale Up

• Scale up (vertical)

• Larger instance sizes

• More CPU

• More memory

• Larger disks

• on AWS

• EBS snapshots

• on Azure

• Resize underlying blob


Scale Out

• Scale out (horizontal)

• Replica sets

• Add replicas for read scaling

• Doesn’t help with write scaling

• Can have a max of 50 nodes

• Shards

• Add shards for write scaling

• Shard rebalancing takes time


Maintenance Operations

• OS patching

• Periodic & on demand OS patching

• Compact

• Deletes & updates fragment the database

• MongoDB does not auto compact

• MongoDB version upgrade

• Minor versions & Major versions

• Test before your upgrade

• Upgrade server by server


Monitoring

• 24 x 7 monitoring

• OS metrics

• CPU

• Disk IOPS

• Mongo metrics

• Lock %, Read/Write tickets

• Connections

• Disk queues

• Replication delay


Query Analysis

• Regularly monitor query performance

• Problem queries

• Frequent queries

• Slowest queries

• Queries scanning most documents

• Queries returning large number of results

• Queries causing high lock %


Questions?

You can reach me at

• @dharshanrg

• [email protected]


MongoDB on Public Clouds : Architecture and Options · Title: 10 questions to ask (and answer) when...

Documents

Transcript of MongoDB on Public Clouds : Architecture and Options · Title: 10 questions to ask (and answer) when...