AWS for the SQL Server Pro

@LynnLangit

September 2012 – for SQL Saturday

What and Why AWS?

• Amazon’s web services – Amazon’s cloud• Set of services• Market leader– In market longest– Usually cheapest – Most often used in production

Application and/or Data Hosting

• Hosted compute• Hosted data– Relational– Non-relational (NoSQL)– Other, massively parallel (i.e. Hadoop)

• Other services

Amazon Web Services

EC 2 for training, testing and production

S3 and Glacierfor archival storage

Note about EC2 storage

• S3 by default– 10 GB max– 3 copies

• EBS optional– Can store AMIs (persistent)– Can ‘stop’ EC2 instances and ‘re-start’ – saves $$$– Costs more– Can expand– One copy only (faster)

RDSfor full SQL Server and more…

DynamoDBfor fast NoSQL with SSDs

Elastic MapReducefor easy Hadoop

Elastic Beanstalkfor application scalability

Compare Cloud DB – RDBMS or NoSQL

AWS Google Microsoft Others

Cloud RDBMS SQL Server mySQL SQL Azure Hosted RDBMS on Rackspace

noSQL buckets S3, EBS, Glacier Cloud Storage / Google Drive

Azure Blobs Many…

NoSQL databases

DynamoDB H/R Datastore on GAE

Azure Tables Heroku bundles

Streaming Machine Learning

Custom EC2 Prospective Search &Prediction API

StreamInsight & Mahout with Hadoop

Various – Splunk, etc…

Document or Graph

MongoDB on EC2

Freebase (g) MongoDB on Windows Azure

Hosted MongoDB

Hadoop Elastic MapReduce on S3 & EC2

Big Query (HBase-like)

Hadoop (HDFS) on Azure

Cloudera Whirr

Data sets & other

Karmasphere Translation APIFull-text search

Azure DataMarket

Database.com

Costs - Free Tier – EC2

Costs - Free Tier SQL and Dynamo

How much does it cost?

Compare other Cloud ServicesVendor AWS Google Azure

Free tier For new (6 months) For developers For new (30 days)

Compute Elastic Beanstalk Google App Engine Web or Worker Roles

Piece Work Mechanical Turk n/a n/a

Routing Direct Connect none VPN services

Virtual Private Cloud

Virtual Private Cloud none Azure Appliance

Auto-scaling for VMs

w/RightScale for EC2 w/RightScale for GCE

w/RightScale for Azure VMs

Conclusions

• EC2 for testing, training and production (Iaas)• S3 for archiving R/W• Glacier for archiving W only• RDS for HA SQL Server• DynamoDB for fast NoSQL – on SSDs• Elastic Map Reduce for easy Hadoop• Elastic Beanstalk for application scalability (PaaS)

www.TeachingKidsProgramming.org• Free Courseware ( • Do a Recipe Teach a Kid (Ages 10 ++)• Java or Microsoft SmallBasic

• recipes)

Toward Data Craftsmanship…

Follow me @LynnLangit

RSS my blog www.LynnLangit.com

Hire me• To help build your BI/Big Data solution• To teach your team next gen BI• To learn more about using NoSQL solutions