Haney and Plough - OTM in the Cloud

OTM in the Cloud

Ryan Haney

The Cloud

The Cloud is a set of services and technologies that delivers real-time and on-demand computing resources

Software as a Service (SaaS) delivers pre-configured applications, usually through web browsers

Infrastructure as a Service (IaaS) delivers complete server and network infrastructure on-demand hosted by a cloud provider

Platform as a Service (PaaS) delivers a solution stack (like LAMP) tailored to certain application types

Cloud Providers Amazon AWS Most popular and largest provider PaaS and IaaS solutions Large number of Cloud datacenters and

services Rackspace Offers Windows and Linux Cloud servers Hybrid cloud model allows for half cloud,

half physical infrastructures Microsoft Windows Azure – Runs Windows and

Linux Has IaaS and PaaS offerings Many other providers, including leading

commodity hardware manufacturers

Benefits to the Cloud Costs No capital expenses, pay as you go

Scale on demand Ease of maintenance, simplified infrastructure Agility in responding to business needs Instances dedicated to UAT, new projects,

patch/upgrade testing created on demand Scripted deployments for fast server

creation and application installation New projects can have server assets in

place in hours versus weeks or months

Audit and regulatory requirements

Downsides to the Cloud Downtime Risks Amazon AWS major outages April 2011 - 36 hours, US East August 2011 – 1 hour, US East June 2012 – 6 hours, 14 hours, US

East

Major cloud providers have SSAE16/SAS70 reports, and are PCI-DSS Level 1 certified

Application expertise High throughput, high performance cloud

offerings are not as fast as traditional hardware Cloud server configurations are limited

Cloud Offerings – Amazon AWS

Amazon m1.xLarge

6.5 ECU, 2 cores

17.1GB RAM

1 Gb Network

420GB Storage

EC2 Storage

Amazon hi1.4xLarge

35 ECU, 8 cores

60.5GB RAM

10 Gb Network

2TB SSD Storage

EC2 Storage

1 ECU provides equivalent CPU to 1-1.2 Ghz 2007 Xeon

Cloud Architecture – Amazon

Elastic Load BalancingInternet

Availability ZoneUS East 1a

Security Group

EC2 InstanceOTM App/Web 01

EC2 Instance OTM App/Web 02

EC2 InstanceDatabase 01

EBS Volume

Security Group

Cloud Offerings – Rackspace

Rackspace Large

4 core CPU

15.8GB RAM

1 Gb Network

620GB Storage

Cloud Architecture – Rackspace

Physical Servers - Commodity

Mid-tier DB

Intel X5675 3.07 Ghz

64GB RAM

1 Gb Network

5.8TB Storage

RAID 5, 15k RPM

Upper-tier DB

Intel E5-2665 2.4 Ghz

96GB RAM

1 Gb Network

6.3TB Storage

RAID 5, 10k RPM

Physical Servers - Commodity

Mid-tier Application

Intel E5630 2.53 Ghz

16GB RAM

1 Gb Network

900GB Storage

RAID 5, 10k RPM

Upper-tier Application

Intel E5-2643 3.3 Ghz

32GB RAM

1 Gb Network

900GB Storage

RAID 5, 15k RPM

Physical Architecture

Costs - Yearly On Demand

2 application/web and 1 database configuration

$0.00

$10,000.00

$20,000.00

$30,000.00

$40,000.00

$50,000.00

$60,000.00

$70,000.00

Mid-tier hardware Upper-tier hardware Amazon AWS Large Amazon AWS High IO Rackspace Large

Year 1

Year 2

Year 3

Ongoing costs for hardware include power, colocation, and bandwidth

Costs – AWS Reserved



$0.00

$10,000.00

$20,000.00

$30,000.00

$40,000.00

$50,000.00

$60,000.00

$70,000.00

Mid-tier hardware Upper-tier hardware Amazon AWS Large Amazon AWS High IO Rackspace Large

Year 1

Year 2

Year 3

Costs – 3 Year TCO On Demand


$0.00

$20,000.00

$40,000.00

$60,000.00

$80,000.00

$100,000.00

$120,000.00

$140,000.00

Mid-tier hardware Upper-tierhardware

Amazon AWSLarge

Amazon AWS HighIO

Rackspace Large

Year 3

Year 2

Year 1


Costs – 3 Year TCO with AWS Reserved



$0.00

$20,000.00

$40,000.00

$60,000.00

$80,000.00

$100,000.00

$120,000.00

Mid-tier hardware Upper-tier hardware Amazon AWS Large Amazon AWS HighIO

Rackspace Large

Year 3

Year 2

Year 1

Benchmarks

DaCapo – Simulates single threaded loads similar to bulk plans

VolanoMark – Simulates multi-threaded, high subsystem I/O loads similar to agent processing, also simulates web traffic

HammerOra – TPCC style Oracle OLTP database benchmark, 70% read 30% write

DaCapo

Lower score is better

0

5000

10000

15000

20000

25000

Rackspace Large Amazon AWS Large Amazon AWS High IO Mid-tier hardware Upper-tier hardware

Average ScoreTim

e (M

illis

econ

ds)

VolanoMark

0

50000

100000

150000

200000

250000

300000

350000

400000

450000


Average Score

Average Per Core

Higher score is better

Con

nect

ions

per

sec

ond

HammerOra

0

50000

100000

150000

200000

250000

300000

350000

1 2 4 8 12 16 20 24 28 30 32 34 36

Tran

sact

ions

per

Min

ute

(Hig

her i

s be

tter

)

Amazon AWS Large

Amazon AWS High IO

Rackspace Large

Mid-tier hardware

Upper-tier hardware

Virtual Users

Cost vs Performance - DaCapo

0

5

10

15

20

25

30


1 Year On Demand

1 Year Reserved


Cost vs Performance - VolanoMark

0

10

20

30

40

50

60

70


On Demand

AWS Reserved


Cost vs Performance - HammerOra


0

2

4

6

8

10

12

14


On Demand

AWS Reserved

Overall Cost vs Performance

AWS reserved instances make current Cloud cost/performance exceed hardware in some cases Database performance per dollar spent is

higher on hardware Storage I/O is the leading factor

Cost vs performance plays to the Cloud’s existing strengths – horizontally scaled applications

RDBMS and other applications that benefit from vertical scale are less cost efficient currently in the cloud

Disaster Recovery on AWS

Availability ZoneUS East 1a


EC2 Instance OTM App/Web 02

Security Group


EBS Volume

Security Group

Route 53 Hosted Zone

Availability ZoneUS West 1a




EBS Volume

Security Group

Elastic Load Balancing

Security Group

Mirroring / Replication

Elastic Load Balancing

Internet

Active DNS

Hybrid OTM DR with the Cloud

OTM Benefits and Usage Development and Test Systems – Agility of

the cloud without the need for high performance Lower costs if reserved AWS servers are

used and if servers are powered off off-hours

Upgrade testing – Test new OTM versions without impacting existing development cycles

Disaster Recovery Running versus non-running billing for

AWS DR system is potentially lower throughput Replicate databases, do not launch app

servers until needed Training – Train users on cloud systems to avoid impacting development cycles

OTM Benefits and Usage Con’t

High Performance Production – Cloud performance still lags behind hardware

Support – Cloud technology is still new, bugs and support difficulties may exist Amazon and Oracle joint support

agreement for EC2 applications Amazon RDS and Oracle Future licensing

Troubleshooting Opacity – Opacity to upstream issues can make troubleshooting OTM performance more difficult

Vendor certification/POC – Validate new OTM related products with lower startup costs

Future Cloud Growth AWS prices are reduced 2-3 times per year,

on average Amazon High I/O instance is the benchmark

for near-future Cloud performance Google has joined the Cloud market with

Google Cloud Platform Growth trends through 2010 show a faster

decrease in Cloud resource prices than corresponding hardware, excluding storage

Future generations of enterprise applications will be tailored to cloud deployments, both public and private

Questions

Haney and Plough - OTM in the Cloud

Technology

Transcript of Haney and Plough - OTM in the Cloud