Pcpratts-cloud Platform Survey

8/2/2019 Pcpratts-cloud Platform Survey

http://slidepdf.com/reader/full/pcpratts-cloud-platform-survey 1/17

Cloud Computing Platform

SurveyPhil Pratt-Szeliga

3/1/2011



Several new servicesexist that provide elastic: Computation

Storage

Web Hosting

Elastic: Pay for what you need by the hour

(Pay only for what you use) Fixed:

Buy the machines and maintain them

(Pay for the maximum load you expect)

Cloud Computing



Three major vendors in Cloud Computing exist today

Microsoft Windows Azure Amazon Elastic Compute Cloud (EC2)

Rackspace Cloud

Rackspace Cloud financially backs the open source

project: OpenStack OpenStack is cloud computing software that runs on the

cloud nodes

I will primarily be focused on interacting with theOpenStack ReST API via Rackspace

Cloud Computing



Server Size Linux Windows

256 MB RAM $0.015 / hour N/A

512 MB RAM $0.03 / hour N/A1 GB RAM $0.06 / hour $0.08 / hour

2 GB RAM $0.12 / hour $0.16 / hour

4 GB RAM $0.24 / hour $0.32 / hour

8 GB RAM $0.48 / hour $0.58 / hour

16 GB RAM $0.96 / hour $1.08 / hour

Rackspace Pricinghttp://www.rackspace.com/cloud/cloud_hosting_products/servers/pricing/

http://www.rackspace.com/cloud/cloud_hosting_products/files/pricing/

Each size has 4 CPU cores (to the best of my knowledge)

Compute

Storage

Space Bandwidth Out Bandwidth In

$0.15 / GB / month $0.18 / GB $0.08 / GB



High Performance Computing withRackspace (8 GB hardware size)

0

5000

10000

15000

20000

0 20 40 60 80 100

C o s t i n

d o l l a

r s

Days of Compute Time

Cost of 18 high performance servers per day

RackSpace Cost

Traditional Cost

Some of our computations take 6 days with 3 local computers.

Rackspace Cost Per Day (18 Computers): $207.36With 18 Rackspace nodes we can complete this in 1 day



OpenStack Compute [1] “Operating System” for the cloud

Manages all resources, networking and authorization OpenStack Storage [2]

Enables redundant, scalable file storage

Platform: Linux / Java

[1] http://www.openstack.org/projects/compute/

[2] http://www.openstack.org/projects/storage/

OpenStack



OpenStack Compute REST APIhttp://docs.rackspacecloud.com/servers/api/v1.0/cs-devguide-20110112.pdf

Authentication

Servers List Servers (including IP

address)

Create Server

Delete Server

Reboot Server Flavors (hardware config)

List Flavors

Get Flavor Details

Images

List Images Create Image

Get Image Details

Delete Image

Backup Schedules List Backup Schedules

Create/Update

Disable



OpenStack Storage REST APIhttp://docs.rackspacecloud.com/files/api/v1/cf-devguide-20110112.pdf

Authentication

Containers

List Containers

List Objects

Create Container

Delete Container

Retrieve Metadata

Object Storage (really Files)

Retrieve Object Create/Update Object Copy Object Delete Object Retrieve Metadata Update Metadata

CDN (Content DistributionNetwork with Akamai) List CDN containers Enable CDN on container



Existing OpenStack API Bindingshttp://www.rackspace.com/cloud/cloud_hosting_products/servers/api/

http://www.rackspace.com/cloud/cloud_hosting_products/files/api/

OpenStack Compute

None

OpenStack Storage

PHP

Python

Ruby

Java .NET

I plan to create Java bindings for OpenStack Compute.

Then I will leverage that to create a Rackspace HPC command and control tool



Create the OpenStackCompute API bindings to: Start a Server Get it’s IP address

Stop a Server

Create a OpenStack Command and Control App: Automatically start N servers Package multiple java .jar files into one .jar Send the single .jar file to the servers and run with command line args Automatically writs results file to OpenStack Storage Automatically shut the servers down when done

Create an example program to do computation Peer-to-Peer matrix multiplication

Final Project Outline



Http REST Client Library

Java: Apache HttpComponents

http://hc.apache.org/

Either XML or JSON parsers

Java: Google JSON parser GSON

http://code.google.com/p/google-gson/

Base64 Encoding

Java: Apache Commons Codec

http://commons.apache.org/codec/

Software Needed to Create Bindings



SCP and SSH clients in Java

sshj is highly regarded on stackoverflow (Google SOC project)

https://github.com/shikhar/sshj

p2pstm (part of my research)

A peer to peer software transactional memory Peers can dynamically change memory in a safe way

Peers can dynamically enter and leave the system

Software Needed to CreateCommand & Control and Example



Passwords storedin a MySQL or MSSQL databaseare often encoded with an MD5 hash

MD5(“password”) =“5f4dcc3b5aa765d61d8327deb882cf99”

If we know “5f4dcc3b5aa765d61d8327deb882cf99” can

we do a brute force computation using Rackspace to findthe password?

I assume the password is not in any dictionaries and noadvanced knowledge of MD5 generation is used

Rackspace Compute Capabilities



password length(72 possible chars)

total blocks of1E6 attempts

CPUcores

Minutes Hours Days Years Cost ($)

1 6.86646E-05 200 3.43323E-08 5.72205E-10 2.38419E-11 6.53202E-14 4.29153E-10

2 0.004943848 200 2.47192E-06 4.11987E-08 1.71661E-09 4.70305E-12 3.0899E-08

3 0.355957031 200 0.000177979 2.96631E-06 1.23596E-07 3.3862E-10 2.22473E-06

4 25.62890625 200 0.012814453 0.000213574 8.89893E-06 2.43806E-08 0.000160181

5 1845.28125 200 0.922640625 0.015377344 0.000640723 1.7554E-06 0.011533008

6 132860.25 200 66.430125 1.10716875 0.046132031 0.000126389 0.830376563

7 9565938 200 4782.969 79.71615 3.32150625 0.009100017 59.7871125

8 688747536 200 344373.768 5739.5628 239.14845 0.655201233 4304.6721

9 49589822592 200 24794911.3 413248.5216 17218.6884 47.17448877 309936.3912

10 3.57047E+12 200 1785233613 29753893.56 1239745.565 3396.563191 22315420.17

Rackspace Compute CapabilitiesCost and Time Estimates for brute force reverse MD5 hash of different password lengths

• This calculation takes very little ram, so we can use the 256MB flavor ($0.015 / hour)• Rackspace allows a max of 50 server instances (each has 4 cores) = 200 total cores• One core can do 1024*1024 attempts in 6 seconds



password length(72 possible chars)

total blocks of1E6 attempts

CPUcores

Minutes Hours Days Years Cost ($)

1 6.86646E-05 200 1.71661E-06 2.86102E-08 1.19209E-09 3.26601E-12 ~0

2 0.004943848 200 0.000123596 2.05994E-06 8.58307E-08 2.35153E-10 ~0

3 0.355957031 200 0.008898926 0.000148315 6.17981E-06 1.6931E-08 ~0

4 25.62890625 200 0.640722656 0.010678711 0.000444946 1.21903E-06 ~0

5 1845.28125 200 46.13203125 0.768867188 0.032036133 8.77702E-05 ~0

6 132860.25 200 3321.50625 55.3584375 2.306601563 0.006319456 ~0

7 9565938 200 239148.45 3985.8075 166.0753125 0.455000856 ~0

8 688747536 200 17218688.4 286978.14 11957.4225 32.76006164 ~0

9 49589822592 200 1239745565 20662426.08 860934.42 2358.724438 ~0

10 3.57047E+12 200 89261680666 1487694678 61987278.24 169828.1596 ~0

Desktop Compute CapabilitiesCost and Time Estimates for brute force reverse MD5 hash of different password lengths

• Assuming computer with 4 cores that basically costs nothing (didn’t includeelectricity)



The cost shown to crack apassword of a certain length is actually thecost to crack an entire list of passwords that length

If someone had the MD5 hashes of all the passwords in asystem they would probably be able to get most of thepasswords in 7 months for $4300

If the minimum password length was increased to 9 or 10characters this is not as feasible.

With a cluster of GPUs (Amazon E2C) the minimum passwordlength may have to be increased even more

Rackspace Compute CapabilitiesConclusions



Slides on how to

Make you own cloud Use the Rackspace Cloud

Demonstrate using Java Bindings for OpenStack Compute

OpenStack Storage

Demonstrate how to use Apache Rest API Demonstrate how to use GSON (Google JSON)

Demonstrate how to use the p2pstm framework

Next Presentation

Pcpratts-cloud Platform Survey

Documents

Transcript of Pcpratts-cloud Platform Survey