Azureus Reborn:Cloud-file Converter

Kyle Thurow, Kyle Neuschaefer, Alexander Matusiak, and Justin Carroll

Problem StatementFile conversion can be a computationally

intensive task. Takes up many CPU cycles, rendering some

computers inoperableTargets netbooks / weaker computers and

power users

What is Cloud-file Converter?A cloud based sand-box with clearly defined

exit and entry paths that can be configured for a wide range of uses

Consists of three main portions of code:1. Windows Server 2008 Uploader (ASP.NET &

C#)2. Linux Head Node (Unix scripting)3. Black Box

Our black box for this project is a Java MP3 Conversion Algorithm

Design RequirementsSimple, easy to useReusable componentsLittle to no communication between

componentsWell defined entry and exit pointsTake advantage of the algorithm black box

Design SpecificationASP.NET web pages designed so that limited user

input is requiredAccessIDSecretAccessIDBucketName

An image of the Webserver was made, so anyone now can take the image and boot it on Amazon

All communication takes places through S3 storage

MP3 algorithm takes advantage of the black box nature of the algorithm

ImplementationLinux computational node, Windows Web server, and Conversion Algorithm

Architecture

Interplay of ComponentsEverything communicates through Amazon

S3 storageMySQL / SQL server option had been

exploredWe would have to integrate it into-

Unix scripting C# and .ASHX / jquery Java

Windows 2008 File UploaderImplementation

• microsoft/Microsoft Web Platform - Full Web Server Development Stack (04-11-2010)

• ami-7b6b3a3e• C# and ASP.NET

The Uploader-Design ChoicesWritten in ASP.NETCode behind in C#All files loaded to the server first

By choosing a website all code is executed on the server

Files will exist in memory anywayLimited ability to view stored S3 files

Instance retrieval gathers files in a class difficult to connect to a gridview

The UploaderUser access keySecret Access KeyBucket Name

Credentials are stored on the server

Permanent until next cycle (csv .txt file)

The UploaderOpen source flash

uploaderCSS class for button

GUI.ASHX script Delegate in the C# code

for Amazon upload logic (OnAllComplete)

S3 Upload codeCreate bucketActual file upload

The UploaderDifficulties

constructing an instance of a datatable and binding it to a GridView

Solution: simply list uploaded files, converted files, and file details according to index

The UploaderInitiates a download

from the serverAny files in the

“converted” folder will be downloaded

Issues encountered: .NET security settingsSolution: open

privileges for any user

The ImageWindows Web Development Server image

released by Microsoft, exclusive to US WestIIS is already preconfigured to host a web

siteRemote Desktop provides a simple method to

access the computer and change settings on the fly

Microsoft Visual Studio 2010 provides a “web deploy” option for release software

A few tweaks to the web.config file, security settings, and server paths and the website is live.

Linux Resource Management SystemImplementation

MP3 Conversion AlgorithmImplementation

SoXUnavailable in Amazon reposLacks mp3 support in fedora reposFedora missing media librariesCompiled from scratch

Converting to ogg vorbis audio

Deployment/Usage1) Boot up web server and Linux head node.

2) Go to Cloud-converter webpage.

3) Upload files.

4) Wait for files to convert.

5) Download files.

The Setup

The UploaderFormed from base Microsoft Web Server image

The ImageBased on Amazon LinuxAdd repos, install software

Condor, s3fs

DemonstrationVisual Studio local copy {stable}ec2-204-236-154-156.us-west-

1.compute.amazonaws.com/Welcome.aspx

EvaluationCloud

Positives Source computations away from your computer Your computer remains useful while important calculations are

completedNegatives

Reliant on internet connectivity Amazons continuing operation

LocalPositives

Local implementation is more stable, data more secureNegatives

May render weaker computers useless for extended periods of time