Speaker(s): Marshall Lamb, Lotus Development Brad … · Cloud Computing for the Portal Developer...

Speaker(s):

Cloud Computing for the Portal Developer

Cloud Computing for Developers Hosted by IBM and Amazon Web ServicesOctober 1, 2009

Marshall Lamb, Lotus DevelopmentBrad Schauf, IBM Software Services for Lotus

2 Cloud Computing for Developers hosted by IBM and Amazon Web Services

IBM Software Available on EC2

� A partnership between IBM and AWS that allows you to develop and deliver your applications on the Amazon Elastic Compute Cloud

� Easy to use. Start developing your applications on IBM software on Amazon EC2 in minutes

� No barriers. IBM is providing software at no charge for development & test ofcommercial applications on Amazon EC2. Pay only infrastructure charges - as little as $0.10/hour.

� Pay as you go. Run production versions of leading IBM software products and pay hourly only for what you need, when you need it.

� Portability. Use your existing IBM licenses for most IBM software products in the cloud or on premise - it’s now your choice.

� Products. Currently DB2, Informix Dynamic Server, WebSphere sMash, Lotus Forms Turbo, IBM Mashup Center, WebSphere Application Server, WebSphere eXtreme Scale, WebSphere Portal Server and Lotus Web Content Management. We have announced our intent to offer others.


$1.60$0.88Lotus Forms Turbo

$1.48$0.81WebSphere Application Server

$3.79$1.98IBM Mashup Center

Hourly Price (in USD)

IBM Production ready Amazon Machine ImagesStandard

Small (default)

Standard Large

Standard Extra Large

High CPU Medium

High CPU Extra Large

DB2 Express Edition $0.38 $0.65

DB2 Workgroup Edition $1.31 $2.50 $3.30

Informix Dynamic Server Express Edition $0.38 $0.65

Informix Dynamic Server Workgroup Edition $1.31 $2.50 $3.30

WebSphere sMash $0.50 $0.60

Lotus Web Content Management Server Standard Edition $2.48 $4.82 $8.71

WebSphere Portal Server and IBM Web Content Management Server Standard Edition $6.39 $12.64 $24.35

IBM Production AMIs on EC2 http://aws.amazon.com/IBM


IBM Use Cases

� Proof-of-Concept/Development. Many projects begin by creating development and test environments. Development AMIs are available at no additional fee beyond Amazon EC2 usage fees.

� Steady State Usage. Migrate your existing IBM software licenses to the Amazon cloud and only pay the normal hourly charges for EC2.

� On-Demand Usage. Cost-effective, pay as you go licensing for select IBM software allows you to scale up or down the number of instances to meet your workload demands. This model works well for unpredictable or variable workloads

� Hybrid. Use a combination of steady state licenses for the predictable low water mark and on-demand licenses for the variable workloads.

http://aws.amazon.com/IBM

Cloud Computing for Developers hosted by IBM and Amazon Web Services

What is Portal and Web Content Management?

� Combines portlets (application user interfaces and/or content) together into one unified presentation

� Delivers a highly personalized experience, considering role, personal settings, and device settings

� Separates site design, site/page assembly/administration, from application design

� Includes an enterprise-class content management system for integrating relevant, targeted content with business logic and data

� Provides application integration, collaboration, single sign-on services and much more


What the IBM Portal/WCM AMI includes� WebSphere Portal and Lotus Web Content Management V6.1.0.1

� DB2 Enterprise Edition V9.5

– Configured as both the Portal/JCR database as well as a VMM custom user registry

� SuSE SLES 10 SP2

� Sample WCM Intranet/Internet sites

� New Site Wizard

� “Development mode” configuration for faster startup and smaller memory footprint

� License prohibits clustering

� No formal support

– IBM is monitoring the Amazon EC2 forum to assist as necessary


Amazon Machine Image types

Four AMIs:

� 1 WP/WCM 32-bit Development AMI

– Free for use (pay Amazon for time and space)

� 2 WP/WCM 64-bit Production AMIs

– Additional charge above Amazon fees

– WP Server/WCM Standard Edition

– WCM Standard Edition

� 1 Portal.Next perpetual beta AMI

– Free for use

– 32-bit


Demo instantiation process

� The process:

1 Create a virtual machine based on the size information provided

2 Unpack the AMI into the virtual machine to form its OS image

3 Boot the OS image

4 Configure the instance

� Instance creation can be accomplished through at least 3 different means

– Amazon's Web Console

• Alternatively, the Elastifox Firefox plugin

– Command line utilities

– Direct use of the Amazon Web Services

• Also used by the Web Consoles and command line utilities

� See Links slide for references


What works well in a cloud environment:

� Self contained mashups and portals● LDAP/User directory is self-contained in AWS or synched to AWS

� Mashups and portals that aggregate data from well defined/well performing Web Services:● RSS/ATOM feeds, Google Gadgets (eg CNN news feed)● Salesforce.com or similar SaaS applications● Web Services: StrikeIron, TDI Ameritrade, Xignite, Alexa. Programmable Web…

� Mashups and portals that aggregate with services/solution hosted on AWS● Aggregating an ISV partner solution on AWS (eg CRM. TotalForms)● Aggregating other applications deployed on AWS taking advantage of cost effective infrastructure

Factors to consider when deploying in the cloud:

� Required Network Performance and Uptime:

● Aggregation with in-house applications: Requires live link to in house applications (eg Oracle/Peoplesoft, SAP and 3rd party backend-system) – check and test performance and connectivity is acceptable from the cloud

● Live integration between cloud and On Premise LDAP/Security servers –check and test performance and connectivity is acceptable from the cloud, may be better to federate/host replica in the cloud

� Regulatory compliance – check specific application and organization’s regulatory compliance requirement to determine cloud suitability.

Core use cases


Customer Scenario – “Stepping Stone”

Business Context

� Need to “test” a new product line or online channel with minimal investment and effort

Potential Solutions

� Portal, Website OR Mashup for new “eChannel” for financial services

� Online Forms Processing for supplier/customer extranet

Management Objectives and Key Decisions

� Still need to determine if web channel/business is viable?

� Determine which is better: “pay-as-you-go” or purchase outright?


Customer Scenario – “Stepping Stone”TCO Comparison and Break-even

Key Trade-off: Initial Investment and Funding Flexibility vs Multi-Year TCO Optimization

Pay-as-you-go make sense for projects looking to :

a)Determine viability OR

b)Need to move quickly while procurement of traditional On-premise solution happens in background

c)Large Capex Budget may not be available in the near term

Longer term projects an On-Premise / Bring your own license will make more commercial sense

Cumulative TCO Comparison & Breakeven

$-

$50,000

$100,000

$150,000

$200,000

$250,000

$300,000

$350,000

$400,000

$450,000

0 6 12 18 24 30 36 42

Months

Cu

mu

lati

ve T

CO

On-Premise AWS Pay-As-You-Go AWS Hybrid


Customer Scenario – “Fluctuating Capacity”Business Context

� Large differences between peak and average load, if purchase as BYOL and/or On Premise will be extremely expensive with software and hardware sitting idle much of the year

� May have need for temporary sites where purchase hardware and software for short term use is not viable

Potential Solutions

� Portal, Website OR Mashup Emergency Services, Online Sports/industry Events

� Temporary emergency site – eg H1N1/Swine Flu

� Retail site that gets massive peaks a few time per year

Management Objectives and Key Decisions

� Need to find flexible pay-as-you-go pricing to keep costs affordable

� Determine which is better: “pay-as-you-go” or purchase outright?


Customer Scenario – “Fluctuating Capacity ”TCO Comparison and Break-even

Pay-as-you-go model is very attractive over long term:

�Scale up/down as needed

�Throw-away when done

�Fast setup time

On-premise/BYOL (Hybrid) no viable as massive expense with idle usage.

Cunmulative TCO Comparison & Break-even

$-

$50,000

$100,000

$150,000

$200,000

$250,000

$300,000

$350,000

$400,000

$450,000

$500,000

Year 1 Year 2 Year 3 Year 4

Cu

mu

lati

ve T

CO

On-Premise AWS Hybrid AWS Pay-as-you-go


� Production use

– Platform for BP/ISV SaaS deployments on AWS

– Temporary solution needs

– Open Standard Reference implementation hosting and interoperability testing

� Development/trial use

– Warehouse for demo, Beta, hosted trials, and POT/POC instances for customer use

– Development/test system augmentation

Other use cases


Where do I start?

1)Use the IBM PAID AMIs�Deploy your own solutions on our proven, prepackaged, pre-tuned instances

and pay IBM as you go

�Don't worry with maintaining your own AMIs

2)Repackage one of our AMIs to contain your solution

�Development or Paid AMIs

�Still tracked using an IBM-owned Amazon product code

�Machine instances all inherit your baseline Portal/WCM configuration

3)Bring you own license�Buy our software up front and deploy your own AMI on AWS

�Pay Amazon only for the time and space

�Engage an IBM Business Partner to help you do it


Hints & Tips when building your own AMIs� 10GB root file system is not a lot of space to work with

– Think about compressing portions of the solution and expanding them into mounted volumes at instance creation time

� Use Elastic Block Storage (EBS) volumes for important data

– Product configuration, application deployments, and user data need to reside in EBS

– New instances can pick up where old instances fail by remounting EBS volumes

� Link stack configuration with the initial boot sequence

– Either through instance user data or panel sequences

– Include such things as user password resets and hostname propagation throughout stack

– Have a way to reset the VM such that the config process restarts at next boot – done just prior to building new AMIs

� AMI rebuilds are time consuming and take space

– Consider leveraging the Simple Storage Service (S3) to maintain deltas that are loaded dynamically into new instances

– AMIs represent baseline configurations that are updated from S3 at instance creation


Product opportunities and direction� Working on “headless” instantiation to support AWS AutoScale and Cloudfront

� Run our continuous open beta from AWS as an added dimension

� Introduce more OOB site templates and examples

� Test with the new Virtual Private Cloud services for Enterprise connectivity

� Vet operational advancements

� Improved self-service and site customization

� WCM/Portal integration around site management

� Portal farming as the simplified scaling/HA model


Observations

� The server farm beneath AWS is impressively powerful

� Performance and capacity nearly the same as a local native install

– Even taking into account Internet latency

� Portlet Factory IDE run from within an instance is usable acrossthe globe

� Remember, these instances ARE on the Internet

� Don't use obvious root passwords

� Don't store important data on the local EC2 instance's file system

� Instances cannot be recovered if terminated


Observations - continued

� A 10 GB root file system is NOT a lot to work with

� Be careful of how much you try to install and where volatile/transient data is stored

� The hardest part about building AMIs was getting the instantiation/localization process successfully tied into the installed product

� No functional issues with the running product

� Using AWS is CHEAP

� My entire development efforts in December cost only $234

� Don't keep unnecessary AMIs, EC2 instances, or EBS volumes around

� While inexpensive, the costs can accumulate unnecessarily


Lessons Learned from packaging an AMI

� Read the Getting Started Guide– Can be found under links at the end

� Ensure your terminal session (putty, ssh, etc) will not time out– The ecs-bundle-vol and ec2-upload-bundle can take a while!

– Loose your session, loose your work!

– Add “ServerAliveInterval=240” to your ~/.ssh/config file

– Adjust Putty timeout settings

� Prepare! – Copy your certificates (cert.pem and pk.pem) and create a directory to hold

the bundle BEFORE you reset the VM

– If you try to connect to the instance after the VM is reset, it thinks the license has not been accepted and the instance will terminate and you will loose all your work.



� Clean up after yourself! – Remember to remove those zip and jar files when you are installing

updates

– 10GB is not much space, really, it isn’t…

– Ever run out of space during a ConfigEngine or Portal Update? No Fun

� Don’t forget about Security Group ports– Make sure they contain the ports your application will require

– Examples for Portal

• 10027 Application server administration console port

• 10040 Default HTTP Port for Portal

• 10041 – IBM Console SSL

• 22 – ssh

• 5900 – vnc

• 80 - web server



� If you update a base Portal AMI with a fix or fixpack…– Ensure your database drivers and jcr passwords are still correct or your

image will not localize correctly (wrong/old host names will persist)

• neccessary_tasks.xml

• wkplc_comp.properties

� Portal AMI – Content Source Configurations

– Remove AWS hostname from “Collect Documents Linked from this URL field” and replace with “localhost”

• Otherwise search will try to index using a non-existant server name

� Remember the IBM Portal AMI's have developer mode enabled– Disable if not needed or alter the lazy load list

– If not, you will get strange "Problem: not found" and other strange behavior when using WCM Authoring and other functions


Thank you for attending.

� Please share your feedback for today’s sessions

– Leveraging Forms/AWS….url to come

� All sessions from today’s Virtual Event will be posted for on-demand viewing along with supportive materials

– http://www.ibm.com/developerworks/offers/cloudcomputing/

� We want to continue to hear from you! Stay connected through our Cloud Computing Central Community

Speaker(s): Marshall Lamb, Lotus Development Brad … · Cloud Computing for the Portal Developer...

Documents

Transcript of Speaker(s): Marshall Lamb, Lotus Development Brad … · Cloud Computing for the Portal Developer...