Dynacache in WebSphere Portal Server
-
Upload
rohit-kelapure -
Category
Documents
-
view
6.628 -
download
10
Transcript of Dynacache in WebSphere Portal Server
©2012 IBM Corporation
IBM Exceptional Web Experience Conference 2012 - Americas
May 21 – 24, 2012 Austin, Texas
TECH-P30Build and Deliver Increased Web Experience Platform Performance with IBM WebSphere Extreme Scale
Benjamin Parees, Software Engineer, XC10 Caching Appliance Development, IBM
© 2012 IBM Corporation2
Exceptional Web Experience Conference 2012 - Americas
Session Overview
TECH-P30
Build and Deliver Increased Web Experience Platform Performance with IBM WebSphere Extreme ScaleBenjamin Parees, Software Engineer, XC10 Caching Appliance Development, IBM
WebSphere Portal can make extensive use of the WebSphere dynamic cache feature for performance optimization. IBM WebSphere eXtreme Scale & WebSphere DataPower XC10 Appliance augment these services by providing a more powerful elastic cache solution that can extend both scale and performance improvement to meet increasing business web platform presentation demands. Attend this session to learn how WebSphere Portal and Web Content Manager (Version 7 and higher releases) can leverage WebSphere eXtreme Scale & WebSphere DataPower XC10 Appliance to greatly increase total cache capacity and eliminate redundant content rendering. This combination can achieve a potential reduction in response time, greater application server throughput, and facilitates faster startup time for new WebSphere Portal servers added to a cluster. Perhaps just as impressive is the fact this can be accomplished with relatively simple configuration changes. This session will deliver the technical capabilities and business benefits of extending yourWebSphere Portal solution to leverage WebSphere eXtreme Scale capabilities for dynamic cache management needed by many organizations today.
Exceptional Web Experience Conference 2012 - Americas
© 2012 IBM Corporation3
Exceptional Web Experience Conference 2012 - Americas
Agenda
● Motivation● Overview of DynaCache and the Portal Advanced Cache● Review Performance Results● Configuration Overview● eXtreme Scale and XC10 Background
Exceptional Web Experience Conference 2012 - Americas
© 2012 IBM Corporation4
Exceptional Web Experience Conference 2012 - Americas
Market Drivers• The competition is only a click away in today's
web-facing world.
• Response times are critical to giving customers a good experience and generating revenue.
• Customer sessions are becoming more critical.
• The cost of attracting new customers to your web site for enrollment is significant.
• Losing the data that they have entered will likely create a negative impression and result much higher abandonment rates
© 2012 IBM Corporation5
Exceptional Web Experience Conference 2012 - Americas
Market Drivers
© 2012 IBM Corporation6
Exceptional Web Experience Conference 2012 - Americas
Elastic Caching minimizes the impact of Transaction Overload
Web Server Tier Back-end SystemsDatabase Tier
App Server Tier Elastic Cache
IBM HTTP ServerIBM HTTP Server WebSphere Application Server
WebSphere Application Server DB2 UDBDB2 UDB
Improve Performance, Scalability & Availability
Highly Scalable Web Applications
Data-intensive Applications
Extreme Performance
© 2012 IBM Corporation7
Exceptional Web Experience Conference 2012 - Americas
Applications using DynaCache
Each JVM has a private disk based cache to support caches much larger than possible with a memory only conventional cache
2 tier cache: JVM has a small local cache, then the disk file.
Cached content is redundant across JVMs
© 2012 IBM Corporation8
Exceptional Web Experience Conference 2012 - Americas
Portal Advanced Cache
● DynaCache instance used to store rendered content● Specifically content pulled from a Web Content Manager database● Configuration used
Site level caching (rendered content)
30 day expiration
Do not clear cache on startup
© 2012 IBM Corporation9
Exceptional Web Experience Conference 2012 - Americas
During a recent ‘News’ application promotion, the customer response to the new portlet overwhelmed the web-site. The web-site became painfully slow under the significant load. The result, not a happy customer…
W e l c o m e , U s e r !
!#*!
… too slow!
DynaCache disk-offload
DynaCache disk-offload
DynaCache disk-offload
DynaCache disk-offload
WPS
News Portlet Deployment - Failure
WPS
WPS
WPS
© 2012 IBM Corporation10
Exceptional Web Experience Conference 2012 - Americas10
Scalability: Off-loading Dynamic cache to WXS/XC10Much larger cache capacity
WebSphere Portal JVMs run more efficiently
– Lower local memory requirements
– Faster start-up time
Improved consistency of performance
– Improved cache and environment stability
– High availability of cached data
© 2012 IBM Corporation11
Exceptional Web Experience Conference 2012 - Americas
W e l c o m e , U s e r !
W X S
Elastic cache
WPS
WPS
WPS
WPS
During a recent ‘News’ application promotion, the customer response to the new portlet was very high. However, with addition of an elastic cache the web-site was able to handle the significant increase in load. The customers did not perceive any slow down of the web-site. The result, happy customers and a successful content promotion…
News Portlet Deployment - Success
With WXS DynaCache Grid configured, disk-offload is no longer required
© 2012 IBM Corporation12
Exceptional Web Experience Conference 2012 - Americas
W e l c o m e , U s e r !
W X S
Elastic cache
WPS
WPS
WPS
WPS
Fast start-up when adding more capacity – on the fly
WPS
New Server
New WebSphere Portal servers can be brought on-line quickly to meet increased capacity needs. When start-up is complete, the new server has immediate access to a warm cache provided by eXtreme Scale.
© 2012 IBM Corporation13
Exceptional Web Experience Conference 2012 - Americas
W e l c o m e , U s e r !
W X S
Elastic cache
WPS
WPS
WPS
WPS
Maintain consistent user experience during site maintenance
WPS Down for maintenance
If a WebSphere Portal server needs to be restarted after applying an iFix, eXtreme Scale can provide up to 54% improvement in time to reach steady-state
© 2012 IBM Corporation14
Exceptional Web Experience Conference 2012 - Americas
Scenario Details
● Two Portal Servers with Web Content Manager
● Single WCM DB Server
● Two XC10 Caching Appliances
● Advanced Cache maximum entries
Using App Server heap: 5000 per server
Offloading to XC10: 1,000,000 shared available (Observed ~9 gigs)
● 300 concurrent users simulating Wiki/Blog accesses
● Web Content Manager DB content: 50 gigs
WPS+WCM
WPS+WCM
WCM DB
2 XC10 Collective
Proxy
© 2012 IBM Corporation15
Exceptional Web Experience Conference 2012 - Americas
Portal Customer Experience – Steady State Comparison
● Enabling WebSphere Content Manager Advanced Cache using an offloaded eXtreme Scale/XC10 grid cache
● With WXS/XC10 average throughput in our steady state/concurrent user scenario was consistently faster than with Default Advanced Cache
42% improvement over no Advanced Cache in our scenario
24% throughput improvement over default cache implementation using Application Server JVM heap in our scenario
● Using the Default Advanced Cache implementation requires available Application Server heap, offloading the cache to WXS/XC10 does not require heap
● Performance is based on measurements and projections using standard IBM benchmarks in a controlled environment. Actual performance in a user's environment may vary.
Throughput(requests/second)50
60
70
80
90
100
Default WCM Advanced CacheWCM Advanced Cache Offloaded to XC10
Throughput(requests/second)50
60
70
80
90
100
No WCM Advanced CacheWCM Advanced Cache Offloaded to XC10
Cache Offload Performance
© 2012 IBM Corporation16
Exceptional Web Experience Conference 2012 - Americas
Portal Customer Experience – Steady State Comparison
Cache Offload Performance● With WXS/XC10 average steady state response-times are consistently faster than with Default WebSphere Content Manager Advanced Cache
5.5 second improvement over no Advanced Cache in our scenario
3.4 second improvement over default cache implementation using Application Server JVM heap in our scenario
● Performance is based on measurements and projections using standard IBM benchmarks in a controlled environment. Actual performance in a user's environment may vary.
Response Time(seconds)4
6
8
10
12
14
16No WCM Advanced CacheWCM Advanced Cache Offloaded to XC10
Response Time(seconds)4
6
8
10
12
14
16
Default WCM Advanced CacheWCM Advanced Cache Offloaded to XC10
© 2012 IBM Corporation17
Exceptional Web Experience Conference 2012 - Americas
Reducing Portal warm-up time – Cold Start Results● With WXS/XC10 average throughput of a
newly started server is consistently faster than with Default WebSphere Content Manager Advanced Cache
54% throughput improvement in our scenario
● With WXS/XC10 average response-times are consistently faster than with Default Advanced Cache
4 second improvement observed in our scenario
● With WXS/XC10 response times improve faster due to quicker cache hydration
● Performance is based on measurements and projections using standard IBM benchmarks in a controlled environment. Actual performance in a user's environment may vary.
Cache Offload Performance
Throughput(requests/second)30
40
50
60
70
80
90
Default Advanced CacheAdvanced Cache Offloaded to XC10
Response Time(seconds)4
6
8
10
12
14
16
Default Advanced CacheAdvanced Cache Offloaded to XC10
© 2012 IBM Corporation18
Exceptional Web Experience Conference 2012 - Americas
Summary of Primary Benefits
● WCM Advanced Cache implemented through the DynaCache, stores fully rendered pages that do not have to be pulled out of WCM DB. Today customers can enable Advanced Cache in the app server’s heap space. Technical goal is to avoid trips back to the WCM database to avoid building these pages. WXS plugin allows you to store the DynaCache content in a remote grid, so that the data being inserted into DynaCache does not consume app server heap space. 1. Caching is of highest importance with WCM. Complex WCM components can be very CPU
intensive2. WXS grid can store more data, have a larger hit percentage than DynaCache and reduce trips to
WCM DB which is more expensive. (More consistent Response times)3. Benefits customers who are heaped constrained (no DynaCache) can leverage the Advanced
Cache by not committing memory on their Portal server. The WXS scenario does not consume memory on the Portal server.
4. Shared cache, each portal JVM does not have to warm its cache on server restarts5. Eliminates invalidation chatter.. critical in the farm topology
© 2012 IBM Corporation19
Exceptional Web Experience Conference 2012 - Americas
Client Usage: eCommerce Retailer
Catalog page cache
1k page views/sec
Faster startup
JVM restarts are nondisruptive
Cache consistency
One of the largest ecommerce sites–Befor e: Existing WebSphere Commerce Server customer.
–Per JVM catalog cache lead to lots of memory wastage and cache warming problems on cluster start as well as JVM restarts
–After : –Moving to a shared cache using WXS, speeds cluster start time by 60%
–customer response times see no impact from JVM restarts.
–Memory is dramatically reduced. –Catalog consistency is better (time based promotions)–Less CPU used
© 2012 IBM Corporation20
Exceptional Web Experience Conference 2012 - Americas
Configuration Steps
● Install eXtreme Scale client on WebSphere Portal● Point WebSphere to grid endpoints (XC10)● Create a new grid● Update the DynaCache instance settings● Restart the server instance
© 2012 IBM Corporation21
Exceptional Web Experience Conference 2012 - Americas
Product Versions
Plus APAR PM63259 (targeted for Portal CF14 and Web Content Manager CF31)
© 2012 IBM Corporation22
Exceptional Web Experience Conference 2012 - Americas
Catalog Service Configuration
© 2012 IBM Corporation23
Exceptional Web Experience Conference 2012 - Americas
Creating a new grid
Click + to create a new cache
Type the name
Click OK
1
2
3
4
Select the cache type
© 2012 IBM Corporation24
Exceptional Web Experience Conference 2012 - Americas
Cache Instance Configuration
© 2012 IBM Corporation25
Exceptional Web Experience Conference 2012 - Americas
DynaCache Instance Configuration
© 2012 IBM Corporation26
Exceptional Web Experience Conference 2012 - Americas
So, what are eXtreme Scale and XC10 anyway?
© 2012 IBM Corporation27
Exceptional Web Experience Conference 2012 - Americas
Scales from simple in-process topologies to powerful distributed
topologies.
It can be used as a platform for building powerful Extreme
Transaction Processing (XTP) / Data Grid
applications.
Can be used as a form of in memory database to manage
application state.
A distributed caching platform.It takes the free memory across a number of Java™
Virtual Machines (JVM™) and marshals them into one logical cache.
New York San Francisco
London Shanghai
© 2012 IBM Corporation28
Exceptional Web Experience Conference 2012 - Americas
Modern Application Infrastructure Topology
Web Ser ver Tier Database TierApp Ser ver Tier Elast ic Data Gr id
WebSpher e Applicat ion Ser ver
DB2 UDB
DataPower XC10 for simple data oriented scenarios:• HTTP Session Replication• Elastic Dynacache• Web Side Cache• REST Cache
eXtreme Scale for maximum flexibility covering data and application oriented scenarios
1
2
XC10
© 2012 IBM Corporation29
Exceptional Web Experience Conference 2012 - Americas
IBM WebSphere eXtreme Scale• Proven mature product:
– Fourth major release of product with V7.1– Public References– Private References– Used at some of the largest web sites/companies in
the world
• Lightweight runtime footprint (20MB jar)
• Integrates with all versions of WebSphere and almost any Java-based application container or Java Virtual Machine
• Proven multi-data center capabilities
• Proven low-latency access to data
© 2012 IBM Corporation30
Exceptional Web Experience Conference 2012 - Americas
IBM WebSphere DataPower XC10 V2
New Form Factor (2U) Larger Cache (240 GB) Better Performance (Faster SSD, Use of RAM) Improved monitoring (SNMP Support) Support for non-Java Applications (REST Gateway) Grid Capping
© 2012 IBM Corporation31
Exceptional Web Experience Conference 2012 - Americas
Scale out with Ease
• 240 GB (new in 2.0) elastic cache for your business-critical applications
• Scales elastically without application downtime
• Linear, predictable scaling at predictable cost
• Quickly and easily increase cache capacity as needs grow
• Unbinds cache from application server memory constraints
© 2012 IBM Corporation32
Exceptional Web Experience Conference 2012 - Americas
Innovative Elastic Caching Solutions“Data Oriented”
“Application Oriented”
Session management
Elastic DynaCache
Web side cache
Event Processing
In-memory OLTP
Worldwide cache
Petabyte analytics
Data buffer
In-memory SOA
eXtreme Scale
DataPower XC10 Appliance
• Ultimate flexibility across a broad range of caching scenarios
• In-memory capabilities for application oriented scenarios
• Drop-in cache solution optimized and hardened for data oriented scenarios
• High density, low footprint improves datacenter efficiency
Elastic caching for linear scalabilityHigh availability data replication
Simplified management, monitoring and administration
© 2012 IBM Corporation33
Exceptional Web Experience Conference 2012 - Americas
Utilizing WebSphere DataPower XC10 for DynaCache
Clients can attach to the ‘cache’ using the network
No dependency on a large file system cache.
No disk dependency, no SAN required.
Cache is as large as the memory in the ‘grid’.
Each record is stored once in the grid and shared by all clients.
Network
XC10 Collective
© 2012 IBM Corporation34
Exceptional Web Experience Conference 2012 - Americas34 DataPower XC10 Overview
Elastic Dynamic Cache service support
• No new code required• WebSphere DataPower XC10 and WebSphere eXtreme Scale
provide client code and a plug-in for WebSphere Application Server applications to support Dynamic Cache API
• Allows applications deployed to WebSphere servers to use WebSphere DataPower XC10 or WebSphere eXtreme Scale as a “drop-in” cache, instead of storing cache data in local memory or multiple instances of a disk cache
© 2012 IBM Corporation35
Exceptional Web Experience Conference 2012 - Americas
Traditional Cache Operation
App
App
App
App
EIS
A
A
A
A
App
Invalidatio n chatterInvalidatio n chatter
■ Cache capacity determined by individual JVM Size.■ Size of each cache = M■ # JVMs = N■ To ta l c a c he = M■ Invalidation load per server increases as cluster grows.■ Cold start servers hit the database.
© 2012 IBM Corporation36
Exceptional Web Experience Conference 2012 - Americas
Extreme Scale based Cache Operation
Exceptional Web Experience Conference 2012 - Americas
App
App
App
App
EIS
A
B
D
C
C’
D’
App
B’
A’ Cache is4x larger!
Cache is5x larger!
■ Cache capacity determined by total cluster size■ Size of each cache = M■ # JVMs = N■ Total Cache = M x N■ No invalidation chatter■ Linearly scalable■ Less load on database and no cold start spikes
© 2012 IBM Corporation37
Exceptional Web Experience Conference 2012 - Americas
One more use case...HTTP Session Persistence
© 2012 IBM Corporation38
Exceptional Web Experience Conference 2012 - Americas38 DataPower XC10 Overview
HTTP Session data cache● No new code required ● Extension of legacy session management caching
mechanism in WebSphere Application Server● Extensions to WebSphere Application Server
administrative console to support WebSphere DataPower XC10 session management caching and WebSphere eXtreme Scale session management caching
● WebSphere Application Server connects seamlessly to the WebSphere DataPower XC10 appliance or WebSphere eXtreme Scale
– Client code must be installed on WebSphere Application Server systems
● Easily configure WebSphere applications to store HTTP session data to a data cache on the WebSphere DataPower XC10 appliance through the WebSphere Application Sever administrative console
● Replaces other session replication mechanisms (memory-to-memory replication)
● Removes the need for Database traditionally used for persistence
● Enables HTTP session failover between WebSphere Application Server cells
© 2012 IBM Corporation39
Exceptional Web Experience Conference 2012 - Americas
Session Caching for WebSphere Portal
© 2012 IBM Corporation40
Exceptional Web Experience Conference 2012 - Americas
•Ability to share the profile & persist session
Manage the life cycles of HTTP sessions that are associated with the application
Improve QoS and Lower Memory footprint
Better guarantees of session availability during server failover
Topology spans multiple data centers across different physical locations
Farming: Shared installations & Session caching
Elastic Cache DataPower XC10
© 2012 IBM Corporation41
Exceptional Web Experience Conference 2012 - Americas
For More Information
WebSphere eXtreme Scale and XC10 User Wiki
http://www.ibm.com/developerworks/wikis/display/extremescale/Home
IBM Customer Experience Suite, WebSphere Portal and Web Content Manager Software and Solutions
http://www-01.ibm.com/software/info/customerexperience/
http://www-3.ibm.com/software/genservers/portal/
WebSphere Portal and IBM Web Content Manager Information Center
http://www.ibm.com/developerworks/websphere/zones/portal/proddoc.html
IBM Web Experience Fast Track Offerings
http://www-01.ibm.com/software/genservers/portal/fasttrack/
WebSphere Portal Business Solutions Catalog
https://greenhouse.lotus.com/catalog/home_full.xsp?fProduct=WebSphere%20Portal
Exceptional Web Experience Conference 2012 - Americas
© 2012 IBM Corporation42
Exceptional Web Experience Conference 2012 - Americas
Your Feedback is Important!
Please visit www.ibmconf.com to enter your feedback from your wireless device, any laptop or one of our evaluation kiosks
Ask a Room Monitor for a paper form if preferred and leave it with a Room Monitor or at Registration
Thank you!
© 2012 IBM Corporation43
Exceptional Web Experience Conference 2012 - Americas
© IBM Corporation 2012. All Rights Reserved.
The information contained in this publication is provided for informational purposes only. While efforts were made to verify the completeness and accuracy of the information contained in this publication, it is provided AS IS without warranty of any kind, express or implied. In addition, this information is based on IBM’s current product plans and strategy, which are subject to change by IBM without notice. IBM shall not be responsible for any damages arising out of the use of, or otherwise related to, this publication or any other materials. Nothing contained in this publication is intended to, nor shall have the effect of, creating any warranties or representations from IBM or its suppliers or licensors, or altering the terms and conditions of the applicable license agreement governing the use of IBM software.
References in this presentation to IBM products, programs, or services do not imply that they will be available in all countries in which IBM operates. Product release dates and/or capabilities referenced in this presentation may change at any time at IBM’s sole discretion based on market opportunities or other factors, and are not intended to be a commitment to future product or feature availability in any way. Nothing contained in these materials is intended to, nor shall have the effect of, stating or implying that any activities undertaken by you will result in any specific sales, revenue growth or other results.
IBM, the IBM logo, Lotus, Lotus Notes, Notes, Domino, Quickr, Sametime, WebSphere, UC2, PartnerWorld and Lotusphere are trademarks of International Business Machines Corporation in the United States, other countries, or both. Unyte is a trademark of WebDialogs, Inc., in the United States, other countries, or both.
Adobe, the Adobe logo, PostScript, and the PostScript logo are either registered trademarks or trademarks of Adobe Systems Incorporated in the United States, and/or other countries. Java and all Java-based trademarks are trademarks of Sun Microsystems, Inc. in the United States, other countries, or both.
Microsoft and Windows are trademarks of Microsoft Corporation in the United States, other countries, or both. Intel, Intel Centrino, Celeron, Intel Xeon, Intel SpeedStep, Itanium, and Pentium are trademarks or registered trademarks of Intel Corporation or its subsidiaries in the United States and other countries.
UNIX is a registered trademark of The Open Group in the United States and other countries.Linux is a registered trademark of Linus Torvalds in the United States, other countries, or both. Other company, product, or service names may be trademarks or service marks of others.
.
Exceptional Web Experience Conference 2012 - Americas
© 2012 IBM Corporation44
Exceptional Web Experience Conference 2012 - Americas
IBM’s statements regarding its plans, directions, and intent are subject to change or withdrawal without notice at IBM’s sole discretion.
Information regarding potential future products is intended to outline our general product direction and it should not be relied on in making a purchasing decision.
The information mentioned regarding potential future products is not a commitment, promise, or legal obligation to deliver any material, code or functionality. Information about potential future products may not be incorporated into any contract. The development, release, and timing of any future features or functionality described for our products remains at our sole discretion.
.
Exceptional Web Experience Conference 2012 - Americas