Performance Warrior Tales: Cloud Load Testing the Retail Giants
-
Upload
soasta -
Category
Technology
-
view
713 -
download
2
Transcript of Performance Warrior Tales: Cloud Load Testing the Retail Giants
1© 2012 SOASTA. All rights reserved.
Performance Warrior Tales: Cloud Testing the Retail Giants.
Webinar
Presents
Tips and Tricksfrom Large-Scale Retail Performance Engineers
2© 2012 SOASTA. All rights reserved. May 22, 2012
Preparing for the best case retail scenarios
In This Webinar
TODAY’S SOASTA PRESENTERS
Paul Korenevsky: Engagement Manager, Load Testing SME - AkamaiCraig Combs: Principal Performance Engineer – Giant Retailer Mike Ostenberg: Sr. Solution Architect – SOASTA Moderator - Brad Johnson: VP Product & Channel Marketing - SOASTA
Agenda: • Intro & Poll question• Meet Paul from Akamai• Meet Craig from a Top 5 retailer• Panel Questions• CloudTest demo for Retail
Questions: Submit in chat box during event
3© 2012 SOASTA. All rights reserved. May 22, 2012
Poll Question
4© 2012 SOASTA. All rights reserved. May 22, 2012
Paul Korenevsky
Load Testing @ Akamai
Engagement Manager, Load Testing SME
©2013 AkamaiAkamai Confidential Faster ForwardTM
The Akamai Intelligent Platform: What is it?
Scale & Breadth
• 120,000+ servers
• 1,100+ networks
• 750+ cities
• 1,700+ locations
• 74 countries
The leading Internet Cloud platform for enabling secure, high-performing user experiences on any device, anywhere.
Web Traffic
• 500 billion hits per day
• 19+ million hits per second
• 100+ million streams per day
• 1M+ concurrent streams
• 5.5+ Terabits per second peak
• 15 – 30 % of all Web traffic
©2013 AkamaiAkamai Confidential Faster ForwardTM
The Akamai Solution Family
Inspire Innovation
©2013 AkamaiAkamai Confidential Faster ForwardTM
How Akamai Works
Customer Origin
Users Akamai Edge Server
closest to Origin Server
Akamai “SureRoute” protocol optimizes routes and reduces
round trips
High Performance Global Overlay
Network
Edge Region close to End
User
Web Server
Security embedded into Akamai Edge
Servers
It All Starts in the Cloud – at the Edge
©2013 AkamaiAkamai Confidential Faster ForwardTM
Preparing for Peak Traffic
1. Inventory potential Availability and Performance risks, such as failures at the:
• Web(servers/LBs)• App (servers/db/cache)• Back end (OMS, inventory, fraud prevention, tokenization…)• Network (ISP, pipe, DNS, LBs …)• Security (firewall, WAF, IPS/IDS)• CDN (unless its Akamai, of course)• 3rd Party (translation/adaptation, recommendations, reviews, a/b testing, analytics, …)
2. Evaluate each risk• Stress testing• Load testing• Penetration testing
3. Mitigate each risk, prioritizing based on evaluation • Define and implement proactive mitigations• Prepare and test reactive mitigations
©2013 AkamaiAkamai Confidential Faster ForwardTM
Typical load provides little insight into issues thatarise under peak load
OriginInfrastructure
©2013 AkamaiAkamai Confidential Faster ForwardTM
Stress test the origin
OriginInfrastructure
©2013 AkamaiAkamai Confidential Faster ForwardTM
Why Performance Matters
Consumers are becoming less patient - 40% of shoppers will abandon after 3 seconds
8 Seconds
4 Seconds
3 Seconds
0 2 4 6 8 10Response Time
Site Abandonment Threshold
Zona Research, 1998
Jupiter Research, 2006
Forrester Research, 2009
10 Seconds
Nielsen, 1996
Webpage Load Time
Seconds
4
2
6
8
10
2
4
6
8
10
Seconds
Consumer Patience
©2013 AkamaiAkamai Confidential Faster ForwardTM
Load test through Akamai for realistic performance results
OriginInfrastructure
13© 2012 SOASTA. All rights reserved. May 22, 2012
Craig Combs
Performance Tips from the Retail Giants
Principal Performance Engineer
RetailerA
14© 2012 SOASTA. All rights reserved. May 22, 2012
Critical Things for Load and Performance Testing Retail sites
Test for spikes
Test what you think doesn’t need to be tested
Test expecting failure
If you can’t test it, virtualize it
Don’t forget about the user experience
Monitor everything
Don’t wait until just before the holidays
Test in production
15© 2012 SOASTA. All rights reserved. May 22, 2012
Critical Things for Load and Performance Testing Retail sites
Test for spikes
Test what you think doesn’t need to be tested
Test expecting failure
If you can’t test it, virtualize it
Don’t forget about the user experience
Monitor everything
Don’t wait until just before the holidays
Test in production
16© 2012 SOASTA. All rights reserved. May 22, 2012
Critical Things for Load and Performance Testing Retail sites
Test for spikes
Test what you think doesn’t need to be tested
Test expecting failure
If you can’t test it, virtualize it
Don’t forget about the user experience
Monitor everything
Don’t wait until just before the holidays
Test in production
17© 2012 SOASTA. All rights reserved. May 22, 2012
Critical Things for Load and Performance Testing Retail sites
Test for spikes
Test what you think doesn’t need to be tested
Test expecting failure
If you can’t test it, virtualize it
Don’t forget about the user experience
Monitor everything
Don’t wait until just before the holidays
Test in production
18© 2012 SOASTA. All rights reserved. May 22, 2012
Critical Things for Load and Performance Testing Retail sites
Test for spikes
Test what you think doesn’t need to be tested
Test expecting failure
If you can’t test it, virtualize it
Don’t forget about the user experience
Monitor everything
Don’t wait until just before the holidays
Test in production
19© 2012 SOASTA. All rights reserved. May 22, 2012
Critical Things for Load and Performance Testing Retail sites
Test for spikes
Test what you think doesn’t need to be tested
Test expecting failure
If you can’t test it, virtualize it
Don’t forget about the user experience
Monitor everything
Don’t wait until just before the holidays
Test in production
20© 2012 SOASTA. All rights reserved. May 22, 2012
Critical Things for Load and Performance Testing Retail sites
Test for spikes
Test what you think doesn’t need to be tested
Test expecting failure
If you can’t test it, virtualize it
Don’t forget about the user experience
Monitor everything
Don’t wait until just before the holidays
Test in production
21© 2012 SOASTA. All rights reserved. May 22, 2012
Critical Things for Load and Performance Testing Retail sites
Test for spikes
Test what you think doesn’t need to be tested
Test expecting failure
If you can’t test it, virtualize it
Don’t forget about the user experience
Monitor everything
Don’t wait until just before the holidays
Test in production
22© 2012 SOASTA. All rights reserved. May 22, 2012
Questions for the ProsGet your notepad app ready!
23© 2012 SOASTA. All rights reserved. May 22, 2012
Questions for the ProsGet your notepad app ready!
1. What are the two primary goals for seasonal
testing?
24© 2012 SOASTA. All rights reserved. May 22, 2012
Questions for the ProsGet your notepad app ready!
1. What are the two primary goals for seasonal
testing?
2. Which critical user-scenarios should be tested
first?
25© 2012 SOASTA. All rights reserved. May 22, 2012
Questions for the ProsGet your notepad app ready!
1. What are the two primary goals for seasonal
testing?
2. Which critical user-scenarios should be tested
first?
3. How do you create realistic conditions
26© 2012 SOASTA. All rights reserved. May 22, 2012
Questions for the ProsGet your notepad app ready!
1. What are the two primary goals for seasonal
testing?
2. Which critical user-scenarios should be tested
first?
3. How do you create realistic conditions
4. When should you stress your CDN?
27© 2012 SOASTA. All rights reserved. May 22, 2012
Questions for the ProsGet your notepad app ready!
1. What are the two primary goals for seasonal
testing?
2. Which critical user-scenarios should be tested
first?
3. How do you create realistic conditions
4. When should you stress your CDN?
5. Should you be hammering on live production
systems?
28© 2012 SOASTA. All rights reserved. May 22, 2012
Questions for the ProsGet your notepad app ready!
1. What are the two primary goals for seasonal
testing?
2. Which critical user-scenarios should be tested
first?
3. How do you create realistic conditions
4. When should you stress your CDN?
5. Should you be hammering on live production
systems?
29© 2012 SOASTA. All rights reserved. May 22, 2012
CloudTest
SOASTA CloudTest Demo
Actionable intelligence
Scale
Speed
The Leading Cloud-Based Load & Performance Test Solution
30© 2012 SOASTA. All rights reserved. May 22, 2012
Thanks
Contact SOASTA:www.soasta.com/cloudtest/
Follow us:
twitter.com/cloudtest
facebook.com/cloudtest
Knowledge Center• White Papers• Webinar Recordings• Case Studies
RESOURCES
www.SOASTA.com
CloudLink Community• Support• Tutorials• Video