1

How To Use Jenkins for Continuous Load Testing and Mobile Test Automation

Webinar

andPresent

Introducing performance and functional automation early with Continuous Integration

2

CI Gets More TestingIn This Webinar

TODAY’S PRESENTERS

Andy Pemberton: CloudBees, Sr. Dir. Solution ArchitectureMike Ostenberg: SOASTA, Dir. Solutions EngineeringBrad Johnson: SOASTA, VP Product

TWO COMPANIES, A SINGLE SOLUTION

- the leader in Mobile and Cloud Testing

- the Jenkins Enterprise company

Together, we offer a complete cloud-based service:

Continuous Delivery for Web & Mobile

@apemberton

@bradjohnsonsv

3

Agenda

• Achieving (even) more test coverage with Jenkins• Utilizing cloud in development and test• CloudBees and Jenkins• From Continuous Integration to Continuous Delivery• CI with SOASTA CloudTest (load) and TouchTest

(mobile)

Questions: Submit in the question box during event

4

TestingThe Legacy of….WAIT

UtUnit

Testing

FtFunctional

Testing

Development Testing Operations

PtPerformance

Testing

MoMonitoring

Legacy Approach: Silos and waiting

TIME

5

Eliminating Delays Compresses TimeEnabling more testing to be done earlier and more often

UtUnit

Testing

FtFunctional

Testing

Testing

PtPerformance

Testing

MoMonitoring

Legacy Approach: Silos and waiting

Agile Approach: Automation and Continuous Testing

OperationsDevelopment

Dev OpsTesting

TIME

6

Continuous Integration BlueprintGartner models “Shift Left” for testing

* Source: Gartner, “Blueprint for Adding Continuous Integration as a Start to Your Continuous Delivery Process” Sean Kenefick, Aug 25, 2014

Traditionally later-stage testing!

Perf & mobile testing plugins enhance value across delivery cycle

7

Poll Question

8

CloudBees and JenkinsFrom Continuous Integration to Continuous

Delivery

Andy Pemberton

@apemberton

o#1 OSS CI server

oWritten in Java

oHighly Extensible

oFounded ~2005

oEasy to install / use

oExtensible via 1000+ plugins

oWidely adopted

o 80K+ installations

oCloudBees knows Jenkins

oOn-premise, cloud and hybrid

oExpert support

oEnterprise plugins

Have you met Jenkins?

o Jenkins founder, Kohsuke Kawaguchi, CloudBees CTO

oWe optimize Jenkins for the enterprise

o Jenkins Operations Center

o Jenkins OSS Support

oEnterprise-class plugins

oCommit code and support the Jenkins Community

o Jenkins training and consulting

o Jenkins User Conferences (JUC) and newsletters

o…we are the Jenkins Enterprise experts!

CloudBees

CloudBees Jenkins Products

On-Premise In the Cloud Hybrid

No matter how you use Jenkins

Jenkins Enterprise by CloudBees

Jenkins Operations Centerby CloudBees

DEV@cloud DEV@cloudHybrid

Jenkins: the Hub of Continuous Delivery

Source Code

Binaries

Quality Analysis Functional Test

Performance / Load Test

Production

Jenkins: the Hub of Continuous Delivery

Source Code

Binaries

Quality Analysis Functional Test

Performance / Load Test

Production

o“Survival is not mandatory (nor is adopting DevOps)”

o Gene Kim, Wall Street Journal - CIO Journal DevOps piece

oSeek out opportunities for automation - testing is an ideal first step

oLoad, functional, and mobile testing have been challenging…

DevOps is a Journey

http://blogs.wsj.com/cio/2014/05/22/enterprise-devops-adoption-isnt-mandatory-but-neither-is-survival/

8x more frequent releases

8000x faster release process

2x higher releases success

12x faster defect fixes

DevOps

15

Mike Ostenberg

Building your tests and automating with Jenkins

16

CI Mobile Application Func & Perf Testing

o Demo:

• Creating a quick functional test in TouchTest

• Creating a quick performance test in CloudTest

• Running Load and Performance Tests from Jenkins:

• Play TouchTest/CloudTest tests from Jenkins

• Setting Thresholds to automatically alert on poor performance

• Plotting performance trending data directly in Jenkins

• Reviewing detailed results directly in Jenkins

• Jenkins Enterprise by CloudBees enhancements

• Add templates

• Add folders

• Add roles and permissions

What are we going to show

17

SOASTA SolutionsQuality Across the Software Application Lifecycle

Expertise

18

Setting up the Test Environment

TouchTest

o Run MATT utility to create testable application

o Install Testable application on device

CloudTest

o Install conductor on laptop

o Modify mobile device proxy settings

Jenkins

o Install SOASTA PlugIn

o Install Plot PlugIn

o Install Jenkins Enterprise by CloudBees

• Open Source: online at jenkins-ci.org

• Automatically available on CloudBees DEV@cloud

• Complete control over CloudTest/TouchTest Automation from within your Jenkins builds:

• Totally integrated into Jenkins environment

SOASTA Jenkins Plug-in

Jenkins Enterprise by CloudBees – Folders Plus Plugin

Jenkins Enterprise by CloudBees – Role-based Access Control

Jenkins Enterprise by CloudBees – Templates Plugin

23

Thanks & Q&A

Contact SOASTA:www.soasta.com/cloudtest/info@soasta.com866.344.8766Follow us:

twitter.com/cloudtest

facebook.com/cloudtest

Knowledge Center• White Papers• Webinar

Recordings• Case Studies

CloudLink Community• Support• Tutorials• Video

RESOURCES

Contact CloudBeeswww.cloudbees.cominfo@cloudbees.com1.781.404.5100Follow us:

twitter.com/cloudbees

facebook.com/CloudBees

www.SOASTA.com www.CloudBees.com/jenkins

blog.cloudbees.com

developer.cloudbees.com• Platform Services• Frameworks