Techwell / IT World Canada - Digital Assurance
-
Upload
jonathon-wright -
Category
Technology
-
view
167 -
download
4
Transcript of Techwell / IT World Canada - Digital Assurance
CA/ITWC WEBINARTesting in the Digital World: Digital Assurance
JUNE 27, 2017
2 © 2017 CA. ALL RIGHTS RESERVED.
Digital AssuranceDigital - ‘Evolution, over Revolution’
Jonathon WrightChief Technology Evangelist – Automation, DevOps & Digital [email protected] | linkedin.com/in/automation
© 2017 CA. ALL RIGHTS RESERVED.
3 © 2017 CA. ALL RIGHTS RESERVED.
Disclaimer
Certain information in this presentation may outline CA’s general product direction. This presentation shall not serve to (i) affect the rights and/or obligations of CA or its licensees under any existing or future license agreement or services agreement relating to any CA software product; or (ii) amend any product documentation or specifications for any CA software product. This presentation is based on current information and resource allocations as of June 27th and is subject to change or withdrawal by CA at any time without notice. The development, release and timing of any features or functionality described in this presentation remain at CA’s sole discretion.
Notwithstanding anything in this presentation to the contrary, upon the general availability of any future CA product release referenced in this presentation, CA may make such release available to new licensees in the form of a regularly scheduled major product release. Such release may be made available to licensees of the product who are active subscribers to CA maintenance and support, on a when and if-available basis. The information in this presentation is not deemed to be incorporated into any contract.
Copyright © 2017 CA. All rights reserved. All trademarks, trade names, service marks and logos referenced herein belong to their respective companies
THIS PRESENTATION IS FOR YOUR INFORMATIONAL PURPOSES ONLY. CA assumes no responsibility for the accuracy or completeness of the information. TO THE EXTENT PERMITTED BY APPLICABLE LAW, CA PROVIDES THIS DOCUMENT “AS IS” WITHOUT WARRANTY OF ANY KIND, INCLUDING, WITHOUT LIMITATION, ANY IMPLIED WARRANTIES OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE, OR NONINFRINGEMENT. In no event will CA be liable for any loss or damage, direct or indirect, in connection with this presentation, including, without limitation, lost profits, lost investment, business interruption, goodwill, or lost data, even if CA is expressly advised in advance of the possibility of such damages.
4 © 2017 CA. ALL RIGHTS RESERVED.
Agenda
INTRODUCTION
DIGITAL ASSURANCE
Q & A
SHIFT LEFT & RIGHT
VALUE-DRIVEN DELIVERY
WHAT NEXT?
1
2
3
4
5
6
5 © 2017 CA. ALL RIGHTS RESERVED.
MA
TUR
ITY
TIME
1960s 1990s TODAY
Digital - ‘Evolution, over Revolution’
1 – “The Battle for Competitive Advantage in the App Economy”, Oxford Economics, 2015
of enterprises believe that they need value-driven algorithmic business models to respond to disruption in the next 3 years.78%
Legacy is your Legacy (API)
Digitalization of your Core (SOA)
Digital (Cognitive Adoption)
6 © 2017 CA. ALL RIGHTS RESERVED.
Businesses no longer have the luxury of time.
Rising customer expectations, competitive threats,
and increased consumer choice have turned rapid
delivery and iteration of software applications into a
competitive differentiator.
Adoption of Value-Driven Delivery has become the
new means to better business outcomes.
TechRadar™: Continuous Software Delivery, Q2 2015, Forrester Research, May 1, 2015
“
”
2014 Vanson Bourne study commissioned by CA
UNPRECEDENTED
94%of executives face increased pressure to release appsmore quickly
“
© 2017 CA. ALL RIGHTS RESERVED.
Digital EnterpriseJourney to Enterprise Digital Adoption
8 © 2017 CA. ALL RIGHTS RESERVED.
© 2017 CA. Confidential. All rights reserved.
BORN DIGITAL TRANSFORMING DIGITIAL
Amazon’s lost sales per 1 second delay
75% Delete apps that load slowly
75%$ 1.6B
1. Akamai, “Performance Matters: Key Consumer Insights”2. Dynatrace Holiday Shopping Report
Digital ExperienceIn the Digital Economy, Every Business is a Software Business
Digital ExperienceIn the Digital Economy, Every Business is a Software Business
OVERWHELMING
feel the impact of change now or will, in the next year.
59%
34% expect to see impact in the next
2 to 5 years. Leadership for Digital
Transformation comes from the C-
level (43%) or from Senior IT
leadership (36%) Canadian CIO Census 2017
“
”
Poll Question #1
What is the main goal for Digital within your organization?
• Business cultural change
• Organizational transformation
• Improved delivery speed / time to market improvement
• Respond to market disruption
• Embrace shift left / shift right
• Increasing customer expectations
12 © 2017 CA. ALL RIGHTS RESERVED.
QUALITY
2/3of business leaders say the future of their business depends on the quality of their software2
VELOCITY
94%of executives face increased pressure to release apps more quickly1
1. 2014 Vanson Bourne study commissioned by CA2. “Surviving Disruption, Leading Change: Winning in the Application Economy,” 2015 3. voke Market Snapshot TM Report: Service Virtualization – January 2015
© 2017 CA. ALL RIGHTS RESERVED.12
EXPERIENCE
79%of users will abandon a site if they don’t quickly find what they need3
While Ensuring a Superior Digital Experience!
Digital QualityDelivering Quality at Speed
13 © 2017 CA. ALL RIGHTS RESERVED.
© 2017 CA. Confidential. All rights reserved.
1. “Accelerating Velocity And Customer Value With Agile And Devops” --Coleman Parkes Research
2. “2016 State of DevOps Report” – Puppet and DORA3. http://www.itproportal.com/news/jobs-requiring-microservices-skills-
up-133-per-cent-in-the-last-year/4. Google Trends – as of 5.23.17
27/05/2012 27/05/2013 27/05/2014 27/05/2015 27/05/2016
Google Searches for DevOps (Worldwide)4 87% have implemented DevOps in their organization1
87%
DevOps teams increased from 16% in 2014 to 22% in 2016 3
22%
2012 2013 2014 2015
45%45% Increase in posted DevOps Job Positions2
Digital AdoptionWhilst DevOps reaches critical mass
2016
14 © 2017 CA. ALL RIGHTS RESERVED.
© 2017 CA. Confidential. All rights reserved.
Digital
Value-driven delivery, adaptive business models, innovation, digital disruption, experiences and engineeringV
elo
city
Mastery
DevOps
Increases collaboration between developers and operations.
Scaled Agile
Accelerates software development with iterative, incremental work cadences.
Digital MasteryJourney to becoming Digitally Enabled
Poll Question #2
What is the current level of Digital maturity within your organization?
• Level 0 – Innovation – Rapid experimenting and prototyping (LeanUX)
• Level 1 – Evolution - Establish solution / design thinking (User Centric Design)
• Level 2 – Differentiation – Change in behaviours are defined, planned,
performed, measured, and controlled
• Level 3 – Adaptive – Continuous delivery and deployment can be validated
against expected value streams
• Level 4 – Quantified – Predictability of changes to behaviours and digital
delivery modes (Harmonisation)
• Level 5 – Optimising – Behaviour variation has statistical predictability
(Systematized Epistemic & Systemic Entropy)
Poll Question #2
17 © 2017 CA. ALL RIGHTS RESERVED.
DesignOpsCreate and deliver Ideas to Outcomes
Pervasive Security
Redefine how work is planned, managed and
executed
Agile Management
Provide a flawless app experience optimized for
performance
Agile Operations
Accelerate and streamline development, testing and
release
Continuous Delivery
Continuous Development Continuous Adaptive Testing Continuous Release
Digital DeliveryShift Left even further … introducing DesignOps
18 © 2016 CA. ALL RIGHTS RESERVED.
http://www.computing.co.uk/digital_assets/634fe325-aa28-41d5-8676-855b06567fe2/CTG-DevOps-Review-2017.pdf
Of self-proclaimed DevOps practitioners, 63% experience delays in the Testing/QA area*
29 per cent of DevOps practitioners told us that quality was being sacrificed
A 2017 survey found that the majority of delays were occurring at the Test/QA stage of the cycle.
Where are the main hold-ups in the software production process?
32%16% 22%
63%
21% 23% 30%
Plan code Pre-test Build Test/QA Release Deploy Review/Improve
What tends to suffer the most in a DevOps environment?
Speed
Security Quality
Nothing
42%
Security
13%
Speed
16%
Quality
29%
Digital TestingQA is STILL a Bottleneck .. Even with DevOps
20 © 2017 CA. ALL RIGHTS RESERVED.
© 2017 CA. Confidential. All rights reserved.
ACCELERATING SOFTWARE INNOVATION
Reducing the impact of time-consuming, manual IT processes to completely transform the software delivery pipeline and deliver software faster.
improvement in time-to-market
for new apps and software updates
97%KEY CHALLENGES
Speed responsiveness tobusiness trends
Global financial services group with
48 million clients in 40+ countries.
20 © 2017 CA. ALL RIGHTS RESERVED.
Replace inefficient manual processes
Increase the rate of apps delivery
Digital EnablementAutomating test and release to speed delivery and responsiveness
22 © 2017 CA. ALL RIGHTS RESERVED.
The ability to reliably release high-quality solutions at any time
DIGITAL ASSURANCE
Accelerate Deliveries
Reduce Errors
Manage Complexity
Increase Visibility
Enterprise Collaboration
Continuous Improvement
Digital AssuranceShifting to a more Dynamic, Adaptive and Continuous business models
23 © 2017 CA. ALL RIGHTS RESERVED.
© 2017 CA. Confidential. All rights reserved.
Testing Volumeand Coverage
EnvironmentSetup Time
Catch CodeChange Defect
Daily Run Frequency
Build Validation Cycle
66% Reductionin minutes
14xIncrease indaily runs
On Demand
75%Reduction
4300%volume increase &
70%coverage increase
Digital Ready
BEFORE TODAY
▪ Release Every Month▪ Feature Focused Releases▪ Committed at Mid-Sprint
▪ Beta Features in Sandbox▪ All Features Reviewed by
Customers Prior to GA
1 Major Release Every YEAR
… along with 1-2 .dot releases
Drinking our own Champagne
24 © 2017 CA. ALL RIGHTS RESERVED.
DesignOps – “Shift Left” (AND Right)
CONTINUOUS ADAPTIVE TESTING
CODE
SHIFT LEFT SHIFT RIGHT
BUILD DELIVERY PRODUCTION
25 © 2017 CA. ALL RIGHTS RESERVED.
CODE
SHIFT LEFT SHIFT RIGHT
BUILD DELIVERY PRODUCTION
CONTINUOUS ADAPTIVE TESTING
DesignOps – “Shift Left” (AND Right)
26 © 2017 CA. ALL RIGHTS RESERVED.
© 2017 CA. Confidential. All rights reserved.
Generate test cases and data automatically
Automate Functional and non-functional
testing
Virtualized testing resources to
eliminate bottlenecks
CX / DX Insight to validate real live
test scenarios
Integrated risk assessment and security testing
DesignOps – “Shift Left” (AND Right)
SHIFT LEFT SHIFT RIGHT
COGNITIVE ADAPTIVE TESTING
27 © 2017 CA. ALL RIGHTS RESERVED.
© 2017 CA. Confidential. All rights reserved.
http://rewrite.ca.com/us/articles/management-cloud/customer-obsessed.aspx
“Getting that insight in production is fantastic, but what is perhaps more brilliant is getting that insight in the development - and - test environment. We have been able to show that by moving monitoring into development and test — making it part of the process in those areas — you can stop defects from getting into production”.
Prevented 10 high-severity incidents, saving more than a dozen hours of investigations.
Another partner improved performance by 85%.
DesignOps – “Shift Right”Continuous Operations enables ‘Insight-Driven’ Business Models
28 © 2017 CA. ALL RIGHTS RESERVED.
© 2017 CA. Confidential. All rights reserved.
DELIVERING A 5 STAR CUSTOMER EXPERIENCE
Around 95 percent of testing for the apps is automated, and the bank is using the App Experience Analytics tool to monitor performance and ensure the bank can jump on any
issues before customers need to report them
Reduction in time to identify an an application performance issue 86%
Provide a rich digital experience – 3secs to reach any feature
Leading Australian Bank serving 10 million customers at more than 800 locations
https://www.itnews.com.au/tools/print.aspx?ciid=441118
KEY CHALLENGES
28 © 2017 CA. ALL RIGHTS RESERVED.
Zero downtimeGet code to production within 1 hour being implemented
Digital ExperienceMonitoring apps performance to drive continuous improvement
29 © 2016 CA. ALL RIGHTS RESERVED.29 © 2017 CA. ALL RIGHTS RESERVED.
Project & Portfolio Management
Unify long term strategy, investment and portfolio planning.
Agile Management
Collaboratively plan, prioritize and track work across the enterprise.
Develop & Test
Synchronize efforts to dramatically speed app development & increase quality
Manage & Monitor
Make a great customer experience a competitive advantage
Release & Deploy
Control the release process, to continuously advance application quality, improve the customer experience and reduce costs.
ContinuousDelivery
Minimum Viable Experience
Minimum Viable Quality
Value-Driven Delivery
BUSINESS INITIATIVE
Complexity-Informed Organizational Change
BUSINESS VALUE
MinimumViableProduct
CUSTOMER
THINK
MAKE
Value-Driven DeliveryEnabling Complexity-Informed Organizational Change
31 © 2017 CA. ALL RIGHTS RESERVED.
IdeasBeliefs, Values, Culture
Heuristics
Behaviors
Value
AgileLean
Methods and Skills
http://catechnologies.podbean.com
Ray Arell
Value-Driven DeliveryWebinar - Continuous Testing 101
32 © 2017 CA. ALL RIGHTS RESERVED.
Where next?
33 © 2017 CA. ALL RIGHTS RESERVED.
Digital Assurance & Quality
DIGITAL TESTING, QUALITY & ASSURANCE
http://bit.ly/digital-assurance http://a.co/jlxMHWp
34 © 2017 CA. ALL RIGHTS RESERVED.
© 2017 CA. All rights reserved.
Thank you!
35 © 2016 CA. ALL RIGHTS RESERVED.
CA Continuous Delivery Director
Orchestrate testing functions parallel or sequentially
Automatically generate test case straight from requirements
Quickly stand up simulated test environments
Start API and backend system “requests & response” testing prior to the development of UI
Access test data on-demand
Orchestrate the release engine to promote code as soon as test cases pass
Democratize performance testing for DevOps era
Integrate open source testing tools like JMeter, Jenkins, Selenium, Appium, Gatling, Locust, and more.
Capture user issues in production and implement a feedback loop to development/ teams
1
2
3
4
5
6
7
8
CA Testing™ - Continuous Testing Ready
CA is Positioned as a Leader in the Gartner MQ for ARA … Forrester Wave SV Leader
Faster time to deploy releases*
20x
Reduced testing costs & improved efficiency*
25%
Reduction in production errors*
98%
Differentiation Customer Success
5 of the top 5Telecom Companies
4 of the top 5 Retailers
4 of the top 5 Banks
Market Validation
Nominated in the “Best Use of Technology in a Project” category for
work with the London Metal Exchange
*Based on Global 500*Forrest TEI Research
Don’t Take Our Word For it
Evaluation Form