Intelligent Testing Conference 2014 - T&VS · PDF fileIntelligent Testing Conference 2014...
32
Parasoft Proprietary and Confidential 1 Intelligent Testing Conference 2014 Service Virtualization and its Benefits to Testing Andrew Thompson – Solution Architect [email protected]
Transcript of Intelligent Testing Conference 2014 - T&VS · PDF fileIntelligent Testing Conference 2014...
Parasoft Proprietary and Confidential 1
2014-11-18
Intelligent Testing Conference 2014 Service Virtualization and its Benefits to Testing
Andrew Thompson – Solution Architect
Parasoft Proprietary and Confidential 2 Parasoft Proprietary and Confidential 2
Service Virtualization delivers a simulated dev / test environment allowing an organization to test
anytime or anywhere
Service Virtualization
Parasoft Proprietary and Confidential 3 Parasoft Proprietary and Confidential 3
Complexity is a Barrier to Innovation
3rd Party System
Evolving Component Mainframe
Scheduled Access
Parasoft Proprietary and Confidential 4 Parasoft Proprietary and Confidential 4
An application is not just “one application” …
Parasoft Proprietary and Confidential 5 Parasoft Proprietary and Confidential 5
… it’s made up of „several components” …
Parasoft Proprietary and Confidential 6 Parasoft Proprietary and Confidential 6
… and they are not all ready at the same time.
Parasoft Proprietary and Confidential 7 Parasoft Proprietary and Confidential 7
How do we ensure quality of the components?
Static Analysis, Unit Testing, Code Review
Parasoft Proprietary and Confidential 8 Parasoft Proprietary and Confidential 8
How to test without dependant components?
API testing
Reusable Virtual Assets
Parasoft Proprietary and Confidential 9 Parasoft Proprietary and Confidential 9
Test as soon as the components are ready
Parasoft Proprietary and Confidential 10 Parasoft Proprietary and Confidential 10
… it’s made up of several components.
Parasoft Proprietary and Confidential 11 Parasoft Proprietary and Confidential 11
Dev/Test Environment Access Survey
Over 400 responses so far
http://bit.ly/x7UWkQ
Parasoft Proprietary and Confidential 12 Parasoft Proprietary and Confidential 12
30
Survey Results…
The average number of dependent application associated with the System Under Test (SUT)
BUT, Dev/QA only have “trustworthy”
access to SIX of the applications
30 29 28 27 26 25
24 23 22 21 20 19
18 17 16 15 14 13
12 11 10 9 8 7
6 5 4 3 2 1
Parasoft Proprietary and Confidential 13 Parasoft Proprietary and Confidential 13
Survey Results…
The average percentage of time spent configuring the test environment.
30%
50% The average percentage of the test plan able to complete once configured.
Parasoft Proprietary and Confidential 14 Parasoft Proprietary and Confidential 14
Survey Results…
When testing with a dependent application only need access to a small percentage of the applications functionality
20%
Parasoft Proprietary and Confidential 15 Parasoft Proprietary and Confidential 15
Survey Results…
75% of organizations must schedule time in order to access a test environment 75%
The average time block allowed to be schedule is hours
4
Parasoft Proprietary and Confidential 16 Parasoft Proprietary and Confidential 16
Survey Conclusions
1. Test environment access hampers testing activity
2. Development needs access to dependent components much earlier in the SDLC
3. Test environment configuration is complex and eats into test execution time
4. The risk of application failures persist as testers are unable to complete testing cycles
Parasoft Proprietary and Confidential 17 Parasoft Proprietary and Confidential 17
Service Virtualization
Parasoft Proprietary and Confidential 18 Parasoft Proprietary and Confidential 18
When to use SV? Access vs Configuration
Access Dependent applications difficult Scheduling conflicts High access fees Geo-political boundaries 3rd party or partner applications
Configuration Complex to configure No control Limited variability Consumes test time
Test Access
Simple Difficult
Configura
tion
Complex
Internal
Service
Internal
Application 3rd Party
Service
ERP
Mainframe
External
Application
External
Database
Internal
Database
Cloud
App
Message
Queue
ESB
Web
Server
Parasoft Proprietary and Confidential 19 Parasoft Proprietary and Confidential 19
When to use SV? Access vs Configuration
Access Dependent applications difficult Scheduling conflicts High access fees Geo-political boundaries 3rd party or partner applications
Configuration Complex to configure No control Limited variability Consumes test time
Test Access
Simple Difficult
Configura
tion
Complex
Internal
Service
Internal
Application 3rd Party
Service
ERP
Mainframe
External
Application
External
Database
Internal
Database
Cloud
App
Message
Queue
ESB
Web
Server
Service Virtualization
Virtual Lab / Server
Virtualization
(i.e. VMWare)
Parasoft Proprietary and Confidential 21 Parasoft Proprietary and Confidential 21
So, What are you Virtualizing?
• SOA / Web services
• XML
• WSDL
• WADL
• UDDI
• WSIL
• SOAP
• PoX (Plain XML)
• REST
• JSON
• BPEL
• Web Applications
• SQL/Stored Procedures
• JDBC/ODBC
• Mainframe CICS/IMS
• Copybook
• Mobile Interfaces
• AJAX
• JSP
• JavaScript
• HTML
• CSS
• WS-*Standards
• SAP RFC/IDoc
• MTOM(XOP) / MIME / DIME
• OAuth
• TCP/IP
• webMethods Broker
• webMethods IS
• HL7
• FTP
• HTTP/HTTPS
• JMS
• IBM WebSphere MQ
• Sonic MQ
• RMI
• EJB
• SMTP
• Tibco Rendezvous
• .NET WCF
• ISO 8583, FIX, SWIFT
• Mainframe CICS, IMS
• EDI
• Java JVM calls
• Extendable Formats and Protocols
AUT
Parasoft Proprietary and Confidential 22 Parasoft Proprietary and Confidential 22
How to create a Virtual Asset
Direct from Recorded traffic
Wizard extracts data and creates parameterised virtual asset
From a WSDL/XSD/WADL schema
From sample messages provided by architects
Parasoft Proprietary and Confidential 23 Parasoft Proprietary and Confidential 23
Parasoft Virtualize: How does it work?
Application Under Test
2 Capture
4 Deploy
3 Create
Application
Database
Service
QA and Test
Performance Test Engineer
Mainframe
Define Monitors 1
Development
Service
Test
LoadRunner
Parasoft Proprietary and Confidential 24 Parasoft Proprietary and Confidential 24
Parasoft Virtualize: How does it work?
Application Under Test
Application
Database
Service
Mainframe
Environment Manager
5 Manage
6 Consume
QA and Test
Performance Test Engineer
Development
QC/ALM
Rational
Parasoft Proprietary and Confidential 25 Parasoft Proprietary and Confidential 25
What is ‘Inside’ a Virtual Asset?
Responder Correlation
Datasource Correlation
Response message
Transport configuration
Parasoft Proprietary and Confidential 26 Parasoft Proprietary and Confidential 26
And more advanced features
Create time stamps on the fly
Performance profiles
Multiple data sources
Data extraction tools
Persistence
Parasoft Proprietary and Confidential 27 Parasoft Proprietary and Confidential 27
Example: Parabank Cloud Deployment
Parabank Retail Services
Virtual Loan Processor
Service
Virtual Loan Processor
Service
Virtual Loan Processor
Service
Virtual Loan Processor
Service
QA Engineer
Accounts DB
Loan Processor Service
Loan Processor Service
Different data/behavior/performance profiles
Parasoft Proprietary and Confidential 28 Parasoft Proprietary and Confidential 28
Demo
Parasoft Proprietary and Confidential 29 Parasoft Proprietary and Confidential 29
Stubs Vs Service Virtualization
Stubs Inside-out approach that disassociates a test case from a system Brittle No reuse Static response
Service Virtualization Creates an environment in which to run “rich” test scenarios Assets represent real system behavior All assets reusable Assets are programmable and extensible
Service Virtualization provides a complete environment for developing and
testing against complex, dependent systems
Parasoft Proprietary and Confidential 30 Parasoft Proprietary and Confidential 30
30 Second Virtualization
But its simpler to get someone to quickly throw a stub
together for me!
Really?
YouTube: “Parasoft Service Virtualization: 30-second demo”
Parasoft Proprietary and Confidential 31 Parasoft Proprietary and Confidential 31
Who Creates the Virtual Assets?
Developers
Testers
Virtualisation SME’s
Parasoft Proprietary and Confidential 32 Parasoft Proprietary and Confidential 32
Reduces time to configure applications for test
Significantly lowers hardware costs or system access fees
Reduces the cost for “Test/QA” licenses
Increase software quality
Increases productivity
Summary - Benefits Service Virtualization
Parasoft Proprietary and Confidential 33
2014-11-18
Thank you
Questions?
