Automated Testing Tools

download Automated Testing Tools

of 65

  • date post

    21-Apr-2015
  • Category

    Documents

  • view

    38
  • download

    2

Embed Size (px)

Transcript of Automated Testing Tools

Automated Testing Tools Research

65 pagesDate: 09.03.2007

Version: 1.0

AUTOMATED TESTING TOOLS RESEARCH

Table of Contents1. 1.1 1.2 1.3 2. 2.1 2.2 2.3 3. 4. 4.1 History .................................................................................................................................................... 4 Revision History..................................................................................................................................... 4 Review History....................................................................................................................................... 4 Approval History .................................................................................................................................... 4 Introduction............................................................................................................................................. 5 Purpose.................................................................................................................................................. 5 Summary ............................................................................................................................................... 5 Scope..................................................................................................................................................... 7 Customer Needs.................................................................................................................................... 8 Estimation Criteria.................................................................................................................................. 9 General Test Automation Comparison Parameters:........................................................................... 9 Test Design tools for both Automated and Manual testing............................................................ 9 Methods used for test creation and test specification.................................................................... 9 Functional Testing.......................................................................................................................... 10 Scripting.......................................................................................................................................... 10 Test Documentation....................................................................................................................... 10 Test Plan Support. ......................................................................................................................... 11 Test Scheduling ............................................................................................................................. 11 Interface.......................................................................................................................................... 11 Support of Test Repository............................................................................................................ 11 Supported protocols for remote testing. ..................................................................................... 12 Supported Testing Environments. .............................................................................................. 12 Statistics and Reporting Tools. ................................................................................................... 12 Integration with external systems................................................................................................ 12 Team work ................................................................................................................................... 12 Learning Effort s........................................................................................................................... 13 Price.............................................................................................................................................. 13I

4.1.1 4.1.2 4.1.3 4.1.4 4.1.5 4.1.6 4.1.7 4.1.8 4.1.9 4.1.10 4.1.11 4.1.12 4.1.13 4.1.14 4.1.15 4.1.16

AUTOMATED TESTING TOOLS RESEARCH

4.2 4.3 5. 5.1

Regression / Unit / Integration Testing Parameters .......................................................................... 13 Load/Stress Testing Parameters........................................................................................................ 14 Automated Testing Tools Comparison................................................................................................ 15 Mercury................................................................................................................................................ 15 Mercury LoadRunner.................................................................................................................. 15 Mercury QuickTest Professional................................................................................................... 17 Mercury WinRunner.................................................................................................................... 20

5.1.1 5.1.2 5.1.3 5.2

Rational................................................................................................................................................ 23 Rational Functional Tester............................................................................................................. 23 Rational Manual Tester ................................................................................................................. 25 Rational Performance Tester ........................................................................................................ 26 Rational Robot ............................................................................................................................... 28

5.2.1 5.2.2 5.2.3 5.2.4 5.3

Segue (Borland) .................................................................................................................................. 29 Borland SilkTest............................................................................................................................. 29 Borland SilkPerformer.................................................................................................................... 30 MaxQ .............................................................................................................................................. 31 Abbot .............................................................................................................................................. 32

5.3.1 5.3.2 5.3.3 5.3.4 5.4 5.5 5.6 5.7 5.8 5.9 5.10 5.11

Parasoft JTest 8.0 .............................................................................................................................. 33 Push-to-test TestMaker 6.2 ................................................................................................................ 37 AdventNet QEngine 6.7 ...................................................................................................................... 38 SLAMD 2.0.0-alpha1........................................................................................................................... 39 JMeter 2.2............................................................................................................................................ 45 IValidator 2.2.0..................................................................................................................................... 47 Jamelon ............................................................................................................................................. 48 Comparison Matrix............................................................................................................................ 50

Appendix ...................................................................................................................................................... 51 General Test Automation Parameter Matrix............................................................................................... 51 Regression / Unit / Integration Testing Parameter Matrix .......................................................................... 60 Load/Stress Testing Parameter Matrix ....................................................................................................... 63II

AUTOMATED TESTING TOOLS RESEARCH

III

AUTOMATED TESTING TOOLS RESEARCH

1. History1.1 Revision HistoryVersion 0.1 0.2 Date 02.03.2007 02.03.2007 Description of Changes Created "Customer Needs" and "Introduction" sections were drafted. Descriptions of some products were drafted. 0.4 06.03.2007 All sections except "Summary" were drafted Reason Customer request for research Made by E. Gomonova I. Anisimov I. Petrov D. Kondratiev

I. Anisimov I. Petrov D. Kondratiev D.Zernov

0.6

09.03.2007

Document is ready for review

O.Moroz I. Anisimov I. Petrov D. Kondratiev D.Zernov

1.0

09.03.2007

Proposed

1.2 Review HistoryVersion 0.3 0.5 0.7 Date 02.03.2007 06.03.2007 09.03.2007 Reviewer A. Ignatov A. Ignatov A. Ignatov Reference

1.3 Approval HistoryVersion 0.8 Date 09.03.2007 Approved by E.Povalyaev Signature or reference

4

AUTOMATED TESTING TOOLS RESEARCH

2. Introduction2.1 PurposeThe main purpose of this document is to present the results of the research established by Luxoft to compare several Automated Testing tools and find out the most appropriate solution, which is eminently suitable to business and technical requirements ofCustomer.

2.2 SummaryWe have evaluated and compared several commercial and free open source tools for autom