Testing of ERP systems finalpriyagupta.weebly.com/uploads/1/0/4/4/1044295/erp... · 2018. 9. 5. ·...

27
1 Copyright © CTG, Inc. ERP en SAP ® Testing in Theorie en Praktijk CTG Belgium NV Woluwelaan 140A bus 3 B-1831 Diegem, Belgium Tel:+32 (0)2 720 51 70 Fax: +32 (0)2 725 09 20 http://www.ctg.be [email protected] [email protected] Copyright © CTG, Inc. Outline Introduction Testing SAP ® in theory: Process People Technology Testing SAP ® in practice: case

Transcript of Testing of ERP systems finalpriyagupta.weebly.com/uploads/1/0/4/4/1044295/erp... · 2018. 9. 5. ·...

  • 1

    Copyright © CTG, Inc.

    ERP en SAP® Testing in Theorie en Praktijk

    CTG Belgium NVWoluwelaan 140A bus 3

    B-1831 Diegem, BelgiumTel:+32 (0)2 720 51 70

    Fax: +32 (0)2 725 09 20http://www.ctg.be

    [email protected]@ctg.com

    Copyright © CTG, Inc.

    Outline

    IntroductionTesting SAP® in theory:

    ProcessPeopleTechnology

    Testing SAP® in practice: case

  • 2

    Copyright © CTG, Inc.

    But what is SAP® ?Systems, Applications, Products: ERP package providing business solutions and applications for automating business processes

    Copyright © CTG, Inc.

    Look & Feel - example

  • 3

    Copyright © CTG, Inc.

    Look & Feel - example

    Copyright © CTG, Inc.

    Look & Feel - example

  • 4

    Copyright © CTG, Inc.

    Look & Feel - example

    Copyright © CTG, Inc.

    Look & Feel - example

  • 5

    Copyright © CTG, Inc.

    Why structured testing SAP® ?

    SAP® systems:Are ‘always’ customized, Are often linked to other legacy systems and other software packages,Often require different local (customized) implementations,Often involve the migration of data between systems, Regularly need ‘changes’ due to legal requirements,Often require functional improvements,Regular upgrades and hot fixes after deployment are a ‘MUST’Often control the complete business process

    Copyright © CTG, Inc.

    Different situations

    ImplementationsMajor upgradesConsolidationsMaintenance

    Hot fixesChange requests

  • 6

    Copyright © CTG, Inc.

    Outline

    IntroductionTesting SAP® in theory:

    ProcessPeopleTechnology

    Testing SAP® in practice: case

    Copyright © CTG, Inc.

    STBoxTM Testing Methodology

  • 7

    Copyright © CTG, Inc.

    GO LIVE &SUPPORT

    PROJECTPREPARATION

    BUSINESSBLUEPRINT

    REALIZATION DEVELOPERTESTING

    FINAL PREPARATION

    IN-STREAMTESTING

    CROSS-STREAMTESTING

    ACCEPTANCETESTING

    TRANSACTIONTESTING

    CTG’s V-Model for SAP®

    Copyright © CTG, Inc.

    Developer Testing

    Developer Testing: Technical tests of low-level components (e.g. a conversion module)

  • 8

    Copyright © CTG, Inc.

    Transaction Testing

    Transaction Testing: Testing a single transaction (e.g. VA01 Create Sales Order). Transaction testing shall be conducted to confirm the operation of transactions + configuration checks (e.g. default values, mandatory fields etc.)

    Copyright © CTG, Inc.

    In-Stream Testing

    In-Stream Testing: Testing of a flow within 1 single process. In-Stream Testing is testing chains of transactions that flow together and which reflect important business process and scenarios.

  • 9

    Copyright © CTG, Inc.

    Cross-Stream Testing

    Cross-Stream Testing: End-to-end testing of integrated processes through execution of predefined business flows (within SAP or collaboration between SAP and legacy systems).

    Copyright © CTG, Inc.

    Acceptance Testing

    Acceptance Testing: In-Stream or Cross-Stream Tests by the user community with the objective of formal acceptance. In some cases, and for practical reasons, the Acceptance Tests are combined with Cross- or even In-Stream Tests.

  • 10

    Copyright © CTG, Inc.

    Used methodology: STBoxTM ModelTEST PROJECT PREPARATION

    TEST

    MANAGEMENT

    DETAILED TEST PLANNING

    TEST BUILD

    TEST EXECUTION

    For every Iteration / Test Level /Test Type: QUALITY

    MANAGEMENT

    TEST PROJECT CLOSURE

    Copyright © CTG, Inc.

    Outline

    IntroductionTesting SAP® in theory:

    ProcessPeopleTechnology

    Testing SAP® in practice: case

  • 11

    Copyright © CTG, Inc.

    STBoxTM Testing Methodology

    Copyright © CTG, Inc.

    Testing Roles

    Test CoordinatorTester

    System & Integration TestersAcceptance Testers

    Test Tool Specialist

  • 12

    Copyright © CTG, Inc.

    Test Coordinator

    ! For a Test Coordinator, it is important to combine ‘in depth test knowledge’ with ‘high-level SAP®knowledge’ (has to know the core business flows of an organization)

    Ability to set up a test process,Compose the overall planning,Define the high-level test requirements,Coordinate and follow up the testing activitiesCoordinate and follow up testers

    Knowledge of Test Management ToolsKey-Role in the test process

    Copyright © CTG, Inc.

    Challenges Test Coordinator

    Complexity: for E2E Acceptance Testing you need coordinate different user groups and you have to put them in a logical business chainMostly there is an external developer/integrator. Testing is not their core capability.Implementations can be on different locationsIntegration with other packages and legacy systemsDifferent processes within SAP® that need to be integrated.

  • 13

    Copyright © CTG, Inc.

    System & Integration Testers

    Structured testing specialist ‘preferably’ with SAP®knowledge

    Representatives of the IT-department

    Intermediary between developers and users

    Copyright © CTG, Inc.

    GO LIVE &SUPPORT

    PROJECTPREPARATION

    BUSINESSBLUEPRINT

    REALIZATION DEVELOPERTESTING

    FINAL PREPARATION

    IN-STREAMTESTING

    CROSS-STREAMTESTING

    ACCEPTANCETESTING

    TRANSACTIONTESTING

    IT-D

    ep.

    Bus

    ines

    s D

    ep.

    CTG’s V-Model for SAP®

  • 14

    Copyright © CTG, Inc.

    Acceptance testers

    Acceptance testers usually are users

    Experts in a specific domainFinanceMarketingHRMEtc...

    Need to be guided in their testing tasks

    Copyright © CTG, Inc.

    GO LIVE &SUPPORT

    PROJECTPREPARATION

    BUSINESSBLUEPRINT

    REALIZATION DEVELOPERTESTING

    FINAL PREPARATION

    IN-STREAMTESTING

    CROSS-STREAMTESTING

    ACCEPTANCETESTING

    TRANSACTIONTESTING

    IT-D

    ep.

    Bus

    ines

    s D

    ep.

    CTG’s V-Model for SAP®

  • 15

    Copyright © CTG, Inc.

    Test Tool Specialist

    General SAP® knowledge

    Specialized tool knowledgePerformance toolsAutomation tools

    Development skills

    Structured testing principles

    Copyright © CTG, Inc.

    Outline

    IntroductionTesting SAP® in theory:

    ProcessPeopleTechnology

    Testing SAP® in practice: case

  • 16

    Copyright © CTG, Inc.

    STBoxTM Testing Methodology

    Copyright © CTG, Inc.

    Types of test tools

    Test management toolsPerformance test toolsTest automation tools

  • 17

    Copyright © CTG, Inc.

    Test management tools

    Centralized test mgt

    TestView

    Centralized test mgt

    TestDirector / Quality center

    Centralized test mgt

    QACenter

    Copyright © CTG, Inc.

    Performance test tools for SAP®

    Performance testing

    Forecast

    Performance testing

    Sucid Load

    Performance testing

    Silk performer

    Performance testing

    Rational performance tester for SAP®

    Load testingLoadRunner

    Performance testing

    QALoad

  • 18

    Copyright © CTG, Inc.

    Test automation tools for SAP®

    Functional testing of SAP® GUI

    Rational robot

    Functional and regression testing

    Quick test professional

    Functional and regression testing

    QARun/Testpartner

    Testing suiteE-CATT

    Analysis toolsSOLO/LiveModel/LiveCapture/LiveCompare/Assessor

    Copyright © CTG, Inc.

    Conclusion

    SAP® specificEnd to endV-modelTesting knowledge underestimatedImportance of system and integration testingTester is test specialist (pref. with SAP® knowledge)

    GenericTest coordinator key roleTest process

  • 19

    Copyright © CTG, Inc.

    Outline

    IntroductionTesting SAP® in theory:

    ProcessPeopleTechnology

    Testing SAP® in practice: case

    Copyright © CTG, Inc.

    Goal of projectCreation of a test strategy for maintenance projectsRegression testing for all new releases:

    New/modified functionalityRollout new sitesVersion upgradesHot packs/legal packs

    Set up structured test approach for all future SAP®maintenance projects

  • 20

    Copyright © CTG, Inc.

    Used methodology: STBoxTM ModelTEST PROJECT PREPARATION

    TEST

    MANAGEMENT

    DETAILED TEST PLANNING

    TEST BUILD

    TEST EXECUTION

    For every Iteration / Test Level /Test Type: QUALITY

    MANAGEMENT

    TEST PROJECT CLOSURE

    Copyright © CTG, Inc.

    1. Generic Test PlanningTEST PROJECT PREPARATION

    TEST

    MANAGEMENT

    DETAILED TEST PLANNING

    TEST BUILD

    TEST EXECUTION

    For every Iteration / Test Level /Test Type: QUALITY

    MANAGEMENT

    TEST PROJECT CLOSURE

  • 21

    Copyright © CTG, Inc.

    Phase 1: Generic Test Planning

    Determine scope of projectSAP® testing in maintenance projectDefine regression test approach

    Determine high level test strategy-> Test strategy matrix per SAP ® module

    List all SAP® transactions in logical business/testing flowInventory of (available) test scenarios and ancestor test scenariosInventory of relevant SAP® documentation: business flow, work instructions, business process proceduresGeneric priority analysis: SLA rating and usageAnalysis cross-module impactListing of tester profile per transaction

    Copyright © CTG, Inc.

    Phase 1: Generic Test Planning

    Test strategy matrix: content:One test strategy matrix per SAP® module Different worksheets per matrix

    The test strategy matrixSLA rating of each transactionUsage of each transaction Transactions with roles: list of simple roles in SAP® against transactions per module -> for authorization testing

    Only useful for the completion of the test strategy matrix

  • 22

    Copyright © CTG, Inc.

    Phase 1: Generic Test Planning

    Copyright © CTG, Inc.

    GO LIVE &SUPPORT

    PROJECTPREPARATION

    BUSINESSBLUEPRINT

    REALIZATION DEVELOPERTESTING

    FINAL PREPARATION

    IN-STREAMTESTING

    CROSS-STREAMTESTING

    ACCEPTANCETESTING

    TRANSACTIONTESTING

    CTG’s V-Model for SAP®

  • 23

    Copyright © CTG, Inc.

    Phase 1: Generic Test Planning

    Authorization analysis-> Authorization analysis

    List of simple roles in SAP® R/3 against the individual transactions / module

    Copyright © CTG, Inc.

    Phase 1: Generic Test Planning

    Create generic test plan-> generic test plan

    Identify test assignment and scopeList test object and test basis List high level Features To Test and Features not To TestDiscuss approach used in this test project:

    Test methodology Test automation?Reviews and inspectionTest strategyDefect trackingMeetings and reportingDifferent test level

  • 24

    Copyright © CTG, Inc.

    Phase 1: Generic Test Planning

    Create generic test plan: cont’d

    List item pass/fail criteriaList suspension and resumption requirementsList testing tasks and deliverablesDescribe IT system landscapeDescribe responsibilitiesInclude chapter on staffing and training needsInclude test schedule

    Copyright © CTG, Inc.

    2. Detailed Test PlanningTEST PROJECT PREPARATION

    TEST

    MANAGEMENT

    DETAILED TEST PLANNING

    TEST BUILD

    TEST EXECUTION

    For every Iteration / Test Level /Test Type: QUALITY

    MANAGEMENT

    TEST PROJECT CLOSURE

  • 25

    Copyright © CTG, Inc.

    Phase 2: Detailed Test Planning

    Determine detailed test strategy

    Analyze scope of maintenance project (upgrade, minor implementation, support pack…)Decide on relevant test levelsPerform impact analysisIdentify FTT’s based priority (impact * SLA * usage) = test effortExtract in scope test plan from test matrixIdentify missing documentation

    Copyright © CTG, Inc.

    Phase 2: Detailed Test Planning

  • 26

    Copyright © CTG, Inc.

    Phase 2: Detailed Test Planning

    Create test data plan-> test data plan

    To support execution of test scenariosFabricated and loaded data

    Copyright © CTG, Inc.

    Next StepsTEST PROJECT PREPARATION

    TEST

    MANAGEMENT

    DETAILED TEST PLANNING

    TEST BUILD

    TEST EXECUTION

    For every Iteration / Test Level /Test Type: QUALITY

    MANAGEMENT

    TEST PROJECT CLOSURE

  • 27

    Copyright © CTG, Inc.

    Outline

    IntroductionTesting SAP® in theory:

    ProcessPeopleTechnology

    Testing SAP® in practice: case

    Copyright © CTG, Inc.

    Conclusion

    Inventory of FTT’s with priorityTest strategy matrix

    Complete and consistentExtensive and reusable basis Minimize risksAchieve higher maturity level in test approachHigher quality through structured testing

    SAP maintenance testing: focus on preparation and planning