02b | Create and Configure Test Plans (2 of 2)

Anthony Borton | ALM Consultant, Enhance ALMSteven Borg | Co-founder & Strategist, Northwest Cadence

• Create Test Plan Properties

• Configure Test Settings

• Define Configurations

• Create Test Suites

• Configure Test Suites

Module Overview

Click to edit Master subtitle style

Microsoft Virtual Academy

Define Configurations

What the Study Guide says…

• Define configurations–managing configuration variables– setting default configurations– adding new configurations– setting configuration state– deleting configurations

Why different configurations?

• Different configurations exist– SOE/MOE (Can you proactively test for upcoming

releases?)– Users will often have varying:• Browsers and browser versions• Operating systems• Architectures (x86 and x64)

– Server side software may have different:• Database versions (SQL 2005, 2008, 2008 R2)• IIS versions (6.0/7.0/7.5)

Dealing with different configurations

• The traditional solution– A room with many PC’s around the outer wall with signs

above them. Eg. Windows XP Pro/IE7/x86/2Gb RAM

• A better solution–Multiple virtual machines running on a testers local

machine so they can easily switch between configurations

• A more ideal solution–Microsoft Lab Management running multiple network-

isolated, test environments with auto refresh and auto deploy of updated releases.

Tracking different configurations

• Traditional approach– Test cases mapped to configurations in a matrix

Configurations

• To manage your configurations, choose Organize in the menu then choose Test Configuration Manager

Deleting Test Configurations

• You can delete test configurations that you do not require.

• If a test configuration is referenced in a test result or is a default configuration for a test plan or a test suite, you cannot delete that configuration.

• Alternatively, you can change the state of the configuration to inactive so that it can no longer be selected as a default configuration for a test suite or a test plan

DEMO

Microsoft Virtual Academy

Define Configurations

Click to edit Master subtitle style

Microsoft Virtual Academy

Create Test Suites

What the Study Guide says…

• Create Test Suites– creating query-based Test Suites– creating requirement-based Test Suites– creating static Test Suites– copying Test Suites– creating a Test Suite hierarchy– assigning Test Suite states

Different Types of Test Suites

• Requirement-based Test Suites– Groups test cases related to a specific requirement

• Static Test Suites– Groups test cases based on the tester manually adding

test cases

• Query-based Test Suites– Groups test cases that match a filter the tester defines

• Test Suites can be – In planning– In progress– Completed

• Change state usingPlan Tab | Contents

Conveying test suite state information

Test Plan

Test Suites

TEST CASES

TEST CASES

7: As a customer…

End-to-end tests

Test ConfigurationsWindows 7 and

IE8Windows 8 and

IE10

• Assigned Build

• Date range

• Manual test settings• Automated test

settings

Copying Test Suites

• Sometimes you need to create a test suite that is the same or similar to one you have created in an earlier test plan.

• Microsoft Test Manager allows you to just copy the test suite to the current plan.

• Once copied you can add or remove test cases from this copied test suite as required, without affecting the original test suite.

• Copying a test suite does not create duplicate copies of the test cases in your team project. The existing test cases in the test suite that you are copying are just added to the new test suite.

Cloning a Test Suite

• Cloning test suites by using tcm.exe creates new test cases in the destination test plan.

• These new test cases are copies of the test cases in your source test plan. After the copy, you can edit the test cases in either plan without affecting the other.

• Cloning test suites is useful when you want to work on two differing releases simultaneously.

• The source and target suites must be in the same team project collection. (MTM RTM)

Summary - Copying vs Cloning

• Copying Test Suites

• Cloning Test Suites

DEMO

Microsoft Virtual Academy

Create Test Suites

Click to edit Master subtitle style

Microsoft Virtual Academy

Configure Test Suites

What the Study Guide says…

• Configure Test Suites– assigning Testers– selecting configurations– ordering Test Cases within a Test Suite– setting defaults

Assigned to

• The Assigned to field for Test Cases is different to the typical Assigned To for other work item types such as Task.

• The person that writes a test case may not be the person who runs it.

Ordering Test Cases within a Test Suite

• You might want to list and run your test cases in a specific order.

• For example, you might want to run the simplest tests first, because if these tests failed then the subsequent tests in your test suite would be blocked

DEMO

Microsoft Virtual Academy

Configure Test Suites

• Make sure you try a few different configurations

• Be mindful of idiosyncrasies of Test Case work items compared to other work item types

• Practice creating different Test Suite types

EXAM BEST BETS

©2013 Microsoft Corporation. All rights reserved. Microsoft, Windows, Office, Azure, System Center, Dynamics and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.