Microsoft Testing Tour - Functional and Automated Testing

25
With TFS and Visual Studio Angela Dugan ALM Practice Manager Polaris Solutions

description

What should I automate? While manual testing is always going to have its place, there are several types of tests that can be automated for efficiency. In this session, we’ll discuss everything from automating functional and load tests to the automation of writing test case steps and designing for reuse.

Transcript of Microsoft Testing Tour - Functional and Automated Testing

Page 1: Microsoft Testing Tour - Functional and Automated Testing

With TFS and Visual Studio

Angela Dugan

ALM Practice Manager

Polaris Solutions

Page 2: Microsoft Testing Tour - Functional and Automated Testing

Angela Dugan

Page 3: Microsoft Testing Tour - Functional and Automated Testing

User

Interface

Services

Business Processes

Business Rules and Logic

Service integrations

Data access

Identity

Data

Automated testingUnit testingIntegration testingPerformance testingLoad testing

Manual testingUser testingAd-hoc exploratory testing Planned manual testing

Automated testingKeyword testingUI automation testingPerformance testing

Continuous integrationsBuild | Deploy | Test

Dev

SIT

UAT

Stress

Prod

Testing toolboxRole tailored tools

Lab management automation

Page 4: Microsoft Testing Tour - Functional and Automated Testing
Page 5: Microsoft Testing Tour - Functional and Automated Testing
Page 6: Microsoft Testing Tour - Functional and Automated Testing

UI regression test needs grow over time

Manual UI testing impacts the delivery cycle times

Automated UI tests are brittle, time-consuming to maintain

Record and automate UI tests

Robustly instrument UI tests to reduce maintenance overhead

Associate UI tests with a scheduled build

Test more functionality in less time

Reduce or eliminate repetitive manual testing

Reduce cycle time when delivering new features

Page 7: Microsoft Testing Tour - Functional and Automated Testing
Page 8: Microsoft Testing Tour - Functional and Automated Testing

Generate your Coded UI test from

an existing recording, or record a

new test case on the fly

Convert the test case to code

for enhanced flexibility

Page 9: Microsoft Testing Tour - Functional and Automated Testing

CodedUI tests interact

directly with your app’s UI

Tests can be run and monitored

on the local machine, or further

automated on a virtual machine

Cross-browser testing

support allows automated

testing on multiple browsers

Page 10: Microsoft Testing Tour - Functional and Automated Testing
Page 11: Microsoft Testing Tour - Functional and Automated Testing
Page 12: Microsoft Testing Tour - Functional and Automated Testing

Coded UI tests run as part of your

unit testing suite, enabling

developers to detect defects early

Even if the look & feel changes, the

automated test still executes properly

Coded UI tests are part of source

control for maximum visibility

Page 13: Microsoft Testing Tour - Functional and Automated Testing

Preferred partner solution : FrogLogic

Import and run Squish GUI

tests directly in Visual

Studio and view results

Push Squish tests into TFS

Associate Squish tests

with MTM Test Cases

Page 14: Microsoft Testing Tour - Functional and Automated Testing

Preferred partner solution : LogiGear

Keyword-driven authoring

platform using familiar tools

Fully integrated,

multi-platform testing

Library of preprogrammed

reusable actions

Page 15: Microsoft Testing Tour - Functional and Automated Testing

Page 16: Microsoft Testing Tour - Functional and Automated Testing

Incident management tools and workflows to integrate operations and development teams in reducing MTTR

Reduction of MTTR

• SCOM and TFS integrated workflows to manage incidents from occurrence to resolution

• One click “Assign to Engineering” from SCOM

• Collection of actionable diagnostics in production for development troubleshooting (IntelliTrace)

Page 17: Microsoft Testing Tour - Functional and Automated Testing

Testing the User Interface with Automated UI Tests: http://msdn.microsoft.com/en-us/library/dd286726%28v=vs.100%29.aspx

CodedUI Testing Walkthroughs: http://msdn.microsoft.com/en-us/library/dd286726.aspx

CodedUI Best Practices: http://msdn.microsoft.com/en-us/library/dd380782.aspx

System Testing with Visual Studio: http://msdn.microsoft.com/en-us/library/jj620889.aspx

Page 18: Microsoft Testing Tour - Functional and Automated Testing
Page 19: Microsoft Testing Tour - Functional and Automated Testing

Mark each step as pass/fail when recording manual tests

Carefully consider which test cases make sense for automation, and when

Use the Automation Status field of test cases to identify candidates for automation

Page 20: Microsoft Testing Tour - Functional and Automated Testing

Use the Coded UI Test Builder whenever possible

Do not modify UIMap.designer.cs as it may be overwritten

Create your test as a sequence of methods

Create a new test method for each new page, form, or dialog

When you create a method, use a meaningful name

Try to limit each method to fewer than 10 actions

Create each assertion using the Coded UI Test Builder

If the UI changes, re-record the test or assertion methods

Page 21: Microsoft Testing Tour - Functional and Automated Testing

Test -> Windows -> Test View -> Properties

Select CSV, XML, or SQL

this.UIMap.SimpleTestParams.UIMyTextboxEditText = TestContext.DataRow[“col_name"].ToString();

Databinding to test parameters happens automatically when converting from manual test cases

Page 22: Microsoft Testing Tour - Functional and Automated Testing

Searchingused to look for all possible controls

Filteringused to narrow that list exactly one match

X, Yonly used to guide where the clicks happen within a control Mouse.Click(uIGOButton,

new Point(19, 18));

Page 23: Microsoft Testing Tour - Functional and Automated Testing

ULTIMATE

Premium

Professional

Test

Professional

Team Explorer Everywhere

SharePoint

Office

Web Access

Page 24: Microsoft Testing Tour - Functional and Automated Testing
Page 25: Microsoft Testing Tour - Functional and Automated Testing