Automating Server-based Build, QA & Test withVisual Studio 2012Neno LojeConsultant & MVP for Visual Studio ALM, TFS, and Scrumwww.teamsystempro.com

Based on:

What's Your Cycle Time?

Sprint illustration by Tyler Gibson, Microsoft Corp.

Customer can benefitfrom the feature

Developer checks innew feature or bug fix

Define "Done"

Explicit Definition of Done (DoD)Constant QualityImportant for EstimatesInfluenced by Enterprise StandardsMeasurableAutomated

Step-by-Step Guide to more Quality

Step 1 – Source Control EverythingStep 2 – Automated BuildStep 3 – Continuous Integration (Gated Check-In)Step 4 – Automated Build Verification Test

Unit Tests, Code Coverage, Data-Driven Unit Tests, Code Analysis, Layer Validation

Step 5 – Automated Deployment & Acceptance TestUI Acceptance Tests

demo Automated Checking against the Definition of Done with Visual Studio 2012

Team Explorer 2012 Keyboard Shortcuts

Shortcut Team Explorer Page

Ctrl+0, H Home

Ctrl+0, P Pending Changes

Ctrl+0, M My Work

Ctrl+0, W Work Items

Ctrl+0, B Build

Ctrl+0, R Reports

Ctrl+0, D Documents

Ctrl+0, S Settings

Ctrl+0, A Web Access – team home page

Source: http://blogs.msdn.com/b/buckh/archive/2012/06/06/team-explorer-2012-keyboard-shortcuts.aspx

TransparencyHow well are we doing?

Build Success Over Time ReportHow well is the team testing the code?

Illustration taken from MSDN Library (msdn.microsoft.com)

Build Summary Report

Illustration taken from MSDN Library (msdn.microsoft.com)

Build Quality Indicators ReportIs the team likely to finish on time based on the code and test metrics?

Illustration taken from MSDN Library (msdn.microsoft.com)

Summary / Next Steps

Define Quality (= Create your Definition of Done)

Automate checking against your DoD

Measure your successCycle Time: Idea working software in the user’s handsMean Time To Repair (MTTR): discovery of a problem fix

References

> Using Code Analysis Rule Setshttp://blogs.msdn.com/b/habibh/archive/2009/08/12/create-your-own-code-analysis-rule-set-using-visual-studio-team-system-2010.aspx

> Validate Layer Diagrams during TFS Buildhttp://msdn.microsoft.com/en-us/library/dd409395.aspx

> Blog series on how to customize TFS Build (by Ewald Hofman)http://www.ewaldhofman.nl/post/2010/04/20/Customize-Team-Build-2010-e28093-Part-1-Introduction.aspx

> Free Book Chapter (Chapter 21) about TFS Build (and how to extend it)http://www.wrox.com/WileyCDA/WroxTitle/Professional-Application-Lifecycle-Management-with-Visual-Studio-2010.productCd-0470484268.html

> Ready-to-use Build Process Template: Build Release Deploy (BRDLite)http://blogs.msdn.com/b/willy-peter_schaub/archive/2011/06/06/build-release-deploy-brdlite-what-is-it.aspx

> Visual Studio Lab Management Videoshttp://blogs.msdn.com/b/lab_management/archive/2010/02/11/visual-studio-lab-management-videos.aspx

> Enabling Code Coverage (in TFS 2010)http://www.codewrecks.com/blog/index.php/2010/06/14/running-code-coverage-in-tfs2010-builds/

Book Recommendations – for TFS 2010

> Inside the Microsoft Build Engine: Using MSBuild and Team Foundation BuildAutomated Build & Build Customization

> Professional Team Foundation Server 2010Must have guidance on everything you need to know about TFS 2012

> Professional Application Lifecycle Management with Visual Studio 2010Introduction to ALM with VS & TFS 2010 [see also: Sample chapter]

> Professional Scrum with Team Foundation Server 2010How to do Scrum using TFS 2010

> Software Testing with Visual Studio 2010Testing with VS & TFS 2010

Upcoming books – for TFS 2012

> Visual Studio Team Foundation Server 2012: Adopting Agile Software Practices: From Backlog to Continuous Feedback (3rd Edition)Definitive guide to the application of agile development with Scrum and modern software engineering practices using Visual Studio

> Professional Team Foundation Server 2012Must have guidance on everything you need to know about TFS 2012

> Professional Application Lifecycle Management with Visual Studio 2012Introduction to ALM with VS & TFS 2012

> Professional Scrum Development with Microsoft Visual Studio 2012 (MS Press)How to turn requirements into working software increments with VS + Scrum + Agile practices

Thank you for your attention!

Visit me at the VS ALM boothor e-mail me at:

neno.loje@teamsystempro.com

Premium Test Professional

Visual Studio 2012 Product Family

Professional

Enhanced Profiling(Tier Interaction)

Code Clone Analysis

Code Metrics

Code Coverage

Ultimate

Web Testing

Unlimited

Load Testing

Team Foundation Server

Unit Testing

For informational purposes only. No guarantee for correctness. All Trademarks owned by Microsoft Corp. Slide: © Neno Loje, www.teamsystempro.com, All rights reserved.

Code Profiler

Code Analysis

UI Test Automation

Microsoft Fakes(Unit Test Isolation)

IntelliTrace Collector

UML Diagrams

Architecture Explorer

Arch. Validation IntelliTrace®

PowerPoint

Storyboarding

Code Review

Feedback

My Work

Backlogs &

Planning

This is all public information taken from: http://www.microsoft.com/visualstudio/11/en-us/products/compare

Team Explorer Everywhere (TEE)

Eclipse Plug-In

Microsoft Test

Manager (MTM)

Related ContentDEV318 Working on an Agile Team with Visual Studio 2012 and Team Foundation Server 2012 – Forum on Wed, 2:45 PM - 4:00 PM

DEV217 Deep Dive Into Team Foundation Server 2012 Agile Management Tools – Emerald Room on Thu, 8:30 AM - 9:45 AM

DEV345 The Accidental Team Foundation Server Admin –Hall 3A on Thu, 8:30 AM - 9:45 AM

DEV340 Taking Your Application Lifecycle Management to the Cloud With the Team Foundation Service – D201 on Thu, 10:15 AM - 11:30 AM

OSP432 Application Lifecycle Management: Automated Builds and Testing for SharePoint projects – Emerald Room on Thu, 12:00 PM - 1:15

DEV324 A Modern Architecture Review: Using the New Code Review Tools –Forum on Fri, 10:15 AM - 11:30 AM

Resources

Connect. Share. Discuss.

http://europe.msteched.com

Learning

Microsoft Certification & Training Resources

www.microsoft.com/learning

TechNet

Resources for IT Professionals

http://microsoft.com/technet

Resources for Developers

http://microsoft.com/msdn

Evaluations

http://europe.msteched.com/sessions

Submit your evals online

© 2012 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries.The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to

be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS

PRESENTATION.