Application Quality with Visual Studio 2010

Using Microsoft Test Manager,
Visual Studio 2010, and TFS 2010 to
Improve Software Quality
xx

arusso@imaginet.com

www.imaginet.com
© Copyright 2011 Imaginet. All rights reserved.

The enclosed material is proprietary to Imaginet and is therefore
copyrighted. This document may not be disclosed in any manner to
anyone other than the addressee and the employees or
representatives of Notion Solutions who are recipients. This
document may not be used in any manner other than for the
purpose it was distributed. Any unauthorized use, reproduction or
transmission in any form is strictly prohibited.

www.imaginet.com

Agenda
• Managing Test
Resources
• Reporting of “Done”
• Test Automation
• Improving Software
Quality


Work Management
How do we manage testing resources?


Managing Test Resources


Demo
Using Planning Workbooks


Reporting of “Done”
What is the end goal?


Improved Reporting


What’s the value?
Are we making progress How are our builds
on running test plans? doing over time?

What’s the quality of
Are we fixing bugs?
our bug fixes?


Improved Test Reporting


Improved Bug Reporting


Reporting


Automated Testing
How does Automation
help?


Microsoft Testing
Tools
Microsoft Test Manager Visual Studio 2010
2010 Automated Testing Tools
Manual Testing Tools Coded UI Tests
Test Plan Management Web Performance Tests
Test Case Management Load Tests
Shared Steps Generic Tests
Management
Developer Unit Tests
Test Configuration
Database Unit Tests
Management
Test Fast Forwarding
Test Data Collectors
Test Lab Management

Anna Bots


Test Process

• Create Test Plan
Release Cycle Test Plan • Review Test Plan

• Write Test Cases
Requirements Test Case • Review Test Cases

Build/ Execute • Write Bugs
Environment Tests • Verify Bugs

Test Run Report • Requirement Traceability Matrix
Results • Bug Trends

Improve Test • Identify Automation Candidates
Coverage
Automation • Create Automation Script

Automated Coded UI Test

Recorded
Actions
from Manual
Tester Automated
Coded UI Test

+ Validation
Code =
Use Visual
Studio
Recorder


Best Practices (From MSDN)
• Create each test case as a sequence of Recorded
Methods.
• Use meaningful method names.
• Try to limit the length of each recorded method to less
than 10 actions.
• Do not modify the RecordedMethods.cs file.
• Do not edit the UIMap.Designer.cs file.


Playback.PlaybackSettings
• Continue on Error …
• DelayBetweenActions
• MatchExactHierarchy
• SearchTimeout
• SmartMatchOptions
• TopLevelWindow
• Control
• None
• ThinkTimeMultiplier
• WaitForReadyTimeout


UITestControl.WaitForControl…
• WaitForControlReady() – This waits for the control to be ready to
accept mouse/keyboard input.
• WaitForControlEnabled() – This waits for the control to be enabled.
• WaitForControlExist() – This waits for the control to exist on the UI.
• WaitForControlNotExist() – This waits till the control cease to exist
on the UI. For example, you can use this for progress dialog to go
away.
• WaitForControlPropertyEqual(string propertyName, object
propertyValue) – This waits for the specified property of the control to
have the given value.


Automation Platform Support
Platform Support Notes Fully supported platform

IE7/8 – HTML/AJAX IE9 supported in SP1.
Partial solution. Further work
.NET Fx Controls fully supported, working required in future to complete
Windows Forms 2.0+ on 3rd party support.
.NET Fx Controls fully supported, working
Best efforts with known issues.
WPF 3.5+ on 3rd party support.
Users can workaround these cases in
SharePoint 2007 & 2010 See blog post for more info. the code. No major ongoing
investment.
Supported in Feature Pack 2 for FF 3.5 &
FireFox – HTML/AJAX
3.6.
Supported in Feature Pack 2 for
Silverlight
Silverlight 4, in-browser apps. Currently no support but on the
roadmap for future releases
May work with some known issues, but
Windows Win32
not officially supported.
Partially supported – see article.
Dynamics (Ax) Dynamics CRM web client is supported. Currently no support and none
planned for now. Opportunity for
Partial support – Known issues & partners to add this using the
MFC Extensibility support. Docs and
Workarounds
samples around extensibility are
The client (MTM or VS) need to be on here.
Citrix/Terminal Services
the remote machine.
Office Client Apps

IE 6/Chrome/Opera/Safari Opportunity for partners to add this
using the Extensibility support. Docs and
For latest info refer to this article.
Flash/Java samples around extensibility are here.
SAP 2010 Imaginet. All rights reserved.
© Copyright

Demo
Automated Coded UI Testing


Test Lab Managment
How do we integrate VM’s for
manual or automated
testing?


Improve Software Quality by
Layering Best Practices
Process and tools support individuals, teams and
organizations frictionlessly and transparently

Overcome Complexity Collaboration Clarity
Quality Mindset Transparency Alignment
Culture of Innovation Integration Efficiency

Highly integrated Productive Extensible Low administration

Agile Customizable Lightweight Patterns and practices Flexible

www.imaginet.com


Application Quality with Visual Studio 2010

More Related Content

What's hot

Viewers also liked

Similar to Application Quality with Visual Studio 2010

Recently uploaded

Application Quality with Visual Studio 2010