Testing with Visual Studio 2012 Agile TMap

1. Module 03
Test Controlling
and Tracking

2. Topics

3. Providing the client with sufficient insight into, and the opportunity to influence, the following:
• The progressof the test process
• The quality and risks of the test object
• The quality of the test process
Manage the test process, the infrastructure and the test products. Using the data thus obtained as a basis, and the
analyses of possibletrends.
http://www.tmap.net/en/tmap/4-essentials/structured-test-process/acceptance-and-system/control-phase
The Control Phase

4. Software Testing with Visual Studio

5. Reporting on Software Quality

6. Monitoring Quality Metrics

7. Available Test Reports

8. Rich Information
Rich Visualization
Harder to Customize
SQL Server Reports

9. Out of the Box
Easy to create your own
Easy to Customize
Excel Reports

10. All information in
one place – the browser
Based on Excel Services
Customizable
Ideal for “Self-Service BI”
SharePoint/Web Access Dashboards

11. Manual/Functional
Test Results
Microsoft Test Manager Results

12. Filters allow you to control
which builds you see
View the test and code coverage
results for each build to
determine quality

15. Line-by-line highlighting illustrates
which code is covered, uncovered,
or partially covered by test
Results show which methods are
covered by test and total coverage is
indicated by a percentage

16. Track total percentage hours
completed by user story
View real-time status of
each user story
Test results quickly display
quality status of each user story
Track active and resolved
bugs by user story

17. Demo
Quality Reports

18. Bugs and Defects

19. Manual Testing

20. Catching and Tracking Bugs
Rich Information
Customizable
Collect rich Information
with Data Diagnostic
Adapters
Customizable bug flow,
states and reporting

21. Organize testing in multiple
configurations
Playback a prior recording to save
time with frequently-repeated
setup steps and prerequisites
Bind data to controls, to
support multiple iterations
and future automation
Pause, save, close, return, and
pick up where you left off

22. Filing Bugs
Rich Information
Customizable
Microsoft Test Runner
Microsoft Test Manager
TFS Web Access
Visual Studio
Feedback Manager*
3rd party tools*

23. IntelliTrace Logs
System logs & configuration
Detailed status and history
visible to all team members
Audio & Video recordings

24. Action Recording
Video
Intellitrace
Test Impact
“Create your own”
Data Diagnostic Adapters

25. Get an overview of the test run
with summary pie charts, or drill
into the details for each test.
Analyze code coverage for manual
tests to determine which specific
parts of your code were tested .
Associate manual test runs
with builds and environments.

26. Demo
Creating and Resolving a Bug

27. The Bug Backlog
Put Bugs on the
Backlog
Create your own
Bug Workflow

28. Custom Reports

29. Relational Databases
(TFS)
Data Warehouse
(Reporting Services)
Creating Customized Reports

30. Creating Excel Reports for Test

31. Quality Status Reports
“What is the status of testing of specific user stories or product areas?”
“What is the quality of builds based on the number of failed and passed tests?”
“How many test cases have never been run?”
“Which test cases have never been run?”
Quality Trend Reports
“How many tests are blocked, passing, or failing over time?”
“How many tests are regressing?”
“How consistent is the manual test activity over time?”
Test Results - Data Points

32. Demo
Creating an Excel Pivot Table