Mitch Denny



              Chief Technology Officer


              mitch.denny@readify.net


              http://notga...
• Managing Testing Efforts
• Automating Test Cases
• Deploying Lab Environments
• Terminology
• Demos
  –   Creating Test Plans
  –   Understanding Test Settings
  –   Creating Test Cases
  –   Using Sh...
• Test Plan; a container for test cases with a
  set time span.
• Test Case; a sequence of steps which must
  be tested.
•...
Demonstration
Demonstration
Demonstration
Demonstration
Demonstration
Demonstration
Demonstration
•   Test Plans – By Feature Area/By Iteration?
•   Shared Steps – When to Use?
•   Configurations – Common Attributes?
•  ...
• Coded UI Test; some code that uses the
  UI test automation framework that is
  hosted inside MSTest.
• Coded UI Test Bu...
• Terminology
• Demos
  – Create from Action Log Recording
  – Create with Coded UI Test Builder
  – Create from Scratch
 ...
Demonstration
Demonstration
Demonstration
Demonstration
• Action Log Recordings - Good or Bad?
• Hand Code? The curse of the UIMap!
• Automation - When to automate?
Legend
                                                  New




        Iteration 1   Iteration 2   Iteration 3          ...
Legend
                                                                  New   Changed




        Iteration 1           I...
Legend
                                                                          New     Changed         Stable




      ...
Legend
                                                                          New     Changed         Stable




      ...
Legend
                                                                          New     Changed         Stable




      ...
Legend
                                                                          New     Changed         Stable




      ...
Legend
                                                                           New     Changed         Stable




     ...
• Terminology
• Demos
  – Running Automated Tests from MTLM
  – Creating Environments
  – Automating Deployments
  – Night...
• Team Build; a component of TFS that
  provides distributed build capability.
• Build Workflow; a XAML file containing
  ...
• Lab; the infrastructure you use to test out
  the products you are developing.
• Environment; a specific subset of the l...
• Library; a storage location for saved VMs,
  ISO images etc.
• Snapshot/Checkpoint; a point in time
  version of a lab m...
Demonstration
Demonstration
Demonstration
Demonstration
•   Snapshotting – Pre/Post?
•   Reporting - Track Quality, Track Activity
•   Network Isolation – What is it? Why?
•   En...
Remote
                                                              Active
Internet                            Access
   ...
• Managing Testing Efforts
• Automating Test Cases
• Deploying Lab Environments
• http://blogs.msdn.com/lab_management/
• http://vslabmgmt.codeplex.com
• http://channel9.msdn.com/tags/ALM/
• Visual Studio 2010 Workshop (1 day)
• Implementation Consulting
• Virtual Build Master (Managed Service)
Mitch Denny



              Chief Technology Officer


              mitch.denny@readify.net


              http://notga...
Microsoft Test Manager
Microsoft Test Manager
Microsoft Test Manager
Microsoft Test Manager
Microsoft Test Manager
Microsoft Test Manager
Upcoming SlideShare
Loading in...5
×

Microsoft Test Manager

27,712

Published on

A presentation to the Canberra VSTS User Group on the topic of Microsoft Test Manager (MTM).

3 Comments
4 Likes
Statistics
Notes
No Downloads
Views
Total Views
27,712
On Slideshare
0
From Embeds
0
Number of Embeds
1
Actions
Shares
0
Downloads
941
Comments
3
Likes
4
Embeds 0
No embeds

No notes for slide

Microsoft Test Manager

  1. 1. Mitch Denny Chief Technology Officer mitch.denny@readify.net http://notgartner.com @MitchDenny
  2. 2. • Managing Testing Efforts • Automating Test Cases • Deploying Lab Environments
  3. 3. • Terminology • Demos – Creating Test Plans – Understanding Test Settings – Creating Test Cases – Using Shared Steps – Launching Test Cases – Creating Bugs – Reviewing Results • Best Practices
  4. 4. • Test Plan; a container for test cases with a set time span. • Test Case; a sequence of steps which must be tested. • Test Run; a group of tests that are being run locally or in the lab. • Test Result; a result from a test case in a test run.
  5. 5. Demonstration
  6. 6. Demonstration
  7. 7. Demonstration
  8. 8. Demonstration
  9. 9. Demonstration
  10. 10. Demonstration
  11. 11. Demonstration
  12. 12. • Test Plans – By Feature Area/By Iteration? • Shared Steps – When to Use? • Configurations – Common Attributes? • Data Recorders – Considerations?
  13. 13. • Coded UI Test; some code that uses the UI test automation framework that is hosted inside MSTest. • Coded UI Test Builder; a utility that allows you to graphically construct UI tests. • Action Log Recording; an XML file previously recorded via the Test Runner with the Action Log Recording data collector.
  14. 14. • Terminology • Demos – Create from Action Log Recording – Create with Coded UI Test Builder – Create from Scratch – Using Test Case Data Sources • Best Practices
  15. 15. Demonstration
  16. 16. Demonstration
  17. 17. Demonstration
  18. 18. Demonstration
  19. 19. • Action Log Recordings - Good or Bad? • Hand Code? The curse of the UIMap! • Automation - When to automate?
  20. 20. Legend New Iteration 1 Iteration 2 Iteration 3 Iteration 4 Story Story #1 #2
  21. 21. Legend New Changed Iteration 1 Iteration 2 Iteration 3 Iteration 4 Story Story Story Story Story #1 #2 #1 #2 #3 Story Story #4 #5
  22. 22. Legend New Changed Stable Iteration 1 Iteration 2 Iteration 3 Iteration 4 Story Story Story Story Story Story Story Story #1 #2 #1 #2 #3 #1 #2 #3 Story Story Story Story Story #4 #5 #4 #5 #6 Story #7
  23. 23. Legend New Changed Stable Iteration 1 Iteration 2 Iteration 3 Iteration 4 Story Story Story Story Story Story Story Story Story Story Story #1 #2 #1 #2 #3 #1 #2 #3 #1 #2 #3 Story Story Story Story Story Story Story Story #4 #5 #4 #5 #6 #4 #5 #6 Story Story Story Story #7 #7 #8 #9
  24. 24. Legend New Changed Stable Iteration 1 Iteration 2 Iteration 3 Iteration 4 Story Story Story Story Story Story Story Story Story Story Story #1 #2 #1 #2 #3 #1 #2 #3 #1 #2 #3 Story Story Story Story Story Story Story Story #4 #5 #4 #5 #6 #4 #5 #6 Story Story Story Story #7 #7 #8 #9 Action Log Assisted Testing
  25. 25. Legend New Changed Stable Iteration 1 Iteration 2 Iteration 3 Iteration 4 Story Story Story Story Story Story Story Story Story Story Story #1 #2 #1 #2 #3 #1 #2 #3 #1 #2 #3 Story Story Story Story Story Story Story Story #4 #5 #4 #5 #6 #4 #5 #6 Story Story Story Story #7 #7 #8 #9 Action Log Assisted Testing Coded UI Testing
  26. 26. Legend New Changed Stable Iteration 1 Iteration 2 Iteration 3 Iteration 4 Story Story Story Story Story Story Story Story Story Story Story #1 #2 #1 #2 #3 #1 #2 #3 #1 #2 #3 Story Story Story Story Story Story Story Story #4 #5 #4 #5 #6 #4 #5 #6 Story Story Story Story #7 #7 #8 #9 Action Log Assisted Testing Coded UI Testing Unit Testing
  27. 27. • Terminology • Demos – Running Automated Tests from MTLM – Creating Environments – Automating Deployments – Nightly Regression Tests • Best Practices
  28. 28. • Team Build; a component of TFS that provides distributed build capability. • Build Workflow; a XAML file containing the instructions to produce a build via Team Build. • Lab Build; a special case build workflow designed to automate lab management.
  29. 29. • Lab; the infrastructure you use to test out the products you are developing. • Environment; a specific subset of the lab dedicated to a particular team project. • Hyper-V; the virtualisation technology created by Microsoft. • SCVMM; a product from the System Centre suite designed to manage multiple Hyper-V hosts.
  30. 30. • Library; a storage location for saved VMs, ISO images etc. • Snapshot/Checkpoint; a point in time version of a lab machine (memory + disk).
  31. 31. Demonstration
  32. 32. Demonstration
  33. 33. Demonstration
  34. 34. Demonstration
  35. 35. • Snapshotting – Pre/Post? • Reporting - Track Quality, Track Activity • Network Isolation – What is it? Why? • Environment Configuration – How?
  36. 36. Remote Active Internet Access Directory Gateway VPN (Encrypted) RDP (Encrypted) Multi- HTTP (Encrypted) Tenant TFS Firewall Hyper-V Farm (VMM) Customer Customer Build Build Server(s) Server(s) Dedicated Dedicated Dedicated Dedicated Other Lab Lab Other optional external Lab Lab Services Machines Machines Services exposure Machines Machines
  37. 37. • Managing Testing Efforts • Automating Test Cases • Deploying Lab Environments
  38. 38. • http://blogs.msdn.com/lab_management/ • http://vslabmgmt.codeplex.com • http://channel9.msdn.com/tags/ALM/
  39. 39. • Visual Studio 2010 Workshop (1 day) • Implementation Consulting • Virtual Build Master (Managed Service)
  40. 40. Mitch Denny Chief Technology Officer mitch.denny@readify.net http://notgartner.com @MitchDenny
  1. A particular slide catching your eye?

    Clipping is a handy way to collect important slides you want to go back to later.

×