SlideShare a Scribd company logo
MICROSOFT TEST MANAGER
2013
Why MTM?
• Test Tool
• Different test types
– Manual/scripted
– Exploratory
– Automated (CodedUI/Unit tests)
• Integration
Visual Studio 2013 ALM
Resources
• Visual Studio 2013 Ultimate/Premium/Test
Professional
• TFS
• Visual Studio Online
• Brian Keller http://aka.ms/almvms
Agenda
Test Planning
Test Case
Management
Test Run
Exploratory
Testing
Lab
Management
Ready?
TEST
PLANNING
• Test plans1
• Test suites2
• Test configuration and
test settings3
Overview
Testing Hierarchy
TEST PLAN
Test Plan
Test Plan Creation
Test Plan Creation
Test Center
• Define tests you plan to run for a specific
sprint/iteration
• Execute the tests from your plan
• Measure progress/quality
Test Plan Properties
Test Plan Run Settings
Create Test plan from Web
TEST PLAN - DEMO
TEST PLAN - SUITES
Test Suites Overview
• Test Suites
• Static Test Suites
• Query-based Test Suites
• Requirement-based Test Suites
• Copying Test Suites
• Cloning Test Suites
Test Suites
• Group your test cases into a hierarchy of test suites
– Root node (suite) contains all other test suites
Test Suites
• Static
– Contains test cases and other test suites
• Query-based
– Contains test cases based on a query
– Test cases that fit the query criteria are dynamically
added
– Cannot contain other test suites
• Requirements-based
– Group your test cases by requirements
– Based on the work items that belong to the Requirement
category (Requirement, Product Backlog Item, User
Story, etc.)
Adding Test Cases to Static Test Suites
• Add existing or create new test cases for your static
test suites
Query-Based Test Suites
• Query-based test suites are defined by work item queries
that select test cases
– Example: All test cases with priority = 1
• Any new test case with priority set to 1 will be dynamically added to the
test suite
Requirement-Based Test Suites
• Add existing requirement (work item) to your test
plan to create test suite
• Each requirement has its own suite
• Test cases added are linked to requirements
• Helps to determine test coverage and completion
of your requirements
Create Test Suites from Web Interface
Copying Test Suites and Test Plans
• Copying
– Copies test cases “by reference”. New suite shares same
test cases
– Useful for testing with different test plans but same test
cases
– Can be done from the GUI
Copying Static Test Suites
Cloning Test Suites and Test Plans
• Cloning
– Copies test cases “by value”. New copies of test cases are
created
– Useful for testing two different releases simultaneously
– Command line
Cloning Test Suites and Test Plans
Cloning Test Suites – What Gets
Cloned?
TEST SUITES - DEMO
TEST CONFIGURATION
AND TEST SETTINGS
Test Configuration and Settings Overview
• Test Configurations
• Creating Test Configurations
• Defining Configuration Variables
• Selecting Test Configurations
• Test Settings
• Data Adapters
• How to Collect Data
Test Configurations
• Configuration
variables specify
setup required
for testing
– Examples:
Operating
system,
browsers,
software,
hardware, SP,
anything
• Can be
associated with
test plans, suites
and test cases
Create Test Configurations
• From Test Plan
Run Settings
• From Organize
tab
Defining Configuration Variables
Selecting Test Configurations
• Set default configuration(s) for your test plan
– You may override at test suite and test case levels
• A test case and test configuration pair is a test point
• Test results are saved for each test point
Test Settings
• Test settings use diagnostic data adapters to collect
data when running manual tests, automated tests,
or both
Test Settings
Test Reports
• View test run results in real time in MTM
• Use predefined test reports (Microsoft Excel, SQL
Server Reporting Services)
• Create your own reports (Microsoft Excel, SQL
Server Reporting Services)
Reporting on Test Progress: Test Plan
Reporting on Test Progress
• Test Case Readiness: Shows how many test cases
are in Design vs. Ready
Reporting on Test Progress (continued)
• Test Plan Progress: Tracks how many tests have
been run and how many are failing
Reporting on Test Progress (continued)
• Healthy version vs. unhealthy version
Healthy version Unhealthy version
Reporting on Test Progress (continued)
TEST CONFIGURATION
AND SETTINGS - DEMO
TEST CASE
MANAGEMENT
• Manual Test Cases1
• Test Steps Parameters2
• Shared Steps3
Overview
MANUAL TEST CASES
Manual Test Cases
• Test cases are work items
• Test results are saved on each run
• Manual test cases contain test steps (test
script)
– May contain test steps with validation
– A tester indicates pass or fail at the test step level
• A test case can be assigned to a tester
Manual Test Cases (continued)
• Test cases can be added to multiple test suites in
the same or different test plans
• Test cases are associated with 1..n test
configurations
– Creating 1..n test points
Team Project
Test Plan
Test
Suite
Test
Case
Test Suite
Test
Case
Test
Case
Test Plan
Test
Suite
Test
Case
Test Suite
Test
Case
Test
Case
Test
Case
Test
Suite
Test
case
Create Manual Test Cases from MTM
Create Manual Test Cases from MTM
(continued)
• Add test steps using Microsoft Test Manager (MTM),
Microsoft Excel, or Microsoft Word (via copy and paste)
• Add test steps
using
Microsoft Test
Manager
(MTM),
Microsoft
Excel, or
Microsoft
Word (via
copy and
paste)
Create Manual Test Cases from Web
Interface
Create Test Cases from an Assembly
of Automated Tests
• Use tcm.exe
• You must use a lab environment
• Make sure that the test project is a part of
your build definition
• The test cases will have the same names as
the test methods
Assign Test Cases to Testers
• Individually or in bulk
• Assign at test point level
TEST STEPS
PARAMETERS
Test Steps Parameters
• Parameters
allow a manual
test case to run
multiple times
with different
data
– Example:
@username,
@password
• Parameters can
be added to
actions or
expected results
Test Steps Parameters (continued)
• Overall test results are based on all iterations
passing
SHARED STEPS
Shared Steps
• Used for repeated sequences of steps, such
as logging in, that occur in many test cases
• Avoiding having to enter these sequences
again and again, create shared steps
Create Shared Steps
• While you’re editing a test case, select a sequence of
steps that you want to share
• Steps you selected are replaced with a link to the new
shared steps work item
TEST CASE
MANAGEMENT - DEMO
TEST RUN
• Running manual test
cases1
• Action recordings2
• Reporting bugs3
Overview
Running Manual Test Cases
• Run individual tests or entire suites
• A test result is recorded for each test run
• Create action recordings
– Used for future runs
– Action recording can be used in CodedUI tests
• Submit new bugs or update existing bugs
directly
• Attach comments, indicate pass or fail, take
screenshots
• Test case management features also available in
Web Portal
Running Manual Test Cases
(continued)
Action Recordings
• Record a manual test (or shared steps) to
allow for a later run of certain parts of
manual tests
– Example: Login, entire smoke test
• Use it to help with:
– A test that you will want to run multiple times
– Different manual tests that contain common
steps via action recordings
– Verifying a bug fix
– Automate by importing it to a Coded UI Test
Creating Action Recordings
Playback Action Recordings
Preview Steps Before Playback
Submitting Bugs
• Submit a bug from Test Runner
– Information automatically added about the test
environment, comments, screenshots, video
recording
• Submit a bug from Test Manager when you
view the manual test result
– No diagnostic data added via this route
Submitting Bugs (continued)
TEST RUN - DEMO
EXPLORATORY
TESTING
Exploratory Testing
• Test the application without a predefined test
script
• Record screenshots, comments, attach files,
video and audio narration
• Submit bugs you find while testing
– Includes rich diagnostic data collected through
testing
– Uses the recorded steps to create a manual test
case
Exploratory Testing (continued)
• Explore the application selecting a user story/requirement
– Bugs created will be automatically linked to the user
story/requirement
• Explore the application without selecting a user
story/requirement
Exploratory Testing (continued)
• Update comments, add screenshots and files
as you work, or add a bug
Exploratory Testing Sessions
EXPLORATORY TESTING
- DEMO
LAB
MANAGEMENT
Lab Environment
• A group of computers that you manage as a
single entity
• Lets you collect diagnostic data from all the
machines in the lab while you’re performing
your tests. The data, such as event actions,
are attached to the test results and to any
bug that you create
• Automate the process of building, deploying,
and running automated tests on your lab
environment
Lab Environment
Standard Lab Environment
• Both physical computers and virtual
machines can be added to a standard
environment
• On each machine:
– Configure a user account and a password that
has administrative privileges. All the machines
must have the same username and password. It
doesn’t matter whether the account is a domain
or a local account
– Make sure that file sharing is enabled
Standard Lab Environment (continued)
Standard Lab Environment (continued)
• Define the environment by adding the
computers. Enter the fully-qualified domain
name of each computer
• Set the role of each machine
Standard Lab Environment (continued)
• When the environment’s status is ready, this means that
test agents have been installed on each machine, and that
they are communicating with your team project’s test
controller. The test agents let you collect diagnostic
data from its machines while you run your test
Use Standard Lab Environment
• Mark the environment as in use to assign it to
yourself
• Connect to the environment
Use Standard Lab Environment
• Log into its machines and install the latest
build of your software
Use Standard Lab Environment
• In testing Center, plan, properties, set the test
environment to the environment you chose. This
allows you to collect event logs and other
data from the machines in the environment
Questions?
Thank you!
Raluca Suditu
raluca.suditu@gmail.com
http://ralucasuditu-softwaretesting.blogspot.ro/

More Related Content

What's hot

Test NG Framework Complete Walk Through
Test NG Framework Complete Walk ThroughTest NG Framework Complete Walk Through
Test NG Framework Complete Walk Through
Narendran Solai Sridharan
 
Selenium ppt
Selenium pptSelenium ppt
Selenium ppt
Aneesh Rangarajan
 
ISTQB Foundation - Chapter 2
ISTQB Foundation - Chapter 2ISTQB Foundation - Chapter 2
ISTQB Foundation - Chapter 2
Chandukar
 
testng
testngtestng
Unit Tests And Automated Testing
Unit Tests And Automated TestingUnit Tests And Automated Testing
Unit Tests And Automated Testing
Lee Englestone
 
TestNG - The Next Generation of Unit Testing
TestNG - The Next Generation of Unit TestingTestNG - The Next Generation of Unit Testing
TestNG - The Next Generation of Unit Testing
Bethmi Gunasekara
 
Unit tests in node.js
Unit tests in node.jsUnit tests in node.js
Unit tests in node.js
Rotem Tamir
 
Introduction to Automation Testing
Introduction to Automation TestingIntroduction to Automation Testing
Introduction to Automation Testing
Archana Krushnan
 
Unit Testing with Jest
Unit Testing with JestUnit Testing with Jest
Unit Testing with Jest
Maayan Glikser
 
Mobile application testing
Mobile application testingMobile application testing
Mobile application testing
vodQA
 
Testes Unitários
Testes UnitáriosTestes Unitários
Testes Unitários
Jadson Santos
 
Selenium Primer
Selenium PrimerSelenium Primer
Selenium Primer
gueste1e4db
 
Mobile Application Testing
Mobile Application Testing Mobile Application Testing
Mobile Application Testing
Shivaraj R
 
Test Automation Framework Design | www.idexcel.com
Test Automation Framework Design | www.idexcel.comTest Automation Framework Design | www.idexcel.com
Test Automation Framework Design | www.idexcel.com
Idexcel Technologies
 
Introduction to software testing
Introduction to software testingIntroduction to software testing
Introduction to software testing
Hadi Fadlallah
 
JMockit
JMockitJMockit
JMockit
Angad Rajput
 
Software testing and quality assurance
Software testing and quality assuranceSoftware testing and quality assurance
Software testing and quality assurance
TOPS Technologies
 
Angular Unit Testing
Angular Unit TestingAngular Unit Testing
Angular Unit Testing
Shailendra Chauhan
 
Building a Test Automation Strategy for Success
Building a Test Automation Strategy for SuccessBuilding a Test Automation Strategy for Success
Building a Test Automation Strategy for Success
Lee Barnes
 
Web Application Testing
Web Application TestingWeb Application Testing
Web Application Testing
Richa Goel
 

What's hot (20)

Test NG Framework Complete Walk Through
Test NG Framework Complete Walk ThroughTest NG Framework Complete Walk Through
Test NG Framework Complete Walk Through
 
Selenium ppt
Selenium pptSelenium ppt
Selenium ppt
 
ISTQB Foundation - Chapter 2
ISTQB Foundation - Chapter 2ISTQB Foundation - Chapter 2
ISTQB Foundation - Chapter 2
 
testng
testngtestng
testng
 
Unit Tests And Automated Testing
Unit Tests And Automated TestingUnit Tests And Automated Testing
Unit Tests And Automated Testing
 
TestNG - The Next Generation of Unit Testing
TestNG - The Next Generation of Unit TestingTestNG - The Next Generation of Unit Testing
TestNG - The Next Generation of Unit Testing
 
Unit tests in node.js
Unit tests in node.jsUnit tests in node.js
Unit tests in node.js
 
Introduction to Automation Testing
Introduction to Automation TestingIntroduction to Automation Testing
Introduction to Automation Testing
 
Unit Testing with Jest
Unit Testing with JestUnit Testing with Jest
Unit Testing with Jest
 
Mobile application testing
Mobile application testingMobile application testing
Mobile application testing
 
Testes Unitários
Testes UnitáriosTestes Unitários
Testes Unitários
 
Selenium Primer
Selenium PrimerSelenium Primer
Selenium Primer
 
Mobile Application Testing
Mobile Application Testing Mobile Application Testing
Mobile Application Testing
 
Test Automation Framework Design | www.idexcel.com
Test Automation Framework Design | www.idexcel.comTest Automation Framework Design | www.idexcel.com
Test Automation Framework Design | www.idexcel.com
 
Introduction to software testing
Introduction to software testingIntroduction to software testing
Introduction to software testing
 
JMockit
JMockitJMockit
JMockit
 
Software testing and quality assurance
Software testing and quality assuranceSoftware testing and quality assurance
Software testing and quality assurance
 
Angular Unit Testing
Angular Unit TestingAngular Unit Testing
Angular Unit Testing
 
Building a Test Automation Strategy for Success
Building a Test Automation Strategy for SuccessBuilding a Test Automation Strategy for Success
Building a Test Automation Strategy for Success
 
Web Application Testing
Web Application TestingWeb Application Testing
Web Application Testing
 

Viewers also liked

Microsoft Test Manager
Microsoft Test ManagerMicrosoft Test Manager
Microsoft Test Manager
MitchDenny
 
QA with Microsoft Test Manager and Lab Management
QA with Microsoft Test Manager and Lab ManagementQA with Microsoft Test Manager and Lab Management
QA with Microsoft Test Manager and Lab Management
Rofiqi Setiawan
 
Intro to Microsoft Test Manager
Intro to Microsoft Test ManagerIntro to Microsoft Test Manager
Intro to Microsoft Test Manager
Esteban Garcia
 
Test cases
Test casesTest cases
Test cases
Nataly Chill
 
Julho 2016 - Microsoft Test Manager
Julho 2016 - Microsoft Test ManagerJulho 2016 - Microsoft Test Manager
Julho 2016 - Microsoft Test Manager
Grupo de Testes Carioca
 
Team Foundation Server Demo
Team Foundation Server DemoTeam Foundation Server Demo
Team Foundation Server Demo
phase2int
 
DaKiRY_BAQ2016_QADay_Marta Firlej "Microsoft Test Manager tool – how can we u...
DaKiRY_BAQ2016_QADay_Marta Firlej "Microsoft Test Manager tool – how can we u...DaKiRY_BAQ2016_QADay_Marta Firlej "Microsoft Test Manager tool – how can we u...
DaKiRY_BAQ2016_QADay_Marta Firlej "Microsoft Test Manager tool – how can we u...
Dakiry
 
Introduction to Team Foundation Server (TFS) Online
Introduction to Team Foundation Server (TFS) OnlineIntroduction to Team Foundation Server (TFS) Online
Introduction to Team Foundation Server (TFS) Online
Denis Voituron
 
Dallas Technologies Sap Training
Dallas Technologies Sap TrainingDallas Technologies Sap Training
Dallas Technologies Sap Training
dallastechnologiesinbtm
 
Graphs
GraphsGraphs
Microsoft Test Manager 2010
Microsoft Test Manager 2010Microsoft Test Manager 2010
Microsoft Test Manager 2010
Oliver Centeno
 
Run Selenium Tests With Microsoft Test Manager
Run Selenium Tests With Microsoft Test ManagerRun Selenium Tests With Microsoft Test Manager
Run Selenium Tests With Microsoft Test Manager
Daniel Herken
 
Software Verification, Validation and Testing
Software Verification, Validation and TestingSoftware Verification, Validation and Testing
Software Verification, Validation and Testing
Dr Sukhpal Singh Gill
 
Test design techniques: Structured and Experienced-based techniques
Test design techniques: Structured and Experienced-based techniquesTest design techniques: Structured and Experienced-based techniques
Test design techniques: Structured and Experienced-based techniques
Khuong Nguyen
 
Data structure computer graphs
Data structure computer graphsData structure computer graphs
Data structure computer graphs
Kumar
 
Blackbox
BlackboxBlackbox
Blackbox
GuruKrishnaTeja
 
Tfs introduction
Tfs introductionTfs introduction
Tfs introduction
Kaoru NAKAMURA
 
Data Structures - Lecture 10 [Graphs]
Data Structures - Lecture 10 [Graphs]Data Structures - Lecture 10 [Graphs]
Data Structures - Lecture 10 [Graphs]
Muhammad Hammad Waseem
 
Test plan
Test planTest plan
Test plan
Sagar Shelar
 
Graph data structure
Graph data structureGraph data structure
Graph data structure
Tech_MX
 

Viewers also liked (20)

Microsoft Test Manager
Microsoft Test ManagerMicrosoft Test Manager
Microsoft Test Manager
 
QA with Microsoft Test Manager and Lab Management
QA with Microsoft Test Manager and Lab ManagementQA with Microsoft Test Manager and Lab Management
QA with Microsoft Test Manager and Lab Management
 
Intro to Microsoft Test Manager
Intro to Microsoft Test ManagerIntro to Microsoft Test Manager
Intro to Microsoft Test Manager
 
Test cases
Test casesTest cases
Test cases
 
Julho 2016 - Microsoft Test Manager
Julho 2016 - Microsoft Test ManagerJulho 2016 - Microsoft Test Manager
Julho 2016 - Microsoft Test Manager
 
Team Foundation Server Demo
Team Foundation Server DemoTeam Foundation Server Demo
Team Foundation Server Demo
 
DaKiRY_BAQ2016_QADay_Marta Firlej "Microsoft Test Manager tool – how can we u...
DaKiRY_BAQ2016_QADay_Marta Firlej "Microsoft Test Manager tool – how can we u...DaKiRY_BAQ2016_QADay_Marta Firlej "Microsoft Test Manager tool – how can we u...
DaKiRY_BAQ2016_QADay_Marta Firlej "Microsoft Test Manager tool – how can we u...
 
Introduction to Team Foundation Server (TFS) Online
Introduction to Team Foundation Server (TFS) OnlineIntroduction to Team Foundation Server (TFS) Online
Introduction to Team Foundation Server (TFS) Online
 
Dallas Technologies Sap Training
Dallas Technologies Sap TrainingDallas Technologies Sap Training
Dallas Technologies Sap Training
 
Graphs
GraphsGraphs
Graphs
 
Microsoft Test Manager 2010
Microsoft Test Manager 2010Microsoft Test Manager 2010
Microsoft Test Manager 2010
 
Run Selenium Tests With Microsoft Test Manager
Run Selenium Tests With Microsoft Test ManagerRun Selenium Tests With Microsoft Test Manager
Run Selenium Tests With Microsoft Test Manager
 
Software Verification, Validation and Testing
Software Verification, Validation and TestingSoftware Verification, Validation and Testing
Software Verification, Validation and Testing
 
Test design techniques: Structured and Experienced-based techniques
Test design techniques: Structured and Experienced-based techniquesTest design techniques: Structured and Experienced-based techniques
Test design techniques: Structured and Experienced-based techniques
 
Data structure computer graphs
Data structure computer graphsData structure computer graphs
Data structure computer graphs
 
Blackbox
BlackboxBlackbox
Blackbox
 
Tfs introduction
Tfs introductionTfs introduction
Tfs introduction
 
Data Structures - Lecture 10 [Graphs]
Data Structures - Lecture 10 [Graphs]Data Structures - Lecture 10 [Graphs]
Data Structures - Lecture 10 [Graphs]
 
Test plan
Test planTest plan
Test plan
 
Graph data structure
Graph data structureGraph data structure
Graph data structure
 

Similar to Test Case Management with MTM 2013

Automation testing
Automation testingAutomation testing
Automation testing
Vivin Chityappa
 
Testing Frameworks
Testing FrameworksTesting Frameworks
Testing Frameworks
Moataz Nabil
 
Test automation principles, terminologies and implementations
Test automation principles, terminologies and implementationsTest automation principles, terminologies and implementations
Test automation principles, terminologies and implementations
Steven Li
 
Automated testing overview
Automated testing overviewAutomated testing overview
Automated testing overview
Alex Pop
 
Software testing
Software testingSoftware testing
Software testing
Preeti Mishra
 
05 test infrastructure
05   test infrastructure05   test infrastructure
05 test infrastructure
Clemens Reijnen
 
Software automation
Software automationSoftware automation
Software automation
gokilabrindha
 
Agile Acceptance testing with Fitnesse
Agile Acceptance testing with FitnesseAgile Acceptance testing with Fitnesse
Agile Acceptance testing with Fitnesse
ClareMcLennan
 
Testing strategy for agile projects updated
Testing strategy for agile projects updatedTesting strategy for agile projects updated
Testing strategy for agile projects updated
Tharinda Liyanage
 
Visual Studio 2010 for testers
Visual Studio 2010 for testersVisual Studio 2010 for testers
Visual Studio 2010 for testers
Arpit Dubey
 
Architecting for the cloud storage build test
Architecting for the cloud storage build testArchitecting for the cloud storage build test
Architecting for the cloud storage build test
Len Bass
 
Test Automation using UiPath Test Suite - Developer Circle Part-2.pdf
Test Automation using UiPath Test Suite - Developer Circle Part-2.pdfTest Automation using UiPath Test Suite - Developer Circle Part-2.pdf
Test Automation using UiPath Test Suite - Developer Circle Part-2.pdf
Diana Gray, MBA
 
Cloud-based Test Microservices JavaOne 2014
Cloud-based Test Microservices JavaOne 2014Cloud-based Test Microservices JavaOne 2014
Cloud-based Test Microservices JavaOne 2014
Shelley Lambert
 
Test Automation
Test AutomationTest Automation
Test Automation
rockoder
 
Automated Testing Tutorial
Automated Testing TutorialAutomated Testing Tutorial
Automated Testing Tutorial
John Liebenau
 
Software testing part
Software testing partSoftware testing part
Software testing part
Preeti Mishra
 
Formulating Agile Testing Strategy
Formulating Agile Testing StrategyFormulating Agile Testing Strategy
Formulating Agile Testing Strategy
Tharinda Liyanage
 
Agile Testing Strategy
Agile Testing StrategyAgile Testing Strategy
Agile Testing Strategy
tharindakasun
 
How To Transform the Manual Testing Process to Incorporate Test Automation
How To Transform the Manual Testing Process to Incorporate Test AutomationHow To Transform the Manual Testing Process to Incorporate Test Automation
How To Transform the Manual Testing Process to Incorporate Test Automation
Ranorex
 
Cucumber jvm best practices v3
Cucumber jvm best practices v3Cucumber jvm best practices v3
Cucumber jvm best practices v3
Ahmed Misbah
 

Similar to Test Case Management with MTM 2013 (20)

Automation testing
Automation testingAutomation testing
Automation testing
 
Testing Frameworks
Testing FrameworksTesting Frameworks
Testing Frameworks
 
Test automation principles, terminologies and implementations
Test automation principles, terminologies and implementationsTest automation principles, terminologies and implementations
Test automation principles, terminologies and implementations
 
Automated testing overview
Automated testing overviewAutomated testing overview
Automated testing overview
 
Software testing
Software testingSoftware testing
Software testing
 
05 test infrastructure
05   test infrastructure05   test infrastructure
05 test infrastructure
 
Software automation
Software automationSoftware automation
Software automation
 
Agile Acceptance testing with Fitnesse
Agile Acceptance testing with FitnesseAgile Acceptance testing with Fitnesse
Agile Acceptance testing with Fitnesse
 
Testing strategy for agile projects updated
Testing strategy for agile projects updatedTesting strategy for agile projects updated
Testing strategy for agile projects updated
 
Visual Studio 2010 for testers
Visual Studio 2010 for testersVisual Studio 2010 for testers
Visual Studio 2010 for testers
 
Architecting for the cloud storage build test
Architecting for the cloud storage build testArchitecting for the cloud storage build test
Architecting for the cloud storage build test
 
Test Automation using UiPath Test Suite - Developer Circle Part-2.pdf
Test Automation using UiPath Test Suite - Developer Circle Part-2.pdfTest Automation using UiPath Test Suite - Developer Circle Part-2.pdf
Test Automation using UiPath Test Suite - Developer Circle Part-2.pdf
 
Cloud-based Test Microservices JavaOne 2014
Cloud-based Test Microservices JavaOne 2014Cloud-based Test Microservices JavaOne 2014
Cloud-based Test Microservices JavaOne 2014
 
Test Automation
Test AutomationTest Automation
Test Automation
 
Automated Testing Tutorial
Automated Testing TutorialAutomated Testing Tutorial
Automated Testing Tutorial
 
Software testing part
Software testing partSoftware testing part
Software testing part
 
Formulating Agile Testing Strategy
Formulating Agile Testing StrategyFormulating Agile Testing Strategy
Formulating Agile Testing Strategy
 
Agile Testing Strategy
Agile Testing StrategyAgile Testing Strategy
Agile Testing Strategy
 
How To Transform the Manual Testing Process to Incorporate Test Automation
How To Transform the Manual Testing Process to Incorporate Test AutomationHow To Transform the Manual Testing Process to Incorporate Test Automation
How To Transform the Manual Testing Process to Incorporate Test Automation
 
Cucumber jvm best practices v3
Cucumber jvm best practices v3Cucumber jvm best practices v3
Cucumber jvm best practices v3
 

Test Case Management with MTM 2013

  • 2. Why MTM? • Test Tool • Different test types – Manual/scripted – Exploratory – Automated (CodedUI/Unit tests) • Integration
  • 4. Resources • Visual Studio 2013 Ultimate/Premium/Test Professional • TFS • Visual Studio Online • Brian Keller http://aka.ms/almvms
  • 13. • Test plans1 • Test suites2 • Test configuration and test settings3 Overview
  • 19. Test Center • Define tests you plan to run for a specific sprint/iteration • Execute the tests from your plan • Measure progress/quality
  • 21. Test Plan Run Settings
  • 22. Create Test plan from Web
  • 23. TEST PLAN - DEMO
  • 24. TEST PLAN - SUITES
  • 25. Test Suites Overview • Test Suites • Static Test Suites • Query-based Test Suites • Requirement-based Test Suites • Copying Test Suites • Cloning Test Suites
  • 26. Test Suites • Group your test cases into a hierarchy of test suites – Root node (suite) contains all other test suites
  • 27. Test Suites • Static – Contains test cases and other test suites • Query-based – Contains test cases based on a query – Test cases that fit the query criteria are dynamically added – Cannot contain other test suites • Requirements-based – Group your test cases by requirements – Based on the work items that belong to the Requirement category (Requirement, Product Backlog Item, User Story, etc.)
  • 28. Adding Test Cases to Static Test Suites • Add existing or create new test cases for your static test suites
  • 29. Query-Based Test Suites • Query-based test suites are defined by work item queries that select test cases – Example: All test cases with priority = 1 • Any new test case with priority set to 1 will be dynamically added to the test suite
  • 30. Requirement-Based Test Suites • Add existing requirement (work item) to your test plan to create test suite • Each requirement has its own suite • Test cases added are linked to requirements • Helps to determine test coverage and completion of your requirements
  • 31. Create Test Suites from Web Interface
  • 32. Copying Test Suites and Test Plans • Copying – Copies test cases “by reference”. New suite shares same test cases – Useful for testing with different test plans but same test cases – Can be done from the GUI
  • 34. Cloning Test Suites and Test Plans • Cloning – Copies test cases “by value”. New copies of test cases are created – Useful for testing two different releases simultaneously – Command line
  • 35. Cloning Test Suites and Test Plans
  • 36. Cloning Test Suites – What Gets Cloned?
  • 39. Test Configuration and Settings Overview • Test Configurations • Creating Test Configurations • Defining Configuration Variables • Selecting Test Configurations • Test Settings • Data Adapters • How to Collect Data
  • 40. Test Configurations • Configuration variables specify setup required for testing – Examples: Operating system, browsers, software, hardware, SP, anything • Can be associated with test plans, suites and test cases
  • 41. Create Test Configurations • From Test Plan Run Settings • From Organize tab
  • 43. Selecting Test Configurations • Set default configuration(s) for your test plan – You may override at test suite and test case levels • A test case and test configuration pair is a test point • Test results are saved for each test point
  • 44. Test Settings • Test settings use diagnostic data adapters to collect data when running manual tests, automated tests, or both
  • 46. Test Reports • View test run results in real time in MTM • Use predefined test reports (Microsoft Excel, SQL Server Reporting Services) • Create your own reports (Microsoft Excel, SQL Server Reporting Services)
  • 47. Reporting on Test Progress: Test Plan
  • 48. Reporting on Test Progress • Test Case Readiness: Shows how many test cases are in Design vs. Ready
  • 49. Reporting on Test Progress (continued) • Test Plan Progress: Tracks how many tests have been run and how many are failing
  • 50. Reporting on Test Progress (continued) • Healthy version vs. unhealthy version Healthy version Unhealthy version
  • 51. Reporting on Test Progress (continued)
  • 54. • Manual Test Cases1 • Test Steps Parameters2 • Shared Steps3 Overview
  • 56. Manual Test Cases • Test cases are work items • Test results are saved on each run • Manual test cases contain test steps (test script) – May contain test steps with validation – A tester indicates pass or fail at the test step level • A test case can be assigned to a tester
  • 57. Manual Test Cases (continued) • Test cases can be added to multiple test suites in the same or different test plans • Test cases are associated with 1..n test configurations – Creating 1..n test points Team Project Test Plan Test Suite Test Case Test Suite Test Case Test Case Test Plan Test Suite Test Case Test Suite Test Case Test Case Test Case Test Suite Test case
  • 58. Create Manual Test Cases from MTM
  • 59. Create Manual Test Cases from MTM (continued) • Add test steps using Microsoft Test Manager (MTM), Microsoft Excel, or Microsoft Word (via copy and paste) • Add test steps using Microsoft Test Manager (MTM), Microsoft Excel, or Microsoft Word (via copy and paste)
  • 60. Create Manual Test Cases from Web Interface
  • 61. Create Test Cases from an Assembly of Automated Tests • Use tcm.exe • You must use a lab environment • Make sure that the test project is a part of your build definition • The test cases will have the same names as the test methods
  • 62. Assign Test Cases to Testers • Individually or in bulk • Assign at test point level
  • 64. Test Steps Parameters • Parameters allow a manual test case to run multiple times with different data – Example: @username, @password • Parameters can be added to actions or expected results
  • 65. Test Steps Parameters (continued) • Overall test results are based on all iterations passing
  • 67. Shared Steps • Used for repeated sequences of steps, such as logging in, that occur in many test cases • Avoiding having to enter these sequences again and again, create shared steps
  • 68. Create Shared Steps • While you’re editing a test case, select a sequence of steps that you want to share • Steps you selected are replaced with a link to the new shared steps work item
  • 71. • Running manual test cases1 • Action recordings2 • Reporting bugs3 Overview
  • 72. Running Manual Test Cases • Run individual tests or entire suites • A test result is recorded for each test run • Create action recordings – Used for future runs – Action recording can be used in CodedUI tests • Submit new bugs or update existing bugs directly • Attach comments, indicate pass or fail, take screenshots • Test case management features also available in Web Portal
  • 73. Running Manual Test Cases (continued)
  • 74. Action Recordings • Record a manual test (or shared steps) to allow for a later run of certain parts of manual tests – Example: Login, entire smoke test • Use it to help with: – A test that you will want to run multiple times – Different manual tests that contain common steps via action recordings – Verifying a bug fix – Automate by importing it to a Coded UI Test
  • 78. Submitting Bugs • Submit a bug from Test Runner – Information automatically added about the test environment, comments, screenshots, video recording • Submit a bug from Test Manager when you view the manual test result – No diagnostic data added via this route
  • 80. TEST RUN - DEMO
  • 82. Exploratory Testing • Test the application without a predefined test script • Record screenshots, comments, attach files, video and audio narration • Submit bugs you find while testing – Includes rich diagnostic data collected through testing – Uses the recorded steps to create a manual test case
  • 83. Exploratory Testing (continued) • Explore the application selecting a user story/requirement – Bugs created will be automatically linked to the user story/requirement • Explore the application without selecting a user story/requirement
  • 84. Exploratory Testing (continued) • Update comments, add screenshots and files as you work, or add a bug
  • 88. Lab Environment • A group of computers that you manage as a single entity • Lets you collect diagnostic data from all the machines in the lab while you’re performing your tests. The data, such as event actions, are attached to the test results and to any bug that you create • Automate the process of building, deploying, and running automated tests on your lab environment
  • 90. Standard Lab Environment • Both physical computers and virtual machines can be added to a standard environment • On each machine: – Configure a user account and a password that has administrative privileges. All the machines must have the same username and password. It doesn’t matter whether the account is a domain or a local account – Make sure that file sharing is enabled
  • 92. Standard Lab Environment (continued) • Define the environment by adding the computers. Enter the fully-qualified domain name of each computer • Set the role of each machine
  • 93. Standard Lab Environment (continued) • When the environment’s status is ready, this means that test agents have been installed on each machine, and that they are communicating with your team project’s test controller. The test agents let you collect diagnostic data from its machines while you run your test
  • 94. Use Standard Lab Environment • Mark the environment as in use to assign it to yourself • Connect to the environment
  • 95. Use Standard Lab Environment • Log into its machines and install the latest build of your software
  • 96. Use Standard Lab Environment • In testing Center, plan, properties, set the test environment to the environment you chose. This allows you to collect event logs and other data from the machines in the environment