ALM USING VISUAL STUDIO 2013
A TESTING PERSPECTIVE
MALINI VALSALA
07-AUG-2014
© Testhouse Ltd  Confidential and Proprietary
AGENDA
 About us
 ALM support in Visual Studio Suite
 Visual Studio
 Microsoft Test Manager
 Team Web Access
 Dashboards - Quality
 Q&A
© Testhouse Ltd.  Confidential and Proprietary
© Testhouse Ltd.  Confidential and Proprietary
 Headquartered in London with service centres in
UK, India and UAE, Kuwait, United States and
Africa
 Gold partnerships with Microsoft & HP
 Adoption of Testing Tools across different domains
 Sharing and adopting best practices and effective
strategies in multiple locations
ABOUT US
© Testhouse Ltd.  Confidential and Proprietary
TESTHOUSE SERVICES
People
Methods
&
Processes
Global Sourcing
• Dedicated testing experts
• Supported by a defined career path
• Aligned to a particular industry
• Actively involved in career-long training (industry-based and testing-based)
• Proven methodologies and processes – (Waterfall, Agile, Scrum etc)
• Informed by best practices and lessons learned from diverse projects
• Consistent application which ensures efficiency, consistency, and quality
• Approach that includes well-coordinated integration and hand-off points
between on and offshore testing functions
• Proven knowledge transfer and migration approaches
Technology
• Best of breed tools and assets applied consistently
• Structured approach to identifying what tools to use when
Keys to Success Components
Global provider of software Testing & QA services
ALM BENEFITS FROM VISUAL STUDIO SUITE
© Testhouse India Private Ltd.  Confidential and Proprietary
 Flexible environment
 Adapts to your team’s needs
 Removes barriers between roles
 Streamlines processes
Delivering high-quality software faster and more efficiently
 Plan
 Develop & Test
 Release
 Operate
MICROSOFT ALM SOLUTIONS
© Testhouse Ltd.  Confidential and Proprietary
ALM SOLUTIONS FOR QUALITY ENABLEMENT
© Testhouse Ltd.  Confidential and Proprietary
Work item tracking
Test lab
management
Build automation
Extensibility interfaces
SCM
Test execution
services
Deployment
automation
Reporting and BI
Lab infrastructure
Test recorders
and runners
Build engines
• Actionable
feedback
• Exploratory
testing
• Requirements
management
• Acceptance
criteria definition
• Developer testing
• Build automation
• Actionable
diagnostics
• Test planning and
management
• Test execution
• Lab management
• Production
monitoring
• Integrated incident
management
Quality metrics and
reporting
Role tailored tools
Role tailored tools
Microsoft Test Manager | Microsoft Visual Studio | Eclipse | Microsoft Feedback client | Microsoft Office | SharePoint | Browser apps |
System Center Operations Manager | SQL BI and Reporting
TOOLING
Team Foundation Server Reporting
Generalist Specialist
Manual Testing Some scripting
Creates scripts to
set up lab, create
data
Strong scripting
skills
Some
coding skills
Strong coding
Develops
automated testing
procedures
Expert
coding skills
VISUAL STUDIO – PROCESS IN PLACE
 Template support to handle diverse SDLC / STLC
processes
 Microsoft Visual Studio Scrum 2013
 MSF for Agile Software Development 2013
 MSF for CMMI Process Improvement 2013
 Version Control
 Team Foundation Version Control
 Git
 Build Control and Management
 Evaluate new builds and take them into testing
© Testhouse Ltd.  Confidential and Proprietary
TEST AUTOMATION
 Coded UI Tests
 Link Coded UI tests to manual tests
created in Test Manager
 Data driven with external file
 Define test effort
 Record manual test cases
 Automate using @parameters
Microsoft Test Manager Microsoft Visual Studio
© Testhouse Ltd.  Confidential and Proprietary
TEST AUTOMATION CODED UI TESTS
 Created in Visual Studio
 Generated from:
 Existing manual recording
 Coded UI recorder
 Locate controls to perform actions
 Add assertions
MICROSOFT TEST
MANAGER
© Testhouse Ltd.  Confidential and Proprietary
MTM OVERVIEW – TESTING CENTRE
 Testing Centre:
Create and execute test plans
Analyze test results
Enables good interactions within team
© Testhouse Ltd.  Confidential and Proprietary
MTM OVERVIEW – LAB CENTER
 Lab Centre:
Create and manage test environments
Execute tests on physical or virtual environments
© Testhouse Ltd.  Confidential and Proprietary
MICROSOFT TEST MANAGER - PLAN
Test Suites
Test Cases
Test Steps
Shared
Steps
Parameters
© Testhouse Ltd.  Confidential and Proprietary
EXAMPLE -REQUIREMENTS BASED TEST
SUITES
Automatically link Test Cases
to requirements or user
stories
• Add requirement to Test Plan
• Add Test Cases to the requirement
Can also be done manually
via Work Item link
© Testhouse Ltd.  Confidential and Proprietary
CREATE A NEW TEST CASE
© Testhouse Ltd.  Confidential and Proprietary
RUNNING A TEST CASE
© Testhouse Ltd.  Confidential and Proprietary
WHAT USUALLY HAPPENS WHEN A TESTER
FINDS A BUG?
 Submit rich bug reports from
the testing session
 Data logs to aid devs in
diagnosing issue
Graphic by Jeff Atwood (CodingHorror.com)
Works on
MY
Machine
© Testhouse Ltd.  Confidential and Proprietary
ANALYZE TEST RUNS
 Each execution of a test
produces results
 These results can be
analyzed to indicate a
‘Failure type’ and a
‘Resolution’
 Bugs can be raised during
analysis
© Testhouse Ltd.  Confidential and Proprietary
TEST PLAN - TEST RESULTS
 Displays test results for the
test plan as a whole
 How many tests failed /
passed / active
 Percentage of different
Failure types and Resolutions
of tests in the plan
 Filtered by test suite / tester
© Testhouse Ltd.  Confidential and Proprietary
EXPLORATORY TESTING
 Let an experienced tester use the application in
different user stories.
 A bug report can be created that contains all steps
in the test.
 A test case can also be generated for verification /
regression.
 A record is kept of every test session. These
contain links to added bugs, test cases etc.
TEAM WEB ACCESS &
DASHBOARD
TEAM WEB ACCESS
 Automatically installed, configured, and
updated when TFS is installed or updated
 Connect to Visual Studio Team Foundation
Server (TFS) through a web browser
 Provides much of the functionality that is
available through Team Explorer
 Tools for project management
 Team communications, track team processes,
and improve project oversight capabilities
“http:// ServerName:8080/tfs/CollectionName/ProjectName”
© Testhouse Ltd.  Confidential and Proprietary
TWA – FOR TESTING TEAMS
© Testhouse Ltd.  Confidential and Proprietary
© Testhouse Ltd.  Confidential and Proprietary
QUALITY DASHBOARD
© Testhouse Ltd.  Confidential and Proprietary
ALM INTEGRATION & TRACEABILITY
In a Nutshell:
Visual Studio ALM provides powerful, easy to use tools and reports to manage and track delivery
activity and quality throughout the whole development lifecycle.
REFERENCES
 Testing with Visual Studio Online
 Better Collaboration with Your Test Teams
Using Visual Studio 2013
 Improve your Automation Testing using VS
Coded UI
 Streamlining the SDLC using Release
Management
 Visual Studio Online for Application Insights &
Cloud Load Testing
© Testhouse Ltd.  Confidential and Proprietary
 http://th-ms.com/demo/visual-studio-online
 http://th-ms.com/demo/better-collaboration-
with-your-test-teams-using-visual-studio-
2013/
 http://th-ms.com/demo/improve-your-
automation-testing-using-vs-coded-ui/
 http://th-ms.com/demo/streamlinining-the-
sdlc-using-release-management-video/
 http://th-ms.com/demo/visual-studio-online-
for-application-insights-cloud-load-testing/
QUESTIONS?
© Testhouse Ltd.  Confidential and Proprietary
THANK YOU!!!
© Testhouse Ltd.  Confidential and Proprietary
CONTACT US:
T +91 471 270 0117
M +91 984 622 9995
MALINI.VALSALA@TESTHOUSE.NET

Microsoft ALM Support - Testing Perspective

  • 1.
    ALM USING VISUALSTUDIO 2013 A TESTING PERSPECTIVE MALINI VALSALA 07-AUG-2014 © Testhouse Ltd  Confidential and Proprietary
  • 2.
    AGENDA  About us ALM support in Visual Studio Suite  Visual Studio  Microsoft Test Manager  Team Web Access  Dashboards - Quality  Q&A © Testhouse Ltd.  Confidential and Proprietary
  • 3.
    © Testhouse Ltd. Confidential and Proprietary  Headquartered in London with service centres in UK, India and UAE, Kuwait, United States and Africa  Gold partnerships with Microsoft & HP  Adoption of Testing Tools across different domains  Sharing and adopting best practices and effective strategies in multiple locations ABOUT US
  • 4.
    © Testhouse Ltd. Confidential and Proprietary TESTHOUSE SERVICES People Methods & Processes Global Sourcing • Dedicated testing experts • Supported by a defined career path • Aligned to a particular industry • Actively involved in career-long training (industry-based and testing-based) • Proven methodologies and processes – (Waterfall, Agile, Scrum etc) • Informed by best practices and lessons learned from diverse projects • Consistent application which ensures efficiency, consistency, and quality • Approach that includes well-coordinated integration and hand-off points between on and offshore testing functions • Proven knowledge transfer and migration approaches Technology • Best of breed tools and assets applied consistently • Structured approach to identifying what tools to use when Keys to Success Components Global provider of software Testing & QA services
  • 5.
    ALM BENEFITS FROMVISUAL STUDIO SUITE © Testhouse India Private Ltd.  Confidential and Proprietary  Flexible environment  Adapts to your team’s needs  Removes barriers between roles  Streamlines processes Delivering high-quality software faster and more efficiently  Plan  Develop & Test  Release  Operate
  • 6.
    MICROSOFT ALM SOLUTIONS ©Testhouse Ltd.  Confidential and Proprietary
  • 7.
    ALM SOLUTIONS FORQUALITY ENABLEMENT © Testhouse Ltd.  Confidential and Proprietary Work item tracking Test lab management Build automation Extensibility interfaces SCM Test execution services Deployment automation Reporting and BI Lab infrastructure Test recorders and runners Build engines • Actionable feedback • Exploratory testing • Requirements management • Acceptance criteria definition • Developer testing • Build automation • Actionable diagnostics • Test planning and management • Test execution • Lab management • Production monitoring • Integrated incident management Quality metrics and reporting Role tailored tools Role tailored tools Microsoft Test Manager | Microsoft Visual Studio | Eclipse | Microsoft Feedback client | Microsoft Office | SharePoint | Browser apps | System Center Operations Manager | SQL BI and Reporting
  • 8.
    TOOLING Team Foundation ServerReporting Generalist Specialist Manual Testing Some scripting Creates scripts to set up lab, create data Strong scripting skills Some coding skills Strong coding Develops automated testing procedures Expert coding skills
  • 9.
    VISUAL STUDIO –PROCESS IN PLACE  Template support to handle diverse SDLC / STLC processes  Microsoft Visual Studio Scrum 2013  MSF for Agile Software Development 2013  MSF for CMMI Process Improvement 2013  Version Control  Team Foundation Version Control  Git  Build Control and Management  Evaluate new builds and take them into testing
  • 10.
    © Testhouse Ltd. Confidential and Proprietary TEST AUTOMATION  Coded UI Tests  Link Coded UI tests to manual tests created in Test Manager  Data driven with external file  Define test effort  Record manual test cases  Automate using @parameters Microsoft Test Manager Microsoft Visual Studio
  • 11.
    © Testhouse Ltd. Confidential and Proprietary TEST AUTOMATION CODED UI TESTS  Created in Visual Studio  Generated from:  Existing manual recording  Coded UI recorder  Locate controls to perform actions  Add assertions
  • 12.
  • 13.
    © Testhouse Ltd. Confidential and Proprietary MTM OVERVIEW – TESTING CENTRE  Testing Centre: Create and execute test plans Analyze test results Enables good interactions within team
  • 14.
    © Testhouse Ltd. Confidential and Proprietary MTM OVERVIEW – LAB CENTER  Lab Centre: Create and manage test environments Execute tests on physical or virtual environments
  • 15.
    © Testhouse Ltd. Confidential and Proprietary MICROSOFT TEST MANAGER - PLAN Test Suites Test Cases Test Steps Shared Steps Parameters
  • 16.
    © Testhouse Ltd. Confidential and Proprietary EXAMPLE -REQUIREMENTS BASED TEST SUITES Automatically link Test Cases to requirements or user stories • Add requirement to Test Plan • Add Test Cases to the requirement Can also be done manually via Work Item link
  • 17.
    © Testhouse Ltd. Confidential and Proprietary CREATE A NEW TEST CASE
  • 18.
    © Testhouse Ltd. Confidential and Proprietary RUNNING A TEST CASE
  • 19.
    © Testhouse Ltd. Confidential and Proprietary WHAT USUALLY HAPPENS WHEN A TESTER FINDS A BUG?  Submit rich bug reports from the testing session  Data logs to aid devs in diagnosing issue Graphic by Jeff Atwood (CodingHorror.com) Works on MY Machine
  • 20.
    © Testhouse Ltd. Confidential and Proprietary ANALYZE TEST RUNS  Each execution of a test produces results  These results can be analyzed to indicate a ‘Failure type’ and a ‘Resolution’  Bugs can be raised during analysis
  • 21.
    © Testhouse Ltd. Confidential and Proprietary TEST PLAN - TEST RESULTS  Displays test results for the test plan as a whole  How many tests failed / passed / active  Percentage of different Failure types and Resolutions of tests in the plan  Filtered by test suite / tester
  • 22.
    © Testhouse Ltd. Confidential and Proprietary EXPLORATORY TESTING  Let an experienced tester use the application in different user stories.  A bug report can be created that contains all steps in the test.  A test case can also be generated for verification / regression.  A record is kept of every test session. These contain links to added bugs, test cases etc.
  • 23.
    TEAM WEB ACCESS& DASHBOARD
  • 24.
    TEAM WEB ACCESS Automatically installed, configured, and updated when TFS is installed or updated  Connect to Visual Studio Team Foundation Server (TFS) through a web browser  Provides much of the functionality that is available through Team Explorer  Tools for project management  Team communications, track team processes, and improve project oversight capabilities “http:// ServerName:8080/tfs/CollectionName/ProjectName” © Testhouse Ltd.  Confidential and Proprietary
  • 25.
    TWA – FORTESTING TEAMS © Testhouse Ltd.  Confidential and Proprietary
  • 26.
    © Testhouse Ltd. Confidential and Proprietary QUALITY DASHBOARD
  • 27.
    © Testhouse Ltd. Confidential and Proprietary ALM INTEGRATION & TRACEABILITY In a Nutshell: Visual Studio ALM provides powerful, easy to use tools and reports to manage and track delivery activity and quality throughout the whole development lifecycle.
  • 28.
    REFERENCES  Testing withVisual Studio Online  Better Collaboration with Your Test Teams Using Visual Studio 2013  Improve your Automation Testing using VS Coded UI  Streamlining the SDLC using Release Management  Visual Studio Online for Application Insights & Cloud Load Testing © Testhouse Ltd.  Confidential and Proprietary  http://th-ms.com/demo/visual-studio-online  http://th-ms.com/demo/better-collaboration- with-your-test-teams-using-visual-studio- 2013/  http://th-ms.com/demo/improve-your- automation-testing-using-vs-coded-ui/  http://th-ms.com/demo/streamlinining-the- sdlc-using-release-management-video/  http://th-ms.com/demo/visual-studio-online- for-application-insights-cloud-load-testing/
  • 29.
    QUESTIONS? © Testhouse Ltd. Confidential and Proprietary
  • 30.
    THANK YOU!!! © TesthouseLtd.  Confidential and Proprietary CONTACT US: T +91 471 270 0117 M +91 984 622 9995 MALINI.VALSALA@TESTHOUSE.NET