Your SlideShare is downloading. ×
0
Technical MeetingAutomated Testing with       VS2010
Suite of Application Lifecycle Management toolshttp://msdn.microsoft.com/en-us/library/fda2bad5.aspx
application lifecycle managementhttp://www.clemensreijnen.nl/post/2008/02/18/ALM-Definitions.aspx
work together__with work packages__on alm artifacts
Testing LifecycleSee also on www.tmap.net:- The Test Lifecycle Model- The 4 essentials
http://msdn.microsoft.com/en-us/library/bb385832.aspx
Microsoft Test Manager 2010
Test Case ManagementSee also on www.tmap.net: Control Phase
Test Plans    Test Suites    Test ConfigurationsOrganize the testing effort in a Test Execution PlanCreate dynamic test su...
Test (Execution) Plans
Test (Execution) Plans
Test Plan OrganizationNaming of test plans for agile environments:Iteration number and name and one extra test plan for en...
Test Configurations
Test Configurations
Test Suites
Test Suites OrganizationNaming of test suites for agile environments:Suite per user story (requirement based) and one addi...
Proposed organization
TCM.exe
TCM plan /list
TCM suites /lists planid:16
Share MTM Artifactsmtm://clemenes-pc:8080/tfs/defaultcollection/p:MSF/Testing/testplan/connect?id=19
mtm://<server name>:<port>/<tfs vdir>/<Collection name>/p:<project name>/<center group>/<group specific>               Ope...
Test Case SpecificationSee also on www.tmap.net: Specification Phase
Test Case    Shared Steps    Test Data IterationsLink test cases and requirements to provide requirement traceabilityData ...
Test Case
Test step types
Test steps   Make them descriptive   Not every step is a validation step   Use the step attachment
Test steps copy-past
Test Data IterationsData drive test cases with different parameters
Test Data Iterations
Test data copy-past
Shared StepsRefactor common shared steps in test casesReduce test maintenance by sharing test steps across test cases
Shared Steps     Shared Step candidates?• REUSE – Many steps, reused for many test cases . Benefit: time, retyping, boring...
Test ExecutionTest RunnerA test that you will want to run multiple times.Different manual tests that contain common steps....
Test Case ExecutionSee also on www.tmap.net: Execution Phase
Test Case Execution
Action recording
TCM run/create
From TCMrun /export id:239 /resultsfile:”c:runresult”
Share with mtm:// mtm://clemens-pc:8080/tfs/defaultcollection/p:MSF/Testing/testrun/open?id=292
Controlling the testing effortBUG’s
File a BUG
Diagnostic Data AdaptersFile a BugFile an Exploratory BugVerify a Bug
Diagnostic Data Adapters
File a BugSubmit a Bug using Test Runner
Ways to file a Bug   Submit a Bug from the Test Runner   Submit a Bug from the Verify Bugs View   Submit a Bug from Test R...
Verify a BugVerify a Bug Fix Using Microsoft Test Manager
The Bug FlowLink build 2 testplan.                T   Execute   File Bug    Verify fix   Close orConfigure Data       E   ...
Test Impact
Test ImpactAssign build 2test plan.           T   Execute            Assign        Evaluated and reset                    ...
Create test from Bug
File an Exploratory BugSubmit an Exploratory Bug using Test Runner
PRO:                                                 -   Reuse scenario knowledge business user                           ...
RECAPTest Activities Planning…
Test Case Management                     RECAP
RECAPTest Case Specification
RECAPTest Case Execution
Test Case Management                     RECAP
Intellitrace
F5
1Open the employee applicationSet the intellitrace optionsSet a breakpoint at …
2When on the breakpoint, save the trace file on your desktop
3Close Visual Studio and double click the intellitrace file
4In the intellitrace summary, open the main threat …
5   … and search for    The values that where entered    during the previous run.
6And now from Microsoft Test Manager
6Set the diagnostic adapter
7Configure the build… it needs a drop location for the symbols (pdb files)
8Run the test case and see it crash… file a bug.
9See the itrace file in the bug report...
10Close MTM, open VS (with or without the employee application).Got to the bug and click the itrace file…See the exception...
11Go back in time
11Go back in time … and find the entered values
Regression Test CandidatesSee also on www.tmap.net: Completion Phase
Test Automationmet Visual Studio 2010                          Test automation       Where? When? How? Who? Why? What?
Where? When? How? Who? Why? What?
Where?   When? How? Who? Why? What?
Where? When? How? Who? Why? What?
VS2010 Test ToolsUI Test Automation Capabilities                        Fast Forward                             CodedUI  ...
Test Automation Investment Levels 0   No investment in any kind of automation. Just click and test. 1   Clean up of the Ac...
1   Clean up of the Action
2   Basic CodedUI             VS2010 ALM MTLM usages patterns for             Windows Azure hosted application            ...
3   Advanced CodedUI
Fast Forward
Cleaning the action recordingWhen: executing the same test case onmultiple environments or when using test dataiteration o...
CodedUI
CodedUIfrom existing action recording from Manual Tester
CodedUIfrom existing action recording from Manual Tester
CodedUIfrom existing action recording from Manual Tester                                                    2             ...
CodedUICreate a new action recording by Developer
UIMap
UIMap
Data-DrivenCoded UI Test
Test InfrastructureWhere and how to run the automated test?
Test EnvironmentsSee also on www.TMap.net:- Checklist "Intake Test Environment“- Checklist "Test Environment“- Infrastruct...
Test labVisual Studio 2010 Lab Management
Where and how to run the automated test?physical test environmentsvirtualized test environments
physical test                 virtualized testenvironments                  environments  MTLM Client                   MT...
Build            application                                        physical test environments                            ...
Lab for PhysicalEnvironments, thedifferent flavors…Visual Studio   Team                Foundation                ServerTes...
Configurations for automated test execution:                                  AFlavor A: Execution from VS2010… Real devel...
Configurations for automated test execution:                                                             BFlavor B: Execut...
Configurations for automated test execution:                                                                     CFlavor C...
Configurations for automated test execution:                                               DFlavor D: Execution from Micro...
Configurations for automated test execution:                                                               EFlavor E: Exec...
Test Controller
Test Agent
New physical environment
Execute CodedUIDuring the build with Visual Studio 2010
Configurations for automated test execution:                                                                     CFlavor C...
1Configure Test Controller.
2Add new Test Settings fileSet remote execution andtest controller.
3Create a new build definitionSet the Automated Test Properties
4Queue a new BuildWatch the Test Agent andTest Environment
Execute CodedUIWithin a test case as an associated automation manualy
Configurations for automated test execution:                                               DFlavor D: Execution from Micro...
1Configure Test Controller.
2Associate the CodedUIwith a Test Case.
2Create Test Environment
3Set test Settings
4Associate the CodedUIwith a Test Case.
5Run Automated Tests from Test Manager
Execute CodedUIWithin a test case as an associated automation from the build
Configurations for automated test execution:                                                               EFlavor E: Exec...
Execute automated test cases ondifferent environments
0Same steps as previous.
1Configure additional environments in Test Plan properties.                              Win 7 IE9 configuration          ...
1Get Test Plan IDGet Test SuiteGet Test Configurations  with TCM.exe
2Create command line for Test Run for the different Test Configurations    "run /create /title:""Run on Host for specific ...
3Add build commands
6Queue a new BuildWatch the Test Agent andTest Environment
Build            application                           ProvisionRun tests                          ‘clean’ env            ...
VS2010 Lab Management• Reproduce the exact conditions of a bug or other development  issue.• Build, deploy, and test appli...
MTLM ClientTFS 2010                 System Center Virtual Machine                         Manager (SCVMM)                 ...
VMLab Agent
TFS 2010
staat voor resultaat
Technical meeting automated testing with vs2010
Technical meeting automated testing with vs2010
Technical meeting automated testing with vs2010
Technical meeting automated testing with vs2010
Technical meeting automated testing with vs2010
Technical meeting automated testing with vs2010
Technical meeting automated testing with vs2010
Technical meeting automated testing with vs2010
Technical meeting automated testing with vs2010
Technical meeting automated testing with vs2010
Technical meeting automated testing with vs2010
Technical meeting automated testing with vs2010
Technical meeting automated testing with vs2010
Technical meeting automated testing with vs2010
Technical meeting automated testing with vs2010
Upcoming SlideShare
Loading in...5
×

Technical meeting automated testing with vs2010

8,295

Published on

automated testing with vs2010 ... test case specification, execution, automation and test infrastructure with VS2010 CodedUI and Lab management

Published in: Technology, Business
3 Comments
3 Likes
Statistics
Notes
No Downloads
Views
Total Views
8,295
On Slideshare
0
From Embeds
0
Number of Embeds
4
Actions
Shares
0
Downloads
180
Comments
3
Likes
3
Embeds 0
No embeds

No notes for slide

Transcript of "Technical meeting automated testing with vs2010"

  1. 1. Technical MeetingAutomated Testing with VS2010
  2. 2. Suite of Application Lifecycle Management toolshttp://msdn.microsoft.com/en-us/library/fda2bad5.aspx
  3. 3. application lifecycle managementhttp://www.clemensreijnen.nl/post/2008/02/18/ALM-Definitions.aspx
  4. 4. work together__with work packages__on alm artifacts
  5. 5. Testing LifecycleSee also on www.tmap.net:- The Test Lifecycle Model- The 4 essentials
  6. 6. http://msdn.microsoft.com/en-us/library/bb385832.aspx
  7. 7. Microsoft Test Manager 2010
  8. 8. Test Case ManagementSee also on www.tmap.net: Control Phase
  9. 9. Test Plans Test Suites Test ConfigurationsOrganize the testing effort in a Test Execution PlanCreate dynamic test suites for changing selection criteriaDefine various test configurations and share automation across those
  10. 10. Test (Execution) Plans
  11. 11. Test (Execution) Plans
  12. 12. Test Plan OrganizationNaming of test plans for agile environments:Iteration number and name and one extra test plan for endto end tests.
  13. 13. Test Configurations
  14. 14. Test Configurations
  15. 15. Test Suites
  16. 16. Test Suites OrganizationNaming of test suites for agile environments:Suite per user story (requirement based) and one additionaltest suite for regression tests.(query based?)(test cases are copied to the regression test suite)
  17. 17. Proposed organization
  18. 18. TCM.exe
  19. 19. TCM plan /list
  20. 20. TCM suites /lists planid:16
  21. 21. Share MTM Artifactsmtm://clemenes-pc:8080/tfs/defaultcollection/p:MSF/Testing/testplan/connect?id=19
  22. 22. mtm://<server name>:<port>/<tfs vdir>/<Collection name>/p:<project name>/<center group>/<group specific> Open Test results Open Test Cases (or any work item) Open Test Runs Open Test Plans Connect to test plans mtm://server:8080/tfs/ProjectCollection/p:Project/testing/testcase/open?id=67http://blogs.msdn.com/b/vstsqualitytools/archive/2010/02/09/sharing-content-in-microsoft-test-manager.aspx
  23. 23. Test Case SpecificationSee also on www.tmap.net: Specification Phase
  24. 24. Test Case Shared Steps Test Data IterationsLink test cases and requirements to provide requirement traceabilityData drive test cases with different parametersRefactor common shared steps in test cases
  25. 25. Test Case
  26. 26. Test step types
  27. 27. Test steps Make them descriptive Not every step is a validation step Use the step attachment
  28. 28. Test steps copy-past
  29. 29. Test Data IterationsData drive test cases with different parameters
  30. 30. Test Data Iterations
  31. 31. Test data copy-past
  32. 32. Shared StepsRefactor common shared steps in test casesReduce test maintenance by sharing test steps across test cases
  33. 33. Shared Steps Shared Step candidates?• REUSE – Many steps, reused for many test cases . Benefit: time, retyping, boring work.• EXPECTED CHANGES – for example environment variables change [URL]. Benefit: Time, test cases which need this step are updated automatically, also action recording.• PRE- CONDITIONS – bring the system under test to a certain state and execute the different verifications. Benefit: beside time, you are certain the application under test is in the same state for every test case• BACK TO INITIAL STATE - after test execution bring the environment back to the initial state for new test cases. Benefit: beside time, you are certain the application under test is always in a clean state for new test cases.
  34. 34. Test ExecutionTest RunnerA test that you will want to run multiple times.Different manual tests that contain common steps.Verifying a bug is fixed by using a manual test.
  35. 35. Test Case ExecutionSee also on www.tmap.net: Execution Phase
  36. 36. Test Case Execution
  37. 37. Action recording
  38. 38. TCM run/create
  39. 39. From TCMrun /export id:239 /resultsfile:”c:runresult”
  40. 40. Share with mtm:// mtm://clemens-pc:8080/tfs/defaultcollection/p:MSF/Testing/testrun/open?id=292
  41. 41. Controlling the testing effortBUG’s
  42. 42. File a BUG
  43. 43. Diagnostic Data AdaptersFile a BugFile an Exploratory BugVerify a Bug
  44. 44. Diagnostic Data Adapters
  45. 45. File a BugSubmit a Bug using Test Runner
  46. 46. Ways to file a Bug Submit a Bug from the Test Runner Submit a Bug from the Verify Bugs View Submit a Bug from Test Results for a Test
  47. 47. Verify a BugVerify a Bug Fix Using Microsoft Test Manager
  48. 48. The Bug FlowLink build 2 testplan. T Execute File Bug Verify fix Close orConfigure Data E Manual by using reopencollectors. S Tests playback Bug T Build definition is the intergrationSetup build anddeploy D Resolve Checkin E Bug Build V Deploy
  49. 49. Test Impact
  50. 50. Test ImpactAssign build 2test plan. T Execute Assign Evaluated and reset Execute ExecuteConfigure Data E ‘passed’ ‘NEW’ build tests impacted by ‘passed’ ‘passed’collectors. S Tests 2 Test Plan code churn Tests Tests T Build definition is the intergrationSetup build anddeploy D Make Checkin E code Build V changes Deploy
  51. 51. Create test from Bug
  52. 52. File an Exploratory BugSubmit an Exploratory Bug using Test Runner
  53. 53. PRO: - Reuse scenario knowledge business user - No typing detailed test steps - Easy to parameterize1 Record scenario by business user with - Writing standards for test steps MTM on application under test. Action - MTM capabilities in step 3. (bug, codedUI, recommended test etc …) recording is captured. Most benefit during step 2 (test case writing), benefit in step 1: run once in common situation. Benefit in step 3: common MTM benefits (record playback, fast forward, parameters etc) and benefit of well written steps.2 Create test steps (with parameters) in MTM by using the action recording. CON: - Manual actions and tests. - Test steps text are technical names - Action recording (step 1) must be clean. - Unknown what is validated, during step 2, need additional knowledge. - The business user must think of the important scenarios3 Save test case and execute it by a tester The action recording during step 1 can have on application under test, by using MTM. unnecessary steps, these can be removed during the execution (1) or during the specification (2).
  54. 54. RECAPTest Activities Planning…
  55. 55. Test Case Management RECAP
  56. 56. RECAPTest Case Specification
  57. 57. RECAPTest Case Execution
  58. 58. Test Case Management RECAP
  59. 59. Intellitrace
  60. 60. F5
  61. 61. 1Open the employee applicationSet the intellitrace optionsSet a breakpoint at …
  62. 62. 2When on the breakpoint, save the trace file on your desktop
  63. 63. 3Close Visual Studio and double click the intellitrace file
  64. 64. 4In the intellitrace summary, open the main threat …
  65. 65. 5 … and search for The values that where entered during the previous run.
  66. 66. 6And now from Microsoft Test Manager
  67. 67. 6Set the diagnostic adapter
  68. 68. 7Configure the build… it needs a drop location for the symbols (pdb files)
  69. 69. 8Run the test case and see it crash… file a bug.
  70. 70. 9See the itrace file in the bug report...
  71. 71. 10Close MTM, open VS (with or without the employee application).Got to the bug and click the itrace file…See the exception andstart debugging…
  72. 72. 11Go back in time
  73. 73. 11Go back in time … and find the entered values
  74. 74. Regression Test CandidatesSee also on www.tmap.net: Completion Phase
  75. 75. Test Automationmet Visual Studio 2010 Test automation Where? When? How? Who? Why? What?
  76. 76. Where? When? How? Who? Why? What?
  77. 77. Where? When? How? Who? Why? What?
  78. 78. Where? When? How? Who? Why? What?
  79. 79. VS2010 Test ToolsUI Test Automation Capabilities Fast Forward CodedUI Test Infrastructure
  80. 80. Test Automation Investment Levels 0 No investment in any kind of automation. Just click and test. 1 Clean up of the Action log maybe re-execute, for more smooth Fast Forward. 2 Basic CodedUI. Only use the default generation, add your own assertion. 3 Advanced CodedUI. Customize the CodedUI and UIMap for optimization.
  81. 81. 1 Clean up of the Action
  82. 82. 2 Basic CodedUI VS2010 ALM MTLM usages patterns for Windows Azure hosted application development
  83. 83. 3 Advanced CodedUI
  84. 84. Fast Forward
  85. 85. Cleaning the action recordingWhen: executing the same test case onmultiple environments or when using test dataiteration or … and don’t forget the sharedsteps
  86. 86. CodedUI
  87. 87. CodedUIfrom existing action recording from Manual Tester
  88. 88. CodedUIfrom existing action recording from Manual Tester
  89. 89. CodedUIfrom existing action recording from Manual Tester 2 1 4 3
  90. 90. CodedUICreate a new action recording by Developer
  91. 91. UIMap
  92. 92. UIMap
  93. 93. Data-DrivenCoded UI Test
  94. 94. Test InfrastructureWhere and how to run the automated test?
  95. 95. Test EnvironmentsSee also on www.TMap.net:- Checklist "Intake Test Environment“- Checklist "Test Environment“- Infrastructure Phase
  96. 96. Test labVisual Studio 2010 Lab Management
  97. 97. Where and how to run the automated test?physical test environmentsvirtualized test environments
  98. 98. physical test virtualized testenvironments environments MTLM Client MTLM Client Physical Test Client TFS 2010 System Center Virtual TFS 2010 Machine Manager (SCVMM) Hyper-V Library Physical Host Shares Test Client VM VM share share
  99. 99. Build application physical test environments versus virtualized test environments ProvisionRun tests ‘clean’ env Deploy application
  100. 100. Lab for PhysicalEnvironments, thedifferent flavors…Visual Studio Team Foundation ServerTest Manager Build Server Test Agent Test Agent Test Agent
  101. 101. Configurations for automated test execution: AFlavor A: Execution from VS2010… Real developer test / test automation dry run (Triggered by: right mouse click – run tests, in test project) http://msdn.microsoft.com/en-us/library/dd286580.aspx No additional configuration needed* * Data Diagnostic Settings in the Local.Testsettings file are configurable. Pro: Con: Easy setup No collection of test results in TFS Debug-able test automation Run on developer environment
  102. 102. Configurations for automated test execution: BFlavor B: Execution during build with Build controller… not recommended, strange to run UI tests on build Part of Build Verification Tests (triggered by: build) Set the Build Service to run in interactive mode http://blogs.msdn.com/b/mathew_aniyan/archive/2009/05/26/coded-ui-test-in-a-team-build.aspx Configure the build to run the tests http://msdn.microsoft.com/en-us/library/ms182465.aspx#CreateBuildType * Data Diagnostic Settings in the *.Testsettings file are configurable. Pro: Con: Easy setup No collection of test results in TFS Test results in build result Build Controller needs to run in interactive mode Tests are executed on build environment Run on build environment
  103. 103. Configurations for automated test execution: CFlavor C: Execution during build with Test controller… B Preferred configuration above flavor Part of Build Verification Tests on multiple test agents (triggered by: build) Configure Test Controller (don’t register it with a project collection ) http://msdn.microsoft.com/en-us/library/dd648127.aspx#TestControllers Configure Test Agents on clients (interactive mode) http://msdn.microsoft.com/en-us/library/dd648127.aspx#TestAgents Configure *.Testsettings file in solution to use Test Controller and Test Agents Configure the build to run the tests (see B) Pro: Con: Test run on test environments No collection of test results in TFS Tests run on multiple environments Harder to configure Test Results in Build result Need for specific test client environments Test Settings from VS
  104. 104. Configurations for automated test execution: DFlavor D: Execution from Microsoft Test Manager…than BVT Other type of test Part of Regression Tests (triggered by: MTM user, right mouse click on test case, run) Configure Test Controller (register it with a project collection ) Configure Test Agents on clients (interactive mode, can be the same as MTM) Configure Lab Center in MTM to use test controller and create test ‘agent’ environment. http://msdn.microsoft.com/en-us/library/ee390842.aspx http://msdn.microsoft.com/en-us/library/dd293551.aspx Associate CodedUI test with WI Test Case from VS. http://www.richard-banks.org/2010/11/how-to-use-codedui-tests-watin-and-mtm.html Pro: Con: Test run on test environments Manually triggered by Tester Tests run on multiple environments Hard to configure Test Result in MTM and TFS Need for specific test client (same as MTM?) Test Settings from MTM
  105. 105. Configurations for automated test execution: EFlavor E: Execution from MTM duringPreferred configuration above flavor C Build… Part of BVT Flavor D and E can be configured together (triggered by: Build) Configure Test Controller (register it with a project collection ) Configure Test Agents on clients (interactive mode, can be the same as MTM) Configure Lab Center in MTM to use test controller and create test ‘agent’ environment. Associate CodedUI test with WI Test Case from VS. Create Build task to run TCM or MSTEST task for Test Plan http://blogs.microsoft.co.il/blogs/shair/archive/2010/10/30/how-to-run-coded-ui-tests-from-command-line.aspx Pro: Con: Test run on test environments Hard to configure Tests run on multiple environments Need for specific test client (same as MTM?) Test Result in MTM and TFS Triggered by build
  106. 106. Test Controller
  107. 107. Test Agent
  108. 108. New physical environment
  109. 109. Execute CodedUIDuring the build with Visual Studio 2010
  110. 110. Configurations for automated test execution: CFlavor C: Execution during build with Test controller… B Preferred configuration above flavor Part of Build Verification Tests on multiple test agents (triggered by: build) Configure Test Controller (don’t register it with a project collection ) http://msdn.microsoft.com/en-us/library/dd648127.aspx#TestControllers Configure Test Agents on clients (interactive mode) http://msdn.microsoft.com/en-us/library/dd648127.aspx#TestAgents Configure *.Testsettings file in solution to use Test Controller and Test Agents Configure the build to run the tests (see B) Pro: Con: Test run on test environments No collection of test results in TFS Tests run on multiple environments Harder to configure Test Results in Build result Need for specific test client environments Test Settings from VS
  111. 111. 1Configure Test Controller.
  112. 112. 2Add new Test Settings fileSet remote execution andtest controller.
  113. 113. 3Create a new build definitionSet the Automated Test Properties
  114. 114. 4Queue a new BuildWatch the Test Agent andTest Environment
  115. 115. Execute CodedUIWithin a test case as an associated automation manualy
  116. 116. Configurations for automated test execution: DFlavor D: Execution from Microsoft Test Manager…than BVT Other type of test Part of Regression Tests (triggered by: MTM user, right mouse click on test case, run) Configure Test Controller (register it with a project collection ) Configure Test Agents on clients (interactive mode, can be the same as MTM) Configure Lab Center in MTM to use test controller and create test ‘agent’ environment. http://msdn.microsoft.com/en-us/library/ee390842.aspx http://msdn.microsoft.com/en-us/library/dd293551.aspx Associate CodedUI test with WI Test Case from VS. http://www.richard-banks.org/2010/11/how-to-use-codedui-tests-watin-and-mtm.html Pro: Con: Test run on test environments Manually triggered by Tester Tests run on multiple environments Hard to configure Test Result in MTM and TFS Need for specific test client (same as MTM?) Test Settings from MTM
  117. 117. 1Configure Test Controller.
  118. 118. 2Associate the CodedUIwith a Test Case.
  119. 119. 2Create Test Environment
  120. 120. 3Set test Settings
  121. 121. 4Associate the CodedUIwith a Test Case.
  122. 122. 5Run Automated Tests from Test Manager
  123. 123. Execute CodedUIWithin a test case as an associated automation from the build
  124. 124. Configurations for automated test execution: EFlavor E: Execution from MTM duringPreferred configuration above flavor C Build… Part of BVT Flavor D and E can be configured together (triggered by: Build) Configure Test Controller (register it with a project collection ) Configure Test Agents on clients (interactive mode, can be the same as MTM) Configure Lab Center in MTM to use test controller and create test ‘agent’ environment. Associate CodedUI test with WI Test Case from VS. Create Build task to run MTC or MSTEST task for Test Plan http://blogs.microsoft.co.il/blogs/shair/archive/2010/10/30/how-to-run-coded-ui-tests-from-command-line.aspx Pro: Con: Test run on test environments Hard to configure Tests run on multiple environments Need for specific test client (same as MTM?) Test Result in MTM and TFS Triggered by build Test Settings from MTM
  125. 125. Execute automated test cases ondifferent environments
  126. 126. 0Same steps as previous.
  127. 127. 1Configure additional environments in Test Plan properties. Win 7 IE9 configuration Win 7 IE8 configuration TC MTLM Client Win 7 IE8 configuration Physical Test Client TFS 2010 Win 7 IE9 configuration Physical Test Client
  128. 128. 1Get Test Plan IDGet Test SuiteGet Test Configurations with TCM.exe
  129. 129. 2Create command line for Test Run for the different Test Configurations "run /create /title:""Run on Host for specific Test Point"" /planid:16 /querytext:""SELECT * FROM TestPoint WHERE ConfigurationId=13"" /settingsname:""Automated Test on Windows 7 Environment IE9"" /testenvironment:""Win 7 IE9"" /collection:http://clemenes- pc:8080/tfs/defaultcollection /teamproject:EmployeeApplication" "run /create /title:""Run on test env for specific Test Point"" /planid:16 /querytext:""SELECT * FROM TestPoint WHERE ConfigurationId=12"" /settingsname:""Automated Test on Windows 7 Environment IE8"" /testenvironment:""Win 7 IE8"" /collection:http://clemenes- pc:8080/tfs/defaultcollection /teamproject:EmployeeApplication"
  130. 130. 3Add build commands
  131. 131. 6Queue a new BuildWatch the Test Agent andTest Environment
  132. 132. Build application ProvisionRun tests ‘clean’ env Deploy application
  133. 133. VS2010 Lab Management• Reproduce the exact conditions of a bug or other development issue.• Build, deploy, and test applications automatically in a clean environment.• Reduce the time required to create and configure machines for testing an application.• Run multiple copies of a test or development at the same time.• Enable members of a team to create and manage virtual environments without requiring system administrator privileges.
  134. 134. MTLM ClientTFS 2010 System Center Virtual Machine Manager (SCVMM) Hyper-V Library Host Shares VM share VM share
  135. 135. VMLab Agent
  136. 136. TFS 2010
  137. 137. staat voor resultaat
  1. A particular slide catching your eye?

    Clipping is a handy way to collect important slides you want to go back to later.

×