Augmenting Coded UI

757 views

Published on

Published in: Automotive, Technology, Business
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
757
On SlideShare
0
From Embeds
0
Number of Embeds
3
Actions
Shares
0
Downloads
34
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide
  • Hello. I would like to welcome to this webinar onHow to augment your coded UI environment with Test Automation, to greatly improve the quality of your application software.My name is
  • ABT separates the Test Cases from the Application under test, through an Easy-to-define Interface
  • ABT separates the Test Cases from the Application under test, through an Easy-to-define Interface
  • ABT separates the Test Cases from the Application under test, through an Easy-to-define Interface
  • ABT separates the Test Cases from the Application under test, through an Easy-to-define Interface
  • Software testing with Visual Studio 2012 is focused on testing all aspects of your application.Test planning and management, manual testing and exploratory testing are handled from Microsoft Test Manager.Automated testing, unit testing, performance and load testing, and code analysis are handled from the Visual Studio IDE.All aspects of the testing lifecycle are monitored and managed with Team Foundation Server, enabling up to date reporting across the entire project.Extensibility points enable 3rd party solutions, customizable build engines and complex lab environments.This module focuses on Build Automation practices to validate quality at a continuous cadence when developing software as a team.
  • UI Automation test creation is handled from the Visual Studio IDE. There are three methods for creating these tests: manual creation via code, keyword based scripts (using the preferred partner solution LogiGear), recording your actions as you interact with the UI, or importing an existing manual test case that has an action recording. Once the test has been created in the IDE, it can be ran from the IDE itself directly, from Test Manager, or automated as part of an automated build or deploy scenario. Automated UI tests can be associated with test cases in TFS for maximum visibility. Just like all other types of testing in Visual Studio, automated UI tests are backed by Team Foundation Server, enabling up to the minute detailed reporting. Depending on the method of execution, bugs can be created (directly in the case of MTM execution, or part of a failed build in the case of complete automation).
  • Talk Track:<see slide>
  • Talk Track:As coded UI tests are code, you can attach them to your continuous integration build verification tests, or other automated builds to ensure that defects in your application’s UI are discovered as soon as possible.
  • Talk Track:Teams often worry that reducing their deployment cycle time will reduce overall quality.  It’s a real risk, but it can be avoided if you modernize your quality management system as well. With MTM and the Visual Studio 2012 ALM solution, your quality management integrates seamlessly into your modern development platform, ensuring that velocity and quality will go hand in hand.
  • Augmenting Coded UI

    1. 1. © 2013 LogiGear Corporation. All rights reserved.Augmenting Coded UIwith Action-BasedTest AutomationMicrosoft | LogiGear
    2. 2. © 2013 LogiGear Corporation. All rights reserved.10xSpeed Maintainability Reusability Scalability
    3. 3. © 2013 LogiGear Corporation. All rights reserved.- Quickly and easily create a large number of testsSpeed10x
    4. 4. © 2013 LogiGear Corporation. All rights reserved.- Quickly and easily create a large number of tests- Maintain tests when the application or GUI changesSpeed10xMaintainability
    5. 5. © 2013 LogiGear Corporation. All rights reserved.- Quickly and easily create a large number of tests- Maintain tests when the application or GUI changes- Focus on reusable test design and flow, not test programmingSpeed10xMaintainability Reusability
    6. 6. © 2013 LogiGear Corporation. All rights reserved.- Quickly and easily create a large number of tests- Maintain tests when the application or GUI changes- Focus on reusable test design and flow, not test programming- Execute data-driven testing for coverage and scalabilitySpeed10xMaintainability Reusability Scalability
    7. 7. © 2013 LogiGear Corporation. All rights reserved.- Quickly and easily create a large number of tests- Maintain tests when the application or GUI changes- Focus on reusable test design and flow, not test programming- Execute data-driven testing for coverage and scalability- Enable test understanding and team collaborationSpeed10xMaintainability Reusability Scalability
    8. 8. © 2013 LogiGear Corporation. All rights reserved.Keyword-drivenmethodologyModulartest designSolutionarchitecture andfunctionalityAutomation EngineActionLibraryInterfaceTest ModuleTest ModuleTest ModuleTest Development Plan
    9. 9. © 2013 LogiGear Corporation. All rights reserved.def action_NewProduct. . . .def action_AddQuantity. . . .def action_CheckQuantity. . . .Keywords and Actions© 2013 LogiGear Corporation. All rights reserved.
    10. 10. © 2013 LogiGear Corporation. All rights reserved.ClickSelectClickClickCheckout.Order EntryLow-level actions …… combined to makehigher-level actions… combined tomake higher-level actions© 2013 LogiGear Corporation. All rights reserved.Action-Based TestingMethodologyKeyword-driven
    11. 11. © 2013 LogiGear Corporation. All rights reserved.OKSUBMITEvery instance of the changedaction is automatically updatedAction-Based TestingMethodologyReusability© 2013 LogiGear Corporation. All rights reserved.
    12. 12. © 2013 LogiGear Corporation. All rights reserved.© 2013 LogiGear Corporation. All rights reserved.CHECKPAYMENTCLOSEAPPRENTCARAction LibraryCustom ActionsSTARTAPPTEST MODULE Car Rentaluser keyTEST CASE TC 01 Rent Carsfirst name last name carlast name amountFINAL Exit Appwindowstart app samrent car Sam Doe Ford Escapecheck payment Doe 89.95close app reservationPROCESSORDERCONFIGACCNTADDINSCHANGEORDERLISTCARSPRINTRECEIPTEasy-to-use test creation for readable, understandable test flowsCLOSEAPPSTARTAPPCHECKPAYMENTRENTCAR
    13. 13. © 2013 LogiGear Corporation. All rights reserved.… results in only a small increase in additional actions2000tests200actions20 functionsA large increase in test cases …4000tests250actions22 functions
    14. 14. © 2013 LogiGear Corporation. All rights reserved.Cash FlowOptimizationReconcileStatementsManagementImageVerificationAuthorizationAuthenticationAccess MgmntRisk/FraudMitigationCrimeDetectionTransactionMonitoringData CommReal-timeProcessingTest Development PlanBusiness ObjectiveBusiness ObjectiveBusiness ObjectiveManagementCrimeDetectionReal-timeProcessing
    15. 15. © 2013 LogiGear Corporation. All rights reserved.Keyword-drivenmethodologyModulartest designSolutionarchitecture andfunctionalityAutomation EngineActionLibraryInterfaceTest ModuleTest ModuleTest ModuleTest Development Plan
    16. 16. © 2013 LogiGear Corporation. All rights reserved.© 2013 LogiGear Corporation. All rights reserved.Objective-driven process at the Business-object levelTest Development Plan• Top-down Test Development Plan
    17. 17. © 2013 LogiGear Corporation. All rights reserved.© 2013 LogiGear Corporation. All rights reserved.ObjectiveTest ModuleObjectiveTest ModuleObjectiveTest ModuleTest Modules, not Test Cases, are the main testing componentTest Development Plan• Top-down Test Development Plan• Business-level Test Module objectives
    18. 18. © 2013 LogiGear Corporation. All rights reserved.© 2013 LogiGear Corporation. All rights reserved.Test ModuleTest ModuleTest ModuleTESTCASEThe best method to scale automation to 100’s or 1000’s of test casesTest Development Plan• Top-down Test Development Plan• Business-level Test Module objectives• Objective-driven Test Cases withsimilar “scope”TESTCASETESTCASE
    19. 19. © 2013 LogiGear Corporation. All rights reserved.© 2013 LogiGear Corporation. All rights reserved.Test ModuleTCTest Development Plan• Top-down Test Development Plan• Business-level Test Module objectives• Objective-driven Test Cases withsimilar “scope”• Action Library and Interfaces drivetest case operationTest ModuleTCTest ModuleTCACTIONLIBRARYINTERFACE
    20. 20. © 2013 LogiGear Corporation. All rights reserved.© 2013 LogiGear Corporation. All rights reserved.• Top-down Test Development Plan• Business-level Test Module objectives• Objective-driven Test Cases withsimilar “scope”• Action Library and Interfaces drivetest case operation• Automation engine to executeTest CasesSeparate test development and test automation environmentsTest ModuleTCAutomation EngineTest Development PlanTest ModuleTCTest ModuleTCACTIONLIBRARYINTERFACE
    21. 21. © 2013 LogiGear Corporation. All rights reserved.© 2013 LogiGear Corporation. All rights reserved.• Suited for complex, enterprise-level testprojects• Test modules, with readable, understandabletest flows• High team involvement, collaboration andcommunication• Emphasis on test design, test flow and testproject organization− Less focus on tools, technology, andprogramming detailsFocus on test design and test flow, not on test programmingTest ModuleTCAutomation EngineACTIONLIBRARYINTERFACETest Development PlanTest ModuleTCTest ModuleTC
    22. 22. © 2013 LogiGear Corporation. All rights reserved.© 2013 LogiGear Corporation. All rights reserved.Cash FlowOptimizationReconcileStatementsManagementImageVerificationAuthorizationAuthenticationAccess MgmntRisk/FraudMitigationCrimeDetectionTransactionMonitoringData CommReal-timeProcessingTest Development PlanBusiness ObjectiveBusiness ObjectiveBusiness ObjectiveManagementCrimeDetectionReal-timeProcessing
    23. 23. © 2013 LogiGear Corporation. All rights reserved.© 2013 LogiGear Corporation. All rights reserved.Cash FlowOptimizationReconcileStatementsManagementImageVerificationAuthorizationAuthenticationAccess MgmntRisk/FraudMitigationCrimeDetectionTransactionMonitoringData CommReal-timeProcessingAutomation EngineACTIONLIBRARYINTERFACESecurityBusiness-levelObjectivesTransactionBusiness-levelObjectivesAccessBusiness-levelObjectivesTest Module Test Module Test ModuleTest Development Plan
    24. 24. © 2013 LogiGear Corporation. All rights reserved.Keyword-drivenmethodologyModulartest designSolutionarchitecture andfunctionalityAutomation EngineActionLibraryInterfaceTest ModuleTest ModuleTest ModuleTest Development Plan
    25. 25. © 2013 LogiGear Corporation. All rights reserved.Test DesignTestObjectivesTest Lines(with Actions)TestModulesActionDefinitionsInterfaceDefinitionsCustomScriptsTest Development Test AutomationTest andActionRepository Architecture and functionalitydesigned for Action-Based Testing Integrated in the QualityEnablement process Extension in Microsoft VisualStudio 2012, and TFS/MTMContinuous Integrationenvironment
    26. 26. © 2013 LogiGear Corporation. All rights reserved. Architecture and functionalitydesigned for Action-Based Testing Integrated to the QualityEnablement process Extension in Microsoft VisualStudio 2012, and TFS/MTMContinuous Integrationenvironmentsource:Microsoft,withpermission
    27. 27. © 2013 LogiGear Corporation. All rights reserved. Architecture and functionalitydesigned for Action-Based Testing Integrated to the QualityEnablement process Extension in Microsoft VisualStudio 2012 and TFS/MTMContinuous IntegrationenvironmentTeamFoundationServerMicrosoftTestManagerVisualStudio
    28. 28. © 2013 LogiGear Corporation. All rights reserved.© 2013 LogiGear Corporation. All rights reserved.TC nsrc ctrlclick add OKTC nsrc ctrlclick add OKTC nsrc ctrlclick add OKTC nsrc ctrlclick add OKTC nsrc ctrlclick add OKTest ScriptsApplicationUnder Test50QuantityusenailsDescr123NumberhammerNameAddOKTest Scripts are fragile when linked directly to the application
    29. 29. © 2013 LogiGear Corporation. All rights reserved.© 2013 LogiGear Corporation. All rights reserved.50QuantityusenailsDescr123NumberhammerNameAddTC nsrc ctrlclick add OKTC nsrc ctrlclick add OKTC nsrc ctrlclick add OKTC nsrc ctrlclick add OKTC nsrc ctrlclick add OKTest ScriptsOKApplicationUnder TestWhen application code changes, test scripts require maintenance
    30. 30. © 2013 LogiGear Corporation. All rights reserved.© 2013 LogiGear Corporation. All rights reserved.INTERFACE Add ProductName ID TA NameORDER_Button 34 OK50QuantityusenailsDescr123NumberhammerNameAddTC nsrc ctrlclick add OKTC nsrc ctrlclick add OKTC nsrc ctrlclick add OKTC nsrc ctrlclick add OKTC nsrc ctrlclick add OKTest CasesINTERFACEApplicationUnder TestTest Cases are linked to a user-defined logical name in the interface
    31. 31. © 2013 LogiGear Corporation. All rights reserved.© 2013 LogiGear Corporation. All rights reserved.INTERFACE Add ProductName ID TA NameORDER_Button 34 OK50QuantityusenailsDescr123NumberhammerNameAddTC nsrc ctrlclick add OKTC nsrc ctrlclick add OKTC nsrc ctrlclick add OKTC nsrc ctrlclick add OKTC nsrc ctrlclick add OKTest CasesINTERFACEApplicationUnder TestInterface is linked to the control properties of the application
    32. 32. © 2013 LogiGear Corporation. All rights reserved.© 2013 LogiGear Corporation. All rights reserved.number name description quantityrow 57463292 Tires Radial tires 8row 45892135 Axles Between the wheels 10row 32198327 Wheels 17 inch wheels 24row 32014827 Taillights Red plastic 326row 03512305 Headlights For nighttime driving 22name criterionfilter high quantity quantity > 8filter low quantity quantity < 100number name description quantityrow 57463292 Tires Radial tires 8row 45892135 Axles Between the wheels 10row 32198327 Wheels 17 inch wheels 24row 32014827 Taillights Red plastic 326row 03512305 Headlights For nighttime driving 22name criterionfilter high quantity quantity > 8filter low quantity quantity < 100nameuse data set /Inventory Data Setnumber name description quantityadd product #number #name #description #quantityname number description quantitycheck product #name #number #description #quantityrepeat for data setnumber name description quantityrow 57463292 Tires Radial tires 8row 45892135 Axles Between the wheels 10row 32198327 Wheels 17 inch wheels 24row 32014827 Taillights Red plastic 326row 03512305 Headlights For nighttime driving 22name criterionfilter high quantity quantity > 8filter low quantity quantity < 100Multiple data sets applied to a single Test Module for code coverageTest ModuleTESTCASETESTCASETESTCASETESTCASE
    33. 33. © 2013 LogiGear Corporation. All rights reserved.© 2013 LogiGear Corporation. All rights reserved.UIautomationtestingsource:Microsoft,withpermission
    34. 34. © 2013 LogiGear Corporation. All rights reserved.© 2013 LogiGear Corporation. All rights reserved.UI automationtestingKeywordBasedsource:Microsoft,withpermissionTest Case
    35. 35. © 2013 LogiGear Corporation. All rights reserved.• Build and check-intests into TFS• Associate the tests toMTM tests• Run the tests in MTMand examine the resultsMicrosoft TFS / MTMContinuous Integration© 2013 LogiGear Corporation. All rights reserved.
    36. 36. © 2013 LogiGear Corporation. All rights reserved. © 2013 LogiGear Corporation. All rights reserved.
    37. 37. © 2013 LogiGear Corporation. All rights reserved.Coded UI tests run as partof the unit testing suiteCoded UI tests in thefamiliar Solution Explorer,are a part of source control© 2013 LogiGear Corporation. All rights reserved.
    38. 38. © 2013 LogiGear Corporation. All rights reserved. © 2013 LogiGear Corporation. All rights reserved.
    39. 39. © 2013 LogiGear Corporation. All rights reserved. © 2013 LogiGear Corporation. All rights reserved.
    40. 40. © 2013 LogiGear Corporation. All rights reserved. © 2013 LogiGear Corporation. All rights reserved.
    41. 41. © 2013 LogiGear Corporation. All rights reserved. © 2013 LogiGear Corporation. All rights reserved.
    42. 42. © 2013 LogiGear Corporation. All rights reserved.Create a high-level action:add plane to cart© 2013 LogiGear Corporation. All rights reserved.
    43. 43. © 2013 LogiGear Corporation. All rights reserved.High-level action:add plane to cart© 2013 LogiGear Corporation. All rights reserved.
    44. 44. © 2013 LogiGear Corporation. All rights reserved. © 2013 LogiGear Corporation. All rights reserved.Identical keywordactions and Coded UIfunctionalityLower-level programmingdetails are hidden fromthe test flow
    45. 45. © 2013 LogiGear Corporation. All rights reserved.Readable,understandabletest flowadd plane to cartRe-use the samehigh-level actionmultiple times© 2013 LogiGear Corporation. All rights reserved.
    46. 46. © 2013 LogiGear Corporation. All rights reserved.www.TestArchitect.com© 2013 LogiGear Corporation. All rights reserved.
    47. 47. © 2013 LogiGear Corporation. All rights reserved.Thank you !

    ×