Functional UI testing of Adobe Flex RIA            Viktor Gamov  viktor.gamov@faratasystems.com           August, 12 2011
Agenda•   Why to test?•   How to test?•   What the automated testing means?•   Automated testing tools•   Automated testin...
Software has to satisfy the          user!
Demo: Killer RIA
How to test?• Unit Testing• Functional (UAT, QA) Testing• Integration Testing• Load Testing
Metaphor: building the           house• think of unit tests as having the building inspector  at the constructions site• t...
What automated         testing means?Automated testing is the use of software to control theexecution of tests, the compar...
General approaches• Code-Driven Testing -               the public (usually) interfaces to  classes, modules, or libraries...
Some Automated      Testing tools• HP QuickTest Professional (QTP)• Selenium• Ranorex• FlexMonkey
HP QTP•   All-in-one suite for automation testing    enterprise applications•   Supports the large pool of  software    de...
Selenium•   Web applications testing•   Open source and large community•   Cross platform (Selenium IDE - browser    exten...
Ranorex•   Similar to QTP, but easier to use•   Support various technologies: .NET, WPF,    Silverlight, Qt, Win32, WFC, J...
Flex Monkey•   Open Source (commercial support available)•   Flex apps testing centric tool•   Cross platform (console - A...
Demo
and the QTP testing tool.         Automated Testing• automation tool — Automation tools are applications that use the data...
Automation APICore Flex API                    SystemManager                                     Automation   DelegatesAut...
You are not required to create an instance of your adapter in the init() method. You can also create this instance inthe A...
5 When it is created, the delegate class adds a reference to its instance in the delegate class map. The de   then handles...
Loading automation        classes• Compile time -            To compile an application that includes the  automation class...
Creating test-friendly        applications•   providing meaningful identification of objects    “submitPanel” rather than “...
Instrumenting events• instrumenting existing events -                     the tools are not  generally interested in recor...
Instrumenting existing         events• override the replayAutomatableEvent()  method of the IAutomationObject interface• c...
Instrumenting custom         events• call the Automation.automationManager2 class’s  recordCustomAutomationEvent()   metho...
What is a custom             component•   A component extending from a standard component    (No additional events, no add...
Instrumenting custom         components• create a delegate class that implements the required  interfaces (IAutomationObje...
Create a delegate class•   use a pattern for delegate class name    [ComponentClassName]AutomationImpl•   extend the UICom...
Instrument component  with a delegate class•   override the getters of the automationName and the    automationValue prope...
Instrument composite          component•   override the getter of the numAutomationChildren    property and the methods to...
And one more thing...
PROBLEM• Unless tests are run automatically, testing is  ineffective
Solution: Use Jenkins• Will automatically run tests for you• Will tell you if they fail• Provide you reports, result and m...
Demo
Instead of an epilogue
«90% of coding is debugging. The other 10% is writing bugs»     Bram Cohen, author of the BitTorrent protocol  «If debuggi...
Be brave!Just test and no more bugs!
Resources• GorillaLogic http://goo.gl/Ly6dd• FlexMonkey resources page http://goo.gl/  eKKaZ• Ranorex Flex Testing http://...
p.s. Sample codehttps://github.com/gAmUssA/flex_flexmonkey_flexunit_ci http://myflex.org/presentations/symposium4/Viktor.zip
Functional UI testing of Adobe Flex RIA
Functional UI testing of Adobe Flex RIA
Functional UI testing of Adobe Flex RIA
Functional UI testing of Adobe Flex RIA
Upcoming SlideShare
Loading in...5
×

Functional UI testing of Adobe Flex RIA

1,434

Published on

Functional UI testing of Adobe Flex RIA on 4th Annual Farata's symposium

Published in: Technology
0 Comments
2 Likes
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total Views
1,434
On Slideshare
0
From Embeds
0
Number of Embeds
2
Actions
Shares
0
Downloads
33
Comments
0
Likes
2
Embeds 0
No embeds

No notes for slide
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • think of unit tests as having the building inspector at the construction's site, focusing on making sure that the internal system of the house (foundation, plumbing, etc) works correctly, while functional testing as having the homeowner visiting the house and being interested in how the house looks, if the rooms have the desired size, etc. He assumes that the internal functions of the house work properly. In unit testing, think of a unit as being the smallest testable part of an application, such as a function/method. The goal is to isolate such parts and make sure they run correctly by being able to test them repeatably. Unit tests are written from the developer's perspective, and as a developer, we have to make sure that we understand the specification and requirements of our software system before writing unit tests. This can be achieved through use cases.\n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • Transcript of "Functional UI testing of Adobe Flex RIA"

    1. 1. Functional UI testing of Adobe Flex RIA Viktor Gamov viktor.gamov@faratasystems.com August, 12 2011
    2. 2. Agenda• Why to test?• How to test?• What the automated testing means?• Automated testing tools• Automated testing architecture• Loading automation classes• Creating test-friendly applications• Bunch of Demos
    3. 3. Software has to satisfy the user!
    4. 4. Demo: Killer RIA
    5. 5. How to test?• Unit Testing• Functional (UAT, QA) Testing• Integration Testing• Load Testing
    6. 6. Metaphor: building the house• think of unit tests as having the building inspector at the constructions site• think of functional testing as having the homeowner visiting the house and being interested in how the house looks, if the rooms have the desired size
    7. 7. What automated testing means?Automated testing is the use of software to control theexecution of tests, the comparison of actual outcomes topredicted outcomes, and other test control and testreporting functions.
    8. 8. General approaches• Code-Driven Testing - the public (usually) interfaces to classes, modules, or libraries are tested with a variety of input arguments to validate that the returned results are correct.• GUI Testing - a testing framework generates and records the UI events keystrokes and mouse clicks. The tester observes the changes reflected via the user interface to validate the observable behavior of the program.
    9. 9. Some Automated Testing tools• HP QuickTest Professional (QTP)• Selenium• Ranorex• FlexMonkey
    10. 10. HP QTP• All-in-one suite for automation testing enterprise applications• Supports the large pool of  software development environments like SAP , Web , Oracle etc.• Support libraries out-of-the-box with Flex (qtp.swc, qtp_air.swc)• VBScript as scripting language
    11. 11. Selenium• Web applications testing• Open source and large community• Cross platform (Selenium IDE - browser extension)• Uses JavaScript as scripting language
    12. 12. Ranorex• Similar to QTP, but easier to use• Support various technologies: .NET, WPF, Silverlight, Qt, Win32, WFC, Java SWT, Flash/ Flex• Script languages C#,VB.NET, IronPython• Integrates with Visual Studio 2010• Platform: Windows only
    13. 13. Flex Monkey• Open Source (commercial support available)• Flex apps testing centric tool• Cross platform (console - AIR application)• Generated FlexUnit 4 test code• Supports testing only Flex applications (no Flash)• Integration with Selenium IDE (FlexMonkium project)
    14. 14. Demo
    15. 15. and the QTP testing tool. Automated Testing• automation tool — Automation tools are applications that use the data that is d include QTP, Omniture, and Segue.• delegates — Flex framework components are instrumented by attaching a de Architecture time. The delegate class defines the methods and properties required to perfoThe following illustration shows the relationship between an application, an age Automation Tool • automation tool are applications that use the data that provided by the agent. • automation agent facilitates communications between an application and an automation Agent tool. • delegates are Flex framework components are instrumented by attaching a delegate class to each component at run time. The delegate class Application defines the methods and properties required built with Flex to perform automation.As this illustration shows, the automation tool uses an agent to communicate wit
    16. 16. Automation APICore Flex API SystemManager Automation DelegatesAutomation API Automation Manager Delegates Delegates QTP FlexMonkey SeleniumAgent Classes Agent Agent AgentAutomation Tools QTP FlexMonkey Selenium
    17. 17. You are not required to create an instance of your adapter in the init() method. You can also create this instance inthe APPLICATION_COMPLETE event handler if your agent requires that the application must be initialized before it isinstantiated. Automation flowUnderstanding the automation flowWhen the application is initialized, the AutomationManager object is created. In its init() method, it adds a listenerfor Event.ADDED events.The following image shows the order of events when the application is initialized and the AutomationManager classconstructs the delegate map.1. Creates the display list. 3. Listens for ADDED event. SystemManager AutomationManager Display List HGroup Automation Accordion Button 4. Maintains map of component TextArea class to delegate class. { } HGroup map[Button] = map[spark.components.Button] TextInput map[HGroup] = map[spark.components.HGroup] TextInput ... Button2. Dispatches the ADDED Delegate event for each UIComponent. 5. Handles component events. Records and plays back events on component instances. { map[spark.components.Button] = SparkButtonAutomationImpl map[spark.components.HGroup] = SparkGroupAutomationImpl ... }1 The SystemManager class creates the display list, a tree of visible objects that make up your application.
    18. 18. 5 When it is created, the delegate class adds a reference to its instance in the delegate class map. The de then handles events during record and play-back sequences. The delegate is now considered registered with the component. It adds event listeners for the compon Automation flow and calls the AutomationManager when the component triggers those events.After the components in the display list are instantiated and mapped to instances of their delegate classeAutomationManager is ready to listen for events and forward them to the agent for processing.The following image shows the flow of operation when a user performs an action that is a recordable eventthe user clicks a Button control in the application.1. User clicks on a component. Application 3. recordAutomationEvent() called. built with Flex Automation- Agent Manager Delegate 4. Dispatches RECORD event. 5. Handles RECORD events. Button2. Listens for component events such as CLICK.1 The user clicks the Button control in the application. The SystemManager dispatches a MouseEvent.2 The SparkButtonAutomationImpl class, the Button control’s automation delegate, listens for click e delegate’s click event handler, the delegate calls the AutomationManager recordAutomationEvent
    19. 19. Loading automation classes• Compile time - To compile an application that includes the automation classes, include automation libraries at compile time by using the compiler’s include-libraries option.• Run time - Compile your app without any additions. At run time, load your application into a wrapper SWF file that has built in automation libraries. This wrapper SWF file uses SWFLoader to load your application SWF file to be tested.
    20. 20. Creating test-friendly applications• providing meaningful identification of objects “submitPanel” rather than “myPanel” or “p1”• avoiding renaming objects if (!automationName) return label;• adding and removing containers from the automation hierarchy showInAutomationHierarchy = false;• instrumenting events• instrumenting custom components
    21. 21. Instrumenting events• instrumenting existing events - the tools are not generally interested in recording all the events : MOUSE_OVER• instrumenting custom events - when you extend components, you often add events that are triggered by new functionality of that component• blocking and overriding events - in some cases, you might want to block or override the default events that are recorded for a component
    22. 22. Instrumenting existing events• override the replayAutomatableEvent() method of the IAutomationObject interface• call the AutomationManager’s method when a recordAutomatableEvent() button dispatch MOUSE_MOVE event• define the new event for the agent
    23. 23. Instrumenting custom events• call the Automation.automationManager2 class’s recordCustomAutomationEvent() method• define the new event for the agent• listen for the AutomationCustomReplayEvent, get the details about it and replay the event
    24. 24. What is a custom component• A component extending from a standard component (No additional events, no additional properties)• A component extending from a standard component – Additional events/ additional properties• A component extending from a non container class, but the current class is a container.
    25. 25. Instrumenting custom components• create a delegate class that implements the required interfaces (IAutomationObject)• add testing-related code to the component (not recommended)
    26. 26. Create a delegate class• use a pattern for delegate class name [ComponentClassName]AutomationImpl• extend the UIComponentAutomationImpl or implement IAutomationObject interface• mark the delegate class as a mixin by using the [Mixin] metadata keyword• register the delegate with the AutomationManager by calling the Automation.registerDelegateClass()
    27. 27. Instrument component with a delegate class• override the getters of the automationName and the automationValue properties• add listeners for events that the automation tool records• override the replayAutomatableEvent() method• add the new component to custom class definition XML file (FlexMonkeyEnv.xml)
    28. 28. Instrument composite component• override the getter of the numAutomationChildren property and the methods to expose children: • getAutomationChildren() • getAutomationChildrenAt()
    29. 29. And one more thing...
    30. 30. PROBLEM• Unless tests are run automatically, testing is ineffective
    31. 31. Solution: Use Jenkins• Will automatically run tests for you• Will tell you if they fail• Provide you reports, result and metrics• Can be downloaded from http://jenkins-ci.org/• Very easy to setup and configure
    32. 32. Demo
    33. 33. Instead of an epilogue
    34. 34. «90% of coding is debugging. The other 10% is writing bugs» Bram Cohen, author of the BitTorrent protocol «If debugging is the process of removing bugs thenprogramming must be the process of putting them in» Edsger Dijkstra
    35. 35. Be brave!Just test and no more bugs!
    36. 36. Resources• GorillaLogic http://goo.gl/Ly6dd• FlexMonkey resources page http://goo.gl/ eKKaZ• Ranorex Flex Testing http://goo.gl/sJI1L• Automation Docs http://goo.gl/PwuZc• Blog on Flex Automation http://goo.gl/CCQ80
    37. 37. p.s. Sample codehttps://github.com/gAmUssA/flex_flexmonkey_flexunit_ci http://myflex.org/presentations/symposium4/Viktor.zip
    1. A particular slide catching your eye?

      Clipping is a handy way to collect important slides you want to go back to later.

    ×