This document outlines a presentation on using Sikuli for automated testing. It includes: - An overview of Sikuli's fuzzy logic pattern matching and features like loops and assertions - A demonstration of recording a Sikuli script and playing it back - Details on integrating Sikuli scripts with Cucumber and Watir-Webdriver for browser automation - The agenda shows how to record a Sikuli script, call it from Cucumber step definitions, and have Cucumber run the automated tests and generate HTML reports.

1. Sikuli Demo + NoVaTAIG
Presentation
June 8, 2012
Raghavendra
University of JNTU

2. Outline
• Sikuli User Experience at OMB (Rudy and Dan)
– Sikuli environment diagram
– Sikuli workflow
– Recording a Sample Script
– Tool Settings
• Fuzzy Logic Pattern matching
– Flow Control Features
• Loops, delays, etc
• Assertions, interfacing with Jython
– Record a script and playback
• Sikuli Current Status (Dr. Yeh)
– Sikuli history
– User Communities
– New Developments and future direction

3. Sikuli Environment Diagram

4. Sikuli Proof Of Concept @ OMB
BSB
Shared Desktop App – similar to
Adobe Connect

5. What Shared Desktop does
• Can open a personal or group room for sharing
• Person who opens a room is the room owner
• Room owner sends URL invitations to attendees
• Room owner can accept attendees individually or
automatically
• Room owner can change attendees permissions –
view only, mouse only, keyboard/mouse, host (full
permissions including changing other attendee
permissions)

6. What we did @ OMB
• Wrote two Sikuli scripts:
– One represented the actions of the room owner
– One represented the actions of an attendee
• The two scripts simulated how a room works, and were
launched at the same time:
– The room owner opened his room and waited for the attendee to
enter
– The attendee sent the room URL and waited for the room to
open
– Once the room was opened the room owner accepted the
attendee
– The room owner gave the attendee Host permission
– The attendee opened up a Word document and the room and
entered text
– The room owner also entered text into the same Word document

7. NoVaTAIG Demo Outline
1) How to record Sikuli script using IDE
a) Sikuli syntax - keywords
b)Image Pattern Matching
2) How to call Sikuli from Watir-Webdriver/ Cucumber
a) Feature file
b)Scenarios/ Scenario Outline
c) Step Definitions
d)HTML output

8. Start by Using Sikuli IDE to record

9. Verify the images are recognized

10. Verify, then migrate sikuli images to
Cucumber/ Watir-Webdriver folder
structure

11. Feature file

12. Step definitions

13. Supporting ruby methods

14. Run the cucumber (happy cuking!)

15. All Green

16. Failure scenario

17. References
http://www.software-testing.com.au/blog/2010/08/16/automating-flash-ajax-popups-and-mor
http://catherinedevlin.pythoneers.com/presentations/sikuli/sikuli.html
http://bob.igo.name/wp-content/uploads/2010/10/Bob_Igo_Sikuli_cposc2010.pdf
http://www.cuberick.com/2010/06/testing-image-generation-with-cucumber.html
For a copy of the cucumber/watir-webdriver/sikuli scripts that were demo’d, please
contact
For a copy of the prototype sikuli storyboard and runner that was demo’d, please contact
tomyeh@umiacs.umd.edu