Image Recognition

2,305 views

Published on

Visually test web sites

Published in: Business, Technology
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
2,305
On SlideShare
0
From Embeds
0
Number of Embeds
23
Actions
Shares
0
Downloads
25
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide
  • Image Recognition

    1. 1. Image Recognition Features
    2. 2. Image recognition Plugin <ul><li>IMAGESEARCH: Search for an image anywhere on the website, including inside of Java and Flash applets. Very useful to get state information from Java or Flash-applets. </li></ul><ul><li>IMAGECLICK: Send mouse clicks to an image, not a fixed X/Y position. This development solves the problem of „moving buttons“ in interactive websites. </li></ul><ul><li>The coordinates of the image are available in the {{!IMAGEX}} and {{!IMAGEY}} variables for further use. </li></ul>The Image Recognition feature provides two new commands that use state-of-the-art image recognition technology:
    3. 3. IMAGESEARCH command <ul><li>IMAGESEARCH IMAGE=c: estimage.bmp  CONFIDENCE=99 </li></ul><ul><li>Two cases: </li></ul><ul><li>Confidence = 100, a high confidence level (100%) means that an exact copy of the test image has to be found on the website. Extremly fast algorithms (less 1 sec) </li></ul><ul><li>Confidence <= 99, This command will trigger an advanced image recognition algorithm. The lower confidence levels allow for color changes. Search focuses on shape of object (letters, characters) </li></ul>
    4. 4. IMAGECLICK <ul><li>IMAGECLICK IMAGE=c:uttonimage.bmp </li></ul><ul><li>CONFIDENCE=99 CONTENT=Hello<SP>World </li></ul><ul><li>IMAGECLICK = IMAGESEARCH + WINCLICK </li></ul><ul><li>The CONTENT= attribute has the same function as for the normal DS CMD=CLICK command. Use it, for example, to fill an input box inside a FLASH applet. </li></ul><ul><li>If the image is found, the image recognition module will return the coordinates of the middle of found image to iMacros: </li></ul>The coordinates are in the {{!IMAGEX}} and {{!IMAGEY}} variables
    5. 5. Test Chat Flash Applet - Blue
    6. 6. Test Chat Flash Applet - White
    7. 7. Test Chat Flash Applet - Black
    8. 8. Test Case <ul><li>Function testing the chat applet: </li></ul><ul><li>Send a text to the input box </li></ul><ul><li>2. Click the &quot;Send&quot; button </li></ul><ul><li>3. Verify that text was received and is displayed in main window. </li></ul><ul><li>This can be achieved with the following command sequence: </li></ul><ul><li>IMAGE CLICK IMAGE= inputbox.bmp CONFIDENCE=99 CONTENT= Welcome<SP>to<SP>Heidelberg! </li></ul><ul><li>IMAGE CLICK IMAGE= sendbutton.bmp CONFIDENCE=99 </li></ul><ul><li>IMAGE SEARCH IMAGE= text.bmp CONFIDENCE=99 </li></ul>
    9. 9. Create Input Images “ inputbox.bmp” “ sendbutton.bmp” “ text.bmp”
    10. 10. Image Recognition Tips <ul><li>Processing time image recognition: 2-3 seconds typically </li></ul><ul><li>Processing time increases with input image size </li></ul><ul><li>Processing time 100% matching: < 1 second </li></ul><ul><li>False detection if confidence level is set too low </li></ul><ul><li>MS Paint useful for creating input images. MS Paint is part of Windows OS. </li></ul>
    11. 11. Demo <ul><li>Write a macro that adds 4 plus 1 at http://www.iopus.com/iim/demo/v6/flash </li></ul><ul><li>Enter „Hello World“ into banner chat at http://www.123flashchat.com/ </li></ul><ul><li>Create macro that logs into http://mywallop.com/ and automatically adds a new blog entry. </li></ul>

    ×