Justin Ison
Sr. Software Engineer
justin.ison@applitools.com
@isonic1
Delivering Flawless UI
The Challenges and Solutions
IN THIS SESSION YOU WILL LEARN:
âś“ Challenges of visual testing in an Agile CI/CD environment (OR: why
bad UI bugs happen to good testers?)
âś“ What is automated visual testing, and how AI fits in
âś“ Why we need it
âś“ Benefits and ROI of visual testing
✓ Getting started with Automated Visual Testing – the easy way!
WHAT IS VISUAL TESTING?
QUALITY ASSURANCE ACTIVITY AIMED TO VERIFYTHAT YOUR
GRAPHICAL USER INTERFACE (GUI)
APPEARS CORRECTLY TO YOUR END USERS
ACROSS ALL DEVICES, BROWSERS, SCREEN SIZES, AND FORM FACTORS
VISUAL BUGS

JUST HAPPEN

TO THE

“SMALL” GUYS...
DON’T
MICROSOFT
TWITTER
AMAZON
UPS
Financial Times
WHY* DO

BAD UI BUGS

HAPPEN TO THE

GOOD GUYS?



*HINT: IT’S NOT (ALL) YOUR FAULT
TOO MANY
DEVICES

+

BROWSERCOMBINATIONS

TO TEST
TEST MATRIX IS
TOO BIG
TO COVER
MANUALLY
Responsive Design
Don’t end
up like
this!
RELEASE
CYCLES
KEEP GETTING
SHORTER
CI-CD PROCESSES DEMAND
AUTOMATION
AND
ZERO
MANUAL BOTTLENECKS
WHY

AUTOMATE?
ohad@applitools.com
HUMAN
ERROR
VISUAL VALIDATION IS A
BORING
REPETITIVE
TIME CONSUMING
PROCESS
PRONE TO HUMAN ERROR
DIGITAL IS
VISUAL
APPS ARE THE
FACEOF THE BUSINESS
WHAT ARE WE TESTING WITH VISUAL TESTING?
✓ Looking at all the visual aspects of your app/site’s UI
âś“ Ensuring all content, data, layout and appearance of all the UI
elements have rendered correctly (preferably with a single
command)
✓ We’re doing it across all platforms: browsers, devices, form factors –
and of course: on all the app/site’s pages & versions!
âś“ Desired: validation of UI elements is decoupled from the DOM/html
of the page
WHAT IF I TOLD YOU…
âś“ This can be easily automated taking away the countless hours we as
humans have been spending doing this for years. Freeing up our team
of (testers, devs) to focus on more critical areas of need
âś“ Ensuring all content, data, layout and appearance of all the UI
elements have rendered correctly across the test matrix
✓ Validating entire UI’s from header to footer with one visual snapshot
that asserts an entire page without a human having to ever view it
Sound too
good to be
true?
DEMO
BENEFITS OF VISUAL TESTING WITH APPLITOOLS
Faster and more
accurate testing
Single checkpoint
validates an entire
page
Opens Dev
bottlenecks
Single baselines for
all browsers.
Maintenance is
automated
Continuous
Integration and
Deployment (CI-
CD)
Works with all test
automation
frameworks and
cloud-based
testing platforms
Q&A
Justin Ison
Sr. Software Engineer
justin.ison@applitools.com
@isonic1

TLC2018 Justin Ison: Delivering Flawless UI - Challenges and Solutions

  • 1.
    Justin Ison Sr. SoftwareEngineer justin.ison@applitools.com @isonic1 Delivering Flawless UI The Challenges and Solutions
  • 2.
    IN THIS SESSIONYOU WILL LEARN: ✓ Challenges of visual testing in an Agile CI/CD environment (OR: why bad UI bugs happen to good testers?) ✓ What is automated visual testing, and how AI fits in ✓ Why we need it ✓ Benefits and ROI of visual testing ✓ Getting started with Automated Visual Testing – the easy way!
  • 3.
    WHAT IS VISUALTESTING? QUALITY ASSURANCE ACTIVITY AIMED TO VERIFYTHAT YOUR GRAPHICAL USER INTERFACE (GUI) APPEARS CORRECTLY TO YOUR END USERS ACROSS ALL DEVICES, BROWSERS, SCREEN SIZES, AND FORM FACTORS
  • 4.
    VISUAL BUGS
 JUST HAPPEN
 TOTHE
 “SMALL” GUYS... DON’T
  • 5.
  • 6.
  • 7.
  • 8.
  • 9.
  • 10.
    WHY* DO
 BAD UIBUGS
 HAPPEN TO THE
 GOOD GUYS?
 
 *HINT: IT’S NOT (ALL) YOUR FAULT
  • 11.
  • 12.
  • 13.
  • 14.
    RELEASE CYCLES KEEP GETTING SHORTER CI-CD PROCESSESDEMAND AUTOMATION AND ZERO MANUAL BOTTLENECKS
  • 15.
  • 16.
    HUMAN ERROR VISUAL VALIDATION ISA BORING REPETITIVE TIME CONSUMING PROCESS PRONE TO HUMAN ERROR
  • 17.
    DIGITAL IS VISUAL APPS ARETHE FACEOF THE BUSINESS
  • 18.
    WHAT ARE WETESTING WITH VISUAL TESTING? ✓ Looking at all the visual aspects of your app/site’s UI ✓ Ensuring all content, data, layout and appearance of all the UI elements have rendered correctly (preferably with a single command) ✓ We’re doing it across all platforms: browsers, devices, form factors – and of course: on all the app/site’s pages & versions! ✓ Desired: validation of UI elements is decoupled from the DOM/html of the page
  • 19.
    WHAT IF ITOLD YOU… ✓ This can be easily automated taking away the countless hours we as humans have been spending doing this for years. Freeing up our team of (testers, devs) to focus on more critical areas of need ✓ Ensuring all content, data, layout and appearance of all the UI elements have rendered correctly across the test matrix ✓ Validating entire UI’s from header to footer with one visual snapshot that asserts an entire page without a human having to ever view it
  • 20.
  • 21.
  • 22.
    BENEFITS OF VISUALTESTING WITH APPLITOOLS Faster and more accurate testing Single checkpoint validates an entire page Opens Dev bottlenecks Single baselines for all browsers. Maintenance is automated Continuous Integration and Deployment (CI- CD) Works with all test automation frameworks and cloud-based testing platforms
  • 23.
    Q&A Justin Ison Sr. SoftwareEngineer justin.ison@applitools.com @isonic1