The document discusses how AI and machine learning can enhance UI/UX testing by leveraging AI. It notes that software development is getting faster but testing needs to keep up. Test automation coverage is still too low and testing is getting more complex. Organizations are turning to AI/ML to support faster changes. The future of testing with AI/ML could increase testing speed by 90% or more and reduce costs by up to 50% while finding 30% more defects before production. Integrating visual AI into testing can help automate more of the testing process through techniques like visual regression testing and detecting visual bugs.

1. 1
How to Enhance UI/UX
Testing by Leveraging AI
January 10, 2023

2. 2
How to Enhance UI/UX
Testing by Leveraging AI
Prepared By: Chris Rolls
Role: CEO Americas
Email: chris.rolls@ttcglobal.com
Prepared By: Andy Knight
Role: Developer Advocate
Email: andrew.knight@applitools.com

3. 3
3
About TTC + Applitools

4. 4
Applitools at a Glance
Applitools is on a mission to help
designers, developers, and testers
deliver their best UI/UX without
spending hundreds of hours
writing, running, and fixing tests.
Applitools Eyes enables teams to
create, execute, and maintain
tests faster and more reliably than
any other traditional testing
platform.
12,000+
Active Customers
16 of 20
Top Financial
Institutions in F100
130K
Test Automation
University Students
50+
Framework SDKs

5. 5
About TTC
ü The unrivaled leaders at
improving the quality of
software for our global
customers
ü Today with offices in
Americas, Middle East,
Australia, Asia, Europe &
New Zealand
ü Committed to Quality of
Service with client base of
Fortune 500 clients
ü A proven knowledge base
with Methodologies, Tools,
and Templates
Resourcing Solutions
• Test Analyst
• Test Engineers
• Test Managers
Testing as a Service
Testing Fundamentals
Test Automation
Environment Management
Performance Engineering
Test Design Optimization
Technology Solutions
Digital Transformation
Agile & DevOps Dojos
Quality Transformation
Robotic Process Automation
Accessibility & Security
Digital Enablement
ü Established as a global
leader in Testing and Quality
Assurance
ü With over 300 employees
serving clients across
multiple industries

6. 6
About the Speakers
Andrew Knight
APPLITOOLS
DEVELOPER ADVOCATE
Chris Rolls
TTC
CEO AMERICAS
Andrew “Pandy” Knight is the Automation Panda, a software
quality champion who loves to help people build better-quality
software. In the past, he’s built large-scale test automation
projects that run continuously and reliably. Currently, as a
Developer Advocate at Applitools, Pandy helps folks make
their apps visually perfect. He serves as Director of Test
Automation University, which offers a multitude of free
courses on software testing from the world’s leading
instructors. An avid supporter of open-source software, Pandy
is a Playwright Ambassador as well as the lead developer for
Boa Constrictor, the .NET Screenplay Pattern.
Chris Rolls is the CEO of Americas for TTC where he has
overseen the growth of TTC in the Americas and oversees.
Chris is an experienced testing practitioner and has been with
TTC for over a decade and has held roles including that of Test
Automation Consultant and National Manager of Test
Engineering. Chris also brings a wealth of knowledge having led
projects at some of the world’s largest Fortune 500
organizations. He is passionate about the positive change that
digital disruption can bring and knows that the key to business
success is the ability to release quality software at speed to
ensure that your software is a competitive advantage.

7. 7
7
Current State of Testing

8. 8
DevOps with Continuous Testing
Digital Disruption
Requires Digital
Transformation
<12% of 1950s Fortune 500
Companies Remain
American Enterprise Institute:
Fortune 500 Firms since 1955
Digital
Transformation
Requires DevOps
>80% of Organizations Plan to
Adopt DevOps
Harvard Business Review:
Competitive Advantage Through DevOps
DevOps Requires
Continuous
Testing
#1 Technical Challenge is
Manual Testing and Deployment
CodeMagic:
Common DevOps Challenges 2021

9. 9
How often do you
deploy changes to
production?
Continuous Delivery is For Real

10. 10
55% of all respondents
automate less than half
their testing
Respondents from companies using
Applitools reported coverage levels that
were significantly higher than non
Applitools users (~1.7x on average)
Automation Coverage Remains a Huge Challenge

11. 11
How many different
applications is your
team responsible
for?
How many local
languages does your
application support?
(English, French, etc.)
How many different
types of browsers do
you support?
How many different
types of mobile
devices do you
support for your
application?
The Complexity of the Testing Matrix is Increasing Exponentially
More than 50% test 2 languages or more, 3 browsers or more, 3 devices or more and 2 applications or more!

12. 12
~2/3rd of respondents think the hardest parts of
testing UIs is that “they are constantly changing”
Traditional Automation Tools Can’t
Handle Testing at Today’s Scale and Speed
5
2
different
browsers
different browser
versions
3 different mobile
devices
5
2
different
apps
different
languages
Browser/Device coverage adds another layer
of complexity, making this a huge challenge

13. 13
What parts of the
testing process are you
supporting or planning
on supporting with AI?
AI-Powered Testing Tools are Gaining Adoption
(AI-Powered Visual Testing and Test Execution are Dominating)

14. 14
What types of testing
do you run on every
deployment?
Continuous Testing is Real
(and it includes non-functional testing)

15. 15
1. Software development is getting faster, and testing needs to keep up
2. Test Automation coverage is still too low to truly support Continuous Testing
3. Testing is getting more complex, and many tools can’t cope
4. Organizations are turning to AI/ML to support change
5. Continuous Testing is about more than just Test Automation
Summary

16. 16
16
Future State of Testing

17. 17
The Future-State of Testing
Increased Speed
90+% Faster Testing
Reduced Cost
Up to 50% Cost Reduction
Increased Quality
30% More Defects Found Before
Production

18. 18
The Future-State of Testing
Smart technologies will
increase cost-efficiency,
reduce the need for
manual testing, shorten
time to market, and help
to sustain a circle of
continuous quality
improvements.
- World Quality Report 2021
80%
Manual
Testing
20%
Automated
Testing
Present Future
Assisted Exploratory Tests
Intelligent Automated UI Tests
Intelligent Automated API Tests
Intelligent Automated Unit Tests
+90%

19. 19
How Does it Work?
We are firm believers in the power of combining
People, Process & Technology. These three
components provide the foundation for TTC’s
Continuous Testing Methodology.
People
Technology
Process
Continuous
Testing
Methodology

20. TTC Confidential – Do Not Distribute
20
Evaluating an Opportunity to Use AI/ML in Testing
What is the Pain
Point?
Are there good
Algorithmic/Heuristic
solutions available to
address it?
Are there enterprise
ready AI/ML
solutions that help?
If “not yet” how do we
position ourselves to
be ready when they
come?
If they are ready –
what happens if the
AI/ML doesn’t
work?

21. 21
21
Integrating Visual AI

22. 22
Spot the Differences

23. 23
Spot the Differences

24. 24
Spot the Visual Bugs

25. 25
Let’s Demo!
Example Code is Available at:
https://github.com/AutomationPanda/
visual-testing-revolution-cypress

26. 26
1. Replacing traditional assertions with visual snapshots
2. Taking baseline and checkpoint snapshots
3. Rendering snapshots on different browsers and devices
4. Viewing results in the dashboard
5. Performing root cause analysis on failures
6. Checking accessibility with Contrast Advisor
What Our Demo Covered:

27. 27
Visual AI helps us automate the automation.
It will empower the next great wave: autonomous testing.

28. 28
Q&A Session

29. 29
applitools.com
testautomationu.applitools.com
Contact Us
applitools.com/request-demo

30. 30
Contact Us
25211 Grogans Mill Rd #450
The Woodlands,
Texas 77380
(832) 813-8063
sales.us@ttcglobal.com
Level 6, Cathedral House
48-52 Wyndham St.
Auckland 1010, New Zealand
+64 9 948 2225
info@ttcglobal.com
Hong Leong Building
6 Raffles Quay, #33-03
Singapore 048581
+65 9822 6679
singapore@ttcglobal.com
154 Lawrence St
Alexandria
Sydney
NSW 2015
+61 2 8999 1965
australia@ttcglobal.com
New Zealand United States Singapore
Australia
10 John Street
London WC1N 2EB
United Kingdom
+44 7384 719098
uk@ttcglobal.com
Europe | UK
14th Floor, Al Khatem Tower
Wework Hub 71 Abu Dhabi
Global Market Square, Al
Maryah Island Abu Dhabi, UAE
+971 58 5233912
UAE@ttcglobal.com
United Arab Emirates
6 Floor Westport S.No.
32/1A/1/30 to 38 & 54 Pan
Card Club Rd, Baner, Pune,
Maharashtra 411045
india@ttcglobal.com
India

31. 31