Looking for cutting-edge AI-based test automation tools to level up your SDLC today? In this webinar, we will hit reset on the industry expectations around what your tooling needs to look and act like—and give you a preview of the new product we’ve been pouring ourselves into. You will see why now is the time to shake things up and push beyond what you thought possible in your test automation practice.
Adobe Marketo Engage Deep Dives: Using Webhooks to Transfer Data
A Test Automation Platform Designed for the Future
1. 1
A Test Automation Platform Designed
for the Future
Introducing Autonomous and the Applitools Intelligent Testing Platform
1
AI-Powered Testing & Monitoring
Feb 2024
2. 2
Agenda
• Why autonomous testing?
• The goal of autonomous testing
• How can it be done?
• The Applitools intelligent testing platform
• Introducing Autonomous
• Q&A
4. 4
The test automation lifecycle
SETUP
• Build a test automation framework
• Integrate with CI/CD
• Setup a device & browser lab
AUTHOR
• Add new tests for new features
• Adapt existing tests to app changes
• Is coverage adequate?
EXECUTE
• Devices & browsers
• Speed
• Stability
ANALYZE
• Analyze test results
• Triage & report issues
• Generate quality reports
Architect
DevOps
Dev
Quality lead
Dev
Dev
DevOps
13. 13
Is the goal of autonomous testing to
eliminate the human factor?
14. 14
Is the goal of autonomous testing to
eliminate the human factor?
15. 15
AI can’t replace the QA practitioner
• Not accurate enough to be trusted blindly
• Requires adjustment and feedback
• Quality issues are often subjective
• Limited perspective
• Limited scope
16. 16
GenAI has lowered the bar for producing software at scale
What impact do you think this will have on software quality?
17. 17
The goal of autonomous testing is to make
automation at scale accessible effortlessly to all
18. 18
Automation at scale accessible effortlessly to all!
Attain near complete
test coverage
From below 20% to 80% or more
Catch unexpected defects
Lower the required
skill set
From dev to quality
Drastically reduce
human involvement
From total involvement to review
findings and filling coverage gaps
28. 28
VisualAI advantages
• Enhance existing tests and reduce the
amount of test code by up to 80%
• A single visual checkpoint for complete
visual and functional coverage
• Catch unexpected defects
• Do not break when the UI changes
• No coding skills required to maintain
validation logic
32. 32
32
AUTHOR
Record live interactions with a powerful web recorder to build
complex end-to-end tests without coding
UI RECORDER
Automatically discover new, missing, faulty or changed pages
and components on your website or web app on every run.
AUTONOMOUS DISCOVERY
Describe complex custom end-to-end flows using nothing more
than plain English: interactions, assertions, API calls, etc.
NLP BUILDER
Integrate Visual AI with your favorite open-source testing
frameworks
FRAMEWORK SDKs
Reduce the time it takes to author automated tests
33. 33
Validate entire pages with hundreds of elements across
different browsers instantly with a single line of code
INCREASE COVERAGE
Easily test dynamic and frequently changing pages
without having to rewrite and maintain tests
DYNAMIC CONTENT
VALIDATE
Increase test coverage with AI assertions
Validate any UI technology: web, native mobile,
hybrid, desktop, PDF documents, design images, etc.
ANY UI TECHNOLOGY
34. 34
EXECUTE
Increase release velocity with faster, resilient tests
Run tests in parallel at massive scale on ultrafast test
infrastructure in the cloud
FAST INFRASTRUCTURE
Automatically heal element locators that break your
tests even for the smallest UI change
SELF-HEALING TESTS
Run tests on demand, from your CI/CD, a webhook, or
use our built-in test scheduler
FLEXIBLE ORCHESTRATION
35. 35
ANALYZE
Get deep insights into every test run
Get comprehensive reports and insights for all your test
runs and easily search and filter test results
INSIGHTFUL REPORTS
Quickly surface code changes underlying UI changes with
Root Cause Analysis
PINPOINT WHAT WENT WRONG
Leverage AI to avoid repetitive test maintenance activities
and to group together similar UI changes and issues
AUTOMATED TEST MAINTENANCE
36. 36
• Collaboration tools
• Bug trackers
• CI / CD
• Source control
• APIs
INTEGRATE
Integrate with everything
38. 38
Autonomous
Autonomous testing for websites and multi-page web apps
Easy one click
setup
Just point Autonomous at your
website and you are done.
Everything you need is available
out of the box.
Automatic website /
app discovery
Automatically create self-adjusting
test suites that detect new,
missing, changed or faulty pages
and components on every run
Natural language
test builder
Describe complex end-to-end flows
using nothing more than plain English.
No coding or element locating skills
required
Flexible test
orchestration
Run tests on demand, from your
CI/CD, a webhook, or use our
built-in test scheduler. No DevOps
skills required
Self-heal broken locators, avoid
repetitive maintenance activities
and group together similar UI
changes and issues
AI assisted test
maintenance
Cross device and
browser testing
Test your public and internal apps on
any device, browser and OS using
the world’s most modern test
infrastructure available out of the box
40. 40
The world’s most intelligent testing platform
Automated test maintenance
Employs DNNs to find similar
differences across different OS,
devices and browsers (e.g.,
different fonts).
Self healing element locators
Employs algorithms and ML to find
UI elements with broken locators
based on previous successful test
runs.
Automated test data generation
Employs DNNs to detect input
forms in apps and the data types
of their fields to facilitate proper
test data generation.
Automatic test suite creation
Employs Generative AI algorithms
to generate entire test suites for
websites and multi-page web
applications.
Author tests in plain English
Employs LLMs for language
understanding and for translating
business level test instructions to
detailed UI interactions.
VisualAI: human vision modeling
Employs dozens of algorithms,
and DNNs to model color
similarity, text vs image, picture vs
graphics, pattern detection, etc.
* ML – Machine Learning, DNN – Deep Neural Network, LLM – Large Language Model