SlideShare a Scribd company logo
1 of 41
1
A Test Automation Platform Designed
for the Future
Introducing Autonomous and the Applitools Intelligent Testing Platform
1
AI-Powered Testing & Monitoring
Feb 2024
2
Agenda
• Why autonomous testing?
• The goal of autonomous testing
• How can it be done?
• The Applitools intelligent testing platform
• Introducing Autonomous
• Q&A
3
Why Autonomous testing?
4
The test automation lifecycle
SETUP
• Build a test automation framework
• Integrate with CI/CD
• Setup a device & browser lab
AUTHOR
• Add new tests for new features
• Adapt existing tests to app changes
• Is coverage adequate?
EXECUTE
• Devices & browsers
• Speed
• Stability
ANALYZE
• Analyze test results
• Triage & report issues
• Generate quality reports
Architect
DevOps
Dev
Quality lead
Dev
Dev
DevOps
5
What’s wrong with the traditional
approach to automation?
6
Requirement: show missing credentials errors
7
A traditional E2E test
8
A traditional E2E test
Need to write a lot of
code
Very limited coverage
Code will break when
the UI changes
9
When the UI changes…
10
Low coverage: unexpected visual bugs
A visual bug
11
Low coverage: unexpected functional bugs
A functional bug
12
Most test automation projects fail
13
Is the goal of autonomous testing to
eliminate the human factor?
14
Is the goal of autonomous testing to
eliminate the human factor?
15
AI can’t replace the QA practitioner
• Not accurate enough to be trusted blindly
• Requires adjustment and feedback
• Quality issues are often subjective
• Limited perspective
• Limited scope
16
GenAI has lowered the bar for producing software at scale
What impact do you think this will have on software quality?
17
The goal of autonomous testing is to make
automation at scale accessible effortlessly to all
18
Automation at scale accessible effortlessly to all!
Attain near complete
test coverage
From below 20% to 80% or more
Catch unexpected defects
Lower the required
skill set
From dev to quality
Drastically reduce
human involvement
From total involvement to review
findings and filling coverage gaps
19
How can it be done?
20
We need to eliminate all this code
21
We need to eliminate all this code
Navigation
22
We need to eliminate all this code
Interaction
23
We need to eliminate all this code
Validation
24
Applitools VisualAI assisted validations
25
26
27
28
VisualAI advantages
• Enhance existing tests and reduce the
amount of test code by up to 80%
• A single visual checkpoint for complete
visual and functional coverage
• Catch unexpected defects
• Do not break when the UI changes
• No coding skills required to maintain
validation logic
29
VisualAI eliminates validation code
and catches unexpected defects
30
The Applitools intelligent testing platform
31
The Applitools intelligent testing platform
32
32
AUTHOR
Record live interactions with a powerful web recorder to build
complex end-to-end tests without coding
UI RECORDER
Automatically discover new, missing, faulty or changed pages
and components on your website or web app on every run.
AUTONOMOUS DISCOVERY
Describe complex custom end-to-end flows using nothing more
than plain English: interactions, assertions, API calls, etc.
NLP BUILDER
Integrate Visual AI with your favorite open-source testing
frameworks
FRAMEWORK SDKs
Reduce the time it takes to author automated tests
33
Validate entire pages with hundreds of elements across
different browsers instantly with a single line of code
INCREASE COVERAGE
Easily test dynamic and frequently changing pages
without having to rewrite and maintain tests
DYNAMIC CONTENT
VALIDATE
Increase test coverage with AI assertions
Validate any UI technology: web, native mobile,
hybrid, desktop, PDF documents, design images, etc.
ANY UI TECHNOLOGY
34
EXECUTE
Increase release velocity with faster, resilient tests
Run tests in parallel at massive scale on ultrafast test
infrastructure in the cloud
FAST INFRASTRUCTURE
Automatically heal element locators that break your
tests even for the smallest UI change
SELF-HEALING TESTS
Run tests on demand, from your CI/CD, a webhook, or
use our built-in test scheduler
FLEXIBLE ORCHESTRATION
35
ANALYZE
Get deep insights into every test run
Get comprehensive reports and insights for all your test
runs and easily search and filter test results
INSIGHTFUL REPORTS
Quickly surface code changes underlying UI changes with
Root Cause Analysis
PINPOINT WHAT WENT WRONG
Leverage AI to avoid repetitive test maintenance activities
and to group together similar UI changes and issues
AUTOMATED TEST MAINTENANCE
36
• Collaboration tools
• Bug trackers
• CI / CD
• Source control
• APIs
INTEGRATE
Integrate with everything
37
Autonomous
Autonomous testing for websites and multi-page web apps
37
38
Autonomous
Autonomous testing for websites and multi-page web apps
Easy one click
setup
Just point Autonomous at your
website and you are done.
Everything you need is available
out of the box.
Automatic website /
app discovery
Automatically create self-adjusting
test suites that detect new,
missing, changed or faulty pages
and components on every run
Natural language
test builder
Describe complex end-to-end flows
using nothing more than plain English.
No coding or element locating skills
required
Flexible test
orchestration
Run tests on demand, from your
CI/CD, a webhook, or use our
built-in test scheduler. No DevOps
skills required
Self-heal broken locators, avoid
repetitive maintenance activities
and group together similar UI
changes and issues
AI assisted test
maintenance
Cross device and
browser testing
Test your public and internal apps on
any device, browser and OS using
the world’s most modern test
infrastructure available out of the box
39
DEMO
39
40
The world’s most intelligent testing platform
Automated test maintenance
Employs DNNs to find similar
differences across different OS,
devices and browsers (e.g.,
different fonts).
Self healing element locators
Employs algorithms and ML to find
UI elements with broken locators
based on previous successful test
runs.
Automated test data generation
Employs DNNs to detect input
forms in apps and the data types
of their fields to facilitate proper
test data generation.
Automatic test suite creation
Employs Generative AI algorithms
to generate entire test suites for
websites and multi-page web
applications.
Author tests in plain English
Employs LLMs for language
understanding and for translating
business level test instructions to
detailed UI interactions.
VisualAI: human vision modeling
Employs dozens of algorithms,
and DNNs to model color
similarity, text vs image, picture vs
graphics, pattern detection, etc.
* ML – Machine Learning, DNN – Deep Neural Network, LLM – Large Language Model
41
Thank you!

More Related Content

Similar to A Test Automation Platform Designed for the Future

Top 5 Features To Look for in a Codeless Automation Solution -- Presentation ...
Top 5 Features To Look for in a Codeless Automation Solution -- Presentation ...Top 5 Features To Look for in a Codeless Automation Solution -- Presentation ...
Top 5 Features To Look for in a Codeless Automation Solution -- Presentation ...Applitools
 
Top 5 automation testing tools to gear up website development
Top 5 automation testing tools to gear up website developmentTop 5 automation testing tools to gear up website development
Top 5 automation testing tools to gear up website developmentBJIT Ltd
 
Top Automated UI Testing Tools 2023.pdf
Top Automated UI Testing Tools 2023.pdfTop Automated UI Testing Tools 2023.pdf
Top Automated UI Testing Tools 2023.pdfpcloudy2
 
Automated Generation, Evolution and Maintenance: a perspective for mobile GUI...
Automated Generation, Evolution and Maintenance: a perspective for mobile GUI...Automated Generation, Evolution and Maintenance: a perspective for mobile GUI...
Automated Generation, Evolution and Maintenance: a perspective for mobile GUI...Riccardo Coppola
 
Applitools Framework
Applitools  FrameworkApplitools  Framework
Applitools FrameworkApplitools
 
Advanced Codeless Testing for Web Apps
Advanced Codeless Testing for Web AppsAdvanced Codeless Testing for Web Apps
Advanced Codeless Testing for Web AppsPerfecto by Perforce
 
App Days 2016 Munich - Mobile Applications testing by Leaware
App Days 2016 Munich - Mobile Applications testing by LeawareApp Days 2016 Munich - Mobile Applications testing by Leaware
App Days 2016 Munich - Mobile Applications testing by LeawareLeaware.com
 
Live Webinar- Making Test Automation 10x Faster for Continuous Delivery- By R...
Live Webinar- Making Test Automation 10x Faster for Continuous Delivery- By R...Live Webinar- Making Test Automation 10x Faster for Continuous Delivery- By R...
Live Webinar- Making Test Automation 10x Faster for Continuous Delivery- By R...RapidValue
 
UiPath Amsterdam DEV meet-up For Developers, By Developers
UiPath Amsterdam DEV meet-up For Developers, By DevelopersUiPath Amsterdam DEV meet-up For Developers, By Developers
UiPath Amsterdam DEV meet-up For Developers, By DevelopersCristina Vidu
 
Automation Testing with Test Complete
Automation Testing with Test CompleteAutomation Testing with Test Complete
Automation Testing with Test CompleteVartika Saxena
 
Next Generation Functional & Visual Testing powered by AI
Next Generation Functional & Visual Testing powered by AINext Generation Functional & Visual Testing powered by AI
Next Generation Functional & Visual Testing powered by AIAnand Bagmar
 
Visual Studio 2015 / Visual Studio Team Services Overview
Visual Studio 2015 / Visual Studio Team Services OverviewVisual Studio 2015 / Visual Studio Team Services Overview
Visual Studio 2015 / Visual Studio Team Services OverviewHimanshu Desai
 
Applitools Visual AI Overview.pdf
Applitools Visual AI Overview.pdfApplitools Visual AI Overview.pdf
Applitools Visual AI Overview.pdfApplitools
 
Udvid din test portefølje med coded ui test og cloud load test
Udvid din test portefølje med coded ui test og cloud load testUdvid din test portefølje med coded ui test og cloud load test
Udvid din test portefølje med coded ui test og cloud load testPeter Lindberg
 
Managing Continuous Delivery of Mobile Apps - for the Enterprise
Managing Continuous Delivery of Mobile Apps - for the EnterpriseManaging Continuous Delivery of Mobile Apps - for the Enterprise
Managing Continuous Delivery of Mobile Apps - for the EnterpriseSauce Labs
 
Top 20 best automation testing tools
Top 20 best automation testing toolsTop 20 best automation testing tools
Top 20 best automation testing toolsQACraft
 
Getting Started With QA Automation
Getting Started With QA AutomationGetting Started With QA Automation
Getting Started With QA AutomationGiovanni Scerra ☃
 
Scriptless Test Automation Framework: Tools And Examples
Scriptless Test Automation Framework: Tools And ExamplesScriptless Test Automation Framework: Tools And Examples
Scriptless Test Automation Framework: Tools And ExamplesSerena Gray
 
Microsoft Testing Tour - Functional and Automated Testing
Microsoft Testing Tour - Functional and Automated TestingMicrosoft Testing Tour - Functional and Automated Testing
Microsoft Testing Tour - Functional and Automated TestingAngela Dugan
 
Decoding Appium No-Code Test Automation With HeadSpin.pdf
Decoding Appium No-Code Test Automation With HeadSpin.pdfDecoding Appium No-Code Test Automation With HeadSpin.pdf
Decoding Appium No-Code Test Automation With HeadSpin.pdfkalichargn70th171
 

Similar to A Test Automation Platform Designed for the Future (20)

Top 5 Features To Look for in a Codeless Automation Solution -- Presentation ...
Top 5 Features To Look for in a Codeless Automation Solution -- Presentation ...Top 5 Features To Look for in a Codeless Automation Solution -- Presentation ...
Top 5 Features To Look for in a Codeless Automation Solution -- Presentation ...
 
Top 5 automation testing tools to gear up website development
Top 5 automation testing tools to gear up website developmentTop 5 automation testing tools to gear up website development
Top 5 automation testing tools to gear up website development
 
Top Automated UI Testing Tools 2023.pdf
Top Automated UI Testing Tools 2023.pdfTop Automated UI Testing Tools 2023.pdf
Top Automated UI Testing Tools 2023.pdf
 
Automated Generation, Evolution and Maintenance: a perspective for mobile GUI...
Automated Generation, Evolution and Maintenance: a perspective for mobile GUI...Automated Generation, Evolution and Maintenance: a perspective for mobile GUI...
Automated Generation, Evolution and Maintenance: a perspective for mobile GUI...
 
Applitools Framework
Applitools  FrameworkApplitools  Framework
Applitools Framework
 
Advanced Codeless Testing for Web Apps
Advanced Codeless Testing for Web AppsAdvanced Codeless Testing for Web Apps
Advanced Codeless Testing for Web Apps
 
App Days 2016 Munich - Mobile Applications testing by Leaware
App Days 2016 Munich - Mobile Applications testing by LeawareApp Days 2016 Munich - Mobile Applications testing by Leaware
App Days 2016 Munich - Mobile Applications testing by Leaware
 
Live Webinar- Making Test Automation 10x Faster for Continuous Delivery- By R...
Live Webinar- Making Test Automation 10x Faster for Continuous Delivery- By R...Live Webinar- Making Test Automation 10x Faster for Continuous Delivery- By R...
Live Webinar- Making Test Automation 10x Faster for Continuous Delivery- By R...
 
UiPath Amsterdam DEV meet-up For Developers, By Developers
UiPath Amsterdam DEV meet-up For Developers, By DevelopersUiPath Amsterdam DEV meet-up For Developers, By Developers
UiPath Amsterdam DEV meet-up For Developers, By Developers
 
Automation Testing with Test Complete
Automation Testing with Test CompleteAutomation Testing with Test Complete
Automation Testing with Test Complete
 
Next Generation Functional & Visual Testing powered by AI
Next Generation Functional & Visual Testing powered by AINext Generation Functional & Visual Testing powered by AI
Next Generation Functional & Visual Testing powered by AI
 
Visual Studio 2015 / Visual Studio Team Services Overview
Visual Studio 2015 / Visual Studio Team Services OverviewVisual Studio 2015 / Visual Studio Team Services Overview
Visual Studio 2015 / Visual Studio Team Services Overview
 
Applitools Visual AI Overview.pdf
Applitools Visual AI Overview.pdfApplitools Visual AI Overview.pdf
Applitools Visual AI Overview.pdf
 
Udvid din test portefølje med coded ui test og cloud load test
Udvid din test portefølje med coded ui test og cloud load testUdvid din test portefølje med coded ui test og cloud load test
Udvid din test portefølje med coded ui test og cloud load test
 
Managing Continuous Delivery of Mobile Apps - for the Enterprise
Managing Continuous Delivery of Mobile Apps - for the EnterpriseManaging Continuous Delivery of Mobile Apps - for the Enterprise
Managing Continuous Delivery of Mobile Apps - for the Enterprise
 
Top 20 best automation testing tools
Top 20 best automation testing toolsTop 20 best automation testing tools
Top 20 best automation testing tools
 
Getting Started With QA Automation
Getting Started With QA AutomationGetting Started With QA Automation
Getting Started With QA Automation
 
Scriptless Test Automation Framework: Tools And Examples
Scriptless Test Automation Framework: Tools And ExamplesScriptless Test Automation Framework: Tools And Examples
Scriptless Test Automation Framework: Tools And Examples
 
Microsoft Testing Tour - Functional and Automated Testing
Microsoft Testing Tour - Functional and Automated TestingMicrosoft Testing Tour - Functional and Automated Testing
Microsoft Testing Tour - Functional and Automated Testing
 
Decoding Appium No-Code Test Automation With HeadSpin.pdf
Decoding Appium No-Code Test Automation With HeadSpin.pdfDecoding Appium No-Code Test Automation With HeadSpin.pdf
Decoding Appium No-Code Test Automation With HeadSpin.pdf
 

More from Applitools

Streamlining Your Tech Stack: A Blueprint for Enhanced Efficiency and Coverag...
Streamlining Your Tech Stack: A Blueprint for Enhanced Efficiency and Coverag...Streamlining Your Tech Stack: A Blueprint for Enhanced Efficiency and Coverag...
Streamlining Your Tech Stack: A Blueprint for Enhanced Efficiency and Coverag...Applitools
 
Visual AI for eCommerce: Improving Conversions with a Flawless UI
Visual AI for eCommerce: Improving Conversions with a Flawless UIVisual AI for eCommerce: Improving Conversions with a Flawless UI
Visual AI for eCommerce: Improving Conversions with a Flawless UIApplitools
 
Add AI to Your SDLC, presented by Applitools and Curiosity
Add AI to Your SDLC, presented by Applitools and CuriosityAdd AI to Your SDLC, presented by Applitools and Curiosity
Add AI to Your SDLC, presented by Applitools and CuriosityApplitools
 
The Future of AI-Based Test Automation
The Future of AI-Based Test AutomationThe Future of AI-Based Test Automation
The Future of AI-Based Test AutomationApplitools
 
Test Automation at Scale: Lessons from Top-Performing Distributed Teams
Test Automation at Scale: Lessons from Top-Performing Distributed TeamsTest Automation at Scale: Lessons from Top-Performing Distributed Teams
Test Automation at Scale: Lessons from Top-Performing Distributed TeamsApplitools
 
Can AI Autogenerate and Run Automated Tests?
Can AI Autogenerate and Run Automated Tests?Can AI Autogenerate and Run Automated Tests?
Can AI Autogenerate and Run Automated Tests?Applitools
 
Navigating the Challenges of Testing at Scale: Lessons from Top-Performing Teams
Navigating the Challenges of Testing at Scale: Lessons from Top-Performing TeamsNavigating the Challenges of Testing at Scale: Lessons from Top-Performing Teams
Navigating the Challenges of Testing at Scale: Lessons from Top-Performing TeamsApplitools
 
Introducing the Applitools Self Healing Execution Cloud.pdf
Introducing the Applitools Self Healing Execution Cloud.pdfIntroducing the Applitools Self Healing Execution Cloud.pdf
Introducing the Applitools Self Healing Execution Cloud.pdfApplitools
 
Unlocking the Power of ChatGPT and AI in Testing - NextSteps, presented by Ap...
Unlocking the Power of ChatGPT and AI in Testing - NextSteps, presented by Ap...Unlocking the Power of ChatGPT and AI in Testing - NextSteps, presented by Ap...
Unlocking the Power of ChatGPT and AI in Testing - NextSteps, presented by Ap...Applitools
 
Collaborating From Design To Experience: Introducing Centra
Collaborating From Design To Experience: Introducing CentraCollaborating From Design To Experience: Introducing Centra
Collaborating From Design To Experience: Introducing CentraApplitools
 
What the QA Position Will Look Like in the Future
What the QA Position Will Look Like in the FutureWhat the QA Position Will Look Like in the Future
What the QA Position Will Look Like in the FutureApplitools
 
Getting Started with Visual Testing
Getting Started with Visual TestingGetting Started with Visual Testing
Getting Started with Visual TestingApplitools
 
Workshop: Head-to-Head Web Testing: Part 1 with Cypress
Workshop: Head-to-Head Web Testing: Part 1 with CypressWorkshop: Head-to-Head Web Testing: Part 1 with Cypress
Workshop: Head-to-Head Web Testing: Part 1 with CypressApplitools
 
From Washing Cars To Automating Test Applications
From Washing Cars To Automating Test ApplicationsFrom Washing Cars To Automating Test Applications
From Washing Cars To Automating Test ApplicationsApplitools
 
A Holistic Approach to Testing in Continuous Delivery
A Holistic Approach to Testing in Continuous DeliveryA Holistic Approach to Testing in Continuous Delivery
A Holistic Approach to Testing in Continuous DeliveryApplitools
 
AI-Powered-Cross-Browser Testing
AI-Powered-Cross-Browser TestingAI-Powered-Cross-Browser Testing
AI-Powered-Cross-Browser TestingApplitools
 
Workshop: An Introduction to API Automation with Javascript
Workshop: An Introduction to API Automation with JavascriptWorkshop: An Introduction to API Automation with Javascript
Workshop: An Introduction to API Automation with JavascriptApplitools
 
Workshop: Introduction to Performance and Load Testing with k6
Workshop: Introduction to Performance and Load Testing with k6Workshop: Introduction to Performance and Load Testing with k6
Workshop: Introduction to Performance and Load Testing with k6Applitools
 
The Role of Automation in Mobile Continuous Testing
The Role of Automation in Mobile Continuous TestingThe Role of Automation in Mobile Continuous Testing
The Role of Automation in Mobile Continuous TestingApplitools
 
Unlocking the Power of ChatGPT and AI in Testing - A Real-World Look, present...
Unlocking the Power of ChatGPT and AI in Testing - A Real-World Look, present...Unlocking the Power of ChatGPT and AI in Testing - A Real-World Look, present...
Unlocking the Power of ChatGPT and AI in Testing - A Real-World Look, present...Applitools
 

More from Applitools (20)

Streamlining Your Tech Stack: A Blueprint for Enhanced Efficiency and Coverag...
Streamlining Your Tech Stack: A Blueprint for Enhanced Efficiency and Coverag...Streamlining Your Tech Stack: A Blueprint for Enhanced Efficiency and Coverag...
Streamlining Your Tech Stack: A Blueprint for Enhanced Efficiency and Coverag...
 
Visual AI for eCommerce: Improving Conversions with a Flawless UI
Visual AI for eCommerce: Improving Conversions with a Flawless UIVisual AI for eCommerce: Improving Conversions with a Flawless UI
Visual AI for eCommerce: Improving Conversions with a Flawless UI
 
Add AI to Your SDLC, presented by Applitools and Curiosity
Add AI to Your SDLC, presented by Applitools and CuriosityAdd AI to Your SDLC, presented by Applitools and Curiosity
Add AI to Your SDLC, presented by Applitools and Curiosity
 
The Future of AI-Based Test Automation
The Future of AI-Based Test AutomationThe Future of AI-Based Test Automation
The Future of AI-Based Test Automation
 
Test Automation at Scale: Lessons from Top-Performing Distributed Teams
Test Automation at Scale: Lessons from Top-Performing Distributed TeamsTest Automation at Scale: Lessons from Top-Performing Distributed Teams
Test Automation at Scale: Lessons from Top-Performing Distributed Teams
 
Can AI Autogenerate and Run Automated Tests?
Can AI Autogenerate and Run Automated Tests?Can AI Autogenerate and Run Automated Tests?
Can AI Autogenerate and Run Automated Tests?
 
Navigating the Challenges of Testing at Scale: Lessons from Top-Performing Teams
Navigating the Challenges of Testing at Scale: Lessons from Top-Performing TeamsNavigating the Challenges of Testing at Scale: Lessons from Top-Performing Teams
Navigating the Challenges of Testing at Scale: Lessons from Top-Performing Teams
 
Introducing the Applitools Self Healing Execution Cloud.pdf
Introducing the Applitools Self Healing Execution Cloud.pdfIntroducing the Applitools Self Healing Execution Cloud.pdf
Introducing the Applitools Self Healing Execution Cloud.pdf
 
Unlocking the Power of ChatGPT and AI in Testing - NextSteps, presented by Ap...
Unlocking the Power of ChatGPT and AI in Testing - NextSteps, presented by Ap...Unlocking the Power of ChatGPT and AI in Testing - NextSteps, presented by Ap...
Unlocking the Power of ChatGPT and AI in Testing - NextSteps, presented by Ap...
 
Collaborating From Design To Experience: Introducing Centra
Collaborating From Design To Experience: Introducing CentraCollaborating From Design To Experience: Introducing Centra
Collaborating From Design To Experience: Introducing Centra
 
What the QA Position Will Look Like in the Future
What the QA Position Will Look Like in the FutureWhat the QA Position Will Look Like in the Future
What the QA Position Will Look Like in the Future
 
Getting Started with Visual Testing
Getting Started with Visual TestingGetting Started with Visual Testing
Getting Started with Visual Testing
 
Workshop: Head-to-Head Web Testing: Part 1 with Cypress
Workshop: Head-to-Head Web Testing: Part 1 with CypressWorkshop: Head-to-Head Web Testing: Part 1 with Cypress
Workshop: Head-to-Head Web Testing: Part 1 with Cypress
 
From Washing Cars To Automating Test Applications
From Washing Cars To Automating Test ApplicationsFrom Washing Cars To Automating Test Applications
From Washing Cars To Automating Test Applications
 
A Holistic Approach to Testing in Continuous Delivery
A Holistic Approach to Testing in Continuous DeliveryA Holistic Approach to Testing in Continuous Delivery
A Holistic Approach to Testing in Continuous Delivery
 
AI-Powered-Cross-Browser Testing
AI-Powered-Cross-Browser TestingAI-Powered-Cross-Browser Testing
AI-Powered-Cross-Browser Testing
 
Workshop: An Introduction to API Automation with Javascript
Workshop: An Introduction to API Automation with JavascriptWorkshop: An Introduction to API Automation with Javascript
Workshop: An Introduction to API Automation with Javascript
 
Workshop: Introduction to Performance and Load Testing with k6
Workshop: Introduction to Performance and Load Testing with k6Workshop: Introduction to Performance and Load Testing with k6
Workshop: Introduction to Performance and Load Testing with k6
 
The Role of Automation in Mobile Continuous Testing
The Role of Automation in Mobile Continuous TestingThe Role of Automation in Mobile Continuous Testing
The Role of Automation in Mobile Continuous Testing
 
Unlocking the Power of ChatGPT and AI in Testing - A Real-World Look, present...
Unlocking the Power of ChatGPT and AI in Testing - A Real-World Look, present...Unlocking the Power of ChatGPT and AI in Testing - A Real-World Look, present...
Unlocking the Power of ChatGPT and AI in Testing - A Real-World Look, present...
 

Recently uploaded

SuccessFactors 1H 2024 Release - Sneak-Peek by Deloitte Germany
SuccessFactors 1H 2024 Release - Sneak-Peek by Deloitte GermanySuccessFactors 1H 2024 Release - Sneak-Peek by Deloitte Germany
SuccessFactors 1H 2024 Release - Sneak-Peek by Deloitte GermanyChristoph Pohl
 
chapter--4-software-project-planning.ppt
chapter--4-software-project-planning.pptchapter--4-software-project-planning.ppt
chapter--4-software-project-planning.pptkotipi9215
 
What are the key points to focus on before starting to learn ETL Development....
What are the key points to focus on before starting to learn ETL Development....What are the key points to focus on before starting to learn ETL Development....
What are the key points to focus on before starting to learn ETL Development....kzayra69
 
MYjobs Presentation Django-based project
MYjobs Presentation Django-based projectMYjobs Presentation Django-based project
MYjobs Presentation Django-based projectAnoyGreter
 
React Server Component in Next.js by Hanief Utama
React Server Component in Next.js by Hanief UtamaReact Server Component in Next.js by Hanief Utama
React Server Component in Next.js by Hanief UtamaHanief Utama
 
Unveiling Design Patterns: A Visual Guide with UML Diagrams
Unveiling Design Patterns: A Visual Guide with UML DiagramsUnveiling Design Patterns: A Visual Guide with UML Diagrams
Unveiling Design Patterns: A Visual Guide with UML DiagramsAhmed Mohamed
 
(Genuine) Escort Service Lucknow | Starting ₹,5K To @25k with A/C 🧑🏽‍❤️‍🧑🏻 89...
(Genuine) Escort Service Lucknow | Starting ₹,5K To @25k with A/C 🧑🏽‍❤️‍🧑🏻 89...(Genuine) Escort Service Lucknow | Starting ₹,5K To @25k with A/C 🧑🏽‍❤️‍🧑🏻 89...
(Genuine) Escort Service Lucknow | Starting ₹,5K To @25k with A/C 🧑🏽‍❤️‍🧑🏻 89...gurkirankumar98700
 
Software Project Health Check: Best Practices and Techniques for Your Product...
Software Project Health Check: Best Practices and Techniques for Your Product...Software Project Health Check: Best Practices and Techniques for Your Product...
Software Project Health Check: Best Practices and Techniques for Your Product...Velvetech LLC
 
What is Fashion PLM and Why Do You Need It
What is Fashion PLM and Why Do You Need ItWhat is Fashion PLM and Why Do You Need It
What is Fashion PLM and Why Do You Need ItWave PLM
 
Building a General PDE Solving Framework with Symbolic-Numeric Scientific Mac...
Building a General PDE Solving Framework with Symbolic-Numeric Scientific Mac...Building a General PDE Solving Framework with Symbolic-Numeric Scientific Mac...
Building a General PDE Solving Framework with Symbolic-Numeric Scientific Mac...stazi3110
 
Dealing with Cultural Dispersion — Stefano Lambiase — ICSE-SEIS 2024
Dealing with Cultural Dispersion — Stefano Lambiase — ICSE-SEIS 2024Dealing with Cultural Dispersion — Stefano Lambiase — ICSE-SEIS 2024
Dealing with Cultural Dispersion — Stefano Lambiase — ICSE-SEIS 2024StefanoLambiase
 
Unveiling the Future: Sylius 2.0 New Features
Unveiling the Future: Sylius 2.0 New FeaturesUnveiling the Future: Sylius 2.0 New Features
Unveiling the Future: Sylius 2.0 New FeaturesŁukasz Chruściel
 
KnowAPIs-UnknownPerf-jaxMainz-2024 (1).pptx
KnowAPIs-UnknownPerf-jaxMainz-2024 (1).pptxKnowAPIs-UnknownPerf-jaxMainz-2024 (1).pptx
KnowAPIs-UnknownPerf-jaxMainz-2024 (1).pptxTier1 app
 
Implementing Zero Trust strategy with Azure
Implementing Zero Trust strategy with AzureImplementing Zero Trust strategy with Azure
Implementing Zero Trust strategy with AzureDinusha Kumarasiri
 
GOING AOT WITH GRAALVM – DEVOXX GREECE.pdf
GOING AOT WITH GRAALVM – DEVOXX GREECE.pdfGOING AOT WITH GRAALVM – DEVOXX GREECE.pdf
GOING AOT WITH GRAALVM – DEVOXX GREECE.pdfAlina Yurenko
 
EY_Graph Database Powered Sustainability
EY_Graph Database Powered SustainabilityEY_Graph Database Powered Sustainability
EY_Graph Database Powered SustainabilityNeo4j
 
Maximizing Efficiency and Profitability with OnePlan’s Professional Service A...
Maximizing Efficiency and Profitability with OnePlan’s Professional Service A...Maximizing Efficiency and Profitability with OnePlan’s Professional Service A...
Maximizing Efficiency and Profitability with OnePlan’s Professional Service A...OnePlan Solutions
 
Advancing Engineering with AI through the Next Generation of Strategic Projec...
Advancing Engineering with AI through the Next Generation of Strategic Projec...Advancing Engineering with AI through the Next Generation of Strategic Projec...
Advancing Engineering with AI through the Next Generation of Strategic Projec...OnePlan Solutions
 
Alluxio Monthly Webinar | Cloud-Native Model Training on Distributed Data
Alluxio Monthly Webinar | Cloud-Native Model Training on Distributed DataAlluxio Monthly Webinar | Cloud-Native Model Training on Distributed Data
Alluxio Monthly Webinar | Cloud-Native Model Training on Distributed DataAlluxio, Inc.
 
Adobe Marketo Engage Deep Dives: Using Webhooks to Transfer Data
Adobe Marketo Engage Deep Dives: Using Webhooks to Transfer DataAdobe Marketo Engage Deep Dives: Using Webhooks to Transfer Data
Adobe Marketo Engage Deep Dives: Using Webhooks to Transfer DataBradBedford3
 

Recently uploaded (20)

SuccessFactors 1H 2024 Release - Sneak-Peek by Deloitte Germany
SuccessFactors 1H 2024 Release - Sneak-Peek by Deloitte GermanySuccessFactors 1H 2024 Release - Sneak-Peek by Deloitte Germany
SuccessFactors 1H 2024 Release - Sneak-Peek by Deloitte Germany
 
chapter--4-software-project-planning.ppt
chapter--4-software-project-planning.pptchapter--4-software-project-planning.ppt
chapter--4-software-project-planning.ppt
 
What are the key points to focus on before starting to learn ETL Development....
What are the key points to focus on before starting to learn ETL Development....What are the key points to focus on before starting to learn ETL Development....
What are the key points to focus on before starting to learn ETL Development....
 
MYjobs Presentation Django-based project
MYjobs Presentation Django-based projectMYjobs Presentation Django-based project
MYjobs Presentation Django-based project
 
React Server Component in Next.js by Hanief Utama
React Server Component in Next.js by Hanief UtamaReact Server Component in Next.js by Hanief Utama
React Server Component in Next.js by Hanief Utama
 
Unveiling Design Patterns: A Visual Guide with UML Diagrams
Unveiling Design Patterns: A Visual Guide with UML DiagramsUnveiling Design Patterns: A Visual Guide with UML Diagrams
Unveiling Design Patterns: A Visual Guide with UML Diagrams
 
(Genuine) Escort Service Lucknow | Starting ₹,5K To @25k with A/C 🧑🏽‍❤️‍🧑🏻 89...
(Genuine) Escort Service Lucknow | Starting ₹,5K To @25k with A/C 🧑🏽‍❤️‍🧑🏻 89...(Genuine) Escort Service Lucknow | Starting ₹,5K To @25k with A/C 🧑🏽‍❤️‍🧑🏻 89...
(Genuine) Escort Service Lucknow | Starting ₹,5K To @25k with A/C 🧑🏽‍❤️‍🧑🏻 89...
 
Software Project Health Check: Best Practices and Techniques for Your Product...
Software Project Health Check: Best Practices and Techniques for Your Product...Software Project Health Check: Best Practices and Techniques for Your Product...
Software Project Health Check: Best Practices and Techniques for Your Product...
 
What is Fashion PLM and Why Do You Need It
What is Fashion PLM and Why Do You Need ItWhat is Fashion PLM and Why Do You Need It
What is Fashion PLM and Why Do You Need It
 
Building a General PDE Solving Framework with Symbolic-Numeric Scientific Mac...
Building a General PDE Solving Framework with Symbolic-Numeric Scientific Mac...Building a General PDE Solving Framework with Symbolic-Numeric Scientific Mac...
Building a General PDE Solving Framework with Symbolic-Numeric Scientific Mac...
 
Dealing with Cultural Dispersion — Stefano Lambiase — ICSE-SEIS 2024
Dealing with Cultural Dispersion — Stefano Lambiase — ICSE-SEIS 2024Dealing with Cultural Dispersion — Stefano Lambiase — ICSE-SEIS 2024
Dealing with Cultural Dispersion — Stefano Lambiase — ICSE-SEIS 2024
 
Unveiling the Future: Sylius 2.0 New Features
Unveiling the Future: Sylius 2.0 New FeaturesUnveiling the Future: Sylius 2.0 New Features
Unveiling the Future: Sylius 2.0 New Features
 
KnowAPIs-UnknownPerf-jaxMainz-2024 (1).pptx
KnowAPIs-UnknownPerf-jaxMainz-2024 (1).pptxKnowAPIs-UnknownPerf-jaxMainz-2024 (1).pptx
KnowAPIs-UnknownPerf-jaxMainz-2024 (1).pptx
 
Implementing Zero Trust strategy with Azure
Implementing Zero Trust strategy with AzureImplementing Zero Trust strategy with Azure
Implementing Zero Trust strategy with Azure
 
GOING AOT WITH GRAALVM – DEVOXX GREECE.pdf
GOING AOT WITH GRAALVM – DEVOXX GREECE.pdfGOING AOT WITH GRAALVM – DEVOXX GREECE.pdf
GOING AOT WITH GRAALVM – DEVOXX GREECE.pdf
 
EY_Graph Database Powered Sustainability
EY_Graph Database Powered SustainabilityEY_Graph Database Powered Sustainability
EY_Graph Database Powered Sustainability
 
Maximizing Efficiency and Profitability with OnePlan’s Professional Service A...
Maximizing Efficiency and Profitability with OnePlan’s Professional Service A...Maximizing Efficiency and Profitability with OnePlan’s Professional Service A...
Maximizing Efficiency and Profitability with OnePlan’s Professional Service A...
 
Advancing Engineering with AI through the Next Generation of Strategic Projec...
Advancing Engineering with AI through the Next Generation of Strategic Projec...Advancing Engineering with AI through the Next Generation of Strategic Projec...
Advancing Engineering with AI through the Next Generation of Strategic Projec...
 
Alluxio Monthly Webinar | Cloud-Native Model Training on Distributed Data
Alluxio Monthly Webinar | Cloud-Native Model Training on Distributed DataAlluxio Monthly Webinar | Cloud-Native Model Training on Distributed Data
Alluxio Monthly Webinar | Cloud-Native Model Training on Distributed Data
 
Adobe Marketo Engage Deep Dives: Using Webhooks to Transfer Data
Adobe Marketo Engage Deep Dives: Using Webhooks to Transfer DataAdobe Marketo Engage Deep Dives: Using Webhooks to Transfer Data
Adobe Marketo Engage Deep Dives: Using Webhooks to Transfer Data
 

A Test Automation Platform Designed for the Future

  • 1. 1 A Test Automation Platform Designed for the Future Introducing Autonomous and the Applitools Intelligent Testing Platform 1 AI-Powered Testing & Monitoring Feb 2024
  • 2. 2 Agenda • Why autonomous testing? • The goal of autonomous testing • How can it be done? • The Applitools intelligent testing platform • Introducing Autonomous • Q&A
  • 4. 4 The test automation lifecycle SETUP • Build a test automation framework • Integrate with CI/CD • Setup a device & browser lab AUTHOR • Add new tests for new features • Adapt existing tests to app changes • Is coverage adequate? EXECUTE • Devices & browsers • Speed • Stability ANALYZE • Analyze test results • Triage & report issues • Generate quality reports Architect DevOps Dev Quality lead Dev Dev DevOps
  • 5. 5 What’s wrong with the traditional approach to automation?
  • 6. 6 Requirement: show missing credentials errors
  • 8. 8 A traditional E2E test Need to write a lot of code Very limited coverage Code will break when the UI changes
  • 9. 9 When the UI changes…
  • 10. 10 Low coverage: unexpected visual bugs A visual bug
  • 11. 11 Low coverage: unexpected functional bugs A functional bug
  • 12. 12 Most test automation projects fail
  • 13. 13 Is the goal of autonomous testing to eliminate the human factor?
  • 14. 14 Is the goal of autonomous testing to eliminate the human factor?
  • 15. 15 AI can’t replace the QA practitioner • Not accurate enough to be trusted blindly • Requires adjustment and feedback • Quality issues are often subjective • Limited perspective • Limited scope
  • 16. 16 GenAI has lowered the bar for producing software at scale What impact do you think this will have on software quality?
  • 17. 17 The goal of autonomous testing is to make automation at scale accessible effortlessly to all
  • 18. 18 Automation at scale accessible effortlessly to all! Attain near complete test coverage From below 20% to 80% or more Catch unexpected defects Lower the required skill set From dev to quality Drastically reduce human involvement From total involvement to review findings and filling coverage gaps
  • 19. 19 How can it be done?
  • 20. 20 We need to eliminate all this code
  • 21. 21 We need to eliminate all this code Navigation
  • 22. 22 We need to eliminate all this code Interaction
  • 23. 23 We need to eliminate all this code Validation
  • 25. 25
  • 26. 26
  • 27. 27
  • 28. 28 VisualAI advantages • Enhance existing tests and reduce the amount of test code by up to 80% • A single visual checkpoint for complete visual and functional coverage • Catch unexpected defects • Do not break when the UI changes • No coding skills required to maintain validation logic
  • 29. 29 VisualAI eliminates validation code and catches unexpected defects
  • 30. 30 The Applitools intelligent testing platform
  • 31. 31 The Applitools intelligent testing platform
  • 32. 32 32 AUTHOR Record live interactions with a powerful web recorder to build complex end-to-end tests without coding UI RECORDER Automatically discover new, missing, faulty or changed pages and components on your website or web app on every run. AUTONOMOUS DISCOVERY Describe complex custom end-to-end flows using nothing more than plain English: interactions, assertions, API calls, etc. NLP BUILDER Integrate Visual AI with your favorite open-source testing frameworks FRAMEWORK SDKs Reduce the time it takes to author automated tests
  • 33. 33 Validate entire pages with hundreds of elements across different browsers instantly with a single line of code INCREASE COVERAGE Easily test dynamic and frequently changing pages without having to rewrite and maintain tests DYNAMIC CONTENT VALIDATE Increase test coverage with AI assertions Validate any UI technology: web, native mobile, hybrid, desktop, PDF documents, design images, etc. ANY UI TECHNOLOGY
  • 34. 34 EXECUTE Increase release velocity with faster, resilient tests Run tests in parallel at massive scale on ultrafast test infrastructure in the cloud FAST INFRASTRUCTURE Automatically heal element locators that break your tests even for the smallest UI change SELF-HEALING TESTS Run tests on demand, from your CI/CD, a webhook, or use our built-in test scheduler FLEXIBLE ORCHESTRATION
  • 35. 35 ANALYZE Get deep insights into every test run Get comprehensive reports and insights for all your test runs and easily search and filter test results INSIGHTFUL REPORTS Quickly surface code changes underlying UI changes with Root Cause Analysis PINPOINT WHAT WENT WRONG Leverage AI to avoid repetitive test maintenance activities and to group together similar UI changes and issues AUTOMATED TEST MAINTENANCE
  • 36. 36 • Collaboration tools • Bug trackers • CI / CD • Source control • APIs INTEGRATE Integrate with everything
  • 37. 37 Autonomous Autonomous testing for websites and multi-page web apps 37
  • 38. 38 Autonomous Autonomous testing for websites and multi-page web apps Easy one click setup Just point Autonomous at your website and you are done. Everything you need is available out of the box. Automatic website / app discovery Automatically create self-adjusting test suites that detect new, missing, changed or faulty pages and components on every run Natural language test builder Describe complex end-to-end flows using nothing more than plain English. No coding or element locating skills required Flexible test orchestration Run tests on demand, from your CI/CD, a webhook, or use our built-in test scheduler. No DevOps skills required Self-heal broken locators, avoid repetitive maintenance activities and group together similar UI changes and issues AI assisted test maintenance Cross device and browser testing Test your public and internal apps on any device, browser and OS using the world’s most modern test infrastructure available out of the box
  • 40. 40 The world’s most intelligent testing platform Automated test maintenance Employs DNNs to find similar differences across different OS, devices and browsers (e.g., different fonts). Self healing element locators Employs algorithms and ML to find UI elements with broken locators based on previous successful test runs. Automated test data generation Employs DNNs to detect input forms in apps and the data types of their fields to facilitate proper test data generation. Automatic test suite creation Employs Generative AI algorithms to generate entire test suites for websites and multi-page web applications. Author tests in plain English Employs LLMs for language understanding and for translating business level test instructions to detailed UI interactions. VisualAI: human vision modeling Employs dozens of algorithms, and DNNs to model color similarity, text vs image, picture vs graphics, pattern detection, etc. * ML – Machine Learning, DNN – Deep Neural Network, LLM – Large Language Model