The Speed Run
Code & No-Code Journeys:
Tim Hinds
Product Team @ Applitools
Tools We’ll Be Using
Functional ✦ Visual ✦ API ✦ Cross Browser ✦ Cross Device ✦ Component ✦ Accessibility ✦ Data Driven
AUTONOMOUS
INTELLIGENT TESTING PLATFORM
Autonomous Site
Scanner
Test Step
Generator
Test Data
Generator
Coded Locator
Healer
Visual Maintenance
Scaler
SOURCE CONTROL
CI/CD
COLLABORATION
BROWSERS & DEVICES
TESTING FRAMEWORKS
DESIGN
CREATE VALIDATE EXECUTE ANALYZE
APPLITOOLS AI TEAM
AI-ASSISTED
NO CODE
CODE
Components
Websites
Web Apps
Mobile Apps
PDFs & Docs
Desktop Apps
Testing Insights
Dashboards
Root Cause Analysis
Auto Maintenance
Deterministic LM Execution
Self-healing
Browser & Device Grid
Scheduled Test Plan Runs
CI/CD Integrations
Parallel Cloud Execution
Autonomous Website Tests
NLP Step Authoring & Editing
Test Step Generation
Test Data Generation
API API Test Step Builder
Interactive Browser Recorder
Eyes MCP Server
30+ SDKs
Deterministic LM
Step Runner
Visual Defect
Analyzer
NLP Test Step
Fixer
20%
Custom Flow Tests
For testing your most important
user flows with functional data,
visual assertions, and API calls
across browsers and devices.
80%
Visual AI Full Page Tests
For increasing test coverage
autonomously with Visual AI for
functional and visual testing
across browsers and devices.
20% AI-Assisted + 80% Visual AI Autonomous
Autonomous Self-maintaining
Website Tests
Autonomous self-maintaining website testing
Easy one-click setup
Everything is included out of the box,
from devices & browsers to test scheduling.
Automatic website discovery
Automatically crawls and finds all the pages in your
website given its URL.
Comprehensive coverage
Automatically reports of any HTTP issue, content
change or rendering difference
Adjusts to website changes
Automatically detects and reports new, missing or
faulty pages on every test run.
BOOST COVERAGE INSTANTLY
Visual assertions powered by VisualAI
Complete coverage
Complete visual and functional assertion coverage
across multiple devices and browsers.
Fewer test steps
80% fewer test steps to author and maintain for the
entire lifetime of the test.
Scalable maintenance
Accept or reject differences once across all pages,
devices and browsers
The best computer vision tech
Accurately mimics the human eye. 12+ dev years /
4B+ tests.
BOOST COVERAGE INSTANTLY
Full-page Cross Browser/Device
Tests for Web Apps
Full-page Cross Browser/Device Tests
Easy setup
Everything is included out of the box,
from devices & browsers to test scheduling.
Increase coverage for pages
Upload URL list of to scan
Run flows before tests
Run flows like auth/login before running the test for
web apps
LIMIT TEST FLAKINESS
No-code Flow Tests with
AI-Assistance
Interactive test authoring in plain English
Author tests in plain English
No coding or locators skills required. Easiest to
understand and maintain.
Interactively record test steps
Speed up authoring by recording steps in English,
and easily refine manually if needed.
Debug tests interactively
From setting breakpoints to step by step execution.
Do everything a code IDE can do.
100% SaaS
No need to install a local recorder. Record and
playback tests exactly as they will run.
LLM assisted test authoring
Automatic error correction
Automatically corrects syntax and grammar mistakes
Automatic step simplification
Automatically splits complex steps to multiple
simpler ones
Automatic step disambiguation
Automatically disambiguates step to clarify how the
step will be executed
Intent-based test generation
Automatically generate test steps and test data
given a test goal.
Functional data driven testing
Robust textual assertions
Verify everything you can do with coded tests from
string formats to numeric values.
Test parameterization
Execute tests with explicit arguments or per row in a
test arguments dataset.
Capture data in variables
Extract value fragments and use them in subsequent
test steps.
Execute JS code
When you need to describe complex logic, reuse a
utility or manipulate the page.
Deterministic LLM test execution
Consistency
No hallucinations or test variance day-to-day. We
also provide 1:1 support if there are LLM questions
specific to your environment.
Fast
With a purpose-built model we can control
performance because the model is sized for
understanding testing; not the history of the world.
Cost
With an in-house model built for testing; we
control for the cost of running an LLM.
Secure
We use synthetic data to test our models; never
your data.
API Calls and Data Assertions
Initiate HTTP requests
Custom authentication, reset app state, data
cleanup, or verify the backend state.
Fully configurable
Specify HTTP verbs, cookies, headers, and body.
Use variables and parameters.
Capture response details
Verify response details or store it in variables to use
in subsequent test steps
Capture application requests
Capture outbound client requests and responses to
verify or use their data.
Converting Test Cases to Flow Tests
Starting with a
test case for a
new feature
CONVERTING TEST
CASES TO FLOW TESTS
Start with Reusable Test Flows
CONVERTING TEST CASES TO FLOW TESTS
Copy and Paste Test Steps from the Test Case
CONVERTING TEST CASES TO FLOW TESTS
LLM Step Generation Converts Intent to Test Steps
CONVERTING TEST CASES TO FLOW TESTS
LLM Step Generation Converts Intent to Test Steps
CONVERTING TEST CASES TO FLOW TESTS
LLM Step Generation Converts Intent to Test Steps
CONVERTING TEST CASES TO FLOW TESTS
Copy and Paste Test Steps from the Test Case
CONVERTING TEST CASES TO FLOW TESTS
Utilize Reusable Flows and
Parameters
Build Modular Test Flows
UTILIZE REUSABLE FLOWS AND PARAMETERS
Build Modular Test Flows
UTILIZE REUSABLE FLOWS AND PARAMETERS
Build Modular Test Flows
UTILIZE REUSABLE FLOWS AND PARAMETERS
Set Up Tests for Devs to Assist
UTILIZE REUSABLE FLOWS AND PARAMETERS
Real example of applitools.com
hosting migration
Tested 1,528 Pages Across 5 Browsers and Devices
WEBSITE HOSTING MIGRATION
Tested 1,528 Pages Across 5 Browsers and Devices
WEBSITE HOSTING MIGRATION
Tested 1,528 Pages Across 5 Browsers and Devices
WEBSITE HOSTING MIGRATION
Tested 1,528 Pages Across 5 Browsers and Devices
WEBSITE HOSTING MIGRATION
Tested 1,528 Pages Across 5 Browsers and Devices
WEBSITE HOSTING MIGRATION
Questions?
Sign up for a 14-day free trial of
Applitools Autonomous
https://applitools.info/jvt
Questions?
Sign up for a 14-day free trial of
Applitools Autonomous
https://applitools.info/jvt

Code and No-Code Journeys: The Speed Run Descent

  • 1.
    The Speed Run Code& No-Code Journeys: Tim Hinds Product Team @ Applitools
  • 2.
  • 3.
    Functional ✦ Visual✦ API ✦ Cross Browser ✦ Cross Device ✦ Component ✦ Accessibility ✦ Data Driven AUTONOMOUS INTELLIGENT TESTING PLATFORM Autonomous Site Scanner Test Step Generator Test Data Generator Coded Locator Healer Visual Maintenance Scaler SOURCE CONTROL CI/CD COLLABORATION BROWSERS & DEVICES TESTING FRAMEWORKS DESIGN CREATE VALIDATE EXECUTE ANALYZE APPLITOOLS AI TEAM AI-ASSISTED NO CODE CODE Components Websites Web Apps Mobile Apps PDFs & Docs Desktop Apps Testing Insights Dashboards Root Cause Analysis Auto Maintenance Deterministic LM Execution Self-healing Browser & Device Grid Scheduled Test Plan Runs CI/CD Integrations Parallel Cloud Execution Autonomous Website Tests NLP Step Authoring & Editing Test Step Generation Test Data Generation API API Test Step Builder Interactive Browser Recorder Eyes MCP Server 30+ SDKs Deterministic LM Step Runner Visual Defect Analyzer NLP Test Step Fixer
  • 4.
    20% Custom Flow Tests Fortesting your most important user flows with functional data, visual assertions, and API calls across browsers and devices. 80% Visual AI Full Page Tests For increasing test coverage autonomously with Visual AI for functional and visual testing across browsers and devices. 20% AI-Assisted + 80% Visual AI Autonomous
  • 5.
  • 6.
    Autonomous self-maintaining websitetesting Easy one-click setup Everything is included out of the box, from devices & browsers to test scheduling. Automatic website discovery Automatically crawls and finds all the pages in your website given its URL. Comprehensive coverage Automatically reports of any HTTP issue, content change or rendering difference Adjusts to website changes Automatically detects and reports new, missing or faulty pages on every test run. BOOST COVERAGE INSTANTLY
  • 7.
    Visual assertions poweredby VisualAI Complete coverage Complete visual and functional assertion coverage across multiple devices and browsers. Fewer test steps 80% fewer test steps to author and maintain for the entire lifetime of the test. Scalable maintenance Accept or reject differences once across all pages, devices and browsers The best computer vision tech Accurately mimics the human eye. 12+ dev years / 4B+ tests. BOOST COVERAGE INSTANTLY
  • 8.
  • 9.
    Full-page Cross Browser/DeviceTests Easy setup Everything is included out of the box, from devices & browsers to test scheduling. Increase coverage for pages Upload URL list of to scan Run flows before tests Run flows like auth/login before running the test for web apps LIMIT TEST FLAKINESS
  • 10.
    No-code Flow Testswith AI-Assistance
  • 11.
    Interactive test authoringin plain English Author tests in plain English No coding or locators skills required. Easiest to understand and maintain. Interactively record test steps Speed up authoring by recording steps in English, and easily refine manually if needed. Debug tests interactively From setting breakpoints to step by step execution. Do everything a code IDE can do. 100% SaaS No need to install a local recorder. Record and playback tests exactly as they will run.
  • 12.
    LLM assisted testauthoring Automatic error correction Automatically corrects syntax and grammar mistakes Automatic step simplification Automatically splits complex steps to multiple simpler ones Automatic step disambiguation Automatically disambiguates step to clarify how the step will be executed Intent-based test generation Automatically generate test steps and test data given a test goal.
  • 13.
    Functional data driventesting Robust textual assertions Verify everything you can do with coded tests from string formats to numeric values. Test parameterization Execute tests with explicit arguments or per row in a test arguments dataset. Capture data in variables Extract value fragments and use them in subsequent test steps. Execute JS code When you need to describe complex logic, reuse a utility or manipulate the page.
  • 14.
    Deterministic LLM testexecution Consistency No hallucinations or test variance day-to-day. We also provide 1:1 support if there are LLM questions specific to your environment. Fast With a purpose-built model we can control performance because the model is sized for understanding testing; not the history of the world. Cost With an in-house model built for testing; we control for the cost of running an LLM. Secure We use synthetic data to test our models; never your data.
  • 15.
    API Calls andData Assertions Initiate HTTP requests Custom authentication, reset app state, data cleanup, or verify the backend state. Fully configurable Specify HTTP verbs, cookies, headers, and body. Use variables and parameters. Capture response details Verify response details or store it in variables to use in subsequent test steps Capture application requests Capture outbound client requests and responses to verify or use their data.
  • 16.
    Converting Test Casesto Flow Tests
  • 17.
    Starting with a testcase for a new feature CONVERTING TEST CASES TO FLOW TESTS
  • 18.
    Start with ReusableTest Flows CONVERTING TEST CASES TO FLOW TESTS
  • 19.
    Copy and PasteTest Steps from the Test Case CONVERTING TEST CASES TO FLOW TESTS
  • 20.
    LLM Step GenerationConverts Intent to Test Steps CONVERTING TEST CASES TO FLOW TESTS
  • 21.
    LLM Step GenerationConverts Intent to Test Steps CONVERTING TEST CASES TO FLOW TESTS
  • 22.
    LLM Step GenerationConverts Intent to Test Steps CONVERTING TEST CASES TO FLOW TESTS
  • 23.
    Copy and PasteTest Steps from the Test Case CONVERTING TEST CASES TO FLOW TESTS
  • 24.
    Utilize Reusable Flowsand Parameters
  • 25.
    Build Modular TestFlows UTILIZE REUSABLE FLOWS AND PARAMETERS
  • 26.
    Build Modular TestFlows UTILIZE REUSABLE FLOWS AND PARAMETERS
  • 27.
    Build Modular TestFlows UTILIZE REUSABLE FLOWS AND PARAMETERS
  • 28.
    Set Up Testsfor Devs to Assist UTILIZE REUSABLE FLOWS AND PARAMETERS
  • 29.
    Real example ofapplitools.com hosting migration
  • 30.
    Tested 1,528 PagesAcross 5 Browsers and Devices WEBSITE HOSTING MIGRATION
  • 31.
    Tested 1,528 PagesAcross 5 Browsers and Devices WEBSITE HOSTING MIGRATION
  • 32.
    Tested 1,528 PagesAcross 5 Browsers and Devices WEBSITE HOSTING MIGRATION
  • 33.
    Tested 1,528 PagesAcross 5 Browsers and Devices WEBSITE HOSTING MIGRATION
  • 34.
    Tested 1,528 PagesAcross 5 Browsers and Devices WEBSITE HOSTING MIGRATION
  • 35.
    Questions? Sign up fora 14-day free trial of Applitools Autonomous https://applitools.info/jvt
  • 36.
    Questions? Sign up fora 14-day free trial of Applitools Autonomous https://applitools.info/jvt