How AI and ML
Can Accelerate
and Optimize
Software
Development
and Testing
Eran Kinsbruner
Best-Selling Author, TechBeacon
Top 30 Test Automation Leader
& the Chief Evangelist and Senior
Director at Perforce Software
Tom Hartig
Webinar Coordinator,
Information Technology Zone
Information Technology Zone
June 15th, 2022
9:30 am PT
12:30 pm ET
5:30 pm BST
With
&
Rollbar is the leading continuous code improvement platform that enables developers to
proactively discover and resolve issues in their code. Rollbar integrates with a
development team's existing toolchain to give greater coverage and insights into broken
code, across the software lifecycle. With Rollbar, developers focus on deploying better
software faster, knowing they can quickly recover from critical errors as they happen.
Thousands of companies, including Twilio, Salesforce, Twitch, and Duolingo, use Rollbar
for their most critical applications, ensuring happier customers and more productive
development teams.
To learn more about how Rollbar can help you, visit Rollbar.com
02
TO USE YOUR COMPUTER'S AUDIO:
When the webinar begins, you will be connected to audio using your
computer's microphone and speakers (VoIP). A headset is recommended. TO USE YOUR TELEPHONE:
You must select "Use Telephone" after joining
and call in using the numbers below.
United States: +1 (562) 247-8422
Access Code: 345-410-448
Audio PIN: Shown after joining the webinar
03
--OR--
Click on the Questions panel
to
interact with the presenters
Information
Technology Zone
04
Eran Kinsbruner
Best-Selling Author, TechBeacon Top 30 Test Automation
Leader & the Chief Evangelist and Senior Director at Perforce
Software
How AI and ML Can Accelerate and Optimize
Software Development and Testing
Information
Technology
Zone
© Perforce Software, Inc.
Presenter
• 22+ years of experience in software development & testing
• Inventor, author, speaker, blogger
Social
: @ek121268
: https://www.linkedin.com/in/erankinsbruner/
Blog : continuoustesting.dev/
Author of
• The Digital Quality Handbook
• Continuous Testing for DevOps Professionals
• Accelerating Software Quality
• A Front-End Web Developer’s Guide to Testing
My List of Books on Digital Quality
© Perforce Software, Inc.
6
AI & ML Core Benefits
© Perforce Software, Inc.
7
AI & ML Investments
https://www.jpmorgan.com/technology/artificial-intelligence
Approximately three out of every four organizations (76%) in DevOps.com 2021 report
said they are prioritizing AI/ML over other IT initiatives, with 28% reporting that it is their
top priority overall
© Perforce Software, Inc.
Top AI Startups in 2020-2021
CBINSIGHTS
© Perforce Software, Inc.
9
AI & ML In DEVOPS!
Source: cloudthat
© Perforce Software, Inc.
10
The Coding
Phase
© Perforce Software, Inc.
11
AI & ML In DEVOPS – Coding Phase!
© Perforce Software, Inc.
12
https://aws.amazon.com/codeguru/
AI & ML In DEVOPS – Coding Phase!
© Perforce Software, Inc.
13
https://cloud.google.com/ai-platform/training/pricing
AI & ML In DEVOPS – Coding Phase!
Use the AI Platform Training to train your machine learning models using the resources of Google Cloud.
© Perforce Software, Inc.
14
The Build
Phase
© Perforce Software, Inc.
15
https://www.diffblue.com/products/
AI & ML In DEVOPS – Build Phase!
© Perforce Software, Inc.
16
The Testing
Phase
© Perforce Software, Inc.
17
AI & ML In DEVOPS – Test Phase!
AppVance
© Perforce Software, Inc.
18
AI & ML In DEVOPS – Test Phase!
DIFFERENTIAL VISUAL DECLARATIVE
Classifications of AI and ML Tools
Image-Based Learning
• Screen Comparisons
• Look and Feel
• UI Design, Accessibility
Comparing application
versions over builds:
• Recognizing changes
• Classifying the differences
• Bugs vs. features
ANALYTICS
SELF-HEALING
Specifying Test Intent
• Goal-Based Automation
• Natural Language Processing
• Domain-Specific Languages
Autocorrecting Test Scripts
• Element Location
• Improved Maintenance
• Improved Robustness
Autocorrecting Test Scripts
• Root Cause Analysis
• Test Selection/Prioritization
• Test Flakiness
© Perforce Software, Inc.
19
AI & ML In DEVOPS – Test Phase!
Autonomous & Agnostic to the Dev Framework
• Sophisticated locators – Picked up autonomously.
Doesn’t require user input.
• Each element identified by a multi locator adaptive
scoring system.
• Most mobile frameworks don’t expose unique IDs –
Perfecto Scriptless has its own locator system, agnostic
to the framework.
Discover & Manage System Messages
• Stable on real devices too: Manage unpredictable
messages that can fail tests randomly.
Adaptive to Screen Load Time
• Identifying progress bars and synchronizing actions to
when screens are loaded and ready.
© Perforce Software, Inc.
20
The Operate
Phase
© Perforce Software, Inc.
21
AIOps, (artificial intelligence for IT operations) is the application of artificial intelligence (AI)
to enhance IT operations. Specifically, AIOps uses big data, analytics, and machine learning
capabilities to do the following:
• Collect and aggregate the huge and ever-increasing volumes of operations data
generated by multiple IT infrastructure components, applications, and
performance-monitoring tools.
• Intelligently sift ‘signals’ out of the ‘noise’ to identify significant events and patterns
related to system performance and availability issues (detect business anomalies).
• Automatically diagnose root causes and report them to IT for rapid response and
remediation — or, in some cases, automatically resolve these issues without human
intervention.
AI & ML In DEVOPS – Test Phase!
© Perforce Software, Inc.
22
APM – Application Performance Management
ITIM – IT Infrastructure Monitoring
ITSM – IT Service Monitoring
APM + ITIM + ITSM =AIOPS
© Perforce Software, Inc.
23
AIOps Maturity Model
© Perforce Software, Inc.
24
• Enhance organizations digital transformation
• Achieve faster MTTR (focus on real issues instead of noise)
• Go from reactive to proactive to predictive management (predictive alerting)
• Modernize your IT operations and your IT operations team (focus on innovation rather
then KTLO)
AIOps Benefits
© Perforce Software, Inc.
25
AIOps Objectives
© Perforce Software, Inc.
26
AIOps Solution Example
Source: https://www.validatek.com/technologies/ai-ops
• Key Features:
• Event correlation
• Noise reduction (filters,
blacklisting, etc.)
• Collaboration between
security and operations
• Ecosystem automation
(auto-ticketing,
auto-diagnostics, escalation,
etc.)
• Flexible implementation
options (SaaS, on-premise,
hybrid)
• Integration with third party
tools (Splunk, Remedy,
SolarWinds)
© Perforce Software, Inc.
27
Future of AIOps
• Integral part of DevOps and IT management
• Shorter DevOps and production issues cycles
• Higher code quality continuously, more emphasis on shift-right processes
• Better cross-function collaboration (Dev, QA, Ops, Business)
© Perforce Software, Inc.
28
The Monitor
Phase
© Perforce Software, Inc.
29
AI & ML In DEVOPS: Monitor/Observability
© Perforce Software, Inc.
30
AI & ML In DEVOPS: API Cybersecurity Identification
© Perforce Software, Inc.
31
CONCULSION
Identify the most painful area
within your process
Start with a single problem
and a single solution
Prove value and continue
down the stream
Maximize the benefits from
AI/ML to automate and
enhance your velocity!
/in/erankinsbruner/ informationtechnologyzone.com
Q&A
Eran Kinsbruner Tom Hartig
Webinar Coordinator
Information Technology Zone
Best-Selling Author, TechBeacon Top 30 Test
Automation Leader & the Chief Evangelist and
Senior Director at Perforce Software
Information Technology Zone

How AI and ML Can Accelerate and Optimize Software Development and Testing

  • 1.
    How AI andML Can Accelerate and Optimize Software Development and Testing Eran Kinsbruner Best-Selling Author, TechBeacon Top 30 Test Automation Leader & the Chief Evangelist and Senior Director at Perforce Software Tom Hartig Webinar Coordinator, Information Technology Zone Information Technology Zone June 15th, 2022 9:30 am PT 12:30 pm ET 5:30 pm BST With &
  • 2.
    Rollbar is theleading continuous code improvement platform that enables developers to proactively discover and resolve issues in their code. Rollbar integrates with a development team's existing toolchain to give greater coverage and insights into broken code, across the software lifecycle. With Rollbar, developers focus on deploying better software faster, knowing they can quickly recover from critical errors as they happen. Thousands of companies, including Twilio, Salesforce, Twitch, and Duolingo, use Rollbar for their most critical applications, ensuring happier customers and more productive development teams. To learn more about how Rollbar can help you, visit Rollbar.com 02
  • 3.
    TO USE YOURCOMPUTER'S AUDIO: When the webinar begins, you will be connected to audio using your computer's microphone and speakers (VoIP). A headset is recommended. TO USE YOUR TELEPHONE: You must select "Use Telephone" after joining and call in using the numbers below. United States: +1 (562) 247-8422 Access Code: 345-410-448 Audio PIN: Shown after joining the webinar 03 --OR-- Click on the Questions panel to interact with the presenters Information Technology Zone
  • 4.
    04 Eran Kinsbruner Best-Selling Author,TechBeacon Top 30 Test Automation Leader & the Chief Evangelist and Senior Director at Perforce Software How AI and ML Can Accelerate and Optimize Software Development and Testing Information Technology Zone
  • 5.
    © Perforce Software,Inc. Presenter • 22+ years of experience in software development & testing • Inventor, author, speaker, blogger Social : @ek121268 : https://www.linkedin.com/in/erankinsbruner/ Blog : continuoustesting.dev/ Author of • The Digital Quality Handbook • Continuous Testing for DevOps Professionals • Accelerating Software Quality • A Front-End Web Developer’s Guide to Testing My List of Books on Digital Quality
  • 6.
    © Perforce Software,Inc. 6 AI & ML Core Benefits
  • 7.
    © Perforce Software,Inc. 7 AI & ML Investments https://www.jpmorgan.com/technology/artificial-intelligence Approximately three out of every four organizations (76%) in DevOps.com 2021 report said they are prioritizing AI/ML over other IT initiatives, with 28% reporting that it is their top priority overall
  • 8.
    © Perforce Software,Inc. Top AI Startups in 2020-2021 CBINSIGHTS
  • 9.
    © Perforce Software,Inc. 9 AI & ML In DEVOPS! Source: cloudthat
  • 10.
    © Perforce Software,Inc. 10 The Coding Phase
  • 11.
    © Perforce Software,Inc. 11 AI & ML In DEVOPS – Coding Phase!
  • 12.
    © Perforce Software,Inc. 12 https://aws.amazon.com/codeguru/ AI & ML In DEVOPS – Coding Phase!
  • 13.
    © Perforce Software,Inc. 13 https://cloud.google.com/ai-platform/training/pricing AI & ML In DEVOPS – Coding Phase! Use the AI Platform Training to train your machine learning models using the resources of Google Cloud.
  • 14.
    © Perforce Software,Inc. 14 The Build Phase
  • 15.
    © Perforce Software,Inc. 15 https://www.diffblue.com/products/ AI & ML In DEVOPS – Build Phase!
  • 16.
    © Perforce Software,Inc. 16 The Testing Phase
  • 17.
    © Perforce Software,Inc. 17 AI & ML In DEVOPS – Test Phase! AppVance
  • 18.
    © Perforce Software,Inc. 18 AI & ML In DEVOPS – Test Phase! DIFFERENTIAL VISUAL DECLARATIVE Classifications of AI and ML Tools Image-Based Learning • Screen Comparisons • Look and Feel • UI Design, Accessibility Comparing application versions over builds: • Recognizing changes • Classifying the differences • Bugs vs. features ANALYTICS SELF-HEALING Specifying Test Intent • Goal-Based Automation • Natural Language Processing • Domain-Specific Languages Autocorrecting Test Scripts • Element Location • Improved Maintenance • Improved Robustness Autocorrecting Test Scripts • Root Cause Analysis • Test Selection/Prioritization • Test Flakiness
  • 19.
    © Perforce Software,Inc. 19 AI & ML In DEVOPS – Test Phase! Autonomous & Agnostic to the Dev Framework • Sophisticated locators – Picked up autonomously. Doesn’t require user input. • Each element identified by a multi locator adaptive scoring system. • Most mobile frameworks don’t expose unique IDs – Perfecto Scriptless has its own locator system, agnostic to the framework. Discover & Manage System Messages • Stable on real devices too: Manage unpredictable messages that can fail tests randomly. Adaptive to Screen Load Time • Identifying progress bars and synchronizing actions to when screens are loaded and ready.
  • 20.
    © Perforce Software,Inc. 20 The Operate Phase
  • 21.
    © Perforce Software,Inc. 21 AIOps, (artificial intelligence for IT operations) is the application of artificial intelligence (AI) to enhance IT operations. Specifically, AIOps uses big data, analytics, and machine learning capabilities to do the following: • Collect and aggregate the huge and ever-increasing volumes of operations data generated by multiple IT infrastructure components, applications, and performance-monitoring tools. • Intelligently sift ‘signals’ out of the ‘noise’ to identify significant events and patterns related to system performance and availability issues (detect business anomalies). • Automatically diagnose root causes and report them to IT for rapid response and remediation — or, in some cases, automatically resolve these issues without human intervention. AI & ML In DEVOPS – Test Phase!
  • 22.
    © Perforce Software,Inc. 22 APM – Application Performance Management ITIM – IT Infrastructure Monitoring ITSM – IT Service Monitoring APM + ITIM + ITSM =AIOPS
  • 23.
    © Perforce Software,Inc. 23 AIOps Maturity Model
  • 24.
    © Perforce Software,Inc. 24 • Enhance organizations digital transformation • Achieve faster MTTR (focus on real issues instead of noise) • Go from reactive to proactive to predictive management (predictive alerting) • Modernize your IT operations and your IT operations team (focus on innovation rather then KTLO) AIOps Benefits
  • 25.
    © Perforce Software,Inc. 25 AIOps Objectives
  • 26.
    © Perforce Software,Inc. 26 AIOps Solution Example Source: https://www.validatek.com/technologies/ai-ops • Key Features: • Event correlation • Noise reduction (filters, blacklisting, etc.) • Collaboration between security and operations • Ecosystem automation (auto-ticketing, auto-diagnostics, escalation, etc.) • Flexible implementation options (SaaS, on-premise, hybrid) • Integration with third party tools (Splunk, Remedy, SolarWinds)
  • 27.
    © Perforce Software,Inc. 27 Future of AIOps • Integral part of DevOps and IT management • Shorter DevOps and production issues cycles • Higher code quality continuously, more emphasis on shift-right processes • Better cross-function collaboration (Dev, QA, Ops, Business)
  • 28.
    © Perforce Software,Inc. 28 The Monitor Phase
  • 29.
    © Perforce Software,Inc. 29 AI & ML In DEVOPS: Monitor/Observability
  • 30.
    © Perforce Software,Inc. 30 AI & ML In DEVOPS: API Cybersecurity Identification
  • 31.
    © Perforce Software,Inc. 31 CONCULSION Identify the most painful area within your process Start with a single problem and a single solution Prove value and continue down the stream Maximize the benefits from AI/ML to automate and enhance your velocity!
  • 32.
    /in/erankinsbruner/ informationtechnologyzone.com Q&A Eran KinsbrunerTom Hartig Webinar Coordinator Information Technology Zone Best-Selling Author, TechBeacon Top 30 Test Automation Leader & the Chief Evangelist and Senior Director at Perforce Software Information Technology Zone