This document discusses the applicability of machine learning and neural networks in test automation. It describes how ML and NN are currently used for log analysis and test data generation. It then outlines several potential uses of ML/NN in test automation, including defect prediction, defect classification, test coverage optimization, and test case generation/scriptless automation. The document concludes by discussing challenges with classifying failed logs and the potential for neural networks to address this problem.

1. APPLICABILITY
OF
MACHINE LEARNING
AND NEURAL
NETWORKS
IN
TEST AUTOMATION

2. Dzmitr y
Humianiuk

3. Dzmitr y
Humianiuk
D e l i v e r y M a n a g e r /
P r o d u c t M a n a g e r
1 1 y e a r s i n I T
L e a d i n g s o l u t i o n s d e v

4. AI IN TESTING

5. AI IN TESTING
W H AT ’ S O N T H E M A R K E T

6. W H AT ’ S O N T H E M A R K E T
M L & N N F O R L O G A N A LY S I S
AI IN TESTING

7. W H AT ’ S O N T H E M A R K E T
M L & N N F O R L O G A N A LY S I S
T E S T D ATA G E N E R AT I O N
AI IN TESTING

8. TOO MANY HYPE

9. M L / N N U S A G E

10. M L / N N U S A G E
Defect prediction

11. M L / N N U S A G E
Defect prediction
Defect classification

12. M L / N N U S A G E
Defect prediction
Defect classification
Test Coverage optimization

13. M L / N N U S A G E
Defect prediction
Defect classification
Test Coverage optimization
Test case generation / scriptless automation

15. FAILED LOG
CLASSIFICATION

16. FA I L E D LO G C L A S S I F I C AT I O N

17. FA I L E D LO G C L A S S I F I C AT I O N

18. FA I L E D LO G C L A S S I F I C AT I O N
Exception: defectId=111689, jiraLink=https://atlassian.net/browse/, submitter=_qa_user, date=, rpId=
com.frontier.ta.jbehave.definition_steps.ConfigDefinitionSteps.beforeAnyScenario(ConfigDefinitionSteps.java:68
)
sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
org.jbehave.core.steps.StepCreator$MethodInvoker.invoke(StepCreator.java:958)
org.jbehave.core.steps.StepCreator$BeforeOrAfterStep.perform(StepCreator.java:624)
org.jbehave.core.embedder.PerformableTree$FineSoFar.run(PerformableTree.java:346)
org.jbehave.core.embedder.PerformableTree$PerformableSteps.perform(PerformableTree.java:1090)
org.jbehave.core.embedder.PerformableTree$NormalPerformableScenario.perform(PerformableTree.java:984)
org.jbehave.core.embedder.PerformableTree$PerformableScenario.perform(PerformableTree.java:904)
org.jbehave.core.embedder.PerformableTree$PerformableStory.performScenarios(PerformableTree.java:825)
org.jbehave.core.embedder.PerformableTree$PerformableStory.perform(PerformableTree.java:798)
org.jbehave.core.embedder.PerformableTree.performCancellable(PerformableTree.java:422)
org.jbehave.core.embedder.PerformableTree.perform(PerformableTree.java:393)
com.frontier.ta.jbehave.DynamicDataPerformableTree.perform(DynamicDataPerformableTree.java:84)
org.jbehave.core.embedder.StoryManager$EnqueuedStory.call(StoryManager.java:292)
org.jbehave.core.embedder.StoryManager$EnqueuedStory.call(StoryManager.java:266)
java.util.concurrent.FutureTask.run(FutureTask.java:266)
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
java.lang.Thread.run(Thread.java:745)

19. FA I L E D LO G C L A S S I F I C AT I O N
Exception: defectId=111689, jiraLink=https://atlassian.net/browse/, submitter=_qa_user, date=, rpId=
com.frontier.ta.jbehave.definition_steps.ConfigDefinitionSteps.beforeAnyScenario(ConfigDefinitionSteps.java:68
)
sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
org.jbehave.core.steps.StepCreator$MethodInvoker.invoke(StepCreator.java:958)
org.jbehave.core.steps.StepCreator$BeforeOrAfterStep.perform(StepCreator.java:624)
org.jbehave.core.embedder.PerformableTree$FineSoFar.run(PerformableTree.java:346)
org.jbehave.core.embedder.PerformableTree$PerformableSteps.perform(PerformableT
org.jbehave.core.embedder.PerformableTree$NormalPerformableScenario.perform(Pe
org.jbehave.core.embedder.PerformableTree$PerformableScenario.perform(Performab
org.jbehave.core.embedder.PerformableTree$PerformableStory.performScenarios(Perf
org.jbehave.core.embedder.PerformableTree$PerformableStory.perform(PerformableT
org.jbehave.core.embedder.PerformableTree.performCancellable(PerformableTree.java
org.jbehave.core.embedder.PerformableTree.perform(PerformableTree.java:393)
com.frontier.ta.jbehave.DynamicDataPerformableTree.perform(DynamicDataPerformab
org.jbehave.core.embedder.StoryManager$EnqueuedStory.call(StoryManager.java:292)
org.jbehave.core.embedder.StoryManager$EnqueuedStory.call(StoryManager.java:266)
java.util.concurrent.FutureTask.run(FutureTask.java:266)
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
java.lang.Thread.run(Thread.java:745)
HM
EX
ST

20. FA I L E D LO G C L A S S I F I C AT I O N
TEXT TO VECTOR
HM EX ST

21. N E U R A L N E T W O R K

24. TEST DATA GENERATION

25. TEST DATA GENERATION

29. THANK YOU