Download as PDF, PPTX
![@roesslerj18
Is it a bug?
.
..
text.c
other.files
for (. . .) {
if (name[0] == '.') continue;
. . .
}
ls](https://image.slidesharecdn.com/aiintesting-181116112753/85/How-to-apply-AI-to-Testing-18-320.jpg)
![@roesslerj
1.
2.
3.
4.
5.
6.
7.
8.
9.
10.
11.
12.
13.
14. 67
public static void main(String... args) throws Exception {
WebDriver driver = new FirefoxDriver();
driver.get("http://www.retest.de");
while (true) {
List<WebElement> links = driver.findElements(By.tagName("a"));
links.get(random.nextInt(links.size())).click();
Thread.sleep(500);
List<WebElement> fields =
driver.findElements(By.xpath("//input[@type='text']"));
WebElement field = fields.get(random.nextInt(fields.size()));
field.sendKeys(randomString());
Thread.sleep(500);
}
}](https://image.slidesharecdn.com/aiintesting-181116112753/85/How-to-apply-AI-to-Testing-67-320.jpg)
Uploaded bySAP SE
How to apply AI to Testing
The document discusses the complexities and challenges of software testing in agile development, noting that 99% of respondents face issues with it. It emphasizes the importance of AI and machine learning in automating tests and predicts that by 2021, 50% of enterprises will implement intelligent test automation. Key challenges highlighted include the lack of proper tools, difficulties in test data management, and integration issues within testing methodologies.
More Related Content
Similar to How to apply AI to Testing
How to apply AI to Testing
- 1. @roesslerj1 How to applyAI to Testing Dr. Jeremias Rößler https://retest.de
- 2. @roesslerj2 • “99% ofrespondents face some kind of challenge with testing in agile development.” • “Test automation tools are fundamental to achieving the continuous testing approach required by DevOps.” • “by 2021, 50% of enterprises will leverage intelligent test automation driven by AI and machine learning.” *Source: Gartner 2017, Magic Quadrant for Software Test Automation
- 3. @roesslerj3 Problem: Software Testingist komplex und erzeugt viel manuellen Aufwand Trends: DevOps, Agile, Shift Left 32% 34% 34% 35% 36% 37% 35% 40% 45% The Automation Challenges Capgemini: 40% of the total IT budget will be allocated to QA + Testing in 2019. Ideate/ analyze/plan Design/ Develop/Build Test Release High Interest Medium Interest Low Interest Source: Forrester Research, Inc We don't have the right automation tools Challenge with the Test Data and Environment Availability Delivery methodology doesn't support test automation We have difficulties to integrate the different automation tools together Application functionality changes too frequently We don't have the right automation testing process/method Lack of stability of test script Lack of skilled and experience test automation resource We have difficulties to automate because of use of multiple development lifecycles *Source: World Quality Report 2016-17
- 4.
- 5.
- 6. @roesslerj6 1 - 2= ? • -1 is mathematically correct • 0 if I don’t want to payback gift certificates to costumers • 23 if I’m working with hours • 59 if I’m working with minutes or seconds • Something between 27 and 30 if I’m working with days • 11 if I am working with months • exception if I am working with degrees Kelvin
- 7.
- 8. @roesslerj8 component recognition password (text) username(text) enter text (action) click button (action) complexity UITester Software
- 9.
- 10.
- 11.
- 12.
- 13. @roesslerj13 How do youbring AIinto testing?
- 14. @roesslerj14 How do YOUdo Testing?
- 15. @roesslerj15 Testing Actual wrong Bug Comparison Expectedvs Actual Test Execution Done No Difference
- 16. @roesslerj16 Actual wrong Bug Comparison Expectedvs Actual Update Expected Expected wrong Test Execution Done No Difference Difference Evaluate Difference Testing
- 17. @roesslerj17 When is abug a bug? When it’s not a feature!
- 18. @roesslerj18 Is it abug? . .. text.c other.files for (. . .) { if (name[0] == '.') continue; . . . } ls
- 19.
- 20.
- 21. @roesslerj21 What is abug? Without specification, there are no bugs — only surprises. Brian Kernighan “
- 22. @roesslerj22 Why do wetest? After implementation? 1 + 1 = 3 2 + 2 = 4
- 23.
- 24.
- 25.
- 26. @roesslerj26 Why do wetest? After implementation? 1 + 1 = 3 2 + 2 = 4 After change? 1 + 1 = 3 1 + 1 = 5
- 27.
- 28.
- 29. @roesslerj29 Why do wetest? After implementation? 1 + 1 = 3 2 + 2 = 4 After change? 1 + 1 = 3 1 + 1 = 5 1 + 1 = 2
- 30.
- 31. @roesslerj31 Actual wrong Bug Comparison Expectedvs Actual Update Expected Expected wrong Test Execution Done No Difference Difference Evaluate Difference Testing
- 32. @roesslerj32 Actual wrong Bug Comparison Expectedvs Actual Update Expected Expected wrong Test Execution Done No Difference Difference Evaluate Difference Testing effort
- 33. @roesslerj33 @Test public void testReTestWebSiteClassic()throws Exception { driver.get("https://retest.de"); assertThat(driver.getTitle()).isEqualTo("retest"); WebElement toDownload = driver.findElement(By.name("submit")); toDownload.click(); assertTrue(driver.findElement(By.id("errorMsg")).isDisplayed()); }
- 34.
- 35. @roesslerj35 public void testSomething()throws Exception { // here be some test code ... UIElement element = driver.getElement(“path/to/element”); assertEquals(null, element.getAction()); assertEquals(“action”, element.getActionCommand()); assertEquals(true, element.isEnabled()); assertEquals(true, element.isFocusable()); assertEquals(“Lucida Grande”, element.getFont().getName()); assertEquals(13, element.getFont().getSize()); assertEquals(0, element.getFont().getStyle()); assertEquals(23, element.getHeight()); assertEquals(null, element.getIcon()); assertEquals(0, element.getMnemonic()); assertEquals(null, element.getPressedIcon()); assertEquals(true, element.isSelected()); assertEquals(“label”, element.getText()); assertEquals(119, element.getWidth()); assertEquals(27, element.getX()); assertEquals(191, element.getY()); }
- 36.
- 37.
- 38.
- 39.
- 40.
- 41.
- 42. @roesslerj42 Actual wrong Bug Comparison Expectedvs Actual Update Expected Expected wrong Test Execution Done No Difference Difference Evaluate Difference Testing effort effort
- 43.
- 44.
- 45.
- 46.
- 47.
- 48.
- 49. @roesslerj49 @Test public void testReTestWebSite()throws Exception { driver.get("https://retest.de"); re.startTest(); re.check(driver, "index"); WebElement toDownload = driver.findElement(By.name("submit")); toDownload.click(); re.check(driver, "download_1"); re.capTest(); } v
- 50.
- 51.
- 52. @roesslerj52 // Use theRecheckDriver as a wrapper for your usual driver driver = new RecheckDriver( new ChromeDriver() ); // Use the unbreakable recheck implementation. re = new RecheckWebImpl(); // Single call instead of multiple assertions re.check( driver, "index" ); // Will issue a warning, as the id has changed driver.findElement( By.id( "intro-slider" ) );
- 53. @roesslerj53 *************** recheck warning*************** The HTML id attribute used for element identification changed from 'intro- slider' to 'introSlider'. retest identified the element based on the persisted old state. If you apply these changes to the state , your test will break. Use `By.id("introSlider")` or `By.retestId("9c40281d-5655-4ffa-9c6d- d079e01bb5a3")` to update your test.
- 54. @roesslerj54 Benefits of recheck: -Reduce effort to create tests - Reduce effort to maintain tests - Tests are more complete - Tests are less fragile
- 55. @roesslerj55 How do youbring AIinto testing?
- 56.
- 57.
- 58.
- 59. @roesslerj59 Infinite-Monkey-Theorem: A monkey hittingkeys at random on a typewriter for a long enough time will type the complete works of William Shakespeare.
- 60. @roesslerj60 We replace thetypewriter with a computer…
- 61. @roesslerj61 public static voidmain(String... args) throws Exception { Robot robot = new Robot(); while (true) { robot.mouseMove(random.nextInt(maxX), random.nextInt(maxY)); robot.mousePress(InputEvent.BUTTON1_DOWN_MASK); robot.mouseRelease(InputEvent.BUTTON1_DOWN_MASK); robot.delay(200); for (char inputChar : randomString().toCharArray()) { robot.keyPress((int) inputChar); robot.keyRelease((int) inputChar); robot.delay(10); } robot.keyPress(KeyEvent.VK_ENTER); robot.keyRelease(KeyEvent.VK_ENTER); } } 1. 2. 3. 4. 5. 6. 7. 8. 9. 10. 11. 12. 13. 14. 15. 16.
- 62.
- 63.
- 64. @roesslerj64 - gremlins.js - NetFlixChaos Monkey - UI/Application Exerciser Monkey Open Source Products
- 65.
- 66.
- 67. @roesslerj 1. 2. 3. 4. 5. 6. 7. 8. 9. 10. 11. 12. 13. 14. 67 public staticvoid main(String... args) throws Exception { WebDriver driver = new FirefoxDriver(); driver.get("http://www.retest.de"); while (true) { List<WebElement> links = driver.findElements(By.tagName("a")); links.get(random.nextInt(links.size())).click(); Thread.sleep(500); List<WebElement> fields = driver.findElements(By.xpath("//input[@type='text']")); WebElement field = fields.get(random.nextInt(fields.size())); field.sendKeys(randomString()); Thread.sleep(500); } }
- 68.
- 69.
- 70.
- 71.
- 72.
- 73.
- 74.
- 75.
- 76.
- 77.
- 78.
- 79.
- 80.
- 81.
- 82.
- 83.
- 84.
- 85.
- 86.
- 87. @roesslerj @roesslerjX test 1.0 approve 1.1 diff train user automate @roesslerjX https://github.com/retest/recheck-web 87 Summary Difference Testing little maintenance nowasteful testing yet more complete Monkey-Testing: cheaper faster better multiplies manual tests
- 88.