Ever had that: after a simple change, suddenly 50+ tests are failing! Brittle tests that hinge on GUI specifics and result in the dreaded NoSuchElementException are a main headache when testing with Selenium. The open source project recheck offers a simple and elegant solution. Not only is a virtual identifier unaffected by UI changes, you can define it for otherwise hard to specify elements, i.e. that would require complex xpath or CSS selector expressions. And on top of that, tests are easier to create and maintain and yet much more complete in what they check. This talk gives a practical introduction to the underlying approach and the tool, complete with a life coding session.

1. @roesslerj
and the
Sorcerer’s Stone
1
Dr. Jeremias Rößler
https://retest.de

2. @roesslerj2

3. @roesslerj3

4. @roesslerj4

5. @roesslerj5
passes

6. @roesslerj6

7. @roesslerj7

8. @roesslerj8

9. @roesslerj9

10. @roesslerj10

11. @roesslerj11

12. @roesslerj12

13. @roesslerj13

14. @roesslerj14

15. @roesslerj15

16. @roesslerj16
Live Demo: SW Changes

17. @roesslerj17

18. @roesslerj18
RecheckDriver
findElement(by.id())
FirefoxDriver
findElement(by.bestMatch())
GoldenMaster

19. @roesslerj19
Multilocators

20. @roesslerj20

21. @roesslerj21
Live Demo:
Unbreakable Changes

22. @roesslerj22

23. @roesslerj
automated
regression test
≠
test
23

24. @roesslerj
automated
regression test
=
version control
24

25. @roesslerj25

26. @roesslerj26

27. @roesslerj27
Close the Gap:
automated Tests

28. @roesslerj28
https://github.com/retest/recheck-web

29. @roesslerj
@roesslerjX
test
1.0
approve
1.1
diff
train
user
automate
@roesslerjX
https://github.com/retest/recheck-web
29
Summary
Difference Testing
little maintenance
no wasteful testing
yet more complete
Monkey-Testing:
cheaper
faster
multiplies manual tests

30. @roesslerj30

31. @roesslerj31
Oracle
Problem

32. @roesslerj32

33. @roesslerj33

34. @roesslerj
Oracle Problem
34

35. @roesslerj
Oracle Problem
35

36. @roesslerj36
How do you bring AIinto testing?
test automation?

37. @roesslerj37
Infinite-Monkey-Theorem:
A monkey hitting keys at random on a typewriter
for a long enough time
will type the complete works of William Shakespeare.

38. @roesslerj38
We replace the typewriter with a computer…

39. @roesslerj39
public static void main(String... args) throws Exception {
Robot robot = new Robot();
while (true) {
robot.mouseMove(random.nextInt(maxX), random.nextInt(maxY));
robot.mousePress(InputEvent.BUTTON1_DOWN_MASK);
robot.mouseRelease(InputEvent.BUTTON1_DOWN_MASK);
robot.delay(200);
for (char inputChar : randomString().toCharArray()) {
robot.keyPress((int) inputChar);
robot.keyRelease((int) inputChar);
robot.delay(10);
}
robot.keyPress(KeyEvent.VK_ENTER);
robot.keyRelease(KeyEvent.VK_ENTER);
}
}
1.
2.
3.
4.
5.
6.
7.
8.
9.
10.
11.
12.
13.
14.
15.
16.

40. @roesslerj40
DEMO

41. @roesslerj41

42. @roesslerj42
- gremlins.js
- NetFlix Chaos Monkey
- UI/Application Exerciser Monkey

43. @roesslerj43

44. @roesslerj44

45. @roesslerj
1.
2.
3.
4.
5.
6.
7.
8.
9.
10.
11.
12.
13.
14. 45
public static void main(String... args) throws Exception {
WebDriver driver = new FirefoxDriver();
driver.get("http://www.retest.de");
while (true) {
List<WebElement> links = driver.findElements(By.tagName("a"));
links.get(random.nextInt(links.size())).click();
Thread.sleep(500);
List<WebElement> fields =
driver.findElements(By.xpath("//input[@type='text']"));
WebElement field = fields.get(random.nextInt(fields.size()));
field.sendKeys(randomString());
Thread.sleep(500);
}
}

46. @roesslerj46
Intelligent Monkey
DEMO

47. @roesslerj47

48. @roesslerj48

49. @roesslerj49

50. @roesslerj50

51. @roesslerj51
Problem Space
Problem
Space

52. @roesslerj52

53. @roesslerj53

54. @roesslerj54

55. @roesslerj55

56. @roesslerj56

57. @roesslerj57
train
AI
Artificial
Neural Net
Genetic
Algorithm
AI

58. @roesslerj58
https://code.fb.com/developer-tools/sapienz-intelligent-automated-software-testing-at-scale/

59. @roesslerj59
test
1.0
approve
1.1
diff
train
user
automate

60. @roesslerj60

61. @roesslerj61
https://code.fb.com/developer-tools/finding-and-fixing-software-bugs-automatically-with-sapfix-and-sapienz/
Automatically Fixing Bugs

62. @roesslerj62

63. @roesslerj
@roesslerjX
test
1.0
approve
1.1
diff
train
user
automate
@roesslerjX
https://github.com/retest/recheck-web
63
Summary
Difference Testing
little maintenance
no wasteful testing
yet more complete
Monkey-Testing:
cheaper
faster
multiplies manual tests

64. @roesslerj64
roessler@retest.de
https://www.facebook.com/retest.de
http://retest.rocks