QA Fest 2017. Jeremias Rößler. Applying AI to testing

@roesslerj
1
Applying AI to Testing
Dr. Jeremias Rößler
Kyiv 2017

@roesslerj
7
How do you bring AIinto testing?

@roesslerj
8
AI in Testing?
– so far I do not see anyone doing it
in a useful way.
Antony Edwards,
CTO of TestPlant
“

@roesslerj
“
9
AI in Testautomation is a hype.
Wolfgang Platz,
Founder & CPO of Tricentis

@roesslerj
10
I think there is a world market
for maybe ﬁve computers.“
Thomas J. Watson
CEO of IBM

@roesslerj
11
Goal of Testing?

@roesslerj
12
When is a bug a bug?
When it’s not a feature!

@roesslerj
13
1.if (name[0] == '.') continue;
Is it a bug?
.
..
text.c
other.files

@roesslerj
16
Without speciﬁcation,
there are no bugs
— only surprises.
Brian Kernighan
“

@roesslerj
17
Why do we test?
After
implementation?
1 + 1 = 3
2 + 2 = 4

@roesslerj
21
Why do we test?
After
implementation?
1 + 1 = 3
2 + 2 = 4
After
change?
1 + 1 = 3
1 + 1 = 5

@roesslerj
regression-test
≠
test
22

@roesslerj
regression-test
=
version control
23

@roesslerj
37
How do you bring AIinto testing?

@roesslerj
38
Inﬁnite-Monkey-Theorem:
A monkey hitting keys at random on a typewriter
for a long enough time
will type the complete works of William Shakespeare.

@roesslerj
39
We replace the typewriter with a computer…

@roesslerj
Inﬁnite Monkey
40
public static void main(String... args) throws Exception {
Robot robot = new Robot();
while (true) {
robot.mouseMove(random.nextInt(maxX), random.nextInt(maxY));
robot.mousePress(InputEvent.BUTTON1_DOWN_MASK);
robot.mouseRelease(InputEvent.BUTTON1_DOWN_MASK);
robot.delay(200);
for (char inputChar : randomString().toCharArray()) {
robot.keyPress((int) inputChar);
robot.keyRelease((int) inputChar);
robot.delay(10);
}
robot.keyPress(KeyEvent.VK_ENTER);
robot.keyRelease(KeyEvent.VK_ENTER);
}
}
1.
2.
3.
4.
5.
6.
7.
8.
9.
10.
11.
12.
13.
14.
15.
16.

@roesslerj
41
DEMO
Inﬁnite Monkey

@roesslerj
Smart Monkey
45
public static void main(String... args) throws Exception {
WebDriver driver = new FirefoxDriver();
driver.get("http://www.retest.de");
while (true) {
List<WebElement> links = driver.findElements(By.tagName("a"));
links.get(random.nextInt(links.size())).click();
Thread.sleep(500);
List<WebElement> fields =
driver.findElements(By.xpath("//input[@type='text']"));
WebElement field = fields.get(random.nextInt(fields.size()));
field.sendKeys(randomString());
Thread.sleep(500);
}
}
1.
2.
3.
4.
5.
6.
7.
8.
9.
10.
11.
12.
13.
14.

@roesslerj
46
Smart Monkey
DEMO

@roesslerj
49
- gremlins.js
- NetFlix Chaos Monkey
- UI/Application Exerciser Monkey
Open Source Products

@roesslerj
53
How many blondes does it need
to screw in a light bulb?
http://www.smbc-comics.com/comic/humor
None, because automation has
eliminated the need for humans.

@roesslerj
“
54
AI is perfectly suited to replace testing.
Jason Arbon,
Founder & CPO of AppDiff

@roesslerj
57
Be afraid if:
- test automation engineer
- manual automate

@roesslerj
59
Intelligenter Affe
Summary
Monkey-Testing:
cheaper
faster
better
multiplies manual tests
Difference Testing
little maintenance
no wasteful testing
yet more complete

@roesslerj
61
@Test
public void test_login() throws Exception {
final WebDriver driver = new FirefoxDriver();
driver.get( "http://www.retest.de" );
recheck.check( driver );
driver.findElement( By.id( "username" ) ).sendKeys( username );
driver.findElement( By.id( "pwd" ) ).sendKeys( password );
driver.findElement( By.className( "button" ) ).submit();
recheck.check( driver );
}

@roesslerj
62
PDF
Excel
XML
HTML
Proprietary

@roesslerj
63
http://retest.rocks
@ReTest_en

@roesslerj
Questions?
https://www.facebook.com/retest.de
http://retest.rocksroessler@retest.de
The largest software testing conference in Ukraine

QA Fest 2017. Jeremias Rößler. Applying AI to testing

QA Fest 2017. Jeremias Rößler. Applying AI to testing

Recommended

More Related Content

What's hot

What's hot(20)

Similar to QA Fest 2017. Jeremias Rößler. Applying AI to testing

Similar to QA Fest 2017. Jeremias Rößler. Applying AI to testing(20)

More from QAFest

More from QAFest(20)

Recently uploaded

Recently uploaded(20)

QA Fest 2017. Jeremias Rößler. Applying AI to testing