Testing Without Assertions

@roesslerj1
Dr. Jeremias Rößler (Roessler)
https://retest.de
Test Automation
without Assertions

@roesslerj2
Please star us on GitHub!
Everyone who gives us a GitHub star, gets a sticker.

@roesslerj3
expect(umbrellaOpens).toBe(true)
tests: 1 passed, 1 total
**all tests passed**

@roesslerj5
We do one thing different.

@roesslerj6
You don’t define the outcome,
you approve it.
First you ensure that everything is as wanted.
Then we make sure it doesn’t change.

@roesslerj7
automated tests
≠
tests

@roesslerj8
automated tests
=
version control

@roesslerj9
Where has the
Code changed?

@roesslerj11
Where has the
_Software_ changed?

@roesslerj12
Closing the gap:
automated tests

@roesslerj13
automated tests
=
version control

@roesslerj22
Two Challenges:
1) Noise
2) Redundancy

@roesslerj24
automated tests
=
version control

@roesslerj25
*.log
*.class
target/.*
.gitignore
Ignore-List
of changes
Deny-List
of changes
check

everything
check

nothing

@roesslerj27
Ignore-List
of changes
Deny-List
of changes
check

everything
check

nothing

@roesslerj28
Ignore-List
of changes
Deny-List
of changes
check

everything
check

nothing

@roesslerj30
# These files are ignored by git
# based on their name:
*.log
*.class
target/.*
.gitignore

@roesslerj31
# Ignore file for recheck.
# Ignore attributes globally:
attribute=class
.retest/recheck.ignore

@roesslerj32
# Ignore attributes with regex:
attribute-regex=.*

@roesslerj33
# Ignore elements by tag:
matcher: type=a

@roesslerj34
# Ignore elements by attribute:
matcher: id=banner

@roesslerj35
# These can be combined:
matcher: id=div-b4f23, attribute-regex: font.*

@roesslerj36
# Ignore whole subtrees:
matcher: xpath=HTML[1]/BODY[1]/DIV[1]/DIV[1]/DIV[1]

@roesslerj37
ignore ≈ ﬁlter

@roesslerj38
Better than pixel difﬁng

@roesslerj40

@roesslerj41
Works with animations

@roesslerj
RedundancyRedundancyRedundancy
42
Redundancy

@roesslerj46
new version
findElement(by.id(“sign-in”))
ID changed
use
new element
and log
find in
old version
old version
breaks
create 1-on-1
assignment
new version
best match

@roesslerj47
*************** recheck warning ***************
The HTML id attribute used for element identification changed
from 'username' to 'asda'.
retest identified the element based on the persisted Golden
Master.
If you apply these changes to the Golden Master , your test
de.retest.recheck.example.MyUnbreakableSeleniumTest will
break.
Use `By.id("asda")` or `By.retestId("username-1")` to update
your test MyUnbreakableSeleniumTest.java:27.

@roesslerj48
ﬁndByRetestId
best match
return Element
ﬁnd in
Golden Master
1-on-1 Assignment
Test

@roesslerj51
data-independent tests

@roesslerj52
+ rule-based deterministic ignore
+ open source
+ oﬄine usage
+ unbreakable selenium
+ works for any technical interface
recheck beneﬁts:

@roesslerj53
some Feedback
… I was thrilled by that
product and new
approach…
… let me congratulate you on your brilliant
idea of the unbreakable Selenium and the
web page difference checking solutions. I
think this is a very much needed solution in
the website testing ﬁeld.
Ahmed Magdy
Michael Wowro
… the tool is very helpful, gives detailed
information and is easy to use …
Karolina Wierbol

@roesslerj54
https://github.com/retest/recheck-web

@roesslerj55
https://github.com/retest/recheck-web-chrome-extension

@roesslerj56
Our Business Model

@roesslerj
new version
findElement(by.id(“sign-in”))
ID changed
use
new element
and log
find in
old version
old version
breaks
create 1-on-1
assignment
new version
best match
@roesslerjX
57
Difference Testing
whitelist testing
easy creation
easy maintenance
Unbreakable Selenium:
easy to use
deﬁne own ids
data-independent tests
Summary

@roesslerj58
roessler@retest.de
https://www.facebook.com/retest.de
http://retest.rocks
@roesslerj
Please star us on GitHub!

Testing Without Assertions

More Related Content

What's hot

Similar to Testing Without Assertions

More from SAP SE

Recently uploaded

Testing Without Assertions