The testing profession will be highly impacted by Artificial Intelligence (AI), Robotics and other Intelligent Machines. This presentation gives an overview of the topics in our book "Testing in the digital age". It is about Testing OF intelligent machines and about Testing WITH intelligent machines. Our vision is that testing will evolve from reactive test execution through active monitoring towards quality forecasting.

1. Welcome

2. Testing…
in the digital age
AI makes the difference
Booklaunch
12 September 2018
Rik Marselis

3. |
Who has a robot?
© Sogeti 2018 4
Who has a robot? In 10 years all of you will !!

4. 1980
Rik Marselis@rikmarselis
2007 2012 20122008
Workgroup
-member
20142009
Management consultant
Digital assurance & testing

5. |
➔ People first !!
© Sogeti 2018 7

6. |
Audio: A personal assistant using AI
© Sogeti 2018 8

7. |
Visual: Image recognition using AI
© Sogeti 2018 9
How hard can it be?

8. |
True intelligence
Cognitive =
“knowing and perceiving”
Source of pictures: Film “Wargames” 1983 © Sogeti 2018 10

9. |
What feelings do intelligent machines give?
Fear
or
Happiness
??
These are the covers of 2 reports in the series of publications of SogetiLabs’s VINT-team © Sogeti 2018 11

10. |
The evolution of the testing & quality profession
Computers are around since the 1940’s.
Testing started to be seen as a separate skill-set in the 1970’s.
Quality assurance is highly valued since the 1980’s.
Testing is a profession in its own right since the 1990’s.
Let’s have a look at what testing and quality assurance
in general are all about…
© Sogeti 2018 12

11. |13Sogeti PowerPoint Referentie 2014
Classical testing

12. |14Sogeti PowerPoint Referentie 2014
Monitoring

13. |
Forecasting

14. |
Logical evolution: from testing, to monitoring …
© Sogeti 2018 16

15. |
… to quality forecasting
© Sogeti 2018 17
Reactive Active Proactive

16. |
Quality forecasting
© Sogeti 2018 18

17. |
Why do we still need humans for forecasting?
The AI-powered models do the forecasting.
Based on huge volumes of data.
But how to decide which is the most
likely scenario?
In the near future we still need a human,
to choose and select from the outcomes.
Because this involves vision, reasoning
& judgement.
Just like the weather man.
© Sogeti 2018 19

18. |
Five hops to the holy grail of quality
© Sogeti 2018 20

19. |
There’s a big difference between…
© Sogeti 2018 21
Testing OF and testing WITH
intelligent machines
The 5 hops refer to both.

20. |
Example: Use a robot for testing
© Sogeti 2018 22

21. |
Fitting data…
© Sogeti 2018 23

22. |
Test and monitor the input…
© Sogeti 2018 24

23. |
Example: Use a digital twin
© Sogeti 2018 25

24. |
AI-powered testing
Smart dashboarding
Intelligent test automation
Cognitive test case selection
© Sogeti 2018 26

25. |
AI-powered models support forecasting
© Sogeti 2018 27

26. |
How to test
intelligent
machines?
© Sogeti 2018 28
Traditional testing Digital testing
Six angles
of quality!

27. |
Testing intelligent machines is different…
© Sogeti 2018 29
Traditional testing compares
expected and actual outcome.
For intelligent machines predicting
outcome is difficult; todays
correct result may differ from
tomorrows correct result, so:
- Define tolerances
- Control input
- Test the machine in its
intended environment
- Use new quality characteristics

28. |
New quality characteristics for digital testing
30© Sogeti 2018

29. |© Sogeti 2018 31
Super intelligence & super stupidity
Photo from the film “Ex Machina” 2015

30. |Morality: Ethics & Privacy
Scene from the film “Robot and Frank” 2012

31. |
Personality - mood
© Sogeti 2018 33
Personality: mood & humor

32. |
Testing in the digital age ➔ overview/recap
© Sogeti 2018 34

33. | 35

34. Questions?

35. |
Thanks for your attention. Have fun with AI !!
The authors: Humayun Shaukat (DE), Tom van de Ven (NL) and Rik Marselis (NL) © Sogeti 2018 42

36. Happy Testing!
in the digital age
AI makes the difference!