SlideShare a Scribd company logo
Testing…
in the digital age
AI makes the difference
Booklaunch
German Testing Days, Frankfurt, 8 June 2018
Rik Marselis
|
Who has a robot?
© Sogeti 2018 2
Who has a robot? In 10 years all of you will !!
1980
Rik Marselis@rikmarselis
2007 2012 20122008
Workgroup
-member
20142009
Management consultant
Digital assurance & testing
|
The future of testing: quality forecasting
© Sogeti 2018 4
|
Would you like to work with a robot?
© Sogeti 2018 5
|
Cobotics: collaborating with robots
© Sogeti 2018 6
|
Exoskeleton: robot gives extra muscle-power
© Sogeti 2018 7
Ruben de Sain crowdfunded his
exoskeleton to get out of his
wheelchair.
|
What are your fears about intelligent machines?
© Sogeti 2018 8
|
The Frankenstein factor: fear of AI
© Sogeti 2018 9Source: SogetiLabs “The Frankenstein Factor”
|© Sogeti 2018 10
Super intelligence & super stupidity
Foto uit de film “Ex Machina” 2015
|
Two more general worries
Loss of culture and defeating nature
© Sogeti 2018 11
|
Let’s cope with these fears in a scientific way…
© Sogeti 2018 12
|
Six angles of quality
© Sogeti 2018 13
Existing knowledge New knowledge
|
Mechanical, Electrical, Information processing
© Sogeti 2018 14
No. 2001 is seen on the rollers at the Vitry test plant
Gresley Society Collection, 1934
Testing an electric stove,
1970’s © handyman
The 7 generic testing activities of
TMap® 1995/2006
Existing knowledge
But still very relevant,
also for testing
intelligent machines.
|
Testing intelligent machines is different…
© Sogeti 2018 15
Traditional testing compares
expected and actual outcome.
For intelligent machines predicting
outcome is difficult; todays
correct result may differ from
tomorrows correct result, so:
- Define tolerances
- Control input
- Test the machine in its
intended environment
- Use new quality characteristics
|
ISO25010 – Product Quality characteristics
© Sogeti 2018 16
|
ISO25010 extended quality characteristics
© Sogeti 2018 17
|
The new quality characteristics
© Sogeti 2018 18
|
Machine learning – ability to learn
© Sogeti 2017 19
<<< vervangen door filmclip >>>
This is what machine learning looked like ☺ Scene from the film “Short circuit” (1986)
|
Ability to learn and to unlearn
Machine learning
• Continued learning
• Frozen
Examination
• One-time
• Continuous
Un-learning
© Sogeti 2018 20
Video:
Unlearning and
relearning to
ride a bicycle
|
How to unlearn AI’s ?
Rule-based AI:
• Change the programmed rules
Reinformement learning AI:
• Change goal(s)
• Control input
• Feed new learning data
© Sogeti 2018 21
U N
|Morality: Ethics & Privacy
Scene from the film “Robot and Frank” 2012
|
Scene from documentary
“I am Alice” 2015
Morality: Ethics & Privacy
|
Personality - mood
© Sogeti 2018 24
Personality: mood & humor
|
now let’s look at
testing WITH them
Well, this was all about
testing OF
intelligent machines,
25© Sogeti 2018
|
Robot automatically performs regression tests
© Sogeti 26
Video that shows how Sogeti does regression testing of a cockpit at Airbus
|
Robot automatically performs regression tests
© Sogeti 2017 27
Low-cost
(€300,-)
robot-arm
tests mobile
devices.
Connected
to test ma-
nagement
tool.
Test cases
check if
the quality
goals are
met and
risks are
covered.
|
Use a digital twin to virtually test a product…
© Sogeti 2018 28
|
More testing in less time
© Sogeti 2018 29
|
The future of testing: quality forecasting
© Sogeti 2018 30
|
Forecasting using multiple models
© Sogeti 2018 31
The tester will interpret the outcome of multiple
models and create the advice for the stakeholders
|
Cognitive QA – for example: smart dashboards
© Sogeti 2018 32
|Sogeti PowerPoint Referentie 2014 33
Thank you.
This book was introduced on 1 June 2018
Humayun Shaukat Tom van de Ven Rik Marselis
© Sogeti 2018

More Related Content

Similar to Testing in the digital age; international booklaunch at German Testing Day

Magic of Automation and Everyday Chores.pptx
Magic of Automation and Everyday Chores.pptxMagic of Automation and Everyday Chores.pptx
Magic of Automation and Everyday Chores.pptx
Jamie Coleman
 
CWIN17 Toulouse / How robotics as a service improves your industrial perform...
CWIN17 Toulouse / How robotics as a service improves  your industrial perform...CWIN17 Toulouse / How robotics as a service improves  your industrial perform...
CWIN17 Toulouse / How robotics as a service improves your industrial perform...
Capgemini
 
OneBot: A Comprehensive Case Study on Enterprise Digital Assistants
OneBot: A Comprehensive Case Study on Enterprise Digital AssistantsOneBot: A Comprehensive Case Study on Enterprise Digital Assistants
OneBot: A Comprehensive Case Study on Enterprise Digital Assistants
Soham Dasgupta
 
“Automotive Vision – What’s Growing, What’s Not, and Why?,” a Presentation fr...
“Automotive Vision – What’s Growing, What’s Not, and Why?,” a Presentation fr...“Automotive Vision – What’s Growing, What’s Not, and Why?,” a Presentation fr...
“Automotive Vision – What’s Growing, What’s Not, and Why?,” a Presentation fr...
Edge AI and Vision Alliance
 
Accelerating Machine Learning Adoption in the Automotive Industry
Accelerating Machine Learning Adoption in the Automotive IndustryAccelerating Machine Learning Adoption in the Automotive Industry
Accelerating Machine Learning Adoption in the Automotive Industry
BigML, Inc
 
Digital transformation continues to drive IT strategy, How is QA and testing ...
Digital transformation continues to drive IT strategy, How is QA and testing ...Digital transformation continues to drive IT strategy, How is QA and testing ...
Digital transformation continues to drive IT strategy, How is QA and testing ...
QA or the Highway
 
Sensors for robotic vehicles 2018 report by yole developpement i-micronews
Sensors for robotic vehicles 2018 report by yole developpement i-micronewsSensors for robotic vehicles 2018 report by yole developpement i-micronews
Sensors for robotic vehicles 2018 report by yole developpement i-micronews
Yole Developpement
 
Collaborative edge intelligence-mihir punjabi and sunil kumar jang bahadur_cw...
Collaborative edge intelligence-mihir punjabi and sunil kumar jang bahadur_cw...Collaborative edge intelligence-mihir punjabi and sunil kumar jang bahadur_cw...
Collaborative edge intelligence-mihir punjabi and sunil kumar jang bahadur_cw...
Capgemini
 
GAIBT Pune - Future of AI.pptx
GAIBT Pune - Future of AI.pptxGAIBT Pune - Future of AI.pptx
GAIBT Pune - Future of AI.pptx
Luis Beltran
 
Cwin16 tls cnes-realite_augmentee_eng_v1 2
Cwin16 tls cnes-realite_augmentee_eng_v1 2Cwin16 tls cnes-realite_augmentee_eng_v1 2
Cwin16 tls cnes-realite_augmentee_eng_v1 2
Capgemini
 
Experiment Management for the Enterprise
Experiment Management for the EnterpriseExperiment Management for the Enterprise
Experiment Management for the Enterprise
SigOpt
 
Agile Adventures: Developers vs. Testers
Agile Adventures: Developers vs. TestersAgile Adventures: Developers vs. Testers
Agile Adventures: Developers vs. Testers
Konstantinos Karamichalis
 
CWIN17 Toulouse / Virtual reality to improve the training path of soldiers m....
CWIN17 Toulouse / Virtual reality to improve the training path of soldiers m....CWIN17 Toulouse / Virtual reality to improve the training path of soldiers m....
CWIN17 Toulouse / Virtual reality to improve the training path of soldiers m....
Capgemini
 
Ac ford innovation day-fina lv2
Ac ford innovation day-fina lv2Ac ford innovation day-fina lv2
Ac ford innovation day-fina lv2
Atakan Cetinsoy
 
Introduction to CW (Cambridge Wireless) Future Devices & Technologies Group (...
Introduction to CW (Cambridge Wireless) Future Devices & Technologies Group (...Introduction to CW (Cambridge Wireless) Future Devices & Technologies Group (...
Introduction to CW (Cambridge Wireless) Future Devices & Technologies Group (...
3G4G
 
My failed projects & lessons learned
My failed projects & lessons learnedMy failed projects & lessons learned
My failed projects & lessons learned
Laihioh Yeh
 
Pragmatic use of artificial intelligence in smart cities 03262018
Pragmatic use of artificial intelligence in smart cities 03262018Pragmatic use of artificial intelligence in smart cities 03262018
Pragmatic use of artificial intelligence in smart cities 03262018
ThomasCook16
 
The Smartest Smart Cities Will Benefit from the Confluence of AI and Big Data...
The Smartest Smart Cities Will Benefit from the Confluence of AI and Big Data...The Smartest Smart Cities Will Benefit from the Confluence of AI and Big Data...
The Smartest Smart Cities Will Benefit from the Confluence of AI and Big Data...
Echelon Corporation
 
Data & Analytics trends STKI summit 2016
Data & Analytics trends STKI summit 2016Data & Analytics trends STKI summit 2016
Data & Analytics trends STKI summit 2016
Einat Shimoni
 
When IGA meets PAM ... through their mutual friend SCIM
When IGA meets PAM ... through their mutual friend SCIMWhen IGA meets PAM ... through their mutual friend SCIM
When IGA meets PAM ... through their mutual friend SCIM
Kelly Grizzle
 

Similar to Testing in the digital age; international booklaunch at German Testing Day (20)

Magic of Automation and Everyday Chores.pptx
Magic of Automation and Everyday Chores.pptxMagic of Automation and Everyday Chores.pptx
Magic of Automation and Everyday Chores.pptx
 
CWIN17 Toulouse / How robotics as a service improves your industrial perform...
CWIN17 Toulouse / How robotics as a service improves  your industrial perform...CWIN17 Toulouse / How robotics as a service improves  your industrial perform...
CWIN17 Toulouse / How robotics as a service improves your industrial perform...
 
OneBot: A Comprehensive Case Study on Enterprise Digital Assistants
OneBot: A Comprehensive Case Study on Enterprise Digital AssistantsOneBot: A Comprehensive Case Study on Enterprise Digital Assistants
OneBot: A Comprehensive Case Study on Enterprise Digital Assistants
 
“Automotive Vision – What’s Growing, What’s Not, and Why?,” a Presentation fr...
“Automotive Vision – What’s Growing, What’s Not, and Why?,” a Presentation fr...“Automotive Vision – What’s Growing, What’s Not, and Why?,” a Presentation fr...
“Automotive Vision – What’s Growing, What’s Not, and Why?,” a Presentation fr...
 
Accelerating Machine Learning Adoption in the Automotive Industry
Accelerating Machine Learning Adoption in the Automotive IndustryAccelerating Machine Learning Adoption in the Automotive Industry
Accelerating Machine Learning Adoption in the Automotive Industry
 
Digital transformation continues to drive IT strategy, How is QA and testing ...
Digital transformation continues to drive IT strategy, How is QA and testing ...Digital transformation continues to drive IT strategy, How is QA and testing ...
Digital transformation continues to drive IT strategy, How is QA and testing ...
 
Sensors for robotic vehicles 2018 report by yole developpement i-micronews
Sensors for robotic vehicles 2018 report by yole developpement i-micronewsSensors for robotic vehicles 2018 report by yole developpement i-micronews
Sensors for robotic vehicles 2018 report by yole developpement i-micronews
 
Collaborative edge intelligence-mihir punjabi and sunil kumar jang bahadur_cw...
Collaborative edge intelligence-mihir punjabi and sunil kumar jang bahadur_cw...Collaborative edge intelligence-mihir punjabi and sunil kumar jang bahadur_cw...
Collaborative edge intelligence-mihir punjabi and sunil kumar jang bahadur_cw...
 
GAIBT Pune - Future of AI.pptx
GAIBT Pune - Future of AI.pptxGAIBT Pune - Future of AI.pptx
GAIBT Pune - Future of AI.pptx
 
Cwin16 tls cnes-realite_augmentee_eng_v1 2
Cwin16 tls cnes-realite_augmentee_eng_v1 2Cwin16 tls cnes-realite_augmentee_eng_v1 2
Cwin16 tls cnes-realite_augmentee_eng_v1 2
 
Experiment Management for the Enterprise
Experiment Management for the EnterpriseExperiment Management for the Enterprise
Experiment Management for the Enterprise
 
Agile Adventures: Developers vs. Testers
Agile Adventures: Developers vs. TestersAgile Adventures: Developers vs. Testers
Agile Adventures: Developers vs. Testers
 
CWIN17 Toulouse / Virtual reality to improve the training path of soldiers m....
CWIN17 Toulouse / Virtual reality to improve the training path of soldiers m....CWIN17 Toulouse / Virtual reality to improve the training path of soldiers m....
CWIN17 Toulouse / Virtual reality to improve the training path of soldiers m....
 
Ac ford innovation day-fina lv2
Ac ford innovation day-fina lv2Ac ford innovation day-fina lv2
Ac ford innovation day-fina lv2
 
Introduction to CW (Cambridge Wireless) Future Devices & Technologies Group (...
Introduction to CW (Cambridge Wireless) Future Devices & Technologies Group (...Introduction to CW (Cambridge Wireless) Future Devices & Technologies Group (...
Introduction to CW (Cambridge Wireless) Future Devices & Technologies Group (...
 
My failed projects & lessons learned
My failed projects & lessons learnedMy failed projects & lessons learned
My failed projects & lessons learned
 
Pragmatic use of artificial intelligence in smart cities 03262018
Pragmatic use of artificial intelligence in smart cities 03262018Pragmatic use of artificial intelligence in smart cities 03262018
Pragmatic use of artificial intelligence in smart cities 03262018
 
The Smartest Smart Cities Will Benefit from the Confluence of AI and Big Data...
The Smartest Smart Cities Will Benefit from the Confluence of AI and Big Data...The Smartest Smart Cities Will Benefit from the Confluence of AI and Big Data...
The Smartest Smart Cities Will Benefit from the Confluence of AI and Big Data...
 
Data & Analytics trends STKI summit 2016
Data & Analytics trends STKI summit 2016Data & Analytics trends STKI summit 2016
Data & Analytics trends STKI summit 2016
 
When IGA meets PAM ... through their mutual friend SCIM
When IGA meets PAM ... through their mutual friend SCIMWhen IGA meets PAM ... through their mutual friend SCIM
When IGA meets PAM ... through their mutual friend SCIM
 

More from Rik Marselis

The End Of Testing As We Know It (TestCon - Rik Marselis).pdf
The End Of Testing As We Know It (TestCon - Rik Marselis).pdfThe End Of Testing As We Know It (TestCon - Rik Marselis).pdf
The End Of Testing As We Know It (TestCon - Rik Marselis).pdf
Rik Marselis
 
TestExpo Quality Engineering & Sustainability
TestExpo Quality Engineering & Sustainability TestExpo Quality Engineering & Sustainability
TestExpo Quality Engineering & Sustainability
Rik Marselis
 
GTR-The End Of Testing As We Know It
GTR-The End Of Testing As We Know ItGTR-The End Of Testing As We Know It
GTR-The End Of Testing As We Know It
Rik Marselis
 
Introduction of TMAP to representatives of ISTQB boards in the GA week in Mar...
Introduction of TMAP to representatives of ISTQB boards in the GA week in Mar...Introduction of TMAP to representatives of ISTQB boards in the GA week in Mar...
Introduction of TMAP to representatives of ISTQB boards in the GA week in Mar...
Rik Marselis
 
Quality Engineering in today's cross-functTeams with TMAP
Quality Engineering in today's cross-functTeams with TMAPQuality Engineering in today's cross-functTeams with TMAP
Quality Engineering in today's cross-functTeams with TMAP
Rik Marselis
 
Quality engineering instead of testing... Why? How?
Quality engineering instead of testing... Why? How?Quality engineering instead of testing... Why? How?
Quality engineering instead of testing... Why? How?
Rik Marselis
 
Quality Engineering and Testing with TMAP in DevOps IT delivery
Quality Engineering and Testing with TMAP in DevOps IT deliveryQuality Engineering and Testing with TMAP in DevOps IT delivery
Quality Engineering and Testing with TMAP in DevOps IT delivery
Rik Marselis
 
Quality engineering & testing in DevOps IT delivery with TMAP
Quality engineering & testing in DevOps IT delivery with TMAPQuality engineering & testing in DevOps IT delivery with TMAP
Quality engineering & testing in DevOps IT delivery with TMAP
Rik Marselis
 
Quality engineering in DevOps... Why? How? (TestBusters Day&Night))
Quality engineering in DevOps... Why? How? (TestBusters Day&Night))Quality engineering in DevOps... Why? How? (TestBusters Day&Night))
Quality engineering in DevOps... Why? How? (TestBusters Day&Night))
Rik Marselis
 
TMAP Quality Engineering workshop on A4Q congress by Rik Marselis
TMAP Quality Engineering workshop on A4Q congress by Rik Marselis TMAP Quality Engineering workshop on A4Q congress by Rik Marselis
TMAP Quality Engineering workshop on A4Q congress by Rik Marselis
Rik Marselis
 
Quality engineering in the digital age... Why? How? (ASQF Keynote by Rik Mars...
Quality engineering in the digital age... Why? How? (ASQF Keynote by Rik Mars...Quality engineering in the digital age... Why? How? (ASQF Keynote by Rik Mars...
Quality engineering in the digital age... Why? How? (ASQF Keynote by Rik Mars...
Rik Marselis
 
Quality for DevOps teams - Quality engineering in the DevOps culture
Quality for DevOps teams - Quality engineering in the DevOps cultureQuality for DevOps teams - Quality engineering in the DevOps culture
Quality for DevOps teams - Quality engineering in the DevOps culture
Rik Marselis
 
How to write a proposal to speak at a conference? Hints & tips
How to write a proposal to speak at a conference? Hints & tipsHow to write a proposal to speak at a conference? Hints & tips
How to write a proposal to speak at a conference? Hints & tips
Rik Marselis
 
Testen ISTQB, TMap, ISO25010 en meer. Gastcollege Windesheim Rik Marselis
Testen ISTQB, TMap, ISO25010 en meer. Gastcollege Windesheim Rik MarselisTesten ISTQB, TMap, ISO25010 en meer. Gastcollege Windesheim Rik Marselis
Testen ISTQB, TMap, ISO25010 en meer. Gastcollege Windesheim Rik Marselis
Rik Marselis
 
Over testen gesproken TestNet najaar 2019 openingskeynote Rik Marselis
Over testen gesproken TestNet najaar 2019 openingskeynote Rik MarselisOver testen gesproken TestNet najaar 2019 openingskeynote Rik Marselis
Over testen gesproken TestNet najaar 2019 openingskeynote Rik Marselis
Rik Marselis
 
Testing of artificial intelligence; AI quality engineering skils - an introdu...
Testing of artificial intelligence; AI quality engineering skils - an introdu...Testing of artificial intelligence; AI quality engineering skils - an introdu...
Testing of artificial intelligence; AI quality engineering skils - an introdu...
Rik Marselis
 
Webinar trends in testen 2017-12-13 door Rik Marselis
Webinar trends in testen 2017-12-13 door Rik MarselisWebinar trends in testen 2017-12-13 door Rik Marselis
Webinar trends in testen 2017-12-13 door Rik Marselis
Rik Marselis
 
Ketenregie in Agile / DevOps: Noodzaak? (oplossing: Gilde, SAFe, combi ...)
Ketenregie in Agile / DevOps: Noodzaak? (oplossing: Gilde, SAFe, combi ...)Ketenregie in Agile / DevOps: Noodzaak? (oplossing: Gilde, SAFe, combi ...)
Ketenregie in Agile / DevOps: Noodzaak? (oplossing: Gilde, SAFe, combi ...)
Rik Marselis
 
Webinar trends in testing 2017 03 08 (in dutch)
Webinar trends in testing 2017 03 08 (in dutch)Webinar trends in testing 2017 03 08 (in dutch)
Webinar trends in testing 2017 03 08 (in dutch)
Rik Marselis
 
Past het testvak nog in de nieuwe IT-wereld?
Past het testvak nog in de nieuwe IT-wereld?Past het testvak nog in de nieuwe IT-wereld?
Past het testvak nog in de nieuwe IT-wereld?
Rik Marselis
 

More from Rik Marselis (20)

The End Of Testing As We Know It (TestCon - Rik Marselis).pdf
The End Of Testing As We Know It (TestCon - Rik Marselis).pdfThe End Of Testing As We Know It (TestCon - Rik Marselis).pdf
The End Of Testing As We Know It (TestCon - Rik Marselis).pdf
 
TestExpo Quality Engineering & Sustainability
TestExpo Quality Engineering & Sustainability TestExpo Quality Engineering & Sustainability
TestExpo Quality Engineering & Sustainability
 
GTR-The End Of Testing As We Know It
GTR-The End Of Testing As We Know ItGTR-The End Of Testing As We Know It
GTR-The End Of Testing As We Know It
 
Introduction of TMAP to representatives of ISTQB boards in the GA week in Mar...
Introduction of TMAP to representatives of ISTQB boards in the GA week in Mar...Introduction of TMAP to representatives of ISTQB boards in the GA week in Mar...
Introduction of TMAP to representatives of ISTQB boards in the GA week in Mar...
 
Quality Engineering in today's cross-functTeams with TMAP
Quality Engineering in today's cross-functTeams with TMAPQuality Engineering in today's cross-functTeams with TMAP
Quality Engineering in today's cross-functTeams with TMAP
 
Quality engineering instead of testing... Why? How?
Quality engineering instead of testing... Why? How?Quality engineering instead of testing... Why? How?
Quality engineering instead of testing... Why? How?
 
Quality Engineering and Testing with TMAP in DevOps IT delivery
Quality Engineering and Testing with TMAP in DevOps IT deliveryQuality Engineering and Testing with TMAP in DevOps IT delivery
Quality Engineering and Testing with TMAP in DevOps IT delivery
 
Quality engineering & testing in DevOps IT delivery with TMAP
Quality engineering & testing in DevOps IT delivery with TMAPQuality engineering & testing in DevOps IT delivery with TMAP
Quality engineering & testing in DevOps IT delivery with TMAP
 
Quality engineering in DevOps... Why? How? (TestBusters Day&Night))
Quality engineering in DevOps... Why? How? (TestBusters Day&Night))Quality engineering in DevOps... Why? How? (TestBusters Day&Night))
Quality engineering in DevOps... Why? How? (TestBusters Day&Night))
 
TMAP Quality Engineering workshop on A4Q congress by Rik Marselis
TMAP Quality Engineering workshop on A4Q congress by Rik Marselis TMAP Quality Engineering workshop on A4Q congress by Rik Marselis
TMAP Quality Engineering workshop on A4Q congress by Rik Marselis
 
Quality engineering in the digital age... Why? How? (ASQF Keynote by Rik Mars...
Quality engineering in the digital age... Why? How? (ASQF Keynote by Rik Mars...Quality engineering in the digital age... Why? How? (ASQF Keynote by Rik Mars...
Quality engineering in the digital age... Why? How? (ASQF Keynote by Rik Mars...
 
Quality for DevOps teams - Quality engineering in the DevOps culture
Quality for DevOps teams - Quality engineering in the DevOps cultureQuality for DevOps teams - Quality engineering in the DevOps culture
Quality for DevOps teams - Quality engineering in the DevOps culture
 
How to write a proposal to speak at a conference? Hints & tips
How to write a proposal to speak at a conference? Hints & tipsHow to write a proposal to speak at a conference? Hints & tips
How to write a proposal to speak at a conference? Hints & tips
 
Testen ISTQB, TMap, ISO25010 en meer. Gastcollege Windesheim Rik Marselis
Testen ISTQB, TMap, ISO25010 en meer. Gastcollege Windesheim Rik MarselisTesten ISTQB, TMap, ISO25010 en meer. Gastcollege Windesheim Rik Marselis
Testen ISTQB, TMap, ISO25010 en meer. Gastcollege Windesheim Rik Marselis
 
Over testen gesproken TestNet najaar 2019 openingskeynote Rik Marselis
Over testen gesproken TestNet najaar 2019 openingskeynote Rik MarselisOver testen gesproken TestNet najaar 2019 openingskeynote Rik Marselis
Over testen gesproken TestNet najaar 2019 openingskeynote Rik Marselis
 
Testing of artificial intelligence; AI quality engineering skils - an introdu...
Testing of artificial intelligence; AI quality engineering skils - an introdu...Testing of artificial intelligence; AI quality engineering skils - an introdu...
Testing of artificial intelligence; AI quality engineering skils - an introdu...
 
Webinar trends in testen 2017-12-13 door Rik Marselis
Webinar trends in testen 2017-12-13 door Rik MarselisWebinar trends in testen 2017-12-13 door Rik Marselis
Webinar trends in testen 2017-12-13 door Rik Marselis
 
Ketenregie in Agile / DevOps: Noodzaak? (oplossing: Gilde, SAFe, combi ...)
Ketenregie in Agile / DevOps: Noodzaak? (oplossing: Gilde, SAFe, combi ...)Ketenregie in Agile / DevOps: Noodzaak? (oplossing: Gilde, SAFe, combi ...)
Ketenregie in Agile / DevOps: Noodzaak? (oplossing: Gilde, SAFe, combi ...)
 
Webinar trends in testing 2017 03 08 (in dutch)
Webinar trends in testing 2017 03 08 (in dutch)Webinar trends in testing 2017 03 08 (in dutch)
Webinar trends in testing 2017 03 08 (in dutch)
 
Past het testvak nog in de nieuwe IT-wereld?
Past het testvak nog in de nieuwe IT-wereld?Past het testvak nog in de nieuwe IT-wereld?
Past het testvak nog in de nieuwe IT-wereld?
 

Recently uploaded

原版一比一利兹贝克特大学毕业证(LeedsBeckett毕业证书)如何办理
原版一比一利兹贝克特大学毕业证(LeedsBeckett毕业证书)如何办理原版一比一利兹贝克特大学毕业证(LeedsBeckett毕业证书)如何办理
原版一比一利兹贝克特大学毕业证(LeedsBeckett毕业证书)如何办理
wyddcwye1
 
DSSML24_tspann_CodelessGenerativeAIPipelines
DSSML24_tspann_CodelessGenerativeAIPipelinesDSSML24_tspann_CodelessGenerativeAIPipelines
DSSML24_tspann_CodelessGenerativeAIPipelines
Timothy Spann
 
Global Situational Awareness of A.I. and where its headed
Global Situational Awareness of A.I. and where its headedGlobal Situational Awareness of A.I. and where its headed
Global Situational Awareness of A.I. and where its headed
vikram sood
 
A presentation that explain the Power BI Licensing
A presentation that explain the Power BI LicensingA presentation that explain the Power BI Licensing
A presentation that explain the Power BI Licensing
AlessioFois2
 
一比一原版巴斯大学毕业证(Bath毕业证书)学历如何办理
一比一原版巴斯大学毕业证(Bath毕业证书)学历如何办理一比一原版巴斯大学毕业证(Bath毕业证书)学历如何办理
一比一原版巴斯大学毕业证(Bath毕业证书)学历如何办理
y3i0qsdzb
 
Build applications with generative AI on Google Cloud
Build applications with generative AI on Google CloudBuild applications with generative AI on Google Cloud
Build applications with generative AI on Google Cloud
Márton Kodok
 
一比一原版(UCSB文凭证书)圣芭芭拉分校毕业证如何办理
一比一原版(UCSB文凭证书)圣芭芭拉分校毕业证如何办理一比一原版(UCSB文凭证书)圣芭芭拉分校毕业证如何办理
一比一原版(UCSB文凭证书)圣芭芭拉分校毕业证如何办理
nuttdpt
 
Challenges of Nation Building-1.pptx with more important
Challenges of Nation Building-1.pptx with more importantChallenges of Nation Building-1.pptx with more important
Challenges of Nation Building-1.pptx with more important
Sm321
 
University of New South Wales degree offer diploma Transcript
University of New South Wales degree offer diploma TranscriptUniversity of New South Wales degree offer diploma Transcript
University of New South Wales degree offer diploma Transcript
soxrziqu
 
一比一原版(harvard毕业证书)哈佛大学毕业证如何办理
一比一原版(harvard毕业证书)哈佛大学毕业证如何办理一比一原版(harvard毕业证书)哈佛大学毕业证如何办理
一比一原版(harvard毕业证书)哈佛大学毕业证如何办理
taqyea
 
一比一原版(UCSF文凭证书)旧金山分校毕业证如何办理
一比一原版(UCSF文凭证书)旧金山分校毕业证如何办理一比一原版(UCSF文凭证书)旧金山分校毕业证如何办理
一比一原版(UCSF文凭证书)旧金山分校毕业证如何办理
nuttdpt
 
STATATHON: Unleashing the Power of Statistics in a 48-Hour Knowledge Extravag...
STATATHON: Unleashing the Power of Statistics in a 48-Hour Knowledge Extravag...STATATHON: Unleashing the Power of Statistics in a 48-Hour Knowledge Extravag...
STATATHON: Unleashing the Power of Statistics in a 48-Hour Knowledge Extravag...
sameer shah
 
Orchestrating the Future: Navigating Today's Data Workflow Challenges with Ai...
Orchestrating the Future: Navigating Today's Data Workflow Challenges with Ai...Orchestrating the Future: Navigating Today's Data Workflow Challenges with Ai...
Orchestrating the Future: Navigating Today's Data Workflow Challenges with Ai...
Kaxil Naik
 
writing report business partner b1+ .pdf
writing report business partner b1+ .pdfwriting report business partner b1+ .pdf
writing report business partner b1+ .pdf
VyNguyen709676
 
Population Growth in Bataan: The effects of population growth around rural pl...
Population Growth in Bataan: The effects of population growth around rural pl...Population Growth in Bataan: The effects of population growth around rural pl...
Population Growth in Bataan: The effects of population growth around rural pl...
Bill641377
 
原版制作(unimelb毕业证书)墨尔本大学毕业证Offer一模一样
原版制作(unimelb毕业证书)墨尔本大学毕业证Offer一模一样原版制作(unimelb毕业证书)墨尔本大学毕业证Offer一模一样
原版制作(unimelb毕业证书)墨尔本大学毕业证Offer一模一样
ihavuls
 
4th Modern Marketing Reckoner by MMA Global India & Group M: 60+ experts on W...
4th Modern Marketing Reckoner by MMA Global India & Group M: 60+ experts on W...4th Modern Marketing Reckoner by MMA Global India & Group M: 60+ experts on W...
4th Modern Marketing Reckoner by MMA Global India & Group M: 60+ experts on W...
Social Samosa
 
在线办理(英国UCA毕业证书)创意艺术大学毕业证在读证明一模一样
在线办理(英国UCA毕业证书)创意艺术大学毕业证在读证明一模一样在线办理(英国UCA毕业证书)创意艺术大学毕业证在读证明一模一样
在线办理(英国UCA毕业证书)创意艺术大学毕业证在读证明一模一样
v7oacc3l
 
Predictably Improve Your B2B Tech Company's Performance by Leveraging Data
Predictably Improve Your B2B Tech Company's Performance by Leveraging DataPredictably Improve Your B2B Tech Company's Performance by Leveraging Data
Predictably Improve Your B2B Tech Company's Performance by Leveraging Data
Kiwi Creative
 
Udemy_2024_Global_Learning_Skills_Trends_Report (1).pdf
Udemy_2024_Global_Learning_Skills_Trends_Report (1).pdfUdemy_2024_Global_Learning_Skills_Trends_Report (1).pdf
Udemy_2024_Global_Learning_Skills_Trends_Report (1).pdf
Fernanda Palhano
 

Recently uploaded (20)

原版一比一利兹贝克特大学毕业证(LeedsBeckett毕业证书)如何办理
原版一比一利兹贝克特大学毕业证(LeedsBeckett毕业证书)如何办理原版一比一利兹贝克特大学毕业证(LeedsBeckett毕业证书)如何办理
原版一比一利兹贝克特大学毕业证(LeedsBeckett毕业证书)如何办理
 
DSSML24_tspann_CodelessGenerativeAIPipelines
DSSML24_tspann_CodelessGenerativeAIPipelinesDSSML24_tspann_CodelessGenerativeAIPipelines
DSSML24_tspann_CodelessGenerativeAIPipelines
 
Global Situational Awareness of A.I. and where its headed
Global Situational Awareness of A.I. and where its headedGlobal Situational Awareness of A.I. and where its headed
Global Situational Awareness of A.I. and where its headed
 
A presentation that explain the Power BI Licensing
A presentation that explain the Power BI LicensingA presentation that explain the Power BI Licensing
A presentation that explain the Power BI Licensing
 
一比一原版巴斯大学毕业证(Bath毕业证书)学历如何办理
一比一原版巴斯大学毕业证(Bath毕业证书)学历如何办理一比一原版巴斯大学毕业证(Bath毕业证书)学历如何办理
一比一原版巴斯大学毕业证(Bath毕业证书)学历如何办理
 
Build applications with generative AI on Google Cloud
Build applications with generative AI on Google CloudBuild applications with generative AI on Google Cloud
Build applications with generative AI on Google Cloud
 
一比一原版(UCSB文凭证书)圣芭芭拉分校毕业证如何办理
一比一原版(UCSB文凭证书)圣芭芭拉分校毕业证如何办理一比一原版(UCSB文凭证书)圣芭芭拉分校毕业证如何办理
一比一原版(UCSB文凭证书)圣芭芭拉分校毕业证如何办理
 
Challenges of Nation Building-1.pptx with more important
Challenges of Nation Building-1.pptx with more importantChallenges of Nation Building-1.pptx with more important
Challenges of Nation Building-1.pptx with more important
 
University of New South Wales degree offer diploma Transcript
University of New South Wales degree offer diploma TranscriptUniversity of New South Wales degree offer diploma Transcript
University of New South Wales degree offer diploma Transcript
 
一比一原版(harvard毕业证书)哈佛大学毕业证如何办理
一比一原版(harvard毕业证书)哈佛大学毕业证如何办理一比一原版(harvard毕业证书)哈佛大学毕业证如何办理
一比一原版(harvard毕业证书)哈佛大学毕业证如何办理
 
一比一原版(UCSF文凭证书)旧金山分校毕业证如何办理
一比一原版(UCSF文凭证书)旧金山分校毕业证如何办理一比一原版(UCSF文凭证书)旧金山分校毕业证如何办理
一比一原版(UCSF文凭证书)旧金山分校毕业证如何办理
 
STATATHON: Unleashing the Power of Statistics in a 48-Hour Knowledge Extravag...
STATATHON: Unleashing the Power of Statistics in a 48-Hour Knowledge Extravag...STATATHON: Unleashing the Power of Statistics in a 48-Hour Knowledge Extravag...
STATATHON: Unleashing the Power of Statistics in a 48-Hour Knowledge Extravag...
 
Orchestrating the Future: Navigating Today's Data Workflow Challenges with Ai...
Orchestrating the Future: Navigating Today's Data Workflow Challenges with Ai...Orchestrating the Future: Navigating Today's Data Workflow Challenges with Ai...
Orchestrating the Future: Navigating Today's Data Workflow Challenges with Ai...
 
writing report business partner b1+ .pdf
writing report business partner b1+ .pdfwriting report business partner b1+ .pdf
writing report business partner b1+ .pdf
 
Population Growth in Bataan: The effects of population growth around rural pl...
Population Growth in Bataan: The effects of population growth around rural pl...Population Growth in Bataan: The effects of population growth around rural pl...
Population Growth in Bataan: The effects of population growth around rural pl...
 
原版制作(unimelb毕业证书)墨尔本大学毕业证Offer一模一样
原版制作(unimelb毕业证书)墨尔本大学毕业证Offer一模一样原版制作(unimelb毕业证书)墨尔本大学毕业证Offer一模一样
原版制作(unimelb毕业证书)墨尔本大学毕业证Offer一模一样
 
4th Modern Marketing Reckoner by MMA Global India & Group M: 60+ experts on W...
4th Modern Marketing Reckoner by MMA Global India & Group M: 60+ experts on W...4th Modern Marketing Reckoner by MMA Global India & Group M: 60+ experts on W...
4th Modern Marketing Reckoner by MMA Global India & Group M: 60+ experts on W...
 
在线办理(英国UCA毕业证书)创意艺术大学毕业证在读证明一模一样
在线办理(英国UCA毕业证书)创意艺术大学毕业证在读证明一模一样在线办理(英国UCA毕业证书)创意艺术大学毕业证在读证明一模一样
在线办理(英国UCA毕业证书)创意艺术大学毕业证在读证明一模一样
 
Predictably Improve Your B2B Tech Company's Performance by Leveraging Data
Predictably Improve Your B2B Tech Company's Performance by Leveraging DataPredictably Improve Your B2B Tech Company's Performance by Leveraging Data
Predictably Improve Your B2B Tech Company's Performance by Leveraging Data
 
Udemy_2024_Global_Learning_Skills_Trends_Report (1).pdf
Udemy_2024_Global_Learning_Skills_Trends_Report (1).pdfUdemy_2024_Global_Learning_Skills_Trends_Report (1).pdf
Udemy_2024_Global_Learning_Skills_Trends_Report (1).pdf
 

Testing in the digital age; international booklaunch at German Testing Day

  • 1. Testing… in the digital age AI makes the difference Booklaunch German Testing Days, Frankfurt, 8 June 2018 Rik Marselis
  • 2. | Who has a robot? © Sogeti 2018 2 Who has a robot? In 10 years all of you will !!
  • 3. 1980 Rik Marselis@rikmarselis 2007 2012 20122008 Workgroup -member 20142009 Management consultant Digital assurance & testing
  • 4. | The future of testing: quality forecasting © Sogeti 2018 4
  • 5. | Would you like to work with a robot? © Sogeti 2018 5
  • 6. | Cobotics: collaborating with robots © Sogeti 2018 6
  • 7. | Exoskeleton: robot gives extra muscle-power © Sogeti 2018 7 Ruben de Sain crowdfunded his exoskeleton to get out of his wheelchair.
  • 8. | What are your fears about intelligent machines? © Sogeti 2018 8
  • 9. | The Frankenstein factor: fear of AI © Sogeti 2018 9Source: SogetiLabs “The Frankenstein Factor”
  • 10. |© Sogeti 2018 10 Super intelligence & super stupidity Foto uit de film “Ex Machina” 2015
  • 11. | Two more general worries Loss of culture and defeating nature © Sogeti 2018 11
  • 12. | Let’s cope with these fears in a scientific way… © Sogeti 2018 12
  • 13. | Six angles of quality © Sogeti 2018 13 Existing knowledge New knowledge
  • 14. | Mechanical, Electrical, Information processing © Sogeti 2018 14 No. 2001 is seen on the rollers at the Vitry test plant Gresley Society Collection, 1934 Testing an electric stove, 1970’s © handyman The 7 generic testing activities of TMap® 1995/2006 Existing knowledge But still very relevant, also for testing intelligent machines.
  • 15. | Testing intelligent machines is different… © Sogeti 2018 15 Traditional testing compares expected and actual outcome. For intelligent machines predicting outcome is difficult; todays correct result may differ from tomorrows correct result, so: - Define tolerances - Control input - Test the machine in its intended environment - Use new quality characteristics
  • 16. | ISO25010 – Product Quality characteristics © Sogeti 2018 16
  • 17. | ISO25010 extended quality characteristics © Sogeti 2018 17
  • 18. | The new quality characteristics © Sogeti 2018 18
  • 19. | Machine learning – ability to learn © Sogeti 2017 19 <<< vervangen door filmclip >>> This is what machine learning looked like ☺ Scene from the film “Short circuit” (1986)
  • 20. | Ability to learn and to unlearn Machine learning • Continued learning • Frozen Examination • One-time • Continuous Un-learning © Sogeti 2018 20 Video: Unlearning and relearning to ride a bicycle
  • 21. | How to unlearn AI’s ? Rule-based AI: • Change the programmed rules Reinformement learning AI: • Change goal(s) • Control input • Feed new learning data © Sogeti 2018 21 U N
  • 22. |Morality: Ethics & Privacy Scene from the film “Robot and Frank” 2012
  • 23. | Scene from documentary “I am Alice” 2015 Morality: Ethics & Privacy
  • 24. | Personality - mood © Sogeti 2018 24 Personality: mood & humor
  • 25. | now let’s look at testing WITH them Well, this was all about testing OF intelligent machines, 25© Sogeti 2018
  • 26. | Robot automatically performs regression tests © Sogeti 26 Video that shows how Sogeti does regression testing of a cockpit at Airbus
  • 27. | Robot automatically performs regression tests © Sogeti 2017 27 Low-cost (€300,-) robot-arm tests mobile devices. Connected to test ma- nagement tool. Test cases check if the quality goals are met and risks are covered.
  • 28. | Use a digital twin to virtually test a product… © Sogeti 2018 28
  • 29. | More testing in less time © Sogeti 2018 29
  • 30. | The future of testing: quality forecasting © Sogeti 2018 30
  • 31. | Forecasting using multiple models © Sogeti 2018 31 The tester will interpret the outcome of multiple models and create the advice for the stakeholders
  • 32. | Cognitive QA – for example: smart dashboards © Sogeti 2018 32
  • 34. Thank you. This book was introduced on 1 June 2018 Humayun Shaukat Tom van de Ven Rik Marselis © Sogeti 2018