SlideShare a Scribd company logo
The Science 	

of 	

Software Testing
@charrett
What is	

Software Testing?
Scientific Method
Formulate hypothesis	

design, run & interpret experiments 	

that bear on this hypothesis
• CM : Clear Memory 	

• Forward: 1 or 2 digit number e.g 10 	

• Back : 1 or 2 digit number 	

• Rotate Left: 1 or 2 digit number e.g 15 	

• Rotate Right 1 or 2 digit number e.g 15	

• Fire: 1 or 2 digit number 	

• Go: Executes the program
Commands
Big Trak Jnr
Discover what the X2 Button does
Challenge
Formulate your hypothesis on what the X2 button
does	

Design a program, execute it and observe the devices
behaviour,	

How does the outcome relate to the hypothesis? 	

Terminate the process when you have discovered what
the X2 button does	

Afterwards we will debrief and discuss
You can ask me any
questions
Verbalise your ideas
What does x2 do?
• x2 is also known as the repeat key	

• x2 requires a numeric parameter (n). 	

• x2 can only be used once in a program 	

• x2 has no effect on instructions following its location in
the program
What does X2 do?
N repeats the entire program
Possible Hypothesis
• One repeat of the last n steps	

• N repeats of the last step	

• One repeat of the first n steps	

• One repeat of the nth step	

• One repeat of the entire program	

• One repeat of the last step
Observations
Exploring Science
• Tests can be easy to construct and easily observable, but
don’t offer much information. 	

• Knowing where to look & Understand what is seen 	

• Experimental design: design of experimental and
observational procedures	

• Hypothesis formation: formation and evaluation of theory	

• Confirmation Bias:“Tendency for people to seek evidence
to verify their hypothesis rather than refute them”
Science & Testing
• Testing requires we ask useful questions, challenge
assumptions	

• Testing is more about acquiring information than pass/fail	

• Testing is about thinking critically about why we test, how
we test and how we evaluate. 	

• Testing like experiments requires good test design	

• Testing like experimentation requires good observational
design 	

• Watch out for Confirmation Bias	

• Don’t conflate Testing with Checking
Suggestions
• Don’t plan all your tests upfront, you need to be able to
react to the information you find 	

• Automated Checking good for confirmation 	

• Exploratory Testing allows us to investigate the product	

• Focus on Testability rather than large automated
regression suites	

• Testability in creating test data	

• Helping to recognise problems
Thank you	

& 	

Tyro Payments 	

for 	

sponsoring me

More Related Content

What's hot

A predictive analytics primer
A predictive analytics primerA predictive analytics primer
A predictive analytics primer
NarasingaMoorthy V
 
Effort estimation
Effort estimationEffort estimation
Effort estimation
Hanokh Aloni
 
Charity Majors - Bootstrapping an Ops Team
Charity Majors - Bootstrapping an Ops TeamCharity Majors - Bootstrapping an Ops Team
Charity Majors - Bootstrapping an Ops Team
Heavybit
 
HPBigData2015Predicting Cyber Security Industry-JohnPark
HPBigData2015Predicting Cyber Security Industry-JohnParkHPBigData2015Predicting Cyber Security Industry-JohnPark
HPBigData2015Predicting Cyber Security Industry-JohnPark
John D. Park
 
Map student power point presentation
Map student power point presentationMap student power point presentation
Map student power point presentation
Phil R
 
Lessons learned after 190M lessons served
Lessons learned after 190M lessons servedLessons learned after 190M lessons served
Lessons learned after 190M lessons served
Ricardo Bánffy
 
Map student power point presentation
Map student power point presentationMap student power point presentation
Map student power point presentation
PV62
 
Map student-power point-presentation
Map student-power point-presentationMap student-power point-presentation
Map student-power point-presentation
bsturgeon
 
Homework
HomeworkHomework
Homework
Sarah Saleh
 
Usability Testing & You
Usability Testing & YouUsability Testing & You
Usability Testing & You
Cate Kompare
 
Sonar In Action 20110302-vn
Sonar In Action 20110302-vnSonar In Action 20110302-vn
Sonar In Action 20110302-vn
Arnaud Héritier
 
Ba Summit 2014 Betere planning en forecasting met predictive analytics
Ba Summit 2014   Betere planning en forecasting met predictive analyticsBa Summit 2014   Betere planning en forecasting met predictive analytics
Ba Summit 2014 Betere planning en forecasting met predictive analytics
Daniel Westzaan
 
Testlio qa meetup presentation 4.2.2015 2
Testlio qa meetup presentation 4.2.2015 2Testlio qa meetup presentation 4.2.2015 2
Testlio qa meetup presentation 4.2.2015 2
Kristel Viidik
 
7.6_burglar_alarm
7.6_burglar_alarm7.6_burglar_alarm
7.6_burglar_alarm
Jim Chenery
 
5 why fishbone
5 why fishbone5 why fishbone
5 why fishbone
Adi Shukla
 
Information Technology - Discover the Root Cause and Develop a solution throu...
Information Technology - Discover the Root Cause and Develop a solution throu...Information Technology - Discover the Root Cause and Develop a solution throu...
Information Technology - Discover the Root Cause and Develop a solution throu...
John Hudson
 

What's hot (16)

A predictive analytics primer
A predictive analytics primerA predictive analytics primer
A predictive analytics primer
 
Effort estimation
Effort estimationEffort estimation
Effort estimation
 
Charity Majors - Bootstrapping an Ops Team
Charity Majors - Bootstrapping an Ops TeamCharity Majors - Bootstrapping an Ops Team
Charity Majors - Bootstrapping an Ops Team
 
HPBigData2015Predicting Cyber Security Industry-JohnPark
HPBigData2015Predicting Cyber Security Industry-JohnParkHPBigData2015Predicting Cyber Security Industry-JohnPark
HPBigData2015Predicting Cyber Security Industry-JohnPark
 
Map student power point presentation
Map student power point presentationMap student power point presentation
Map student power point presentation
 
Lessons learned after 190M lessons served
Lessons learned after 190M lessons servedLessons learned after 190M lessons served
Lessons learned after 190M lessons served
 
Map student power point presentation
Map student power point presentationMap student power point presentation
Map student power point presentation
 
Map student-power point-presentation
Map student-power point-presentationMap student-power point-presentation
Map student-power point-presentation
 
Homework
HomeworkHomework
Homework
 
Usability Testing & You
Usability Testing & YouUsability Testing & You
Usability Testing & You
 
Sonar In Action 20110302-vn
Sonar In Action 20110302-vnSonar In Action 20110302-vn
Sonar In Action 20110302-vn
 
Ba Summit 2014 Betere planning en forecasting met predictive analytics
Ba Summit 2014   Betere planning en forecasting met predictive analyticsBa Summit 2014   Betere planning en forecasting met predictive analytics
Ba Summit 2014 Betere planning en forecasting met predictive analytics
 
Testlio qa meetup presentation 4.2.2015 2
Testlio qa meetup presentation 4.2.2015 2Testlio qa meetup presentation 4.2.2015 2
Testlio qa meetup presentation 4.2.2015 2
 
7.6_burglar_alarm
7.6_burglar_alarm7.6_burglar_alarm
7.6_burglar_alarm
 
5 why fishbone
5 why fishbone5 why fishbone
5 why fishbone
 
Information Technology - Discover the Root Cause and Develop a solution throu...
Information Technology - Discover the Root Cause and Develop a solution throu...Information Technology - Discover the Root Cause and Develop a solution throu...
Information Technology - Discover the Root Cause and Develop a solution throu...
 

Viewers also liked

Ask the Tester with Michael Larsen
Ask the Tester with Michael LarsenAsk the Tester with Michael Larsen
Ask the Tester with Michael LarsenMichael Larsen
 
EuroSTAR presentation: What's in the cloud for testing, the sky is the limit
EuroSTAR presentation:  What's in the cloud for testing, the sky is the limitEuroSTAR presentation:  What's in the cloud for testing, the sky is the limit
EuroSTAR presentation: What's in the cloud for testing, the sky is the limit
Edwin Loon, van
 
Agile Load Testing in the Real World
Agile Load Testing in the Real WorldAgile Load Testing in the Real World
Agile Load Testing in the Real World
Lee Barnes
 
Introduction to ExtJS and its new features
Introduction to ExtJS and its new featuresIntroduction to ExtJS and its new features
Introduction to ExtJS and its new features
Synerzip
 
Remaining relevant - July TMF
Remaining relevant - July TMFRemaining relevant - July TMF
Remaining relevant - July TMF
tonybruce
 
What Is In The Cloud For Testing Test Net 2011
What Is In The Cloud For Testing   Test Net 2011What Is In The Cloud For Testing   Test Net 2011
What Is In The Cloud For Testing Test Net 2011Edwin Loon, van
 
Develop your brand
Develop your brandDevelop your brand
Develop your brand
Anne-Marie Charrett
 
Mike Cottmeyer - How to Get Started with Agile
Mike Cottmeyer - How to Get Started with AgileMike Cottmeyer - How to Get Started with Agile
Mike Cottmeyer - How to Get Started with Agile
SFA
 
Coaching Testing
Coaching Testing Coaching Testing
Coaching Testing
Anne-Marie Charrett
 
London Tester Gathering Workshops 2014 - Exploratory Testing Session
London Tester Gathering Workshops 2014 - Exploratory Testing SessionLondon Tester Gathering Workshops 2014 - Exploratory Testing Session
London Tester Gathering Workshops 2014 - Exploratory Testing Session
tonybruce
 
T12 exploitation testing - presentation 1.2
T12   exploitation testing - presentation 1.2T12   exploitation testing - presentation 1.2
T12 exploitation testing - presentation 1.2
Edwin Loon, van
 
15 Uses of Video in Technical Communications
15 Uses of Video in Technical Communications15 Uses of Video in Technical Communications
15 Uses of Video in Technical Communications
Matthew Pierce
 
Synerzip Agile Software Development
Synerzip Agile Software DevelopmentSynerzip Agile Software Development
Synerzip Agile Software Development
Synerzip
 
Agile: Looking Back, Looking Forward: Adapt, Innovate, Collaborate & Deliver
Agile: Looking Back, Looking Forward: Adapt, Innovate, Collaborate & DeliverAgile: Looking Back, Looking Forward: Adapt, Innovate, Collaborate & Deliver
Agile: Looking Back, Looking Forward: Adapt, Innovate, Collaborate & Deliver
Craig Smith
 
Mobile test automation overview & tools evaluation
Mobile test automation overview & tools evaluationMobile test automation overview & tools evaluation
Mobile test automation overview & tools evaluation
Experitest
 
Learning from mistakes with BDD
Learning from mistakes with BDDLearning from mistakes with BDD
Learning from mistakes with BDD
tonybruce
 
T12 Exploitation Testing Presentation 1.2
T12   Exploitation Testing   Presentation 1.2T12   Exploitation Testing   Presentation 1.2
T12 Exploitation Testing Presentation 1.2
Edwin Loon, van
 
It's Not You It's Us: How design reviews can make you better at visual design
It's Not You It's Us: How design reviews can make you better at visual designIt's Not You It's Us: How design reviews can make you better at visual design
It's Not You It's Us: How design reviews can make you better at visual design
Matthew Pierce
 
One more question... eurostar 2013
One more question...   eurostar 2013One more question...   eurostar 2013
One more question... eurostar 2013
tonybruce
 

Viewers also liked (19)

Ask the Tester with Michael Larsen
Ask the Tester with Michael LarsenAsk the Tester with Michael Larsen
Ask the Tester with Michael Larsen
 
EuroSTAR presentation: What's in the cloud for testing, the sky is the limit
EuroSTAR presentation:  What's in the cloud for testing, the sky is the limitEuroSTAR presentation:  What's in the cloud for testing, the sky is the limit
EuroSTAR presentation: What's in the cloud for testing, the sky is the limit
 
Agile Load Testing in the Real World
Agile Load Testing in the Real WorldAgile Load Testing in the Real World
Agile Load Testing in the Real World
 
Introduction to ExtJS and its new features
Introduction to ExtJS and its new featuresIntroduction to ExtJS and its new features
Introduction to ExtJS and its new features
 
Remaining relevant - July TMF
Remaining relevant - July TMFRemaining relevant - July TMF
Remaining relevant - July TMF
 
What Is In The Cloud For Testing Test Net 2011
What Is In The Cloud For Testing   Test Net 2011What Is In The Cloud For Testing   Test Net 2011
What Is In The Cloud For Testing Test Net 2011
 
Develop your brand
Develop your brandDevelop your brand
Develop your brand
 
Mike Cottmeyer - How to Get Started with Agile
Mike Cottmeyer - How to Get Started with AgileMike Cottmeyer - How to Get Started with Agile
Mike Cottmeyer - How to Get Started with Agile
 
Coaching Testing
Coaching Testing Coaching Testing
Coaching Testing
 
London Tester Gathering Workshops 2014 - Exploratory Testing Session
London Tester Gathering Workshops 2014 - Exploratory Testing SessionLondon Tester Gathering Workshops 2014 - Exploratory Testing Session
London Tester Gathering Workshops 2014 - Exploratory Testing Session
 
T12 exploitation testing - presentation 1.2
T12   exploitation testing - presentation 1.2T12   exploitation testing - presentation 1.2
T12 exploitation testing - presentation 1.2
 
15 Uses of Video in Technical Communications
15 Uses of Video in Technical Communications15 Uses of Video in Technical Communications
15 Uses of Video in Technical Communications
 
Synerzip Agile Software Development
Synerzip Agile Software DevelopmentSynerzip Agile Software Development
Synerzip Agile Software Development
 
Agile: Looking Back, Looking Forward: Adapt, Innovate, Collaborate & Deliver
Agile: Looking Back, Looking Forward: Adapt, Innovate, Collaborate & DeliverAgile: Looking Back, Looking Forward: Adapt, Innovate, Collaborate & Deliver
Agile: Looking Back, Looking Forward: Adapt, Innovate, Collaborate & Deliver
 
Mobile test automation overview & tools evaluation
Mobile test automation overview & tools evaluationMobile test automation overview & tools evaluation
Mobile test automation overview & tools evaluation
 
Learning from mistakes with BDD
Learning from mistakes with BDDLearning from mistakes with BDD
Learning from mistakes with BDD
 
T12 Exploitation Testing Presentation 1.2
T12   Exploitation Testing   Presentation 1.2T12   Exploitation Testing   Presentation 1.2
T12 Exploitation Testing Presentation 1.2
 
It's Not You It's Us: How design reviews can make you better at visual design
It's Not You It's Us: How design reviews can make you better at visual designIt's Not You It's Us: How design reviews can make you better at visual design
It's Not You It's Us: How design reviews can make you better at visual design
 
One more question... eurostar 2013
One more question...   eurostar 2013One more question...   eurostar 2013
One more question... eurostar 2013
 

Similar to Robots, Testing and LAST

Don’t Let Missed Bugs Cause Mayhem in your Organization!
Don’t Let Missed Bugs Cause Mayhem in your Organization!Don’t Let Missed Bugs Cause Mayhem in your Organization!
Don’t Let Missed Bugs Cause Mayhem in your Organization!
Qualitest
 
Scientific Research Steps Part 2
Scientific Research Steps Part 2Scientific Research Steps Part 2
Scientific Research Steps Part 2
Ainul Yaqin
 
Dare to Explore: Discover ET!
Dare to Explore: Discover ET!Dare to Explore: Discover ET!
Dare to Explore: Discover ET!
Raj Indugula
 
Test-Driven Development
 Test-Driven Development  Test-Driven Development
Test-Driven Development
Amir Assad
 
Test Strategy-The real silver bullet in testing by Matthew Eakin
Test Strategy-The real silver bullet in testing by Matthew EakinTest Strategy-The real silver bullet in testing by Matthew Eakin
Test Strategy-The real silver bullet in testing by Matthew Eakin
QA or the Highway
 
Lean UX principles
Lean UX principlesLean UX principles
Lean UX principles
Tristan Libersat
 
[HCMC STC Jan 2015] Proving Our Worth Quantifying The Value Of Testing
[HCMC STC Jan 2015] Proving Our Worth  Quantifying The Value Of Testing[HCMC STC Jan 2015] Proving Our Worth  Quantifying The Value Of Testing
[HCMC STC Jan 2015] Proving Our Worth Quantifying The Value Of Testing
Ho Chi Minh City Software Testing Club
 
Pragmatisk softwareinnovation, Ivan Aaen, AAU
Pragmatisk softwareinnovation, Ivan Aaen, AAUPragmatisk softwareinnovation, Ivan Aaen, AAU
Pragmatisk softwareinnovation, Ivan Aaen, AAU
InfinIT - Innovationsnetværket for it
 
Worst practices in software testing by the Testing troll
Worst practices in software testing by the Testing trollWorst practices in software testing by the Testing troll
Worst practices in software testing by the Testing troll
Viktor Slavchev
 
How did i miss that bug rtc
How did i miss that bug rtcHow did i miss that bug rtc
How did i miss that bug rtc
GerieOwen
 
Intro to TDD
Intro to TDDIntro to TDD
Intro to TDD
Jason Nocks
 
Introduction to bugs measurement
Introduction to bugs measurementIntroduction to bugs measurement
Introduction to bugs measurement
Volodya Novostavsky
 
Help! I need an empirical study for my PhD!
Help! I need an empirical study for my PhD!Help! I need an empirical study for my PhD!
Help! I need an empirical study for my PhD!
Walid Maalej
 
Lean Startup 301
Lean Startup 301Lean Startup 301
Lean Startup 301
Lean Startup Co.
 
Metrics in Security Operations
Metrics in Security OperationsMetrics in Security Operations
Metrics in Security Operations
Sergey Soldatov
 
Learn Learning + Prototype Testing
Learn Learning + Prototype TestingLearn Learning + Prototype Testing
Learn Learning + Prototype Testing
Dave Hora
 
Will Robots Replace Testers?
Will Robots Replace Testers?Will Robots Replace Testers?
Will Robots Replace Testers?
TEST Huddle
 
Outcome Over Output - And why should we care?
Outcome Over Output - And why should we care?Outcome Over Output - And why should we care?
Outcome Over Output - And why should we care?
Scrum Australia Pty Ltd
 
Defining Test Competence
Defining Test CompetenceDefining Test Competence
Defining Test Competence
Johan Hoberg
 
Building innovative products
Building innovative productsBuilding innovative products
Building innovative products
Shishir Choudhary
 

Similar to Robots, Testing and LAST (20)

Don’t Let Missed Bugs Cause Mayhem in your Organization!
Don’t Let Missed Bugs Cause Mayhem in your Organization!Don’t Let Missed Bugs Cause Mayhem in your Organization!
Don’t Let Missed Bugs Cause Mayhem in your Organization!
 
Scientific Research Steps Part 2
Scientific Research Steps Part 2Scientific Research Steps Part 2
Scientific Research Steps Part 2
 
Dare to Explore: Discover ET!
Dare to Explore: Discover ET!Dare to Explore: Discover ET!
Dare to Explore: Discover ET!
 
Test-Driven Development
 Test-Driven Development  Test-Driven Development
Test-Driven Development
 
Test Strategy-The real silver bullet in testing by Matthew Eakin
Test Strategy-The real silver bullet in testing by Matthew EakinTest Strategy-The real silver bullet in testing by Matthew Eakin
Test Strategy-The real silver bullet in testing by Matthew Eakin
 
Lean UX principles
Lean UX principlesLean UX principles
Lean UX principles
 
[HCMC STC Jan 2015] Proving Our Worth Quantifying The Value Of Testing
[HCMC STC Jan 2015] Proving Our Worth  Quantifying The Value Of Testing[HCMC STC Jan 2015] Proving Our Worth  Quantifying The Value Of Testing
[HCMC STC Jan 2015] Proving Our Worth Quantifying The Value Of Testing
 
Pragmatisk softwareinnovation, Ivan Aaen, AAU
Pragmatisk softwareinnovation, Ivan Aaen, AAUPragmatisk softwareinnovation, Ivan Aaen, AAU
Pragmatisk softwareinnovation, Ivan Aaen, AAU
 
Worst practices in software testing by the Testing troll
Worst practices in software testing by the Testing trollWorst practices in software testing by the Testing troll
Worst practices in software testing by the Testing troll
 
How did i miss that bug rtc
How did i miss that bug rtcHow did i miss that bug rtc
How did i miss that bug rtc
 
Intro to TDD
Intro to TDDIntro to TDD
Intro to TDD
 
Introduction to bugs measurement
Introduction to bugs measurementIntroduction to bugs measurement
Introduction to bugs measurement
 
Help! I need an empirical study for my PhD!
Help! I need an empirical study for my PhD!Help! I need an empirical study for my PhD!
Help! I need an empirical study for my PhD!
 
Lean Startup 301
Lean Startup 301Lean Startup 301
Lean Startup 301
 
Metrics in Security Operations
Metrics in Security OperationsMetrics in Security Operations
Metrics in Security Operations
 
Learn Learning + Prototype Testing
Learn Learning + Prototype TestingLearn Learning + Prototype Testing
Learn Learning + Prototype Testing
 
Will Robots Replace Testers?
Will Robots Replace Testers?Will Robots Replace Testers?
Will Robots Replace Testers?
 
Outcome Over Output - And why should we care?
Outcome Over Output - And why should we care?Outcome Over Output - And why should we care?
Outcome Over Output - And why should we care?
 
Defining Test Competence
Defining Test CompetenceDefining Test Competence
Defining Test Competence
 
Building innovative products
Building innovative productsBuilding innovative products
Building innovative products
 

More from Anne-Marie Charrett

It takes a village to build a quality product
It takes a village to build a quality productIt takes a village to build a quality product
It takes a village to build a quality product
Anne-Marie Charrett
 
Test Management Revisited ATD2K16
Test Management Revisited ATD2K16Test Management Revisited ATD2K16
Test Management Revisited ATD2K16
Anne-Marie Charrett
 
Testing Microservices
Testing MicroservicesTesting Microservices
Testing Microservices
Anne-Marie Charrett
 
Speak easy diversity
Speak easy diversity Speak easy diversity
Speak easy diversity
Anne-Marie Charrett
 
Disruptive Testing
Disruptive TestingDisruptive Testing
Disruptive Testing
Anne-Marie Charrett
 
Testing trapeze-2014-april
Testing trapeze-2014-aprilTesting trapeze-2014-april
Testing trapeze-2014-april
Anne-Marie Charrett
 
how to reduce the cost of software testing
how to reduce the cost of software testinghow to reduce the cost of software testing
how to reduce the cost of software testing
Anne-Marie Charrett
 
A story on failure
A story on failureA story on failure
A story on failure
Anne-Marie Charrett
 
Software testing
Software testingSoftware testing
Software testing
Anne-Marie Charrett
 
Creating a Context Driven Test Team
Creating a Context Driven Test TeamCreating a Context Driven Test Team
Creating a Context Driven Test Team
Anne-Marie Charrett
 
A taste of Exploratory Testing
A taste of Exploratory TestingA taste of Exploratory Testing
A taste of Exploratory Testing
Anne-Marie Charrett
 
Agile Testing
Agile Testing Agile Testing
Agile Testing
Anne-Marie Charrett
 
A Taste of Exploratory Testing
A Taste of Exploratory TestingA Taste of Exploratory Testing
A Taste of Exploratory Testing
Anne-Marie Charrett
 
Develop your inner tester
Develop your inner tester Develop your inner tester
Develop your inner tester
Anne-Marie Charrett
 
Exploratory testing workshop
Exploratory testing workshopExploratory testing workshop
Exploratory testing workshop
Anne-Marie Charrett
 
Discovering your inner tester
Discovering your inner testerDiscovering your inner tester
Discovering your inner tester
Anne-Marie Charrett
 
Testing a SaaS Platform
Testing a SaaS PlatformTesting a SaaS Platform
Testing a SaaS Platform
Anne-Marie Charrett
 
Startups And Software Testing
Startups And Software TestingStartups And Software Testing
Startups And Software Testing
Anne-Marie Charrett
 

More from Anne-Marie Charrett (18)

It takes a village to build a quality product
It takes a village to build a quality productIt takes a village to build a quality product
It takes a village to build a quality product
 
Test Management Revisited ATD2K16
Test Management Revisited ATD2K16Test Management Revisited ATD2K16
Test Management Revisited ATD2K16
 
Testing Microservices
Testing MicroservicesTesting Microservices
Testing Microservices
 
Speak easy diversity
Speak easy diversity Speak easy diversity
Speak easy diversity
 
Disruptive Testing
Disruptive TestingDisruptive Testing
Disruptive Testing
 
Testing trapeze-2014-april
Testing trapeze-2014-aprilTesting trapeze-2014-april
Testing trapeze-2014-april
 
how to reduce the cost of software testing
how to reduce the cost of software testinghow to reduce the cost of software testing
how to reduce the cost of software testing
 
A story on failure
A story on failureA story on failure
A story on failure
 
Software testing
Software testingSoftware testing
Software testing
 
Creating a Context Driven Test Team
Creating a Context Driven Test TeamCreating a Context Driven Test Team
Creating a Context Driven Test Team
 
A taste of Exploratory Testing
A taste of Exploratory TestingA taste of Exploratory Testing
A taste of Exploratory Testing
 
Agile Testing
Agile Testing Agile Testing
Agile Testing
 
A Taste of Exploratory Testing
A Taste of Exploratory TestingA Taste of Exploratory Testing
A Taste of Exploratory Testing
 
Develop your inner tester
Develop your inner tester Develop your inner tester
Develop your inner tester
 
Exploratory testing workshop
Exploratory testing workshopExploratory testing workshop
Exploratory testing workshop
 
Discovering your inner tester
Discovering your inner testerDiscovering your inner tester
Discovering your inner tester
 
Testing a SaaS Platform
Testing a SaaS PlatformTesting a SaaS Platform
Testing a SaaS Platform
 
Startups And Software Testing
Startups And Software TestingStartups And Software Testing
Startups And Software Testing
 

Recently uploaded

The Python for beginners. This is an advance computer language.
The Python for beginners. This is an advance computer language.The Python for beginners. This is an advance computer language.
The Python for beginners. This is an advance computer language.
sachin chaurasia
 
一比一原版(CalArts毕业证)加利福尼亚艺术学院毕业证如何办理
一比一原版(CalArts毕业证)加利福尼亚艺术学院毕业证如何办理一比一原版(CalArts毕业证)加利福尼亚艺术学院毕业证如何办理
一比一原版(CalArts毕业证)加利福尼亚艺术学院毕业证如何办理
ecqow
 
学校原版美国波士顿大学毕业证学历学位证书原版一模一样
学校原版美国波士顿大学毕业证学历学位证书原版一模一样学校原版美国波士顿大学毕业证学历学位证书原版一模一样
学校原版美国波士顿大学毕业证学历学位证书原版一模一样
171ticu
 
Introduction to AI Safety (public presentation).pptx
Introduction to AI Safety (public presentation).pptxIntroduction to AI Safety (public presentation).pptx
Introduction to AI Safety (public presentation).pptx
MiscAnnoy1
 
ISPM 15 Heat Treated Wood Stamps and why your shipping must have one
ISPM 15 Heat Treated Wood Stamps and why your shipping must have oneISPM 15 Heat Treated Wood Stamps and why your shipping must have one
ISPM 15 Heat Treated Wood Stamps and why your shipping must have one
Las Vegas Warehouse
 
Advanced control scheme of doubly fed induction generator for wind turbine us...
Advanced control scheme of doubly fed induction generator for wind turbine us...Advanced control scheme of doubly fed induction generator for wind turbine us...
Advanced control scheme of doubly fed induction generator for wind turbine us...
IJECEIAES
 
Engineering Drawings Lecture Detail Drawings 2014.pdf
Engineering Drawings Lecture Detail Drawings 2014.pdfEngineering Drawings Lecture Detail Drawings 2014.pdf
Engineering Drawings Lecture Detail Drawings 2014.pdf
abbyasa1014
 
CHINA’S GEO-ECONOMIC OUTREACH IN CENTRAL ASIAN COUNTRIES AND FUTURE PROSPECT
CHINA’S GEO-ECONOMIC OUTREACH IN CENTRAL ASIAN COUNTRIES AND FUTURE PROSPECTCHINA’S GEO-ECONOMIC OUTREACH IN CENTRAL ASIAN COUNTRIES AND FUTURE PROSPECT
CHINA’S GEO-ECONOMIC OUTREACH IN CENTRAL ASIAN COUNTRIES AND FUTURE PROSPECT
jpsjournal1
 
Software Engineering and Project Management - Introduction, Modeling Concepts...
Software Engineering and Project Management - Introduction, Modeling Concepts...Software Engineering and Project Management - Introduction, Modeling Concepts...
Software Engineering and Project Management - Introduction, Modeling Concepts...
Prakhyath Rai
 
International Conference on NLP, Artificial Intelligence, Machine Learning an...
International Conference on NLP, Artificial Intelligence, Machine Learning an...International Conference on NLP, Artificial Intelligence, Machine Learning an...
International Conference on NLP, Artificial Intelligence, Machine Learning an...
gerogepatton
 
Generative AI leverages algorithms to create various forms of content
Generative AI leverages algorithms to create various forms of contentGenerative AI leverages algorithms to create various forms of content
Generative AI leverages algorithms to create various forms of content
Hitesh Mohapatra
 
Optimizing Gradle Builds - Gradle DPE Tour Berlin 2024
Optimizing Gradle Builds - Gradle DPE Tour Berlin 2024Optimizing Gradle Builds - Gradle DPE Tour Berlin 2024
Optimizing Gradle Builds - Gradle DPE Tour Berlin 2024
Sinan KOZAK
 
CEC 352 - SATELLITE COMMUNICATION UNIT 1
CEC 352 - SATELLITE COMMUNICATION UNIT 1CEC 352 - SATELLITE COMMUNICATION UNIT 1
CEC 352 - SATELLITE COMMUNICATION UNIT 1
PKavitha10
 
Null Bangalore | Pentesters Approach to AWS IAM
Null Bangalore | Pentesters Approach to AWS IAMNull Bangalore | Pentesters Approach to AWS IAM
Null Bangalore | Pentesters Approach to AWS IAM
Divyanshu
 
Unit-III-ELECTROCHEMICAL STORAGE DEVICES.ppt
Unit-III-ELECTROCHEMICAL STORAGE DEVICES.pptUnit-III-ELECTROCHEMICAL STORAGE DEVICES.ppt
Unit-III-ELECTROCHEMICAL STORAGE DEVICES.ppt
KrishnaveniKrishnara1
 
哪里办理(csu毕业证书)查尔斯特大学毕业证硕士学历原版一模一样
哪里办理(csu毕业证书)查尔斯特大学毕业证硕士学历原版一模一样哪里办理(csu毕业证书)查尔斯特大学毕业证硕士学历原版一模一样
哪里办理(csu毕业证书)查尔斯特大学毕业证硕士学历原版一模一样
insn4465
 
Redefining brain tumor segmentation: a cutting-edge convolutional neural netw...
Redefining brain tumor segmentation: a cutting-edge convolutional neural netw...Redefining brain tumor segmentation: a cutting-edge convolutional neural netw...
Redefining brain tumor segmentation: a cutting-edge convolutional neural netw...
IJECEIAES
 
Mechanical Engineering on AAI Summer Training Report-003.pdf
Mechanical Engineering on AAI Summer Training Report-003.pdfMechanical Engineering on AAI Summer Training Report-003.pdf
Mechanical Engineering on AAI Summer Training Report-003.pdf
21UME003TUSHARDEB
 
原版制作(Humboldt毕业证书)柏林大学毕业证学位证一模一样
原版制作(Humboldt毕业证书)柏林大学毕业证学位证一模一样原版制作(Humboldt毕业证书)柏林大学毕业证学位证一模一样
原版制作(Humboldt毕业证书)柏林大学毕业证学位证一模一样
ydzowc
 
AI assisted telemedicine KIOSK for Rural India.pptx
AI assisted telemedicine KIOSK for Rural India.pptxAI assisted telemedicine KIOSK for Rural India.pptx
AI assisted telemedicine KIOSK for Rural India.pptx
architagupta876
 

Recently uploaded (20)

The Python for beginners. This is an advance computer language.
The Python for beginners. This is an advance computer language.The Python for beginners. This is an advance computer language.
The Python for beginners. This is an advance computer language.
 
一比一原版(CalArts毕业证)加利福尼亚艺术学院毕业证如何办理
一比一原版(CalArts毕业证)加利福尼亚艺术学院毕业证如何办理一比一原版(CalArts毕业证)加利福尼亚艺术学院毕业证如何办理
一比一原版(CalArts毕业证)加利福尼亚艺术学院毕业证如何办理
 
学校原版美国波士顿大学毕业证学历学位证书原版一模一样
学校原版美国波士顿大学毕业证学历学位证书原版一模一样学校原版美国波士顿大学毕业证学历学位证书原版一模一样
学校原版美国波士顿大学毕业证学历学位证书原版一模一样
 
Introduction to AI Safety (public presentation).pptx
Introduction to AI Safety (public presentation).pptxIntroduction to AI Safety (public presentation).pptx
Introduction to AI Safety (public presentation).pptx
 
ISPM 15 Heat Treated Wood Stamps and why your shipping must have one
ISPM 15 Heat Treated Wood Stamps and why your shipping must have oneISPM 15 Heat Treated Wood Stamps and why your shipping must have one
ISPM 15 Heat Treated Wood Stamps and why your shipping must have one
 
Advanced control scheme of doubly fed induction generator for wind turbine us...
Advanced control scheme of doubly fed induction generator for wind turbine us...Advanced control scheme of doubly fed induction generator for wind turbine us...
Advanced control scheme of doubly fed induction generator for wind turbine us...
 
Engineering Drawings Lecture Detail Drawings 2014.pdf
Engineering Drawings Lecture Detail Drawings 2014.pdfEngineering Drawings Lecture Detail Drawings 2014.pdf
Engineering Drawings Lecture Detail Drawings 2014.pdf
 
CHINA’S GEO-ECONOMIC OUTREACH IN CENTRAL ASIAN COUNTRIES AND FUTURE PROSPECT
CHINA’S GEO-ECONOMIC OUTREACH IN CENTRAL ASIAN COUNTRIES AND FUTURE PROSPECTCHINA’S GEO-ECONOMIC OUTREACH IN CENTRAL ASIAN COUNTRIES AND FUTURE PROSPECT
CHINA’S GEO-ECONOMIC OUTREACH IN CENTRAL ASIAN COUNTRIES AND FUTURE PROSPECT
 
Software Engineering and Project Management - Introduction, Modeling Concepts...
Software Engineering and Project Management - Introduction, Modeling Concepts...Software Engineering and Project Management - Introduction, Modeling Concepts...
Software Engineering and Project Management - Introduction, Modeling Concepts...
 
International Conference on NLP, Artificial Intelligence, Machine Learning an...
International Conference on NLP, Artificial Intelligence, Machine Learning an...International Conference on NLP, Artificial Intelligence, Machine Learning an...
International Conference on NLP, Artificial Intelligence, Machine Learning an...
 
Generative AI leverages algorithms to create various forms of content
Generative AI leverages algorithms to create various forms of contentGenerative AI leverages algorithms to create various forms of content
Generative AI leverages algorithms to create various forms of content
 
Optimizing Gradle Builds - Gradle DPE Tour Berlin 2024
Optimizing Gradle Builds - Gradle DPE Tour Berlin 2024Optimizing Gradle Builds - Gradle DPE Tour Berlin 2024
Optimizing Gradle Builds - Gradle DPE Tour Berlin 2024
 
CEC 352 - SATELLITE COMMUNICATION UNIT 1
CEC 352 - SATELLITE COMMUNICATION UNIT 1CEC 352 - SATELLITE COMMUNICATION UNIT 1
CEC 352 - SATELLITE COMMUNICATION UNIT 1
 
Null Bangalore | Pentesters Approach to AWS IAM
Null Bangalore | Pentesters Approach to AWS IAMNull Bangalore | Pentesters Approach to AWS IAM
Null Bangalore | Pentesters Approach to AWS IAM
 
Unit-III-ELECTROCHEMICAL STORAGE DEVICES.ppt
Unit-III-ELECTROCHEMICAL STORAGE DEVICES.pptUnit-III-ELECTROCHEMICAL STORAGE DEVICES.ppt
Unit-III-ELECTROCHEMICAL STORAGE DEVICES.ppt
 
哪里办理(csu毕业证书)查尔斯特大学毕业证硕士学历原版一模一样
哪里办理(csu毕业证书)查尔斯特大学毕业证硕士学历原版一模一样哪里办理(csu毕业证书)查尔斯特大学毕业证硕士学历原版一模一样
哪里办理(csu毕业证书)查尔斯特大学毕业证硕士学历原版一模一样
 
Redefining brain tumor segmentation: a cutting-edge convolutional neural netw...
Redefining brain tumor segmentation: a cutting-edge convolutional neural netw...Redefining brain tumor segmentation: a cutting-edge convolutional neural netw...
Redefining brain tumor segmentation: a cutting-edge convolutional neural netw...
 
Mechanical Engineering on AAI Summer Training Report-003.pdf
Mechanical Engineering on AAI Summer Training Report-003.pdfMechanical Engineering on AAI Summer Training Report-003.pdf
Mechanical Engineering on AAI Summer Training Report-003.pdf
 
原版制作(Humboldt毕业证书)柏林大学毕业证学位证一模一样
原版制作(Humboldt毕业证书)柏林大学毕业证学位证一模一样原版制作(Humboldt毕业证书)柏林大学毕业证学位证一模一样
原版制作(Humboldt毕业证书)柏林大学毕业证学位证一模一样
 
AI assisted telemedicine KIOSK for Rural India.pptx
AI assisted telemedicine KIOSK for Rural India.pptxAI assisted telemedicine KIOSK for Rural India.pptx
AI assisted telemedicine KIOSK for Rural India.pptx
 

Robots, Testing and LAST

  • 1. The Science of Software Testing @charrett
  • 3.
  • 4. Scientific Method Formulate hypothesis design, run & interpret experiments that bear on this hypothesis
  • 5. • CM : Clear Memory • Forward: 1 or 2 digit number e.g 10 • Back : 1 or 2 digit number • Rotate Left: 1 or 2 digit number e.g 15 • Rotate Right 1 or 2 digit number e.g 15 • Fire: 1 or 2 digit number • Go: Executes the program Commands
  • 6. Big Trak Jnr Discover what the X2 Button does
  • 7. Challenge Formulate your hypothesis on what the X2 button does Design a program, execute it and observe the devices behaviour, How does the outcome relate to the hypothesis? Terminate the process when you have discovered what the X2 button does Afterwards we will debrief and discuss
  • 8. You can ask me any questions
  • 10. What does x2 do? • x2 is also known as the repeat key • x2 requires a numeric parameter (n). • x2 can only be used once in a program • x2 has no effect on instructions following its location in the program
  • 11. What does X2 do? N repeats the entire program
  • 12. Possible Hypothesis • One repeat of the last n steps • N repeats of the last step • One repeat of the first n steps • One repeat of the nth step • One repeat of the entire program • One repeat of the last step
  • 14. Exploring Science • Tests can be easy to construct and easily observable, but don’t offer much information. • Knowing where to look & Understand what is seen • Experimental design: design of experimental and observational procedures • Hypothesis formation: formation and evaluation of theory • Confirmation Bias:“Tendency for people to seek evidence to verify their hypothesis rather than refute them”
  • 15. Science & Testing • Testing requires we ask useful questions, challenge assumptions • Testing is more about acquiring information than pass/fail • Testing is about thinking critically about why we test, how we test and how we evaluate. • Testing like experiments requires good test design • Testing like experimentation requires good observational design • Watch out for Confirmation Bias • Don’t conflate Testing with Checking
  • 16. Suggestions • Don’t plan all your tests upfront, you need to be able to react to the information you find • Automated Checking good for confirmation • Exploratory Testing allows us to investigate the product • Focus on Testability rather than large automated regression suites • Testability in creating test data • Helping to recognise problems
  • 17. Thank you & Tyro Payments for sponsoring me