SlideShare a Scribd company logo
1 
Traditional Testing R.I.P. 
Alternative Testing 
Do We Have to Test Like We Always Have? 
by Julian Harty 
14 Nov 2010 
2 
Today's climate 
We live in an era where quality has 
been replaced by speed - people are 
trained to expect little to none, and 
are perfectly happy getting it. 
In such world, testing for quality 
must redefine itself and find a new 
purpose. 
Goranka Bjedov (Google)
3 
Cost of “doing the right thing” 
“the cost of "doing it right" is far 
higher than the cost of only responding 
when someone does find a problem” 
John Viega: CTO McAfee: The myths of security 
4 
Business Reality... 
Police, private security experts and 
internet service providers said on 
Wednesday they had shut down the 
Mariposa botnet, one of the largest 
networks of hacked personal computers 
discovered. 
It had siphoned off financial and 
other information from inside half of 
the largest 1,000 US companies. 
March 3rd, 2010 
http://www.ft.com/cms/s/0/f6960e5a-2711-11df-b84e-00144feabdc0.html
5 
Are Testers impotent? 
 Why didn't any of the testers 
find the security flaw(s)? 
 What can we do to improve our 
testing competences? 
6 
Why test at all? 
 Testing slows projects down 
 It can mislead, or divert 
attention from other, more 
important work 
 Most testing is futile! 
 What's the risk of failure?
7 
Some impacts of “testing” 
 Incorrect diagnosis 
 Incorrect changes 
 Irrelevant bugs 
 Still unfixed bugs 
(what we know could hurt us...) 
8 
Testers as second-class citizens 
“Anyone can test” 
 Therefore, one tester is as good 
as another, and no/little better 
than 'anyone' 
 Therefore, testers are nothing 
special...
9 
Speed is the competitive 
advantage 
Faster, iterative, releases 
Testing for 
Productivity vs Quality 
10 
What do you actually do? 
(when you think you're testing...)
11 
Checking vs. Testing 
Checking Is Confirmation 
Testing Is Exploration and Learning 
Checks Are Machine-Decidable; Tests 
Require Sapience 
http://www.developsense.com/blog/category/testing-vs-checking/ 
12 
Some outputs of testing 
 Data 
 Error logs 
Can we get these from other sources?
15 
Use Canaries 
 What are they good for? 
16 
Canaries 
 What are they good for? 
 We expect some to die 
R.I.P. 
Cheep 
(2010)
17 
Automate the Checking 
 When practical, create automated 
'tests' that check: 
 Results 
 Data 
 Logs 
 The state of the software 
18 
Good uses of automated tests? 
 T.D.D. 
RED 
REFACTOR GREEN 
 Continuous Builds 
 Regression Tests 
 Security Tests
19 
Contributory Success Factors 
(for 'not' testing) 
 Quality and Speed of feedback 
 Perception of failure 
 Time to address and fix issues 
 Risk and cost of failure 
 The Art of Customer Relationships 
20 
What about the Testers? 
 “Traditional Testing” is waning 
 Change brings Opportunity 
 We can choose to apply our skills 
to more valuable & rewarding work
21 
Now what? 
What can we do with all the 
redundant testers? 
22 
Strengths of Testers 
 Recognizing there may be alternatives 
 Produces answers sooner 
 Reduce doubt / Increase confidence 
 Advocate for: bugs, users, developers, software 
 Be Trusted Advisors 
 Debunk mysteries & superstitions 
 Test for productivity (better, faster, cheaper) 
 Test for quality (of the end product) 
 Be disruptive; yet likeable :)
23 
Test to provide answers sooner 
 A good reason to test is to 
provide answers sooner 
 We need to decide: 
 What the aims are 
 What to measure, and how 
 How to run the test (environment) 
 Then we need to: run the tests, 
analyze the results, & present 
our assessment clearly 
See: Gordon Bragg & Design of Experiments 
24 
Testing as a Leadership skill 
 Probe 
 Experiment 
 Execute 
 Decide 
 Move on...
25 
What now? 
 Rethink what you do 
 Consider: 
 The value you offer 
 The value you deliver 
 Your competencies 
 How you work 
 Who you work for 
 Be willing to give up any 
“kindergarten testing” 
26 
Facets of Software Testing 
Software 
design 
10 
8 
6 
4 
2 
0 
Testing 
techniques 
Test automation 
Industry 
knowledge 
Ability to apply 
Product 
knowledge 
stuff 
People skills
27 
Improving in your current role 
Sapient Testing:Engage your brain 
when testing software 
http://www.satisfice.com/blog/archives/99 
http://www.satisfice.com/blog/archives/358 
 Trinity Testing 
http://julianharty-softwaretesting.blogspot.com 
 Use automation appropriately 
28 
Honing our Testing Skills 
 Beta Testing for other software 
“Be a better tester, be a Beta tester” 
(Alan Richardson) 
 Work for a crowd-sourcing company 
 Mob4hire 
 uTest 
 Learn from others 
 Pairing 
 Exercises
29 
Possible new roles? 
 Technical Due Diligence 
 Disruptive Agent of Change 
 Chief Engineer 
 Spy? 
30 
Read on... 
 Gordon M. Bragg: Principles of Experimentation and Measurement 
ISBN 0-13-701169-5 
 Lloyd Roden: Trusted Advisors 
http://www.stickyminds.com/s.asp?F=S7849_CP_2 
 Alan Richardson: Be a better tester, be a Beta tester 
http://www.compendiumdev.co.uk/eurostar2003/default.php 
 Julian Harty: Trinity Testing 
http://julianharty-softwaretesting.blogspot.com 
 Dr Stuart Reid + Julian Harty 
Non Functional Testing (NFT) http://www.commercetest.com/ 
P.T.M.M. http://julianharty-softwaretesting.blogspot.com 
 Tom Van Vleck: Three Questions About Each Bug You Find 
http://www.multicians.org/thvv/threeq.html
31 
Q & A 
Now? 
Later? 
julianharty@gmail.com

More Related Content

What's hot

Ken Johnston - Big Bugs That Got Away - EuroSTAR 2010
Ken Johnston - Big Bugs That Got Away -  EuroSTAR 2010Ken Johnston - Big Bugs That Got Away -  EuroSTAR 2010
Ken Johnston - Big Bugs That Got Away - EuroSTAR 2010
TEST Huddle
 
Fredrik Rydberg - Can Exploratory Testing Save Lives - EuroSTAR 2010
Fredrik Rydberg - Can Exploratory Testing Save Lives - EuroSTAR 2010Fredrik Rydberg - Can Exploratory Testing Save Lives - EuroSTAR 2010
Fredrik Rydberg - Can Exploratory Testing Save Lives - EuroSTAR 2010
TEST Huddle
 
Eric Jimmink - The Specialized Testers of the Future
Eric Jimmink - The Specialized Testers of the FutureEric Jimmink - The Specialized Testers of the Future
Eric Jimmink - The Specialized Testers of the Future
TEST Huddle
 
Gitte Ottosen - Agility and Process Maturity, Of Course They Mix!
Gitte Ottosen - Agility and Process Maturity, Of Course They Mix!Gitte Ottosen - Agility and Process Maturity, Of Course They Mix!
Gitte Ottosen - Agility and Process Maturity, Of Course They Mix!
TEST Huddle
 
Graham Freeburn - Make Your Testing Smarter - Know Your Context!
Graham Freeburn - Make Your Testing Smarter - Know Your Context!Graham Freeburn - Make Your Testing Smarter - Know Your Context!
Graham Freeburn - Make Your Testing Smarter - Know Your Context!
TEST Huddle
 
A Taste of Exploratory Testing
A Taste of Exploratory TestingA Taste of Exploratory Testing
A Taste of Exploratory Testing
Anne-Marie Charrett
 
Using Functional ,Test Automation to Prevent Defects from Escaping the Develo...
Using Functional ,Test Automation to Prevent Defects from Escaping the Develo...Using Functional ,Test Automation to Prevent Defects from Escaping the Develo...
Using Functional ,Test Automation to Prevent Defects from Escaping the Develo...
TEST Huddle
 
'Top Challenges We Face In IT Today To Hinder Our Pursuit Of Quality' by Lloy...
'Top Challenges We Face In IT Today To Hinder Our Pursuit Of Quality' by Lloy...'Top Challenges We Face In IT Today To Hinder Our Pursuit Of Quality' by Lloy...
'Top Challenges We Face In IT Today To Hinder Our Pursuit Of Quality' by Lloy...
TEST Huddle
 
Geoff Thompson - Why Do We Bother With Test Strategies
Geoff Thompson - Why Do We Bother With Test StrategiesGeoff Thompson - Why Do We Bother With Test Strategies
Geoff Thompson - Why Do We Bother With Test Strategies
TEST Huddle
 
Vipul Kocher - Software Testing, A Framework Based Approach
Vipul Kocher - Software Testing, A Framework Based ApproachVipul Kocher - Software Testing, A Framework Based Approach
Vipul Kocher - Software Testing, A Framework Based Approach
TEST Huddle
 
David Hayman - Say What? Testing a Voice Avtivated System - EuroSTAR 2010
David Hayman - Say What? Testing a Voice Avtivated System - EuroSTAR 2010David Hayman - Say What? Testing a Voice Avtivated System - EuroSTAR 2010
David Hayman - Say What? Testing a Voice Avtivated System - EuroSTAR 2010
TEST Huddle
 
Erik Beolen - The Power of Risk
Erik Beolen - The Power of RiskErik Beolen - The Power of Risk
Erik Beolen - The Power of Risk
TEST Huddle
 
'Test Data Management and Project Quality Go Hand In Hand' by Kristian Fische...
'Test Data Management and Project Quality Go Hand In Hand' by Kristian Fische...'Test Data Management and Project Quality Go Hand In Hand' by Kristian Fische...
'Test Data Management and Project Quality Go Hand In Hand' by Kristian Fische...
TEST Huddle
 
A Rapid Introduction to Rapid Software Testing
A Rapid Introduction to Rapid Software TestingA Rapid Introduction to Rapid Software Testing
A Rapid Introduction to Rapid Software Testing
TechWell
 
Isabel Evans - Quality In Use - EuroSTAR 2011
Isabel Evans - Quality In Use - EuroSTAR 2011Isabel Evans - Quality In Use - EuroSTAR 2011
Isabel Evans - Quality In Use - EuroSTAR 2011
TEST Huddle
 
Peter Zimmerer - Establishing Testing Knowledge and Experience Sharing at Sie...
Peter Zimmerer - Establishing Testing Knowledge and Experience Sharing at Sie...Peter Zimmerer - Establishing Testing Knowledge and Experience Sharing at Sie...
Peter Zimmerer - Establishing Testing Knowledge and Experience Sharing at Sie...
TEST Huddle
 
'Team Work Within The Test Team - (E2)Q + p + P = TW' by Malini Mohankumar
'Team Work Within The Test Team - (E2)Q + p + P = TW' by Malini Mohankumar'Team Work Within The Test Team - (E2)Q + p + P = TW' by Malini Mohankumar
'Team Work Within The Test Team - (E2)Q + p + P = TW' by Malini Mohankumar
TEST Huddle
 
Clive Bates - A Pragmatic Approach to Improving Your Testing Process - EuroST...
Clive Bates - A Pragmatic Approach to Improving Your Testing Process - EuroST...Clive Bates - A Pragmatic Approach to Improving Your Testing Process - EuroST...
Clive Bates - A Pragmatic Approach to Improving Your Testing Process - EuroST...
TEST Huddle
 
Johan Jonasson - Introducing Exploratory Testing to Save the Project
Johan Jonasson - Introducing Exploratory Testing to Save the ProjectJohan Jonasson - Introducing Exploratory Testing to Save the Project
Johan Jonasson - Introducing Exploratory Testing to Save the Project
TEST Huddle
 
Thomas Axen - Lean Kaizen Applied To Software Testing - EuroSTAR 2010
Thomas Axen - Lean Kaizen Applied To Software Testing - EuroSTAR 2010Thomas Axen - Lean Kaizen Applied To Software Testing - EuroSTAR 2010
Thomas Axen - Lean Kaizen Applied To Software Testing - EuroSTAR 2010
TEST Huddle
 

What's hot (20)

Ken Johnston - Big Bugs That Got Away - EuroSTAR 2010
Ken Johnston - Big Bugs That Got Away -  EuroSTAR 2010Ken Johnston - Big Bugs That Got Away -  EuroSTAR 2010
Ken Johnston - Big Bugs That Got Away - EuroSTAR 2010
 
Fredrik Rydberg - Can Exploratory Testing Save Lives - EuroSTAR 2010
Fredrik Rydberg - Can Exploratory Testing Save Lives - EuroSTAR 2010Fredrik Rydberg - Can Exploratory Testing Save Lives - EuroSTAR 2010
Fredrik Rydberg - Can Exploratory Testing Save Lives - EuroSTAR 2010
 
Eric Jimmink - The Specialized Testers of the Future
Eric Jimmink - The Specialized Testers of the FutureEric Jimmink - The Specialized Testers of the Future
Eric Jimmink - The Specialized Testers of the Future
 
Gitte Ottosen - Agility and Process Maturity, Of Course They Mix!
Gitte Ottosen - Agility and Process Maturity, Of Course They Mix!Gitte Ottosen - Agility and Process Maturity, Of Course They Mix!
Gitte Ottosen - Agility and Process Maturity, Of Course They Mix!
 
Graham Freeburn - Make Your Testing Smarter - Know Your Context!
Graham Freeburn - Make Your Testing Smarter - Know Your Context!Graham Freeburn - Make Your Testing Smarter - Know Your Context!
Graham Freeburn - Make Your Testing Smarter - Know Your Context!
 
A Taste of Exploratory Testing
A Taste of Exploratory TestingA Taste of Exploratory Testing
A Taste of Exploratory Testing
 
Using Functional ,Test Automation to Prevent Defects from Escaping the Develo...
Using Functional ,Test Automation to Prevent Defects from Escaping the Develo...Using Functional ,Test Automation to Prevent Defects from Escaping the Develo...
Using Functional ,Test Automation to Prevent Defects from Escaping the Develo...
 
'Top Challenges We Face In IT Today To Hinder Our Pursuit Of Quality' by Lloy...
'Top Challenges We Face In IT Today To Hinder Our Pursuit Of Quality' by Lloy...'Top Challenges We Face In IT Today To Hinder Our Pursuit Of Quality' by Lloy...
'Top Challenges We Face In IT Today To Hinder Our Pursuit Of Quality' by Lloy...
 
Geoff Thompson - Why Do We Bother With Test Strategies
Geoff Thompson - Why Do We Bother With Test StrategiesGeoff Thompson - Why Do We Bother With Test Strategies
Geoff Thompson - Why Do We Bother With Test Strategies
 
Vipul Kocher - Software Testing, A Framework Based Approach
Vipul Kocher - Software Testing, A Framework Based ApproachVipul Kocher - Software Testing, A Framework Based Approach
Vipul Kocher - Software Testing, A Framework Based Approach
 
David Hayman - Say What? Testing a Voice Avtivated System - EuroSTAR 2010
David Hayman - Say What? Testing a Voice Avtivated System - EuroSTAR 2010David Hayman - Say What? Testing a Voice Avtivated System - EuroSTAR 2010
David Hayman - Say What? Testing a Voice Avtivated System - EuroSTAR 2010
 
Erik Beolen - The Power of Risk
Erik Beolen - The Power of RiskErik Beolen - The Power of Risk
Erik Beolen - The Power of Risk
 
'Test Data Management and Project Quality Go Hand In Hand' by Kristian Fische...
'Test Data Management and Project Quality Go Hand In Hand' by Kristian Fische...'Test Data Management and Project Quality Go Hand In Hand' by Kristian Fische...
'Test Data Management and Project Quality Go Hand In Hand' by Kristian Fische...
 
A Rapid Introduction to Rapid Software Testing
A Rapid Introduction to Rapid Software TestingA Rapid Introduction to Rapid Software Testing
A Rapid Introduction to Rapid Software Testing
 
Isabel Evans - Quality In Use - EuroSTAR 2011
Isabel Evans - Quality In Use - EuroSTAR 2011Isabel Evans - Quality In Use - EuroSTAR 2011
Isabel Evans - Quality In Use - EuroSTAR 2011
 
Peter Zimmerer - Establishing Testing Knowledge and Experience Sharing at Sie...
Peter Zimmerer - Establishing Testing Knowledge and Experience Sharing at Sie...Peter Zimmerer - Establishing Testing Knowledge and Experience Sharing at Sie...
Peter Zimmerer - Establishing Testing Knowledge and Experience Sharing at Sie...
 
'Team Work Within The Test Team - (E2)Q + p + P = TW' by Malini Mohankumar
'Team Work Within The Test Team - (E2)Q + p + P = TW' by Malini Mohankumar'Team Work Within The Test Team - (E2)Q + p + P = TW' by Malini Mohankumar
'Team Work Within The Test Team - (E2)Q + p + P = TW' by Malini Mohankumar
 
Clive Bates - A Pragmatic Approach to Improving Your Testing Process - EuroST...
Clive Bates - A Pragmatic Approach to Improving Your Testing Process - EuroST...Clive Bates - A Pragmatic Approach to Improving Your Testing Process - EuroST...
Clive Bates - A Pragmatic Approach to Improving Your Testing Process - EuroST...
 
Johan Jonasson - Introducing Exploratory Testing to Save the Project
Johan Jonasson - Introducing Exploratory Testing to Save the ProjectJohan Jonasson - Introducing Exploratory Testing to Save the Project
Johan Jonasson - Introducing Exploratory Testing to Save the Project
 
Thomas Axen - Lean Kaizen Applied To Software Testing - EuroSTAR 2010
Thomas Axen - Lean Kaizen Applied To Software Testing - EuroSTAR 2010Thomas Axen - Lean Kaizen Applied To Software Testing - EuroSTAR 2010
Thomas Axen - Lean Kaizen Applied To Software Testing - EuroSTAR 2010
 

Viewers also liked

Dorothy Graham - Can The Past Tell Us The Future
Dorothy Graham -  Can The Past Tell Us The FutureDorothy Graham -  Can The Past Tell Us The Future
Dorothy Graham - Can The Past Tell Us The Future
TEST Huddle
 
Julie Gardiner - Branch out using Classification Trees for Test Case Design -...
Julie Gardiner - Branch out using Classification Trees for Test Case Design -...Julie Gardiner - Branch out using Classification Trees for Test Case Design -...
Julie Gardiner - Branch out using Classification Trees for Test Case Design -...
TEST Huddle
 
In Turkish: Yazılım Test-Kod Mühendisliği (YTKM): Kaliteli Test-Kodu Geliştir...
In Turkish: Yazılım Test-Kod Mühendisliği (YTKM): Kaliteli Test-Kodu Geliştir...In Turkish: Yazılım Test-Kod Mühendisliği (YTKM): Kaliteli Test-Kodu Geliştir...
In Turkish: Yazılım Test-Kod Mühendisliği (YTKM): Kaliteli Test-Kodu Geliştir...
Vahid Garousi
 
Üniversite Yazılım Mühendisliği programları müfredatının SWEBOK kılavuzu kull...
Üniversite Yazılım Mühendisliği programları müfredatının SWEBOK kılavuzu kull...Üniversite Yazılım Mühendisliği programları müfredatının SWEBOK kılavuzu kull...
Üniversite Yazılım Mühendisliği programları müfredatının SWEBOK kılavuzu kull...
Vahid Garousi
 
Good Testers are Often Lucky
Good Testers are Often LuckyGood Testers are Often Lucky
Good Testers are Often Lucky
TEST Huddle
 
PROJECTS_Portfolio_ITC
PROJECTS_Portfolio_ITCPROJECTS_Portfolio_ITC
PROJECTS_Portfolio_ITC
Srinivas Kadiyala
 
Hacking JavaScript Games - Cellular Automata
Hacking JavaScript Games - Cellular AutomataHacking JavaScript Games - Cellular Automata
Hacking JavaScript Games - Cellular Automata
Alan Richardson
 
La paradoja de la eficiencia
La paradoja de la eficienciaLa paradoja de la eficiencia
La paradoja de la eficiencia
Pablo Lischinsky
 
In English: Latest Trends in Software Engineering ( Yazılım Mühendisliğinde S...
In English: Latest Trends in Software Engineering (Yazılım Mühendisliğinde S...In English: Latest Trends in Software Engineering (Yazılım Mühendisliğinde S...
In English: Latest Trends in Software Engineering ( Yazılım Mühendisliğinde S...
Vahid Garousi
 
Taller de Resiliencia y Agilidad en la conferencia Ágiles 2015, Montevideo 23...
Taller de Resiliencia y Agilidad en la conferencia Ágiles 2015, Montevideo 23...Taller de Resiliencia y Agilidad en la conferencia Ágiles 2015, Montevideo 23...
Taller de Resiliencia y Agilidad en la conferencia Ágiles 2015, Montevideo 23...
Pablo Lischinsky
 
UML-Driven Software Performance Engineering: A systematic mapping and a revie...
UML-Driven Software Performance Engineering: A systematic mapping and a revie...UML-Driven Software Performance Engineering: A systematic mapping and a revie...
UML-Driven Software Performance Engineering: A systematic mapping and a revie...
Vahid Garousi
 
Test Bash Netherlands Alan Richardson "How to misuse 'Automation' for testing...
Test Bash Netherlands Alan Richardson "How to misuse 'Automation' for testing...Test Bash Netherlands Alan Richardson "How to misuse 'Automation' for testing...
Test Bash Netherlands Alan Richardson "How to misuse 'Automation' for testing...
Alan Richardson
 
Upgrading to Selenium WebDriver version 3
Upgrading to Selenium WebDriver version 3Upgrading to Selenium WebDriver version 3
Upgrading to Selenium WebDriver version 3
Alan Richardson
 
A road to awesomeness
A road to awesomenessA road to awesomeness
A road to awesomeness
Huib Schoots
 
Telling the testing story - Storytelling voor testers (DUTCH)
Telling the testing story - Storytelling voor testers (DUTCH)Telling the testing story - Storytelling voor testers (DUTCH)
Telling the testing story - Storytelling voor testers (DUTCH)
Huib Schoots
 
Exploratory testing
Exploratory testingExploratory testing
Exploratory testing
Huib Schoots
 
Are Your Tests Well-Travelled? Thoughts About Test Coverage
Are Your Tests Well-Travelled? Thoughts About Test CoverageAre Your Tests Well-Travelled? Thoughts About Test Coverage
Are Your Tests Well-Travelled? Thoughts About Test Coverage
TEST Huddle
 

Viewers also liked (17)

Dorothy Graham - Can The Past Tell Us The Future
Dorothy Graham -  Can The Past Tell Us The FutureDorothy Graham -  Can The Past Tell Us The Future
Dorothy Graham - Can The Past Tell Us The Future
 
Julie Gardiner - Branch out using Classification Trees for Test Case Design -...
Julie Gardiner - Branch out using Classification Trees for Test Case Design -...Julie Gardiner - Branch out using Classification Trees for Test Case Design -...
Julie Gardiner - Branch out using Classification Trees for Test Case Design -...
 
In Turkish: Yazılım Test-Kod Mühendisliği (YTKM): Kaliteli Test-Kodu Geliştir...
In Turkish: Yazılım Test-Kod Mühendisliği (YTKM): Kaliteli Test-Kodu Geliştir...In Turkish: Yazılım Test-Kod Mühendisliği (YTKM): Kaliteli Test-Kodu Geliştir...
In Turkish: Yazılım Test-Kod Mühendisliği (YTKM): Kaliteli Test-Kodu Geliştir...
 
Üniversite Yazılım Mühendisliği programları müfredatının SWEBOK kılavuzu kull...
Üniversite Yazılım Mühendisliği programları müfredatının SWEBOK kılavuzu kull...Üniversite Yazılım Mühendisliği programları müfredatının SWEBOK kılavuzu kull...
Üniversite Yazılım Mühendisliği programları müfredatının SWEBOK kılavuzu kull...
 
Good Testers are Often Lucky
Good Testers are Often LuckyGood Testers are Often Lucky
Good Testers are Often Lucky
 
PROJECTS_Portfolio_ITC
PROJECTS_Portfolio_ITCPROJECTS_Portfolio_ITC
PROJECTS_Portfolio_ITC
 
Hacking JavaScript Games - Cellular Automata
Hacking JavaScript Games - Cellular AutomataHacking JavaScript Games - Cellular Automata
Hacking JavaScript Games - Cellular Automata
 
La paradoja de la eficiencia
La paradoja de la eficienciaLa paradoja de la eficiencia
La paradoja de la eficiencia
 
In English: Latest Trends in Software Engineering ( Yazılım Mühendisliğinde S...
In English: Latest Trends in Software Engineering (Yazılım Mühendisliğinde S...In English: Latest Trends in Software Engineering (Yazılım Mühendisliğinde S...
In English: Latest Trends in Software Engineering ( Yazılım Mühendisliğinde S...
 
Taller de Resiliencia y Agilidad en la conferencia Ágiles 2015, Montevideo 23...
Taller de Resiliencia y Agilidad en la conferencia Ágiles 2015, Montevideo 23...Taller de Resiliencia y Agilidad en la conferencia Ágiles 2015, Montevideo 23...
Taller de Resiliencia y Agilidad en la conferencia Ágiles 2015, Montevideo 23...
 
UML-Driven Software Performance Engineering: A systematic mapping and a revie...
UML-Driven Software Performance Engineering: A systematic mapping and a revie...UML-Driven Software Performance Engineering: A systematic mapping and a revie...
UML-Driven Software Performance Engineering: A systematic mapping and a revie...
 
Test Bash Netherlands Alan Richardson "How to misuse 'Automation' for testing...
Test Bash Netherlands Alan Richardson "How to misuse 'Automation' for testing...Test Bash Netherlands Alan Richardson "How to misuse 'Automation' for testing...
Test Bash Netherlands Alan Richardson "How to misuse 'Automation' for testing...
 
Upgrading to Selenium WebDriver version 3
Upgrading to Selenium WebDriver version 3Upgrading to Selenium WebDriver version 3
Upgrading to Selenium WebDriver version 3
 
A road to awesomeness
A road to awesomenessA road to awesomeness
A road to awesomeness
 
Telling the testing story - Storytelling voor testers (DUTCH)
Telling the testing story - Storytelling voor testers (DUTCH)Telling the testing story - Storytelling voor testers (DUTCH)
Telling the testing story - Storytelling voor testers (DUTCH)
 
Exploratory testing
Exploratory testingExploratory testing
Exploratory testing
 
Are Your Tests Well-Travelled? Thoughts About Test Coverage
Are Your Tests Well-Travelled? Thoughts About Test CoverageAre Your Tests Well-Travelled? Thoughts About Test Coverage
Are Your Tests Well-Travelled? Thoughts About Test Coverage
 

Similar to Julian Harty - Alternatives To Testing - EuroSTAR 2010

[Paul Holland] Trends in Software Testing
[Paul Holland] Trends in Software Testing[Paul Holland] Trends in Software Testing
[Paul Holland] Trends in Software Testing
Ho Chi Minh City Software Testing Club
 
Is Crowd Testing (relevant) for Software Engineers?
Is Crowd Testing (relevant) for Software Engineers?Is Crowd Testing (relevant) for Software Engineers?
Is Crowd Testing (relevant) for Software Engineers?
Henry Muccini
 
TestHiveB
TestHiveBTestHiveB
Practical Software Quality and Testing
Practical Software Quality and TestingPractical Software Quality and Testing
Practical Software Quality and Testing
jerrykprague
 
TestWorksConf: Experience exploratory testing
TestWorksConf: Experience exploratory testingTestWorksConf: Experience exploratory testing
TestWorksConf: Experience exploratory testing
Maaret Pyhäjärvi
 
Axa Hackathon: User Centric Guide to Application Prototyping
Axa Hackathon: User Centric Guide to Application PrototypingAxa Hackathon: User Centric Guide to Application Prototyping
Axa Hackathon: User Centric Guide to Application Prototyping
Jay Suthar
 
Testing the unknown: the art and science of working with hypothesis
Testing the unknown: the art and science of working with hypothesisTesting the unknown: the art and science of working with hypothesis
Testing the unknown: the art and science of working with hypothesis
Ardita Karaj
 
Design research for a quality product
Design research for a quality productDesign research for a quality product
Design research for a quality product
Carmen Brion
 
Software Testing As a Career Path
Software Testing As a Career PathSoftware Testing As a Career Path
Software Testing As a Career Path
Rock Interview
 
Exploratory Testing Explained
Exploratory Testing ExplainedExploratory Testing Explained
Exploratory Testing Explained
TechWell
 
Foundations of Software Testing Lecture 4
Foundations of Software Testing Lecture 4Foundations of Software Testing Lecture 4
Foundations of Software Testing Lecture 4
Iosif Itkin
 
Michael Bolton - Two futures of software testing - Sept 2010
Michael Bolton - Two futures of software testing - Sept 2010Michael Bolton - Two futures of software testing - Sept 2010
Michael Bolton - Two futures of software testing - Sept 2010
David O'Dowd
 
Digital Transformation, Testing and Automation
Digital Transformation, Testing and AutomationDigital Transformation, Testing and Automation
Digital Transformation, Testing and Automation
TEST Huddle
 
Customer Discovery at Venture Out Moldova, Fall 2013
Customer Discovery at Venture Out Moldova, Fall 2013Customer Discovery at Venture Out Moldova, Fall 2013
Customer Discovery at Venture Out Moldova, Fall 2013
David Kirsch
 
Soft serve quality control
Soft serve quality controlSoft serve quality control
Soft serve quality control
Natalie Semenyuk
 
Nancy's webinar
Nancy's webinarNancy's webinar
Nancy's webinar
VWO
 
Exploratory Testing Explained
Exploratory Testing ExplainedExploratory Testing Explained
Exploratory Testing Explained
TechWell
 
1325 keynote kohavi
1325 keynote kohavi1325 keynote kohavi
1325 keynote kohavi
Rising Media, Inc.
 
2010 04 28 The Lean Startup webinar for the Lean Enterprise Institute
2010 04 28 The Lean Startup webinar for the Lean Enterprise Institute2010 04 28 The Lean Startup webinar for the Lean Enterprise Institute
2010 04 28 The Lean Startup webinar for the Lean Enterprise Institute
Eric Ries
 
The Testing Planet Issue 10
The Testing Planet Issue 10The Testing Planet Issue 10
The Testing Planet Issue 10
Rosie Sherry
 

Similar to Julian Harty - Alternatives To Testing - EuroSTAR 2010 (20)

[Paul Holland] Trends in Software Testing
[Paul Holland] Trends in Software Testing[Paul Holland] Trends in Software Testing
[Paul Holland] Trends in Software Testing
 
Is Crowd Testing (relevant) for Software Engineers?
Is Crowd Testing (relevant) for Software Engineers?Is Crowd Testing (relevant) for Software Engineers?
Is Crowd Testing (relevant) for Software Engineers?
 
TestHiveB
TestHiveBTestHiveB
TestHiveB
 
Practical Software Quality and Testing
Practical Software Quality and TestingPractical Software Quality and Testing
Practical Software Quality and Testing
 
TestWorksConf: Experience exploratory testing
TestWorksConf: Experience exploratory testingTestWorksConf: Experience exploratory testing
TestWorksConf: Experience exploratory testing
 
Axa Hackathon: User Centric Guide to Application Prototyping
Axa Hackathon: User Centric Guide to Application PrototypingAxa Hackathon: User Centric Guide to Application Prototyping
Axa Hackathon: User Centric Guide to Application Prototyping
 
Testing the unknown: the art and science of working with hypothesis
Testing the unknown: the art and science of working with hypothesisTesting the unknown: the art and science of working with hypothesis
Testing the unknown: the art and science of working with hypothesis
 
Design research for a quality product
Design research for a quality productDesign research for a quality product
Design research for a quality product
 
Software Testing As a Career Path
Software Testing As a Career PathSoftware Testing As a Career Path
Software Testing As a Career Path
 
Exploratory Testing Explained
Exploratory Testing ExplainedExploratory Testing Explained
Exploratory Testing Explained
 
Foundations of Software Testing Lecture 4
Foundations of Software Testing Lecture 4Foundations of Software Testing Lecture 4
Foundations of Software Testing Lecture 4
 
Michael Bolton - Two futures of software testing - Sept 2010
Michael Bolton - Two futures of software testing - Sept 2010Michael Bolton - Two futures of software testing - Sept 2010
Michael Bolton - Two futures of software testing - Sept 2010
 
Digital Transformation, Testing and Automation
Digital Transformation, Testing and AutomationDigital Transformation, Testing and Automation
Digital Transformation, Testing and Automation
 
Customer Discovery at Venture Out Moldova, Fall 2013
Customer Discovery at Venture Out Moldova, Fall 2013Customer Discovery at Venture Out Moldova, Fall 2013
Customer Discovery at Venture Out Moldova, Fall 2013
 
Soft serve quality control
Soft serve quality controlSoft serve quality control
Soft serve quality control
 
Nancy's webinar
Nancy's webinarNancy's webinar
Nancy's webinar
 
Exploratory Testing Explained
Exploratory Testing ExplainedExploratory Testing Explained
Exploratory Testing Explained
 
1325 keynote kohavi
1325 keynote kohavi1325 keynote kohavi
1325 keynote kohavi
 
2010 04 28 The Lean Startup webinar for the Lean Enterprise Institute
2010 04 28 The Lean Startup webinar for the Lean Enterprise Institute2010 04 28 The Lean Startup webinar for the Lean Enterprise Institute
2010 04 28 The Lean Startup webinar for the Lean Enterprise Institute
 
The Testing Planet Issue 10
The Testing Planet Issue 10The Testing Planet Issue 10
The Testing Planet Issue 10
 

More from TEST Huddle

Why We Need Diversity in Testing- Accenture
Why We Need Diversity in Testing- AccentureWhy We Need Diversity in Testing- Accenture
Why We Need Diversity in Testing- Accenture
TEST Huddle
 
Keys to continuous testing for faster delivery euro star webinar
Keys to continuous testing for faster delivery euro star webinar Keys to continuous testing for faster delivery euro star webinar
Keys to continuous testing for faster delivery euro star webinar
TEST Huddle
 
Why you Shouldnt Automated But You Will Anyway
Why you Shouldnt Automated But You Will Anyway Why you Shouldnt Automated But You Will Anyway
Why you Shouldnt Automated But You Will Anyway
TEST Huddle
 
Being a Tester in Scrum
Being a Tester in ScrumBeing a Tester in Scrum
Being a Tester in Scrum
TEST Huddle
 
Leveraging Visual Testing with Your Functional Tests
Leveraging Visual Testing with Your Functional TestsLeveraging Visual Testing with Your Functional Tests
Leveraging Visual Testing with Your Functional Tests
TEST Huddle
 
Using Test Trees to get an Overview of Test Work
Using Test Trees to get an Overview of Test WorkUsing Test Trees to get an Overview of Test Work
Using Test Trees to get an Overview of Test Work
TEST Huddle
 
Big Data: The Magic to Attain New Heights
Big Data:  The Magic to Attain New HeightsBig Data:  The Magic to Attain New Heights
Big Data: The Magic to Attain New Heights
TEST Huddle
 
Will Robots Replace Testers?
Will Robots Replace Testers?Will Robots Replace Testers?
Will Robots Replace Testers?
TEST Huddle
 
TDD For The Rest Of Us
TDD For The Rest Of UsTDD For The Rest Of Us
TDD For The Rest Of Us
TEST Huddle
 
Scaling Agile with LeSS (Large Scale Scrum)
Scaling Agile with LeSS (Large Scale Scrum)Scaling Agile with LeSS (Large Scale Scrum)
Scaling Agile with LeSS (Large Scale Scrum)
TEST Huddle
 
Creating Agile Test Strategies for Larger Enterprises
Creating Agile Test Strategies for Larger EnterprisesCreating Agile Test Strategies for Larger Enterprises
Creating Agile Test Strategies for Larger Enterprises
TEST Huddle
 
Is There A Risk?
Is There A Risk?Is There A Risk?
Is There A Risk?
TEST Huddle
 
Growing a Company Test Community: Roles and Paths for Testers
Growing a Company Test Community: Roles and Paths for TestersGrowing a Company Test Community: Roles and Paths for Testers
Growing a Company Test Community: Roles and Paths for Testers
TEST Huddle
 
Do we need testers on agile teams?
Do we need testers on agile teams?Do we need testers on agile teams?
Do we need testers on agile teams?
TEST Huddle
 
How to use selenium successfully
How to use selenium successfullyHow to use selenium successfully
How to use selenium successfully
TEST Huddle
 
Testers & Teams on the Agile Fluency™ Journey
Testers & Teams on the Agile Fluency™ Journey Testers & Teams on the Agile Fluency™ Journey
Testers & Teams on the Agile Fluency™ Journey
TEST Huddle
 
Practical Test Strategy Using Heuristics
Practical Test Strategy Using HeuristicsPractical Test Strategy Using Heuristics
Practical Test Strategy Using Heuristics
TEST Huddle
 
Thinking Through Your Role
Thinking Through Your RoleThinking Through Your Role
Thinking Through Your Role
TEST Huddle
 
Using Selenium 3 0
Using Selenium 3 0Using Selenium 3 0
Using Selenium 3 0
TEST Huddle
 
New Model Testing: A New Test Process and Tool
New Model Testing:  A New Test Process and ToolNew Model Testing:  A New Test Process and Tool
New Model Testing: A New Test Process and Tool
TEST Huddle
 

More from TEST Huddle (20)

Why We Need Diversity in Testing- Accenture
Why We Need Diversity in Testing- AccentureWhy We Need Diversity in Testing- Accenture
Why We Need Diversity in Testing- Accenture
 
Keys to continuous testing for faster delivery euro star webinar
Keys to continuous testing for faster delivery euro star webinar Keys to continuous testing for faster delivery euro star webinar
Keys to continuous testing for faster delivery euro star webinar
 
Why you Shouldnt Automated But You Will Anyway
Why you Shouldnt Automated But You Will Anyway Why you Shouldnt Automated But You Will Anyway
Why you Shouldnt Automated But You Will Anyway
 
Being a Tester in Scrum
Being a Tester in ScrumBeing a Tester in Scrum
Being a Tester in Scrum
 
Leveraging Visual Testing with Your Functional Tests
Leveraging Visual Testing with Your Functional TestsLeveraging Visual Testing with Your Functional Tests
Leveraging Visual Testing with Your Functional Tests
 
Using Test Trees to get an Overview of Test Work
Using Test Trees to get an Overview of Test WorkUsing Test Trees to get an Overview of Test Work
Using Test Trees to get an Overview of Test Work
 
Big Data: The Magic to Attain New Heights
Big Data:  The Magic to Attain New HeightsBig Data:  The Magic to Attain New Heights
Big Data: The Magic to Attain New Heights
 
Will Robots Replace Testers?
Will Robots Replace Testers?Will Robots Replace Testers?
Will Robots Replace Testers?
 
TDD For The Rest Of Us
TDD For The Rest Of UsTDD For The Rest Of Us
TDD For The Rest Of Us
 
Scaling Agile with LeSS (Large Scale Scrum)
Scaling Agile with LeSS (Large Scale Scrum)Scaling Agile with LeSS (Large Scale Scrum)
Scaling Agile with LeSS (Large Scale Scrum)
 
Creating Agile Test Strategies for Larger Enterprises
Creating Agile Test Strategies for Larger EnterprisesCreating Agile Test Strategies for Larger Enterprises
Creating Agile Test Strategies for Larger Enterprises
 
Is There A Risk?
Is There A Risk?Is There A Risk?
Is There A Risk?
 
Growing a Company Test Community: Roles and Paths for Testers
Growing a Company Test Community: Roles and Paths for TestersGrowing a Company Test Community: Roles and Paths for Testers
Growing a Company Test Community: Roles and Paths for Testers
 
Do we need testers on agile teams?
Do we need testers on agile teams?Do we need testers on agile teams?
Do we need testers on agile teams?
 
How to use selenium successfully
How to use selenium successfullyHow to use selenium successfully
How to use selenium successfully
 
Testers & Teams on the Agile Fluency™ Journey
Testers & Teams on the Agile Fluency™ Journey Testers & Teams on the Agile Fluency™ Journey
Testers & Teams on the Agile Fluency™ Journey
 
Practical Test Strategy Using Heuristics
Practical Test Strategy Using HeuristicsPractical Test Strategy Using Heuristics
Practical Test Strategy Using Heuristics
 
Thinking Through Your Role
Thinking Through Your RoleThinking Through Your Role
Thinking Through Your Role
 
Using Selenium 3 0
Using Selenium 3 0Using Selenium 3 0
Using Selenium 3 0
 
New Model Testing: A New Test Process and Tool
New Model Testing:  A New Test Process and ToolNew Model Testing:  A New Test Process and Tool
New Model Testing: A New Test Process and Tool
 

Recently uploaded

How to Interpret Trends in the Kalyan Rajdhani Mix Chart.pdf
How to Interpret Trends in the Kalyan Rajdhani Mix Chart.pdfHow to Interpret Trends in the Kalyan Rajdhani Mix Chart.pdf
How to Interpret Trends in the Kalyan Rajdhani Mix Chart.pdf
Chart Kalyan
 
“Temporal Event Neural Networks: A More Efficient Alternative to the Transfor...
“Temporal Event Neural Networks: A More Efficient Alternative to the Transfor...“Temporal Event Neural Networks: A More Efficient Alternative to the Transfor...
“Temporal Event Neural Networks: A More Efficient Alternative to the Transfor...
Edge AI and Vision Alliance
 
Apps Break Data
Apps Break DataApps Break Data
Apps Break Data
Ivo Velitchkov
 
Astute Business Solutions | Oracle Cloud Partner |
Astute Business Solutions | Oracle Cloud Partner |Astute Business Solutions | Oracle Cloud Partner |
Astute Business Solutions | Oracle Cloud Partner |
AstuteBusiness
 
"Choosing proper type of scaling", Olena Syrota
"Choosing proper type of scaling", Olena Syrota"Choosing proper type of scaling", Olena Syrota
"Choosing proper type of scaling", Olena Syrota
Fwdays
 
Northern Engraving | Nameplate Manufacturing Process - 2024
Northern Engraving | Nameplate Manufacturing Process - 2024Northern Engraving | Nameplate Manufacturing Process - 2024
Northern Engraving | Nameplate Manufacturing Process - 2024
Northern Engraving
 
5th LF Energy Power Grid Model Meet-up Slides
5th LF Energy Power Grid Model Meet-up Slides5th LF Energy Power Grid Model Meet-up Slides
5th LF Energy Power Grid Model Meet-up Slides
DanBrown980551
 
AppSec PNW: Android and iOS Application Security with MobSF
AppSec PNW: Android and iOS Application Security with MobSFAppSec PNW: Android and iOS Application Security with MobSF
AppSec PNW: Android and iOS Application Security with MobSF
Ajin Abraham
 
[OReilly Superstream] Occupy the Space: A grassroots guide to engineering (an...
[OReilly Superstream] Occupy the Space: A grassroots guide to engineering (an...[OReilly Superstream] Occupy the Space: A grassroots guide to engineering (an...
[OReilly Superstream] Occupy the Space: A grassroots guide to engineering (an...
Jason Yip
 
Deep Dive: AI-Powered Marketing to Get More Leads and Customers with HyperGro...
Deep Dive: AI-Powered Marketing to Get More Leads and Customers with HyperGro...Deep Dive: AI-Powered Marketing to Get More Leads and Customers with HyperGro...
Deep Dive: AI-Powered Marketing to Get More Leads and Customers with HyperGro...
saastr
 
Your One-Stop Shop for Python Success: Top 10 US Python Development Providers
Your One-Stop Shop for Python Success: Top 10 US Python Development ProvidersYour One-Stop Shop for Python Success: Top 10 US Python Development Providers
Your One-Stop Shop for Python Success: Top 10 US Python Development Providers
akankshawande
 
Energy Efficient Video Encoding for Cloud and Edge Computing Instances
Energy Efficient Video Encoding for Cloud and Edge Computing InstancesEnergy Efficient Video Encoding for Cloud and Edge Computing Instances
Energy Efficient Video Encoding for Cloud and Edge Computing Instances
Alpen-Adria-Universität
 
Programming Foundation Models with DSPy - Meetup Slides
Programming Foundation Models with DSPy - Meetup SlidesProgramming Foundation Models with DSPy - Meetup Slides
Programming Foundation Models with DSPy - Meetup Slides
Zilliz
 
Mutation Testing for Task-Oriented Chatbots
Mutation Testing for Task-Oriented ChatbotsMutation Testing for Task-Oriented Chatbots
Mutation Testing for Task-Oriented Chatbots
Pablo Gómez Abajo
 
Overcoming the PLG Trap: Lessons from Canva's Head of Sales & Head of EMEA Da...
Overcoming the PLG Trap: Lessons from Canva's Head of Sales & Head of EMEA Da...Overcoming the PLG Trap: Lessons from Canva's Head of Sales & Head of EMEA Da...
Overcoming the PLG Trap: Lessons from Canva's Head of Sales & Head of EMEA Da...
saastr
 
zkStudyClub - LatticeFold: A Lattice-based Folding Scheme and its Application...
zkStudyClub - LatticeFold: A Lattice-based Folding Scheme and its Application...zkStudyClub - LatticeFold: A Lattice-based Folding Scheme and its Application...
zkStudyClub - LatticeFold: A Lattice-based Folding Scheme and its Application...
Alex Pruden
 
Introduction of Cybersecurity with OSS at Code Europe 2024
Introduction of Cybersecurity with OSS  at Code Europe 2024Introduction of Cybersecurity with OSS  at Code Europe 2024
Introduction of Cybersecurity with OSS at Code Europe 2024
Hiroshi SHIBATA
 
JavaLand 2024: Application Development Green Masterplan
JavaLand 2024: Application Development Green MasterplanJavaLand 2024: Application Development Green Masterplan
JavaLand 2024: Application Development Green Masterplan
Miro Wengner
 
HCL Notes and Domino License Cost Reduction in the World of DLAU
HCL Notes and Domino License Cost Reduction in the World of DLAUHCL Notes and Domino License Cost Reduction in the World of DLAU
HCL Notes and Domino License Cost Reduction in the World of DLAU
panagenda
 

Recently uploaded (20)

How to Interpret Trends in the Kalyan Rajdhani Mix Chart.pdf
How to Interpret Trends in the Kalyan Rajdhani Mix Chart.pdfHow to Interpret Trends in the Kalyan Rajdhani Mix Chart.pdf
How to Interpret Trends in the Kalyan Rajdhani Mix Chart.pdf
 
“Temporal Event Neural Networks: A More Efficient Alternative to the Transfor...
“Temporal Event Neural Networks: A More Efficient Alternative to the Transfor...“Temporal Event Neural Networks: A More Efficient Alternative to the Transfor...
“Temporal Event Neural Networks: A More Efficient Alternative to the Transfor...
 
Apps Break Data
Apps Break DataApps Break Data
Apps Break Data
 
Astute Business Solutions | Oracle Cloud Partner |
Astute Business Solutions | Oracle Cloud Partner |Astute Business Solutions | Oracle Cloud Partner |
Astute Business Solutions | Oracle Cloud Partner |
 
"Choosing proper type of scaling", Olena Syrota
"Choosing proper type of scaling", Olena Syrota"Choosing proper type of scaling", Olena Syrota
"Choosing proper type of scaling", Olena Syrota
 
Northern Engraving | Nameplate Manufacturing Process - 2024
Northern Engraving | Nameplate Manufacturing Process - 2024Northern Engraving | Nameplate Manufacturing Process - 2024
Northern Engraving | Nameplate Manufacturing Process - 2024
 
5th LF Energy Power Grid Model Meet-up Slides
5th LF Energy Power Grid Model Meet-up Slides5th LF Energy Power Grid Model Meet-up Slides
5th LF Energy Power Grid Model Meet-up Slides
 
AppSec PNW: Android and iOS Application Security with MobSF
AppSec PNW: Android and iOS Application Security with MobSFAppSec PNW: Android and iOS Application Security with MobSF
AppSec PNW: Android and iOS Application Security with MobSF
 
Artificial Intelligence and Electronic Warfare
Artificial Intelligence and Electronic WarfareArtificial Intelligence and Electronic Warfare
Artificial Intelligence and Electronic Warfare
 
[OReilly Superstream] Occupy the Space: A grassroots guide to engineering (an...
[OReilly Superstream] Occupy the Space: A grassroots guide to engineering (an...[OReilly Superstream] Occupy the Space: A grassroots guide to engineering (an...
[OReilly Superstream] Occupy the Space: A grassroots guide to engineering (an...
 
Deep Dive: AI-Powered Marketing to Get More Leads and Customers with HyperGro...
Deep Dive: AI-Powered Marketing to Get More Leads and Customers with HyperGro...Deep Dive: AI-Powered Marketing to Get More Leads and Customers with HyperGro...
Deep Dive: AI-Powered Marketing to Get More Leads and Customers with HyperGro...
 
Your One-Stop Shop for Python Success: Top 10 US Python Development Providers
Your One-Stop Shop for Python Success: Top 10 US Python Development ProvidersYour One-Stop Shop for Python Success: Top 10 US Python Development Providers
Your One-Stop Shop for Python Success: Top 10 US Python Development Providers
 
Energy Efficient Video Encoding for Cloud and Edge Computing Instances
Energy Efficient Video Encoding for Cloud and Edge Computing InstancesEnergy Efficient Video Encoding for Cloud and Edge Computing Instances
Energy Efficient Video Encoding for Cloud and Edge Computing Instances
 
Programming Foundation Models with DSPy - Meetup Slides
Programming Foundation Models with DSPy - Meetup SlidesProgramming Foundation Models with DSPy - Meetup Slides
Programming Foundation Models with DSPy - Meetup Slides
 
Mutation Testing for Task-Oriented Chatbots
Mutation Testing for Task-Oriented ChatbotsMutation Testing for Task-Oriented Chatbots
Mutation Testing for Task-Oriented Chatbots
 
Overcoming the PLG Trap: Lessons from Canva's Head of Sales & Head of EMEA Da...
Overcoming the PLG Trap: Lessons from Canva's Head of Sales & Head of EMEA Da...Overcoming the PLG Trap: Lessons from Canva's Head of Sales & Head of EMEA Da...
Overcoming the PLG Trap: Lessons from Canva's Head of Sales & Head of EMEA Da...
 
zkStudyClub - LatticeFold: A Lattice-based Folding Scheme and its Application...
zkStudyClub - LatticeFold: A Lattice-based Folding Scheme and its Application...zkStudyClub - LatticeFold: A Lattice-based Folding Scheme and its Application...
zkStudyClub - LatticeFold: A Lattice-based Folding Scheme and its Application...
 
Introduction of Cybersecurity with OSS at Code Europe 2024
Introduction of Cybersecurity with OSS  at Code Europe 2024Introduction of Cybersecurity with OSS  at Code Europe 2024
Introduction of Cybersecurity with OSS at Code Europe 2024
 
JavaLand 2024: Application Development Green Masterplan
JavaLand 2024: Application Development Green MasterplanJavaLand 2024: Application Development Green Masterplan
JavaLand 2024: Application Development Green Masterplan
 
HCL Notes and Domino License Cost Reduction in the World of DLAU
HCL Notes and Domino License Cost Reduction in the World of DLAUHCL Notes and Domino License Cost Reduction in the World of DLAU
HCL Notes and Domino License Cost Reduction in the World of DLAU
 

Julian Harty - Alternatives To Testing - EuroSTAR 2010

  • 1. 1 Traditional Testing R.I.P. Alternative Testing Do We Have to Test Like We Always Have? by Julian Harty 14 Nov 2010 2 Today's climate We live in an era where quality has been replaced by speed - people are trained to expect little to none, and are perfectly happy getting it. In such world, testing for quality must redefine itself and find a new purpose. Goranka Bjedov (Google)
  • 2. 3 Cost of “doing the right thing” “the cost of "doing it right" is far higher than the cost of only responding when someone does find a problem” John Viega: CTO McAfee: The myths of security 4 Business Reality... Police, private security experts and internet service providers said on Wednesday they had shut down the Mariposa botnet, one of the largest networks of hacked personal computers discovered. It had siphoned off financial and other information from inside half of the largest 1,000 US companies. March 3rd, 2010 http://www.ft.com/cms/s/0/f6960e5a-2711-11df-b84e-00144feabdc0.html
  • 3. 5 Are Testers impotent?  Why didn't any of the testers find the security flaw(s)?  What can we do to improve our testing competences? 6 Why test at all?  Testing slows projects down  It can mislead, or divert attention from other, more important work  Most testing is futile!  What's the risk of failure?
  • 4. 7 Some impacts of “testing”  Incorrect diagnosis  Incorrect changes  Irrelevant bugs  Still unfixed bugs (what we know could hurt us...) 8 Testers as second-class citizens “Anyone can test”  Therefore, one tester is as good as another, and no/little better than 'anyone'  Therefore, testers are nothing special...
  • 5. 9 Speed is the competitive advantage Faster, iterative, releases Testing for Productivity vs Quality 10 What do you actually do? (when you think you're testing...)
  • 6. 11 Checking vs. Testing Checking Is Confirmation Testing Is Exploration and Learning Checks Are Machine-Decidable; Tests Require Sapience http://www.developsense.com/blog/category/testing-vs-checking/ 12 Some outputs of testing  Data  Error logs Can we get these from other sources?
  • 7.
  • 8. 15 Use Canaries  What are they good for? 16 Canaries  What are they good for?  We expect some to die R.I.P. Cheep (2010)
  • 9. 17 Automate the Checking  When practical, create automated 'tests' that check:  Results  Data  Logs  The state of the software 18 Good uses of automated tests?  T.D.D. RED REFACTOR GREEN  Continuous Builds  Regression Tests  Security Tests
  • 10. 19 Contributory Success Factors (for 'not' testing)  Quality and Speed of feedback  Perception of failure  Time to address and fix issues  Risk and cost of failure  The Art of Customer Relationships 20 What about the Testers?  “Traditional Testing” is waning  Change brings Opportunity  We can choose to apply our skills to more valuable & rewarding work
  • 11. 21 Now what? What can we do with all the redundant testers? 22 Strengths of Testers  Recognizing there may be alternatives  Produces answers sooner  Reduce doubt / Increase confidence  Advocate for: bugs, users, developers, software  Be Trusted Advisors  Debunk mysteries & superstitions  Test for productivity (better, faster, cheaper)  Test for quality (of the end product)  Be disruptive; yet likeable :)
  • 12. 23 Test to provide answers sooner  A good reason to test is to provide answers sooner  We need to decide:  What the aims are  What to measure, and how  How to run the test (environment)  Then we need to: run the tests, analyze the results, & present our assessment clearly See: Gordon Bragg & Design of Experiments 24 Testing as a Leadership skill  Probe  Experiment  Execute  Decide  Move on...
  • 13. 25 What now?  Rethink what you do  Consider:  The value you offer  The value you deliver  Your competencies  How you work  Who you work for  Be willing to give up any “kindergarten testing” 26 Facets of Software Testing Software design 10 8 6 4 2 0 Testing techniques Test automation Industry knowledge Ability to apply Product knowledge stuff People skills
  • 14. 27 Improving in your current role Sapient Testing:Engage your brain when testing software http://www.satisfice.com/blog/archives/99 http://www.satisfice.com/blog/archives/358  Trinity Testing http://julianharty-softwaretesting.blogspot.com  Use automation appropriately 28 Honing our Testing Skills  Beta Testing for other software “Be a better tester, be a Beta tester” (Alan Richardson)  Work for a crowd-sourcing company  Mob4hire  uTest  Learn from others  Pairing  Exercises
  • 15. 29 Possible new roles?  Technical Due Diligence  Disruptive Agent of Change  Chief Engineer  Spy? 30 Read on...  Gordon M. Bragg: Principles of Experimentation and Measurement ISBN 0-13-701169-5  Lloyd Roden: Trusted Advisors http://www.stickyminds.com/s.asp?F=S7849_CP_2  Alan Richardson: Be a better tester, be a Beta tester http://www.compendiumdev.co.uk/eurostar2003/default.php  Julian Harty: Trinity Testing http://julianharty-softwaretesting.blogspot.com  Dr Stuart Reid + Julian Harty Non Functional Testing (NFT) http://www.commercetest.com/ P.T.M.M. http://julianharty-softwaretesting.blogspot.com  Tom Van Vleck: Three Questions About Each Bug You Find http://www.multicians.org/thvv/threeq.html
  • 16. 31 Q & A Now? Later? julianharty@gmail.com