SlideShare a Scribd company logo
1 of 47
Download to read offline
Pursuing quality? (you won’t get there by testing) 
James Whittaker 
Engineering Director, Google 
+docjamesw (Google+) 
@docjamesw (Twitter)
2011 
j f m a m j j a s o n d
2011 
j f m a m j j a s o n d
2011 
j f m a m j j a s o n d
2011 
j f m a m j j a s o n d
2011 
j f m a m j j a s o n d
2011 
j f m a m j j a s o n d
2011 
j f m a m j j a s o n d
2011 
j f m a m j j a s o n d
2011 
j f m a m j j a s o n d
2011 
j f m a m j j a s o n d 
“Want to make 30% less money? Put the word „test‟ in your title.” 
-- Alberto Savoia aka Testivus (GTAC 2011 Keynote Test is Dead)
2011 
j f m a m j j a s o n d
Software is getting better! 
Vs.
Why software is better ... 
Immediate cost of low quality 
Competition
Why software is better ... 
Post-ship bug fixing 
Auto update
Why software is better ... 
Self repairing software 
Crash recovery
Why software is better ... 
Goodbye server config 
Cloud deployment
Why software is better ... 
Reduction of dependencies 
Standards
Why software is better ... 
Elegant programming languages 
Languages
Why software is better ... 
Eradication of certain bug species 
Extinction
Why software is better ... 
Better code management 
Initial code quality
Why software is better ... 
Continuous build/integration/release/test 
No More Big Bang
Why software is better ... 
Convergence of the user and test community 
Crowd Source
Where is testing in this mix?
“Your quality is not good”
So what‟s the problem here? 
We have an overinflated opinion of ourselves 
When do you appreciate car mechanics? 
When they find a problem? … Or when they fix it?
So what‟s the problem here? 
We identify with our role instead of our product 
This is anti-team, anti-company
So what‟s the problem here? 
We think testing provides something of value 
The value of testing is in the activity, 
not the artifacts
So what‟s the problem here? 
We‟ve made developers lazy 
I can mow my own lawn, but why would I? 
Test is development’s crutch
So what‟s the solution here? 
“If you are not part of the solution … 
…there is good money to be made in being part of the problem”
If you can‟t beat „em, join „em!
If you can‟t beat „em, join „em 
What is the value of a single, great tester? 
One user? 
Ten? 
A hundred? 
Ten thousand? 
More? 
We are paying testers to act like users? Really? 
Users don‟t have to act and they have all the devices we‟re interested in 
Stop testing, start enabling those who do
If you can‟t beat „em, join „em 
Who says developers can‟t test? 
They can‟t? … Or they don‟t have to? 
They can‟t? … Or its too hard to be worth the effort? 
Stop testing, start enabling those who should
2011 
j f m a m j j a s o n d
2011 
j f m a m j j a s o n d
2011 
j f m a m j j a s o n d 
Shipped new APIs every few weeks since mid August 
• More than half of the developers have „test‟ in their title 
• Zero dedicated testers, everyone is a dev 
• One developer owns the testing feature 
• Dogfood and trusted tester programs aggressively managed 
• No production defect has lived more than a few hours
2011 
j f m a m j j a s o n d
2011 
j f m a m j j a s o n d 
What does this do to testing? 
• Quality is now “just another feature” of the product 
• Testing is focused on enabling, tracking … not doing 
• The “crowd” takes center stage 
• Specialization is a career opportunity
developer 
tester 
user
developer 
tester 
user 
•treat testing as a feature 
•gets managed in dev workflow 
•product is the focus, not the role
developer 
tester 
user 
•treat testing as a feature 
•gets managed in dev workflow 
•product is the focus, not the role 
•it doesn't matter who does the testing, only that it gets done 
•establish test goals, measure progress toward these goals 
•specialized testing is focus
James Whittaker Engineering Director Google 
If following my work appeals to you: 
+docjamesw (Google+) 
@docjamesw (Twitter) 
googledevspot.blogspot.com 
googletesting.blogspot.com

More Related Content

What's hot

'Acceptance Testing' by Erik Boelen
'Acceptance Testing' by Erik Boelen'Acceptance Testing' by Erik Boelen
'Acceptance Testing' by Erik Boelen
TEST Huddle
 

What's hot (20)

Fredrik Rydberg - Can Exploratory Testing Save Lives - EuroSTAR 2010
Fredrik Rydberg - Can Exploratory Testing Save Lives - EuroSTAR 2010Fredrik Rydberg - Can Exploratory Testing Save Lives - EuroSTAR 2010
Fredrik Rydberg - Can Exploratory Testing Save Lives - EuroSTAR 2010
 
Isabel Evans - Quality In Use - EuroSTAR 2011
Isabel Evans - Quality In Use - EuroSTAR 2011Isabel Evans - Quality In Use - EuroSTAR 2011
Isabel Evans - Quality In Use - EuroSTAR 2011
 
Gitte Ottosen - Agility and Process Maturity, Of Course They Mix!
Gitte Ottosen - Agility and Process Maturity, Of Course They Mix!Gitte Ottosen - Agility and Process Maturity, Of Course They Mix!
Gitte Ottosen - Agility and Process Maturity, Of Course They Mix!
 
'Acceptance Testing' by Erik Boelen
'Acceptance Testing' by Erik Boelen'Acceptance Testing' by Erik Boelen
'Acceptance Testing' by Erik Boelen
 
Niels Malotaux - Help We Have a QA Problem!
Niels Malotaux -  Help We Have a QA Problem!Niels Malotaux -  Help We Have a QA Problem!
Niels Malotaux - Help We Have a QA Problem!
 
Gustav Olsson - Agile - Common Sense with a New Name Tag revised
Gustav Olsson - Agile - Common Sense with a New Name Tag revisedGustav Olsson - Agile - Common Sense with a New Name Tag revised
Gustav Olsson - Agile - Common Sense with a New Name Tag revised
 
Kristian Fischer - Put Test in the Driver's Seat
Kristian Fischer - Put Test in the Driver's SeatKristian Fischer - Put Test in the Driver's Seat
Kristian Fischer - Put Test in the Driver's Seat
 
Martin Koojj - Testers in the Board of Directors
Martin Koojj - Testers in the Board of DirectorsMartin Koojj - Testers in the Board of Directors
Martin Koojj - Testers in the Board of Directors
 
Christian Bk Hansen - Agile on Huge Banking Mainframe Legacy Systems - EuroST...
Christian Bk Hansen - Agile on Huge Banking Mainframe Legacy Systems - EuroST...Christian Bk Hansen - Agile on Huge Banking Mainframe Legacy Systems - EuroST...
Christian Bk Hansen - Agile on Huge Banking Mainframe Legacy Systems - EuroST...
 
Dirk Van Dael - Test Accounting - EuroSTAR 2010
Dirk Van Dael - Test Accounting - EuroSTAR 2010Dirk Van Dael - Test Accounting - EuroSTAR 2010
Dirk Van Dael - Test Accounting - EuroSTAR 2010
 
Beata Karpinska - Testing and Lean Principles - EuroSTAR 2010
Beata Karpinska - Testing and Lean Principles - EuroSTAR 2010Beata Karpinska - Testing and Lean Principles - EuroSTAR 2010
Beata Karpinska - Testing and Lean Principles - EuroSTAR 2010
 
Darius Silingas - From Model Driven Testing to Test Driven Modelling
Darius Silingas - From Model Driven Testing to Test Driven ModellingDarius Silingas - From Model Driven Testing to Test Driven Modelling
Darius Silingas - From Model Driven Testing to Test Driven Modelling
 
Derk jan de Grood - ET, Best of Both Worlds
Derk jan de Grood - ET, Best of Both WorldsDerk jan de Grood - ET, Best of Both Worlds
Derk jan de Grood - ET, Best of Both Worlds
 
Erik Boelen - Testing, The Next Level
Erik Boelen - Testing, The Next LevelErik Boelen - Testing, The Next Level
Erik Boelen - Testing, The Next Level
 
Vipul Kocher - Software Testing, A Framework Based Approach
Vipul Kocher - Software Testing, A Framework Based ApproachVipul Kocher - Software Testing, A Framework Based Approach
Vipul Kocher - Software Testing, A Framework Based Approach
 
John Fodeh - Spend Wisely, Test Well
John Fodeh - Spend Wisely, Test WellJohn Fodeh - Spend Wisely, Test Well
John Fodeh - Spend Wisely, Test Well
 
Peter Zimmerer - Establishing Testing Knowledge and Experience Sharing at Sie...
Peter Zimmerer - Establishing Testing Knowledge and Experience Sharing at Sie...Peter Zimmerer - Establishing Testing Knowledge and Experience Sharing at Sie...
Peter Zimmerer - Establishing Testing Knowledge and Experience Sharing at Sie...
 
Henrik Andersson - Exploratory Testing Champions - EuroSTAR 2010
Henrik Andersson - Exploratory Testing Champions - EuroSTAR 2010Henrik Andersson - Exploratory Testing Champions - EuroSTAR 2010
Henrik Andersson - Exploratory Testing Champions - EuroSTAR 2010
 
[HCMC STC Jan 2015] Workshop Of Context-Driven Testing In Agile
[HCMC STC Jan 2015] Workshop Of Context-Driven Testing In Agile[HCMC STC Jan 2015] Workshop Of Context-Driven Testing In Agile
[HCMC STC Jan 2015] Workshop Of Context-Driven Testing In Agile
 
'Top Challenges We Face In IT Today To Hinder Our Pursuit Of Quality' by Lloy...
'Top Challenges We Face In IT Today To Hinder Our Pursuit Of Quality' by Lloy...'Top Challenges We Face In IT Today To Hinder Our Pursuit Of Quality' by Lloy...
'Top Challenges We Face In IT Today To Hinder Our Pursuit Of Quality' by Lloy...
 

Similar to James Whittaker - Pursuing Quality-You Won't Get There - EuroSTAR 2011

Acceptance testfurureinmind
Acceptance testfurureinmindAcceptance testfurureinmind
Acceptance testfurureinmind
LeanDog
 
I Smell A RAT- Rapid Application Testing
I Smell A RAT- Rapid Application TestingI Smell A RAT- Rapid Application Testing
I Smell A RAT- Rapid Application Testing
Peter Presnell
 

Similar to James Whittaker - Pursuing Quality-You Won't Get There - EuroSTAR 2011 (20)

Atlassian Summit 2015 Lean QA and Agile Testing
Atlassian Summit 2015 Lean QA and Agile TestingAtlassian Summit 2015 Lean QA and Agile Testing
Atlassian Summit 2015 Lean QA and Agile Testing
 
How to Build in Quality from Day 1 using Lean QA and Agile Testing
How to Build in Quality from Day 1 using Lean QA and Agile TestingHow to Build in Quality from Day 1 using Lean QA and Agile Testing
How to Build in Quality from Day 1 using Lean QA and Agile Testing
 
Improving developer tester collaboration with microsoft visual studio 2010
Improving developer tester collaboration with microsoft visual studio 2010Improving developer tester collaboration with microsoft visual studio 2010
Improving developer tester collaboration with microsoft visual studio 2010
 
Acceptance testfurureinmind
Acceptance testfurureinmindAcceptance testfurureinmind
Acceptance testfurureinmind
 
I Smell A RAT- Rapid Application Testing
I Smell A RAT- Rapid Application TestingI Smell A RAT- Rapid Application Testing
I Smell A RAT- Rapid Application Testing
 
Testing in a DevOps team
Testing in a DevOps teamTesting in a DevOps team
Testing in a DevOps team
 
The Portal Builder Story: From Hell to Lean, from Zero to Cloud - part 2
The Portal Builder Story:  From Hell to Lean, from Zero to Cloud - part 2The Portal Builder Story:  From Hell to Lean, from Zero to Cloud - part 2
The Portal Builder Story: From Hell to Lean, from Zero to Cloud - part 2
 
Creating testing tools to support development
Creating testing tools to support developmentCreating testing tools to support development
Creating testing tools to support development
 
DevOps beyond the Tools
DevOps beyond the ToolsDevOps beyond the Tools
DevOps beyond the Tools
 
Cultural learnings of testing for make benefit glorious nation of startup
Cultural learnings of testing for make benefit glorious nation of startupCultural learnings of testing for make benefit glorious nation of startup
Cultural learnings of testing for make benefit glorious nation of startup
 
Continuous delivery is more than dev ops
Continuous delivery is more than dev opsContinuous delivery is more than dev ops
Continuous delivery is more than dev ops
 
Using AI-Powered Visual Tests to empower your tests
Using AI-Powered Visual Tests to empower your testsUsing AI-Powered Visual Tests to empower your tests
Using AI-Powered Visual Tests to empower your tests
 
Go or No-Go: Operability and Contingency Planning at Etsy.com
Go or No-Go: Operability and Contingency Planning at Etsy.comGo or No-Go: Operability and Contingency Planning at Etsy.com
Go or No-Go: Operability and Contingency Planning at Etsy.com
 
Tec314
Tec314Tec314
Tec314
 
Agile testing
Agile testingAgile testing
Agile testing
 
The Future of Testing
The Future of TestingThe Future of Testing
The Future of Testing
 
Getting it Booking right
Getting it Booking rightGetting it Booking right
Getting it Booking right
 
Ben Walters - Creating Customer Value With Agile Testing - EuroSTAR 2011
Ben Walters - Creating Customer Value With Agile Testing - EuroSTAR 2011Ben Walters - Creating Customer Value With Agile Testing - EuroSTAR 2011
Ben Walters - Creating Customer Value With Agile Testing - EuroSTAR 2011
 
Moving Towards Zero Defects with Specification by Example
Moving Towards Zero Defects with Specification by ExampleMoving Towards Zero Defects with Specification by Example
Moving Towards Zero Defects with Specification by Example
 
Agile Testing 20021015
Agile Testing 20021015Agile Testing 20021015
Agile Testing 20021015
 

More from TEST Huddle

More from TEST Huddle (20)

Why We Need Diversity in Testing- Accenture
Why We Need Diversity in Testing- AccentureWhy We Need Diversity in Testing- Accenture
Why We Need Diversity in Testing- Accenture
 
Keys to continuous testing for faster delivery euro star webinar
Keys to continuous testing for faster delivery euro star webinar Keys to continuous testing for faster delivery euro star webinar
Keys to continuous testing for faster delivery euro star webinar
 
Why you Shouldnt Automated But You Will Anyway
Why you Shouldnt Automated But You Will Anyway Why you Shouldnt Automated But You Will Anyway
Why you Shouldnt Automated But You Will Anyway
 
Being a Tester in Scrum
Being a Tester in ScrumBeing a Tester in Scrum
Being a Tester in Scrum
 
Leveraging Visual Testing with Your Functional Tests
Leveraging Visual Testing with Your Functional TestsLeveraging Visual Testing with Your Functional Tests
Leveraging Visual Testing with Your Functional Tests
 
Using Test Trees to get an Overview of Test Work
Using Test Trees to get an Overview of Test WorkUsing Test Trees to get an Overview of Test Work
Using Test Trees to get an Overview of Test Work
 
Big Data: The Magic to Attain New Heights
Big Data:  The Magic to Attain New HeightsBig Data:  The Magic to Attain New Heights
Big Data: The Magic to Attain New Heights
 
Will Robots Replace Testers?
Will Robots Replace Testers?Will Robots Replace Testers?
Will Robots Replace Testers?
 
TDD For The Rest Of Us
TDD For The Rest Of UsTDD For The Rest Of Us
TDD For The Rest Of Us
 
Scaling Agile with LeSS (Large Scale Scrum)
Scaling Agile with LeSS (Large Scale Scrum)Scaling Agile with LeSS (Large Scale Scrum)
Scaling Agile with LeSS (Large Scale Scrum)
 
Creating Agile Test Strategies for Larger Enterprises
Creating Agile Test Strategies for Larger EnterprisesCreating Agile Test Strategies for Larger Enterprises
Creating Agile Test Strategies for Larger Enterprises
 
Is There A Risk?
Is There A Risk?Is There A Risk?
Is There A Risk?
 
Are Your Tests Well-Travelled? Thoughts About Test Coverage
Are Your Tests Well-Travelled? Thoughts About Test CoverageAre Your Tests Well-Travelled? Thoughts About Test Coverage
Are Your Tests Well-Travelled? Thoughts About Test Coverage
 
Growing a Company Test Community: Roles and Paths for Testers
Growing a Company Test Community: Roles and Paths for TestersGrowing a Company Test Community: Roles and Paths for Testers
Growing a Company Test Community: Roles and Paths for Testers
 
Do we need testers on agile teams?
Do we need testers on agile teams?Do we need testers on agile teams?
Do we need testers on agile teams?
 
How to use selenium successfully
How to use selenium successfullyHow to use selenium successfully
How to use selenium successfully
 
Testers & Teams on the Agile Fluency™ Journey
Testers & Teams on the Agile Fluency™ Journey Testers & Teams on the Agile Fluency™ Journey
Testers & Teams on the Agile Fluency™ Journey
 
Practical Test Strategy Using Heuristics
Practical Test Strategy Using HeuristicsPractical Test Strategy Using Heuristics
Practical Test Strategy Using Heuristics
 
Thinking Through Your Role
Thinking Through Your RoleThinking Through Your Role
Thinking Through Your Role
 
Using Selenium 3 0
Using Selenium 3 0Using Selenium 3 0
Using Selenium 3 0
 

Recently uploaded

+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
?#DUbAI#??##{{(☎️+971_581248768%)**%*]'#abortion pills for sale in dubai@
 
Histor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slideHistor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slide
vu2urc
 

Recently uploaded (20)

[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdf[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdf
 
Advantages of Hiring UIUX Design Service Providers for Your Business
Advantages of Hiring UIUX Design Service Providers for Your BusinessAdvantages of Hiring UIUX Design Service Providers for Your Business
Advantages of Hiring UIUX Design Service Providers for Your Business
 
Strategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a FresherStrategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a Fresher
 
Tech Trends Report 2024 Future Today Institute.pdf
Tech Trends Report 2024 Future Today Institute.pdfTech Trends Report 2024 Future Today Institute.pdf
Tech Trends Report 2024 Future Today Institute.pdf
 
Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024
 
Scaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationScaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organization
 
Boost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivityBoost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivity
 
2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...
 
Automating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps ScriptAutomating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps Script
 
The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected Worker
 
Handwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed textsHandwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed texts
 
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law DevelopmentsTrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
 
TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data DiscoveryTrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
 
HTML Injection Attacks: Impact and Mitigation Strategies
HTML Injection Attacks: Impact and Mitigation StrategiesHTML Injection Attacks: Impact and Mitigation Strategies
HTML Injection Attacks: Impact and Mitigation Strategies
 
Real Time Object Detection Using Open CV
Real Time Object Detection Using Open CVReal Time Object Detection Using Open CV
Real Time Object Detection Using Open CV
 
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
 
Understanding Discord NSFW Servers A Guide for Responsible Users.pdf
Understanding Discord NSFW Servers A Guide for Responsible Users.pdfUnderstanding Discord NSFW Servers A Guide for Responsible Users.pdf
Understanding Discord NSFW Servers A Guide for Responsible Users.pdf
 
Histor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slideHistor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slide
 
GenAI Risks & Security Meetup 01052024.pdf
GenAI Risks & Security Meetup 01052024.pdfGenAI Risks & Security Meetup 01052024.pdf
GenAI Risks & Security Meetup 01052024.pdf
 

James Whittaker - Pursuing Quality-You Won't Get There - EuroSTAR 2011

  • 1. Pursuing quality? (you won’t get there by testing) James Whittaker Engineering Director, Google +docjamesw (Google+) @docjamesw (Twitter)
  • 2. 2011 j f m a m j j a s o n d
  • 3. 2011 j f m a m j j a s o n d
  • 4. 2011 j f m a m j j a s o n d
  • 5. 2011 j f m a m j j a s o n d
  • 6. 2011 j f m a m j j a s o n d
  • 7. 2011 j f m a m j j a s o n d
  • 8. 2011 j f m a m j j a s o n d
  • 9. 2011 j f m a m j j a s o n d
  • 10. 2011 j f m a m j j a s o n d
  • 11. 2011 j f m a m j j a s o n d “Want to make 30% less money? Put the word „test‟ in your title.” -- Alberto Savoia aka Testivus (GTAC 2011 Keynote Test is Dead)
  • 12. 2011 j f m a m j j a s o n d
  • 13. Software is getting better! Vs.
  • 14. Why software is better ... Immediate cost of low quality Competition
  • 15. Why software is better ... Post-ship bug fixing Auto update
  • 16. Why software is better ... Self repairing software Crash recovery
  • 17. Why software is better ... Goodbye server config Cloud deployment
  • 18. Why software is better ... Reduction of dependencies Standards
  • 19. Why software is better ... Elegant programming languages Languages
  • 20. Why software is better ... Eradication of certain bug species Extinction
  • 21. Why software is better ... Better code management Initial code quality
  • 22. Why software is better ... Continuous build/integration/release/test No More Big Bang
  • 23. Why software is better ... Convergence of the user and test community Crowd Source
  • 24. Where is testing in this mix?
  • 25. “Your quality is not good”
  • 26. So what‟s the problem here? We have an overinflated opinion of ourselves When do you appreciate car mechanics? When they find a problem? … Or when they fix it?
  • 27. So what‟s the problem here? We identify with our role instead of our product This is anti-team, anti-company
  • 28. So what‟s the problem here? We think testing provides something of value The value of testing is in the activity, not the artifacts
  • 29. So what‟s the problem here? We‟ve made developers lazy I can mow my own lawn, but why would I? Test is development’s crutch
  • 30. So what‟s the solution here? “If you are not part of the solution … …there is good money to be made in being part of the problem”
  • 31. If you can‟t beat „em, join „em!
  • 32. If you can‟t beat „em, join „em What is the value of a single, great tester? One user? Ten? A hundred? Ten thousand? More? We are paying testers to act like users? Really? Users don‟t have to act and they have all the devices we‟re interested in Stop testing, start enabling those who do
  • 33.
  • 34.
  • 35.
  • 36.
  • 37. If you can‟t beat „em, join „em Who says developers can‟t test? They can‟t? … Or they don‟t have to? They can‟t? … Or its too hard to be worth the effort? Stop testing, start enabling those who should
  • 38. 2011 j f m a m j j a s o n d
  • 39. 2011 j f m a m j j a s o n d
  • 40. 2011 j f m a m j j a s o n d Shipped new APIs every few weeks since mid August • More than half of the developers have „test‟ in their title • Zero dedicated testers, everyone is a dev • One developer owns the testing feature • Dogfood and trusted tester programs aggressively managed • No production defect has lived more than a few hours
  • 41. 2011 j f m a m j j a s o n d
  • 42. 2011 j f m a m j j a s o n d What does this do to testing? • Quality is now “just another feature” of the product • Testing is focused on enabling, tracking … not doing • The “crowd” takes center stage • Specialization is a career opportunity
  • 43.
  • 45. developer tester user •treat testing as a feature •gets managed in dev workflow •product is the focus, not the role
  • 46. developer tester user •treat testing as a feature •gets managed in dev workflow •product is the focus, not the role •it doesn't matter who does the testing, only that it gets done •establish test goals, measure progress toward these goals •specialized testing is focus
  • 47. James Whittaker Engineering Director Google If following my work appeals to you: +docjamesw (Google+) @docjamesw (Twitter) googledevspot.blogspot.com googletesting.blogspot.com