Acceptance testfurureinmind
Upcoming SlideShare
Loading in...5
×
 

Acceptance testfurureinmind

on

  • 1,445 views

 

Statistics

Views

Total Views
1,445
Views on SlideShare
390
Embed Views
1,055

Actions

Likes
2
Downloads
8
Comments
0

4 Embeds 1,055

http://localhost 576
http://leandog.com 334
http://www.leandog.com 132
http://10.1.1.235 13

Accessibility

Categories

Upload Details

Uploaded via as Apple Keynote

Usage Rights

© All Rights Reserved

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Processing…
Post Comment
Edit your comment
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n

Acceptance testfurureinmind Acceptance testfurureinmind Presentation Transcript

  • Cucumber Acceptance Tests Lessons Learned
  • Cucumber Acceptance Tests Lessons Learned A Frightening Journey Inside Cheezy’s Mind
  • Life is good
  • Starting Point
  • What should the testers do?
  • TesterDeveloper Project Ping Pong
  • The true cost of a defect Code Test
  • The true cost of a defect Code Test
  • The true cost of a defect Code Test
  • The true cost of a defect Code Test
  • The true cost of a defect Steps Code Test
  • The true cost of a defect Steps Code Test
  • The true cost of a defect Review / Prioritize Steps Code Test
  • The true cost of a defect Review / Prioritize Steps Code Test
  • The true cost of a defect Review / Describe Prioritize Steps Code Test
  • The true cost of a defect Review / Describe Prioritize Steps Code Test
  • The true cost of a defect Review / Describe PrioritizeReproduce Steps Code Test
  • The true cost of a defect Review / Describe PrioritizeReproduce Steps Code Test UpdateFix Defect Retest Document
  • Capers JonesSoftware Assessments, Benchmarks, and Best Practices Addison-Wesley, 2000
  • What else?
  • What else?• Unhappy Customers
  • What else?• Unhappy Customers• Demoralized Demotivated Team • Team Flight
  • What else?• Unhappy Customers• Demoralized Demotivated Team • Team Flight• Pressure
  • QA Went Beyond Spec
  • Testing cut short We have a date to makeso testing needs to end now!
  • Manual Testing (not ET)1
  • Manual Testing (not ET) 1.51
  • Manual Testing (not ET) 2.2 1.51
  • Manual Testing (not ET) 6.4 5.3 4.0 3.0 2.2 1.51
  • Automation Fails “Record / Playback testing tools should be clearlylabeled as training wheels” - Elizabeth Hendrickson
  • First attempts at automationjust automated manual tests
  • First attempts at automationjust automated manual tests yielding brittle tests!
  • Little or NoCollaboration
  • 3 Letter Word
  • 3 Letter Word 4 Letter Word
  • Our testers are not verygood because we have way too many bugs!
  • Hardening Phase
  • Fear
  • Bug List
  • “Cheezy”Coach Extraordinaire (with a dirty little secret)
  • Leave QA Alone
  • Testing was constraint
  • Tester Mr. T
  • I can handle anything thatfool Cheezy can throw at me!
  • Thought Process?
  • Thought Process?• Mr. T is very strong
  • Thought Process?• Mr. T is very strong• He can be quite intimidating
  • Thought Process?• Mr. T is very strong• He can be quite intimidating• Did he intimidate the defects out of the system?
  • Thought Process?• Mr. T is very strong• He can be quite intimidating• Did he intimidate the defects out of the system?• Did the approach actually work?
  • The Dogs
  • Early attempts were not always successful
  • Repeating Mistakes
  • Repeating Mistakes Test App
  • Repeating Mistakes Test Test Test Test Test Test Test App Test Test Test Test Test Test
  • Repeating Mistakes App
  • Repeating Mistakes App
  • Works in the small
  • Large Project Fail
  • Hard to understand
  • Hard to understand
  • Communication?
  • Kinda makes you sad:(
  • Success at last!
  • What is it?
  • Acceptance Test Driven Development
  • Acceptance Test Driven Development Behavior Driven Development
  • Acceptance Test Driven Development Behavior Driven DevelopmentExecutable Specifications
  • Acceptance Test Driven Development Behavior Driven DevelopmentExecutable SpecificationsSpecification by Example
  • What did we learn?
  • The words friggin’ matter
  • Collaboration is the goal
  • Automation is necessary (and easy)
  • Quality is a team sport
  • Getting the words right
  • Getting the words right was the hardest part
  • Speak it!
  • Collaboration
  • We discovered walls were still standing
  • Done Done is Evil
  • We Need Automation
  • We Need AutomationStarted off thinking it was all about automation
  • We Need AutomationStarted off thinking it was all about automation Initially automated too much
  • Focus on BehaviorConversion of manual scripts == FAIL
  • Brittle test
  • Brittle test
  • Brittle test
  • Engineering Principles
  • Engineering Principles Test code is production code!
  • Engineering Principles Test code is production code!Keep it clean
  • Engineering Principles Test code is production code!Keep it clean Keep it D.R.Y.
  • Engineering Principles Test code is production code!Keep it clean Keep it D.R.Y. Build abstractions
  • Clean D.R.Y. Test
  • Tools Goals
  • Tools GoalsMake it very easy to adopt and simple to use
  • Tools GoalsMake it very easy to adopt and simple to use Provide “template” for code
  • Tools GoalsMake it very easy to adopt and simple to use Provide “template” for code Make it simple to update as app changes
  • Data?
  • Data?Most data doesn’t matter
  • Data?Most data doesn’t matter Focus on what matters
  • Data? Most data doesn’t matter Focus on what mattersProvide defaults for everything else
  • Nice Picture
  • Still have a ways to go
  • Still have a ways to goTest Data Management
  • Still have a ways to goTest Data Management Parallel Execution
  • Who should automate?
  • Who should automate? Specification
  • Who should automate? Specification Automation
  • Who should automate? Specification Automation Application
  • Who should automate? Specification Automation Application Exploration
  • Who should automate? Specification Automation Application Exploration Specification
  • Who should automate? Specification Automation Application Exploration Specification Application Automation
  • Who should automate? Specification Automation Application Exploration Specification Application Exploration Automation
  • Who should automate? Specification Automation Application Exploration Specification Application Exploration Collaboration Automation
  • Quality is driven by everybody
  • How do defects get into software?
  • How do we get them out?
  • If you find defects after development you are already too late
  • IT’S TIME
  • TO CHANGE
  • THE WAY
  • WE WORK!
  • COLLABORATION
  • WINS!
  • Thank You