• Save
Building the Testing Pipeline
Upcoming SlideShare
Loading in...5
×
 

Building the Testing Pipeline

on

  • 2,480 views

Presentation used to supplement the workshop given at ACCU2010 and XP2010

Presentation used to supplement the workshop given at ACCU2010 and XP2010

Statistics

Views

Total Views
2,480
Views on SlideShare
2,475
Embed Views
5

Actions

Likes
1
Downloads
0
Comments
0

1 Embed 5

http://www.slideshare.net 5

Accessibility

Categories

Upload Details

Uploaded via as Microsoft PowerPoint

Usage Rights

© All Rights Reserved

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Processing…
Post Comment
Edit your comment
  • We will break out into
  • We will break out into
  • Break into small groups. Let people introduce themselves to each other. Make sure they have flip charts, and

Building the Testing Pipeline Building the Testing Pipeline Presentation Transcript

  • Building the Testing Pipeline [email_address] http://www.thekua.com/atwork Twitter: @patkua
  • This is a Work shop Expect to do some work (but it won’t be too taxing)
  • Our Own Pipeline for Today What’s a testing pipeline and why should I care? Understanding tests better Assembling a testing pipeline The right tools for the job Real life examples
  • Who am I?
  • Who are you?
  • Audience Poll: Who knows about… Continuous Integration? Automated Testing?
  • Continuous Integration in a nutshell Source “ Build server” “ Developer” “ Developer” “ Developer” “ Developer” Shippable Product “ CI Pipeline”
  • Continuous Integration Pipelines
  • The simplest .net example Checkout C# “ Assemble” DLL
  • But does it work?
  • Improving quality Checkout C# “ Assemble” DLL Test DLL No idea this works More confidence this works
  • What’s a testing pipeline and why should I care? Understanding tests better Assembling a testing pipeline The right tools for the job Real life examples
  • Checkout C# “ Assemble” DLL Test DLL Speed matters ✓ Fast feedback ✓ Fail fast
  • Testing Pipeline … Tests … Tests … Tests … Tests Automated Consciously designed
  • What’s a testing pipeline and why should I care? Understanding tests better Assembling a testing pipeline The right tools for the job Real life examples
  • Automated Testing ? ? ? ? Brainstorm
  • What types of automated testing do we have?
  • Functional Non Functional Unit Testing Integration Testing Acceptance Testing System Testing Scenario Testing Penetration Testing Load Testing Stress Testing Usability Testing Scalability Testing Approaches Black box White box Story based Testing Boundary Manual Automated Exploratory
  • A simple application
  • Acceptance Tests
  • Unit Tests
  • Integration Tests
  • For each type of test answer:
    • What are its benefits?
    • What are its costs?
    Consider some of the following aspects Speed to write Speed to run Coping with changes Repeatability Isolation Traceability Hardware or environment needs Understandability by entire team Aids design
  • Report Back
  • What’s a testing pipeline and why should I care? Understanding tests better Assembling a testing pipeline The right tools for the job Real life examples
  • Ideal Automated Testing Pyramid Unit Integration Acceptance Significantly more of these compared to others
  • Most Implementations of Testing Pyramid Unit Integration Acceptance Often lacking in these or non existent Very slow! Can’t maintain all of them
  • What’s a testing pipeline and why should I care? Understanding tests better Assembling a testing pipeline The right tools for the job Real life examples
    • Using sticky notes, write down tools that you can use to help automate that part of the testing pipeline
    Group Exercise
    • Walk around and look at others
  • What’s a testing pipeline and why should I care? Understanding tests better Assembling a testing pipeline The right tools for the job Real life examples
  • Practical Applications
  • Email Authoring Tool Unit test Acceptance Integration GUI Component DB JUnit (execution framework) Abbot Abbot Hibernate
  • ISP Provider Provisioning System All Tests 20 minutes Previously: After: Unit Tests 3 minutes Database Tests 10 minutes System Tests 7 minutes JUnit DBUnit +JUnit FIT
  • REST messaging System Toolsets: JUnit HttpUnit JMeter Unit tests 1500+ in 1 minute File Based Integration Tests 100+ in 1 minute Acceptance Tests 80+ in 2 minutes Sanity Performance Tests 1 in 1 minute Load/stress Performance Tests 5 in 60 minutes
  • Concluding thoughts
  • Questions? [email_address] Twitter: @patkua
    • http://c2.com/cgi/wiki?UnitTestingCostsBenefits
    • http://jamesshore.com/Blog/The-Problems-With-Acceptance-Testing.html
    • http://dhemery.com/pdf/writing_maintainable_automated_acceptance_tests.pdf
    Useful links