SlideShare a Scribd company logo
1 of 83
Download to read offline
Making Test
Automation Work in
  Agile Projects

Belgium Testing Days 2012
          Lisa Crispin
 With Material from Janet Gregory


                                    1
Introductions: Experience, Goals
 Form groups:
    New to automation
    One to two years experience w/ automation
    More than two years experience
 Talk with at least two other people
    Tell each other your learning goals for today
    Note the most interesting one you hear




                                              2
About me…
Programmer, tester, agile team member




                                              3
               Copyright 2012: Lisa Crispin
Introduction - You
   Main role on team?
   Programming, automation experience?
   Using agile approach?
   What have you automated? (Test,
    CI,deployment...)




                                                 4
                  Copyright 2012: Lisa Crispin
Takeaways
Foundation for successful test automation
 “Whole Team” approach
 What/when to automate
 Identifying, overcoming barriers
 Choosing, implementing tools
 First steps
We won’t do any hands-on automation, but will demo
 some examples




                                                   5
                    Copyright 2012: Lisa Crispin
Exercise: Your Learning Goals
 Write one interesting learning goal you heard
  from another participant at the start of the
  class on a sticky note.
 Write your number one learning goal for
  today on a sticky note.
 Put the sticky notes on your table group
  “learning goals” sheet
 Group similar ones together



                                             6
Let‟s start by defining “agile”

Agile teams:
     Deliver business value
      frequently
     at a sustainable pace
     while adapting to the changing
      needs of the business

  Source: Elisabeth Hendrickson


                                                     7
                      Copyright 2012: Lisa Crispin
The key is “sustainable pace”

Technical debt slows us down




                                                8
                 Copyright 2012: Lisa Crispin
The Death
Spiral
High technical debt +
insufficient automation = even
less time
          Copyright 2012: Lisa Crispin
Barriers to Test Automation
What‟s holding you back?




                                               11
                Copyright 2012: Lisa Crispin
Exercise: Your barriers
Individually and silently – write one barrier
  hindering your team per sticky note
Put these on the “impediments” wall chart
  for your table group
Talk to your fellow group members – do you
  see any patterns?




                                                12
                 Copyright 2012: Lisa Crispin
Questions?




                                            13
             Copyright 2012: Lisa Crispin
The Whole-Team Approach
   Automated tests are code
   Respecting the tests
   Collaborating
   Commitment to quality
   Return on investment




                                                 14
                  Copyright 2012: Lisa Crispin
Automated tests are code
public class CalculatorFixture extends
 ColumnFixture {
  public String startDate;
  public String endDate;
  public double startBalance;
  public double endBalance;
  public String irrTarget;
private Calculator calculator = new
 Calculator();
  private Double irr;
                                                15
                 Copyright 2012: Lisa Crispin
Test code deserves the same respect as
production code!
                           (Rodney
                           Dangerfield, a
                           comedian whose
                           tag line was “I
                           don’t get no
                           respect… )
Source: Gojko Adzic, StarEast 2011 keynote
Source: Gojko Adzic, StarEast 2011 keynote
Testers are especially good at…
 Eliciting examples

 Turning them into tests

 Ensuring the right testing
 gets done
 Exploratory testing




                                                  19
                   Copyright 2012: Lisa Crispin
Give testers time to do what we do best




                       How?
                                      20
21

The Whole-Team Approach
Experiment: Iteration 1
   Pair up: one will be tester, one programmer
   Sit back to back so you face away from each
    other
   Tester gets a drawing which needs to be
    replicated
   Tester tells the programmer what to draw, all at
    one time.
   Programmer draws the shapes based on what
    the tester explained.
      No talking during „coding‟!
   Tester “tests” the drawing, reports “bugs” on
    index cards
   Programmer fixes the “bugs”
   How long did it take? Will the customer be         22

    happy?              Copyright 2012: Lisa Crispin
Experiment: Iteration 2
   Collaborate!
   Tester tells programmer what to draw, watches
    the programmer draw, answers questions, points
    out „defects‟ for programmer to fix immediately
      (Don‟t show the programmer the drawing, that
       makes it too easy, we‟re trying to simulate real
       coding)
   How long did it take? Will the customer be
    happy?

    Thanks to the members of the agile-games group and
    Kane Mar for ideas & pictures for this game



                                                          23
                         Copyright 2012: Lisa Crispin
Ways to collaborate



                                        Pair




                                               24
               Copyright 2012: Lisa Crispin
Team responsibility
Automate all regression tests




                                              25
               Copyright 2012: Lisa Crispin
26
Copyright 2012: Lisa Crispin
Commitment to quality
What‟s your team‟s commitment?
The best possible software product?




                                                 27
                  Copyright 2012: Lisa Crispin
Meaningful
Commitmen
t

                                            Experimen
                                            t




                                            Learn
                                                    28
             Copyright 2012: Lisa Crispin
Under-commit
Plan less work than you think you can do
Including all test automation




                Copyright 2012: Lisa Crispin
Learn to write maintainable tests
   Get over the “hump of pain”
                                    From Gerard Meszaros’
                                    XUnit Test Patterns




                                                            30
                   Copyright 2012: Lisa Crispin
Whole-team software development
Create a       Expand
  user         tests –
 story          Story
                Tests
                           Automate
  Write                    Q2 Tests       Pair,
Customer         Start                   “Show
  (Q2)         thinking                   Me”
 Tests          how to
                 code
                             TDD

                                      Exploratory
                                        testing
   Product owner
   Product owner/ Tester
   Tester
   Tester/Programmer
   Programmer                          Customer
                                         User
                                      Acceptance

                                                    31
Exercise

 •Think of an experiment to get your
 whole team engaged in automating
 tests
 •Share with your table group
 •Pick two to share with the class




               Copyright 2012: Lisa Crispin
Getting Over the Hump
   The test automation pyramid
   The agile testing quadrants
   What should be automated
   What shouldn't
   Difficult areas




                                                 33
                  Copyright 2012: Lisa Crispin
Test Automation Pyramid




                                             34
              Copyright 2012: Lisa Crispin
Agile Testing Quadrants




                                              35
               Copyright 2012: Lisa Crispin
Shared Understanding
 Start with tests
 Collaborate




                                                    36
                     Copyright 2012: Lisa Crispin
What Should We Automate?
 Quadrant 1 tests
    Unit, component, TDD
 Quadrant 2 tests
    API, service-level
 Quadrant 4 tests
    Load, performance, stress
 Quadrant 3 tests?
    Leverage automation where useful




                                                 37
                  Copyright 2012: Lisa Crispin
What Shouldn‟t We Automate?
 Quadrant 2 tests
    Wizard of Oz, prototyping
 Quadrant 3 tests
    Usability, UAT, ET
 Tests that will never fail?
    Assess risk
 ROI not enough
    One-off tests




                                                  38
                   Copyright 2012: Lisa Crispin
Where Should We Be Careful?
 GUI tests
    Watch ROI
 End-to-End tests
    Push testing down to lowest level
 Remember the Pyramid




                                                  39
                   Copyright 2012: Lisa Crispin
Hard to Automate?
 Legacy code
    Hard to automate, or just lack of skill?
    “Working Effectively with Legacy Code” –
     Feathers
    “Strangling” – Fowler, Thomas




                                                  40
                   Copyright 2012: Lisa Crispin
Exercise: Low-Hanging Fruit




                                              41
               Copyright 2012: Lisa Crispin
Agile Automation Strategy
 What hurts the most
 Layered approach
 Applying agile principles
    Small chunks/thin slices
    Smart test design
 Choosing the right tools




                                                  42
                   Copyright 2012: Lisa Crispin
What Hurts the Most
   Use retrospectives
   Keep an impediment backlog




                                                   43
                    Copyright 2012: Lisa Crispin
Multi-Layered Approach
Example:
   Learn TDD at unit level
   Automate GUI smoke tests




                                              44
               Copyright 2012: Lisa Crispin
Simplicity
    Address one or two needs at a time
    Understand the problem first
    Try simplest approach first
    Work in small chunks, thin slices
    Incremental & iterative




                                                  45
                   Copyright 2012: Lisa Crispin
Automate a Slice at a Time
Example: 4-step UI to validate, upload profit
  sharing contribution data
• Thread 1: All four pages with navigation
• Thread 2: Select year, enter description on page
  1, display on page 2, browse and upload file on
  page 2
• Thread 3: Validate data in file, display on page 3
• Thread 4: Persist data, display „success‟
  message on page 4




                                                   46
                    Copyright 2012: Lisa Crispin
Thin Slice Example




                                             47
              Copyright 2012: Lisa Crispin
Exercise: Thin Slices
Here‟s our user story:
As an internet shopper, I want to create an
account so that I do not have to enter my address
and billing information each time I make a
purchase
Draw a mind map for this story on a big sheet of
paper
Identify a basic end-to-end slice of functionality
that can be coded, tested, and automated.
If you have time, identify additional slices.

                                                   48
                    Copyright 2012: Lisa Crispin
Test Design Patterns/Principles
                    Code design patterns
                    One clear purpose
                    Don‟t Repeat Yourself




                                             49
Demo




                                      50
       Copyright 2012: Lisa Crispin
Iterative Feedback
   Spike two different approaches
   Pick one to try for N # of iterations
   Use retrospectives to evaluate




                                                   51
                    Copyright 2012: Lisa Crispin
Learn by Doing
   Courage – don‟t be afraid to fail
   Production code practices for test code
   Incremental, thin slices
   Experiment




                                                  52
                   Copyright 2012: Lisa Crispin
Questions About Automation Strategy?




                                             53
              Copyright 2012: Lisa Crispin
Choosing Tools
   Team effort
   Time
   Requirements
   Focus on goals, problems, not tools.
   Experiment




                                                  54
                   Copyright 2012: Lisa Crispin
Understand the Purpose
   Who‟s using the tests? What for?
   What‟s being automated?
   Existing tools, environment
   Who‟s doing what for automating?




                                                 55
                  Copyright 2012: Lisa Crispin
What Fits Your Situation
•   Existing skills
•   Language of application under test
•   Collaboration needs
•   What‟s being automated
•   Life span, future use of tests




                                                  56
                   Copyright 2012: Lisa Crispin
Test Drivers/Frameworks
   Automation layer
   Fit for everyone on team
   Try out more than one
   Let‟s look at more examples




                                                 57
                  Copyright 2012: Lisa Crispin
Where To Find Tools
   www.softwareqatest.com/qattls1.html
   www.testingfaqs.org
   www.opensourcetesting.org
   awta.wikispaces.com/2009ToolsList
   groups.yahoo.com/group/agile-testing
   http://bit.ly/AgileTestTools - aa-ftt spreadsheet




                                                        58
                     Copyright 2012: Lisa Crispin
Example: My Team‟s Tool Choices
•   IntelliJ Idea
•   Jenkins, ant, Maven
•   JUnit
•   FitNesse
•   Canoo WebTest
•   Watir
•   JMeter
•   Selenium 2.0 / WebDriver with Geb framework




                                                  59
                   Copyright 2012: Lisa Crispin
Exercise: Tools




                                                 60
                  Copyright 2012: Lisa Crispin
Making Test Automation Work

   Time to do it right
   Learning culture
   Testable architecture
   Test data
   Managing tests




                                                 61
                  Copyright 2012: Lisa Crispin
Time To Do It Right

   Limit scope, don‟t over-commit
   Write automation task cards
   Quality must be team goal
   Long-term, will let you go faster




                                                  62
                   Copyright 2012: Lisa Crispin
Learning Culture

   OK to make mistakes
   Lots of small experiments
   Slack
   Evolve right design




                                                 63
                  Copyright 2012: Lisa Crispin
Testable Architecture
• Layered architecture
  •   eg. UI, business logic, data access
• Ports and Adapters pattern
  •   App can work without UI or database
  •   Ports accept outside events
  •   Adapters convert for human or automated
      users




                                                  64
                   Copyright 2012: Lisa Crispin
Test Data

 Avoid database access when possible
 Setup/Teardown
   Independent, rerunnable tests
 Canonical data
   Refresh before each test run
 Customizable data for ET
 Production-like data
   Get customers to provide example data



                                                65
                 Copyright 2012: Lisa Crispin
Managing Automated Tests

   Tests as Documentation
   Continuous Integration
   Reporting results
   Metrics




                                                66
                 Copyright 2012: Lisa Crispin
Tests as Documentation
 Understandable
 Who will really use them?
 Once passing, must always pass




                                               67
                Copyright 2012: Lisa Crispin
Any Example Can Become a Test




                                            68
             Copyright 2012: Lisa Crispin
Given/Then/When Example
Scenario: Valid name search returns results

GIVEN that Kant is a supervisor with employees
AND Kant has an employee named Smith
WHEN Kant navigates to the employee name
   search page
AND enters the value “S”
THEN Kant will see a search result that includes
   Smith


                                                   69
                   Copyright 2012: Lisa Crispin
Continuous integration/testing…
…short feedback loop




                                              70
               Copyright 2012: Lisa Crispin
Keep tests passing
Stop the line to fix problems




                                              71
               Copyright 2012: Lisa Crispin
Test Management Tools
 Manage tests, code together
 Some tools have own management
 What problem are you trying to solve?




                                                72
                 Copyright 2012: Lisa Crispin
Exercise: Tests as Documentation




                                             73
              Copyright 2012: Lisa Crispin
Key Success Factors

           Thin Slices


                           Specificatio
                           n by
              Whole Team   Example
              Approach
Short
Feedback
Loops

                  Experiments
                                    74
Exercise: Breaking Barriers




                                              75
               Copyright 2012: Lisa Crispin
Remember
   It‟s a team problem!
   Tackle automation problems with diversity
   Try small experiments
   Baby steps – start simple




                                                    76
                     Copyright 2012: Lisa Crispin
Questions? “Aha” Moments?




                                            77
             Copyright 2012: Lisa Crispin
Agile Testing: A Practical Guide for Testers and Agile
Teams

By Lisa Crispin and Janet Gregory

www.agiletester.ca




                             Copyright 2012: Lisa Crispin
                                  78
Experiences of Test Automation
Dorothy Graham and Mark Fewster




                          Copyright 2012: Lisa Crispin
                               79
Beautiful Testing: Leading Professionals Reveal How
They Improve Software
Edited by Tim Riley, Adam Goucher

Includes chapter by yours truly




                              Copyright 2012: Lisa Crispin
                                   80
Test Patterns

Xunit Test Patterns: Refactoring Test Code
By Gerard Meszaros




                     Copyright 2012: Lisa Crispin
                          81
Specification by Example
How successful teams deliver the right
software

Gojko Adzic

Case studies from > 50 teams




                                                              82
                       Copyright 2012: Lisa Crispin
                   Copyright 2008 Janet Gregory, DragonFire
Agile Test Automation Resources
dhemery.com/pdf/writing_maintainable_automated_accep
tance_tests.pdf
lisacrispin.com
janetgregory.ca
gokjo.net
exampler.com
agile-testing@yahoogroups.com
testobsessed.com
testingreflections.com
pairwith.us



                                                        83
                         Copyright 2012: Lisa Crispin

More Related Content

What's hot

Whole Team Approach to Testing, Illustrated
Whole Team Approach to Testing, IllustratedWhole Team Approach to Testing, Illustrated
Whole Team Approach to Testing, Illustratedlisacrispin
 
Changing Your Testing Mindset, Booster Conference, Bergen, Norway, 2014
Changing Your Testing Mindset, Booster Conference, Bergen, Norway, 2014Changing Your Testing Mindset, Booster Conference, Bergen, Norway, 2014
Changing Your Testing Mindset, Booster Conference, Bergen, Norway, 2014lisacrispin
 
What testers can learn to work more effectively with programmers
What testers can learn to work more effectively with programmersWhat testers can learn to work more effectively with programmers
What testers can learn to work more effectively with programmerslisacrispin
 
Advanced Topics in Agile Testing - The Future - Agile Testing Days 2014
Advanced Topics in Agile Testing - The Future - Agile Testing Days 2014Advanced Topics in Agile Testing - The Future - Agile Testing Days 2014
Advanced Topics in Agile Testing - The Future - Agile Testing Days 2014lisacrispin
 
Welcome to the Future! Preparing for our agile testing journeys, Agile Testin...
Welcome to the Future! Preparing for our agile testing journeys, Agile Testin...Welcome to the Future! Preparing for our agile testing journeys, Agile Testin...
Welcome to the Future! Preparing for our agile testing journeys, Agile Testin...lisacrispin
 
Do testers have to code... to be useful? Janet Gregory and Lisa Crispin plena...
Do testers have to code... to be useful? Janet Gregory and Lisa Crispin plena...Do testers have to code... to be useful? Janet Gregory and Lisa Crispin plena...
Do testers have to code... to be useful? Janet Gregory and Lisa Crispin plena...lisacrispin
 
Do testers have to code... to be useful?
Do testers have to code... to be useful?Do testers have to code... to be useful?
Do testers have to code... to be useful?lisacrispin
 
Advanced Topics in Agile Tsting: Focus on Automation
Advanced Topics in Agile Tsting: Focus on AutomationAdvanced Topics in Agile Tsting: Focus on Automation
Advanced Topics in Agile Tsting: Focus on Automationlisacrispin
 
Making Test Automation Work in Agile Projects 2012
Making Test Automation Work in Agile Projects 2012Making Test Automation Work in Agile Projects 2012
Making Test Automation Work in Agile Projects 2012lisacrispin
 
Agile Requirements Exploration: How Testers Add Value
Agile Requirements Exploration: How Testers Add ValueAgile Requirements Exploration: How Testers Add Value
Agile Requirements Exploration: How Testers Add Valuelisacrispin
 
Scrum plus – why scrum is not enough for successful delivery
Scrum plus – why scrum is not enough for successful deliveryScrum plus – why scrum is not enough for successful delivery
Scrum plus – why scrum is not enough for successful deliveryNaveen Kumar Singh
 
ScrumOps - Scrum + Practical DevOps
ScrumOps - Scrum + Practical DevOpsScrumOps - Scrum + Practical DevOps
ScrumOps - Scrum + Practical DevOpsNaveen Kumar Singh
 
ScrumOps - Featuring Dave West & Jayne Groll
ScrumOps - Featuring Dave West & Jayne GrollScrumOps - Featuring Dave West & Jayne Groll
ScrumOps - Featuring Dave West & Jayne GrollTaylor Puleri
 
Agile is Dead :: Agile Connect Lisbon 2018
Agile is Dead :: Agile Connect Lisbon 2018 Agile is Dead :: Agile Connect Lisbon 2018
Agile is Dead :: Agile Connect Lisbon 2018 Pedro Gustavo Torres
 
Agile is Dead :: Viana Tech Meetups 2018
Agile is Dead :: Viana Tech Meetups 2018Agile is Dead :: Viana Tech Meetups 2018
Agile is Dead :: Viana Tech Meetups 2018Pedro Gustavo Torres
 
Testing in a Continuous World
Testing in a Continuous WorldTesting in a Continuous World
Testing in a Continuous WorldLisi Hocke
 
PMI ACP Prep Course
PMI ACP Prep CoursePMI ACP Prep Course
PMI ACP Prep Coursesparkagility
 
Agile is Dead :: Aginext London 2018
Agile is Dead :: Aginext London 2018Agile is Dead :: Aginext London 2018
Agile is Dead :: Aginext London 2018Pedro Gustavo Torres
 
Don't scale agile. Descale your organisation.
Don't scale agile. Descale your organisation.Don't scale agile. Descale your organisation.
Don't scale agile. Descale your organisation.sbargon
 
AgileTestingOverview
AgileTestingOverviewAgileTestingOverview
AgileTestingOverviewUmair Anis
 

What's hot (20)

Whole Team Approach to Testing, Illustrated
Whole Team Approach to Testing, IllustratedWhole Team Approach to Testing, Illustrated
Whole Team Approach to Testing, Illustrated
 
Changing Your Testing Mindset, Booster Conference, Bergen, Norway, 2014
Changing Your Testing Mindset, Booster Conference, Bergen, Norway, 2014Changing Your Testing Mindset, Booster Conference, Bergen, Norway, 2014
Changing Your Testing Mindset, Booster Conference, Bergen, Norway, 2014
 
What testers can learn to work more effectively with programmers
What testers can learn to work more effectively with programmersWhat testers can learn to work more effectively with programmers
What testers can learn to work more effectively with programmers
 
Advanced Topics in Agile Testing - The Future - Agile Testing Days 2014
Advanced Topics in Agile Testing - The Future - Agile Testing Days 2014Advanced Topics in Agile Testing - The Future - Agile Testing Days 2014
Advanced Topics in Agile Testing - The Future - Agile Testing Days 2014
 
Welcome to the Future! Preparing for our agile testing journeys, Agile Testin...
Welcome to the Future! Preparing for our agile testing journeys, Agile Testin...Welcome to the Future! Preparing for our agile testing journeys, Agile Testin...
Welcome to the Future! Preparing for our agile testing journeys, Agile Testin...
 
Do testers have to code... to be useful? Janet Gregory and Lisa Crispin plena...
Do testers have to code... to be useful? Janet Gregory and Lisa Crispin plena...Do testers have to code... to be useful? Janet Gregory and Lisa Crispin plena...
Do testers have to code... to be useful? Janet Gregory and Lisa Crispin plena...
 
Do testers have to code... to be useful?
Do testers have to code... to be useful?Do testers have to code... to be useful?
Do testers have to code... to be useful?
 
Advanced Topics in Agile Tsting: Focus on Automation
Advanced Topics in Agile Tsting: Focus on AutomationAdvanced Topics in Agile Tsting: Focus on Automation
Advanced Topics in Agile Tsting: Focus on Automation
 
Making Test Automation Work in Agile Projects 2012
Making Test Automation Work in Agile Projects 2012Making Test Automation Work in Agile Projects 2012
Making Test Automation Work in Agile Projects 2012
 
Agile Requirements Exploration: How Testers Add Value
Agile Requirements Exploration: How Testers Add ValueAgile Requirements Exploration: How Testers Add Value
Agile Requirements Exploration: How Testers Add Value
 
Scrum plus – why scrum is not enough for successful delivery
Scrum plus – why scrum is not enough for successful deliveryScrum plus – why scrum is not enough for successful delivery
Scrum plus – why scrum is not enough for successful delivery
 
ScrumOps - Scrum + Practical DevOps
ScrumOps - Scrum + Practical DevOpsScrumOps - Scrum + Practical DevOps
ScrumOps - Scrum + Practical DevOps
 
ScrumOps - Featuring Dave West & Jayne Groll
ScrumOps - Featuring Dave West & Jayne GrollScrumOps - Featuring Dave West & Jayne Groll
ScrumOps - Featuring Dave West & Jayne Groll
 
Agile is Dead :: Agile Connect Lisbon 2018
Agile is Dead :: Agile Connect Lisbon 2018 Agile is Dead :: Agile Connect Lisbon 2018
Agile is Dead :: Agile Connect Lisbon 2018
 
Agile is Dead :: Viana Tech Meetups 2018
Agile is Dead :: Viana Tech Meetups 2018Agile is Dead :: Viana Tech Meetups 2018
Agile is Dead :: Viana Tech Meetups 2018
 
Testing in a Continuous World
Testing in a Continuous WorldTesting in a Continuous World
Testing in a Continuous World
 
PMI ACP Prep Course
PMI ACP Prep CoursePMI ACP Prep Course
PMI ACP Prep Course
 
Agile is Dead :: Aginext London 2018
Agile is Dead :: Aginext London 2018Agile is Dead :: Aginext London 2018
Agile is Dead :: Aginext London 2018
 
Don't scale agile. Descale your organisation.
Don't scale agile. Descale your organisation.Don't scale agile. Descale your organisation.
Don't scale agile. Descale your organisation.
 
AgileTestingOverview
AgileTestingOverviewAgileTestingOverview
AgileTestingOverview
 

Viewers also liked

ALN Houston - "Build Quality In: Guiding Development with Tests"
ALN Houston - "Build Quality In: Guiding Development with Tests"ALN Houston - "Build Quality In: Guiding Development with Tests"
ALN Houston - "Build Quality In: Guiding Development with Tests"lisacrispin
 
Agile Test Case Management
Agile Test Case ManagementAgile Test Case Management
Agile Test Case ManagementAdam Goucher
 
Agile Testing and Test Automation
Agile Testing and Test AutomationAgile Testing and Test Automation
Agile Testing and Test AutomationNaveen Kumar Singh
 
Agile Test Automation: Truth, Oxymoron or Lie?
Agile Test Automation: Truth, Oxymoron or Lie?Agile Test Automation: Truth, Oxymoron or Lie?
Agile Test Automation: Truth, Oxymoron or Lie?Original Software
 
Exploratory testing in an agile development organization (it quality & test ...
Exploratory testing in an agile development organization  (it quality & test ...Exploratory testing in an agile development organization  (it quality & test ...
Exploratory testing in an agile development organization (it quality & test ...Johan Åtting
 
Scrum Crash Course - Anatoli Iliev and Lyubomir Cholakov, Infragistics
Scrum Crash Course - Anatoli Iliev and Lyubomir Cholakov, InfragisticsScrum Crash Course - Anatoli Iliev and Lyubomir Cholakov, Infragistics
Scrum Crash Course - Anatoli Iliev and Lyubomir Cholakov, InfragisticsbeITconference
 
Atd 2016-mapping-mashup
Atd 2016-mapping-mashupAtd 2016-mapping-mashup
Atd 2016-mapping-mashupJoEllen Carter
 
Growing whole teams using the Dreyfus model
Growing whole teams using the Dreyfus modelGrowing whole teams using the Dreyfus model
Growing whole teams using the Dreyfus modelMatt Barcomb
 
Klaus Olsen - Agile Test Management Using Scrum
Klaus Olsen - Agile Test Management Using ScrumKlaus Olsen - Agile Test Management Using Scrum
Klaus Olsen - Agile Test Management Using ScrumTEST Huddle
 
Build the "right" regression suite using Behavior Driven Testing (BDT)
Build the "right" regression suite using Behavior Driven Testing (BDT)Build the "right" regression suite using Behavior Driven Testing (BDT)
Build the "right" regression suite using Behavior Driven Testing (BDT)Anand Bagmar
 
ISTQB Agile Tester - Agile Test Tools
ISTQB Agile Tester - Agile Test ToolsISTQB Agile Tester - Agile Test Tools
ISTQB Agile Tester - Agile Test ToolsMoataz Nabil
 
OPNFV Arno Installation and Validation Walk Through
OPNFV Arno Installation and Validation Walk ThroughOPNFV Arno Installation and Validation Walk Through
OPNFV Arno Installation and Validation Walk ThroughOPNFV
 
Los nuevos desafíos del testing
Los nuevos desafíos del testingLos nuevos desafíos del testing
Los nuevos desafíos del testingTestingBaires
 
Test automation - What? Why? How?
Test automation - What? Why? How?Test automation - What? Why? How?
Test automation - What? Why? How?Anand Bagmar
 
Agile testing principles and practices - Anil Karade
Agile testing principles and practices - Anil KaradeAgile testing principles and practices - Anil Karade
Agile testing principles and practices - Anil KaradeIndicThreads
 

Viewers also liked (19)

ALN Houston - "Build Quality In: Guiding Development with Tests"
ALN Houston - "Build Quality In: Guiding Development with Tests"ALN Houston - "Build Quality In: Guiding Development with Tests"
ALN Houston - "Build Quality In: Guiding Development with Tests"
 
Agile Test Case Management
Agile Test Case ManagementAgile Test Case Management
Agile Test Case Management
 
Agile Testing and Test Automation
Agile Testing and Test AutomationAgile Testing and Test Automation
Agile Testing and Test Automation
 
Agile Test Automation: Truth, Oxymoron or Lie?
Agile Test Automation: Truth, Oxymoron or Lie?Agile Test Automation: Truth, Oxymoron or Lie?
Agile Test Automation: Truth, Oxymoron or Lie?
 
Exploratory testing in an agile development organization (it quality & test ...
Exploratory testing in an agile development organization  (it quality & test ...Exploratory testing in an agile development organization  (it quality & test ...
Exploratory testing in an agile development organization (it quality & test ...
 
Scrum Crash Course - Anatoli Iliev and Lyubomir Cholakov, Infragistics
Scrum Crash Course - Anatoli Iliev and Lyubomir Cholakov, InfragisticsScrum Crash Course - Anatoli Iliev and Lyubomir Cholakov, Infragistics
Scrum Crash Course - Anatoli Iliev and Lyubomir Cholakov, Infragistics
 
Pitch uCoz White Label
Pitch uCoz White LabelPitch uCoz White Label
Pitch uCoz White Label
 
Testing Your Emotions
Testing Your EmotionsTesting Your Emotions
Testing Your Emotions
 
Atd 2016-mapping-mashup
Atd 2016-mapping-mashupAtd 2016-mapping-mashup
Atd 2016-mapping-mashup
 
Growing whole teams using the Dreyfus model
Growing whole teams using the Dreyfus modelGrowing whole teams using the Dreyfus model
Growing whole teams using the Dreyfus model
 
Klaus Olsen - Agile Test Management Using Scrum
Klaus Olsen - Agile Test Management Using ScrumKlaus Olsen - Agile Test Management Using Scrum
Klaus Olsen - Agile Test Management Using Scrum
 
Ucoz Website Builder
Ucoz Website BuilderUcoz Website Builder
Ucoz Website Builder
 
Build the "right" regression suite using Behavior Driven Testing (BDT)
Build the "right" regression suite using Behavior Driven Testing (BDT)Build the "right" regression suite using Behavior Driven Testing (BDT)
Build the "right" regression suite using Behavior Driven Testing (BDT)
 
ISTQB Agile Tester - Agile Test Tools
ISTQB Agile Tester - Agile Test ToolsISTQB Agile Tester - Agile Test Tools
ISTQB Agile Tester - Agile Test Tools
 
OPNFV Arno Installation and Validation Walk Through
OPNFV Arno Installation and Validation Walk ThroughOPNFV Arno Installation and Validation Walk Through
OPNFV Arno Installation and Validation Walk Through
 
Los nuevos desafíos del testing
Los nuevos desafíos del testingLos nuevos desafíos del testing
Los nuevos desafíos del testing
 
Test automation - What? Why? How?
Test automation - What? Why? How?Test automation - What? Why? How?
Test automation - What? Why? How?
 
Agile testing principles and practices - Anil Karade
Agile testing principles and practices - Anil KaradeAgile testing principles and practices - Anil Karade
Agile testing principles and practices - Anil Karade
 
Test Automation in Agile
Test Automation in AgileTest Automation in Agile
Test Automation in Agile
 

Similar to Making Test Automation Work in Agile Projects

What Testers Can Learn to Collaborate Effectively with Programmers, others
What Testers Can Learn to Collaborate Effectively with Programmers, othersWhat Testers Can Learn to Collaborate Effectively with Programmers, others
What Testers Can Learn to Collaborate Effectively with Programmers, otherslisacrispin
 
Common Objections to TDD (and their refutations)
Common Objections to TDD (and their refutations)Common Objections to TDD (and their refutations)
Common Objections to TDD (and their refutations)Seb Rose
 
Agile Testing, Uncertainty, Risk, and Why It All Works
Agile Testing, Uncertainty, Risk, and Why It All WorksAgile Testing, Uncertainty, Risk, and Why It All Works
Agile Testing, Uncertainty, Risk, and Why It All WorksElisabeth Hendrickson
 
What if you could eliminate the hidden costs of development?
What if you could eliminate the hidden costs of development?What if you could eliminate the hidden costs of development?
What if you could eliminate the hidden costs of development?Rogue Wave Software
 
SQuAD 2013: Team Collaboration for Testing
SQuAD 2013: Team Collaboration for TestingSQuAD 2013: Team Collaboration for Testing
SQuAD 2013: Team Collaboration for Testinglisacrispin
 
Agile Anti-Patterns. Yes your agile projects can and will fail too.
Agile Anti-Patterns. Yes your agile projects can and will fail too.Agile Anti-Patterns. Yes your agile projects can and will fail too.
Agile Anti-Patterns. Yes your agile projects can and will fail too.Sander Hoogendoorn
 
Software craftsmanship and you a strong foundation in your team
Software craftsmanship and you a strong foundation in your teamSoftware craftsmanship and you a strong foundation in your team
Software craftsmanship and you a strong foundation in your teamDattatray Kale
 
Originate - Think In Hours Not Sprints
Originate - Think In Hours Not SprintsOriginate - Think In Hours Not Sprints
Originate - Think In Hours Not SprintsRob Meadows
 
Analysis of the interaction between practices for introducing XP effectively
Analysis of the interaction between practices for introducing XP effectivelyAnalysis of the interaction between practices for introducing XP effectively
Analysis of the interaction between practices for introducing XP effectivelyMakoto SAKAI
 
Black box-software-testing-douglas-hoffman2483
Black box-software-testing-douglas-hoffman2483Black box-software-testing-douglas-hoffman2483
Black box-software-testing-douglas-hoffman2483Chaitanya Kn
 
Software Quality via Unit Testing
Software Quality via Unit TestingSoftware Quality via Unit Testing
Software Quality via Unit TestingShaun Abram
 
Emily Bache - Readable, Executable Requirements: Hands-On - EuroSTAR 2013
Emily Bache - Readable, Executable Requirements: Hands-On - EuroSTAR 2013Emily Bache - Readable, Executable Requirements: Hands-On - EuroSTAR 2013
Emily Bache - Readable, Executable Requirements: Hands-On - EuroSTAR 2013TEST Huddle
 
Don't let your tests slow you down
Don't let your tests slow you downDon't let your tests slow you down
Don't let your tests slow you downDaniel Irvine
 
Global Day of Coderetreat Munich 2018
Global Day of Coderetreat Munich 2018Global Day of Coderetreat Munich 2018
Global Day of Coderetreat Munich 2018David Völkel
 
Julian Harty - Alternatives To Testing - EuroSTAR 2010
Julian Harty - Alternatives To Testing - EuroSTAR 2010Julian Harty - Alternatives To Testing - EuroSTAR 2010
Julian Harty - Alternatives To Testing - EuroSTAR 2010TEST Huddle
 
Improving your Agile Process
Improving your Agile ProcessImproving your Agile Process
Improving your Agile ProcessDavid Copeland
 

Similar to Making Test Automation Work in Agile Projects (20)

What Testers Can Learn to Collaborate Effectively with Programmers, others
What Testers Can Learn to Collaborate Effectively with Programmers, othersWhat Testers Can Learn to Collaborate Effectively with Programmers, others
What Testers Can Learn to Collaborate Effectively with Programmers, others
 
Common Objections to TDD (and their refutations)
Common Objections to TDD (and their refutations)Common Objections to TDD (and their refutations)
Common Objections to TDD (and their refutations)
 
Agile Testing Overview
Agile Testing OverviewAgile Testing Overview
Agile Testing Overview
 
Agile Testing, Uncertainty, Risk, and Why It All Works
Agile Testing, Uncertainty, Risk, and Why It All WorksAgile Testing, Uncertainty, Risk, and Why It All Works
Agile Testing, Uncertainty, Risk, and Why It All Works
 
What if you could eliminate the hidden costs of development?
What if you could eliminate the hidden costs of development?What if you could eliminate the hidden costs of development?
What if you could eliminate the hidden costs of development?
 
SQuAD 2013: Team Collaboration for Testing
SQuAD 2013: Team Collaboration for TestingSQuAD 2013: Team Collaboration for Testing
SQuAD 2013: Team Collaboration for Testing
 
Agile Anti-Patterns. Yes your agile projects can and will fail too.
Agile Anti-Patterns. Yes your agile projects can and will fail too.Agile Anti-Patterns. Yes your agile projects can and will fail too.
Agile Anti-Patterns. Yes your agile projects can and will fail too.
 
Software craftsmanship and you a strong foundation in your team
Software craftsmanship and you a strong foundation in your teamSoftware craftsmanship and you a strong foundation in your team
Software craftsmanship and you a strong foundation in your team
 
Stepping Outside
Stepping OutsideStepping Outside
Stepping Outside
 
Raising the Bar
Raising the BarRaising the Bar
Raising the Bar
 
Originate - Think In Hours Not Sprints
Originate - Think In Hours Not SprintsOriginate - Think In Hours Not Sprints
Originate - Think In Hours Not Sprints
 
Analysis of the interaction between practices for introducing XP effectively
Analysis of the interaction between practices for introducing XP effectivelyAnalysis of the interaction between practices for introducing XP effectively
Analysis of the interaction between practices for introducing XP effectively
 
Black box-software-testing-douglas-hoffman2483
Black box-software-testing-douglas-hoffman2483Black box-software-testing-douglas-hoffman2483
Black box-software-testing-douglas-hoffman2483
 
Software Quality via Unit Testing
Software Quality via Unit TestingSoftware Quality via Unit Testing
Software Quality via Unit Testing
 
Emily Bache - Readable, Executable Requirements: Hands-On - EuroSTAR 2013
Emily Bache - Readable, Executable Requirements: Hands-On - EuroSTAR 2013Emily Bache - Readable, Executable Requirements: Hands-On - EuroSTAR 2013
Emily Bache - Readable, Executable Requirements: Hands-On - EuroSTAR 2013
 
Scrum myth buster
Scrum myth busterScrum myth buster
Scrum myth buster
 
Don't let your tests slow you down
Don't let your tests slow you downDon't let your tests slow you down
Don't let your tests slow you down
 
Global Day of Coderetreat Munich 2018
Global Day of Coderetreat Munich 2018Global Day of Coderetreat Munich 2018
Global Day of Coderetreat Munich 2018
 
Julian Harty - Alternatives To Testing - EuroSTAR 2010
Julian Harty - Alternatives To Testing - EuroSTAR 2010Julian Harty - Alternatives To Testing - EuroSTAR 2010
Julian Harty - Alternatives To Testing - EuroSTAR 2010
 
Improving your Agile Process
Improving your Agile ProcessImproving your Agile Process
Improving your Agile Process
 

More from lisacrispin

Exploring Requirements for Shared Understanding
Exploring Requirements for Shared UnderstandingExploring Requirements for Shared Understanding
Exploring Requirements for Shared Understandinglisacrispin
 
Principles for Agile Testers and Modern Testing Principles
Principles for Agile Testers and Modern Testing PrinciplesPrinciples for Agile Testers and Modern Testing Principles
Principles for Agile Testers and Modern Testing Principleslisacrispin
 
BDD and CD - better together
BDD and CD - better togetherBDD and CD - better together
BDD and CD - better togetherlisacrispin
 
Get testing bottlenecks out of your pipelines
Get testing bottlenecks out of your pipelinesGet testing bottlenecks out of your pipelines
Get testing bottlenecks out of your pipelineslisacrispin
 
Thinking Outside the Box: Cognitive bias and testing
Thinking Outside the Box: Cognitive bias and testingThinking Outside the Box: Cognitive bias and testing
Thinking Outside the Box: Cognitive bias and testinglisacrispin
 
The Whole Team Approach to Quality in Continuous Delivery
The Whole Team Approach to Quality in Continuous DeliveryThe Whole Team Approach to Quality in Continuous Delivery
The Whole Team Approach to Quality in Continuous Deliverylisacrispin
 
DeliveryConf - Whole Team Approach to Testing in Continuous Delivery
DeliveryConf - Whole Team Approach to Testing in Continuous DeliveryDeliveryConf - Whole Team Approach to Testing in Continuous Delivery
DeliveryConf - Whole Team Approach to Testing in Continuous Deliverylisacrispin
 
Agile 20015 Boot Camp: Intro to Agile Testing - Everyone Owns Quality
Agile 20015 Boot Camp: Intro to Agile Testing - Everyone Owns QualityAgile 20015 Boot Camp: Intro to Agile Testing - Everyone Owns Quality
Agile 20015 Boot Camp: Intro to Agile Testing - Everyone Owns Qualitylisacrispin
 
Build Quality In, workshop with Janet Gregory and Lisa Crispin at Agile Roots...
Build Quality In, workshop with Janet Gregory and Lisa Crispin at Agile Roots...Build Quality In, workshop with Janet Gregory and Lisa Crispin at Agile Roots...
Build Quality In, workshop with Janet Gregory and Lisa Crispin at Agile Roots...lisacrispin
 
Morph your mindset for Continuous Delivery, Agile Roots 2014
Morph your mindset for Continuous Delivery,  Agile Roots 2014Morph your mindset for Continuous Delivery,  Agile Roots 2014
Morph your mindset for Continuous Delivery, Agile Roots 2014lisacrispin
 
Belgium Testing Days: Shift your testing mindset
Belgium Testing Days: Shift your testing mindsetBelgium Testing Days: Shift your testing mindset
Belgium Testing Days: Shift your testing mindsetlisacrispin
 
Developers who grok testing: why I love them and how they mitigate risk
Developers who grok testing: why I love them and how they mitigate riskDevelopers who grok testing: why I love them and how they mitigate risk
Developers who grok testing: why I love them and how they mitigate risklisacrispin
 
Code mashadvancedtopicsworkshop
Code mashadvancedtopicsworkshopCode mashadvancedtopicsworkshop
Code mashadvancedtopicsworkshoplisacrispin
 
Atd advanced topicsworkshop
Atd advanced topicsworkshopAtd advanced topicsworkshop
Atd advanced topicsworkshoplisacrispin
 

More from lisacrispin (14)

Exploring Requirements for Shared Understanding
Exploring Requirements for Shared UnderstandingExploring Requirements for Shared Understanding
Exploring Requirements for Shared Understanding
 
Principles for Agile Testers and Modern Testing Principles
Principles for Agile Testers and Modern Testing PrinciplesPrinciples for Agile Testers and Modern Testing Principles
Principles for Agile Testers and Modern Testing Principles
 
BDD and CD - better together
BDD and CD - better togetherBDD and CD - better together
BDD and CD - better together
 
Get testing bottlenecks out of your pipelines
Get testing bottlenecks out of your pipelinesGet testing bottlenecks out of your pipelines
Get testing bottlenecks out of your pipelines
 
Thinking Outside the Box: Cognitive bias and testing
Thinking Outside the Box: Cognitive bias and testingThinking Outside the Box: Cognitive bias and testing
Thinking Outside the Box: Cognitive bias and testing
 
The Whole Team Approach to Quality in Continuous Delivery
The Whole Team Approach to Quality in Continuous DeliveryThe Whole Team Approach to Quality in Continuous Delivery
The Whole Team Approach to Quality in Continuous Delivery
 
DeliveryConf - Whole Team Approach to Testing in Continuous Delivery
DeliveryConf - Whole Team Approach to Testing in Continuous DeliveryDeliveryConf - Whole Team Approach to Testing in Continuous Delivery
DeliveryConf - Whole Team Approach to Testing in Continuous Delivery
 
Agile 20015 Boot Camp: Intro to Agile Testing - Everyone Owns Quality
Agile 20015 Boot Camp: Intro to Agile Testing - Everyone Owns QualityAgile 20015 Boot Camp: Intro to Agile Testing - Everyone Owns Quality
Agile 20015 Boot Camp: Intro to Agile Testing - Everyone Owns Quality
 
Build Quality In, workshop with Janet Gregory and Lisa Crispin at Agile Roots...
Build Quality In, workshop with Janet Gregory and Lisa Crispin at Agile Roots...Build Quality In, workshop with Janet Gregory and Lisa Crispin at Agile Roots...
Build Quality In, workshop with Janet Gregory and Lisa Crispin at Agile Roots...
 
Morph your mindset for Continuous Delivery, Agile Roots 2014
Morph your mindset for Continuous Delivery,  Agile Roots 2014Morph your mindset for Continuous Delivery,  Agile Roots 2014
Morph your mindset for Continuous Delivery, Agile Roots 2014
 
Belgium Testing Days: Shift your testing mindset
Belgium Testing Days: Shift your testing mindsetBelgium Testing Days: Shift your testing mindset
Belgium Testing Days: Shift your testing mindset
 
Developers who grok testing: why I love them and how they mitigate risk
Developers who grok testing: why I love them and how they mitigate riskDevelopers who grok testing: why I love them and how they mitigate risk
Developers who grok testing: why I love them and how they mitigate risk
 
Code mashadvancedtopicsworkshop
Code mashadvancedtopicsworkshopCode mashadvancedtopicsworkshop
Code mashadvancedtopicsworkshop
 
Atd advanced topicsworkshop
Atd advanced topicsworkshopAtd advanced topicsworkshop
Atd advanced topicsworkshop
 

Recently uploaded

Genislab builds better products and faster go-to-market with Lean project man...
Genislab builds better products and faster go-to-market with Lean project man...Genislab builds better products and faster go-to-market with Lean project man...
Genislab builds better products and faster go-to-market with Lean project man...Farhan Tariq
 
WomenInAutomation2024: AI and Automation for eveyone
WomenInAutomation2024: AI and Automation for eveyoneWomenInAutomation2024: AI and Automation for eveyone
WomenInAutomation2024: AI and Automation for eveyoneUiPathCommunity
 
So einfach geht modernes Roaming fuer Notes und Nomad.pdf
So einfach geht modernes Roaming fuer Notes und Nomad.pdfSo einfach geht modernes Roaming fuer Notes und Nomad.pdf
So einfach geht modernes Roaming fuer Notes und Nomad.pdfpanagenda
 
Why Agile? - A handbook behind Agile Evolution
Why Agile? - A handbook behind Agile EvolutionWhy Agile? - A handbook behind Agile Evolution
Why Agile? - A handbook behind Agile EvolutionDEEPRAJ PATHAK
 
Glenn Lazarus- Why Your Observability Strategy Needs Security Observability
Glenn Lazarus- Why Your Observability Strategy Needs Security ObservabilityGlenn Lazarus- Why Your Observability Strategy Needs Security Observability
Glenn Lazarus- Why Your Observability Strategy Needs Security Observabilityitnewsafrica
 
Generative Artificial Intelligence: How generative AI works.pdf
Generative Artificial Intelligence: How generative AI works.pdfGenerative Artificial Intelligence: How generative AI works.pdf
Generative Artificial Intelligence: How generative AI works.pdfIngrid Airi González
 
How to Effectively Monitor SD-WAN and SASE Environments with ThousandEyes
How to Effectively Monitor SD-WAN and SASE Environments with ThousandEyesHow to Effectively Monitor SD-WAN and SASE Environments with ThousandEyes
How to Effectively Monitor SD-WAN and SASE Environments with ThousandEyesThousandEyes
 
Emixa Mendix Meetup 11 April 2024 about Mendix Native development
Emixa Mendix Meetup 11 April 2024 about Mendix Native developmentEmixa Mendix Meetup 11 April 2024 about Mendix Native development
Emixa Mendix Meetup 11 April 2024 about Mendix Native developmentPim van der Noll
 
Email Marketing Automation for Bonterra Impact Management (fka Social Solutio...
Email Marketing Automation for Bonterra Impact Management (fka Social Solutio...Email Marketing Automation for Bonterra Impact Management (fka Social Solutio...
Email Marketing Automation for Bonterra Impact Management (fka Social Solutio...Jeffrey Haguewood
 
Deliver Latency Free Customer Experience
Deliver Latency Free Customer ExperienceDeliver Latency Free Customer Experience
Deliver Latency Free Customer ExperienceOpsTree solutions
 
2024 April Patch Tuesday
2024 April Patch Tuesday2024 April Patch Tuesday
2024 April Patch TuesdayIvanti
 
UiPath Community: Communication Mining from Zero to Hero
UiPath Community: Communication Mining from Zero to HeroUiPath Community: Communication Mining from Zero to Hero
UiPath Community: Communication Mining from Zero to HeroUiPathCommunity
 
Microsoft 365 Copilot: How to boost your productivity with AI – Part one: Ado...
Microsoft 365 Copilot: How to boost your productivity with AI – Part one: Ado...Microsoft 365 Copilot: How to boost your productivity with AI – Part one: Ado...
Microsoft 365 Copilot: How to boost your productivity with AI – Part one: Ado...Nikki Chapple
 
The Future Roadmap for the Composable Data Stack - Wes McKinney - Data Counci...
The Future Roadmap for the Composable Data Stack - Wes McKinney - Data Counci...The Future Roadmap for the Composable Data Stack - Wes McKinney - Data Counci...
The Future Roadmap for the Composable Data Stack - Wes McKinney - Data Counci...Wes McKinney
 
Microservices, Docker deploy and Microservices source code in C#
Microservices, Docker deploy and Microservices source code in C#Microservices, Docker deploy and Microservices source code in C#
Microservices, Docker deploy and Microservices source code in C#Karmanjay Verma
 
Connecting the Dots for Information Discovery.pdf
Connecting the Dots for Information Discovery.pdfConnecting the Dots for Information Discovery.pdf
Connecting the Dots for Information Discovery.pdfNeo4j
 
React JS; all concepts. Contains React Features, JSX, functional & Class comp...
React JS; all concepts. Contains React Features, JSX, functional & Class comp...React JS; all concepts. Contains React Features, JSX, functional & Class comp...
React JS; all concepts. Contains React Features, JSX, functional & Class comp...Karmanjay Verma
 
Arizona Broadband Policy Past, Present, and Future Presentation 3/25/24
Arizona Broadband Policy Past, Present, and Future Presentation 3/25/24Arizona Broadband Policy Past, Present, and Future Presentation 3/25/24
Arizona Broadband Policy Past, Present, and Future Presentation 3/25/24Mark Goldstein
 
Microsoft 365 Copilot: How to boost your productivity with AI – Part two: Dat...
Microsoft 365 Copilot: How to boost your productivity with AI – Part two: Dat...Microsoft 365 Copilot: How to boost your productivity with AI – Part two: Dat...
Microsoft 365 Copilot: How to boost your productivity with AI – Part two: Dat...Nikki Chapple
 
Top 10 Hubspot Development Companies in 2024
Top 10 Hubspot Development Companies in 2024Top 10 Hubspot Development Companies in 2024
Top 10 Hubspot Development Companies in 2024TopCSSGallery
 

Recently uploaded (20)

Genislab builds better products and faster go-to-market with Lean project man...
Genislab builds better products and faster go-to-market with Lean project man...Genislab builds better products and faster go-to-market with Lean project man...
Genislab builds better products and faster go-to-market with Lean project man...
 
WomenInAutomation2024: AI and Automation for eveyone
WomenInAutomation2024: AI and Automation for eveyoneWomenInAutomation2024: AI and Automation for eveyone
WomenInAutomation2024: AI and Automation for eveyone
 
So einfach geht modernes Roaming fuer Notes und Nomad.pdf
So einfach geht modernes Roaming fuer Notes und Nomad.pdfSo einfach geht modernes Roaming fuer Notes und Nomad.pdf
So einfach geht modernes Roaming fuer Notes und Nomad.pdf
 
Why Agile? - A handbook behind Agile Evolution
Why Agile? - A handbook behind Agile EvolutionWhy Agile? - A handbook behind Agile Evolution
Why Agile? - A handbook behind Agile Evolution
 
Glenn Lazarus- Why Your Observability Strategy Needs Security Observability
Glenn Lazarus- Why Your Observability Strategy Needs Security ObservabilityGlenn Lazarus- Why Your Observability Strategy Needs Security Observability
Glenn Lazarus- Why Your Observability Strategy Needs Security Observability
 
Generative Artificial Intelligence: How generative AI works.pdf
Generative Artificial Intelligence: How generative AI works.pdfGenerative Artificial Intelligence: How generative AI works.pdf
Generative Artificial Intelligence: How generative AI works.pdf
 
How to Effectively Monitor SD-WAN and SASE Environments with ThousandEyes
How to Effectively Monitor SD-WAN and SASE Environments with ThousandEyesHow to Effectively Monitor SD-WAN and SASE Environments with ThousandEyes
How to Effectively Monitor SD-WAN and SASE Environments with ThousandEyes
 
Emixa Mendix Meetup 11 April 2024 about Mendix Native development
Emixa Mendix Meetup 11 April 2024 about Mendix Native developmentEmixa Mendix Meetup 11 April 2024 about Mendix Native development
Emixa Mendix Meetup 11 April 2024 about Mendix Native development
 
Email Marketing Automation for Bonterra Impact Management (fka Social Solutio...
Email Marketing Automation for Bonterra Impact Management (fka Social Solutio...Email Marketing Automation for Bonterra Impact Management (fka Social Solutio...
Email Marketing Automation for Bonterra Impact Management (fka Social Solutio...
 
Deliver Latency Free Customer Experience
Deliver Latency Free Customer ExperienceDeliver Latency Free Customer Experience
Deliver Latency Free Customer Experience
 
2024 April Patch Tuesday
2024 April Patch Tuesday2024 April Patch Tuesday
2024 April Patch Tuesday
 
UiPath Community: Communication Mining from Zero to Hero
UiPath Community: Communication Mining from Zero to HeroUiPath Community: Communication Mining from Zero to Hero
UiPath Community: Communication Mining from Zero to Hero
 
Microsoft 365 Copilot: How to boost your productivity with AI – Part one: Ado...
Microsoft 365 Copilot: How to boost your productivity with AI – Part one: Ado...Microsoft 365 Copilot: How to boost your productivity with AI – Part one: Ado...
Microsoft 365 Copilot: How to boost your productivity with AI – Part one: Ado...
 
The Future Roadmap for the Composable Data Stack - Wes McKinney - Data Counci...
The Future Roadmap for the Composable Data Stack - Wes McKinney - Data Counci...The Future Roadmap for the Composable Data Stack - Wes McKinney - Data Counci...
The Future Roadmap for the Composable Data Stack - Wes McKinney - Data Counci...
 
Microservices, Docker deploy and Microservices source code in C#
Microservices, Docker deploy and Microservices source code in C#Microservices, Docker deploy and Microservices source code in C#
Microservices, Docker deploy and Microservices source code in C#
 
Connecting the Dots for Information Discovery.pdf
Connecting the Dots for Information Discovery.pdfConnecting the Dots for Information Discovery.pdf
Connecting the Dots for Information Discovery.pdf
 
React JS; all concepts. Contains React Features, JSX, functional & Class comp...
React JS; all concepts. Contains React Features, JSX, functional & Class comp...React JS; all concepts. Contains React Features, JSX, functional & Class comp...
React JS; all concepts. Contains React Features, JSX, functional & Class comp...
 
Arizona Broadband Policy Past, Present, and Future Presentation 3/25/24
Arizona Broadband Policy Past, Present, and Future Presentation 3/25/24Arizona Broadband Policy Past, Present, and Future Presentation 3/25/24
Arizona Broadband Policy Past, Present, and Future Presentation 3/25/24
 
Microsoft 365 Copilot: How to boost your productivity with AI – Part two: Dat...
Microsoft 365 Copilot: How to boost your productivity with AI – Part two: Dat...Microsoft 365 Copilot: How to boost your productivity with AI – Part two: Dat...
Microsoft 365 Copilot: How to boost your productivity with AI – Part two: Dat...
 
Top 10 Hubspot Development Companies in 2024
Top 10 Hubspot Development Companies in 2024Top 10 Hubspot Development Companies in 2024
Top 10 Hubspot Development Companies in 2024
 

Making Test Automation Work in Agile Projects

  • 1. Making Test Automation Work in Agile Projects Belgium Testing Days 2012 Lisa Crispin With Material from Janet Gregory 1
  • 2. Introductions: Experience, Goals  Form groups:  New to automation  One to two years experience w/ automation  More than two years experience  Talk with at least two other people  Tell each other your learning goals for today  Note the most interesting one you hear 2
  • 3. About me… Programmer, tester, agile team member 3 Copyright 2012: Lisa Crispin
  • 4. Introduction - You  Main role on team?  Programming, automation experience?  Using agile approach?  What have you automated? (Test, CI,deployment...) 4 Copyright 2012: Lisa Crispin
  • 5. Takeaways Foundation for successful test automation  “Whole Team” approach  What/when to automate  Identifying, overcoming barriers  Choosing, implementing tools  First steps We won’t do any hands-on automation, but will demo some examples 5 Copyright 2012: Lisa Crispin
  • 6. Exercise: Your Learning Goals  Write one interesting learning goal you heard from another participant at the start of the class on a sticky note.  Write your number one learning goal for today on a sticky note.  Put the sticky notes on your table group “learning goals” sheet  Group similar ones together 6
  • 7. Let‟s start by defining “agile” Agile teams:  Deliver business value frequently  at a sustainable pace  while adapting to the changing needs of the business Source: Elisabeth Hendrickson 7 Copyright 2012: Lisa Crispin
  • 8. The key is “sustainable pace” Technical debt slows us down 8 Copyright 2012: Lisa Crispin
  • 10. High technical debt + insufficient automation = even less time Copyright 2012: Lisa Crispin
  • 11. Barriers to Test Automation What‟s holding you back? 11 Copyright 2012: Lisa Crispin
  • 12. Exercise: Your barriers Individually and silently – write one barrier hindering your team per sticky note Put these on the “impediments” wall chart for your table group Talk to your fellow group members – do you see any patterns? 12 Copyright 2012: Lisa Crispin
  • 13. Questions? 13 Copyright 2012: Lisa Crispin
  • 14. The Whole-Team Approach  Automated tests are code  Respecting the tests  Collaborating  Commitment to quality  Return on investment 14 Copyright 2012: Lisa Crispin
  • 15. Automated tests are code public class CalculatorFixture extends ColumnFixture { public String startDate; public String endDate; public double startBalance; public double endBalance; public String irrTarget; private Calculator calculator = new Calculator(); private Double irr; 15 Copyright 2012: Lisa Crispin
  • 16. Test code deserves the same respect as production code! (Rodney Dangerfield, a comedian whose tag line was “I don’t get no respect… )
  • 17. Source: Gojko Adzic, StarEast 2011 keynote
  • 18. Source: Gojko Adzic, StarEast 2011 keynote
  • 19. Testers are especially good at…  Eliciting examples  Turning them into tests  Ensuring the right testing gets done  Exploratory testing 19 Copyright 2012: Lisa Crispin
  • 20. Give testers time to do what we do best How? 20
  • 22. Experiment: Iteration 1  Pair up: one will be tester, one programmer  Sit back to back so you face away from each other  Tester gets a drawing which needs to be replicated  Tester tells the programmer what to draw, all at one time.  Programmer draws the shapes based on what the tester explained.  No talking during „coding‟!  Tester “tests” the drawing, reports “bugs” on index cards  Programmer fixes the “bugs”  How long did it take? Will the customer be 22 happy? Copyright 2012: Lisa Crispin
  • 23. Experiment: Iteration 2  Collaborate!  Tester tells programmer what to draw, watches the programmer draw, answers questions, points out „defects‟ for programmer to fix immediately  (Don‟t show the programmer the drawing, that makes it too easy, we‟re trying to simulate real coding)  How long did it take? Will the customer be happy? Thanks to the members of the agile-games group and Kane Mar for ideas & pictures for this game 23 Copyright 2012: Lisa Crispin
  • 24. Ways to collaborate Pair 24 Copyright 2012: Lisa Crispin
  • 25. Team responsibility Automate all regression tests 25 Copyright 2012: Lisa Crispin
  • 27. Commitment to quality What‟s your team‟s commitment? The best possible software product? 27 Copyright 2012: Lisa Crispin
  • 28. Meaningful Commitmen t Experimen t Learn 28 Copyright 2012: Lisa Crispin
  • 29. Under-commit Plan less work than you think you can do Including all test automation Copyright 2012: Lisa Crispin
  • 30. Learn to write maintainable tests  Get over the “hump of pain” From Gerard Meszaros’ XUnit Test Patterns 30 Copyright 2012: Lisa Crispin
  • 31. Whole-team software development Create a Expand user tests – story Story Tests Automate Write Q2 Tests Pair, Customer Start “Show (Q2) thinking Me” Tests how to code TDD Exploratory testing Product owner Product owner/ Tester Tester Tester/Programmer Programmer Customer User Acceptance 31
  • 32. Exercise •Think of an experiment to get your whole team engaged in automating tests •Share with your table group •Pick two to share with the class Copyright 2012: Lisa Crispin
  • 33. Getting Over the Hump  The test automation pyramid  The agile testing quadrants  What should be automated  What shouldn't  Difficult areas 33 Copyright 2012: Lisa Crispin
  • 34. Test Automation Pyramid 34 Copyright 2012: Lisa Crispin
  • 35. Agile Testing Quadrants 35 Copyright 2012: Lisa Crispin
  • 36. Shared Understanding  Start with tests  Collaborate 36 Copyright 2012: Lisa Crispin
  • 37. What Should We Automate?  Quadrant 1 tests  Unit, component, TDD  Quadrant 2 tests  API, service-level  Quadrant 4 tests  Load, performance, stress  Quadrant 3 tests?  Leverage automation where useful 37 Copyright 2012: Lisa Crispin
  • 38. What Shouldn‟t We Automate?  Quadrant 2 tests  Wizard of Oz, prototyping  Quadrant 3 tests  Usability, UAT, ET  Tests that will never fail?  Assess risk  ROI not enough  One-off tests 38 Copyright 2012: Lisa Crispin
  • 39. Where Should We Be Careful?  GUI tests  Watch ROI  End-to-End tests  Push testing down to lowest level  Remember the Pyramid 39 Copyright 2012: Lisa Crispin
  • 40. Hard to Automate?  Legacy code  Hard to automate, or just lack of skill?  “Working Effectively with Legacy Code” – Feathers  “Strangling” – Fowler, Thomas 40 Copyright 2012: Lisa Crispin
  • 41. Exercise: Low-Hanging Fruit 41 Copyright 2012: Lisa Crispin
  • 42. Agile Automation Strategy  What hurts the most  Layered approach  Applying agile principles  Small chunks/thin slices  Smart test design  Choosing the right tools 42 Copyright 2012: Lisa Crispin
  • 43. What Hurts the Most  Use retrospectives  Keep an impediment backlog 43 Copyright 2012: Lisa Crispin
  • 44. Multi-Layered Approach Example:  Learn TDD at unit level  Automate GUI smoke tests 44 Copyright 2012: Lisa Crispin
  • 45. Simplicity  Address one or two needs at a time  Understand the problem first  Try simplest approach first  Work in small chunks, thin slices  Incremental & iterative 45 Copyright 2012: Lisa Crispin
  • 46. Automate a Slice at a Time Example: 4-step UI to validate, upload profit sharing contribution data • Thread 1: All four pages with navigation • Thread 2: Select year, enter description on page 1, display on page 2, browse and upload file on page 2 • Thread 3: Validate data in file, display on page 3 • Thread 4: Persist data, display „success‟ message on page 4 46 Copyright 2012: Lisa Crispin
  • 47. Thin Slice Example 47 Copyright 2012: Lisa Crispin
  • 48. Exercise: Thin Slices Here‟s our user story: As an internet shopper, I want to create an account so that I do not have to enter my address and billing information each time I make a purchase Draw a mind map for this story on a big sheet of paper Identify a basic end-to-end slice of functionality that can be coded, tested, and automated. If you have time, identify additional slices. 48 Copyright 2012: Lisa Crispin
  • 49. Test Design Patterns/Principles  Code design patterns  One clear purpose  Don‟t Repeat Yourself 49
  • 50. Demo 50 Copyright 2012: Lisa Crispin
  • 51. Iterative Feedback  Spike two different approaches  Pick one to try for N # of iterations  Use retrospectives to evaluate 51 Copyright 2012: Lisa Crispin
  • 52. Learn by Doing  Courage – don‟t be afraid to fail  Production code practices for test code  Incremental, thin slices  Experiment 52 Copyright 2012: Lisa Crispin
  • 53. Questions About Automation Strategy? 53 Copyright 2012: Lisa Crispin
  • 54. Choosing Tools  Team effort  Time  Requirements  Focus on goals, problems, not tools.  Experiment 54 Copyright 2012: Lisa Crispin
  • 55. Understand the Purpose  Who‟s using the tests? What for?  What‟s being automated?  Existing tools, environment  Who‟s doing what for automating? 55 Copyright 2012: Lisa Crispin
  • 56. What Fits Your Situation • Existing skills • Language of application under test • Collaboration needs • What‟s being automated • Life span, future use of tests 56 Copyright 2012: Lisa Crispin
  • 57. Test Drivers/Frameworks  Automation layer  Fit for everyone on team  Try out more than one  Let‟s look at more examples 57 Copyright 2012: Lisa Crispin
  • 58. Where To Find Tools  www.softwareqatest.com/qattls1.html  www.testingfaqs.org  www.opensourcetesting.org  awta.wikispaces.com/2009ToolsList  groups.yahoo.com/group/agile-testing  http://bit.ly/AgileTestTools - aa-ftt spreadsheet 58 Copyright 2012: Lisa Crispin
  • 59. Example: My Team‟s Tool Choices • IntelliJ Idea • Jenkins, ant, Maven • JUnit • FitNesse • Canoo WebTest • Watir • JMeter • Selenium 2.0 / WebDriver with Geb framework 59 Copyright 2012: Lisa Crispin
  • 60. Exercise: Tools 60 Copyright 2012: Lisa Crispin
  • 61. Making Test Automation Work  Time to do it right  Learning culture  Testable architecture  Test data  Managing tests 61 Copyright 2012: Lisa Crispin
  • 62. Time To Do It Right  Limit scope, don‟t over-commit  Write automation task cards  Quality must be team goal  Long-term, will let you go faster 62 Copyright 2012: Lisa Crispin
  • 63. Learning Culture  OK to make mistakes  Lots of small experiments  Slack  Evolve right design 63 Copyright 2012: Lisa Crispin
  • 64. Testable Architecture • Layered architecture • eg. UI, business logic, data access • Ports and Adapters pattern • App can work without UI or database • Ports accept outside events • Adapters convert for human or automated users 64 Copyright 2012: Lisa Crispin
  • 65. Test Data  Avoid database access when possible  Setup/Teardown  Independent, rerunnable tests  Canonical data  Refresh before each test run  Customizable data for ET  Production-like data  Get customers to provide example data 65 Copyright 2012: Lisa Crispin
  • 66. Managing Automated Tests  Tests as Documentation  Continuous Integration  Reporting results  Metrics 66 Copyright 2012: Lisa Crispin
  • 67. Tests as Documentation  Understandable  Who will really use them?  Once passing, must always pass 67 Copyright 2012: Lisa Crispin
  • 68. Any Example Can Become a Test 68 Copyright 2012: Lisa Crispin
  • 69. Given/Then/When Example Scenario: Valid name search returns results GIVEN that Kant is a supervisor with employees AND Kant has an employee named Smith WHEN Kant navigates to the employee name search page AND enters the value “S” THEN Kant will see a search result that includes Smith 69 Copyright 2012: Lisa Crispin
  • 70. Continuous integration/testing… …short feedback loop 70 Copyright 2012: Lisa Crispin
  • 71. Keep tests passing Stop the line to fix problems 71 Copyright 2012: Lisa Crispin
  • 72. Test Management Tools  Manage tests, code together  Some tools have own management  What problem are you trying to solve? 72 Copyright 2012: Lisa Crispin
  • 73. Exercise: Tests as Documentation 73 Copyright 2012: Lisa Crispin
  • 74. Key Success Factors Thin Slices Specificatio n by Whole Team Example Approach Short Feedback Loops Experiments 74
  • 75. Exercise: Breaking Barriers 75 Copyright 2012: Lisa Crispin
  • 76. Remember  It‟s a team problem!  Tackle automation problems with diversity  Try small experiments  Baby steps – start simple 76 Copyright 2012: Lisa Crispin
  • 77. Questions? “Aha” Moments? 77 Copyright 2012: Lisa Crispin
  • 78. Agile Testing: A Practical Guide for Testers and Agile Teams By Lisa Crispin and Janet Gregory www.agiletester.ca Copyright 2012: Lisa Crispin 78
  • 79. Experiences of Test Automation Dorothy Graham and Mark Fewster Copyright 2012: Lisa Crispin 79
  • 80. Beautiful Testing: Leading Professionals Reveal How They Improve Software Edited by Tim Riley, Adam Goucher Includes chapter by yours truly Copyright 2012: Lisa Crispin 80
  • 81. Test Patterns Xunit Test Patterns: Refactoring Test Code By Gerard Meszaros Copyright 2012: Lisa Crispin 81
  • 82. Specification by Example How successful teams deliver the right software Gojko Adzic Case studies from > 50 teams 82 Copyright 2012: Lisa Crispin Copyright 2008 Janet Gregory, DragonFire
  • 83. Agile Test Automation Resources dhemery.com/pdf/writing_maintainable_automated_accep tance_tests.pdf lisacrispin.com janetgregory.ca gokjo.net exampler.com agile-testing@yahoogroups.com testobsessed.com testingreflections.com pairwith.us 83 Copyright 2012: Lisa Crispin