Tw specifications for-testing1

  • 889 views
Uploaded on

 

More in: Technology
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Be the first to comment
No Downloads

Views

Total Views
889
On Slideshare
0
From Embeds
0
Number of Embeds
1

Actions

Shares
Downloads
16
Comments
0
Likes
1

Embeds 0

No embeds

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
    No notes for slide
  • Start with automated tests Collaboration between testers and developers More time spent on exploratory testing Don ’ t talk process or jargon words Show failing tests Don ’ t make test automation end goal Our Focus Collaboration and process-change
  • Don ’ t forget to update contact details ;-)

Transcript

  • 1. December 2011 Specifications For Enterprise Testing Presenters Sathyan Sethumadhavan & Shalabh Varma
  • 2. Agenda
    • Where do we spend more time
    • A new approach for collaboration
    • Implement Specifications
    • Gauge Progress
    • Q&A
    Private and Confidential. © 2011 ThoughtWorks, Ltd. All rights reserved.
  • 3. Do you experience any of this Private and Confidential. © 2011 ThoughtWorks, Ltd. All rights reserved. Long Regression Cycles Defects Leakage - Missing Requirements Test and Requirements documents becomes stale Spends more time on defect management and triage Less confidence - Existing test coverage Frequent changes - Breaks existing functionalities
  • 4. Do you spend more time here Private and Confidential. © 2011 ThoughtWorks, Ltd. All rights reserved. Requirements document Creating test plan and strategy Creating test Cases/Steps Defect Management Traceability Matrix Fix production Defects
  • 5. Private and Confidential. © 2011 ThoughtWorks, Ltd. All rights reserved.
  • 6. Private and Confidential. © 2011 ThoughtWorks, Ltd. All rights reserved. Specifications Driven Development
  • 7. Private and Confidential. © 2011 ThoughtWorks, Ltd. All rights reserved. EXAMPLES REQUIREMENTS TESTS Can Become Elaborate Verify
  • 8. Specifications – Focus Area Private and Confidential. © 2011 ThoughtWorks, Ltd. All rights reserved. Requirements document Creating test plan and strategy Creating test cases Defect management and analysis Traceability Matrix Fix production defects Specifications for both humans and machines Tests as Documentation Managing stale artifcats Specifying Collaborately Validating Frequently
  • 9. A Good Specification Private and Confidential. © 2011 ThoughtWorks, Ltd. All rights reserved.
    • Examples should be complete
    • Precise and Testable
    • True Specification – Not a script
    • About business functionality – Not software design
    • Self-explanatory and focused
  • 10. A Good Specification Private and Confidential. © 2011 ThoughtWorks, Ltd. All rights reserved.
  • 11. A Good Specification Private and Confidential. © 2011 ThoughtWorks, Ltd. All rights reserved.
  • 12. Benefits Private and Confidential. © 2011 ThoughtWorks, Ltd. All rights reserved.
    • Distributed teams - Necessary artifacts and re-use artifacts
    • One-time specification – Referred by stakeholders and team
    • Artifacts remain as living documents
    • Focus on collaboration and communication gap
    • More time on exploratory/business testing
    • Time-to-market availability
  • 13. Private and Confidential. © 2011 ThoughtWorks, Ltd. All rights reserved. Specifications – Key Process Patterns
  • 14. Key Process Patterns Private and Confidential. © 2011 ThoughtWorks, Ltd. All rights reserved.
  • 15. Key Process Patterns - Goals Private and Confidential. © 2011 ThoughtWorks, Ltd. All rights reserved.
    • Understand customer’s business requirements
    • Understand the “Why” and “Who”
    • Understand the intent and value
    • Understand the Output
    • Team delivers complete feature
  • 16. Key Process Patterns - Collaboration Private and Confidential. © 2011 ThoughtWorks, Ltd. All rights reserved.
  • 17. Key Process Patterns - Examples Private and Confidential. © 2011 ThoughtWorks, Ltd. All rights reserved.
    • Requirements - Don ’ t provide full and unambiguous context
    • Don’t have Yes/No answers in your example
    • Ask for alternate way for validation
    • Avoid making up your own data
    • Avoid temptation to explore all possibility
  • 18. Key Process Patterns - Refining Private and Confidential. © 2011 ThoughtWorks, Ltd. All rights reserved.
  • 19. Key Process Patterns - Refining Private and Confidential. © 2011 ThoughtWorks, Ltd. All rights reserved.
    • Don ’ t create workflow like descriptions
    • Don ’ t get trapped in user interface details
    • Show and lets the user understand
    • Refined Examples = Acceptance criteria for delivery
  • 20. Key Process Patterns - Refining Private and Confidential. © 2011 ThoughtWorks, Ltd. All rights reserved.
  • 21. Key Process Patterns - Automation Private and Confidential. © 2011 ThoughtWorks, Ltd. All rights reserved.
    • Plan for automation upfront
    • Don ’ t delegate automation towards the end
    • Avoid automating existing manual scripts
    • Automate along system boundaries with necessary context
    • Automated Specification = Executable Specification
  • 22. Key Process Patterns - Automation Private and Confidential. © 2011 ThoughtWorks, Ltd. All rights reserved.
  • 23. Key Process Patterns - Validation Private and Confidential. © 2011 ThoughtWorks, Ltd. All rights reserved.
    • Fix the most annoying thing, fix it and repeat
    • Simpler test doubles for external systems
    • Isolated environment and fully automated deployments
    • Look for ways for faster feedback
    • Don’t just disable failing tests
  • 24. Key Process Patterns – Living Documentation Private and Confidential. © 2011 ThoughtWorks, Ltd. All rights reserved.
    • Don’t create long specifications
    • Avoid using technical concepts in tests
    • Base specification on personas
    • Evolve the ubiquitous language and use it consistently.
    • Organize based on functional areas
  • 25. Private and Confidential. © 2011 ThoughtWorks, Ltd. All rights reserved. Implementing Specifications
  • 26. Greenfield Private and Confidential. © 2011 ThoughtWorks, Ltd. All rights reserved.
    • Implement as part of the big process change
    • Use TDD as a first step towards Specifications
    • Follow the key process patterns
  • 27. Existing Projects Private and Confidential. © 2011 ThoughtWorks, Ltd. All rights reserved.
    • Start with automated tests
    • Don ’ t talk process or jargon words
    • Don ’ t make test automation end goal
    • Our Focus - Collaboration and process-change
    • Executable specification in the same codebase
  • 28. Private and Confidential. © 2011 ThoughtWorks, Ltd. All rights reserved. Gauge Progress
  • 29. Gauge Progress Private and Confidential. © 2011 ThoughtWorks, Ltd. All rights reserved.
  • 30. Take Away Private and Confidential. © 2011 ThoughtWorks, Ltd. All rights reserved.
    • Distributed teams - Necessary artifacts and re-use artifacts
    • One-time specification – Referred by stakeholders and team
    • Artifacts remain as living documents
    • Focus on collaboration and communication gap
    • More time on exploratory/business testing
    • Time-to-market availability
  • 31. Private and Confidential. © 2011 ThoughtWorks, Ltd. All rights reserved. Case Studies
  • 32. Private and Confidential. © 2011 ThoughtWorks, Ltd. All rights reserved. Case Studies
  • 33. Tools Private and Confidential. © 2011 ThoughtWorks, Ltd. All rights reserved.
    • Twist - http://studios.thoughtworks.com/twist-agile-test-automation/
    • Cucumber – http:// cukes.info
    • Concordion – http://www.concordion.org
    • FitNesse - http://fitnesse.org
    • Jbehave - http://jbehave.org
    • GreenPepper: http://www.greenpeppersoftware.com .
    • Robot Framework: http:// www.robotframework.org
    • SpecFlow: http:// www.specflow.org
    • TextTest: http:// www.texttest.org
  • 34. Contact us Sathyan Sethumadhavan [email_address] Shalabh Varma [email_address]
  • 35. References Private and Confidential. © 2011 ThoughtWorks, Ltd. All rights reserved.
      • Specification by example and Manning the specification- Gojko Adzic
      • Projects implemented SDD in real-time