December 2011 Specifications For Enterprise Testing Presenters Sathyan Sethumadhavan  &  Shalabh Varma
Agenda <ul><li>Where do we spend more time </li></ul><ul><li>A new approach for collaboration </li></ul><ul><li>Implement ...
Do you experience any of this Private and Confidential.  © 2011 ThoughtWorks, Ltd.  All rights reserved. Long Regression C...
Do you spend more time here Private and Confidential.  © 2011 ThoughtWorks, Ltd.  All rights reserved. Requirements docume...
Private and Confidential.  © 2011 ThoughtWorks, Ltd.  All rights reserved.
Private and Confidential.  © 2011 ThoughtWorks, Ltd.  All rights reserved. Specifications Driven Development
Private and Confidential.  © 2011 ThoughtWorks, Ltd.  All rights reserved. EXAMPLES REQUIREMENTS TESTS Can Become Elaborat...
Specifications – Focus Area Private and Confidential.  © 2011 ThoughtWorks, Ltd.  All rights reserved. Requirements docume...
A Good Specification Private and Confidential.  © 2011 ThoughtWorks, Ltd.  All rights reserved. <ul><li>Examples should be...
A Good Specification Private and Confidential.  © 2011 ThoughtWorks, Ltd.  All rights reserved.
A Good Specification Private and Confidential.  © 2011 ThoughtWorks, Ltd.  All rights reserved.
Benefits Private and Confidential.  © 2011 ThoughtWorks, Ltd.  All rights reserved. <ul><li>Distributed teams - Necessary ...
Private and Confidential.  © 2011 ThoughtWorks, Ltd.  All rights reserved. Specifications – Key Process Patterns
Key Process Patterns Private and Confidential.  © 2011 ThoughtWorks, Ltd.  All rights reserved.
Key Process Patterns - Goals Private and Confidential.  © 2011 ThoughtWorks, Ltd.  All rights reserved. <ul><li>Understand...
Key Process Patterns - Collaboration Private and Confidential.  © 2011 ThoughtWorks, Ltd.  All rights reserved.
Key Process Patterns - Examples Private and Confidential.  © 2011 ThoughtWorks, Ltd.  All rights reserved. <ul><li>Require...
Key Process Patterns - Refining Private and Confidential.  © 2011 ThoughtWorks, Ltd.  All rights reserved.
Key Process Patterns - Refining Private and Confidential.  © 2011 ThoughtWorks, Ltd.  All rights reserved. <ul><li>Don ’ t...
Key Process Patterns - Refining Private and Confidential.  © 2011 ThoughtWorks, Ltd.  All rights reserved.
Key Process Patterns - Automation Private and Confidential.  © 2011 ThoughtWorks, Ltd.  All rights reserved. <ul><li>Plan ...
Key Process Patterns - Automation Private and Confidential.  © 2011 ThoughtWorks, Ltd.  All rights reserved.
Key Process Patterns - Validation Private and Confidential.  © 2011 ThoughtWorks, Ltd.  All rights reserved. <ul><li>Fix t...
Key Process Patterns – Living Documentation Private and Confidential.  © 2011 ThoughtWorks, Ltd.  All rights reserved. <ul...
Private and Confidential.  © 2011 ThoughtWorks, Ltd.  All rights reserved. Implementing Specifications
Greenfield Private and Confidential.  © 2011 ThoughtWorks, Ltd.  All rights reserved. <ul><li>Implement as part of the big...
Existing Projects Private and Confidential.  © 2011 ThoughtWorks, Ltd.  All rights reserved. <ul><li>Start with automated ...
Private and Confidential.  © 2011 ThoughtWorks, Ltd.  All rights reserved. Gauge Progress
Gauge Progress Private and Confidential.  © 2011 ThoughtWorks, Ltd.  All rights reserved.
Take Away Private and Confidential.  © 2011 ThoughtWorks, Ltd.  All rights reserved. <ul><li>Distributed teams - Necessary...
Private and Confidential.  © 2011 ThoughtWorks, Ltd.  All rights reserved. Case Studies
Private and Confidential.  © 2011 ThoughtWorks, Ltd.  All rights reserved. Case Studies
Tools Private and Confidential.  © 2011 ThoughtWorks, Ltd.  All rights reserved. <ul><li>Twist  -  http://studios.thoughtw...
Contact us Sathyan Sethumadhavan [email_address] Shalabh Varma [email_address]
References Private and Confidential.  © 2011 ThoughtWorks, Ltd.  All rights reserved. <ul><ul><li>Specification by example...
Upcoming SlideShare
Loading in...5
×

Tw specifications for-testing1

981

Published on

Published in: Technology
0 Comments
1 Like
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total Views
981
On Slideshare
0
From Embeds
0
Number of Embeds
1
Actions
Shares
0
Downloads
17
Comments
0
Likes
1
Embeds 0
No embeds

No notes for slide
  • Start with automated tests Collaboration between testers and developers More time spent on exploratory testing Don ’ t talk process or jargon words Show failing tests Don ’ t make test automation end goal Our Focus Collaboration and process-change
  • Don ’ t forget to update contact details ;-)
  • Tw specifications for-testing1

    1. 1. December 2011 Specifications For Enterprise Testing Presenters Sathyan Sethumadhavan & Shalabh Varma
    2. 2. Agenda <ul><li>Where do we spend more time </li></ul><ul><li>A new approach for collaboration </li></ul><ul><li>Implement Specifications </li></ul><ul><li>Gauge Progress </li></ul><ul><li>Q&A </li></ul>Private and Confidential. © 2011 ThoughtWorks, Ltd. All rights reserved.
    3. 3. Do you experience any of this Private and Confidential. © 2011 ThoughtWorks, Ltd. All rights reserved. Long Regression Cycles Defects Leakage - Missing Requirements Test and Requirements documents becomes stale Spends more time on defect management and triage Less confidence - Existing test coverage Frequent changes - Breaks existing functionalities
    4. 4. Do you spend more time here Private and Confidential. © 2011 ThoughtWorks, Ltd. All rights reserved. Requirements document Creating test plan and strategy Creating test Cases/Steps Defect Management Traceability Matrix Fix production Defects
    5. 5. Private and Confidential. © 2011 ThoughtWorks, Ltd. All rights reserved.
    6. 6. Private and Confidential. © 2011 ThoughtWorks, Ltd. All rights reserved. Specifications Driven Development
    7. 7. Private and Confidential. © 2011 ThoughtWorks, Ltd. All rights reserved. EXAMPLES REQUIREMENTS TESTS Can Become Elaborate Verify
    8. 8. Specifications – Focus Area Private and Confidential. © 2011 ThoughtWorks, Ltd. All rights reserved. Requirements document Creating test plan and strategy Creating test cases Defect management and analysis Traceability Matrix Fix production defects Specifications for both humans and machines Tests as Documentation Managing stale artifcats Specifying Collaborately Validating Frequently
    9. 9. A Good Specification Private and Confidential. © 2011 ThoughtWorks, Ltd. All rights reserved. <ul><li>Examples should be complete </li></ul><ul><li>Precise and Testable </li></ul><ul><li>True Specification – Not a script </li></ul><ul><li>About business functionality – Not software design </li></ul><ul><li>Self-explanatory and focused </li></ul>
    10. 10. A Good Specification Private and Confidential. © 2011 ThoughtWorks, Ltd. All rights reserved.
    11. 11. A Good Specification Private and Confidential. © 2011 ThoughtWorks, Ltd. All rights reserved.
    12. 12. Benefits Private and Confidential. © 2011 ThoughtWorks, Ltd. All rights reserved. <ul><li>Distributed teams - Necessary artifacts and re-use artifacts </li></ul><ul><li>One-time specification – Referred by stakeholders and team </li></ul><ul><li>Artifacts remain as living documents </li></ul><ul><li>Focus on collaboration and communication gap </li></ul><ul><li>More time on exploratory/business testing </li></ul><ul><li>Time-to-market availability </li></ul>
    13. 13. Private and Confidential. © 2011 ThoughtWorks, Ltd. All rights reserved. Specifications – Key Process Patterns
    14. 14. Key Process Patterns Private and Confidential. © 2011 ThoughtWorks, Ltd. All rights reserved.
    15. 15. Key Process Patterns - Goals Private and Confidential. © 2011 ThoughtWorks, Ltd. All rights reserved. <ul><li>Understand customer’s business requirements </li></ul><ul><li>Understand the “Why” and “Who” </li></ul><ul><li>Understand the intent and value </li></ul><ul><li>Understand the Output </li></ul><ul><li>Team delivers complete feature </li></ul>
    16. 16. Key Process Patterns - Collaboration Private and Confidential. © 2011 ThoughtWorks, Ltd. All rights reserved.
    17. 17. Key Process Patterns - Examples Private and Confidential. © 2011 ThoughtWorks, Ltd. All rights reserved. <ul><li>Requirements - Don ’ t provide full and unambiguous context </li></ul><ul><li>Don’t have Yes/No answers in your example </li></ul><ul><li>Ask for alternate way for validation </li></ul><ul><li>Avoid making up your own data </li></ul><ul><li>Avoid temptation to explore all possibility </li></ul>
    18. 18. Key Process Patterns - Refining Private and Confidential. © 2011 ThoughtWorks, Ltd. All rights reserved.
    19. 19. Key Process Patterns - Refining Private and Confidential. © 2011 ThoughtWorks, Ltd. All rights reserved. <ul><li>Don ’ t create workflow like descriptions </li></ul><ul><li>Don ’ t get trapped in user interface details </li></ul><ul><li>Show and lets the user understand </li></ul><ul><li>Refined Examples = Acceptance criteria for delivery </li></ul>
    20. 20. Key Process Patterns - Refining Private and Confidential. © 2011 ThoughtWorks, Ltd. All rights reserved.
    21. 21. Key Process Patterns - Automation Private and Confidential. © 2011 ThoughtWorks, Ltd. All rights reserved. <ul><li>Plan for automation upfront </li></ul><ul><li>Don ’ t delegate automation towards the end </li></ul><ul><li>Avoid automating existing manual scripts </li></ul><ul><li>Automate along system boundaries with necessary context </li></ul><ul><li>Automated Specification = Executable Specification </li></ul>
    22. 22. Key Process Patterns - Automation Private and Confidential. © 2011 ThoughtWorks, Ltd. All rights reserved.
    23. 23. Key Process Patterns - Validation Private and Confidential. © 2011 ThoughtWorks, Ltd. All rights reserved. <ul><li>Fix the most annoying thing, fix it and repeat </li></ul><ul><li>Simpler test doubles for external systems </li></ul><ul><li>Isolated environment and fully automated deployments </li></ul><ul><li>Look for ways for faster feedback </li></ul><ul><li>Don’t just disable failing tests </li></ul>
    24. 24. Key Process Patterns – Living Documentation Private and Confidential. © 2011 ThoughtWorks, Ltd. All rights reserved. <ul><li>Don’t create long specifications </li></ul><ul><li>Avoid using technical concepts in tests </li></ul><ul><li>Base specification on personas </li></ul><ul><li>Evolve the ubiquitous language and use it consistently. </li></ul><ul><li>Organize based on functional areas </li></ul>
    25. 25. Private and Confidential. © 2011 ThoughtWorks, Ltd. All rights reserved. Implementing Specifications
    26. 26. Greenfield Private and Confidential. © 2011 ThoughtWorks, Ltd. All rights reserved. <ul><li>Implement as part of the big process change </li></ul><ul><li>Use TDD as a first step towards Specifications </li></ul><ul><li>Follow the key process patterns </li></ul>
    27. 27. Existing Projects Private and Confidential. © 2011 ThoughtWorks, Ltd. All rights reserved. <ul><li>Start with automated tests </li></ul><ul><li>Don ’ t talk process or jargon words </li></ul><ul><li>Don ’ t make test automation end goal </li></ul><ul><li>Our Focus - Collaboration and process-change </li></ul><ul><li>Executable specification in the same codebase </li></ul>
    28. 28. Private and Confidential. © 2011 ThoughtWorks, Ltd. All rights reserved. Gauge Progress
    29. 29. Gauge Progress Private and Confidential. © 2011 ThoughtWorks, Ltd. All rights reserved.
    30. 30. Take Away Private and Confidential. © 2011 ThoughtWorks, Ltd. All rights reserved. <ul><li>Distributed teams - Necessary artifacts and re-use artifacts </li></ul><ul><li>One-time specification – Referred by stakeholders and team </li></ul><ul><li>Artifacts remain as living documents </li></ul><ul><li>Focus on collaboration and communication gap </li></ul><ul><li>More time on exploratory/business testing </li></ul><ul><li>Time-to-market availability </li></ul>
    31. 31. Private and Confidential. © 2011 ThoughtWorks, Ltd. All rights reserved. Case Studies
    32. 32. Private and Confidential. © 2011 ThoughtWorks, Ltd. All rights reserved. Case Studies
    33. 33. Tools Private and Confidential. © 2011 ThoughtWorks, Ltd. All rights reserved. <ul><li>Twist - http://studios.thoughtworks.com/twist-agile-test-automation/ </li></ul><ul><li>Cucumber – http:// cukes.info </li></ul><ul><li>Concordion – http://www.concordion.org </li></ul><ul><li>FitNesse - http://fitnesse.org </li></ul><ul><li>Jbehave - http://jbehave.org </li></ul><ul><li>GreenPepper: http://www.greenpeppersoftware.com . </li></ul><ul><li>Robot Framework: http:// www.robotframework.org </li></ul><ul><li>SpecFlow: http:// www.specflow.org </li></ul><ul><li>TextTest: http:// www.texttest.org </li></ul>
    34. 34. Contact us Sathyan Sethumadhavan [email_address] Shalabh Varma [email_address]
    35. 35. References Private and Confidential. © 2011 ThoughtWorks, Ltd. All rights reserved. <ul><ul><li>Specification by example and Manning the specification- Gojko Adzic </li></ul></ul><ul><ul><li>Projects implemented SDD in real-time </li></ul></ul>
    1. A particular slide catching your eye?

      Clipping is a handy way to collect important slides you want to go back to later.

    ×