Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

So long, and thanks for all the tests (Scottish Developers 2014)

2,695 views

Published on

TDD has long been recommended by agile practitioners, but the community still argues about how to go about it. Inside-out or outside-in? Mockist or classical? Through a component’s public API or for every class? And then there’s Kent Beck’s famous quote: “I get paid for code that works, not for tests, so my philosophy is to test as little as possible to reach a given level of confidence.” This introduces a further level of subjectivity, especially since developers are frequently overconfident.
In this session, Seb will explore the choices that agile teams need to make when considering which development practices to adopt. He’ll look again at some of the arguments for the different approaches and urge teams to practice until you’re happy with the way you code.

Published in: Technology, Education
  • Thanks for the mention. I also have a post you may like on the relationship between TDD, Flow theory and Gamification:

    http://effectivesoftwaredesign.com/2011/11/21/tdd-and-the-gamification-of-testing/
       Reply 
    Are you sure you want to  Yes  No
    Your message goes here

So long, and thanks for all the tests (Scottish Developers 2014)

  1. 1. So  long,  and  thanks  for  all  the   tests Seb  Rose Claysnow  Limited @sebrose Friday, 2 May 14
  2. 2. Friday, 2 May 14
  3. 3. “The last ever dolphin message was misinterpreted as a surprisingly sophisticated attempt to do a double-backwards-somersault through a hoop whilst whistling the 'Star Spangled Banner', but in fact the message was this: So long and thanks for all the fish.” http://en.wikipedia.org/wiki/The_Hitchhiker%27s_Guide_to_the_Galaxy_(novel) Friday, 2 May 14
  4. 4. Why do we test software? “a process of gathering information about [software] with the intent that the information could be used for some purpose” Friday, 2 May 14
  5. 5. Developer tests What are they for? • making sure the code works • preventing regressions • documenting the code • driving a testable design Friday, 2 May 14
  6. 6. “I get paid for code that works, not for tests, so my philosophy is to test as little as possible to reach a given level of confidence ... “I suspect this level of confidence is high compared to industry standards” http://stackoverflow.com/questions/153234/how-deep-are-your-unit-tests/153565#153565 Friday, 2 May 14
  7. 7. Friday, 2 May 14
  8. 8. Developer testing When do you write tests? • never • after writing the code • while you write the code • before writing the code Friday, 2 May 14
  9. 9. http://www.slideshare.net/sebrose/common-objections-to-tdd-and-their-refutations Any objections? Friday, 2 May 14
  10. 10. “Takes too much time to write tests.” “If I change something it will break a whole bunch of tests that I will have to fix and it will be more work for me in the end than just verifying my changes manually.” “Running the tests takes too long.” http://www.slideshare.net/sebrose/common-objections-to-tdd-and-their-refutations Friday, 2 May 14
  11. 11. “No scientific proof of it actually having any benefit (compared to just code reviews, pair programming or etc.) for the same amount of time” “It's not practical for the kind of work I do. By which I mean, it cannot be conclusively shown to provide tangible benefits that outweigh the perceived costs.” http://www.slideshare.net/sebrose/common-objections-to-tdd-and-their-refutations Friday, 2 May 14
  12. 12. TDD - Where did it all go wrong? Ian Cooper - http://vimeo.com/68375232 Why are people abandoning TDD? - Test first is unproductive obstacle - Faster feedback gives the competitive advantage - It’s difficult to understand the test’s intent Friday, 2 May 14
  13. 13. Accelerating agile Dan North - http://vimeo.com/68215534 Isn’t agility about speed? - Fast feedback - Understand the risk - Use appropriate methods http://programmingandthecity.wordpress.com/2013/09/30/whats-dan-north-wearing-today/ Friday, 2 May 14
  14. 14. TDD is dead David Heinemeier Hansson- http://david.heinemeierhansson.com/2014/tdd-is-dead-long-live-testing.html http://david.heinemeierhansson.com/2014/test-induced-design-damage.html TDD isn’t useful anymore - We’ve learnt what we needed - Unit tests aren’t useful - Testability hurts the design Friday, 2 May 14
  15. 15. Oh no it’s not Robert C. Martin (aka Uncle Bob) - TDD is still useful - Unit tests are fast and thorough - It’s not universally applicable - Decomposition is good design http://blog.8thlight.com/uncle-bob/2014/04/25/MonogamousTDD.html http://blog.8thlight.com/uncle-bob/2014/04/30/When-tdd-does-not-work.html http://blog.8thlight.com/uncle-bob/2014/05/01/Design-Damage.html Friday, 2 May 14
  16. 16. Queuing theory JB Rainsberger - http://www.jbrains.ca/permalink/how-test-driven-development-works-and-more Given a process B, which follows a process A, sometimes in performing B we need to perform some of A again. We can remove the need to rework by taking some portion of process B and performing it before process A Friday, 2 May 14
  17. 17. “With emergent design, a development organization starts delivering functionality and lets the design emerge. ...while it is being built, the organization will [...] refactor out the commonality ... At the end [we are] left with the smallest set of the design needed, as opposed to the design that could have been anticipated in advance.” Emergent design http://en.wikipedia.org/wiki/Emergent_Design Friday, 2 May 14
  18. 18. http://effectivesoftwaredesign.com/2013/10/18/avoiding-technical-debt-how-to-accumulate-technical- savings/ Adaptable design up-front? “... software systems must evolve, and that this evolution must be supported through well planned, adaptable designs.” Friday, 2 May 14
  19. 19. http://blog.testdouble.com/posts/2014-01-25-the-failures-of-intro-to-tdd.html Fake it until you make it “The goal of this game is to discover as many collaboration objects as necessary in order to define leaf nodes that implement a piece of narrowly-defined logic that your feature needs.” Friday, 2 May 14
  20. 20. Domain discontinuity Robert C. Martin (aka Uncle Bob) - “First I am going to express my deep disagreement with the Author. I will refute his arguments and utterly destroy his conclusions. And then, once I'm done salting the ground where he used to live, I'll tell you why I completely agree with him.” http://blog.8thlight.com/uncle-bob/2014/01/27/TheChickenOrTheRoad.html Friday, 2 May 14
  21. 21. Domain discontinuity Robert C. Martin (aka Uncle Bob) - TDD works within an architectural domain - Refactoring is cheap - Test the behaviour not the implementation - We won’t get it right the first time http://blog.8thlight.com/uncle-bob/2014/01/27/TheChickenOrTheRoad.html Friday, 2 May 14
  22. 22. Domain discontinuity Robert C. Martin (aka Uncle Bob) - TDD doesn’t work across domains - Refactoring is costly - Moving behaviours requires new tests - Architecture must be up-front http://blog.8thlight.com/uncle-bob/2014/01/27/TheChickenOrTheRoad.html Friday, 2 May 14
  23. 23. What about architecture and design? https://leanpub.com/software-architecture-for-developers Friday, 2 May 14
  24. 24. Friday, 2 May 14
  25. 25. Dreyfus model of skill acquisition http://en.wikipedia.org/wiki/Dreyfus_model_of_skill_acquisition Friday, 2 May 14
  26. 26. Intermission Friday, 2 May 14
  27. 27. Friday, 2 May 14
  28. 28. http://www.slideshare.net/dannorth/accelerating-agile-testing Friday, 2 May 14
  29. 29. http://www.slideshare.net/dannorth/accelerating-agile-testing Friday, 2 May 14
  30. 30. http://c2.com/cgi/wiki?ExtremeRules But, Dan.What about the Extreme Rules? Friday, 2 May 14
  31. 31. There’s a rule to cover that... http://c2.com/cgi/wiki?TheyreJustRules Friday, 2 May 14
  32. 32. TDD Friday, 2 May 14
  33. 33. Which test first? Inside-out? - “Classicist” Outside-in? - “London school” In the middle? - also “Classic” http://programmers.stackexchange.com/questions/166409/tdd-outside-in-vs-inside-out http://martinfowler.com/articles/mocksArentStubs.html Friday, 2 May 14
  34. 34. Friday, 2 May 14
  35. 35. Friday, 2 May 14
  36. 36. What is a unit test anyway? A test is not a unit test if: • It talks to the database • It communicates across the network • It touches the file system • It can’t run at the same time as other unit tests • You have to do special things to your environment (such as editing config files) to run it http://www.artima.com/weblogs/viewpost.jsp?thread=126923 Friday, 2 May 14
  37. 37. Friday, 2 May 14
  38. 38. http://codebetter.com/iancooper/2011/10/06/avoid-testing-implementation-details-test-behaviours/ Test behaviours not implementation details “When we refactor we don’t want to break tests. If our tests know too much about our implementation, that will be difficult, because changes to our implementation will necessarily result in us re-writing tests – at which point we are not refactoring.We would say that we have over- specified through our tests. Instead of assisting change, our tests have now begun to hamper it.” http://vimeo.com/68375232 Friday, 2 May 14
  39. 39. Properties of unit testing Understandable Maintainable Repeatable Necessary Granular Fast Friday, 2 May 14
  40. 40. Design for testability - Inversion of control - Dependency Injection How can we test a component in isolation? http://www.jamesshore.com/Blog/Dependency-Injection-Demystified.html Friday, 2 May 14
  41. 41. http://www.jamesshore.com/Blog/Continuous-Integration-on-a- Dollar-a-Day.html Friday, 2 May 14
  42. 42. Mocking in a nutshell Friday, 2 May 14
  43. 43. The Meszaros taxonomy http://xunitpatterns.com ■Dummy objects are passed around but never actually used. ■Fake objects have working implementations. ■Stubs provide canned responses'. ■Mocks are pre-programmed with expectations which form a specification of the calls they are expected to receive. Friday, 2 May 14
  44. 44. Mocking can give you a false sense of security Friday, 2 May 14
  45. 45. Mocking can make a terrible mess Friday, 2 May 14
  46. 46. Friday, 2 May 14
  47. 47. - A stub in a collaboration test must correspond to an expected result in a contract test - An expectation in a collaboration test must correspond to an action in a contract test This provides a /systematic/ way to check that [your code] remains in sync with the implementations of [the component you are mocking]. Contract and Collaboration tests via JB Rainsberger, GOOS mailing list,“Unit-test mock/stub assumptions rots”, 15 March 2012 Friday, 2 May 14
  48. 48. 1. Change the implementation A1 of A, noticing a change in the contract of A. 2. For each change in the contract of A: 1. If an action in A has changed (parameter changed, method name changed), then look for expectations of that action in collaboration tests, and change them to match the new action. 2. If a response from A has changed (return type, value, what the value means), then look for stubs of that action in collaboration tests, and change them to match the new response. via JB Rainsberger, GOOS mailing list,“Unit-test mock/stub assumptions rots”, 15 March 2012 Friday, 2 May 14
  49. 49. Friday, 2 May 14
  50. 50. http://blog.8thlight.com/uncle-bob/2013/09/23/Test-first.html Are we really writing tests? “If somehow all your production code got deleted, but you had a backup of your tests, then you'd be able to recreate the production system with a little work. “If, however, it was your tests that got deleted, then you'd have no tests to keep the production code clean.The production code would inevitably rot, slowing you down.” Friday, 2 May 14
  51. 51. “So we can conclude that if it became a choice between the tests or the production code, we'd rather preserve the tests. “And this means that the tests are a more important component of the system than the production code is. “Because the tests are the specs.” http://blog.8thlight.com/uncle-bob/2013/09/23/Test-first.html Or are we writing specifications? Friday, 2 May 14
  52. 52. What use is coverage? Friday, 2 May 14
  53. 53. http://pitest.org Mutation testing Friday, 2 May 14
  54. 54. Friday, 2 May 14
  55. 55. Friday, 2 May 14
  56. 56. Friday, 2 May 14
  57. 57. Who do developer tests help? - NOT the application - NOT the customers - The development team (sometimes) The tests should make your life EASIER Friday, 2 May 14
  58. 58. Things that seem important to me: - chase the VALUE - identify the RISKS - understand your CONTEXT The tests should make your life EASIER Friday, 2 May 14
  59. 59. http://edinburgh.bcs.org/courses Friday, 2 May 14
  60. 60. http://edinburgh.bcs.org/courses Friday, 2 May 14
  61. 61. Seb  Rose Twi;er:     @sebrose Blog:       www.claysnow.co.uk E-­‐mail:     seb@claysnow.co.uk Friday, 2 May 14
  62. 62. Backup 62 Friday, 2 May 14
  63. 63. Step 1 Write exactly one new test. It should be the smallest test which seems to point in the direction of a solution TDD as if you meant it http://cumulative-hypotheses.org/2011/08/30/tdd-as-if-you-meant-it/ Friday, 2 May 14
  64. 64. Step 2 Run the test to make sure it fails TDD as if you meant it http://cumulative-hypotheses.org/2011/08/30/tdd-as-if-you-meant-it/ Friday, 2 May 14
  65. 65. Step 3 Make the test from (Step 1) pass by writing the least amount of implementation code you can INTHETEST METHOD. TDD as if you meant it http://cumulative-hypotheses.org/2011/08/30/tdd-as-if-you-meant-it/ Friday, 2 May 14
  66. 66. Step 4 Refactor to remove duplication or otherwise as required to improve the design. Be strict about the refactorings. Only introduce new abstractions (methods, classes, etc) when they will help to improve the design of the code. Specifically... TDD as if you meant it http://cumulative-hypotheses.org/2011/08/30/tdd-as-if-you-meant-it/ Friday, 2 May 14
  67. 67. Step 4 (continued) 1.ONLY Extract a new method if there is sufficient code duplication in the test methods.When extracting a method, initially extract it to the test class (don't create a new class yet). 2.ONLY create a new class when a clear grouping of methods emerges and when the test class starts to feel crowded or too large. TDD as if you meant it http://cumulative-hypotheses.org/2011/08/30/tdd-as-if-you-meant-it/ Friday, 2 May 14
  68. 68. Step 5 Repeat the process by writing another test (go back to Step 1). TDD as if you meant it http://cumulative-hypotheses.org/2011/08/30/tdd-as-if-you-meant-it/ Friday, 2 May 14

×