Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

Kickoff Test Automation Day 2012


Published on

Presentation to kick off the Test Automation Day, June 21, 2012.

Published in: Technology
  • Be the first to comment

  • Be the first to like this

Kickoff Test Automation Day 2012

  1. 1. @avandeursen #TADNLTest Automation Day 2012Kicking off the Future of Test Automation Arie van Deursen Delft University of Technology Rotterdam WTC, 21 June 2012
  2. 2. The TU DelftSoftware Engineering Research GroupEducation Research• Programming, • Software architecture software engineering • Software testing• MSc, BSc projects • Repository mining • Collaboration • Services • Model-driven engineering • End-user programming 2
  3. 3. 3
  4. 4. • A test case is an executable example of system behavior• Each example can help in stakeholder communication• Throughout the full development cycle 4
  5. 5. The Set of Examples is Incomplete• Too much data• Too many combinations• Too many paths• Properties of interest fundamentally undecidable 5
  6. 6. The Set of Examples needs to Change• Software serves society• Society is changing continually• Successful software is easy to change 6
  7. 7. Test AutomationAutomation of any step in • Test execution the testing process • Test case design • Test case creation • Test data generation • Test output verification • Test case management • Test traceability • Test adequacy analysis 7
  8. 8. Test AutomationBenefits The Dark Side• Run tests faster • Costly infrastructure• Run more of them • Test case construction costs• Run as often as you like • Fragile test cases• Continuous integration • Test suite maintenance• Early bug detection • Possibly false sense of• More variation safety• More reliable • Human out of the loop Engineering tradeoffs to be made Requires skills and experience. 8
  9. 9. Plugin / Junit Testing in Eclipse. >> 1000s of tests 9
  10. 10. Test Automation: The Past “Test automation has been around since DAY ONE of the computing industry.” 10
  11. 11. Test Automation: The Present• State of the art: Today!• State of the practice: A bit behind. 11
  12. 12. Test Automation: The Future -- Two Research Examples --• “Concolic testing” – Directed automated random testing• Self-monitoring – Built-in self testing & testability interfaces 12
  13. 13. Discussions (1)Die Wahrheit ist konkret• Ask speakers for concrete experience!• Offer your concrete experience to audience! Georg Wilhelm Friedrich Hegel 13
  14. 14. Discussions (2) Elk nadeelheb z’n voordeel Johan Cruijff 14
  15. 15. Plenary Program 9:30 Kickoff 9:55 Keynote 1 Scott Barber Adding Value10:35 Keynote 2 Walter Belgers Security11:10 Coffee11:45 Tracks 113:05 Lunch (Tut. Scott Barber)14:00 Keynote 3 Elfriede Dustin Near Future15:00 Tracks 215:35 Tea16:10 Tracks 316:55 Closing Keynote Dion Johnson Retrospective17:35 Drinks18:30 Dinner 15