@avandeursen                                          #TADNLTest Automation Day 2012Kicking off the Future of Test Automat...
The TU DelftSoftware Engineering Research GroupEducation                Research• Programming,           • Software archit...
3
• A test case is an  executable example  of system behavior• Each example can  help in stakeholder  communication• Through...
The Set of Examples is Incomplete• Too much data• Too many combinations• Too many paths• Properties of interest  fundament...
The Set of Examples needs to Change• Software serves society• Society is changing  continually• Successful software is  ea...
Test AutomationAutomation of any step in   •   Test execution  the testing process       •   Test case design             ...
Test AutomationBenefits                        The Dark Side• Run tests faster              • Costly infrastructure• Run m...
Plugin / Junit Testing in Eclipse.       >> 1000s of tests                                     9
Test Automation: The Past                    “Test automation                    has been around                  since DA...
Test Automation: The Present• State of the art: Today!• State of the practice: A bit behind.                              ...
Test Automation: The Future      -- Two Research Examples --• “Concolic testing”  – Directed automated random testing• Sel...
Discussions (1)Die Wahrheit ist konkret• Ask speakers for  concrete experience!• Offer your concrete  experience to  audie...
Discussions (2)  Elk nadeelheb z’n voordeel                           Johan Cruijff   14
Plenary Program 9:30       Kickoff 9:55     Keynote 1        Scott Barber       Adding Value10:35     Keynote 2       Walt...
Upcoming SlideShare
Loading in …5
×

Kickoff Test Automation Day 2012

925
-1

Published on

Presentation to kick off the Test Automation Day, June 21, 2012.

http://www.testautomationday.com/

Published in: Technology
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total Views
925
On Slideshare
0
From Embeds
0
Number of Embeds
0
Actions
Shares
0
Downloads
4
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

Kickoff Test Automation Day 2012

  1. 1. @avandeursen #TADNLTest Automation Day 2012Kicking off the Future of Test Automation Arie van Deursen Delft University of Technology Rotterdam WTC, 21 June 2012
  2. 2. The TU DelftSoftware Engineering Research GroupEducation Research• Programming, • Software architecture software engineering • Software testing• MSc, BSc projects • Repository mining • Collaboration • Services • Model-driven engineering • End-user programming 2
  3. 3. 3
  4. 4. • A test case is an executable example of system behavior• Each example can help in stakeholder communication• Throughout the full development cycle 4
  5. 5. The Set of Examples is Incomplete• Too much data• Too many combinations• Too many paths• Properties of interest fundamentally undecidable 5
  6. 6. The Set of Examples needs to Change• Software serves society• Society is changing continually• Successful software is easy to change 6
  7. 7. Test AutomationAutomation of any step in • Test execution the testing process • Test case design • Test case creation • Test data generation • Test output verification • Test case management • Test traceability • Test adequacy analysis 7
  8. 8. Test AutomationBenefits The Dark Side• Run tests faster • Costly infrastructure• Run more of them • Test case construction costs• Run as often as you like • Fragile test cases• Continuous integration • Test suite maintenance• Early bug detection • Possibly false sense of• More variation safety• More reliable • Human out of the loop Engineering tradeoffs to be made Requires skills and experience. 8
  9. 9. Plugin / Junit Testing in Eclipse. >> 1000s of tests 9
  10. 10. Test Automation: The Past “Test automation has been around since DAY ONE of the computing industry.” 10
  11. 11. Test Automation: The Present• State of the art: Today!• State of the practice: A bit behind. 11
  12. 12. Test Automation: The Future -- Two Research Examples --• “Concolic testing” – Directed automated random testing• Self-monitoring – Built-in self testing & testability interfaces 12
  13. 13. Discussions (1)Die Wahrheit ist konkret• Ask speakers for concrete experience!• Offer your concrete experience to audience! Georg Wilhelm Friedrich Hegel 13
  14. 14. Discussions (2) Elk nadeelheb z’n voordeel Johan Cruijff 14
  15. 15. Plenary Program 9:30 Kickoff 9:55 Keynote 1 Scott Barber Adding Value10:35 Keynote 2 Walter Belgers Security11:10 Coffee11:45 Tracks 113:05 Lunch (Tut. Scott Barber)14:00 Keynote 3 Elfriede Dustin Near Future15:00 Tracks 215:35 Tea16:10 Tracks 316:55 Closing Keynote Dion Johnson Retrospective17:35 Drinks18:30 Dinner 15
  1. A particular slide catching your eye?

    Clipping is a handy way to collect important slides you want to go back to later.

×