• A test case is an executable example of system behavior• Each example can help in stakeholder communication• Throughout the full development cycle 4
The Set of Examples is Incomplete• Too much data• Too many combinations• Too many paths• Properties of interest fundamentally undecidable 5
The Set of Examples needs to Change• Software serves society• Society is changing continually• Successful software is easy to change 6
Test AutomationAutomation of any step in • Test execution the testing process • Test case design • Test case creation • Test data generation • Test output verification • Test case management • Test traceability • Test adequacy analysis 7
Test AutomationBenefits The Dark Side• Run tests faster • Costly infrastructure• Run more of them • Test case construction costs• Run as often as you like • Fragile test cases• Continuous integration • Test suite maintenance• Early bug detection • Possibly false sense of• More variation safety• More reliable • Human out of the loop Engineering tradeoffs to be made Requires skills and experience. 8
Plugin / Junit Testing in Eclipse. >> 1000s of tests 9
Test Automation: The Past “Test automation has been around since DAY ONE of the computing industry.” 10
Test Automation: The Present• State of the art: Today!• State of the practice: A bit behind. 11
Test Automation: The Future -- Two Research Examples --• “Concolic testing” – Directed automated random testing• Self-monitoring – Built-in self testing & testability interfaces 12
Discussions (1)Die Wahrheit ist konkret• Ask speakers for concrete experience!• Offer your concrete experience to audience! Georg Wilhelm Friedrich Hegel 13
Discussions (2) Elk nadeelheb z’n voordeel Johan Cruijff 14
Plenary Program 9:30 Kickoff 9:55 Keynote 1 Scott Barber Adding Value10:35 Keynote 2 Walter Belgers Security11:10 Coffee11:45 Tracks 113:05 Lunch (Tut. Scott Barber)14:00 Keynote 3 Elfriede Dustin Near Future15:00 Tracks 215:35 Tea16:10 Tracks 316:55 Closing Keynote Dion Johnson Retrospective17:35 Drinks18:30 Dinner 15
A particular slide catching your eye?
Clipping is a handy way to collect important slides you want to go back to later.