EuroSTAR Software Testing Conference 2013 presentation on Questioning the Evolution of Testing: What's Next? by Martin Pol. See more at: http://conference.eurostarsoftwaretesting.com/past-presentations/

1. Questioning The Evolution Of Testing: What’s Next?
Martin Pol
www.eurostarconferences.com
@esconfs
#esconfs

2. Then Today
 Structure
Pioneering
Structuring
Optimizing
Unstructured
Undisciplined
Flexible
Structured
Disciplined
Inflexible

3. • Unknown, no buy-in, no budget, no process, no tools
• Fully integrated in the development process
– Generalists, joined effort
– Prototype, exploratory driven
• Only test pioneers
Pioneering
Then Today
 Structure

4. • Struggling required to get involved
• Lacking experiences, references
• Only welcome in emergency situations
•
Pioneering
Then Today
 Structure

5. Structuring
Then Today
 Structure

7. • Structuring the process
• Publishing
• Functionality and non-functionality
• Test automation
• Test Process Improvement models
– TPI, TMM, TMMi, TOM, TIM, TSM, …
Structuring
Then Today
 Structure

8. • Dedicated (trained) staff
• (Early) involvement, master test planning
– Risk based coverage
• Independent testing
• Test competence center, factory methods
• Recognized as a function
Structuring
Then Today
 Structure

9. • Becoming a referee
• Process Improvement freaks
• Measure and metrics mania
– Spreadsheet management
• Complaining and blaming
• Tunnel vision
Structuring
Then Today
 Structure

10. Process
Theory
Schedule
Manual
Independent
Discipline
Structure
Standards
Structuring
Then Today
 Structure

11. The IT Optimizing
Then Today
 Structure
Technology push Efficiency push

12. • Architecture
– SOA
– Virtualization
– Web technology
– Devices
• Cloud
*aaS
Technologypush
searching, recording, accounting, paying, writing,
reviewing, tracking, calculating, developing,
listening, analyzing, transmitting, learning,
controlling, purchasing, testing, alarming,
changing, updating, deleting, accessing, rejecting,
correcting, studying, booking, receiving, tracing,
protecting, deciding, managing, teaching,
facilitating, identifying, copying, removing,
demonstrating, checking, showing, selecting,
subscribing, unsubscribing, sharing, mailing,
communicating, reading, playing, working,
meeting, gambling, shopping, storing, cross
checking, retrieving, configuring, sketching,
saving, accelerating, enhancing, creating, growing,
checking in, checking out, finding out, reaching,
denying, talking, designing, making, verifying,
measuring
The IT
Email
Surf
Transfer
Develop and Test
Operate and Manage Store

13. The IT
• Architecture
• Cloud
• SoLoMo
Technologypush
Hi Martin. Good to see you back!
Today: 3 pairs of socks, you pay 2

14. The IT
• Architecture
• Cloud
•
Technologypush

15. • Architecture
• Cloud
• SoLoMo
• Big Data
• Integration
Technologypush
The IT

16. Efficiency push • Outsourcing
• *aaS
• Package software
• Agile, Scrum
• Collaboration
The IT

17. • Outsourcing
• *aaS
• Package software
• Agile, Scrum
• Collaboration
• DevOps
• Continuous Delivery
Efficiency push
The IT

18. • Architecture
• Cloud, *aaS
• SoLoMo
• Big Data
• Integration
• Outsourcing
• Packages
• Agile, Scrum
• DevOps
• Cont. Delivery
The IT
Optimizing
Then Today
 Structure

19. Actual Requirements for our Community
Optimizing
Today Tomorrow
• Architecture
• Cloud, *aaS
• SoLoMo
• Big Data
• Integration
• Outsourcing
• Packages
• Agile, Scrum
• DevOps
• Cont. Delivery

20. Optimizing
Then Today
 Structure
• Agile, Scrum
– Joint effort and success
– Focus on business value
– Social skills required
– Test management role
Testing

21. • Agile, Scrum
• Context Driven
– Problem solving, practice, heuristics, stories, skills
– People, cooperation, community
– Rapid Software Testing
Optimizing
Then Today
 Structure
Testing
The Seven Basic Principles of the Context-Driven School
1. The value of any practice depends on its context.
2. There are good practices in context, but there are no best
practices.
3. People, working together, are the most important part of any
project’s context.
4. Projects unfold over time in ways that are often not predictable.
5. The product is a solution. If the problem isn’t solved, the product
doesn’t work.
6. Good software testing is a challenging intellectual process.
7. Only through judgment and skill, exercised cooperatively
throughout the entire project, are we able to do the right things at
the right times to effectively test our products.

22. • Agile, Scrum
• Context Driven
• SDTM (Service Driven Test Management)
– From complaining and blaming towards enabling
– Tactful leadership
Optimizing
Then Today
 Structure
Testing

23. • Agile, Scrum
• Context Driven
• SDTM
• TestOps
– Test in production
– Cloud testing (Iaas, Taas)
– Integration
Optimizing
Then Today
 Structure
Testing

24. • Agile, Scrum
• Context Driven
• SDTM
• TestOps
• Automation 2.0
– Automation of testing
– Architecture
Optimizing
Then Today
 Structure
Testware
Test scripts
Test cases
Test data
Registration Reporting
Test Automation
Software – Platform – Infrastructure
Test Automation Process & Organization
Projects
Changes
Patches
Fixes
System Under Test
Software – Service – Platform - Infrastructure
Testing

25. Testing
• Agile, Scrum
• Context Driven
• SDTM
• TestOps
• Automation 2.0
• Cloud Computing
– Testing in the Cloud (TaaS)
– Testing Cloud Services
Optimizing
Then Today
 Structure

26. • Agile, Scrum
• Context Driven
• SDTM
• TestOps
• Automation 2.0
• Cloud Computing
• SoLoMo
– Hot
– Sexy
– Wild
Optimizing
Then Today
 Structure
Testing

27. • Agile, Scrum
• Context Driven
• SDTM
• TestOps
• Automation 2.0
• Cloud Computing
• SoLoMo
– Technical skills
– Multi dimensional
– Continuous integration
Optimizing
Then Today
 Structure
Testing

28. • Agile, Scrum
• Context Driven
• SDTM
• TestOps
• Automation 2.0
• Cloud Computing
• SoLoMo
• Outsourcing
– Scoping
– Agreements
– Management
controls, metrics, health checks
test deliverables
test progress test process
product quality
Optimizing
Then Today
 Structure
Testing

29. Optimizing
Then Today
 Structure
Testing
• Agile, Scrum
• Context Driven
• SDTM
• TestOps
• Automation 2.0
• Cloud Computing
• SoLoMo
• Outsourcing
•

30. Optimizing
Then Today
 Structure
Testing
• Agile, Scrum
• Context Driven
• SDTM
• TestOps
• Automation 2.0
• Cloud Computing
• SoLoMo
• Outsourcing
• Crowd testing
• Changed role

31. CMMI
TMap
DevOps
Creative
Tolerant
Outsourcing
SaaS
BYOD
Waterfall
Telecom
Logistics
Reporting
SBTM
CI
CD
Virtualization
IT-general
Networks
Infrastructure
IREB
PRINCE2

32. Distributed
Business/RQMS
Development
Operations
Technical
Automation
Cloud
SoLoMo
Security
Programming
Automation
Testing
Development
Social
Team player
Communication
Craftsmanship
Testing
Test management
CHANGED ROLE

33. Process
Theory
Schedule
Manual
Independent
Discipline
Structure
Standards
People
Skills
Change
Automated
Collaboration
Solution
Flexibility
Creative
towards
Optimizing
Then Today Tomorrow
 Structure
Optimizing our contribution

34. Process
Theory
Schedule
Discipline
Structure
Standards
People
Change
Collaboration
Flexibility
Creative
TMap
ISTQB
ISO/IEC 29119
CDT
RST
Exploratory Testing
SBTM
Agile Scrum
Skills
Explicit
Tacit

35. The economy continues to challenge
Jointly optimizing the craft remains top requirement
www.polteq.com
martin.pol@polteq.com