A Peek at the Future of Software Testing
Ruud Teunissen – Passionate software tester since 1989
“The best way to predict the future is to invent it” – Alan Kay
© 2014 2
Structure
Pioneering
Structuring
Optimizing
Unstructured
Undisciplined
Flexible
Structured
Disciplined
Inflexible
Evolution
Time 
© 2014 3
© 2014 4
© 2014 5
© 2014 6
Structure
Pioneering
Structuring
Optimizing
Unstructured
Undisciplined
Flexible
Structured
Disciplined
Inflexible
Evolution of (software) testing
Time 
© 2014 7
Pioneering
• Fully integrated in the development process
• Unknown, no buy-in, no budget, no process, no tools
• Struggling to get involved
• Only welcome in emergency situations
© 2014 8
Structuring
© 2014 9
• Defining the process
• Publishing
• Test automation
• Test Process Improvement models
Structuring
© 2014 10
Great!
• Dedicated, trained staff
• (Early) involvement
• Independent testing
• Risk based
• Testing Competence Center
• Recognized Role
Structuring
Structure
© 2014 11
But…
• Template Zombies
• Process (Improvement) freaks
Structuring
Structure
Process
Theory
Schedule
Strict
Independent
Discipline
Structure
Standards
© 2014 12
But…
• Template Zombies
• Process (Improvement) freaks
• Spreadsheet management
• Measure and metrics mania
• Complaining and blaming
Structuring
Structure
© 2014 13
Optimizing
© 2014 14
Technology push Efficiency push
A Peek at the Future of IT
© 2014 15
A Peek at the Future of IT
• Architecture
– SOA, Virtualization, Web technology, Devices
© 2014 16
A Peek at the Future of IT
• Architecture
• Cloud
– *aaS
searching, recording, accounting, paying, writing,
reviewing, tracking, calculating, developing,
listening, analyzing, transmitting, learning,
controlling, purchasing, testing, alarming,
changing, updating, deleting, accessing, rejecting,
correcting, studying, booking, receiving, tracing,
protecting, deciding, managing, teaching,
facilitating, identifying, copying, removing,
demonstrating, checking, showing, selecting,
subscribing, unsubscribing, sharing, mailing,
communicating, reading, playing, working,
meeting, gambling, shopping, storing, cross
checking, retrieving, configuring, sketching,
saving, accelerating, enhancing, creating, growing,
checking in, checking out, finding out, reaching,
denying, talking, designing, making, verifying,
measuring
© 2014 17
• Architecture
• Cloud
• SoLoMo
A Peek at the Future of IT
© 2014 18
• Architecture
• Cloud
• SoLoMo
A Peek at the Future of IT
© 2014 19
• Architecture
• Cloud
• SoLoMo
A Peek at the Future of IT
© 2014 20
• Architecture
• Cloud
• SoLoMo
• Packages
• Integration
A Peek at the Future of IT
© 2014 21
• Architecture
• Cloud
• SoLoMo
• Packages
• Integration
• Outsourcing
A Peek at the Future of IT
© 2014 22
• Architecture
• Cloud
• SoLoMo
• Packages
• Integration
• Outsourcing
• Agile, Scrum
A Peek at the Future of IT
© 2014 23
• Architecture
• Cloud
• SoLoMo
• Packages
• Integration
• Outsourcing
• Agile, Scrum
• Collaboration
A Peek at the Future of IT
© 2014 24
• Architecture
• Cloud
• SoLoMo
• Packages
• Integration
• Outsourcing
• Agile, Scrum
• Collaboration
• DevOps
A Peek at the Future of IT
© 2014 25
• Architecture
• Cloud
• SoLoMo
• Packages
• Integration
• Outsourcing
• Agile, Scrum
• Collaboration
• DevOps
• Continuous Delivery
A Peek at the Future of IT
© 2014 26
• Architecture
• Cloud
• SoLoMo
• Packages
• Integration
• Outsourcing
• Agile, Scrum
• Collaboration
• DevOps
• Continuous Delivery
• … … … …
A Peek at the Future of IT
© 2014 27
• Architecture
• Cloud
• SoLoMo
• Packages
• Integration
• Outsourcing
• Agile, Scrum
• Collaboration
• DevOps
• Continuous Delivery
• … … … …
A Peek at the Future of Software Testing
Optimizing
Today Tomorrow/Next
© 2014 28
A Peek at the Future of Software Testing
• Agile, Scrum
– Joint effort and success
– Early involvement and feedback
– Social skills required
– Test management role
© 2014 29
A Peek at the Future of Software Testing
• Agile, Scrum
• Context Driven
– Problem solving, (good) practice, heuristics, questioning
–People, skills, cooperation
– Exploratory
– Rapid Software Testing
The SevenBasic Principlesof the Context-DrivenSchool
1.The value of any practice depends on its context.
2.There are good practices in context, but there are no best practices.
3.People, working together, are the most important part of any project’s
context.
4.Projects unfold over time in ways that are often not predictable.
5.The product is a solution. If the problem isn’t solved, the product doesn’t
work.
6.Good software testing is a challenging intellectual process.
7.Only through judgment and skill, exercised cooperatively throughout the
entire project, are we able to do the right things at the right times to
effectively test our products.
© 2014 30
A Peek at the Future of Software Testing
• Agile, Scrum
• Context Driven
• SDTM (Service Driven Test Management)
– From complaining and blaming towards enabling
– Tactful leadership
© 2014 31
A Peek at the Future of Software Testing
• Agile, Scrum
• Context Driven
• SDTM (Service Driven Test Management)
• TestOps
– Test in production
– Cloud testing (Iaas, Taas)
– Integration
© 2014 32
A Peek at the Future of Software Testing
• Agile, Scrum
• Context Driven
• SDTM (Service Driven Test Management)
• TestOps
• Automation 2.0
– Automation of testing
– Architecture Testware
Test scripts
Test cases
Test data
Registration Reporting
Test Automation
Software – Platform – Infrastructure
Test Automation Process & Organization
Projects
Changes
Patches
Fixes
System Under Test
Software – Service – Platform - Infrastructure
© 2014 33
A Peek at the Future of Software Testing
• Agile, Scrum
• Context Driven
• SDTM (Service Driven Test Management)
• TestOps
• Automation 2.0
• Cloud Computing
– Testing in the Cloud (TaaS)
– Testing Cloud Services (SaaS)
© 2014 34
A Peek at the Future of Software Testing
• Agile, Scrum
• Context Driven
• SDTM (Service Driven Test Management)
• TestOps
• Automation 2.0
• Cloud Computing
• SoLoMo
– Technical skills
– Multi dimensional
– Continuous integration
© 2014 35
A Peek at the Future of Software Testing
• Agile, Scrum
• Context Driven
• SDTM (Service Driven Test Management)
• TestOps
• Automation 2.0
• Cloud Computing
• SoLoMo
• Outsourcing
– Scoping
– Agreements
– Management controls, metrics, health checks
test deliverables
test progress test process
product quality
© 2014 36
A Peek at the Future of Software Testing
• Agile, Scrum
• Context Driven
• SDTM (Service Driven Test Management)
• TestOps
• Automation 2.0
• Cloud Computing
• SoLoMo
• Outsourcing
•
© 2014 37
• Architecture
• Cloud
• SoLoMo
• Packages
• Integration
• Outsourcing
• Agile, Scrum
• Collaboration
• DevOps
• Continuous Delivery
• … … … …
A Peek at the Future of Software Testing
Optimizing
Today Tomorrow/Next
© 2014 38
TMap
DevOps
Creative
Tolerant
CMMI
Outsourcing
SaaS
BYOD
Waterfall
Telecom
Logistics
Reporting
CI
CD
SBTM
Virtualization
IT-general
Networks
Infrastructure
PRINCE2
IREB
A Peek at the Future of Software Testing
© 2014 39
Distributed
Business/RQMS
Development
Operations
Technical
Automation
Cloud
SoLoMo
e.g. Security
Coding
Automation
Testing
Development
Social
Team player
Communication
Craftsmanship
Testing
Test management
A Peek at the Future of Software Testing
© 2014 40
Process
Theory
Schedule
Strict
Independent
Discipline
Structure
Standards
People
Skills
Change
Loose
Collaboration
Solution
Flexibility
Creative
We’re Optimizing!
Optimizing
Today Tomorrow/Next
and
© 2014 41
Process
Theory
Schedule
Strict
Independent
Discipline
Structure
Standards
Creative
Flexibility
Solution
Collaboration
Loose
Change
Skills
People

IndigoCube - a peek at the future of software testing by Polteq, Ruud Teunissen

  • 1.
    A Peek atthe Future of Software Testing Ruud Teunissen – Passionate software tester since 1989 “The best way to predict the future is to invent it” – Alan Kay
  • 2.
  • 3.
  • 4.
  • 5.
  • 6.
  • 7.
    © 2014 7 Pioneering •Fully integrated in the development process • Unknown, no buy-in, no budget, no process, no tools • Struggling to get involved • Only welcome in emergency situations
  • 8.
  • 9.
    © 2014 9 •Defining the process • Publishing • Test automation • Test Process Improvement models Structuring
  • 10.
    © 2014 10 Great! •Dedicated, trained staff • (Early) involvement • Independent testing • Risk based • Testing Competence Center • Recognized Role Structuring Structure
  • 11.
    © 2014 11 But… •Template Zombies • Process (Improvement) freaks Structuring Structure Process Theory Schedule Strict Independent Discipline Structure Standards
  • 12.
    © 2014 12 But… •Template Zombies • Process (Improvement) freaks • Spreadsheet management • Measure and metrics mania • Complaining and blaming Structuring Structure
  • 13.
  • 14.
    © 2014 14 Technologypush Efficiency push A Peek at the Future of IT
  • 15.
    © 2014 15 APeek at the Future of IT • Architecture – SOA, Virtualization, Web technology, Devices
  • 16.
    © 2014 16 APeek at the Future of IT • Architecture • Cloud – *aaS searching, recording, accounting, paying, writing, reviewing, tracking, calculating, developing, listening, analyzing, transmitting, learning, controlling, purchasing, testing, alarming, changing, updating, deleting, accessing, rejecting, correcting, studying, booking, receiving, tracing, protecting, deciding, managing, teaching, facilitating, identifying, copying, removing, demonstrating, checking, showing, selecting, subscribing, unsubscribing, sharing, mailing, communicating, reading, playing, working, meeting, gambling, shopping, storing, cross checking, retrieving, configuring, sketching, saving, accelerating, enhancing, creating, growing, checking in, checking out, finding out, reaching, denying, talking, designing, making, verifying, measuring
  • 17.
    © 2014 17 •Architecture • Cloud • SoLoMo A Peek at the Future of IT
  • 18.
    © 2014 18 •Architecture • Cloud • SoLoMo A Peek at the Future of IT
  • 19.
    © 2014 19 •Architecture • Cloud • SoLoMo A Peek at the Future of IT
  • 20.
    © 2014 20 •Architecture • Cloud • SoLoMo • Packages • Integration A Peek at the Future of IT
  • 21.
    © 2014 21 •Architecture • Cloud • SoLoMo • Packages • Integration • Outsourcing A Peek at the Future of IT
  • 22.
    © 2014 22 •Architecture • Cloud • SoLoMo • Packages • Integration • Outsourcing • Agile, Scrum A Peek at the Future of IT
  • 23.
    © 2014 23 •Architecture • Cloud • SoLoMo • Packages • Integration • Outsourcing • Agile, Scrum • Collaboration A Peek at the Future of IT
  • 24.
    © 2014 24 •Architecture • Cloud • SoLoMo • Packages • Integration • Outsourcing • Agile, Scrum • Collaboration • DevOps A Peek at the Future of IT
  • 25.
    © 2014 25 •Architecture • Cloud • SoLoMo • Packages • Integration • Outsourcing • Agile, Scrum • Collaboration • DevOps • Continuous Delivery A Peek at the Future of IT
  • 26.
    © 2014 26 •Architecture • Cloud • SoLoMo • Packages • Integration • Outsourcing • Agile, Scrum • Collaboration • DevOps • Continuous Delivery • … … … … A Peek at the Future of IT
  • 27.
    © 2014 27 •Architecture • Cloud • SoLoMo • Packages • Integration • Outsourcing • Agile, Scrum • Collaboration • DevOps • Continuous Delivery • … … … … A Peek at the Future of Software Testing Optimizing Today Tomorrow/Next
  • 28.
    © 2014 28 APeek at the Future of Software Testing • Agile, Scrum – Joint effort and success – Early involvement and feedback – Social skills required – Test management role
  • 29.
    © 2014 29 APeek at the Future of Software Testing • Agile, Scrum • Context Driven – Problem solving, (good) practice, heuristics, questioning –People, skills, cooperation – Exploratory – Rapid Software Testing The SevenBasic Principlesof the Context-DrivenSchool 1.The value of any practice depends on its context. 2.There are good practices in context, but there are no best practices. 3.People, working together, are the most important part of any project’s context. 4.Projects unfold over time in ways that are often not predictable. 5.The product is a solution. If the problem isn’t solved, the product doesn’t work. 6.Good software testing is a challenging intellectual process. 7.Only through judgment and skill, exercised cooperatively throughout the entire project, are we able to do the right things at the right times to effectively test our products.
  • 30.
    © 2014 30 APeek at the Future of Software Testing • Agile, Scrum • Context Driven • SDTM (Service Driven Test Management) – From complaining and blaming towards enabling – Tactful leadership
  • 31.
    © 2014 31 APeek at the Future of Software Testing • Agile, Scrum • Context Driven • SDTM (Service Driven Test Management) • TestOps – Test in production – Cloud testing (Iaas, Taas) – Integration
  • 32.
    © 2014 32 APeek at the Future of Software Testing • Agile, Scrum • Context Driven • SDTM (Service Driven Test Management) • TestOps • Automation 2.0 – Automation of testing – Architecture Testware Test scripts Test cases Test data Registration Reporting Test Automation Software – Platform – Infrastructure Test Automation Process & Organization Projects Changes Patches Fixes System Under Test Software – Service – Platform - Infrastructure
  • 33.
    © 2014 33 APeek at the Future of Software Testing • Agile, Scrum • Context Driven • SDTM (Service Driven Test Management) • TestOps • Automation 2.0 • Cloud Computing – Testing in the Cloud (TaaS) – Testing Cloud Services (SaaS)
  • 34.
    © 2014 34 APeek at the Future of Software Testing • Agile, Scrum • Context Driven • SDTM (Service Driven Test Management) • TestOps • Automation 2.0 • Cloud Computing • SoLoMo – Technical skills – Multi dimensional – Continuous integration
  • 35.
    © 2014 35 APeek at the Future of Software Testing • Agile, Scrum • Context Driven • SDTM (Service Driven Test Management) • TestOps • Automation 2.0 • Cloud Computing • SoLoMo • Outsourcing – Scoping – Agreements – Management controls, metrics, health checks test deliverables test progress test process product quality
  • 36.
    © 2014 36 APeek at the Future of Software Testing • Agile, Scrum • Context Driven • SDTM (Service Driven Test Management) • TestOps • Automation 2.0 • Cloud Computing • SoLoMo • Outsourcing •
  • 37.
    © 2014 37 •Architecture • Cloud • SoLoMo • Packages • Integration • Outsourcing • Agile, Scrum • Collaboration • DevOps • Continuous Delivery • … … … … A Peek at the Future of Software Testing Optimizing Today Tomorrow/Next
  • 38.
  • 39.
    © 2014 39 Distributed Business/RQMS Development Operations Technical Automation Cloud SoLoMo e.g.Security Coding Automation Testing Development Social Team player Communication Craftsmanship Testing Test management A Peek at the Future of Software Testing
  • 40.
  • 41.