Testers can’t live without their beloved tools, and the landscape of testing and development tools is changing rapidly. While testers were previously limited to a few expensive and difficult to use tools, the market is now filling with many more affordable, powerful, and easy to use products. In this presentation, Kevin will discuss 5 of the most important macro trends in test tools: 1) Specialization 2) Cloud hosting 3) Architectural Shifts 4) Collaboration 5) Ease of Use/Deployment. Kevin will also provide examples of popular tools that are capitalizing on these trends and gaining popularity in the market. Watch the Quality Jam presentation at www.qasymphony.com/blog/quality-jam-2017-presentations/

1. Macro Trends and Useful
Tools that “Get it”
Kevin Dunne

2. INSERT PHOTO ON TOP
“Man is a tool-using Animal.
Nowhere do you find him
without tools; without tools he
is nothing, with tools he is
all.”
Thomas Carlyle

3. Agenda
Specialization
Cloud
Hosting
Architectural
Shifts
Collaboration
Ease of Use /
Deployment
Product
Hub!

4. Specialization

5. INSERT PHOTO ON TOP
Distinct Tools Across the Test Pyramid
Legacy test automation tools were focused on
solving a wide array of problems across the testing
pyramid
Today’s testing tools have focused on specific
problems within the pyramid
Specialization typically leads to similar or better
functionality at a lower cost
Source: https://www.ministryoftesting.com/wp-
content/uploads/2014/10/typical_pyramid.jpg

6. Growth in JavaScript
As the usage of JavaScript grows, the number of frameworks associated to it is
also exploding:
Source: http://developer.telerik.com/featured/what-to-expect-from-javascript-in-2016-frameworks/

7. INSERT PHOTO ON TOP
Specialization Within a Discipline
As the number of new UI frameworks increases,
the number of testing tools will also increase
An increased number of frameworks can be both
good and bad
Source: https://semaphoreci.com/community/tutorials/testing-react-
components-with-enzyme-and-mocha
Platform + Front End
Test Runner + Library
Meteor React Mocha Enzyme

8. INSERT PHOTO ON TOP
Growing # of Tools = Need for Consolidation
As the number of front ends and frameworks
increases, there is a need for a consolidated
source of truth for information
Tools with open plugin frameworks and API’s
are often good candidates for data consolidation

9. Cloud Hosting

10. Cloud Adoption for DevOps Infrastructure

11. Using the Cloud Infra for Testing Applications
Performance Testing
Leverage the cloud to allow for easy testing
with a large number of users at scale
Functional Testing
Create browsers and mobile devices in the
cloud that can run automated or manual
functional tests
User Experience Testing
Leverage the cloud to push tests to a public
pool of users for feedback

12. How Cloud Functional Testing Platforms Work
Source: https://lh3.googleusercontent.com/-cpqmGDRS5V8/UmbNdlY4ucI/AAAAAAAAHg0/I9riM6izAEg/w911-h394/Sauce%2BLabs%2Bsolution.png

13. Roll Your Own Functional Testing Platform
Source; http://www.seleniumframework.com/wp-content/uploads/2015/01/Overall_GRID_architecture.png

14. Architectural Shifts

15. Challenges Solved with Service Oriented Architecture
Source: https://image.slidesharecdn.com/ole-soa-bpm-overview-1229534561537601-1/95/service-oriented-architecture-and-business-process-modeling-
overview-4-728.jpg?cb=1229507794
Easier Cross Channel Development
Separate as much logic as possible from the UI,
allowing easier development on mobile, web,
other platforms
Independent Release Cycles
Services remain static while code changes,
allows for independent development cycles
Ease of Integration
As the number of outside data sources involved
in typical applications grows, SOA allows for
easier connection to outside services

16. The New Testing World in SOA
Testing in the new SOA architecture is a departure from traditional testing, and values three major areas for
most API’s tested:
Uptime
• How often does the API/service return no result or a bad result?
Accuracy
• Is the response from the API accurate (does it match records in DB)?
Latency
• How long does the service take to return an accurate response?

17. New Tools in the API Testing Space
Legacy Tools
• SOATest
• SoapUI
Newer Tools
• API Fortress
• Runscope
• Support for API Documentation Tools
• Cloud hosting
• Support of global test execution
• CI integration

18. Collaboration

19. The Remote Manifesto
GitLab has famously supported a “remote-only” culture and has published The Remote Manifesto to
extend the Agile Manifesto for remote teams:
1. Work from anywhere you want
2. Communicate Asynchronously
3. Recognize that the future is unknown
4. Have face-to-face meetings online
5. Daily stand-up meetings are for bonding, blockers and the future
6. Estimate workload on a need-to-know basis
7. Bond in real life
8. Give credit where it's due and remember to say thank you
Source: https://about.gitlab.com/2015/04/08/the-remote-manifesto/

20. Best of Breed Tooling

21. Tool Features for Today’s Teams
Ease of Adoption
• Difficult to adopt tools
will force users to other
methods
Real-Time
• Tools need to stay
current and direct users
to new/important
information
Flexible
• Teams work in different
ways, so they need to
adapt to the different
workflows
Integrated
• Needs to speak well and
easily to the number of
other tools in the
development stack

22. Easy to Use
IDE
• Record tests easily without needing
to learn selenium or coding
languages
• Generate tests that run across
browsers and across languages
with little effort
• Free!

23. Real-Time
• Integrate to tools in the ecosystem
for streamlined alerting – more
than 150 integrations and an open
API
• Break out into smaller groups for
solving specific issues, direct
message if needed
• Specific apps for web, mobile,
desktop to get messages anywhere,
ant time

24. Flexible
• 1300+ plugins to drive specific
functionality and features
• Deployment on cloud, server, and
in data center (high availability)
• Customizable fields, workflows,
and issue types to make a tailored
solution
• Open API’s and WebHooks to drive
integration into external systems

25. The New DevOps Process
Source: http://15809-presscdn-0-93.pagely.netdna-cdn.com/wp-content/uploads/2016/02/MTIyMzAyMzE5NDE2MDc3NTkz.png

26. Real-Time Splunk for JIRA Service Desk Real-Time JIRA Service Desk Connector for Splunk

27. ITSM and DevOps

28. Ease of Use/Deployment

29. Extreme Growth in Containers
Source: https://www.docker.com/what-container?gclid=CJ2-u9yRjtMCFQyDaQodcmQK-w

30. What Does a Container Do?
Source: https://www.docker.com/what-container?gclid=CJ2-u9yRjtMCFQyDaQodcmQK-w

31. Tools That Work with Containers

32. Tools in the Product Hub

34. Thank You