This slidedeck talks about the emerging trends, best practices and tools for Agile Test Management. As lines between development and operations blur, sprints get shorter, the difficulty mounts in meeting the higher expectations both for speed and quality of software deliverables. How to configure your test management solution to get your delivery up to speed and improve your release quality build by build.

1. New Trends in Test Management © 2017 QMetry Inc.
New Trends in
Agile Test Management

2. New Trends in Test Management © 2017 QMetry Inc.
Meet the Speakers
Vishal Jhala
Cloud Architect
Harshal Vora
Product Specialist

3. New Trends in Test Management © 2017 QMetry Inc.
Software development landscape:
What has changed?
• Software development is now fiercely complex, competitive
and fast-paced.
• To survive the competitive landscape, agile practice and
DevOps teams are driving the Digital Transformation efforts
globally.
• Mushrooming of the app economy over the years has
transformed the consumer mindset and expectations.
• There is a demand for faster, better and relevant digital
experiences that make lives easier.
• Very little margin for error when it comes to software
development. The cost of each mistake keeps spiraling.

4. New Trends in Test Management © 2017 QMetry Inc.
State of Software Development

5. New Trends in Test Management © 2017 QMetry Inc.
How DX initiatives - DevOps and Agile have
changed the game?
• Agility has changed the way we test
• TestOps at the speed of DevOps
• Continuous Testing and Testing early
• Reduced feedback latency
• Breaking of Siloed approach
Continuous Testing: Missing Link for Continuous Delivery

6. New Trends in Test Management © 2017 QMetry Inc.
Some facts and figures…
• World Quality Report led by Capgemini shows that there is increased investment in the QA
and Test function reported by 90% of US and 69% percent of Canadian survey
participants in the past four years
• “By 2020, DevOps initiatives will cause 50% of enterprises to implement continuous testing
using frameworks and open-source tools.” (Predicts 2017: Application Development, Gartner,
Nov. 28, 2016)

7. New Trends in Test Management © 2017 QMetry Inc.
"The term everyone is using is DevOps, but I think it should
really be DevTestOps. Testing is really crucial for achieving
quality @ speed.”
- Diego Lo Giudice,
FORRESTER

8. New Trends in Test Management © 2017 QMetry Inc.
But going Agile

9. New Trends in Test Management © 2017 QMetry Inc.
Challenges
• Shorter sprints require better collaboration and clarity
• QA teams, product teams and dev teams need to be part of the
sprint from Day 1.
• Requires higher integration of tools and better interoperability
• The need for continuity and real-time improvements and access to
metrics
• One-size doesn’t fit all
• Outdated tools and practices, legacy software that fail to keep up
• Gaps between traditional test management and modern, Agile
development approach

10. New Trends in Test Management © 2017 QMetry Inc.
Challenges at Each Stage
REQUIREMENTS
DEVELOPMENT
SCM BUILD PACKAGE DEPLOY
TEST
STAGE
PRODUCTION
Changes In Requirements, Delays In Scope
Errors During Development, Shortcuts
Processes Are Governed But Manual, Not Automated
Heavily Interdependent
Less Time To Test, Quality Compromised
Availability Of
Environment
Communication Gaps At Each Level

11. New Trends in Test Management © 2017 QMetry Inc.
Challenges at Each Stage
REQUIREMENTS
DEVELOPMENT
SCM BUILD PACKAGE DEPLOY
TEST
STAGE
PRODUCTION

12. New Trends in Test Management © 2017 QMetry Inc.
50-60%
UI Testing
10-40%
Functional
0-10%
Unit Testing
LEVELOFTESTING
REQUIREMENT, DESIGN, DEVELOPMENT, TESTING, SUPPORT
Traditional Agile Concept

13. New Trends in Test Management © 2017 QMetry Inc.
LEVELOFTESTING
R E Q U I R E M E N T , D E S I G N , D E V E L O P M E N T , T E S T I N G , S U P P O R T
The Shift Left Agile Concept
50-60%
Unit Testing
20-40%
Automation
0-10%
UI Testing

14. New Trends in Test Management © 2017 QMetry Inc.
• Unified solutions
• Starting as early as possible in the dev. cycle
• Frequent test runs and more feedback for
continuous development
• Bi-directional sharing
• Continuous Integration
• Continuous Collaboration
Test Management to be Truly Agile needs…

15. New Trends in Test Management © 2017 QMetry Inc.
Roadblocks
for Agile and
DevOps teams

16. New Trends in Test Management © 2017 QMetry Inc.
New Trends Demand New Tools
and Fresh Approach
Can we match the agility with current tools and practices?

17. New Trends in Test Management © 2017 QMetry Inc.
Continuous Testing & Integration
• Test early, often and well
• Start as early as possible in the sprint
• The earlier defects are found, the easier they are to fix
• With the help of continuous testing and automation, Continuous
Integration can be achieved
• Continuous QA and Testing support faster development cycles in
true Agile and DevOps fashion, reducing feedback latency
• CI shortens the feedback loop, enables continuous builds and
provides the continuous improvement and deployment that is crucial
to scalable, complex software use cases of today
• A wide range of tools are available for test-driven development,
behavior-driven development and continuous integration
Automation
• Continuous testing requires automation
• Agile teams generate copious volumes of test data because of
the increased test frequency. Test automation is required to
sustain the pace for large number of tests to be run
• Automation experts and development teams need to collaborate
and develop test script that maximize the test coverage
• Exploratory testing – a popular approach in testing yields great
results with help from automation as it applies context-driven
testing that complements principles of Agile
Predictive Quality and Prescriptive Quality
Analytics
• Use of algorithms to analyze vast amounts of test
data
• AI and machine learning are optimizing software
testing
• Designing better models by extracting the most
important information from defect management
and test automation
• Using this actionable intelligence to benchmark
and identify patterns and predict outcomes –
thereby shrinking the dev cycle and provide
prescriptive analytics in real-time

18. New Trends in Test Management © 2017 QMetry Inc.
Rules and Tools for the Game

19. New Trends in Test Management © 2017 QMetry Inc.
What Best Practices We Recommend?
Focus on collaboration and integrated approach for
test management to be Truly Agile
• Visibility
• Traceability
• Continuous Integration
• Behavior-driven development
• Integrated toolset
• Busting siloed workflows
• Exploratory testing
• Predictive Analytics

20. New Trends in Test Management © 2017 QMetry Inc.
Setting it all up
• Set up your project & roles inside Test
Management.
• Better visibility for your developers and entire
team. Integrate your project management
tools such as JIRA with Test Management.
Sync defects and test results in real time.
• Plug in your automation. Generate API keys
and set up your TM to accept automation
results.
• Define platforms. A must in today’s world.
Sign up for a cloud based Test Management solution.

21. New Trends in Test Management © 2017 QMetry Inc.
How should teams use Test Management?
• Create or import requirements. Test Coverage is the key to go/no-go decisions.
• Author modular tests - to reduce authoring and maintenance efforts.
• Link test cases to requirements. This promotes the reuse of test assets.

22. New Trends in Test Management © 2017 QMetry Inc.
How should teams use Test Management?
Use exploratory testing and reduce documentation efforts

23. New Trends in Test Management © 2017 QMetry Inc.
How should teams use Test Management?
• Let automation create its own tests.
• Bring in automation results. Get comprehensive view of manual and automation testing to make more informed decisions.

24. New Trends in Test Management © 2017 QMetry Inc.
How should teams use Test Management?
• Create Test suites by release & platforms. Helps track if the quality of software is by improving build by build or not.
• Execute and log defects. Reuse defects here.

25. New Trends in Test Management © 2017 QMetry Inc.
Use Case
• Our client is a multinational corporation with 90 offices in 40
countries
• Multiple Agile teams in different locations used Excel to
manage their test load. It soon became cumbersome and
painful with distributed teams
• Pain points: The need for test collaboration and high-quality
reporting and metrics, JIRA integration, reusability
automation stack integration
Overview
Challenges
How QMetry Resolved these Challenges?
• Offered a modular/customizable test management
• Version control to create and retain versions of test assets
• Integration with external software tools like LDAP and JIRA
• Custom reporting based on organization with simple query
language
• Pay as you go model to choose appropriate features when
scaling up
• Greater flexibility and control over test organization along
with advanced reporting and real-time dashboards insights

26. New Trends in Test Management © 2017 QMetry Inc.
Questions ?