The presentation discusses how analytics is transforming the approach to testing, emphasizing the importance of customer feedback and experience in defining product quality. Key takeaways highlight user behavior, defect analysis, and the necessity for improved testing methodologies based on user sentiment and patterns. Additionally, it presents various analytical techniques like regression and sentiment analysis, which can enhance test design and quality assurance processes.

1. #ATAGTR2019
How is Analytics reshaping
Testing?
Himani Yadav & Brijesh Deb
14th 15th Dec, 2019

2. #ATAGTR2019
As a author of this presentation I/we own the copyright and confirm the originality of the content. I/we allow Agile testing alliance to use the content for social media marketing, publishing it on ATA Blog or
ATA social medial channels(Provided due credit is given to me/us)
Himani Yadav
Senior QA Engineer – Viewics,Inc. (acquired by Roche)
LinkedIn: - https://www.linkedin.com/in/himani-yadav-6172a716
Twitter: - @himaniyadav176
Brijesh Deb
Test Manager – Sogeti
LinkedIn: - https://www.linkedin.com/in/brijeshkumardeb/
Twitter: - @brijeshdeb
About The Speakers

3. #ATAGTR2019
As a author of this presentation I/we own the copyright and confirm the originality of the content. I/we allow Agile testing alliance to use the content for social media marketing, publishing it on ATA Blog or
ATA social medial channels(Provided due credit is given to me/us)
Feedback – How is it relevant to products and tests?
The changing definition of quality
Analysing the feedback
Translating Analysis to Tests
The result
1
2
3
4
5
What Will You Hear Today?

4. #ATAGTR2019
As a author of this presentation I/we own the copyright and confirm the originality of the content. I/we allow Agile testing alliance to use the content for social media marketing, publishing it on ATA Blog or
ATA social medial channels(Provided due credit is given to me/us)
Customer Satisfaction
Build Test
Collect Customer Feedback
Analyze
Customer Success
What’s It About?

5. #ATAGTR2019
As a author of this presentation I/we own the copyright and confirm the originality of the content. I/we allow Agile testing alliance to use the content for social media marketing, publishing it on ATA Blog or
ATA social medial channels(Provided due credit is given to me/us)
Key Takeaways from Feedback
• User behaviour
• Usage Patterns
• Most used feature/functionality
• New areas/features that users would like to be included
• Defect clusters – Functional dependencies and most
impacted functionality.
Feedback – What Does It Tell Us?

6. #ATAGTR2019
As a author of this presentation I/we own the copyright and confirm the originality of the content. I/we allow Agile testing alliance to use the content for social media marketing, publishing it on ATA Blog or
ATA social medial channels(Provided due credit is given to me/us)
Try before you buy. Would you?
The Changing Definition Of Quality

7. #ATAGTR2019
As a author of this presentation I/we own the copyright and confirm the originality of the content. I/we allow Agile testing alliance to use the content for social media marketing, publishing it on ATA Blog or
ATA social medial channels(Provided due credit is given to me/us)
Try before you fly. Would you?
The Changing Definition Of Quality

8. #ATAGTR2019
As a author of this presentation I/we own the copyright and confirm the originality of the content. I/we allow Agile testing alliance to use the content for social media marketing, publishing it on ATA Blog or
ATA social medial channels(Provided due credit is given to me/us)
Customer Experience (CX) has evolved as the new parameter of quality. The new set of
questions that have gained importance are…
 What does the customer think about the product?
 Does the look and feel impress him/her?
 Does it do what it is supposed to do?
 Does it solve the customer’s problems?
 Does it have the features that would solve the problems or does the customer expect more?
The Changing Definition Of Quality

9. #ATAGTR2019
As a author of this presentation I/we own the copyright and confirm the originality of the content. I/we allow Agile testing alliance to use the content for social media marketing, publishing it on ATA Blog or
ATA social medial channels(Provided due credit is given to me/us)
ISO 9126
Maintainability
Efficiency
Portability
Reliability
Functionality
Usability
Resource utilization
Time behaviour
Adaptability, Replaceability,
Installability, Co-existence
Fault tolerance, Maturity,
Recoverability
Regularity, Accuracy, Security,
Suitability, Interoperability
Learnability, Understandability,
Attractiveness, Operability
Analyzability, Changeability,
Testability, Stability
The Changing Definition Of Quality

10. #ATAGTR2019
As a author of this presentation I/we own the copyright and confirm the originality of the content. I/we allow Agile testing alliance to use the content for social media marketing, publishing it on ATA Blog or
ATA social medial channels(Provided due credit is given to me/us)
The Changing Definition Of Quality

11. #ATAGTR2019
As a author of this presentation I/we own the copyright and confirm the originality of the content. I/we allow Agile testing alliance to use the content for social media marketing, publishing it on ATA Blog or
ATA social medial channels(Provided due credit is given to me/us)
Defect clustering
Analyzing Feedback
0 10 20 30 40 50 60 70 80
Review
Pricing
Product Details
Sorting
Filters
Search Result Page
Home Page
Number of Bugs

12. #ATAGTR2019
As a author of this presentation I/we own the copyright and confirm the originality of the content. I/we allow Agile testing alliance to use the content for social media marketing, publishing it on ATA Blog or
ATA social medial channels(Provided due credit is given to me/us)
Low Quality
Product
Poor SupportManagement
Fishbone Analysis
Analyzing Feedback
Low Customer Satisfaction Cause and Effect Diagram
Low Customer
Satisfaction
High Price
Poor Materials
Bad Design
Incompetent employee
Bad package
Low production efficiency
High cost of materials
Ineffective marketing
No advanced technology
No sense of responsibility
Complicated procedure
No standard criteria
Bad leadership
Small scale
Not enough personnel
Long hold time
Wrong answers

13. #ATAGTR2019
As a author of this presentation I/we own the copyright and confirm the originality of the content. I/we allow Agile testing alliance to use the content for social media marketing, publishing it on ATA Blog or
ATA social medial channels(Provided due credit is given to me/us)
Regression Analysis
Analyzing Feedback

14. #ATAGTR2019
As a author of this presentation I/we own the copyright and confirm the originality of the content. I/we allow Agile testing alliance to use the content for social media marketing, publishing it on ATA Blog or
ATA social medial channels(Provided due credit is given to me/us)
Sentiment Analysis
Analyzing Feedback

15. #ATAGTR2019
As a author of this presentation I/we own the copyright and confirm the originality of the content. I/we allow Agile testing alliance to use the content for social media marketing, publishing it on ATA Blog or
ATA social medial channels(Provided due credit is given to me/us)
Traceability of defects to tests to requirements
Translating Analysis To Tests

16. #ATAGTR2019
As a author of this presentation I/we own the copyright and confirm the originality of the content. I/we allow Agile testing alliance to use the content for social media marketing, publishing it on ATA Blog or
ATA social medial channels(Provided due credit is given to me/us)
Tests can be written based on the
feedback analysis where we can focus
on areas that have
• Risks foreseen and experienced by users
• Most defects
• Maximum impacts
• Features needing security and/or
performance improvements
Tests can be improved based on the analysis
done so far
• Robust regression tests from the beta test results.
• Improved traceability based on results of
regression analysis.
• Better UI/UX tests based on customer sentiment
analysis.
• User behaviour tests that can be used to for
machine learning and AI driven tests.
Translating Analysis To Tests

17. #ATAGTR2019
As a author of this presentation I/we own the copyright and confirm the originality of the content. I/we allow Agile testing alliance to use the content for social media marketing, publishing it on ATA Blog or
ATA social medial channels(Provided due credit is given to me/us)
The Results

18. #ATAGTR2019
As a author of this presentation I/we own the copyright and confirm the originality of the content. I/we allow Agile testing alliance to use the content for social media marketing, publishing it on ATA Blog or
ATA social medial channels(Provided due credit is given to me/us)
The Results

19. #ATAGTR2019
As a author of this presentation I/we own the copyright and confirm the originality of the content. I/we allow Agile testing alliance to use the content for social media marketing, publishing it on ATA Blog or
ATA social medial channels(Provided due credit is given to me/us)

20. #ATAGTR2019
As a author of this presentation I/we own the copyright and confirm the originality of the content. I/we allow Agile testing alliance to use the content for social media marketing, publishing it on ATA Blog or
ATA social medial channels(Provided due credit is given to me/us)
Image Credits and References
Slide 5:- https://www.centercode.com/
https://web.archive.org/web/20160413143321
Slide 6:- http://www.it-sideways.com/2018/03/try-before-you-buy-jabra-elite-65t.html
Slide 7:- https://insideflyer.nl/klm-lanceert-augmented-reality-try-before-you-fly
Slide 9:- https://en.wikipedia.org/wiki/ISO/IEC_9126#/media/File:ISO_9126_quality_(en).svg
Slide 10:- http://tmap.net/blogs/
Slide 11:- www.testingexcellence.com
Slide 13:- https://www.callcentrehelper.com/quality-parameters-ideal-scorecard-metric-124846.htm
Slide 14:- https://www.satalytics.com/feature-highlights/sentiment-analysis/
Slide 15:- https://confluence.xpand-it.com/display/public/XRAY/Traceability+Report
Slide 17:- https://www.callcentrehelper.com/quality-parameters-ideal-scorecard-metric-124846.htm
Slide 18:- Harvard Business Review Analytic Services Survey March 2018

21. Thank you!