The document discusses test management struggles and challenges in the software development life cycle (SDLC). It outlines three main challenges: 1) too much workload for reporting and manually linking test cases to incident tickets, 2) difficulty managing requirements and test cases and utilizing testing activities, and 3) difficulty completing automation tasks on time. It proposes solutions such as reducing reporting time, linking items automatically, improving test case management tools, and prioritizing automation.

1. Test Management Struggles and Challenges in
SDLC
Mar 29th 2019
Fumikazu Fujiwara
Service Quality Assurance Group
Leisure Product Section
Leisure Product Department
Life & Leisure Technology Supervisory Department
Rakuten, Inc.

2. 2
1.About Our Team
2.About Our Product
3.SDLC
4.Struggles
5.Challenges
Agenda

3. 3
1.About Our Team
2.About Our Product
3.SDLC
4.Struggles
5.Challenges
Agenda

4. 4
[Career Summary]
2004-2010 : Experienced 2 internet based companies
Aug 2010 : Joined Rakuten (3rd company for me)
2010-2013 : Lead Developer for Ad-tech platform
2013-2016 : Manager for Social tool platform dev team
2017- : Manager for SQA Group for leisure services
Self-Introduction
@freddiefujiwara

5. 5
Product Quality
Assurance
By Testing
Reaching
ZERO Customer Dissatisfaction
Our Mission
Best Experience
Assurance
By Data Science
Our Team
Reliability
Assurance
By Stress Test

6. 6
Product Quality
Assurance
By Testing
Reaching
ZERO Customer Dissatisfaction
Our Mission
Best Experience
Assurance
By Data Science
Our Team
Reliability
Assurance
By Stress Test
Today’s scope

7. 7
Our Team

8. 8
1.About Our Team
2.About Our Product
3.SDLC
4.Struggles
5.Challenges
Agenda

9. 9
Our Product
*As of Feb 28 2018
*As of Feb 28 2018
*As of Feb 28 2018
*As of Feb 28 2018

10. 10
1.About Our Team
2.About Our Product
3.SDLC
4.Struggles
5.Challenges
Agenda

11. T1(Unit Test)Implementation
DevSpec T2(Integration Test)
PRD(Requirement)
1.Test
Plan
2.Test
Design
3.Test
Implementatio
n
5.Test
Execution
6.Release
Judgement
PRD
Affected Area/
Test Environment Information
System Test(QA)
• Test Strategy
• Test Scope
• Estimation(Draft
)
• RTM
• HLS
• Estimation(Fix)
• Case
• Data
• Env Setup
SQA Task
Output
For stakeholders
Legend
• Incident
Report
• Final Report
Signoff for Reliability , Maintainability….
4.Smoke Test
Sharing
• Smoke
Test
Cases
Smoke Test
Result
Output
w/o sharing
Input from
stakeholders
SDLC

12. 12
1.About Our Team
2.About Our Product
3.SDLC
4.Struggles
5.Challenges
Agenda

13. 1.Test
Plan
2.Test
Design
3.Test
Implementatio
n
5.Test
Execution
6.Release
Judgement
• Test Strategy
• Test Scope
• Estimation(Draft
)
• RTM
• HLS
• Estimation(Fix)
• Case
• Data
• Env Setup
• Incident
Report
• Final Report
4.Smoke Test
Sharing
• Smoke
Test
Cases
Struggle#1

14. 1.Test
Plan
2.Test
Design
3.Test
Implementatio
n
5.Test
Execution
6.Release
Judgement
• Test Strategy
• Test Scope
• Estimation(Draft
)
• RTM
• HLS
• Estimation(Fix)
• Case
• Data
• Env Setup
• Incident
Report
• Final Report
4.Smoke Test
Sharing
• Smoke
Test
Cases
Struggle#1

15. 1.Test
Plan
2.Test
Design
3.Test
Implementatio
n
5.Test
Execution
6.Release
Judgement
• Test Strategy
• Test Scope
• Estimation(Draft
)
• RTM
• HLS
• Estimation(Fix)
• Case
• Data
• Env Setup
• Incident
Report
• Final Report
4.Smoke Test
Sharing
• Smoke
Test
Cases
Struggle#1
1.Too much work load for reporting
2.Manual linkage test case and incident ticket

16. 1.Test
Plan
2.Test
Design
3.Test
Implementatio
n
5.Test
Execution
6.Release
Judgement
• Test Strategy
• Test Scope
• Estimation(Draft
)
• RTM
• HLS
• Estimation(Fix)
• Case
• Data
• Env Setup
• Incident
Report
• Final Report
4.Smoke Test
Sharing
• Smoke
Test
Cases
Struggle#2

17. 1.Test
Plan
2.Test
Design
3.Test
Implementatio
n
5.Test
Execution
6.Release
Judgement
• Test Strategy
• Test Scope
• Estimation(Draft
)
• RTM
• HLS
• Estimation(Fix)
• Case
• Data
• Env Setup
• Incident
Report
• Final Report
4.Smoke Test
Sharing
• Smoke
Test
Cases
Struggle#2

18. 1.Test
Plan
2.Test
Design
3.Test
Implementatio
n
5.Test
Execution
6.Release
Judgement
• Test Strategy
• Test Scope
• Estimation(Draft
)
• RTM
• HLS
• Estimation(Fix)
• Case
• Data
• Env Setup
• Incident
Report
• Final Report
4.Smoke Test
Sharing
• Smoke
Test
Cases
Struggle#2
1.Difficult to manage both of Requirement and Test cases
2.Difficult to utilize our activity.
Requirement0
1
Test Idea01
Test
Condition01
Test Idea02
Test
Condition02
Test
Condition03
Requirement0
2
Test Idea03
Test
Condition04
Test Idea04
Test
Condition05
Test
Condition06
Product
Requireme
nt
Document

19. 1.Test
Plan
2.Test
Design
3.Test
Implementatio
n
5.Test
Execution
6.Release
Judgement
• Test Strategy
• Test Scope
• Estimation(Draft
)
• RTM
• HLS
• Estimation(Fix)
• Case
• Data
• Env Setup
• Incident
Report
• Final Report
4.Smoke Test
Sharing
• Smoke
Test
Cases
Struggle#3

20. 1.Test
Plan
2.Test
Design
3.Test
Implementatio
n
5.Test
Execution
6.Release
Judgement
• Test Strategy
• Test Scope
• Estimation(Draft
)
• RTM
• HLS
• Estimation(Fix)
• Case
• Data
• Env Setup
• Incident
Report
• Final Report
4.Smoke Test
Sharing
• Smoke
Test
Cases
Struggle#3

21. 1.Test
Plan
2.Test
Design
3.Test
Implementatio
n
5.Test
Execution
6.Release
Judgement
• Test Strategy
• Test Scope
• Estimation(Draft
)
• RTM
• HLS
• Estimation(Fix)
• Case
• Data
• Env Setup
• Incident
Report
• Final Report
4.Smoke Test
Sharing
• Smoke
Test
Cases
Struggle#3
1.Difficult to make it on time about automation task

22. 22
1.About Our Team
2.About Our Product
3.SDLC
4.Struggles
5.Challenge
Agenda

23. 23
Challenge#1
1.Too much work load for reporting
2.Manual linkage test case and incident ticket

24. 24
Task As is To be Effect/month
Daily report 30 min /
project
5 min / project -46 hours
Create Incident
ticket
20 min /
Incident
15 min /
Incident
-9 hours
Incident
handling
10 min /
Incident
1 min /
Incident
-16.5 hours
※
1 month = 22 day
Average run project = 5
Average new Incident / day = 5
Challenge#1
75.5 hours/month
reduction
1.Too much work load for reporting
2.Manual linkage test case and incident ticket

25. Challenge#2
1.Difficult to manage both of Requirement and Test cases
2.Difficult to utilize our activity.

26. Challenge#2
Requirement01 Test Idea01 Test Condition01 Test Scenario01
Test Idea02 Test Condition02
Test Condition03
Test Scenario02
Test Scenario03
Requirement02 Test Idea03 Test Condition04 Test Scenario04
Test Idea04 Test Condition05
Test Condition06
Test Scenario05
Test Scenario06
Product
Requirement
Document
1.Difficult to manage both of Requirement and Test cases
2.Difficult to utilize our activity.

27. Challenge#2
Requirement01 Test Idea01 Test Condition01 Test Scenario01
Test Idea02 Test Condition02
Test Condition03
Test Scenario02
Test Scenario03
Requirement02 Test Idea03 Test Condition04 Test Scenario04
Test Idea04 Test Condition05
Test Condition06
Test Scenario05
Test Scenario06
Product
Requirement
Document
1.Difficult to manage both of Requirement and Test cases
2.Difficult to utilize our activity.

28. Challenge#2
1.Difficult to manage both of Requirement and Test cases
2.Difficult to utilize our activity.
It shows which requirement had major #of defects.
It is easier to take a decision on whether to release or not by looking at
it.
If any requirement changes then its easier to find out the test cases id
which needs modification.
It ensures coverage, so easy to find out if any requirement is without
test cases.

29. Challenge#2
Requirement01 Test Idea01 Test Condition01 Test Scenario01
Test Idea02 Test Condition02
Test Condition03
Test Scenario02
Test Scenario03
Requirement02 Test Idea03 Test Condition04 Test Scenario04
Test Idea04 Test Condition05
Test Condition06
Test Scenario05
Test Scenario06
Product
Requirement
Document
The coverage of
our
Test Management Tool
Test Management Tool
Doesn’t cover this area

30. Challenge#2
Requirement01 Test Idea01 Test Condition01 Test Scenario01
Test Idea02 Test Condition02
Test Condition03
Test Scenario02
Test Scenario03
Requirement02 Test Idea03 Test Condition04 Test Scenario04
Test Idea04 Test Condition05
Test Condition06
Test Scenario05
Test Scenario06
Product
Requirement
Document
Refining flow and tools
The coverage of
our
Test Management Tool
Test Management Tool
Doesn’t cover this area

31. Challenge#3
1.Difficult to make it on time about automation task

32. 1.Test
Plan
2.Test
Design
3.Test
Implementatio
n
5.Test
Execution
6.Release
Judgement
4.Smoke Test
Sharing
Challenge#3
1.Difficult to make it on time about automation task
Task#1 fixing issues
Task#2 add new functionality