“A New Model for Building Business Process Quality“ - Originally presented by Mark Summers during a Worksoft webinar on June 23, 2015.

1. © 2015 Worksoft, Inc.www.worksoft.com
A New Model for Building
Business Process Quality
Mark Summers

2. www.worksoft.com 2
Develop and institutionalize a world class Structured Software Testing and Quality Assurance
Framework leveraging a “Assess > Improve > Transform” methodology, resulting in a more
efficient and effective IT organization capable of delivering high quality and high availability systems.
A Framework for Advancing Competency
Assess
Maturity Assessments based
on TMMI are the foundation for
maturing your quality
framework and overall IT.
Improve
Maximize your ability to
eliminate defects early and
concurrently lower the defect
discovery costs.
Transform
Achieve “world-class" quality
and efficiencies by streamlining
your IT organization with the
introduction of a formal test
competency or COE.
Assess Improve Transform

3. www.worksoft.com 3
Why strive for “High Maturity”?

4. www.worksoft.com 4
Typical Federated “Low Maturity” Test Teams
Assess Improve Transform
BU #1 -
eComm
BU #3 –
Financial Sys
BU #2 –
Logistics
= Standards
= Tools
= Expertise
= Compliance
o Inconsistent levels of quality
o Inconsistent execution and
levels of success
o Higher cost of development
and test
o Expensive duplication testing
tools
o Inability to sustain or reuse
testing assets
o Inability to leverage and reuse
best practices of other BU’s
o Duplicate specialty resource
o High levels of staffing
o Low Defect Removal Efficiency
Characterizations

5. www.worksoft.com 5
Typical Federated “Low Maturity” Test Teams
Assess Improve Transform
BU #1 -
eComm
BU #3 –
Financial Sys
BU #2 –
Logistics
= Standards
= Tools
= Expertise
= Compliance
o Inconsistent levels of quality
o Inconsistent execution and
levels of success
o Higher cost of development
and test
o Expensive duplication testing
tools
o Inability to sustain or reuse
testing assets
o Inability to leverage and reuse
best practices of other BU’s
o Duplicate specialty resource
o High levels of staffing
o Low Defect Removal Efficiency
Characterizations
?

6. www.worksoft.com 6
Optimized “High Maturity” Test Organization – TCOE
Characterizations Quality Standards
* Enterprise wide standards
Standard Tools
* One set of testing tools
Education
* Subject matter experts
Process
Governance & Continuous
Improvement
* Process governance &
predictable outcomes
Business
Unit #1
Business
Unit #2
Business
Unit #3
* Maximize resource
utilization and balancing
QCOE Shared Service
Test
Automation
Performance
Tuning
SDLC
Governance
Specialized
Test Services
* Specialized resources
sharing
* High defect removal
rate
* More efficient IT
department
* Lower defect discovery
costs

7. www.worksoft.com 7
Get there faster!
Assess Improve Transform
How can Worksoft’s maturity model of
“Assess>Improve>Transform”
get you there faster?

8. www.worksoft.com 8
Assess>Improve>Transform
Assess Improve Transform
Assess
Maturity Assessments based on TMMI are the foundation for
maturing your quality framework and overall IT.
o Select an expert to perform deep assessment
o Understand objectives and IT drivers
o Select appropriate assessment based on objectives and
industry standards
o Worksoft Health Check
o Test Maturity Baseline
o Test Maturity Assessment
o Compare results to industry standards and best practices
o Present findings and recommendations
o Assist with maturity roadmap
o Help prioritize & select process improvement initiatives

9. www.worksoft.com 9
Assess>Test Assessment Overview
Assessment Findings Report
Maturity Level Report
Action Plan & Basic Roadmap
Continuous Improvement
Assess Improve Transform
Input Analysis Output
Stakeholder Interviews
Questionnaires
Project Samples & Work Products
Worksoft
Assessment
Framework
TMMi
Model
Worksoft
Platform
Model

10. www.worksoft.com 10
Evidence collected for “Baseline” Assessment
IT Participants:
• Developers
• Infrastructure
• Technology
experts
• Quality assurance
• Program managers
• More…
Business
Participants:
• Jim Siegel
• Toby Cappello
• Business SMEs
• Business Analysts
Evidence Collected:
• Interview notes from
Participants
• Test Policy
• 2x Test Strategy
Document
• 2x Master Test Plan
• 12x Test Status Reports
• 10x Defect Reports
• Performance Test Plan
• QA Metric Report
• Test Execution
Schedule
• Test Technique
worksheets
• Test Lifecycle Website
• Templates Website
Process Area Coverage:
10 of 17 PA’s
• Test Policy & Strategy
• Test Planning
• Test Monitoring & Control
• Test Design & Execution
• Test Organization
• Test Lifecycle & Int
• Non-Functional Testing
• Test Measurement
• Advanced Reviews
• Defect Prevention
60+ Goals
- See below
200+ Practices
- See below
Deliverables:
• Strength & Weakness
Report
• Detailed Findings Report
• Evidence Coverage
Report
• Executive Summary
Report
• 4 Month RoadMap
• Workshop (depending on
assessment type)
• Project Plans (depending
on assessment type)
Other Sources:
• Worksoft Cerify
• HP Quality Center
• Remedy
• Service Now
• PMO Process
• EA Process
• LoadRunner
• McCabe Team Test
• Solman
• ST03
• Metics
• DRE
• Coverage
• Project Variance

11. www.worksoft.com 11
Assess>Sample Assessment detail
• Deep Assessment
• 17 Process Area’s
• 100 Goals
• 500 Practices

12. www.worksoft.com 12
Assess>Sample Assessment detail
• Wide Sampling
• # of Business
Units
• # of Projects
• Type of SDLC

13. www.worksoft.com 13
Assess>Sample Assessment detail
• Meaningful findings
• Detailed opportunities for
improvement
• Evidence collection

14. www.worksoft.com 14
Assess>Improve>Transform
Assess Improve Transform
Improve
Maximize your ability to eliminate defects early and concurrently lower the defect
discovery costs by leveraging Worksoft solutions
o Assist in prioritization of initiatives from the assessment
o Leverage experts for the process improvement initiatives
o Acceleration packages based on industry best practices
o world-class test competency & COE frameworks that can be quickly tailored
o includes process, templates, work products, tools, metrics, reporting and
governance.
o Worksoft testing platform enablement services
o Professional education and certifications
o Outsourcing and Test Factories
o Onsite, near-shore and offshore

15. www.worksoft.com 15
Results>Process Area

16. www.worksoft.com 16
Results>Specific Practices (1 of 17)
2.1 Test Policy and Strategy
Aggregated Strength:
• SP1.1> The test policy document exists and very clear QA Goals
• SP1.2> Great Test Policy
• SP2.3> Project manager confirms that there was a discussion about the test strategy document and has signed off in the document. Strong
evidence.
Aggregated Opportunity:
• SP1.2> more education with the Project Managers would be valuable
• SP1.3> Add a link in the Test Plan to the policy
• SP2.1> Risk section needs more detail, basic risk identified but needs the risk mitigation completed.no risks identified
• SP2.2> The entry/exit criteria should contain precise measures and need to be captured.
• SP3.1> The only metrics captured is production defects, this not an adequate measure for development and can't be used until after the project is
complete. The SDLC document does not reference and KPI's to measured during project
• SP3.2> only production defects are captured only production defects are captured
Recommendations:
• 1. Implement a Formal M&A capability which will help make the entry/exit criteria something that will be enforceable.
• 2. Create mitigation plans if the identified risks in case they occur. Then you will be prepared to take immediate action.

17. www.worksoft.com 17
Top 4 Recommendations

18. www.worksoft.com 18
Assess>Improve>Transform
Assess Improve Transform
Transform
Achieve “world-class" quality and efficiencies by streamlining your IT
organization with the introduction of a formal test competency or COE
o Testing competency improvements
o Testing Center Of Excellence
o Quality Center of Excellence
o Governance frameworks
o Measurement and analysis programs
o Continuous improvement framework
o Test outsourcing and test factories

19. www.worksoft.com 19
The Journey for an Emerging Test Team
Time
Maturity/Adoption
Sample Initiatives
• Establish a Test Policy
communicated by Executive
Leadership
• Document organizational
testing standards
• Educate everyone in IT on the
standards and expectations.
• Implement Test Automation
• Begin measuring Defect
Removal Efficiency rate
Sample Initiatives
• Establish TCOE
• Implement FAGAN inspection
model
• Develop a performance testing
strategy and tool
• Improve non-production
environments
• Service Virtualization
• Data Mgt
Assess>Improve Transform
Initial
Managed
Defined
Measured
Optimization
Sample Optimization Initiatives
• Implement a QA Metric Data Warehouse
• Implement a SDLC Governance
Framework
• Evolve TCOE to QCOE
• Implement CMMI
OPF and OPD
Continuous Improvement
• CMMI CAR & DAR
• Lean SixSigma
• Causal Analysis
Improvement
Continuous

20. www.worksoft.com 20
Evolving from a Testing COE to Quality COE
Causal
Analysis &
Trending
Predictive
Analytics
Advanced
Measurement,
Analysis &
Governance
Process
Engineering
and CMMI
OPF and OPD

21. www.worksoft.com 21
Next Steps
1. Assessment
• Have an independent, unbiased, professional assessment performed
2. Tackle Quick Wins!
• Take action on the items from the “general recommendations” from the process area slides
2. Process Improvement Workshop
• Prioritize process improvement initiatives
• Develop detailed project plans for each initiative
• Develop integration and implementation plans
• Determine how to fully institutionalize and govern the new process.
3. Projects Execution, Monitoring and Measurement
• Identify project you have time or skillset to manage yourself
• Identify the initiatives that you need expert support to drive
• Implement the projects
• Measure ROI
4. Re-Assess or Full Assessment

22. © 2015 Worksoft, Inc.www.worksoft.com
Questions?
Thank you
Mark Summers
msummers@worksoft.com
+1 414-704-7326