and Better Software magazine presents...


Published on

  • Be the first to comment

  • Be the first to like this

No Downloads
Total views
On SlideShare
From Embeds
Number of Embeds
Embeds 0
No embeds

No notes for slide and Better Software magazine presents...

  1. 1. and Better Software magazine presents… How to Build a Testing Center of Excellence Sponsored by Cognizant This event aired on July 8, 2008.
  2. 2. Testing centers of Excellence Building © 2007, Cognizant Technology Solutions. Confidential TCOE
  3. 3. © 2007, Cognizant Technology Solutions. Confidential Agenda Testing CoE  Voice of Customers  TCoE Models  Scope  Activities  Critical Success Factors  Key Considerations TCoE Ecosystem Q&A
  4. 4. © 2006, Cognizant Technology Solutions. Confidential Testing is time-consuming No testing value-adds Increasing Business User Demand, Diversified Technologies and locations with different approaches Lack of standards, tools, metrics, templates for quality assessment, comparison across projects Testing in one group is high Inconsistency in testing approach BAs perform the role of QA Testing is expensive © 2007, Cognizant Technology Solutions. Confidential
  5. 5. Testing Process CoE • Definition | Development | Maintenance of test processes, standards & templates • Facilitation of Test Management Community • Metrics Reporting & Management • Test Process Training • Continuous Process Improvement (CPI) • Provision | Administration | Support of Test Infrastructure and Test Tools • Provision of NFT Services & Test Automation Services • Technical Test Consultancy • Provision of Functional, UAT & liaison services • Flexible resource pool creation • Provision of specialized testing services Testing Tools/ Infrastructure CoE NFT & Automation CoE Shared Testing Team Decentralized centralized © 2007, Cognizant Technology Solutions. Confidential
  6. 6. • Process definitions & Roll-out • Process facilitation & maintenance • Process Compliance Audit • Facilitation of Test management community • Continuous process improvement Services • Assessment of existing process assets • Define/Refine and standardize processes • Institute metrics framework • Usage guidelines and communication plan • Establish centralized process framework PreSetup Activities • Organizational strategy alignment • Effective Communication & Training • Effective Piloting and Evaluation • Process compliance review mechanism Critical Success Factors • Representation of key stakeholders from various groups • Seed change agents to facilitate propagation • Closed loop feedback mechanism Key Considerations Testing Process CoE • Communicating, Piloting & Training • Process audits • Change management • Industry benchmarking PostSetup © 2007, Cognizant Technology Solutions. Confidential
  7. 7. • Tool evaluation • Testing tools technical support • Test tool license management & administration • Tool process standardization • Tool optimization Services • Tools inventory • Tool evaluation • Capacity planning & Platform optimization • ROI Analysis • Tool licensing & procurement policy PreSetup Activities • Clear understanding of opportunities for operational efficiencies • Demand forecasting mechanism • Tool/Infrastructure utilization & Optimization • Service Level Agreements Critical Success Factors • Tool standardization for testing activities such as requirement management, defect management etc. • Leverage vendor organization’s tool partnership • Tool set integration • Alternative tool pricing model Key Considerations Infrastructure & Tools CoE • Maintain tools inventory • Tool administration, upgrades, license management & tools training • Monitoring & maintenance • Incident management workflow PostSetup © 2007, Cognizant Technology Solutions. Confidential
  8. 8. • Review/Refine & publish scripting standards and guidelines • Resource sharing & allocation models • ROI Analysis • Team identification PreSetup Activities • Uniform Automation/Performance Testing guidelines & scripting standards • Reusable Automation/Performance testing framework & work load models • Defined Non Functional/automation testing requirements Critical Success Factors • Scope for Regression & Test Automation based on scheduled releases • Utilize Tools CoE for standards & guidelines definition • Utilize Process CoE for propagation of best practices Key Considerations NFT & Automation CoE • Feasibility analysis & Proof of concepts • Construct reusable frameworks • Technical Training/Support • Technical test consulting PostSetup Services • Performance testing • Security testing • Usability testing • Workload Modeling NFT • Test Automation • Framework design and Implementation Automation Value-Adds • Technical consultancy • Feasibility analysis © 2007, Cognizant Technology Solutions. Confidential
  9. 9. • Establish test management office • Scope analysis & demand forecasting • Engagement & Sourcing model • Institute training program • KPI definition PreSetup Activities • Identification of core vs. non-core business functions. • Strong Governance Model • KPI identifications • Management by Metrics Critical Success Factors • Tracking mechanism to measure achievements over period of time against established goals • Cross-functional training • Effective collaboration of Business Analysts and QA Key Considerations Shared Testing Team • Resource allocation • Skill assessment and training • Test program management • Construct knowledge assets PostSetup Services • Functional testing • System testing/SIT • Acceptance testing Basic Specialized Support & Consultancy • Defect Management • Test Life Cycle modeling • Test Strategy conceptualization • Compliance testing • DW testing • Agile testing • SOA testing • Product/Package testing © 2007, Cognizant Technology Solutions. Confidential
  10. 10. © 2007, Cognizant Technology Solutions. Confidential Piloting for Success Shared Testing Tools Defined basic processes Standardized tool management Defined scope and schedule Tool licensing & procurement policy System Testing System Integration Testing UAT support 3-6 months 4-8 weeks High Medium Data Generation & Sanitization Reporting utilities, portlets Knowledge Repository Dash-boards Increased Test Coverage Traceability Established Quality gates Effective defect management Objective Go/No-Go decisions Improved productivity & test effectiveness Reduced defect leakage Cycle time reduction Quality Gains New project OR AVM Project Existing projects Pilot Accelerators Project types BenefitRealization Test Management Management by metrics Short-term Long Term Pre-requisites Scope Pilot Length Business Disruption
  11. 11. © 2007, Cognizant Technology Solutions. Confidential Piloting for Success Automation Non-functional testing Defined automation scripting standards &guidelines Defined NFT requirements Tools Inventory Defined NFT scripting standards & guidelines Tool Evaluation Feasibility analysis Tool licensing & procurement policy Feasibility Analysis ROI Analysis Performance Proof of Concepts Security (Application Vulnerability Assessment & Reusable framework Usability Proof of concepts Minimum 4 releases per year 6-8 weeks Low Medium Automation framework Tool driven testing Skilled resources Leveraging existing labs Skilled resources Consistency Identifying bottlenecks & vulnerabilities Improved Coverage Reusability Enhanced user experience Reduced maintenance Customer retention Cost Savings Release-based New projects AND Web-based Short-term Long Term Pre-requisites Scope Pilot Length Business Disruption Pilot Accelerators Project types BenefitRealization
  12. 12. Test Planning & Estimation Test Design & Build Test Execution & Management Test Reporting Test Metrics Management Test Program Management Testing Center of Excellence Infrastructure & Tools COE  Tool Maintenance & Support  Test Automation  Tool Implementation  Tool Provision Process COE  Process Maintenance  Process Definition  Metrics Program  Test Process Training  Continuous Process Improvement  Best Practice implementation > > T e s t i n g C e n t e r O f E x c e l l e n c e Service Spectrum System Testing System Integration testing Regression Testing Test Automation UAT Core – Flexible resourcing Standard process & Frameworks Common Tools, Infrastructure & Automation Solution Accelerations/ Best practices Governance structure > TCoE Ecosystem © 2007, Cognizant Technology Solutions. Confidential
  13. 13. Good Luck on your TCOE Journey © 2007, Cognizant Technology Solutions. Confidential
  14. 14. Have a question for the speaker? Ask now. Q & A