Your SlideShare is downloading. ×
0
Olenick & Associates Software Test Management Using IBM Rational Tools 29 SEPTEMBER 2005
<ul><li>Agenda </li></ul><ul><li>Introduction </li></ul><ul><li>History with Rational </li></ul><ul><li>Approach for Softw...
<ul><li>Set the Context: </li></ul><ul><li>Our Software Testing Methodology is called “Deployment Readiness” </li></ul><ul...
<ul><li>About Us </li></ul><ul><ul><li>Software Testing Specialists </li></ul></ul><ul><ul><ul><li>Functional </li></ul></...
<ul><li>Our History </li></ul><ul><ul><li>Founded in 1998 </li></ul></ul><ul><ul><li>Current staff of 75 Full Time Employe...
<ul><li>Our History with Rational </li></ul><ul><li>Began with SQA in 1997 </li></ul><ul><ul><li>Robot & SQA Manager used ...
<ul><li>Our History with Rational (cont.) </li></ul><ul><li>2001 3rd Client Clear Quest, Test Manager, Load Test & Robot <...
<ul><li>Controlling Software Quality </li></ul><ul><li>Top 5 reasons Software Quality takes a hit… </li></ul><ul><li>Poor ...
<ul><li>Controlling Software Quality </li></ul><ul><li>Manifested Results… </li></ul><ul><li>Testing begins late delaying ...
<ul><li>Controlling Software Quality </li></ul><ul><li>Problems only increase in maintenance mode… </li></ul><ul><li>Defec...
<ul><li>The  Tenets  of our Approach are the fundamentals of our methodology for Software Testing and Project Management… ...
<ul><li>Prepare a  Test Approach Document & Quality Plan  and obtain approval during test planning.  </li></ul><ul><li>Def...
<ul><li>Have  Business Users  play the key role in the test condition discovery process.  </li></ul><ul><li>Use the  Test ...
<ul><li>Automate the  Tracking  of Issues, Defects and other items requiring closure. </li></ul><ul><li>Employ  Workflow  ...
<ul><li>Architect  the test  Processes  and  Environments  to exist for the life of the application.  </li></ul><ul><li>De...
<ul><li>Functional Readiness  </li></ul><ul><li>Performance Readiness </li></ul><ul><li>Deployment Readiness Reporting </l...
Functional Test Readiness A methodology to insure that all testing assets created during the development of a software app...
Functional Test Readiness A methodology to insure that all testing assets created during the development of a software app...
Functional Test Readiness A methodology to insure that all testing assets created during the development of a software app...
Functional Test Readiness A methodology to insure that all testing assets created during the development of a software app...
Deployment Readiness Reporting A method of Project Quality Reporting that provides the stakeholders with fully  objective ...
Deployment Readiness Reporting A method of Project Quality Reporting that provides the stakeholders with fully  objective ...
Deployment Readiness Reporting A method of Project Quality Reporting that provides the stakeholders with fully  objective ...
Deployment Readiness Reporting A method of Project Quality Reporting that provides the stakeholders with fully  objective ...
Performance Readiness A repeatable framework to support the identification and resolution of application risks relating to...
Performance Readiness A repeatable framework to support the identification and resolution of application risks relating to...
Performance Readiness A repeatable framework to support the identification and resolution of application risks relating to...
Performance Readiness A repeatable framework to support the identification and resolution of application risks relating to...
 
 
 
Scripts Conditions Use Cases Business Functions Defects Software Component Data Model Test Assets  &  Test Tracking Data I...
Initial  Development Maintenance YR1 YR2 YR3 YR4 YR5 Life of a Software Application Deploy YR0 Application Changes Applica...
Initial  Development Maintenance YR1 YR2 YR3 YR4 YR5 Life of a Software Application Deploy YR0 Other Integrated Applicatio...
Initial  Development Maintenance YR1 YR2 YR3 YR4 YR5 Life of a Software Application Deploy YR0 V1R1 V1R2 V1R3 V1R4 V2R0 V2...
Initial  Development Maintenance YR1 YR2 YR3 YR4 YR5 Life of a Software Application Deploy YR0 Application Changes App A T...
Initial  Development Maintenance YR1 YR2 YR3 YR4 YR5 Life of a Software Application Deploy YR0 Other Integrated Applicatio...
Initial  Development Maintenance YR1 YR2 YR3 YR4 YR5 Life of a Software Application Deploy YR0 App A Test Assets App B Tes...
Initial  Development Maintenance YR1 YR2 YR3 YR4 YR5 Life of a Software Application Deploy YR0 Application Changes Applica...
Initial  Development Maintenance YR1 YR2 YR3 YR4 YR5 Life of a Software Application Deploy YR0 Tracking Data Tracking Data...
YR1 YR2 YR3 YR4 YR5 Life of a Software Application Deploy YR0 Consolidated Test Tracking Database Project Reports Analysis...
<ul><li>Project Reports </li></ul><ul><li>Defects </li></ul><ul><ul><li>By Status, Distribution, etc. </li></ul></ul><ul><...
Deployment Readiness Data Model Implemented with IBM Rational Tools Functional Requirements Test Conditions Test Scripts D...
IBM Rational Product Links RequistePro Rose ClearCase Functional Tester Performance Tester ClearQuest Software Test Manage...
Olenick & Associates 205 West  Wacker Drive Suite 2000 Chicago, IL 312-332-0096 www. olenick .com Olenick & Associates www...
Upcoming SlideShare
Loading in...5
×

Olenick

227

Published on

0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total Views
227
On Slideshare
0
From Embeds
0
Number of Embeds
0
Actions
Shares
0
Downloads
2
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

Transcript of "Olenick "

  1. 1. Olenick & Associates Software Test Management Using IBM Rational Tools 29 SEPTEMBER 2005
  2. 2. <ul><li>Agenda </li></ul><ul><li>Introduction </li></ul><ul><li>History with Rational </li></ul><ul><li>Approach for Software Quality </li></ul><ul><li>Deployment Readiness </li></ul><ul><li>Managing Test Assets </li></ul><ul><li>Leveraging Test Tracking Data </li></ul><ul><li>Rational Suite Demo </li></ul><ul><li>What’s Next from Rational </li></ul>Software Test Management using IBM Rational Tools
  3. 3. <ul><li>Set the Context: </li></ul><ul><li>Our Software Testing Methodology is called “Deployment Readiness” </li></ul><ul><ul><li>Addresses traditional System, Integration, Performance & UAT </li></ul></ul><ul><ul><li>Based of our “Tenets” for achieving software quality </li></ul></ul><ul><ul><li>Will support Agile and Test Driven Development approaches but does not overlap </li></ul></ul><ul><li>Focus on managing Test Assets and Test Tracking Data </li></ul><ul><li>Using Rational tools as the implementation </li></ul><ul><li>Demo Requisite Pro, Test Manager & Clear Quest </li></ul>Software Test Management using IBM Rational Tools
  4. 4. <ul><li>About Us </li></ul><ul><ul><li>Software Testing Specialists </li></ul></ul><ul><ul><ul><li>Functional </li></ul></ul></ul><ul><ul><ul><li>Performance </li></ul></ul></ul><ul><ul><ul><li>Automation </li></ul></ul></ul><ul><ul><li>Business Requirements Specifications </li></ul></ul><ul><ul><li>Project Management </li></ul></ul><ul><ul><li>Infrastructure Tuning </li></ul></ul><ul><ul><li>Deployment Readiness </li></ul></ul>Software Test Management using IBM Rational Tools
  5. 5. <ul><li>Our History </li></ul><ul><ul><li>Founded in 1998 </li></ul></ul><ul><ul><li>Current staff of 75 Full Time Employees </li></ul></ul><ul><ul><li>Home Office & Test Lab in Chicago </li></ul></ul><ul><ul><li>Houston Office in 2003 </li></ul></ul><ul><ul><li>Verticals </li></ul></ul><ul><ul><ul><li>Trading, Utilities, Banking, Manufacturing </li></ul></ul></ul><ul><ul><li>Currently 22 Active Clients </li></ul></ul><ul><ul><ul><li>CME, CBOT, Exelon, Dell, USG, Northern Trust </li></ul></ul></ul>Software Test Management using IBM Rational Tools
  6. 6. <ul><li>Our History with Rational </li></ul><ul><li>Began with SQA in 1997 </li></ul><ul><ul><li>Robot & SQA Manager used for Peoplesoft project </li></ul></ul><ul><ul><li>Workflow feature of SQA Manager to support Defects, Code Migration & Issues </li></ul></ul><ul><ul><li>Presented at QAI Int’l Conference ’98 </li></ul></ul><ul><li>1999 SQA Manager for 170 staffed project </li></ul><ul><ul><li>Defects, Requirements, Change Requests and Issues </li></ul></ul><ul><ul><li>Presented at PSQT Conference ’99 </li></ul></ul><ul><li>2000 2rd Client Clear Quest & Robot </li></ul><ul><ul><li>Use across all IT +20 projects for Requirements, Issues, Test Conditions, Scripts & Change Requests </li></ul></ul><ul><ul><li>Feed to Management Dashboard </li></ul></ul><ul><ul><li>Presented at ASM Conference ‘00 </li></ul></ul>Software Test Management using IBM Rational Tools
  7. 7. <ul><li>Our History with Rational (cont.) </li></ul><ul><li>2001 3rd Client Clear Quest, Test Manager, Load Test & Robot </li></ul><ul><ul><li>Use across all IT ~ 6 projects for Requirements, Issues, Test Conditions, Scripts, Defects & Change Requests </li></ul></ul><ul><ul><li>Clear Quest prototyped for Help Desk usage </li></ul></ul><ul><li>2002 4th Client Clear Quest & Test Mgr & Robot </li></ul><ul><ul><li>Use across all IT ~ 3 projects for Issues, Defects, Change Requests & Project Schedule Tracking </li></ul></ul><ul><ul><li>Feed to Management Dashboard </li></ul></ul><ul><li>2002 5th Client Clear Quest </li></ul><ul><ul><li>Use across all IT ~ 8 projects for Issues, Defects, Change Requests </li></ul></ul><ul><ul><li>Fully integrated into revised SDLC </li></ul></ul>Software Test Management using IBM Rational Tools
  8. 8. <ul><li>Controlling Software Quality </li></ul><ul><li>Top 5 reasons Software Quality takes a hit… </li></ul><ul><li>Poor planning & design for testing activities. </li></ul><ul><li>Low skill level of testing resources (and developers). </li></ul><ul><li>Uncontrolled test environments, test data & test scripts. </li></ul><ul><li>Loose coordination among developers & testers. </li></ul><ul><li>Ineffective quality reporting to management. </li></ul>Software Test Management using IBM Rational Tools
  9. 9. <ul><li>Controlling Software Quality </li></ul><ul><li>Manifested Results… </li></ul><ul><li>Testing begins late delaying the project. </li></ul><ul><li>Tests take longer than necessary. </li></ul><ul><li>Tests are incomplete & not reliable. </li></ul><ul><li>Verification of defect fixes are incomplete. </li></ul><ul><li>State of quality is not accurately reported. </li></ul>Software Test Management using IBM Rational Tools
  10. 10. <ul><li>Controlling Software Quality </li></ul><ul><li>Problems only increase in maintenance mode… </li></ul><ul><li>Defects outside of affected changed modules go undetected – poor regression testing. </li></ul><ul><li>Test data grows obsolete. </li></ul><ul><li>New functionality not integrated into scripts. </li></ul><ul><li>Special focus not given to components that previously have been problematic. </li></ul><ul><li>5. Coverage of tests are not tracked. </li></ul>Software Test Management using IBM Rational Tools
  11. 11. <ul><li>The Tenets of our Approach are the fundamentals of our methodology for Software Testing and Project Management… </li></ul>Software Test Management using IBM Rational Tools
  12. 12. <ul><li>Prepare a Test Approach Document & Quality Plan and obtain approval during test planning. </li></ul><ul><li>Define all necessary Test Environments and ensure readiness prior to test execution. </li></ul><ul><li>Document the Configuration Management process and assign accountability. </li></ul><ul><li>Separate Functional tests from Performance and Operational tests. </li></ul><ul><li>Establish framework for Continually Improving the testing process. </li></ul>Software Test Management using IBM Rational Tools
  13. 13. <ul><li>Have Business Users play the key role in the test condition discovery process. </li></ul><ul><li>Use the Test Script Development and Review process to identify gaps in specifications. </li></ul><ul><li>Perform formal Test Script Reviews that include developers and business users. </li></ul><ul><li>Use the Functional Requirements as the foundation for managing test completion. </li></ul><ul><li>Define Test Goals and use them for sign off criteria. </li></ul>Software Test Management using IBM Rational Tools
  14. 14. <ul><li>Automate the Tracking of Issues, Defects and other items requiring closure. </li></ul><ul><li>Employ Workflow software for tracking construction and testing activities. </li></ul><ul><li>Establish a reporting approach that allows &quot;rollup&quot; to a Metrics Dashboard for senior management. </li></ul>Software Test Management using IBM Rational Tools
  15. 15. <ul><li>Architect the test Processes and Environments to exist for the life of the application. </li></ul><ul><li>Develop a framework for Regression Testing and employ automated testing software when clear ROI. </li></ul><ul><li>Rigorously Organize Test Data and apply strict version control. </li></ul>Software Test Management using IBM Rational Tools
  16. 16. <ul><li>Functional Readiness </li></ul><ul><li>Performance Readiness </li></ul><ul><li>Deployment Readiness Reporting </li></ul>Software Test Management using IBM Rational Tools
  17. 17. Functional Test Readiness A methodology to insure that all testing assets created during the development of a software application can be fully leveraged for subsequent post deployment release testing . Software Test Management using IBM Rational Tools
  18. 18. Functional Test Readiness A methodology to insure that all testing assets created during the development of a software application can be fully leveraged for subsequent post deployment release testing . Test assets include test conditions, test scripts, test data, test result tracking and the infrastructure to support all assets. The goal is to reduce the timeframe needed to re-execute tests for subsequent releases of the application and maintain the completeness of the testing operation. Software Test Management using IBM Rational Tools
  19. 19. Functional Test Readiness A methodology to insure that all testing assets created during the development of a software application can be fully leveraged for subsequent post deployment release testing . Test assets include test conditions, test scripts, test data, test result tracking and the infrastructure to support all assets. The goal is to reduce the timeframe needed to re-execute tests for subsequent releases of the application and maintain the completeness of the testing operation. Controls and processes are clearly defined to assure a fully functional regression test enterprise remains in place throughout the life of the application system. Methods for change impact analysis, test coverage reporting and deployment readiness reporting remain effective by instituting processes to insure currency with the changing functionality of the application system. Software Test Management using IBM Rational Tools
  20. 20. Functional Test Readiness A methodology to insure that all testing assets created during the development of a software application can be fully leveraged for subsequent post deployment release testing . Test assets include test conditions, test scripts, test data, test result tracking and the infrastructure to support all assets. The goal is to reduce the timeframe needed to re-execute tests for subsequent releases of the application and maintain the completeness of the testing operation. Controls and processes are clearly defined to assure a fully functional regression test enterprise remains in place throughout the life of the application system. Methods for change impact analysis, test coverage reporting and deployment readiness reporting remain effective by instituting processes to insure currency with the changing functionality of the application system. The result is higher quality deployments that eliminate unforeseen defects in production. Software Test Management using IBM Rational Tools
  21. 21. Deployment Readiness Reporting A method of Project Quality Reporting that provides the stakeholders with fully objective data for risk assessment relating to application software deployments. Software Test Management using IBM Rational Tools
  22. 22. Deployment Readiness Reporting A method of Project Quality Reporting that provides the stakeholders with fully objective data for risk assessment relating to application software deployments. This approach translates captured project defect, change control and issue information into metric form . The metrics are organized by application functionality, technology and software component to allow the observer to isolate behavior and help identify where quality and stability problems may lie . Software Test Management using IBM Rational Tools
  23. 23. Deployment Readiness Reporting A method of Project Quality Reporting that provides the stakeholders with fully objective data for risk assessment relating to application software deployments. This approach translates captured project defect, change control and issue information into metric form . The metrics are organized by application functionality, technology and software component to allow the observer to isolate behavior and help identify where quality and stability problems may lie . Ultimately the stakeholders can more clearly assess the presence of deployment risks and enables them to make the best informed judgment for deployment strategies . Software Test Management using IBM Rational Tools
  24. 24. Deployment Readiness Reporting A method of Project Quality Reporting that provides the stakeholders with fully objective data for risk assessment relating to application software deployments. This approach translates captured project defect, change control and issue information into metric form . The metrics are organized by application functionality, technology and software component to allow the observer to isolate behavior and help identify where quality and stability problems may lie . Ultimately the stakeholders can more clearly assess the presence of deployment risks and enables them to make the best informed judgment for deployment strategies . This approach moves project teams to a method of rigor in readiness reporting that avoids the situation where the stakeholder is making deployment decisions based on unclear metrics or anecdotal information. Software Test Management using IBM Rational Tools
  25. 25. Performance Readiness A repeatable framework to support the identification and resolution of application risks relating to performance. Performance risks are identified using a methodical approach of examination of the features, architecture, hardware and environmental software of an application in the context of likely usage tendencies and defined service level agreements (SLA). Software Test Management using IBM Rational Tools
  26. 26. Performance Readiness A repeatable framework to support the identification and resolution of application risks relating to performance. Performance risks are identified using a methodical approach of examination of the features, architecture, hardware and environmental software of an application in the context of likely usage tendencies and defined service level agreements (SLA). All areas of performance are scrutinized to identify the highest potential risks to be addressed early in the development lifecycle through prototypes, proof of concepts and manual extrapolation. A complete inventory of performance risks are captured and identified for vetting during the testing phase of the development cycle. Software Test Management using IBM Rational Tools
  27. 27. Performance Readiness A repeatable framework to support the identification and resolution of application risks relating to performance. Performance risks are identified using a methodical approach of examination of the features, architecture, hardware and environmental software of an application in the context of likely usage tendencies and defined service level agreements (SLA). All areas of performance are scrutinized to identify the highest potential risks to be addressed early in the development lifecycle through prototypes, proof of concepts and manual extrapolation. A complete inventory of performance risks are captured and identified for vetting during the testing phase of the development cycle. This approach works to insure all risks are brought to closure within the typical aggressive timeframe of the development effort. A post deployment strategy is also developed to insure the proactive monitoring and assessment of the application for compliance to performance requirements. Software Test Management using IBM Rational Tools
  28. 28. Performance Readiness A repeatable framework to support the identification and resolution of application risks relating to performance. Performance risks are identified using a methodical approach of examination of the features, architecture, hardware and environmental software of an application in the context of likely usage tendencies and defined service level agreements (SLA). All areas of performance are scrutinized to identify the highest potential risks to be addressed early in the development lifecycle through prototypes, proof of concepts and manual extrapolation. A complete inventory of performance risks are captured and identified for vetting during the testing phase of the development cycle. This approach works to insure all risks are brought to closure within the typical aggressive timeframe of the development effort. A post deployment strategy is also developed to insure the proactive monitoring and assessment of the application for compliance to performance requirements. The strategy includes the identification of areas where exposure may still be deemed to exist and the identification of countermeasures that can be employed in the event of performance problems. Software Test Management using IBM Rational Tools
  29. 32. Scripts Conditions Use Cases Business Functions Defects Software Component Data Model Test Assets & Test Tracking Data Issues Change Requests Test Executions Software Test Management using IBM Rational Tools
  30. 33. Initial Development Maintenance YR1 YR2 YR3 YR4 YR5 Life of a Software Application Deploy YR0 Application Changes Application A Software Test Management using IBM Rational Tools
  31. 34. Initial Development Maintenance YR1 YR2 YR3 YR4 YR5 Life of a Software Application Deploy YR0 Other Integrated Applications Requiring Changes App B App C App D Application A Software Test Management using IBM Rational Tools
  32. 35. Initial Development Maintenance YR1 YR2 YR3 YR4 YR5 Life of a Software Application Deploy YR0 V1R1 V1R2 V1R3 V1R4 V2R0 V2R1 Application B Application C Application D Application A Software Test Management using IBM Rational Tools
  33. 36. Initial Development Maintenance YR1 YR2 YR3 YR4 YR5 Life of a Software Application Deploy YR0 Application Changes App A Test Assets Test Asset Revisions & Execution Software Test Management using IBM Rational Tools
  34. 37. Initial Development Maintenance YR1 YR2 YR3 YR4 YR5 Life of a Software Application Deploy YR0 Other Integrated Applications Requiring Changes App A Test Assets App B Test Assets App C Test Assets App D Test Assets Software Test Management using IBM Rational Tools
  35. 38. Initial Development Maintenance YR1 YR2 YR3 YR4 YR5 Life of a Software Application Deploy YR0 App A Test Assets App B Test Assets App C Test Assets App D Test Assets V1R1 V1R2 V1R3 V1R4 V2R0 V2R1 Software Test Management using IBM Rational Tools
  36. 39. Initial Development Maintenance YR1 YR2 YR3 YR4 YR5 Life of a Software Application Deploy YR0 Application Changes Application A Test Assets Test Asset Revisions & Execution Test Tracking Data Software Test Management using IBM Rational Tools
  37. 40. Initial Development Maintenance YR1 YR2 YR3 YR4 YR5 Life of a Software Application Deploy YR0 Tracking Data Tracking Data Tracking Data Tracking Data Software Test Management using IBM Rational Tools
  38. 41. YR1 YR2 YR3 YR4 YR5 Life of a Software Application Deploy YR0 Consolidated Test Tracking Database Project Reports Analysis Reports Software Test Management using IBM Rational Tools
  39. 42. <ul><li>Project Reports </li></ul><ul><li>Defects </li></ul><ul><ul><li>By Status, Distribution, etc. </li></ul></ul><ul><li>Coverage </li></ul><ul><li>Execution History </li></ul><ul><li>Analysis Reports </li></ul><ul><li>Impact Analysis </li></ul><ul><li>Trend Analysis </li></ul><ul><li>Cycle Times </li></ul><ul><li>“ Drill Down” Capability </li></ul>Software Test Management using IBM Rational Tools
  40. 43. Deployment Readiness Data Model Implemented with IBM Rational Tools Functional Requirements Test Conditions Test Scripts Defects Issues Change Requests Binary Components RequisitePro Manage Requirements TestManager Manage Test Req’s and Results Functional Tester Performance Tester Manual Tester Develop, Execute Test Scripts ClearQuest Manage Defects, Change Requests and Issues. A workflow is enforced. Rose or XDE ClearCase Manage Binary Components Software Test Management using IBM Rational Tools
  41. 44. IBM Rational Product Links RequistePro Rose ClearCase Functional Tester Performance Tester ClearQuest Software Test Management using IBM Rational Tools
  42. 45. Olenick & Associates 205 West Wacker Drive Suite 2000 Chicago, IL 312-332-0096 www. olenick .com Olenick & Associates www. olenick .com
  1. A particular slide catching your eye?

    Clipping is a handy way to collect important slides you want to go back to later.

×