Copyright by Krishna Oruganti Test Management


Published on

1 Like
  • Be the first to comment

No Downloads
Total views
On SlideShare
From Embeds
Number of Embeds
Embeds 0
No embeds

No notes for slide
  • Configuration Management: CM controls the builds as well as the environments that are tracked by test management for test execution Change management: Change management affects all parts of software development, but the tracked changes most relevant to the testing effort are defects . Defects are frequently the main communication channel between testing and development. Requirements management is a precursor to the bulk of the testing effort, providing a significant amount of test motivation and validation needs. A project's particular requirements management process can have a huge impact on the test management process.
  • Personal security Systems security Application security or General identity security
  • The wise test manager tends the skills of her team The wise tester grows his skills relentless: skills guard against commoditization
  • Copyright by Krishna Oruganti Test Management

    1. 1. Test Management
    2. 2. Agenda <ul><li>Test Management </li></ul><ul><ul><li>Test Management & Test Project Phases </li></ul></ul><ul><ul><li>Test Project – End to End Testing </li></ul></ul><ul><ul><li>Test Management - Services </li></ul></ul><ul><ul><li>Test Management - Right Balance </li></ul></ul><ul><li>Automated Testing </li></ul><ul><ul><li>Why Automated Testing </li></ul></ul><ul><ul><li>Automation Workflow & tips </li></ul></ul><ul><li>Performance Testing </li></ul><ul><ul><li>Performance Testing Overview </li></ul></ul><ul><ul><li>Performance Testing Process </li></ul></ul><ul><li>Security Testing </li></ul><ul><ul><li>Security Testing Overview </li></ul></ul><ul><ul><li>Security vulnerabilities </li></ul></ul><ul><li>Conclusion </li></ul><ul><li>Question & Answers </li></ul>
    3. 3. Test Management <ul><li>What is Test Management: </li></ul><ul><ul><li>Test management is an umbrella term for managing the Test Projects, Test Processes, Managing Testing financials, Road map etc.. </li></ul></ul><ul><li>Phases in a Test Project </li></ul><ul><ul><li>Test Strategy ( Test Stages, Models etc.. ) </li></ul></ul><ul><ul><li>Test Planning ( Scope, Approach, Sch., RAL, Est., EE Criteria, Res., Env., Etc. ) </li></ul></ul><ul><ul><li>Test Preparation ( Test Design, Priority, Req. Traceability etc.. ) </li></ul></ul><ul><ul><li>Test Execution ( Test Exec sets, Execution, Res. Capture, Defects etc.. ) </li></ul></ul><ul><ul><li>Reporting ( Execution Rep, Defect Rep, etc.. ) </li></ul></ul><ul><ul><li>Closedown & PIR ( Summary Report, Recommendation etc.. ) </li></ul></ul>
    4. 4. Test Project - End to End Testing <ul><ul><li>Classification </li></ul></ul><ul><ul><li>Functional Testing </li></ul></ul><ul><ul><ul><li>V&V of the requirements and the data integrity of the system </li></ul></ul></ul><ul><ul><li>Non Functional Testing </li></ul></ul><ul><ul><ul><li>Performance : To evaluate the scalability of the system in an integrated ENV </li></ul></ul></ul><ul><ul><ul><li>Security : To identify various security vulnerabilities the system is exposed to </li></ul></ul></ul>UAT Performance Integration System Unit Security Support Business Req. Spec Functional Req. Spec Technical Spec Non Functional Req. Spec
    5. 5. Test Management - Services <ul><li>Process Management </li></ul><ul><ul><li>Outsourcing / Remote operations </li></ul></ul><ul><ul><li>Development Models (Waterfall, V Model, RUP, Agile) </li></ul></ul><ul><li>Financial Tracking </li></ul><ul><ul><li>Visible Project Planning and Tracking </li></ul></ul><ul><li>Change Management (Change Control Boards) </li></ul><ul><li>Requirements Management </li></ul><ul><li>Configuration Management </li></ul><ul><ul><li>Build Management and Env Management </li></ul></ul><ul><li>Defect management </li></ul><ul><li>Release Management </li></ul><ul><li>Maintenance and Support </li></ul>
    6. 6. Test Management – Right Balance <ul><li>Processes </li></ul><ul><ul><li>Too much, Too less </li></ul></ul><ul><li>Test Estimation </li></ul><ul><ul><li>Complexity of Application ( Enterprise integrated application or a simple Web App ) </li></ul></ul><ul><ul><li>Technology ( Mainframes, J2EE, BPM etc.. ) </li></ul></ul><ul><li>Efficient Tools </li></ul><ul><ul><li>Investigation ( Expensive Tool is not always the right tool for you.. ) </li></ul></ul><ul><li>Experience / Knowledge </li></ul><ul><ul><li>Right mix and complementing teams </li></ul></ul><ul><li>Team Building </li></ul><ul><ul><li>No fun, No productivity </li></ul></ul><ul><li>Metrics </li></ul><ul><ul><li>Reactive and Iterative improvement </li></ul></ul><ul><li>Roles and Responsibilities </li></ul><ul><ul><li>Am I supposed to do that ? </li></ul></ul>
    7. 7. Automated Testing <ul><li>What is Automated Testing ? </li></ul><ul><li>Why use Automated Testing ? </li></ul><ul><li>Long-term strategic solution to reduce per unit cost in software testing </li></ul><ul><li>Smoke Testing </li></ul><ul><li>Agile Development </li></ul><ul><ul><li>Run more tests more often </li></ul></ul><ul><ul><ul><li>Will increase Test Coverage (Identify defects at the earlier stages ) </li></ul></ul></ul><ul><ul><ul><li>Less risk in not testing end to end time to time </li></ul></ul></ul><ul><ul><ul><li>Improves Business confidence with more testing and less defects in Prod </li></ul></ul></ul><ul><li>Regression Testing </li></ul><ul><ul><li>More focused testing on the new features and enhancements (Manual) </li></ul></ul><ul><ul><li>Reduce time spent on redundant testing </li></ul></ul><ul><li>Run with machines </li></ul><ul><ul><li>Schedule tests with minimum personnel to run them and monitor </li></ul></ul><ul><ul><li>Reduced time and effort for Test Case execution </li></ul></ul><ul><li>Release Testing </li></ul><ul><li>Cross Browser </li></ul><ul><li>Software platform upgrades etc… </li></ul><ul><li>Speed </li></ul><ul><li>Coverage </li></ul><ul><li>Repeatability </li></ul><ul><li>Reliability </li></ul><ul><li>Reusability </li></ul><ul><li>Process Oriented </li></ul><ul><li>Employee Satisfaction </li></ul>Automated Testing
    8. 8. Automation Workflow and Tips <ul><li>High Scoring Test Cases </li></ul><ul><li>Daily Tests (Smoke / Sanity, Regression test, Agile Testing) </li></ul><ul><li>Tests that use multiple data values for the same actions </li></ul><ul><li>Complex and time consuming tests </li></ul><ul><li>Tests requiring a great deal of precision </li></ul><ul><li>Tests involving many simple, repetitive tests </li></ul><ul><li>Testing needed on multiple OS / cross Browsers </li></ul><ul><li>Testing needed in multiple testing phases (SYS, INT, UAT, DRT etc) </li></ul><ul><li>Low Scoring Test Cases </li></ul><ul><li>One-time testing </li></ul><ul><li>“ Test it NOW! “ Test Cases </li></ul><ul><li>Ad hoc testing - based on the knowledge of application </li></ul><ul><li>Interface testing (Technical feasibility) </li></ul><ul><li>Weekly / Monthly Batch program dependency </li></ul>Manual Test Case & Test Data Test Mgmt Tool Framework Automation script Application Under Test QTP / RFT Object Repository
    9. 9. Performance Testing <ul><li>Performance Testing is an umbrella term for various types of testing carried out in checking the system performance </li></ul><ul><li>Load Testing </li></ul><ul><li>Stress Testing </li></ul><ul><li>Volume Testing </li></ul><ul><li>Endurance Testing </li></ul><ul><li>Sociability Testing </li></ul>System Database Hardware Network Configuration ? ? ? ? ?
    10. 10. Performance Testing Process <ul><ul><li>Understand performance requirements </li></ul></ul><ul><ul><li>Analyse the System and identify test objectives </li></ul></ul><ul><ul><li>Define the test strategy </li></ul></ul><ul><ul><li>Identify performance test tools </li></ul></ul><ul><ul><li>Prepare a performance test plan </li></ul></ul><ul><ul><li>Set up the target system and ENV </li></ul></ul><ul><ul><li>Build performance test scripts and test scenario </li></ul></ul><ul><ul><li>Performance test execution and Metrics / data collection </li></ul></ul><ul><ul><li>Performance analysis and reporting </li></ul></ul>Iterative Improvement Analyses Identify Test Fine tune Re- Assess
    11. 11. Security Testing (Application) <ul><li>Security Testing is an umbrella term for various types of testing carried out to identify the security vulnerabilities that the system is exposed to. </li></ul>Intranet Application Server DMZ External Firewall DB Sensitive Data Internet Cloud Internet Internal Firewall Web Server <ul><li>Customer Info </li></ul><ul><li>Employee Info </li></ul><ul><li>Credit Card Info </li></ul><ul><li>SSN or TFN </li></ul>Customer Agent
    12. 12. Security Vulnerabilities <ul><li>Are Security defects given any priority in organisations ? </li></ul><ul><li>Yes, (Defame Organisation, could loose business, Legal implications) </li></ul><ul><li>Mandate should be in place at organisational level </li></ul><ul><li>Tools ( Appscan, QAInspect etc.. ) </li></ul><ul><li>Top 10 Security Vulnerabilities </li></ul><ul><li>Cross-Site Scripting ( Redirecting, Content spoofing etc.. ) </li></ul><ul><li>SQL Injection ( Tautology ‘1=1’, Blind SQL Injection ) </li></ul><ul><li>Denial of Service </li></ul><ul><li>Broken Access Control ( Authentication ) </li></ul><ul><li>Broken Account and Session Mgmt ( Spoofing ) </li></ul><ul><li>Invalidated Input </li></ul><ul><li>Insecure Configuration Mgmt </li></ul><ul><li>Insecure Storage </li></ul><ul><li>Buffer Overflows </li></ul><ul><li>Improper Error Handling </li></ul>
    13. 13. Conclusion <ul><li>Wise Test Management brings in lot of cost savings to the organisation </li></ul><ul><li>Test Tools (Automation, Performance and Security) are available to do a better work </li></ul><ul><li>Testing remains among the most challenging of high tech jobs </li></ul><ul><li>Future, 2010’s decade: not a easy cruise for the Test Professionals with the ever increasing demand for skills </li></ul>
    14. 14. Question and Answers