How can we prove test coverage adequacy ? Have we considered all test scenarios for all requirements/features? 100% Code coverage is insufficient Are new features & platforms covered in testing? Are updates to old test cases accurately done? Why is this tested so late or what else broken? Implies lack of visibility in design, execution or tracking When was it tested last? How to do more with same? Worries of VP Engg and QA Manager

How can we prove test coverage adequacy ?

Have we considered all test scenarios for all requirements/features?

100% Code coverage is insufficient

Are new features & platforms covered in testing?

Are updates to old test cases accurately done?

Why is this tested so late or what else broken?

Implies lack of visibility in design, execution or tracking

When was it tested last?

How to do more with same?

Test Assurance Vs Test Management Meet adequate, measurable and agreed upon test coverage criteria. “ Are we doing everything that needs to be done ?” Vs “ Are we doing all that is planned to be done ?” Quality of information: Google Vs Yahoo. No new features but better analysis Test Management tools too process heavy and rigid; hence not widely used Deficiency in test management tools compensated by extra staff, more load & longer test cycle Test Visibility Diagram Possible tests Nuevosoft Test Manager Other tools (free and paid)

Test Assurance Vs Test Management

Meet adequate, measurable and agreed upon test coverage criteria.

“ Are we doing everything that needs to be done ?” Vs

“ Are we doing all that is planned to be done ?”

Quality of information: Google Vs Yahoo. No new features but better analysis

Test Management tools too process heavy and rigid; hence not widely used

Deficiency in test management tools compensated by extra staff, more load & longer test cycle

Test Visibility Diagram

Born from experience of many years and deep knowledge of QA dynamics Patents pending in multiple countries Imposes no changes on existing methods of testing but complements them Manages complete scope of a Test Plan Product modules, versions, features, test cases and platform configurations Provides collaborative workflow for Test Execution Test assignments, automatic notifications, test data interchange with Excel, integrates with Bugzilla Generates insightful and interactive analytics and reports Bug trends, aging and breakdown, feature coverage and test coverage Not just manages but improves test case quality Nuevosoft Test Manager

Born from experience of many years and deep knowledge of QA dynamics

Patents pending in multiple countries

Imposes no changes on existing methods of testing but complements them

Manages complete scope of a Test Plan

Product modules, versions, features, test cases and platform configurations

Provides collaborative workflow for Test Execution

Test assignments, automatic notifications, test data interchange with Excel, integrates with Bugzilla

Generates insightful and interactive analytics and reports

Bug trends, aging and breakdown, feature coverage and test coverage

Not just manages but improves test case quality

Key Features Insightful and interactive dashboards iPhone and other mobiles Collaboration across geographically and organizationally distributed product development and test teams Highly scalable – capable of managing thousands of test cases and hundreds of concurrent testers Zero overhead on Testers! No changes in test methodologies Testers receive test cases in Excel and capture their results in Excel Easy maintenance of testcases in case of feature updates More than a dozen analytical and status reports Fully web-based. No desktop software required.

Insightful and interactive dashboards

iPhone and other mobiles

Collaboration across geographically and organizationally distributed product development and test teams

Highly scalable – capable of managing thousands of test cases and hundreds of concurrent testers

Zero overhead on Testers!

No changes in test methodologies

Testers receive test cases in Excel and capture their results in Excel

Easy maintenance of testcases in case of feature updates

More than a dozen analytical and status reports

Fully web-based. No desktop software required.

Bug Trend Built-in and automated integration with Bugzilla (Jira planned)

Bug Breakdown (Modules & Severity)‏

Bug Aging (Modules, Severity & Time)‏

Feature Coverage Which product features have test cases?

Test Coverage How many test cases have been planned? How many test cases have been executed? How many test cases pass? … for each module, version, build and test platform configuration! How else would you know when to ship a product?

Comprehensive Product Representation

Model Complex Test Environments

Intuitive Test Case Development Avoid tedious and slow web forms! Import testcases or link requirements/features to testcases using spreadsheet Establish full & manageable traceability Group testcases by features; identify test gaps quickly

Avoid tedious and slow web forms!

Import testcases or link requirements/features to testcases using spreadsheet

Establish full & manageable traceability

Group testcases by features; identify test gaps quickly

Manage Hundreds of Test runs! Simultaneously & Collaboratively

Automate Status Reports & Test Analysis

Database Object Manager Business Logic (Web services) Presentation Browser Automated Tests Software Architecture

Assetlink Case Study 50+ developers 10+ QA engineers 490 features 5500 testcases; automated logging of results to the Nuevosoft system Multi platform - Servers, browsers etc. Latest build given to QA with 0 regressions and 0 “BrokenNewFeatures” No test status meetings for any releases Test report consolidation time reduced from 2 hours per day to zero Improved thoroughness of test design, review, maintenance, execution, analysis, audit and reporting Improved testing discipline QA Manager role evolved to monitoring and process improvement Customer testing audits became simple

50+ developers

10+ QA engineers

490 features

5500 testcases; automated logging of results to the Nuevosoft system

Multi platform - Servers, browsers etc.

Latest build given to QA with 0 regressions and 0 “BrokenNewFeatures”

No test status meetings for any releases

Test report consolidation time reduced from 2 hours per day to zero

Improved thoroughness of test design, review, maintenance, execution, analysis, audit and reporting

Improved testing discipline

QA Manager role evolved to monitoring and process improvement

Customer testing audits became simple

Differentiator Solution designed for realities of current QA and for real world Major design goals: Ease of implementation and use - Zero overhead Lightweight No learning curve Improvement in quality of product ( not just tracking of tests ) Requires no extensive training and no dedicated person to manage data

Solution designed for realities of current QA and for real world

Major design goals:

Ease of implementation and use - Zero overhead

Lightweight

No learning curve

Improvement in quality of product ( not just tracking of tests )

Requires no extensive training and no dedicated person to manage data

Summary of Benefits Dramatic quality improvement without redoing any work or changing any methods of testing Streamlines, unifies and automates the test management process across all systems, software and services, resulting in efficiencies that accelerate time-to-market Eliminates friction from transaction with customers Eliminates test status meetings and data consolidation Promotes collaboration between geographically and organizationally distributed teams of Product Managers, Quality Assurance, R&D and outsourced service vendors, resulting in improved quality, transparency, reduced (or zero) defects Improves stakeholder’s insight, confidence and appreciation of the test management process as well as overall product quality

Dramatic quality improvement without redoing any work or changing any methods of testing

Streamlines, unifies and automates the test management process across all systems, software and services, resulting in efficiencies that accelerate time-to-market

Eliminates friction from transaction with customers

Eliminates test status meetings and data consolidation

Promotes collaboration between geographically and organizationally distributed teams of Product Managers, Quality Assurance, R&D and outsourced service vendors, resulting in improved quality, transparency, reduced (or zero) defects

Improves stakeholder’s insight, confidence and appreciation of the test management process as well as overall product quality

How do I get it? Sign up for a 30 day free trial SaaS Model – no hardware, software or administration Multi-tenant architecture – each client can have a custom branded interface Your team can be up and running in less than one day!

Sign up for a 30 day free trial

SaaS Model – no hardware, software or administration

Multi-tenant architecture – each client can have a custom branded interface

Your team can be up and running in less than one day!

Application Areas Computers, Networking and Telecommunication - Software, Web Services, Computer and Network Systems, Embedded Systems, mobile and Smartphones Video Game - Console based and online Consumer Electronics Pharmaceutical – 21 CFR Part11 Compliance Automotive and durable goods Professional and Government Services

Computers, Networking and Telecommunication - Software, Web Services, Computer and Network Systems, Embedded Systems, mobile and Smartphones

Video Game - Console based and online

Consumer Electronics

Pharmaceutical – 21 CFR Part11 Compliance

Automotive and durable goods

Professional and Government Services