1. Mike Lyles , Jay Philips and
Rex Black
The Good, The Bad and
The Metrics

2. About XBOSoft
•
Founded in 2006
•
Dedicated to software quality
• Software QA consulting
• Software testing services
•
Offices in San Francisco, Beijing, Oslo
and Amsterdam

3. From XBOSoft
• Amy
• Jan

4. Housekeeping
• Everyone except the speakers is muted
• Questions via the gotowebinar control on the right side of your
screen
• Questions can be asked throughout the webinar, we’ll try to fit
them in when appropriate
• General Q & A at the end of the webinar
• You will receive info on recording after the webinar

5. An XBOSoft Webinar
with
Mike Lyles, Jay Philips, & Rex Black
December 17, 2013
11am-12pm EST

6. Rex Black - President of RBCS.
His popular first book, Managing
the Testing Process, has sold over
50,000 copies around the
world, and is now in its third
edition. His ten other books on
testing have also sold tens of
thousands of copies. Rex is the
past President of the
International Software Testing
Qualifications Board and of the
American Software Testing
Qualifications Board.
Jay Philips - CEO & President of
Project Realms, Inc. an IT
consulting firm focusing on
software quality. Jay is also the
CEO & President of
TeamQualityPro, which is a realtime integrated dashboard
platform used to evaluate the
entire ecosystem of application
projects and resources.
TeamQualityPro is code agnostic
so all organizations can
implement a real-time executive
dashboard system.
Mike Lyles - Sr. QA Manager
with 20+ years of IT
experience. His current role is
over Performance
testing, Automation testing, and
Service Virtualization for all
business communities within
his organization. Mike enjoys
teaching others in the testing
profession. He has spoken at
multiple conferences on
testing, and has written multiple
published articles.

7. Has your organization ever considered replacing
a tester that did not write, for example, 15 test
cases per day?
Is the testing team blamed if defect leakage is
greater than 5% into production?
What drives decisions like these? The common
thread in these examples is “Test Metrics”

8. Everyone has an opinion…
 Some believe they are the most valuable way to
communicate the results of testing


Some think that they are useless, misleading, and
damaging to the communication of test results
Some believe that without measurement you are
not managing the effort. And some believe that
bad metrics are worse than no metrics at all.

9. Is your team aligned? Do you agree with the team?
Do you use a reporting process for test results?
Are you forced to report on metrics you don't believe
are valuable?
Do you have dozens of metrics that you are reporting
periodically that no one looks at, and when they do
look at them, there is room for misinterpretation?

10. 1.
Top metrics that are misused or
misunderstood
2.
Best metrics that everyone should use
3.
Worst metrics that you should avoid or
remove
4.
Tools and processes that can help your
organization better measure your testing

11. What metrics do you see in the
industry that are predominantly
being misused or misunderstood
by organizations?

13. What are the top metrics that you
would suggest for any
organization to use? What are the
most common?

15. What are metrics that
organizations should avoid
and/or discontinue using?

17. What tools and/or processes can
best assist organizations in
delivering
meaningful, accurate, and quality
metrics?

21. Rex Black
http://www.rbcs-us.com
@RBCS
Jay Philips
http://www.projectrealms.com
http://teamqualitypro.com
@jayphilips, @ProjectRealms,
@TeamQualityPro
Mike Lyles
http://www.mikewlyles.com
@mikelyles

22. Thank you for attending
Follow us: @XBOSoft
Questions : services@xbosoft.com