The document discusses how to prove the value of evaluation through various methods. It covers topics like defining metrics, choosing an evaluation methodology, asking the right questions, and identifying appropriate data sources and methods. The key points are to focus the evaluation on the questions stakeholders want answered, select data collection sources and methods suited to answering those questions, and embed ongoing evaluative practices in the organization.

1. Prove Your Value
Through Evaluation
Stephanie Christine G. Fuentes, Ph.D.
ASTD Greater Tucson Presentation
November 20, 2009
© 2009, Inventivo Design, LLC 1

2. Topics
 The “value” in evaluation
 Metrics
 Semantics and perspective
 Asking the right questions
 Choosing a methodology
 Now what?
 Summary
 Resources
2 © 2009, Inventivo Design, LLC

3. The “Value” in Evaluation
 Judgment of the merit or worth of something
 Stakeholder-defined
 More than ROI
 Not research
 Begin with the end - what do you really want
to know?
3 © 2009, Inventivo Design, LLC

4. Metrics
 “a system or standard of measurement”
 Can be measures
 Counts, perception data
 Can be other data
 Maps
 Anecdotes
 Use your imagination
4 © 2009, Inventivo Design, LLC

5. Metrics
 Efficiency = doing things right
 Return on Investment (ROI)
 Resource utilization
 Productivity
 Compliance
 Effectiveness = doing the right things
 Satisfaction scores
 Engagement levels
 Performance change
 Stories
5 © 2009, Inventivo Design, LLC

6. Semantics & Perspective
Quantitative Qualitative
 Experiment  Participant Observer
 Positivist  Constructivist
 Hypothesis  Discovery
 Randomization  Purposeful
 Numeric  Non-numeric
6 © 2009, Inventivo Design, LLC

7. Asking Questions
 Focusing the evaluation - key evaluation
questions
 Data collection approaches:
 What is out there? [Exploratory]
 What does it look like? [Descriptive]
 Why or how is it like that? [Explanatory]
 Does it work? [Evaluative]
 Can we forecast it? [Predictive]
7 © 2009, Inventivo Design, LLC

8. Choosing a Methodology
 The Decision Tool
 Activity
 Data source considerations
Example Question:
How effective is our leadership development program in
preparing new leaders to fill our executive talent pipeline?
8 © 2009, Inventivo Design, LLC

9. Deciding on a Path…
9 © 2009, Inventivo Design, LLC

10. Data Sources
 Level and type
 Validity
 Reliability
 Representativeness
 Integrity
 Triangulation
 Source choice
 Perishability
10 © 2009, Inventivo Design, LLC

11. Now what?
 Reporting
 More questions
 Repeating the process
11 © 2009, Inventivo Design, LLC

12. Summary
Prove your value through evaluation by:
 Asking the right questions
 Answering the questions stakeholders want
to know
 Identifying appropriate sources and methods
 Embedding evaluative practices in your
organization
12 © 2009, Inventivo Design, LLC

13. Resources/References
 American Evaluation Association
www.eval.org
 Evaluation in Organizations, 2nd Ed., Russ-
Eft & Preskill (2009)
ISBN: 978-0-465-01866-6
13 © 2009, Inventivo Design, LLC

14. Questions
?
Contact Information:
Stephanie Christine G. Fuentes
Inventivo Design, LLC
http://www.inventivodesign.com
520.307.6138
14 © 2009, Inventivo Design, LLC