70-20-10 blended learning ecosystems are more complex than traditional learning and development activities. They have more components and are connected in more complex ways. Evaluation methods such as post-course surveys don't work with 70-20-10 learning ecosystems, so we need different approaches and methods. For many learning and development professionals evaluation is an afterthought, but at Sprout Labs we have repeatedly found that a well-designed evaluation approach can help to drive the success of the program. During this interactive webinar we will explored: how a mindset of prototyping and feedback can accelerate the maturity of a program - how to build a culture of evaluation and research in your learning and development team - technologies for embedding continuous measurement into learning programs - the use of the Robert Brinkerhoff Success Case Method in the evaluation of 70-20-10 learning models.

2. What we do

3. • how a mindset of prototyping and feedback can accelerate the
maturity of a program
• how to build a culture of evaluation and research in your learning
and development team
• technologies for embedding continuous measurement into
learning programs
• the use of the Robert Brinkerhoff Success Case Method in the
evaluation of 70-20-10 learning models.
We will discuss …

4. Where’s your organisation?
We don’t really evaluate
beyond surveys
We take a mature approach to
evaluation

5. “Of the 96 Fortune 500 CEOs responding to the
survey, 96 percent said that they want data
demonstrating the connection between
investment in people and improvement in
critical business measures. However, only 8
percent report getting that information.”
Source: ROI Institute/ATD research study on what CEOs think about investment in people
https://www.td.org/Publications/Blogs/Learning-Executive-Blog/2014/11/What-Ceos-Want-and
How-to-Give-It-to-Them

6. What is hard about evaluating learning?

8. It’s not a straight line of
course = outcome
Image CC – by Brett Cronin

9. Image CC – by Michael Coghlan
It’s not about the inputs

10. Image CC – Antony Mayfield
We measure the
wrong things

11. Image CC – by Glug Events
It’s about the outputs

12. IMPACT

14. Design thinking applied to learning

15. Startups do this
QUICKLY

16. Low fidelity
High fidelity
Pilots
Role plays

17. Project
Small amount of
funding and
time
Manager
support for the
project
Community of
Practice
Mentoring
Fostering innovation

18. How could this mindset of prototyping be embedded in
L&D teams?

19. We are working on developing our
line managers into being
learning leaders. The first step is a
program for managers in coaching
skills.

20. Coaching program for managers

21. How could this program be prototyped?

22. Marketing has similar problems to
learning
Vague statements like
promote the brand of an organisation

23. Digital
marketing is
data driven

24. A/B testing

25. xAPI aka Tin Can

27. The risk is that
it’s only an input

28. Some LRS’s allow for the correlation between the
business metrics and the data.

29. Learning logs
Increases reflection Makes learning
visible

30. With our coaching program what data could be collected?
Your thoughts …

31. Success case method
www.brinkerhoffevaluationinstitute.com
“Combines the ancient craft of
storytelling with more current
evaluation approaches of naturalistic
inquiry and case study”

32. Success case method
www.brinkerhoffevaluationinstitute.com

33. What are the pro and cons of using the success method
with the coaching program?
Pros Cons

34. How could you improve the evaluation of programs in your
organisation?

35. Thank you for your participation!
Dr Robin Petterd
Learning Consultant
M: +61 419 101 928
E: robin@sproutlabs.com.au
T: @sproutlabs_au