Developmental Evaluation
Cameron D. Norman PhD CE
Principal CENSE Research + Design
Adjunct Professor, Dalla Lana School o...
Outline
• Thinking about the problem(s)
• What is Developmental Evaluation?
• Methods
• Case Examples
• Discussion & dialo...
Same Evaluation Tools / "
Different Thinking Tools
Complexity
Example: Organizing a children’s
party
Evaluation & Measurement:
Problems & Opportunities
What is an effective coffee date?
Is that the right question?
What is an effective tree? 	

What is the best practice for being a tree? 	

What is a fully optimized tree?
Do you know what is inside before you crack it open?
Confusing moving things with static things
The Importance of Theory
What is Developmental Evaluation?
Developmental Evaluation
•  First proposed by Michael Quinn Patton (1994)
•  Combines Utilization-Focused Evaluation with ...
Developmental Evaluation
•  Assists social innovators in learning strategically about how to intentionally
develop their p...
Complicated Systems
 Complex Systems
Single causality
 Multiple causality
Designed & intended
 Adaptive & emergent
High de...
Program Improvements
 Program Developments
1. Add a new topic to a training
curriculum
1. Change the scope, sequence
and d...
Design Thinking
Developmental Design
Methods & Methodology
Mindfulness
Ethnography
Network Analysis
Timelines
Visual Thinking
Gigamapping
 http://www.systemsorienteddesign.net/
Idea Generation
Knowledge Mobilization
Strategic Learning
Discussion
Cameron D. Norman PhD	
  
@cdnorman
censemaking.com
Developmental Evaluation for Social Innovation
Developmental Evaluation for Social Innovation
Upcoming SlideShare
Loading in …5
×

Developmental Evaluation for Social Innovation

1,561 views
1,338 views

Published on

Morning lecture given to the Social Innovation Generation graduate program from the University of Waterloo (Dr. Dan McCarthy, instructor). Slides focus on some of the key tenets of developmental evaluation and how it can apply to complex systems.

Published in: Education, Technology
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
1,561
On SlideShare
0
From Embeds
0
Number of Embeds
847
Actions
Shares
0
Downloads
20
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

Developmental Evaluation for Social Innovation

  1. 1. Developmental Evaluation Cameron D. Norman PhD CE Principal CENSE Research + Design Adjunct Professor, Dalla Lana School of Public Health, University of Toronto @cdnorman August 28, 2013
  2. 2. Outline • Thinking about the problem(s) • What is Developmental Evaluation? • Methods • Case Examples • Discussion & dialogue
  3. 3. Same Evaluation Tools / " Different Thinking Tools
  4. 4. Complexity
  5. 5. Example: Organizing a children’s party
  6. 6. Evaluation & Measurement: Problems & Opportunities
  7. 7. What is an effective coffee date? Is that the right question?
  8. 8. What is an effective tree? What is the best practice for being a tree? What is a fully optimized tree?
  9. 9. Do you know what is inside before you crack it open?
  10. 10. Confusing moving things with static things
  11. 11. The Importance of Theory
  12. 12. What is Developmental Evaluation?
  13. 13. Developmental Evaluation •  First proposed by Michael Quinn Patton (1994) •  Combines Utilization-Focused Evaluation with concepts from Complexity Science •  Recognizes that social innovation and resiliency require a different form of feedback to enable programs to adapt and thrive in changing conditions •  An approach to evaluation, not a specific method. •  Strategic learning / real-time evaluation
  14. 14. Developmental Evaluation •  Assists social innovators in learning strategically about how to intentionally develop their program while acknowledging to complexity •  Supports adaptation to changing conditions •  Can identify and nurture promising interventions •  Documents innovators’ actions •  Identifies emergent processes and outcomes; enhances resiliency •  Determines if an innovation is ready for formative evaluation
  15. 15. Complicated Systems Complex Systems Single causality Multiple causality Designed & intended Adaptive & emergent High degree of certainty High degree of uncertainty Assumed predictability Anticipation of events Focus on ‘boxes’ Focus on ‘arrows’ Structures determine relationships Structures & relationships interact Linear Non-linear Noise, tension & flux undesirable Noise, tension & flux embraced Adaptation to static environment Interaction with static environment Reaction Engagement Adapted from http://www.healthandeverything.org
  16. 16. Program Improvements Program Developments 1. Add a new topic to a training curriculum 1. Change the scope, sequence and delivery of curriculum 2. Provide staff training to enhance skills 2. Change job descriptions, reconceptualize fundamentals of the job 3. Expand recruitment effort to a target area 3. Question and re-evaluate recruitment strategy 4. Expand staff to serve increasing numbers using the same model 4. Expand staff, change the model to suit new scale and scope of practice 5. Fine-tune programming based on participant feedback 5. Change programming to fit ever-changing realities 6. Add more content to provide additional information 6. Change the way the audience interacts with content altogether
  17. 17. Design Thinking
  18. 18. Developmental Design
  19. 19. Methods & Methodology
  20. 20. Mindfulness
  21. 21. Ethnography
  22. 22. Network Analysis
  23. 23. Timelines
  24. 24. Visual Thinking
  25. 25. Gigamapping http://www.systemsorienteddesign.net/
  26. 26. Idea Generation
  27. 27. Knowledge Mobilization
  28. 28. Strategic Learning
  29. 29. Discussion
  30. 30. Cameron D. Norman PhD   @cdnorman censemaking.com

×