Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

Using a Developmental Approach to Evaluating Innovative Extension Programs


Published on

Presentation with Kathleen Kelsy for the American Evaluation Association, October 2012

Published in: Education, Technology
  • Be the first to comment

  • Be the first to like this

Using a Developmental Approach to Evaluating Innovative Extension Programs

  1. 1. Using a DevelopmentalUsing a DevelopmentalApproach to EvaluatingApproach to EvaluatingInnovative ExtensionInnovative ExtensionProgramsProgramsKathleen Kelsey, Grape CoPOklahoma State UniversitySarah Baughman, Network Literacy CoPeXtension
  2. 2. 1. Ongoing development oradapting an intervention to newconditions2. Adapting effective generalprinciples to a new context3. Developing a rapid response toa major change4. Pre-formative development of apotentially scalable innovation orgetting an intervention ready fora summative evaluation5. Major systems change andcross-scale evaluation toprovide feedback about how theintervention is unfolding andhow it may need to be adaptedfor broader application.(p. 21-22)
  3. 3. PlanningPlanningWhy Developmental Approach?Why Developmental Approach?Grapes• Collaborative approach ofcommunity of practice• Exploration of what is beingdeveloped and what isemerging• Sustainability or what’s nextNetwork Literacy• CoP leaders looking for amore “flexible” evaluationprocess that allowed foroutcomes to emerge andchange• Ultimately looking for systemchange• Social media significant partof programming requiringrapid response
  4. 4. Finding an EvaluatorFinding an EvaluatorWhy Us?Why Us?Grapes Network Literacy• Staff evaluator for largerMFLN• Willingness to try differentapproach
  5. 5. Working with the evaluatorsWorking with the evaluators
  6. 6. Data CollectionData Collection
  7. 7. ReportingReportingGrapes• Informal• Continuous• Included formal annualreports for grantNetwork Literacy• Combination of informalreporting throughconversations withleadership team• Formal reporting to MFLNand Department of Defenseon monthly basis
  8. 8. Cycling Lessons LearnedCycling Lessons Learned• Critical friend roleNetwork Literacy• Incorporates the informaland formal reporting intoleadership team work• Challenge to getmembership and leadershipof CoP to take action• Heavy investment of timeand effort
  9. 9. Where we are now and what weWhere we are now and what wemight changemight change• Year 3 for Grape CoP, year 2 forNetwork Literacy• NetLit still emerging based partly onchallenges reaching target DoDaudience• Grapes ready to begin formativeevaluation