Monitoring and evaluating knowledge management strategies


Published on

Presentation about the challenges and decisions to take when monitoring knowledge management strategies. Summary of a longer paper.

Published in: Education, Business

Monitoring and evaluating knowledge management strategies

  1. 1. Monitoring and Evaluating Knowledge Management Strategies ”  
  2. 2. Background of the work <ul><li>Paper commissioned by IKM emergent, a research program </li></ul><ul><li>Work done in 2008 </li></ul><ul><li>By Sibrenne Wagenaar, Mark Turpin and Joitske Hulsebosch </li></ul>
  3. 3. Core question <ul><li>How to monitor and evaluate knowledge management strategies to generate conclusive evidence of their value for development efforts? Or “How to measure the intangible”? </li></ul><ul><li>Method: literature. Interviews with 15 leading thinkers from within the development sectors and experts from other sectors. </li></ul>
  4. 4. Some common elements of a KM strategy <ul><li>putting in place knowledge sharing systems; </li></ul><ul><li>strengthening communities of practice (CoPs) or learning networks; </li></ul><ul><li>using stories to make worthwhile experiences explicit; </li></ul><ul><li>encouraging cultural change within the organization; and </li></ul><ul><li>creating knowledge- sharing relationships with partners (based upon an overview of Hovland, 2003). </li></ul>
  5. 5. The ripple model Performance improvement Changed practices Knowledge capital Knowledge process enhancing activities
  6. 6. Main challenges <ul><li>the lag time between cause and effect; </li></ul><ul><li>demonstrating causality and attribution; </li></ul><ul><li>quantifying the unquantifiable; </li></ul><ul><li>power relations and ownership; </li></ul><ul><li>reflection, critical thinking and documenting experiences; </li></ul><ul><li>finding the right balance between the cost and the results of the assessment; </li></ul><ul><li>working across multicultural settings and in a multicultural context; and </li></ul><ul><li>proving results versus risk-taking and innovation. </li></ul>
  7. 7. Lessons from M&E in the development sector <ul><li>E very knowledge management strategy is unique and requires its own M&E approach and methods. Methods however, cannot ensure a valuable M&E cyclus, therefore the design needs to be well thought through and care should be taken to ensure that the right people are engaged. </li></ul>
  8. 8. Lessons from profit sector <ul><li>The combination of narrative techniques that may capture causality between the various levels of our ripple model and efforts to measure changes by using rating sheets. </li></ul>
  9. 9. General key lessons <ul><li>The core question needs to be questioned: do we always need evidence? </li></ul><ul><li>Decide on inherent versus extractive assessments (avoid the risk of success story-telling) </li></ul><ul><li>Use informal methods and use the ability of people to read what is going on </li></ul><ul><li>Combine measurements with narratives and sense-making </li></ul><ul><li>Link and use available data </li></ul>
  10. 10. Design considerations: decisions we have to make <ul><li>Phase 1: Questions to consider at the start </li></ul><ul><li>Is it important to formally monitor and evaluate the impact or not? </li></ul><ul><li>To monetize or not? </li></ul><ul><li>What is the main purpose of the impact assessment? </li></ul><ul><li>Who is the owner? Who judges? </li></ul><ul><li>Who is involved in the design process? </li></ul>
  11. 11. <ul><li>Phase 2: Focus of the M&E process   </li></ul><ul><li>What kind of change processes are we measuring? </li></ul><ul><li>Do we measure all the way down? </li></ul><ul><li>Which indicators do we use? What can we measure? </li></ul><ul><li>What do we assess? </li></ul>
  12. 12. <ul><li>Phase 3: Selection of methods   </li></ul><ul><li>Do we use retrospective techniques or baseline studies? </li></ul><ul><li>What mix of methods is appropriate? </li></ul>
  13. 13. <ul><li>Phase 4: Presenting and learning from the results   </li></ul><ul><li>How are we going to present the results? </li></ul><ul><li>How are we going to read the assessment? </li></ul>