0
Postgraduate Course                    One or two things about                  Evidence-Based Management        Pitstop E...
Postgraduate Course             Evidence-Based Management?                      VOV leden, n= 86
Evidence-Based PracticePostgraduate Course           1991       Medicine           1998       Education           1999    ...
DefinitionPostgraduate Course          Evidence-based management means making decisions          about the management of e...
Four sourcesPostgraduate Course
Four sourcesPostgraduate Course
Postgraduate Course   Trust me: 20 years of management experience!
Bounded rationalityPostgraduate Course
Bounded rationalityPostgraduate Course
Het feilbare breinPostgraduate Course        Seeing order in randomness        Mental corner cutting        Misinterpre...
Postgraduate Course                 if you’re                                  breathe into a bag               hyperventi...
Postgraduate Course     elderly people who have      give them a drug that     an irregular heartbeat are          reduces...
How 40,000 cardiologists can be wrongPostgraduate Course                      In the early 1980s newly introduced anti-   ...
Errors and Biases of Human JudgmentPostgraduate Course         Doctors and managers hold many erroneous beliefs,         n...
Problem II: false informationPostgraduate Course        Half of what you learn will be shown to be either dead           ...
Evidence-based?Postgraduate Course      1. Incompetent people benefit more from feedback than             highly competent...
Evidence-based?Postgraduate Course                   Competentie management                   Excellente zorg           ...
Postgraduate Course         Don’t be a parrot!                              Think critically about experience,            ...
Postgraduate Course
5-step approachPostgraduate Course       1. Formulate a focused question       2. Searching for the best available evidenc...
Postgraduate Course        Step 3: Critical appraisal of studies
Postgraduate Course           Best available evidence?
Research designsPostgraduate Course                      What is the BEST car?
Research designsPostgraduate Course             Which design for which question?
Twee type vragenPostgraduate Course                      Effect   vs   Non-effect
Type vraag: effectPostgraduate Course                      Werkt het?                      Werkt het beter dan ....?    Ef...
Type: non-effectPostgraduate Course   Needs:             Wat hebben mensen nodig, waar hebben ze                      beho...
Which design for which question?Postgraduate Course   Explanation
Postgraduate Course                      Best research design?
Best available?Postgraduate Course
What is evidence?Postgraduate Course     Evidence is not the same as ‘proof’ or ‘hard facts’     Evidence can be        ...
Postgraduate Course             The best available evidence =             Studies with the highest internal validity      ...
Internal validityPostgraduate Course          internal validity = indicates to what extent the          results of the res...
ConfoundingPostgraduate Course        Confounding is the idea that a 3rd variable can distort or        confuse (or confou...
What are the confounders?Postgraduate Course       1.         Shoe size & quality of handwriting       2.         Body len...
Reverse causationPostgraduate Course                                ?          Charismatic leaders                        ...
Levels of internal validityPostgraduate Course        1. Were there enough subjects in the study?        2. Was a control ...
Levels of internal validityPostgraduate Course
Levels of internal validityPostgraduate Course                               It is shown that …                           ...
Postgraduate Course                      Best available evidence:                          external validity
External validity: generalizabilityPostgraduate Course          Always ask yourself to what extent the evidence           ...
GeneralizabilityPostgraduate Course                             Keep in mind:             What works in one narrowly defin...
Postgraduate Course                          Step 4:               Turning evidence into practice
Postgraduate Course
Feasible?Postgraduate Course                organizational facts and characteristics                cultural aspects    ...
Tot slot:Postgraduate Course               Focus on the decision making process!                           (not the outcome)
Upcoming SlideShare
Loading in...5
×

One or Two Things About Evidence-Based Management

356

Published on

Presentation VOV Lerend Netwerk, Gent, Belgium, Sept 2012
Title: One or Two Things About Evidence-Based Management

Published in: Education, Health & Medicine
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total Views
356
On Slideshare
0
From Embeds
0
Number of Embeds
0
Actions
Shares
0
Downloads
20
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

Transcript of "One or Two Things About Evidence-Based Management"

  1. 1. Postgraduate Course One or two things about Evidence-Based Management Pitstop Evidence-Based HR, VOV lerend netwerk, Gent, 27 september 2012
  2. 2. Postgraduate Course Evidence-Based Management? VOV leden, n= 86
  3. 3. Evidence-Based PracticePostgraduate Course 1991 Medicine 1998 Education 1999 Social care, public policy 2000 Nursing 2000 Criminal justice ???? Management?
  4. 4. DefinitionPostgraduate Course Evidence-based management means making decisions about the management of employees, teams or organizations through the conscientious, explicit and judicious use of four sources of information: 1. The best available scientific evidence 2. Organizational facts, metrics and characteristics 3. Stakeholders’ values and concerns 4. Practitioner expertise and judgment
  5. 5. Four sourcesPostgraduate Course
  6. 6. Four sourcesPostgraduate Course
  7. 7. Postgraduate Course Trust me: 20 years of management experience!
  8. 8. Bounded rationalityPostgraduate Course
  9. 9. Bounded rationalityPostgraduate Course
  10. 10. Het feilbare breinPostgraduate Course  Seeing order in randomness  Mental corner cutting  Misinterpretation of incomplete data  Halo effect  False consensus effect  Group think  Confirmation bias  Self serving bias  Authority bias  Sunk cost fallacy  Small numbers fallacy  Cognitive dissonance reduction  In-group bias  Recall bias  Anchoring bias  Inaccurate covariation detection  Distortions due to plausibility
  11. 11. Postgraduate Course if you’re breathe into a bag hyperventilating
  12. 12. Postgraduate Course elderly people who have give them a drug that an irregular heartbeat are reduces the much more likely to die of number of coronary disease irregular beats
  13. 13. How 40,000 cardiologists can be wrongPostgraduate Course In the early 1980s newly introduced anti- arrhythmic drugs were found to be highly successful at suppressing arrhythmias. Not until a RCT was performed was it realized that, although these drugs suppressed arrhythmias, they actually increased mortality. The CAST trial revealed Excess mortality of 56/1000. By the time the results of this trial were published, at least 100,000 such patients had been taking these drugs.
  14. 14. Errors and Biases of Human JudgmentPostgraduate Course Doctors and managers hold many erroneous beliefs, not because they are ignorant or stupid, but because they seem to be the most sensible conclusion consistent with their own professional experience! available evidence.
  15. 15. Problem II: false informationPostgraduate Course  Half of what you learn will be shown to be either dead wrong or out-of-date within 7 years of your graduation; the trouble is that nobody can tell you which half  Sackett: remember that your teachers are full of crap, just like your parents.
  16. 16. Evidence-based?Postgraduate Course 1. Incompetent people benefit more from feedback than highly competent people. 2. Task conflict improves work group performance while relational conflict harms it. 3. Being intelligent is a disadvantage for performing low skilled jobs.
  17. 17. Evidence-based?Postgraduate Course  Competentie management  Excellente zorg  Kwaliteits management  Het nieuwe werken  Kennis management  Magnet, Investors in People  Plain Tree, Healing Environment  Balanced Score Card / INK  Lean / Six Sigma / TOC
  18. 18. Postgraduate Course Don’t be a parrot! Think critically about experience, question your assumptions, and challenge what you think you know. (Show me the evidence!)
  19. 19. Postgraduate Course
  20. 20. 5-step approachPostgraduate Course 1. Formulate a focused question 2. Searching for the best available evidence 3. Critical appraisal 4. Turning evidence into practice 5. Monitor the outcome
  21. 21. Postgraduate Course Step 3: Critical appraisal of studies
  22. 22. Postgraduate Course Best available evidence?
  23. 23. Research designsPostgraduate Course What is the BEST car?
  24. 24. Research designsPostgraduate Course Which design for which question?
  25. 25. Twee type vragenPostgraduate Course Effect vs Non-effect
  26. 26. Type vraag: effectPostgraduate Course Werkt het? Werkt het beter dan ....? Effect Heeft het een effect op ....? Wat zijn de succesfactoren voor ....? Wat is nodig om het te laten werken?
  27. 27. Type: non-effectPostgraduate Course Needs: Wat hebben mensen nodig, waar hebben ze behoefte aan? Attitude: Wat denken of vinden mensen van ...? Experience: Wat zijn de ervaringen van mensen met ...? Prevalence: Hoeveel mensen / organisaties ....? Procedure: Hoe kunnen we .... implementeren? Explanation: Waarom werkt het? Economics: Hoeveel kost het (tijd en geld)?
  28. 28. Which design for which question?Postgraduate Course Explanation
  29. 29. Postgraduate Course Best research design?
  30. 30. Best available?Postgraduate Course
  31. 31. What is evidence?Postgraduate Course  Evidence is not the same as ‘proof’ or ‘hard facts’  Evidence can be - so strong that no one doubts its correctness, or - so weak that it is hardly convincing at all
  32. 32. Postgraduate Course The best available evidence = Studies with the highest internal validity Studies with the highest external validity
  33. 33. Internal validityPostgraduate Course internal validity = indicates to what extent the results of the research may be biased and is thus a comment on the degree to which alternative explanations for the outcome found are possible (confounding).
  34. 34. ConfoundingPostgraduate Course Confounding is the idea that a 3rd variable can distort or confuse (or confound..) a relationship between two other variables. For instance, when factor X causes disease Y, that relationship could be confounded by factor C that is associated with both factor X and disease Y. C would be an alternative explanation for the relationship observed between X and Y.
  35. 35. What are the confounders?Postgraduate Course 1. Shoe size & quality of handwriting 2. Body length & body weight 3. Number of storks & birth rate 4. Smoking youngsters & better lung function
  36. 36. Reverse causationPostgraduate Course ? Charismatic leaders Successful companies
  37. 37. Levels of internal validityPostgraduate Course 1. Were there enough subjects in the study? 2. Was a control group used? 3. Were the subjects randomly assigned? 4. Was a pretest used? 5. Was the study started prior to the intervention or event? 6. Was the outcome measured in an objective and reliable way? 6x yes = very high (A) 5x yes = high (A) 4-3x yes = limited (B) 2x yes = low (C) 1-0x yes = very low (D)
  38. 38. Levels of internal validityPostgraduate Course
  39. 39. Levels of internal validityPostgraduate Course It is shown that … It is likely that … There are signs that … Experts are of the opinion that …
  40. 40. Postgraduate Course Best available evidence: external validity
  41. 41. External validity: generalizabilityPostgraduate Course Always ask yourself to what extent the evidence is generalizable to your situation: Ecological validity: Is your organization so different from those in the study that its results may be difficult to apply? Population validity: Is your population so different from those in the study that its results may be difficult to apply?
  42. 42. GeneralizabilityPostgraduate Course Keep in mind: What works in one narrowly defined setting might not work in another, but some psychological principles are generalizable to all human beings.
  43. 43. Postgraduate Course Step 4: Turning evidence into practice
  44. 44. Postgraduate Course
  45. 45. Feasible?Postgraduate Course  organizational facts and characteristics  cultural aspects  stakeholders’ values and concerns  political aspects  financial aspects /cost-effectiveness / ROI  priorities  change readiness / resistance to change  implementation capacity  timing
  46. 46. Tot slot:Postgraduate Course Focus on the decision making process! (not the outcome)
  1. A particular slide catching your eye?

    Clipping is a handy way to collect important slides you want to go back to later.

×