Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

Excellence, Innovation, Evaluation: Collaboration x Innovation

712 views

Published on

Slides for my talk at Calsberg #cix working in Copenhagen on 30 June 2015. Covers evaluation and questions of identifying "excellence"

Published in: Science
  • Be the first to comment

  • Be the first to like this

Excellence, Innovation, Evaluation: Collaboration x Innovation

  1. 1. Excellence, Innovation, Evaluation: A critical view on how poor questions lead to misleading answers @cameronneylon http://orcid.org/0000-0002-0068-716X
  2. 2. “How can excellence in innovation lead to economic growth?”
  3. 3. “How can excellence in innovation lead to economic growth?”
  4. 4. What do we mean when we use the word… “excellence”?
  5. 5. Pursuit of excellence: We strive for excellence, seeking to apply the highest standards to benefit… University of Queensland
  6. 6. The university pursues academic excellence through the creation, preservation… University of San Diego
  7. 7. …to strive for excellence and distinction… Curtin University
  8. 8. We prize excellence Cape Peninsula University of Technology
  9. 9. We demand excellence University of Westminster
  10. 10. …with world- class excellence across all of its departments Princeton
  11. 11. As a world-leading centre of academic excellence we aim… University of Edinburgh
  12. 12. The university counts the diversity of its community as […] integral to its mission of excellence, and it is committed to diversity and inclusiveness in both educational… University of Maryland
  13. 13. excellence in…?
  14. 14. excellence in professionally relevant teaching University of Westminster
  15. 15. excellence in research and education Indiana University
  16. 16. excellence in research, education and knowledge exchange Strathclyde University
  17. 17. excellence in teaching, research, and public engagement Cornell University
  18. 18. excellence in teaching and research Curtin University
  19. 19. …leadership, innovation and excellence in teaching Curtin University and research
  20. 20. …a center of excellence for cultural, athletic and other events University of Toledo
  21. 21. …internationally recognized excellence in information technology services and infrastructure. Indiana University
  22. 22. What do we mean when we use the word… “excellence”?
  23. 23. How can we determine or measure… “excellence”?
  24. 24. [schools] are recognized for their excellence through national and international peer comparisons. Indiana University
  25. 25. Pursuing excellence means being satisfied with no less than the highest goals we can envision. University of Missouri
  26. 26. Pursuing excellence involves being informed by regional, national and global standards, as well as our personal expectations. University of Missouri
  27. 27. “excellence” is the holy grail of academic life Michèle Lamont How Professors Think
  28. 28. excellence is produced and defined in a multitude of sites and by an array of actors Michèle Lamont How Professors Think
  29. 29. “excellence” tells us nothing about how important the science is and everything about who decides. Jack Stilgoe Against Excellence
  30. 30. Using the word excellence is a means of avoiding a difficult conversation
  31. 31. Using the word excellence is a means of avoiding talking about values
  32. 32. Impact Research Economic Cultural Education Health Environment
  33. 33. Impact Research Economic Cultural Education Health Environment excellence
  34. 34. Impact Research Economic Cultural Education Health Environment
  35. 35. Impact Research Economic Cultural Education Health Environment impact
  36. 36. Impact Research Economic Cultural Education Health Environment quality
  37. 37. Impact Research Economic Cultural Education Health Environment innovation
  38. 38. Impact Research Economic Cultural Education Health Environment
  39. 39. Impact Research Economic Cultural Education Health Environment
  40. 40. Impact Research Economic Cultural Education Health Environment
  41. 41. Impact Research Economic Cultural Education Health Environment
  42. 42. Impact evaluation
  43. 43. …what we may be doing […] when we make [a] value judgement of a […] work... Barbara Herrnstein Smith Contingencies of Value
  44. 44. …articulating an estimate of how well that work will serve implicitly defined functions… Barbara Herrnstein Smith Contingencies of Value
  45. 45. …for an implicitly defined audience… Barbara Herrnstein Smith Contingencies of Value
  46. 46. …experiencing the work under implicitly defined conditions… Barbara Herrnstein Smith Contingencies of Value
  47. 47. Impact Research Economic Cultural Education Health Environment
  48. 48. Impact There is some good news…
  49. 49. http://www.flickr.com/photos/verzo/8020565592/ CC  BY
  50. 50. https://www.flickr.com/photos/see-­‐through-­‐the-­‐eye-­‐of-­‐g/5392290809  CC  BY
  51. 51. https://www.flickr.com/photos/jenny-­‐pics/3239638494  CC  BY
  52. 52. Citation
  53. 53. Bookmark Citation
  54. 54. Bookmark Citation Social  media conversation
  55. 55. Bookmark Citation Previous   co-­‐authorship Conference co-­‐attendance Social  media conversation
  56. 56. 5. * Neylon, C. & Wu, S. (2009). Article- Level Metrics and the Evolution of Scientific Impact. PLoS Biol 7, e1000242+ Evidence of Impact: Over 150 citations according to Google Scholar.…
  57. 57. 6. * Neylon, C. The Political Economics of Open Access Publishing (blog series). Science in the Open (2015-16). Evidence of Impact: Over 2500 unique blog views to date…
  58. 58. Impact “excellence” becomes a performance
  59. 59. Impact …performance of “excellence”
  60. 60. Impact …in the place of excellent performance
  61. 61. Impact Change the narrative…
  62. 62. Impact “soundness”
  63. 63. 1.85 1.9 1.95 2 2.05 2.1 2.15 2.2 1996 2001 2006 2011 Global  R&D  Expenditure  (%  of  GDP)
  64. 64. 0 50000 100000 150000 200000 250000 1996 2001 2006 2011 Researchers  per  million  people
  65. 65. evaluation
  66. 66. Impact PLOS ONE (and arXiv)
  67. 67. Impact Infrastructure and capacity
  68. 68. Impact Research Economic Cultural Education Health Environment evaluation
  69. 69. Impact Research Economic Cultural Education Health Environment
  70. 70. Impact Answers are easy…
  71. 71. Impact …it’s the questions that are hard
  72. 72. @cameronneylon http://orcid.org/0000-0002-0068-716X

×