Measuring and Enhancing your
Academic Medical Impact
MARION R. SILLS, MD, MPH
PROFESSOR, PEDIATRICS AND EMERGENCY MEDICINE
Overview
On Impact
On stakeholders
Measuring impact
Promoting impact
Overview
On Impact
On stakeholders
Measuring impact
Promoting impact
What is Impact?
Your
academic
work
Patient care
ResearchEducation
Advocacy
What is Impact?
Benefit to academic
world
◦ Within field
◦ Beyond field
Benefit to society and
the economy
◦ Individuals
◦ Organizations
◦ Nations
Your
academic
work
Patient care
ResearchEducation
Advocacy
Overview
On Impact
On stakeholders
Measuring impact
Promoting impact
Who judges your impact?
You!
Who judges your impact?
Steve
Mike
CU
Hospital
CU Med
Kevin
Institution-
level
measures
Who judges your impact?
Steve
Mike
CU
Hospital
CU Med
Kevin
Collaborators
Recruiters
Journalists
Politicians
Other academics
The universe … and beyond
Who judges your impact?
Scholarship: A record of multiple publications related to clinical
or health services topics, that have advanced the science and
practice of health care quality improvement.
Clinical: Development of new techniques, therapies, clinical
guidelines, patient care practices or health care delivery systems
that have improved the health of patients or populations.
Service: Significant involvement in health care advocacy,
community service or outreach, community-based participatory
research programs, or other activities that shape public policy on
health care or that address health disparities.
Teaching: Record of successful mentorship of students,
residents, fellows or other faculty; evidence that mentees have
pursued outstanding careers.
Overview
On Impact
On stakeholders
Measuring impact
Promoting impact
Measuring impact
Promotions guidance:
◦ Include bibliometrics…
What are
these?
Measuring impact
Promotions guidance:
◦ Include bibliometrics…
Demonstrating Impact: Publications
Bibliometrics = How many scholars
cite the work
Demonstrating Impact: Publications
Promotions guidance:
◦ Include bibliometrics…but these are not enough
◦ “Provide information about the importance, impact and reach of
your creative and scholarly work”
How do you
show this?
Demonstrating Impact: Publications
Promotions guidance:
◦ Include bibliometrics…but these are not enough
◦ “Provide information about the importance, impact and reach of
your creative and scholarly work”
Demonstrating Impact: Publications
Newer metrics help describe “importance, impact and
reach"
◦ Article-level metrics: how individual articles are being used in the
scientific community
◦ Altmetrics:
◦ Uptake of diverse scholarly work
◦ Measured by activity in web-based environments including those outside
the scientific community
Other academic media
Traditional media
Demonstrating Impact: Publications
Article-level metrics
Journal article
Scientific
community
Social media
Traditional media
Demonstrating Impact: Scholarship
Altmetrics
Scholarly output
Books, chapters,
podcasts, datasets,
code, slides, posters,
blog posts
Broader
community
Other web-based
activity
Article Level Metrics
Introduced in 2009 by the Public Library of
Science (PLoS) for all PLOS journal articles
Scholar level metrics
Scholar level metrics
For now: build your own impact CV
Track metrics for published work using Altmetric and other tools
Altmetric
Track metrics for
unpublished work
Use an existing academic sharing
repository
Common repositories of scholarly
output:
◦ Slideshare
◦ FigShare
◦ ResearchGate
◦ Others
Medical education
materials: MedEdPORTAL
Repository metrics
Follow your metrics at the
host site
Guide people to your
content
Optimizing Altmetrics
Availability of altmetrics depends on your work being available online
◦ Work that is openly available online (no paywall) -> accessible to more people ->
greater impact
Reliability of altmetrics depends on you being easily disambiguated from others
with similar names
◦ Register at ORCID to get your unique identifier
Overview
On Impact
On stakeholders
Measuring impact
Promoting impact
Using Altmetrics
Tell the story of the impact of your work
◦ Intramurally: e.g., annual reviews and promotions portfolios
◦ Extramurally: e.g., in our NIH Biosketches, job seeking, networking, applying
for opportunities
Using Altmetrics
This article received an Altmetric attention score in the top 5% of all research
outputs scored by Altmetric, reflecting social media and other online attention,.
This article has received national news coverage from 3 major news outlets. The
reach of this article included the readership of the New York Times, which
reaches millions worldwide. Based on this attention, Aurora Public Schools has
asked me to join their student nutrition choices team.
The QI project presentation on SlideShare has received 624 views, placing it in
the top 10% of slide decks in SlideShare’s collection. In addition to our impact on
patients in our own hospital, 7 hospital QI teams have contacted me for more
information after viewing my slides, and have implemented our pathway in their
institutions.
Improve your altmetrics
Be productive
Promote your own work via CU
Communications
◦ On social media
◦ Include the URL to your work in all posts
◦ Tag well (including @CUAnschutz)
◦ Use a good visual
CU Communications
Press release
Sometimes leads to interviews
(Also great at sharing what we post
on social media)
Social media
Twitter: more sharing beyond CU
Facebook: more engagements by those you know
Take home points
Get your work online
Get an ORCID account
Track your work through metrics like Altmetric
(for publications) and on the hosting website
(like SlideShare) for unpublished work
Promote your work through traditional media
and social media
Use altmetrics to help tell your story—it also
takes narrative
Questions?

Measuring and Enhancing Your Academic Medical Impact

  • 1.
    Measuring and Enhancingyour Academic Medical Impact MARION R. SILLS, MD, MPH PROFESSOR, PEDIATRICS AND EMERGENCY MEDICINE
  • 2.
  • 3.
  • 4.
    What is Impact? Your academic work Patientcare ResearchEducation Advocacy
  • 5.
    What is Impact? Benefitto academic world ◦ Within field ◦ Beyond field Benefit to society and the economy ◦ Individuals ◦ Organizations ◦ Nations Your academic work Patient care ResearchEducation Advocacy
  • 6.
  • 7.
    Who judges yourimpact? You!
  • 8.
    Who judges yourimpact? Steve Mike CU Hospital CU Med Kevin Institution- level measures
  • 9.
    Who judges yourimpact? Steve Mike CU Hospital CU Med Kevin Collaborators Recruiters Journalists Politicians Other academics The universe … and beyond
  • 10.
    Who judges yourimpact? Scholarship: A record of multiple publications related to clinical or health services topics, that have advanced the science and practice of health care quality improvement. Clinical: Development of new techniques, therapies, clinical guidelines, patient care practices or health care delivery systems that have improved the health of patients or populations. Service: Significant involvement in health care advocacy, community service or outreach, community-based participatory research programs, or other activities that shape public policy on health care or that address health disparities. Teaching: Record of successful mentorship of students, residents, fellows or other faculty; evidence that mentees have pursued outstanding careers.
  • 11.
  • 12.
    Measuring impact Promotions guidance: ◦Include bibliometrics… What are these?
  • 13.
  • 14.
    Demonstrating Impact: Publications Bibliometrics= How many scholars cite the work
  • 15.
    Demonstrating Impact: Publications Promotionsguidance: ◦ Include bibliometrics…but these are not enough ◦ “Provide information about the importance, impact and reach of your creative and scholarly work” How do you show this?
  • 16.
    Demonstrating Impact: Publications Promotionsguidance: ◦ Include bibliometrics…but these are not enough ◦ “Provide information about the importance, impact and reach of your creative and scholarly work”
  • 17.
    Demonstrating Impact: Publications Newermetrics help describe “importance, impact and reach" ◦ Article-level metrics: how individual articles are being used in the scientific community ◦ Altmetrics: ◦ Uptake of diverse scholarly work ◦ Measured by activity in web-based environments including those outside the scientific community
  • 18.
    Other academic media Traditionalmedia Demonstrating Impact: Publications Article-level metrics Journal article Scientific community
  • 19.
    Social media Traditional media DemonstratingImpact: Scholarship Altmetrics Scholarly output Books, chapters, podcasts, datasets, code, slides, posters, blog posts Broader community Other web-based activity
  • 20.
    Article Level Metrics Introducedin 2009 by the Public Library of Science (PLoS) for all PLOS journal articles
  • 21.
  • 22.
    Scholar level metrics Fornow: build your own impact CV Track metrics for published work using Altmetric and other tools
  • 23.
  • 24.
    Track metrics for unpublishedwork Use an existing academic sharing repository Common repositories of scholarly output: ◦ Slideshare ◦ FigShare ◦ ResearchGate ◦ Others Medical education materials: MedEdPORTAL
  • 25.
    Repository metrics Follow yourmetrics at the host site Guide people to your content
  • 26.
    Optimizing Altmetrics Availability ofaltmetrics depends on your work being available online ◦ Work that is openly available online (no paywall) -> accessible to more people -> greater impact Reliability of altmetrics depends on you being easily disambiguated from others with similar names ◦ Register at ORCID to get your unique identifier
  • 27.
  • 28.
    Using Altmetrics Tell thestory of the impact of your work ◦ Intramurally: e.g., annual reviews and promotions portfolios ◦ Extramurally: e.g., in our NIH Biosketches, job seeking, networking, applying for opportunities
  • 29.
    Using Altmetrics This articlereceived an Altmetric attention score in the top 5% of all research outputs scored by Altmetric, reflecting social media and other online attention,. This article has received national news coverage from 3 major news outlets. The reach of this article included the readership of the New York Times, which reaches millions worldwide. Based on this attention, Aurora Public Schools has asked me to join their student nutrition choices team. The QI project presentation on SlideShare has received 624 views, placing it in the top 10% of slide decks in SlideShare’s collection. In addition to our impact on patients in our own hospital, 7 hospital QI teams have contacted me for more information after viewing my slides, and have implemented our pathway in their institutions.
  • 30.
    Improve your altmetrics Beproductive Promote your own work via CU Communications ◦ On social media ◦ Include the URL to your work in all posts ◦ Tag well (including @CUAnschutz) ◦ Use a good visual
  • 31.
    CU Communications Press release Sometimesleads to interviews (Also great at sharing what we post on social media)
  • 32.
    Social media Twitter: moresharing beyond CU Facebook: more engagements by those you know
  • 33.
    Take home points Getyour work online Get an ORCID account Track your work through metrics like Altmetric (for publications) and on the hosting website (like SlideShare) for unpublished work Promote your work through traditional media and social media Use altmetrics to help tell your story—it also takes narrative
  • 34.