SlideShare a Scribd company logo
Mike Buschman, Co-founder
                   mike@plumanalytics.com
                       @plumanalytics



    Using Plum to
Assess Research Impact
       October 30, 2012
Current State of Scholarly Measure




              Plum Analytics Confidential   2
Reality of Scholarly Communication




              Plum Analytics Confidential   3
Plum Analytics Confidential
4
Changing the focus on metrics

                   how much your
    COUNTER        university uses




                                     Plum Analytics Confidential
                    the collection


   Article-level    how much the
   metrics and     world uses your
                      research
       Plum                                 5
Metrics are not the same




    Plum Analytics Confidential
6
Different categories of impact
• Usage
  • Downloads, views, book holdings, ILL, document
     delivery
• Captures
  • Favorites, bookmarks, saves, readers, groups, watchers




                                                             Plum Analytics Confidential
• Mentions
  • Blog post, news story, Wikipedia article, comments,
     review
• Social Media
  • Tweets, Google +1s, likes, shares, ratings
• Citations
  • Web of Science, Scopus, Google Scholar, Microsoft               7
     Academic Search, patents
Different versions and links
                         Institutional   Researcher
arxiv.org       PLOS     repository      website




                                                      Plum Analytics Confidential
     Link       Bit.ly         DOI       Direct
     resolver                            link




                                                             8
#altmetrics
 allmetrics
 altmetrics

              9
What is Plum building?
• Next generation impact analysis metrics for scholarly research.
• Aggregating artifact and author level metrics into a research
  reputation graph.
• Clicks, views, tweets, likes, links, tags, favorites, Google +1’s,




                                                                        Plum Analytics Confidential
  etc. will be captured and correlated.


                                  This graph will power intuitive
                                  research directories and
                                  visualizations at the artifact,
                                  researcher, lab, department,
                                  publication, and institution level.
                                                                        10
Plum Impact Reports
• Measure people, labs, departments,
  institutes, universities, museums,
  journals, etc.




                                       Plum Analytics Confidential
                                       11
Measuring the Modern Researcher
Nicolas Pinto – PhD from MIT in 2010
 • Some of his research is published.




                                                     Plum Analytics Confidential
 • What other research is Pinto doing? How is his
   research being used? Promoted? Interacted with?



                                                     12
 • What is Pinto’s real scientific impact?
Comparisons
• He tweets:




• He shares, and it is measurable:




                                                 Plum Analytics Confidential
  •   1,204 slideshare views
  •   26 tweets
  •   2 Google +1
  •   3 LinkedIn Shares
  •   1 Facebook Share, 1 like, 1 comment

• All before his research is “published”
• Web of Science cited-by count = 2 in 3 years   13
• Google Citations does not list him yet
Categories of Impact
Plum allows you to drill into the specifics behind each type of impact.




                                                                          Plum Analytics Confidential
       Clicking on any category shows more detailed metrics.



                                                                          14
Fully Customizable Hierarchy
                     Group researchers
                    in flexible hierarchy
                        for your own
                          purposes




                                            Plum Analytics Confidential
                                            15
Create User and Group Profiles
                          Web-based tools to
                          create a profile for
                            each group and
                              researcher




                                                 Plum Analytics Confidential
 Plum can also import
 profiles from existing                          16
        systems
Associate Artifacts
                Artifacts can be associated with
                 a researcher and/or a group




                                                   Plum Analytics Confidential
                     Each section can be
                  expanded to fill in details.     17
Research Output Summarized
 Clear, visual summaries of each researcher’s or group’s output




                                                                  Plum Analytics Confidential
                                                                  18
Tabular View
               Sortable, table-view of full output.
Exportable to spreadsheets or integrated into other applications.




                                                                    Plum Analytics Confidential
                                                                    19
Visualizations of Output

                       Sunburst chart
                          shows the




                                        Plum Analytics Confidential
                           relative
                        impact of all
                        output for a
                         researcher.




                                        20
Thank You!



    Mike Buschman
    mike@plumanalytics.com
    206-331-7297

                             21

More Related Content

Similar to Using plum to assess research impact -2012-10-30

Evaluating social media
Evaluating social mediaEvaluating social media
Evaluating social media
netc2012
 
2collab London Online web2.0 after the buzz
2collab London Online web2.0 after the buzz2collab London Online web2.0 after the buzz
2collab London Online web2.0 after the buzz
f kersten
 
Social Media Measurement
Social Media Measurement Social Media Measurement
Social Media Measurement
Sarah Baughman
 
Maximizing the power of ORCID with PlumX interoperability
Maximizing the power of ORCID with PlumX interoperabilityMaximizing the power of ORCID with PlumX interoperability
Maximizing the power of ORCID with PlumX interoperability
ORCID, Inc
 
Making Open the Default
Making Open the DefaultMaking Open the Default
Making Open the Default
Björn Brembs
 
ALAMW14 Altmetrics Panel: Redefining Research Impact
ALAMW14 Altmetrics Panel: Redefining Research ImpactALAMW14 Altmetrics Panel: Redefining Research Impact
ALAMW14 Altmetrics Panel: Redefining Research Impact
William Gunn
 
Plum analytics - acs -- 2013-09-09
Plum analytics  - acs -- 2013-09-09Plum analytics  - acs -- 2013-09-09
Plum analytics - acs -- 2013-09-09
plumanalytics
 
NeXC 2012 evaluating social media 101 presentation
NeXC 2012 evaluating social media 101 presentationNeXC 2012 evaluating social media 101 presentation
NeXC 2012 evaluating social media 101 presentation
Sarah Baughman
 
Facilitate Research Communities Adoption of Open Science Publishing Principle...
Facilitate Research Communities Adoption of Open Science Publishing Principle...Facilitate Research Communities Adoption of Open Science Publishing Principle...
Facilitate Research Communities Adoption of Open Science Publishing Principle...
OpenAIRE
 
Stephanie Faulkner - Using Metrics Beyond Citations to Demonstrate the Impact...
Stephanie Faulkner - Using Metrics Beyond Citations to Demonstrate the Impact...Stephanie Faulkner - Using Metrics Beyond Citations to Demonstrate the Impact...
Stephanie Faulkner - Using Metrics Beyond Citations to Demonstrate the Impact...
SciELO - Scientific Electronic Library Online
 
Plum analytics - ssp -- 2013-06-06
Plum analytics  - ssp -- 2013-06-06Plum analytics  - ssp -- 2013-06-06
Plum analytics - ssp -- 2013-06-06plumanalytics
 
Article Impact (ALM and altmetrics)
Article Impact (ALM and altmetrics)Article Impact (ALM and altmetrics)
Article Impact (ALM and altmetrics)
Richard Cave
 
Using social media for research impact
Using social media for research impactUsing social media for research impact
Using social media for research impact
Helen Dixon
 
Research data and output management
Research data and output managementResearch data and output management
Research data and output management
Jane Frazier
 
Csora, "2Collab, The Research Collaboration Tool"
Csora, "2Collab, The Research Collaboration Tool"Csora, "2Collab, The Research Collaboration Tool"
Csora, "2Collab, The Research Collaboration Tool"
National Information Standards Organization (NISO)
 
Altmetrics: The Movement, The Tools, and the Implications
Altmetrics: The Movement, The Tools, and the ImplicationsAltmetrics: The Movement, The Tools, and the Implications
Altmetrics: The Movement, The Tools, and the Implications
KR_Barker
 
Altmetrics: The Movement, The Tools, and the Implications
Altmetrics: The Movement, The Tools, and the ImplicationsAltmetrics: The Movement, The Tools, and the Implications
Altmetrics: The Movement, The Tools, and the Implications
CMHSL
 
Altmetrics 2014-4-15-slideshare
Altmetrics 2014-4-15-slideshareAltmetrics 2014-4-15-slideshare
Altmetrics 2014-4-15-slideshareCMHSL
 
Using free social media online tools to communicate scientific activities and...
Using free social media online tools to communicate scientific activities and...Using free social media online tools to communicate scientific activities and...
Using free social media online tools to communicate scientific activities and...
US Environmental Protection Agency (EPA), Center for Computational Toxicology and Exposure
 
Altmetrics: the movement, the tools, and the implications
Altmetrics: the movement, the tools, and the implicationsAltmetrics: the movement, the tools, and the implications
Altmetrics: the movement, the tools, and the implications
KR_Barker
 

Similar to Using plum to assess research impact -2012-10-30 (20)

Evaluating social media
Evaluating social mediaEvaluating social media
Evaluating social media
 
2collab London Online web2.0 after the buzz
2collab London Online web2.0 after the buzz2collab London Online web2.0 after the buzz
2collab London Online web2.0 after the buzz
 
Social Media Measurement
Social Media Measurement Social Media Measurement
Social Media Measurement
 
Maximizing the power of ORCID with PlumX interoperability
Maximizing the power of ORCID with PlumX interoperabilityMaximizing the power of ORCID with PlumX interoperability
Maximizing the power of ORCID with PlumX interoperability
 
Making Open the Default
Making Open the DefaultMaking Open the Default
Making Open the Default
 
ALAMW14 Altmetrics Panel: Redefining Research Impact
ALAMW14 Altmetrics Panel: Redefining Research ImpactALAMW14 Altmetrics Panel: Redefining Research Impact
ALAMW14 Altmetrics Panel: Redefining Research Impact
 
Plum analytics - acs -- 2013-09-09
Plum analytics  - acs -- 2013-09-09Plum analytics  - acs -- 2013-09-09
Plum analytics - acs -- 2013-09-09
 
NeXC 2012 evaluating social media 101 presentation
NeXC 2012 evaluating social media 101 presentationNeXC 2012 evaluating social media 101 presentation
NeXC 2012 evaluating social media 101 presentation
 
Facilitate Research Communities Adoption of Open Science Publishing Principle...
Facilitate Research Communities Adoption of Open Science Publishing Principle...Facilitate Research Communities Adoption of Open Science Publishing Principle...
Facilitate Research Communities Adoption of Open Science Publishing Principle...
 
Stephanie Faulkner - Using Metrics Beyond Citations to Demonstrate the Impact...
Stephanie Faulkner - Using Metrics Beyond Citations to Demonstrate the Impact...Stephanie Faulkner - Using Metrics Beyond Citations to Demonstrate the Impact...
Stephanie Faulkner - Using Metrics Beyond Citations to Demonstrate the Impact...
 
Plum analytics - ssp -- 2013-06-06
Plum analytics  - ssp -- 2013-06-06Plum analytics  - ssp -- 2013-06-06
Plum analytics - ssp -- 2013-06-06
 
Article Impact (ALM and altmetrics)
Article Impact (ALM and altmetrics)Article Impact (ALM and altmetrics)
Article Impact (ALM and altmetrics)
 
Using social media for research impact
Using social media for research impactUsing social media for research impact
Using social media for research impact
 
Research data and output management
Research data and output managementResearch data and output management
Research data and output management
 
Csora, "2Collab, The Research Collaboration Tool"
Csora, "2Collab, The Research Collaboration Tool"Csora, "2Collab, The Research Collaboration Tool"
Csora, "2Collab, The Research Collaboration Tool"
 
Altmetrics: The Movement, The Tools, and the Implications
Altmetrics: The Movement, The Tools, and the ImplicationsAltmetrics: The Movement, The Tools, and the Implications
Altmetrics: The Movement, The Tools, and the Implications
 
Altmetrics: The Movement, The Tools, and the Implications
Altmetrics: The Movement, The Tools, and the ImplicationsAltmetrics: The Movement, The Tools, and the Implications
Altmetrics: The Movement, The Tools, and the Implications
 
Altmetrics 2014-4-15-slideshare
Altmetrics 2014-4-15-slideshareAltmetrics 2014-4-15-slideshare
Altmetrics 2014-4-15-slideshare
 
Using free social media online tools to communicate scientific activities and...
Using free social media online tools to communicate scientific activities and...Using free social media online tools to communicate scientific activities and...
Using free social media online tools to communicate scientific activities and...
 
Altmetrics: the movement, the tools, and the implications
Altmetrics: the movement, the tools, and the implicationsAltmetrics: the movement, the tools, and the implications
Altmetrics: the movement, the tools, and the implications
 

Using plum to assess research impact -2012-10-30

  • 1. Mike Buschman, Co-founder mike@plumanalytics.com @plumanalytics Using Plum to Assess Research Impact October 30, 2012
  • 2. Current State of Scholarly Measure Plum Analytics Confidential 2
  • 3. Reality of Scholarly Communication Plum Analytics Confidential 3
  • 5. Changing the focus on metrics how much your COUNTER university uses Plum Analytics Confidential the collection Article-level how much the metrics and world uses your research Plum 5
  • 6. Metrics are not the same Plum Analytics Confidential 6
  • 7. Different categories of impact • Usage • Downloads, views, book holdings, ILL, document delivery • Captures • Favorites, bookmarks, saves, readers, groups, watchers Plum Analytics Confidential • Mentions • Blog post, news story, Wikipedia article, comments, review • Social Media • Tweets, Google +1s, likes, shares, ratings • Citations • Web of Science, Scopus, Google Scholar, Microsoft 7 Academic Search, patents
  • 8. Different versions and links Institutional Researcher arxiv.org PLOS repository website Plum Analytics Confidential Link Bit.ly DOI Direct resolver link 8
  • 10. What is Plum building? • Next generation impact analysis metrics for scholarly research. • Aggregating artifact and author level metrics into a research reputation graph. • Clicks, views, tweets, likes, links, tags, favorites, Google +1’s, Plum Analytics Confidential etc. will be captured and correlated. This graph will power intuitive research directories and visualizations at the artifact, researcher, lab, department, publication, and institution level. 10
  • 11. Plum Impact Reports • Measure people, labs, departments, institutes, universities, museums, journals, etc. Plum Analytics Confidential 11
  • 12. Measuring the Modern Researcher Nicolas Pinto – PhD from MIT in 2010 • Some of his research is published. Plum Analytics Confidential • What other research is Pinto doing? How is his research being used? Promoted? Interacted with? 12 • What is Pinto’s real scientific impact?
  • 13. Comparisons • He tweets: • He shares, and it is measurable: Plum Analytics Confidential • 1,204 slideshare views • 26 tweets • 2 Google +1 • 3 LinkedIn Shares • 1 Facebook Share, 1 like, 1 comment • All before his research is “published” • Web of Science cited-by count = 2 in 3 years 13 • Google Citations does not list him yet
  • 14. Categories of Impact Plum allows you to drill into the specifics behind each type of impact. Plum Analytics Confidential Clicking on any category shows more detailed metrics. 14
  • 15. Fully Customizable Hierarchy Group researchers in flexible hierarchy for your own purposes Plum Analytics Confidential 15
  • 16. Create User and Group Profiles Web-based tools to create a profile for each group and researcher Plum Analytics Confidential Plum can also import profiles from existing 16 systems
  • 17. Associate Artifacts Artifacts can be associated with a researcher and/or a group Plum Analytics Confidential Each section can be expanded to fill in details. 17
  • 18. Research Output Summarized Clear, visual summaries of each researcher’s or group’s output Plum Analytics Confidential 18
  • 19. Tabular View Sortable, table-view of full output. Exportable to spreadsheets or integrated into other applications. Plum Analytics Confidential 19
  • 20. Visualizations of Output Sunburst chart shows the Plum Analytics Confidential relative impact of all output for a researcher. 20
  • 21. Thank You! Mike Buschman mike@plumanalytics.com 206-331-7297 21

Editor's Notes

  1. Published articles in prominent journals cite other articles in prominent journals = prestige and tenure.This mechanism of using citations in published journals to determine impact of research was built in the 1960’s.
  2. Promotion vs. interactionPeople metrics vs. artifact metricsTweets != citations