13 0212 toccon - carpenter altmetrics 2

Alternative Metrics How the future of assessment can improve discovery and delivery of content Todd Carpenter, Executive Director, NISO Tools of Change Conference, New York, NY February 12, 2013Tuesday, February 12, 13

@TAC_NISO Twitter Highlights • So excited to present on #altmetrics today during #tocfbf at #fbf12 • Again, I’m pre-tweeting my presentation. Slides to come! #tocfbf #fbf12 • #NISO = 1/3 Publishers, 1/3 Libraries, 1/3 automation suppliers. Communities converge to develop standards #tocfbf #fbf12 • Standards are everywhere in book publishing, we just don’t notice them anymore. #tocfbf #fbf12 • In 1955 Eugene Garfield published “Citation Indexes for Science” in Science http://bit.ly/xfylwh #tocfbf #fbf12 • Quote: “If I have seen further it is by standing on ye shoulders of Giants." Sir Isaac Newton #tocfbf #fbf12 • Sounds like beginning of a joke: 2 guys at Stanford, they wrote this paper, then started a company in a garage ... #tocfbf #fbf12 • Citations are awesome, aren’t they? A perfect solution to all the world’s problems, no? #tocfbf #fbf12 • Citations aren’t always a measure of quality. They are also a very lagging indicator of impact #tocfbf #fbf12 • #altmetrics a suite of assessment criteria & measures being developed to assess importance of a particular scholarly output #tocfbf #fbf12 • #altmetrics examples: usage analysis, metrics of non-traditional content, observational or behavioral analysis, social media #tocfbf #fbf12 • How 1 can apply #altmetrics Sell related content, spot trends in near-real-time, ID new fields or new services, marketing #tocfbf #fbf12 • Real world #altmetrics examples: http://bit.ly/OzGnGt www.tynt.com http://bit.ly/TcNIh0 http://bit.ly/ PknZb4 #tocfbf #fbf12 • Issues needing consensus regarding #altmetrics - Authorship, provenance, definitions of components, privacy, openness #tocfbf #fbf12Tuesday, February 12, 13

About • Non-proﬁt industry trade association accredited by ANSI with 150+ members • Mission of developing and maintaining technical standards related to information, documentation, discovery and distribution of published materials and media • Volunteer driven organization: 400+ spread out across the world • Responsible for standards like ISSN, DOI, Dublin Core metadata, DAISY digital talking books, OpenURL, MARC records, and ISBN (indirectly)Tuesday, February 12, 13

Standards are familiar, even if you don’t notice Image: DanTaylor Image: : Joel WashingTuesday, February 12, 13

Who is reading published content?Tuesday, February 12, 13

We stand on the shoulders of giants...Tuesday, February 12, 13

The Mighty CitationTuesday, February 12, 13

Impact factorTuesday, February 12, 13

Thomson-Reuters IMPACT FACTORTuesday, February 12, 13

Two Stanford StudentsTuesday, February 12, 13

They wrote a paperTuesday, February 12, 13

They started a company in someone’s garage Photo: APTuesday, February 12, 13

Tuesday, February 12, 13

A simple conclusion can be drawn Citations are awesome, aren’t they? A perfect solution to all the world’s problems, no?Tuesday, February 12, 13

Back to Sir Isaac Newton “What Des-Cartes did was a good step.You have added much several ways, & especially in taking ye colours of thin plates into philosophical consideration. If I have seen further it is by standing on ye shoulders of Giants."Tuesday, February 12, 13

Caveat emptor Citations aren’t always what we think they areTuesday, February 12, 13

Another problem with citationsTuesday, February 12, 13

So where to from here?Tuesday, February 12, 13

Deﬁne Altmetrics, PleaseTuesday, February 12, 13

Usage Based MetricsTuesday, February 12, 13

Citation of non-traditional content Citations to new forms of communciation aren’t as simple as one might think. Deﬁne a use of this? Image: Domenico, Caron, Davis, et al.Tuesday, February 12, 13

Clickstream AnalysisTuesday, February 12, 13

Social Media Metrics Image: Danny Brown, The State of Social Media Marketing 2012Tuesday, February 12, 13

Behavioral MetricsTuesday, February 12, 13

Multivariate analysisTuesday, February 12, 13

OK, it’s important, but what does it mean for MY BUSINESSTuesday, February 12, 13

Have you bought something from Amazon?Tuesday, February 12, 13

Did you buy something that “other people bought”?Tuesday, February 12, 13

$$$$ One Million Dollars $$$$Tuesday, February 12, 13

o t e d N nt m e $$$$ l e $$$$ One Million Dollars p I mTuesday, February 12, 13

Netﬂix Recommendations: Beyond the 5 stars Everything is a RecommendationTuesday, February 12, 13

“All I see now is blonde, brunette, redhead” What can Netﬂix glean from: Several billion item ratings Item popularity - along many axis Stream plays each - along many axis Millions of “queue” additions daily Rich item metadata User interface interactions Social data External dataTuesday, February 12, 13

Presenting movies is not the only game to play with these dataTuesday, February 12, 13

Innovation often takes place at the intersection of different ﬁeldsTuesday, February 12, 13

Image: http://www.crispian.net/CrispiansScienceMap.htmlTuesday, February 12, 13

Mapping the World of Science Clickstream data yields high- resolution maps of science Johan Bollen, Herbert Van de Sompel, et al. PLoS One, February 2009Tuesday, February 12, 13

So what else can I do?Tuesday, February 12, 13

Realtime Trend SpottingTuesday, February 12, 13

Improve products and customer servicesTuesday, February 12, 13

Editorial applicationsTuesday, February 12, 13

Author services (“How is my book doing?”)Tuesday, February 12, 13

Marketing applicationsTuesday, February 12, 13

Is anyone really doing any of this? (Beyond Amazon, Google & Netﬂix?)Tuesday, February 12, 13

70%Tuesday, February 12, 13

Issues we face with alternative metricsTuesday, February 12, 13

Image: Flickr user karindalzielTuesday, February 12, 13

Authorship ----- Disambiguation Contributor RolesTuesday, February 12, 13

Basic Deﬁnitions Needed (So we are all talking about the same thing)Tuesday, February 12, 13

More open exchange of component dataTuesday, February 12, 13

All you need is.... Large Amounts of Data Good Analysts Implementation Strategy Creativity Standards (we can only do so much)Tuesday, February 12, 13

One Very Last Thing… Image from Will Lion: http://www.flickr.com/photos/will-lion/2646213692/Tuesday, February 12, 13

Thank you! Todd Carpenter, Executive Director tcarpenter@niso.org National Information Standards Organization (NISO) 3600 Clipper Mill Road, Suite 302 Baltimore, MD 21211 USA +1 (301) 654-2512 www.niso.orgTuesday, February 12, 13

http://www.toccon.com	54
https://twitter.com	53
http://storify.com	8
http://lanyrd.com	5

13 0212 toccon - carpenter altmetrics 2

by National Information Standards Organization (NISO) on Feb 12, 2013

Accessibility

Categories

Upload Details

Usage Rights

4 Embeds 120

Statistics