AMERICAN UNIVERSITY LIBRARY
COLLOQUIUM ON SCHOLARLY COMMUNICATION
NOVEMBER 2017
Motivational Metrics: A Publisher and Library Collaboration
In response to increasing internal demand for and focus on metrics associated with
Academies’ work, in 2015 The National Academies Press and the Research Center
launched an institution wide initiative to standardize data collection processes and
create “best practice” guidelines for staff. This ongoing initiative includes; developing
a common definition for impact, a standardized taxonomy for data collection,
development work on the internal metrics platform, staff training on data analysis, and
marketing tools for reports to sponsors and new funding proposals.
Alphonse L. MacDonald and Colleen Willis will present what they have learned and
what they have in mind for the future.
National Academy of Sciences
Charter (1863)
“The academy shall, whenever called upon by any
department of the government, investigate, examine… and
report upon any subject of science or art…”
The National Academy of Sciences
1863
National Academy of Sciences
1916
National Research Council
1964
National Academy of Engineering
1970
Institute of Medicine
2015
National Academy of Medicine
National Academies Press
1993 - 2003
• 1st self sustaining publisher to provide
Open Access
– free online reading (1993)
• For Sale Print and PDFs (1998)
Data suggested increased discoverability led
to increased sales.
2003 – 2011 – The Journey to Free PDF
NAP.edu Technology Stack - LAMP w/Lucene
Client-side (JavaScript, HTML, CSS)
AngularJS
jQuery
Bootstrap 3
Foundation 5
Highcharts
moment.js
Plugins
Angular UI Bootstrap
jQuery UI
TinyMCE
Drag and Drop File Upload
Typeahead
Dropzone
Server-side (PHP/Apache)
Composer
Twig
Slim Framework v2
PDO
Mysqli
Propel
GeoIP
Development Environment
Sublime Text
CoffeeScript
Sass
Bower
Eclipse
2011 – 2017 Data Rich Dissemination
Web
• 999,660 – MyNAP Accounts
• 2,580,000 Sessions/month
E-Mail
• 325,000 – Engaged E-Mail Subscribers
• 2,000,000 – Emails sent/month
Publisher-Library Partnership
• Determine common definition
• Standardized data taxonomy
• Self Service Platform - NAXchange
• Best Practice Guidelines
• Training on tools and data analysis
• Automated marketing reports
• Agile User Driven Development
Essentially, it is the measurable evidence of change a report, workshop
summary, or other activity makes in the: development of federal laws
and regulations, effectiveness of government programs, shaping the
direction of research fields and informing public knowledge and dialog
about issues of critical importance.
The ability to collect and communicate impact evidence is an essential
component for the institution as we seek to maximize and report on the
investments of our stakeholders. Additionally, evidence can be used to
boost new business development, attract collaborative partnerships and
be repurposed to enhance member and volunteer researcher profiles.
How do we define “impact” in relation to the
work of the Academies?
Standardized Data Taxonomy
• Bibliographic
– Record ID
– ISBN
• Usage (Internal)
– Traffic to Academies
web properties
– Downloads
– Location
• Geographic &
Institutional (domain)
• Attention (External)
– Altmetrics
– Scopus and Web of
Science (citation
counts)- not currently
in NAXchange
– LexisNexis (legislative
and press) - not
currently in
NAXchange
NAXchange
“Best Practice” Guidelines
Staff Training
Automated Reports
Future Developments
Manually Curated Outcome
Collection
News
Congressional Affairs,
Program Units
Aggregate Reporting
Organizational Unit
Topic
Post Publication Surveys
New/Improved Data
Connections
Internal
External
Orcid
Counter
NASEM LABS
API
Plugin
Presenters
Alphonse L. MacDonald
Acting Co-Executive Director,
The National Academies Press
Email: AMacDonald@nas.edu | Phone: 202 334-3625
Colleen Willis
Manager, Research Center
Knowledge Services Office
Information and Technology Services
Email: cwillis@nas.edu | Phone: 202-334-3791

Motivational Metrics: A Publisher and Library Collaboration

  • 1.
    AMERICAN UNIVERSITY LIBRARY COLLOQUIUMON SCHOLARLY COMMUNICATION NOVEMBER 2017 Motivational Metrics: A Publisher and Library Collaboration In response to increasing internal demand for and focus on metrics associated with Academies’ work, in 2015 The National Academies Press and the Research Center launched an institution wide initiative to standardize data collection processes and create “best practice” guidelines for staff. This ongoing initiative includes; developing a common definition for impact, a standardized taxonomy for data collection, development work on the internal metrics platform, staff training on data analysis, and marketing tools for reports to sponsors and new funding proposals. Alphonse L. MacDonald and Colleen Willis will present what they have learned and what they have in mind for the future.
  • 2.
    National Academy ofSciences Charter (1863) “The academy shall, whenever called upon by any department of the government, investigate, examine… and report upon any subject of science or art…” The National Academy of Sciences
  • 4.
    1863 National Academy ofSciences 1916 National Research Council 1964 National Academy of Engineering 1970 Institute of Medicine 2015 National Academy of Medicine
  • 5.
    National Academies Press 1993- 2003 • 1st self sustaining publisher to provide Open Access – free online reading (1993) • For Sale Print and PDFs (1998) Data suggested increased discoverability led to increased sales.
  • 6.
    2003 – 2011– The Journey to Free PDF
  • 7.
    NAP.edu Technology Stack- LAMP w/Lucene Client-side (JavaScript, HTML, CSS) AngularJS jQuery Bootstrap 3 Foundation 5 Highcharts moment.js Plugins Angular UI Bootstrap jQuery UI TinyMCE Drag and Drop File Upload Typeahead Dropzone Server-side (PHP/Apache) Composer Twig Slim Framework v2 PDO Mysqli Propel GeoIP Development Environment Sublime Text CoffeeScript Sass Bower Eclipse
  • 8.
    2011 – 2017Data Rich Dissemination Web • 999,660 – MyNAP Accounts • 2,580,000 Sessions/month E-Mail • 325,000 – Engaged E-Mail Subscribers • 2,000,000 – Emails sent/month
  • 9.
    Publisher-Library Partnership • Determinecommon definition • Standardized data taxonomy • Self Service Platform - NAXchange • Best Practice Guidelines • Training on tools and data analysis • Automated marketing reports • Agile User Driven Development
  • 10.
    Essentially, it isthe measurable evidence of change a report, workshop summary, or other activity makes in the: development of federal laws and regulations, effectiveness of government programs, shaping the direction of research fields and informing public knowledge and dialog about issues of critical importance. The ability to collect and communicate impact evidence is an essential component for the institution as we seek to maximize and report on the investments of our stakeholders. Additionally, evidence can be used to boost new business development, attract collaborative partnerships and be repurposed to enhance member and volunteer researcher profiles. How do we define “impact” in relation to the work of the Academies?
  • 11.
    Standardized Data Taxonomy •Bibliographic – Record ID – ISBN • Usage (Internal) – Traffic to Academies web properties – Downloads – Location • Geographic & Institutional (domain) • Attention (External) – Altmetrics – Scopus and Web of Science (citation counts)- not currently in NAXchange – LexisNexis (legislative and press) - not currently in NAXchange
  • 12.
  • 26.
  • 27.
  • 28.
  • 29.
    Future Developments Manually CuratedOutcome Collection News Congressional Affairs, Program Units Aggregate Reporting Organizational Unit Topic Post Publication Surveys New/Improved Data Connections Internal External Orcid Counter NASEM LABS API Plugin
  • 30.
    Presenters Alphonse L. MacDonald ActingCo-Executive Director, The National Academies Press Email: AMacDonald@nas.edu | Phone: 202 334-3625 Colleen Willis Manager, Research Center Knowledge Services Office Information and Technology Services Email: cwillis@nas.edu | Phone: 202-334-3791