Investigating Impact Metrics for Performance
for the US EPA National Center for
Computational Toxicology
Antony Williams*,...
Who is NCCT?
• National Center for Computational Toxicology – part of EPA’s
Office of Research and Development
• Research ...
What are our “products”?
• Our scientific publications and presentations
• Our research data
• Our software applications, ...
What are our products?
• Our Scientific Publications and Presentations
https://cfpub.epa.gov/si/si_lab_search_results.cfm?...
What are our products?
• Our Applications
4
What are our products?
• Our Data
https://www.epa.gov/chemical-research/downloadable-computational-toxicology-data
5
What are our products?
• Our collaborations
https://www.epa.gov/chemical-research/collaborative-agreements-computational-t...
What are our products?
• Our scientific leadership
https://www.epa.gov/chemical-research/toxicity-forecasting
7
How should our impact be measured?
• Classical measures of impact – publications (How many,
where published, how many time...
Altmetrics impact
• Scientific Publications and Presentations – how many
downloads, views, shares, tweets, embeds,
• Resea...
Altmetrics impact
• Collaborations – funding of external work, provision of
ToxCast plated materials,
• Training – postdoc...
Scientist AltMetrics
• Many Social and Altmetric platforms in recent
years…
• …and publishers use these for tracking, assi...
Article Metrics: e.g. PLoS
http://journals.plos.org/plosone/article?id=10.1371/journal.pone.0062325
12
PLoS Article
http://journals.plos.org/plosone/article?id=10.1371/journal.pone.0062325
13
Scientists Identifier: ORCiD
14
ORCiD
15
PlumX: Scientists AltMetrics
https://plu.mx/u/awilliams/
16
PlumX: Scientists AltMetrics
https://plu.mx/u/awilliams/
17
PlumX: Article Level Metrics
https://plu.mx/u/awilliams/
18
AltMetric: Article Level Metrics
https://www.altmetric.com/details/1425979?src=bookmarklet
19
AltMetric: Geographical Metrics
20
GrowKudos: Article Level Data
21
GrowKudos: Article Level Metrics
22
GrowKudos integrating AltMetric
23
Altmetric Widgets
http://api.altmetric.com/embeds.html
24
Kudos Widgets
https://www.growkudos.com/about/user_guide
25
PlumX Widget
26
Integrating Data
• Tools can provide BOTH scientist level
and article level metrics and activities
• NCCT wants to aggrega...
What we are building…
MOCKUP: Landing Page
28
Scientific Papers: All NCCT
What we would like…
MOCKUP: Publications
Scientific Papers: By Author
What we would like…
MOCKUP: Scientists
Data & Tools: ToxCast Data Download Web
0
50
100
150
200
1-Sep-2015 1-Oct-2015 1-Nov-2015 1-Dec-2015 1-Jan-2016 1-Feb-2016...
Data & Tools:ToxCast Data Download Web Demographics
Top Users by Country
1. United States 1,715
2. Germany 170
3. United K...
Interest and Use: 2014 Stakeholder Workshop Survey Results
60%
13%
27%
ToxCast Data
Very Satisfied
Satisfied
Neither Satis...
Publications: Using Widgets
34
• We are investigating AltMetric, PlumX and Kudos Widgets
Publications: AltMetric Widget
35
• AltMetric will give us access to social sharing statistics
and other stats
Publications: PlumX Widget
36
• PlumX will give us access to social sharing
statistics and other publication stats
Publications: Kudos Widget
37
• Kudos will provide
details of social
shares and article
“enrichment”
App Analytics: Google
38
The Power of a Tweet
Work in Progress
• Investigating VIVO Open Source
• Data model in development
• ORCiDs for people, DOIs for papers
• Will ...
Our center – A BIG Impact!
We are out to measure it…
40
Upcoming SlideShare
Loading in …5
×

Investigating Impact Metrics for Performance for the US-EPA National Center for Computational Toxicology

851 views

Published on

The U.S. Environmental Protection Agency (EPA) Computational Toxicology Program integrates advances in biology, chemistry, and computer science to help prioritize chemicals for further research based on potential human health risks. This work involves computational and data driven approaches that integrate chemistry, exposure and biological data. We have delivered public access to terabytes of open data, as well to a large number of publicly accessible databases and applications, to support the research efforts for a large community of scientists. Many of our contributions to science are summarily described in research papers but to date we have not optimized our contributions to inform altmetrics statistics associated with our work. Critically missing from altmetrics is access to our numerous software applications and web service accesses, as well as the growing importance of our experimental data and models (e.g ToxCast, ExpoCast, DSSTox and others) to the scientific and regulatory communities. This presentation will provide an overview of our efforts to more fully understand, and quantify, our impact on the environmental sciences using a combination of our measurement approaches and available altmetrics tools. This abstract does not reflect U.S. EPA policy.

Published in: Science
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
851
On SlideShare
0
From Embeds
0
Number of Embeds
581
Actions
Shares
0
Downloads
1
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

Investigating Impact Metrics for Performance for the US-EPA National Center for Computational Toxicology

  1. 1. Investigating Impact Metrics for Performance for the US EPA National Center for Computational Toxicology Antony Williams*, Monica Linnenbrink, Kevin Crofton, Russell Thomas and Jeffery Edwards National Center for Computational Toxicology U.S. Environmental Protection Agency, RTP, NC August 21-25, 2016 ACS Fall Meeting, Philadelphia, PA http://www.orcid.org/0000-0002-2668-4821 The views expressed in this presentation are those of the author and do not necessarily reflect the views or policies of the U.S. EPA
  2. 2. Who is NCCT? • National Center for Computational Toxicology – part of EPA’s Office of Research and Development • Research driven by the EPA’s Chemical Safety for Sustainability Research Program – Develop new approaches to evaluate the safety of chemicals – Integrate advances in biology, biotechnology, chemistry, exposure science and computer science • Goal - To identify chemical exposures that may disrupt biological processes and cause adverse outcomes. • Can we quickly and cheaply evaluate thousands of chemicals for potential risk? 1
  3. 3. What are our “products”? • Our scientific publications and presentations • Our research data • Our software applications, code, algorithms and models • Our collaborations • Our trainings – postdoctoral researchers • Our Scientific Leadership 2
  4. 4. What are our products? • Our Scientific Publications and Presentations https://cfpub.epa.gov/si/si_lab_search_results.cfm?fed_org_id=1267&SIType=PR&TIM SType=Journal&showCriteria=0&view=citation&sortBy=pubDateYear 3
  5. 5. What are our products? • Our Applications 4
  6. 6. What are our products? • Our Data https://www.epa.gov/chemical-research/downloadable-computational-toxicology-data 5
  7. 7. What are our products? • Our collaborations https://www.epa.gov/chemical-research/collaborative-agreements-computational-toxicology-research 6
  8. 8. What are our products? • Our scientific leadership https://www.epa.gov/chemical-research/toxicity-forecasting 7
  9. 9. How should our impact be measured? • Classical measures of impact – publications (How many, where published, how many times cited) • The world of AltMetrics (http://altmetrics.org/manifesto/) 8
  10. 10. Altmetrics impact • Scientific Publications and Presentations – how many downloads, views, shares, tweets, embeds, • Research data – downloads, uses, publications about and citations to data • Software applications, code, algorithms and models – number of visitors, geography of visitors, number of searches, amount of data downloaded, integration to applications (web service access), resuse of code, algorithms and models 9
  11. 11. Altmetrics impact • Collaborations – funding of external work, provision of ToxCast plated materials, • Training – postdoctoral researchers – what careers do they have when they leave NCCT? • Scientific Leadership – contributions to EPA policy documents 10
  12. 12. Scientist AltMetrics • Many Social and Altmetric platforms in recent years… • …and publishers use these for tracking, assisting distribution and for amplification 11
  13. 13. Article Metrics: e.g. PLoS http://journals.plos.org/plosone/article?id=10.1371/journal.pone.0062325 12
  14. 14. PLoS Article http://journals.plos.org/plosone/article?id=10.1371/journal.pone.0062325 13
  15. 15. Scientists Identifier: ORCiD 14
  16. 16. ORCiD 15
  17. 17. PlumX: Scientists AltMetrics https://plu.mx/u/awilliams/ 16
  18. 18. PlumX: Scientists AltMetrics https://plu.mx/u/awilliams/ 17
  19. 19. PlumX: Article Level Metrics https://plu.mx/u/awilliams/ 18
  20. 20. AltMetric: Article Level Metrics https://www.altmetric.com/details/1425979?src=bookmarklet 19
  21. 21. AltMetric: Geographical Metrics 20
  22. 22. GrowKudos: Article Level Data 21
  23. 23. GrowKudos: Article Level Metrics 22
  24. 24. GrowKudos integrating AltMetric 23
  25. 25. Altmetric Widgets http://api.altmetric.com/embeds.html 24
  26. 26. Kudos Widgets https://www.growkudos.com/about/user_guide 25
  27. 27. PlumX Widget 26
  28. 28. Integrating Data • Tools can provide BOTH scientist level and article level metrics and activities • NCCT wants to aggregate the activities of the Center – including through our scientists and our publications. But also all of our other “products”… • Aggregation into one website is underway 27
  29. 29. What we are building… MOCKUP: Landing Page 28
  30. 30. Scientific Papers: All NCCT What we would like… MOCKUP: Publications
  31. 31. Scientific Papers: By Author What we would like… MOCKUP: Scientists
  32. 32. Data & Tools: ToxCast Data Download Web 0 50 100 150 200 1-Sep-2015 1-Oct-2015 1-Nov-2015 1-Dec-2015 1-Jan-2016 1-Feb-2016 ToxCast Data Download Webpage Traffic (Daily) Pageviews Unique Pageviews 0 500 1,000 1,500 2,000 2,500 September '15 October '15 November '15 December '15 January '16 February '16 ToxCast Data Download Webpage Traffic (Monthly) Pageviews Unique Pageviews What we would like… MOCKUP: Data Usage
  33. 33. Data & Tools:ToxCast Data Download Web Demographics Top Users by Country 1. United States 1,715 2. Germany 170 3. United Kingdom 148 4. Canada 120 5. France 119 6. China 117 7. Japan 84 8. Italy 78 9. South Korea 60 10.Switzerland 56 1 23 4 5 6 78 9 10 What we would like… MOCKUP: Geographic Access
  34. 34. Interest and Use: 2014 Stakeholder Workshop Survey Results 60% 13% 27% ToxCast Data Very Satisfied Satisfied Neither Satisfied or Dissatisfied Dissatisfied 13% 34% 20% 33% iCSS Dashboard Very Satisfied Satisfied Neither Satisfied or Dissatisfied 27% 66% 7% Workshop improved understanding of data/tools and use of them Strongly Agree Agree Undecided Disagree Strongly Disagree What we would like… MOCKUP: Aggregating Feedback
  35. 35. Publications: Using Widgets 34 • We are investigating AltMetric, PlumX and Kudos Widgets
  36. 36. Publications: AltMetric Widget 35 • AltMetric will give us access to social sharing statistics and other stats
  37. 37. Publications: PlumX Widget 36 • PlumX will give us access to social sharing statistics and other publication stats
  38. 38. Publications: Kudos Widget 37 • Kudos will provide details of social shares and article “enrichment”
  39. 39. App Analytics: Google 38 The Power of a Tweet
  40. 40. Work in Progress • Investigating VIVO Open Source • Data model in development • ORCiDs for people, DOIs for papers • Will integrate AltMetric, PlumX and Kudos embeddable widgets 39 • Integrate existing EPA tracking systems – e.g. EPA Science Inventory
  41. 41. Our center – A BIG Impact! We are out to measure it… 40

×