Heather Piwowar and Jason Priem presented on Depsy, a software tool for measuring the impact of research software using metrics like downloads, citations, and authorship. Depsy launched in November 2016 and gathered feedback, with the biggest request being to pull in new data from GitHub. Future plans for Depsy include adding more data sources, improving text mining, and integrating more tightly with libraries.io and Impactstory.

1. #3amconf
Sept 2016
Heather Piwowar and Jason Priem
@ImpactStory
software-native metrics

5. depsy.org

7. 10.1038/529115a

8. https://github.com/Impactstory/depsy-research/blob/master/introducing_depsy.md

9. depsy.org

14. launched last November
....what did people think?

18. some areas we weren’t sure about,
but feedback suggested we got right

19. public profiles for everybody!

20. an overall score,
with equal weighting to 3 components

21. downloads, log transformed vs ranked, and display
for interprebility, with percentiles

22. pagerank
to weight or not to weight,
displayed in interpretable way

23. citations

24. authorship weighting
(committers vs pypi author vs maintainer)

26. and some big requests

27. biggest one: pull in new data from GitHub

28. expected:
more package library systems (esp bioconductor)
more languages (import detection complexity)
more platforms like bitbucket
(esp to get commit history for authorship)
better deduplication (no orcid, alas)
things that aren't on a version control system
at all (not happening)

29. outstanding challenge:
deciding what is a research package
(important b/c refset matters)

30. future plans

31. above, plus better text mining

32. integrate better with libraries.io

33. tighter integration with Impactstory

34. https://impactstory.org/u/0000-0001-6728-7745

38. https://github.com/Impactstory/depsy-research/blob/master/introducing_depsy.md
more Depsy details:

39. thoughts?
tweet @depsy_org or via github issue.

40. thanks!