GrimoireLab is a toolset for software development analytics. It includes a coordinated set of tools to retrieve data from systems used to support software development (repositories), store it in databases, enrich it by computing relevant metrics, and making it easy to run analytics and visualizations on it.

1. GrimoireLab:
Measuring the health of
your software project with
Python
valcos@bitergia.com
@_valcos_
bitergia.com
PyConES, 4th-6th October

2. /context

3. /context
How can I measure my software
project?

4. /context

5. /context
Activity
How many contributions do we have?

6. /context
Activity
How many contributions do we have?
Community
How many organizations are
contributing to my project?

7. /context
Activity
How many contributions do we have?
Community
How many organizations are
contributing to my project?
Processes
How good we are in handling issues?

8. /history/today
chaoss.github.io/grimoirelab

9. /history/2001

10. /history/2007-2011

11. /history/2011-2014

12. /history/2011-2014

13. /history/2011-2014

14. /history/recent

15. /history/very-recent

16. /overview
chaoss/grimoirelab

17. /perceval
chaoss/grimoirelab-perceval

18. /perceval
Perceval: Software Project data at your Will

19. /perceval
{ "backend_name": "Git",
"backend_version": "0.10.2",
"category": "commit",
"data": {
"Author": "...,
"AuthorDate": "Mon Sep 3 11:37:40 ...",
"Commit": ...",
"CommitDate": "Mon Sep 3 11:37:40 …”,
"commit": "d3a8e97444dd9a63b0c ….",
"files": [...], "message": "Merge ...",
"parents": [...], "refs": [...]
},
"origin": "https://github.com/chaoss/grimoirelab-perceval",
"perceval_version": "0.11.11",
"tag": "https://github.com/chaoss/grimoirelab-perceval",
"timestamp": 1537685906.51857,
"updated_on": 1535967460.0,
"uuid": "9b7b4722fef72a8ce69781641a8220ed96868d0d" }
Data source
data
}
]Perceval
data

20. /perceval
As a program
As a Python3 library
$ pip3 install perceval
$ perceval git https://github.com/chaoss/grimoirelab-perceval
--from-date=2018-09-01
[2018-09-23 08:58:25,085] - Sir Perceval is on his quest.
[2018-09-23 08:58:25,088] - Fetching commits ...
… JSON Documents
[2018-09-23 08:58:26,540] - Sir Perceval completed his quest.
from perceval.backends.core.git import Git
from_date = datetime.datetime(2018, 9, 1)
backend = Git(".../grimoirelab-perceval", "/tmp/test")
commits = [commit for commit in backend.fetch(from_date=...)]

21. /graal
chaoss/grimoirelab-graal

22. /graal
Graal: The Quest for Source Code Knowledge

23. /arthur
chaoss/grimoirelab-kingarthur

24. /arthur
Arthur allows to schedule and run Perceval executions at
scale through distributed Redis queues.

25. /sortinghat
chaoss/grimoirelab-sortinghat

26. /sortinghat

27. /sortinghat
Manrique López <jsmanrique@bitergia.com>
José Manrique López de la Fuente <jsmanrique@gmail.com>
Manrique López <jsmanrique@gmail.com>
jsmanrique
jsmanrique@gmail.com
jsmanrique@bitergia.com
correo@jsmanrique.es
jsmanrique
jsmanrique@bitergia.com
02/2005 - 12/2010 CTIC
01/2010 - 12/2012 Andago
01/2013 - 06/2013 TapQuo
07/2013 - 12/2015 freelance (ASOLIF, CENATIC)
07/2013 - now Bitergia

28. /sortinghat
Who is who?

29. Hatstall
/sortinghat
SortingHat: Wizardry on Software Project Members

30. /hatstall
chaoss/grimoirelab-hatstall

31. /hatstall

32. /elk
chaoss/grimoirelab-elk

33. /manuscripts
chaoss/grimoirelab-manuscripts

34. /manuscripts

35. /sigils & kibiter
chaoss/grimoirelab-sigils

36. /sigils & kibiter
chaoss/grimoirelab-kibiter
Kibiter is a downstream of Kibana

37. /index patterns

38. /visualizations
* Kibiter visualizations

39. /panels

40. /mordred
chaoss/grimoirelab-sirmordred

41. /cauldron
alpha.cauldron.io
GrimoireLab as SaaS

42. /context
How can I measure my software
project?

43. /grimoirelab
Activity
How many contributions we have?
Community
How many companies are contributing
to my project?
Processes
How good we are in handling issues?

44. Answering
questions with
visualizations
Data from CHAOSS project
chaoss.biterg.io

45. /activity
How many contributions
do we have?

46. /activity
Last year

47. /activity
Last year

48. /activity
Last 2 years

49. /activity
Last 2 years

50. /community
How many organizations are
contributing to my project?

51. /community
Last year Last 2 years

52. /community
Last 2 years

53. /processes
How good we are in handling
issues?

54. /processes
Last 2 years
Last 6 months

55. /takeaway
● More than 30 data sources
● Automatic/incremental data collection,
enrichment and visualization
● Independent components
● 100% Open Source
● Python

56. valcos@bitergia.com
@_valcos_
Let’s go for questions!
@grimoirelab
@bitergia
@CHAOSSproj
@crossminer