The document discusses using the gitdm tool to analyze contributions to the OpenStack project. It describes how gitdm works and how to configure it to run analyses of specific OpenStack releases. The analyses produced by gitdm provide statistics on contributions by employer and individual contributor based on lines of code changed and code reviews. The document raises questions about ensuring gitdm provides an accurate view of all contributors and weighting different types of contributions.

1. Who Built Grizzly
Using gitdm to analyze OpenStack contributions
Dan Stangel / April 15, 2013
OpenStack Summit, Portland Oregon
© Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.

2. Using gitdm to measure OpenStack
contributions
© Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.

3. Gitdm – the git data miner
• Written by Linux kernel gurus Greg Kroah-Hartman and Jonathan Corbet ,
“to crank out statistics on where kernel patches come from”
• See “The Kernel Report” by Jonathan Corbet
• Forked by Mark McLoughlin (markmc), customized for use with OpenStack
• Simplistic but useful low-level git changeset analysis
• Includes tools to mine relevant data on bugs closed in LaunchPad (lpdm),
and code reviews done via Gerrit (gerritdm)
• Maps multiple emails/IDs to a single contributor, tracks dates of service
with organization
3 © Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.

4. Running gitdm
$ for project in cinder glance horizon
keystone nova quantum swift; do
git clone https://github.com/openstack/$project.git
done
$ git clone https://github.com/markmc/openstack-gitdm.git
$ cd openstack-gtidm
$ ./do-it.sh
4 © Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.

5. Gitdm report on Grizzly
Published by Mark McLoughlin (markmc) on April 4, 2013
Data Set Available Online At
https://github.com/markmc/openstack-gitdm/tree/results/grizzly
© Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.

6. Top lines changed for all Grizzly core projects by
employer
other
Core includes
nova, swift, glance,
horizon, keystone,
cinder, quantum
6 © Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.

7. Top changeset contributors for all Grizzly core
projects by employer
other
Core includes
nova, swift, glance,
horizon, keystone,
cinder, quantum
7 © Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.

8. Employers with the most hackers for Grizzly core
projects
other
Core includes
nova, swift, glance,
horizon, keystone,
cinder, quantum
8 © Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.

9. Top bugs fixed by employer for Grizzly core projects
Core includes other
nova, swift, glance,
horizon, keystone,
cinder, quantum
9 © Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.

10. Top code reviewers for Grizzly core projects by
employer other
Core includes
nova, swift, glance,
horizon, keystone,
cinder, quantum
10 © Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.

11. Configuring gitdm
© Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.

12. Configuring gitdm – What’s in a release
$ vi openstack-gitdm/openstack-config/grizzly
# project revisions
nova 2012.2..2013.1.rc2 (a701771|..big list of excludes..|5d9a5d1)
glance 2012.2..2013.1.rc2
swift 1.7.4..1.8.0.rc2
keystone 2012.2..2013.1.rc2 (bec8b31|..big list of excludes..|23bb7ec)
horizon 2012.2..2013.1.rc2
quantum 2012.2..2013.1.rc2 (9f55912|..big list of excludes..|02fbf7d)
cinder 2012.2..2013.1.rc3
12 © Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.

13. Configuring gitdm – Who’s who
$ vi openstack-gitdm/openstack-config/aliases
#
# This is the email aliases file, mapping secondary
# addresses onto a single, canonical address.
#
john.doe@example.com john_doe@company_a.com
johndoe@gmail.com john_doe@company_a.com
jane-doe@example.ru jane.doe@some_organization.org
...
13 © Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.

14. Configuring gitdm – Who’s who in LaunchPad
$ vi openstack-gitdm/openstack-config/launchpad-ids.txt
johndoe john_doe@company_a.com
janedoe77 jane.doe@some_organization.org
...
14 © Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.

15. Configuring gitdm – Who works for who
$ vi openstack-gitdm/openstack-config/email-map
# [user@]domain employer [< yyyy-mm-dd]
johndoe@gmail.com Company A
johndoe@gmail.com Another Company < 2012-07-01
jane.doe@some_organization.org SomeOrg
...
15 © Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.

16. Configuring gitdm – Which orgs are which
$ vi openstack-gitdm/openstack-config/domain-map
# domain employer [< yyyy-mm-dd]
was_company_a.com Company A < 2011-12-31
company_a.com Company A
mail.company_a.com Company A
labs.company_a.com Company A
some_organization.org SomeOrg
...
16 © Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.

17. Opportunities for Improvement
© Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.

18. Measure all of OpenStack – 50 projects in Grizzly
• Including all of the OpenStack projects will provide a complete
picture of a rapidly growing community
Integrated (7) Library (7) Documentation (8) Infrastructure (20)
OpenStack compute OpenStack common OpenStack-manuals config
OpenStack object storage python-*-client api-site zuul
OpenStack Image Service *-api jeepyb
OpenStack Identity Gating (4) devstack-gate
OpenStack Dashboard devstack Incubated (4) gear
OpenStack Networking tempest Ceilometer jenkins-job-builder
OpenStack Block Storage OpenStack-nose Heat gerrit
OpenStack-requirements Python ceilometer client git-review
Python heat client reviewday
…
18 © Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.

19. Some Questions to Consider
When is a defect “done” Can we produce a Should code
and who “did” it? consistent, unified contributions be
“Fix Committed” seems to be database mapping weighted?
a logical state contributors and Lines of code does not tell the
• Assignee vs. Opener? organizations? whole story
(maybe count both) • Difficult to judge the impact of
Including dates of service
any given commit
• Centrally maintained
• Could weight using sloccount or
• Open for review
other code-quality measures
• Could devise a peer-assigned
points system via Gerrit
19 © Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.

20. Final Thought
Providing community-vetted metrics that are generated
regularly, and that are based on open source tools and open
data sources, can only help us to tell a complete and
accurate story about who is working on OpenStack.
20 © Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.

21. Thank you
© Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.