Who Built Grizzly Using gitdm to analyze OpenStack contributions Dan Stangel / April 15, 2013 OpenStack Summit, Portland O...
Using gitdm to measure OpenStackcontributions© Copyright 2013 Hewlett-Packard Development Company, L.P. The information co...
Gitdm – the git data miner• Written by Linux kernel gurus Greg Kroah-Hartman and Jonathan Corbet ,  “to crank out statisti...
Running gitdm    $ for project in cinder glance horizon                      keystone nova quantum swift; do          git ...
Gitdm report on Grizzly   Published by Mark McLoughlin (markmc) on April 4, 2013   Data Set Available Online At   https://...
Top lines changed for all Grizzly core projects byemployer                                                                ...
Top changeset contributors for all Grizzly coreprojects by employer                                                       ...
Employers with the most hackers for Grizzly coreprojects                                                                  ...
Top bugs fixed by employer for Grizzly core projectsCore includes                                                         ...
Top code reviewers for Grizzly core projects byemployer                   otherCore includesnova, swift, glance,horizon, k...
Configuring gitdm© Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to...
Configuring gitdm – What’s in a release     $ vi openstack-gitdm/openstack-config/grizzly         # project revisions     ...
Configuring gitdm – Who’s who     $ vi openstack-gitdm/openstack-config/aliases         #         # This is the email alia...
Configuring gitdm – Who’s who in LaunchPad     $ vi openstack-gitdm/openstack-config/launchpad-ids.txt         johndoe joh...
Configuring gitdm – Who works for who     $ vi openstack-gitdm/openstack-config/email-map          # [user@]domain employe...
Configuring gitdm – Which orgs are which     $ vi openstack-gitdm/openstack-config/domain-map          # domain employer [...
Opportunities for Improvement© Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein i...
Measure all of OpenStack – 50 projects in Grizzly     • Including all of the OpenStack projects will provide a complete   ...
Some Questions to ConsiderWhen is a defect “done”                                                    Can we produce a     ...
Final ThoughtProviding community-vetted metrics that are generatedregularly, and that are based on open source tools and o...
Thank you© Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change ...
Upcoming SlideShare
Loading in...5
×

Who Built Grizzly

1,540

Published on

Published in: Technology, Business
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total Views
1,540
On Slideshare
0
From Embeds
0
Number of Embeds
0
Actions
Shares
0
Downloads
25
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

Who Built Grizzly

  1. 1. Who Built Grizzly Using gitdm to analyze OpenStack contributions Dan Stangel / April 15, 2013 OpenStack Summit, Portland Oregon© Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
  2. 2. Using gitdm to measure OpenStackcontributions© Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
  3. 3. Gitdm – the git data miner• Written by Linux kernel gurus Greg Kroah-Hartman and Jonathan Corbet , “to crank out statistics on where kernel patches come from” • See “The Kernel Report” by Jonathan Corbet• Forked by Mark McLoughlin (markmc), customized for use with OpenStack• Simplistic but useful low-level git changeset analysis• Includes tools to mine relevant data on bugs closed in LaunchPad (lpdm), and code reviews done via Gerrit (gerritdm)• Maps multiple emails/IDs to a single contributor, tracks dates of service with organization3 © Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
  4. 4. Running gitdm $ for project in cinder glance horizon keystone nova quantum swift; do git clone https://github.com/openstack/$project.git done $ git clone https://github.com/markmc/openstack-gitdm.git $ cd openstack-gtidm $ ./do-it.sh4 © Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
  5. 5. Gitdm report on Grizzly Published by Mark McLoughlin (markmc) on April 4, 2013 Data Set Available Online At https://github.com/markmc/openstack-gitdm/tree/results/grizzly© Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
  6. 6. Top lines changed for all Grizzly core projects byemployer otherCore includesnova, swift, glance,horizon, keystone,cinder, quantum6 © Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
  7. 7. Top changeset contributors for all Grizzly coreprojects by employer otherCore includesnova, swift, glance,horizon, keystone,cinder, quantum7 © Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
  8. 8. Employers with the most hackers for Grizzly coreprojects otherCore includesnova, swift, glance,horizon, keystone,cinder, quantum8 © Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
  9. 9. Top bugs fixed by employer for Grizzly core projectsCore includes othernova, swift, glance,horizon, keystone,cinder, quantum9 © Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
  10. 10. Top code reviewers for Grizzly core projects byemployer otherCore includesnova, swift, glance,horizon, keystone,cinder, quantum10 © Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
  11. 11. Configuring gitdm© Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
  12. 12. Configuring gitdm – What’s in a release $ vi openstack-gitdm/openstack-config/grizzly # project revisions nova 2012.2..2013.1.rc2 (a701771|..big list of excludes..|5d9a5d1) glance 2012.2..2013.1.rc2 swift 1.7.4..1.8.0.rc2 keystone 2012.2..2013.1.rc2 (bec8b31|..big list of excludes..|23bb7ec) horizon 2012.2..2013.1.rc2 quantum 2012.2..2013.1.rc2 (9f55912|..big list of excludes..|02fbf7d) cinder 2012.2..2013.1.rc312 © Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
  13. 13. Configuring gitdm – Who’s who $ vi openstack-gitdm/openstack-config/aliases # # This is the email aliases file, mapping secondary # addresses onto a single, canonical address. # john.doe@example.com john_doe@company_a.com johndoe@gmail.com john_doe@company_a.com jane-doe@example.ru jane.doe@some_organization.org ...13 © Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
  14. 14. Configuring gitdm – Who’s who in LaunchPad $ vi openstack-gitdm/openstack-config/launchpad-ids.txt johndoe john_doe@company_a.com janedoe77 jane.doe@some_organization.org ...14 © Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
  15. 15. Configuring gitdm – Who works for who $ vi openstack-gitdm/openstack-config/email-map # [user@]domain employer [< yyyy-mm-dd] johndoe@gmail.com Company A johndoe@gmail.com Another Company < 2012-07-01 jane.doe@some_organization.org SomeOrg ...15 © Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
  16. 16. Configuring gitdm – Which orgs are which $ vi openstack-gitdm/openstack-config/domain-map # domain employer [< yyyy-mm-dd] was_company_a.com Company A < 2011-12-31 company_a.com Company A mail.company_a.com Company A labs.company_a.com Company A some_organization.org SomeOrg ...16 © Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
  17. 17. Opportunities for Improvement© Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
  18. 18. Measure all of OpenStack – 50 projects in Grizzly • Including all of the OpenStack projects will provide a complete picture of a rapidly growing community Integrated (7) Library (7) Documentation (8) Infrastructure (20) OpenStack compute OpenStack common OpenStack-manuals config OpenStack object storage python-*-client api-site zuul OpenStack Image Service *-api jeepyb OpenStack Identity Gating (4) devstack-gate OpenStack Dashboard devstack Incubated (4) gear OpenStack Networking tempest Ceilometer jenkins-job-builder OpenStack Block Storage OpenStack-nose Heat gerrit OpenStack-requirements Python ceilometer client git-review Python heat client reviewday …18 © Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
  19. 19. Some Questions to ConsiderWhen is a defect “done” Can we produce a Should codeand who “did” it? consistent, unified contributions be“Fix Committed” seems to be database mapping weighted?a logical state contributors and Lines of code does not tell the• Assignee vs. Opener? organizations? whole story (maybe count both) • Difficult to judge the impact of Including dates of service any given commit • Centrally maintained • Could weight using sloccount or • Open for review other code-quality measures • Could devise a peer-assigned points system via Gerrit19 © Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
  20. 20. Final ThoughtProviding community-vetted metrics that are generatedregularly, and that are based on open source tools and opendata sources, can only help us to tell a complete andaccurate story about who is working on OpenStack.20 © Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
  21. 21. Thank you© Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
  1. A particular slide catching your eye?

    Clipping is a handy way to collect important slides you want to go back to later.

×