Gonzalez barahona community_board_metrics_0415162
Upcoming SlideShare
Loading in...5
×
 

Gonzalez barahona community_board_metrics_0415162

on

  • 470 views

 

Statistics

Views

Total Views
470
Slideshare-icon Views on SlideShare
470
Embed Views
0

Actions

Likes
0
Downloads
5
Comments
0

0 Embeds 0

No embeds

Accessibility

Categories

Upload Details

Uploaded via as Adobe PDF

Usage Rights

© All Rights Reserved

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Processing…
Post Comment
Edit your comment

    Gonzalez barahona community_board_metrics_0415162 Gonzalez barahona community_board_metrics_0415162 Presentation Transcript

    • Using *Grimoire to analyze OpenStack Jesus M. Gonzalez-Barahona jgb@bitergia.com http://identi.ca/jgbarah http://twitter.com/jgbarah Bitergia GSyC/LibreSoft (Universidad Rey Juan Carlos) OpenStack Summit, Portland, April 15th, 2013 OpenStack Summit Portland 2013 1/Jesus Gonzalez-Barahona (Bitergia) Using *Grimoire to analyze OpenStack 20
    • c 2012, 2013 Bitergia Some rights reserved. This presentation is distributed under the “Attribution-ShareAlike 3.0” license, by Creative Commons, available at http://creativecommons.org/licenses/by-sa/3.0/ OpenStack Summit Portland 2013 2/Jesus Gonzalez-Barahona (Bitergia) Using *Grimoire to analyze OpenStack 20
    • We’ve done the Grizzly companies analysis http://blog.bitergia.com/2013/04/04/ companies-contributing-to-openstack-grizzly-analysis/ OpenStack Summit Portland 2013 3/Jesus Gonzalez-Barahona (Bitergia) Using *Grimoire to analyze OpenStack 20
    • We’re deploying the OpenStack activity dashboard http://activity.openstack.org/dash/ OpenStack Summit Portland 2013 4/Jesus Gonzalez-Barahona (Bitergia) Using *Grimoire to analyze OpenStack 20
    • We’re deploying the OpenStack activity dashboard (2)This is a (preliminary) preview!!! http://activity.openstack.org/dash/dashboard/ OpenStack Summit Portland 2013 5/Jesus Gonzalez-Barahona (Bitergia) Using *Grimoire to analyze OpenStack 20
    • Measuring OpenStack activity Information about code, community, development for OpenStack can be retrieved, organized, analyzedLet’s do it! OpenStack Summit Portland 2013 6/Jesus Gonzalez-Barahona (Bitergia) Using *Grimoire to analyze OpenStack 20
    • Measuring OpenStack activity (why?)Why? Open development: transparency Complex information: knowledge extraction Community-based decisions: objective information Decision tracking: parameters to decide ... OpenStack Summit Portland 2013 7/Jesus Gonzalez-Barahona (Bitergia) Using *Grimoire to analyze OpenStack 20
    • Data has to be extracted, minedData lives in repositoriesusually not designed to release it easily: tools are needed to retrieve and extractData includes many complexities and details tools are needed to assist in mining, analysisAnalyze free software with free software! OpenStack Summit Portland 2013 8/Jesus Gonzalez-Barahona (Bitergia) Using *Grimoire to analyze OpenStack 20
    • The MetricsGrimoire approachSet of tools specialized in retrieving information fromdifferent kinds of repositories. Among them: CVSAnalY: source code management (CVS, Subversion, git, etc.) Bicho: issue tracking systems (Bugzilla, Jira, SourceForge, Allura, Launchpad, Google Code, etc.) & code revision systems (Gerrit) MLStats: mailing lists (mbox files, Mailman archives, etc.)Store all the information in SQL databases http://metricsgrimoire.github.com OpenStack Summit Portland 2013 9/Jesus Gonzalez-Barahona (Bitergia) Using *Grimoire to analyze OpenStack 20
    • vizGrimoire: Milking the databasesOnce information is ready for querying: it can be queried directly in the database it can be analyzed from R, Python, etc. it can be filtered, manually inspected, improved it can be combined, cross-analyzed it can be visualizedSet of tools to simplify & automate all of this https://vizgrimoire.github.com OpenStack Summit Portland 2013 10 /Jesus Gonzalez-Barahona (Bitergia) Using *Grimoire to analyze OpenStack 20
    • vizGrimoireR: statistics, chartsR package specialized in managing MetricsGrimoireinformationConnects directly to the database and: gets the information from it filters & massages it does statistical analysis on it produces charts and WebGL 3D graphs produces JSON files to export to other tools...and lets you unleash all the potential of R OpenStack Summit Portland 2013 11 /Jesus Gonzalez-Barahona (Bitergia) Using *Grimoire to analyze OpenStack 20
    • vizGrimoireJS: visualizationJavaScript library producing visualizationsRetrieves JSON files and produces: live charts: evolution, pies, bars, etc. tables and text comparative charts actionable dashboards soon to support links to information in forgeIntegration with HTML5 applications OpenStack Summit Portland 2013 12 /Jesus Gonzalez-Barahona (Bitergia) Using *Grimoire to analyze OpenStack 20
    • How the OpenStack dashboard is created Run MetricsGrimoire (CVSAnalY, Bicho, MLStats) on repositories Example: determining which git repositories to mine Produce queries specific for OpenStack Example: condition for deciding who closes a ticket Run customized Python & R scripts to produce JSON files Example: produce results per OpenStack subproject Customize vizGrimoireJS to display charts Example: remove bots from top tables Export the result via HTTP We still have performance issues...DoGonzalez-Barahona (Bitergia) Using *Grimoire to analyze OpenStack OpenStack Summit Portland 2013 20 /Jesus all of this continuously 13
    • Future features: tracking other parameters 0.99 (black) / 0.95 (green) / 0.5 (red) / 0.25 (blue) 6 5 4 3 2 2000 2002 2004 2006 2008 2010 2012 Time Time-to-close (quantiles over time): Time in minutes, log 10 scale OpenStack Summit Portland 2013 14 /Jesus Gonzalez-Barahona (Bitergia) Using *Grimoire to analyze OpenStack 20
    • Future features: tracking other parameters (2)Time-to-close (quantiles over time) OpenStack Summit Portland 2013 15 /Jesus Gonzalez-Barahona (Bitergia) Using *Grimoire to analyze OpenStack 20
    • Future features: tracking other parameters (3)Demographics (attraction rate, retention rate per generation) OpenStack Summit Portland 2013 16 /Jesus Gonzalez-Barahona (Bitergia) Using *Grimoire to analyze OpenStack 20
    • In summary... OpenStack repositories have a wealth of information We all can do (and many do) our own analysis Free software to analyze free software development Let’s define common formats to interface to different tools We can incrementally develop a powerful platform What would you like to know about OpenStack? OpenStack Summit Portland 2013 17 /Jesus Gonzalez-Barahona (Bitergia) Using *Grimoire to analyze OpenStack 20
    • Bitergia: an spin-offStarted operations in July 2012Builds on the experience of LibreSoft R&D groupOffering professional products and servicesFocused on: Metrics about software development (including community metrics) Specialized support for development forges (including metrics for projects) http://bitergia.com OpenStack Summit Portland 2013 18 /Jesus Gonzalez-Barahona (Bitergia) Using *Grimoire to analyze OpenStack 20
    • CreditsThanks go to... Many LibreSoft developers who developed MetricsGrimoire The (small) community now maintaining MetricsGrimoire Some Bitergia developers producing vizGrimoire The (future) community maintaining vizGrimoire The many free software developers who produced all the software on which these tools rely You, who are producing OpenStack http://libresoft.es http://bitergia.com OpenStack Summit Portland 2013 19 /Jesus Gonzalez-Barahona (Bitergia) Using *Grimoire to analyze OpenStack 20
    • This is the end, my friend Please, provide *any* feedback [I would love to know what interested you the most] [...and the least] Final note: Let’s find ways to understand OpenStack a bit better OpenStack Summit Portland 2013 20 /Jesus Gonzalez-Barahona (Bitergia) Using *Grimoire to analyze OpenStack 20