Map of the Perl and CPAN community

Introduction Distribution’s map Author’s map Map of the web community Perl and its community Franck Cuny franck.cuny@rtgi.fr RTGI July 31, 2009 Franck Cuny franck.cuny@rtgi.fr RTGI Perl and its community

Introduction Distribution’s map Author’s map Map of the web community Why study the CPAN community ? RTGI creates and sells tools to analyze the social web Franck Cuny franck.cuny@rtgi.fr RTGI Perl and its community

Introduction Distribution’s map Author’s map Map of the web community Why study the CPAN community ? RTGI creates and sells tools to analyze the social web Been using Perl for the last 3 years Franck Cuny franck.cuny@rtgi.fr RTGI Perl and its community

Introduction Distribution’s map Author’s map Map of the web community Why study the CPAN community ? RTGI creates and sells tools to analyze the social web Been using Perl for the last 3 years Experience in datamining and mapping web communities Franck Cuny franck.cuny@rtgi.fr RTGI Perl and its community

Introduction Distribution’s map Author’s map Map of the web community The Perl community from a CPAN perspective Quick notes about CPAN Franck Cuny franck.cuny@rtgi.fr RTGI Perl and its community

Introduction Distribution’s map Author’s map Map of the web community The Perl community from a CPAN perspective Quick notes about CPAN 11 years of existence Franck Cuny franck.cuny@rtgi.fr RTGI Perl and its community

Introduction Distribution’s map Author’s map Map of the web community The Perl community from a CPAN perspective Quick notes about CPAN 11 years of existence > 15000 distributions Franck Cuny franck.cuny@rtgi.fr RTGI Perl and its community

Introduction Distribution’s map Author’s map Map of the web community The Perl community from a CPAN perspective Quick notes about CPAN 11 years of existence > 15000 distributions > 7000 authors Franck Cuny franck.cuny@rtgi.fr RTGI Perl and its community

Introduction Distribution’s map Author’s map Map of the web community The Perl community from a CPAN perspective Quick notes about CPAN 11 years of existence > 15000 distributions > 7000 authors Tools for developers and users (RT, CPANTS, etc.) Franck Cuny franck.cuny@rtgi.fr RTGI Perl and its community

Introduction Distribution’s map Author’s map Map of the web community The Perl community from a CPAN perspective Quick notes about CPAN 11 years of existence > 15000 distributions > 7000 authors Tools for developers and users (RT, CPANTS, etc.) But there is little informations on the actors of the community : Franck Cuny franck.cuny@rtgi.fr RTGI Perl and its community

Introduction Distribution’s map Author’s map Map of the web community The Perl community from a CPAN perspective Quick notes about CPAN 11 years of existence > 15000 distributions > 7000 authors Tools for developers and users (RT, CPANTS, etc.) But there is little informations on the actors of the community : No metrics (except Kwalitee) Franck Cuny franck.cuny@rtgi.fr RTGI Perl and its community

Introduction Distribution’s map Author’s map Map of the web community The Perl community from a CPAN perspective Quick notes about CPAN 11 years of existence > 15000 distributions > 7000 authors Tools for developers and users (RT, CPANTS, etc.) But there is little informations on the actors of the community : No metrics (except Kwalitee) No dependency graphs between modules Franck Cuny franck.cuny@rtgi.fr RTGI Perl and its community

Introduction Distribution’s map Author’s map Map of the web community The Perl community from a CPAN perspective Quick notes about CPAN 11 years of existence > 15000 distributions > 7000 authors Tools for developers and users (RT, CPANTS, etc.) But there is little informations on the actors of the community : No metrics (except Kwalitee) No dependency graphs between modules No social tools (eg. GitHub) Franck Cuny franck.cuny@rtgi.fr RTGI Perl and its community

Introduction Distribution’s map Author’s map Map of the web community Our datasource First version (presented during the FPW09) used CPANTS’ data Franck Cuny franck.cuny@rtgi.fr RTGI Perl and its community

Introduction Distribution’s map Author’s map Map of the web community Our datasource First version (presented during the FPW09) used CPANTS’ data This time I decided to use CPANDB and Task::Kensho. Franck Cuny franck.cuny@rtgi.fr RTGI Perl and its community

Introduction Distribution’s map Author’s map Map of the web community Our datasource First version (presented during the FPW09) used CPANTS’ data This time I decided to use CPANDB and Task::Kensho. 3 maps have been created : Franck Cuny franck.cuny@rtgi.fr RTGI Perl and its community

Introduction Distribution’s map Author’s map Map of the web community Our datasource First version (presented during the FPW09) used CPANTS’ data This time I decided to use CPANDB and Task::Kensho. 3 maps have been created : Distributions’ map Franck Cuny franck.cuny@rtgi.fr RTGI Perl and its community

Introduction Distribution’s map Author’s map Map of the web community Our datasource First version (presented during the FPW09) used CPANTS’ data This time I decided to use CPANDB and Task::Kensho. 3 maps have been created : Distributions’ map Authors’ map Franck Cuny franck.cuny@rtgi.fr RTGI Perl and its community

Introduction Distribution’s map Author’s map Map of the web community Our datasource First version (presented during the FPW09) used CPANTS’ data This time I decided to use CPANDB and Task::Kensho. 3 maps have been created : Distributions’ map Authors’ map Web community’s map Franck Cuny franck.cuny@rtgi.fr RTGI Perl and its community

Introduction Distribution’s map Author’s map Map of the web community How the map is created Use of modules listed in Task::Kensho as a seed. Franck Cuny franck.cuny@rtgi.fr RTGI Perl and its community

Introduction Distribution’s map Author’s map Map of the web community How the map is created Use of modules listed in Task::Kensho as a seed. A node represents a distribution. Its diameter depends on the total number of distributions using it Franck Cuny franck.cuny@rtgi.fr RTGI Perl and its community

Introduction Distribution’s map Author’s map Map of the web community How the map is created Use of modules listed in Task::Kensho as a seed. A node represents a distribution. Its diameter depends on the total number of distributions using it An edge represents a dependency between two distributions Franck Cuny franck.cuny@rtgi.fr RTGI Perl and its community

Introduction Distribution’s map Author’s map Map of the web community How the map is created Use of modules listed in Task::Kensho as a seed. A node represents a distribution. Its diameter depends on the total number of distributions using it An edge represents a dependency between two distributions Edges are not weighted Franck Cuny franck.cuny@rtgi.fr RTGI Perl and its community

Introduction Distribution’s map Author’s map Map of the web community How the map is created Use of modules listed in Task::Kensho as a seed. A node represents a distribution. Its diameter depends on the total number of distributions using it An edge represents a dependency between two distributions Edges are not weighted Spatialization with Gephi1 (force-directed : nodes rejected themselves, and edges bound them) 1 http://gephi.org/ Franck Cuny franck.cuny@rtgi.fr RTGI Perl and its community

Introduction Distribution’s map Author’s map Map of the web community How to read this map Most important cluster : Tests::* modules (Test::POD, Test::Exception, ... ) Franck Cuny franck.cuny@rtgi.fr RTGI Perl and its community

Introduction Distribution’s map Author’s map Map of the web community How to read this map Most important cluster : Tests::* modules (Test::POD, Test::Exception, ... ) On the left, a cluster of web distributions (LWP, HTML::Parser, WWW::Mechanize, Catalyst, etc.) Franck Cuny franck.cuny@rtgi.fr RTGI Perl and its community

Introduction Distribution’s map Author’s map Map of the web community How to read this map Most important cluster : Tests::* modules (Test::POD, Test::Exception, ... ) On the left, a cluster of web distributions (LWP, HTML::Parser, WWW::Mechanize, Catalyst, etc.) Moose, with a lot of MooseX::* distributions, close to DBIx::Class Franck Cuny franck.cuny@rtgi.fr RTGI Perl and its community

Introduction Distribution’s map Author’s map Map of the web community How to read this map Most important cluster : Tests::* modules (Test::POD, Test::Exception, ... ) On the left, a cluster of web distributions (LWP, HTML::Parser, WWW::Mechanize, Catalyst, etc.) Moose, with a lot of MooseX::* distributions, close to DBIx::Class POE distribtions, with few connections to the other distributions Franck Cuny franck.cuny@rtgi.fr RTGI Perl and its community

Introduction Distribution’s map Author’s map Map of the web community How to read the map Zoom on modern Perl Moose and MooseX::* extensions Franck Cuny franck.cuny@rtgi.fr RTGI Perl and its community

Introduction Distribution’s map Author’s map Map of the web community How to read the map Zoom on modern Perl Moose and MooseX::* extensions Close to Catalyst, web framework Franck Cuny franck.cuny@rtgi.fr RTGI Perl and its community

Introduction Distribution’s map Author’s map Map of the web community How to read the map Zoom on modern Perl Moose and MooseX::* extensions Close to Catalyst, web framework really close to DBIx::Class, even if there is no Moose code in DBIx::Class Franck Cuny franck.cuny@rtgi.fr RTGI Perl and its community

Introduction Distribution’s map Author’s map Map of the web community How to read the map Zoom on modern Perl Moose and MooseX::* extensions Close to Catalyst, web framework really close to DBIx::Class, even if there is no Moose code in DBIx::Class Note Thoses 3 projects are developped by the same group of people Franck Cuny franck.cuny@rtgi.fr RTGI Perl and its community

Introduction Distribution’s map Author’s map Map of the web community How to read the authors map Zoom on POE Group of POE modules at the bottom of the map Franck Cuny franck.cuny@rtgi.fr RTGI Perl and its community

Introduction Distribution’s map Author’s map Map of the web community How to read the authors map Zoom on POE Group of POE modules at the bottom of the map Not quite linked to the others modules Franck Cuny franck.cuny@rtgi.fr RTGI Perl and its community

Introduction Distribution’s map Author’s map Map of the web community How to read the authors map Zoom on POE Group of POE modules at the bottom of the map Not quite linked to the others modules Important and independent community Franck Cuny franck.cuny@rtgi.fr RTGI Perl and its community

Introduction Distribution’s map Author’s map Map of the web community How the map was created Use of the authors from the distributions map Franck Cuny franck.cuny@rtgi.fr RTGI Perl and its community

Introduction Distribution’s map Author’s map Map of the web community How the map was created Use of the authors from the distributions map A node represents an author. The diameter is proportional to the use of this author’s modules by others. The size of the label depends on the number of inbound links. The color of the node represent the average kwalitee of the author Franck Cuny franck.cuny@rtgi.fr RTGI Perl and its community

Introduction Distribution’s map Author’s map Map of the web community How the map was created Use of the authors from the distributions map A node represents an author. The diameter is proportional to the use of this author’s modules by others. The size of the label depends on the number of inbound links. The color of the node represent the average kwalitee of the author An edge represents the use of a module by an author. the thickness of an edge is proportional to the number of modules used by an author of another author Franck Cuny franck.cuny@rtgi.fr RTGI Perl and its community

Introduction Distribution’s map Author’s map Map of the web community How the map was created Use of the authors from the distributions map A node represents an author. The diameter is proportional to the use of this author’s modules by others. The size of the label depends on the number of inbound links. The color of the node represent the average kwalitee of the author An edge represents the use of a module by an author. the thickness of an edge is proportional to the number of modules used by an author of another author Edges are weighted Franck Cuny franck.cuny@rtgi.fr RTGI Perl and its community

Introduction Distribution’s map Author’s map Map of the web community How the map was created Use of the authors from the distributions map A node represents an author. The diameter is proportional to the use of this author’s modules by others. The size of the label depends on the number of inbound links. The color of the node represent the average kwalitee of the author An edge represents the use of a module by an author. the thickness of an edge is proportional to the number of modules used by an author of another author Edges are weighted Spatialization with Gephi (force-directed) Franck Cuny franck.cuny@rtgi.fr RTGI Perl and its community

Introduction Distribution’s map Author’s map Map of the web community How to read the map A list of outstanding authors Franck Cuny franck.cuny@rtgi.fr RTGI Perl and its community

Introduction Distribution’s map Author’s map Map of the web community How to read the map A list of outstanding authors Gisle Aas (main developper for LWP and URI) Franck Cuny franck.cuny@rtgi.fr RTGI Perl and its community

Introduction Distribution’s map Author’s map Map of the web community How to read the map A list of outstanding authors Gisle Aas (main developper for LWP and URI) Dave Rolsky (DateTime, Moose, ...) Franck Cuny franck.cuny@rtgi.fr RTGI Perl and its community

Introduction Distribution’s map Author’s map Map of the web community How to read the map A list of outstanding authors Gisle Aas (main developper for LWP and URI) Dave Rolsky (DateTime, Moose, ...) Adam Kennedy (one of the biggest contributors to the CPAN, > 200 distributions !) Franck Cuny franck.cuny@rtgi.fr RTGI Perl and its community

Introduction Distribution’s map Author’s map Map of the web community How to read the map A list of outstanding authors Gisle Aas (main developper for LWP and URI) Dave Rolsky (DateTime, Moose, ...) Adam Kennedy (one of the biggest contributors to the CPAN, > 200 distributions !) Steven Little (Moose, Class::MOP, ...) Franck Cuny franck.cuny@rtgi.fr RTGI Perl and its community

Introduction Distribution’s map Author’s map Map of the web community How to read the map A list of outstanding authors Gisle Aas (main developper for LWP and URI) Dave Rolsky (DateTime, Moose, ...) Adam Kennedy (one of the biggest contributors to the CPAN, > 200 distributions !) Steven Little (Moose, Class::MOP, ...) Adrian Howard (Test::Class, Test::Exception) Franck Cuny franck.cuny@rtgi.fr RTGI Perl and its community

Introduction Distribution’s map Author’s map Map of the web community How to read the authors map Zoom on modern Perl Group of developers who work on Moose, Catalyst, DBIx::Class Franck Cuny franck.cuny@rtgi.fr RTGI Perl and its community

Introduction Distribution’s map Author’s map Map of the web community How to read the authors map Zoom on modern Perl Group of developers who work on Moose, Catalyst, DBIx::Class Top of the map, with Steven Little, Marcus Ramberg, Yuval Kogman, Ash Berlin, Jonatan Rockway, J. Shirley, Florian Ragwitz, ... Franck Cuny franck.cuny@rtgi.fr RTGI Perl and its community

Introduction Distribution’s map Author’s map Map of the web community How to read the authors map Zoom on modern Perl Group of developers who work on Moose, Catalyst, DBIx::Class Top of the map, with Steven Little, Marcus Ramberg, Yuval Kogman, Ash Berlin, Jonatan Rockway, J. Shirley, Florian Ragwitz, ... The group is structured, they are well connected Franck Cuny franck.cuny@rtgi.fr RTGI Perl and its community

Introduction Distribution’s map Author’s map Map of the web community How to read the authors map Zoom on POE Group of developers on the right of the map Franck Cuny franck.cuny@rtgi.fr RTGI Perl and its community

Introduction Distribution’s map Author’s map Map of the web community How to read the authors map Zoom on POE Group of developers on the right of the map Rocco Caputo main developper Franck Cuny franck.cuny@rtgi.fr RTGI Perl and its community

Introduction Distribution’s map Author’s map Map of the web community How to read the authors map Zoom on POE Group of developers on the right of the map Rocco Caputo main developper Zoﬃx and Chris Williams develop a lot of POE modules Franck Cuny franck.cuny@rtgi.fr RTGI Perl and its community

Introduction Distribution’s map Author’s map Map of the web community How to read the authors map Zoom on POE Group of developers on the right of the map Rocco Caputo main developper Zoﬃx and Chris Williams develop a lot of POE modules They are on the equator of the map Franck Cuny franck.cuny@rtgi.fr RTGI Perl and its community

Introduction Distribution’s map Author’s map Map of the web community How we created the web community map A web crawl from the CPAN’s authors pages ( 700 authors) Franck Cuny franck.cuny@rtgi.fr RTGI Perl and its community

Introduction Distribution’s map Author’s map Map of the web community How we created the web community map A web crawl from the CPAN’s authors pages ( 700 authors) A node represents a site, its diameter is based on the number of inbound links Franck Cuny franck.cuny@rtgi.fr RTGI Perl and its community

Introduction Distribution’s map Author’s map Map of the web community How we created the web community map A web crawl from the CPAN’s authors pages ( 700 authors) A node represents a site, its diameter is based on the number of inbound links An edge represents a hyperlink from one site to another Franck Cuny franck.cuny@rtgi.fr RTGI Perl and its community

Introduction Distribution’s map Author’s map Map of the web community How we created the web community map A web crawl from the CPAN’s authors pages ( 700 authors) A node represents a site, its diameter is based on the number of inbound links An edge represents a hyperlink from one site to another Edge are not weighted Franck Cuny franck.cuny@rtgi.fr RTGI Perl and its community

Introduction Distribution’s map Author’s map Map of the web community How we created the web community map A web crawl from the CPAN’s authors pages ( 700 authors) A node represents a site, its diameter is based on the number of inbound links An edge represents a hyperlink from one site to another Edge are not weighted Spatialization with Gephi (force-directed) Franck Cuny franck.cuny@rtgi.fr RTGI Perl and its community

Introduction Distribution’s map Author’s map Map of the web community How to read the map Five communities : Franck Cuny franck.cuny@rtgi.fr RTGI Perl and its community

Introduction Distribution’s map Author’s map Map of the web community How to read the map Five communities : CPAN’s authors Franck Cuny franck.cuny@rtgi.fr RTGI Perl and its community

Introduction Distribution’s map Author’s map Map of the web community How to read the map Five communities : CPAN’s authors Community and oﬃcials Franck Cuny franck.cuny@rtgi.fr RTGI Perl and its community

Introduction Distribution’s map Author’s map Map of the web community How to read the map Five communities : CPAN’s authors Community and oﬃcials Perl Bloggers Franck Cuny franck.cuny@rtgi.fr RTGI Perl and its community

Introduction Distribution’s map Author’s map Map of the web community How to read the map Five communities : CPAN’s authors Community and oﬃcials Perl Bloggers Opensource world Franck Cuny franck.cuny@rtgi.fr RTGI Perl and its community

Introduction Distribution’s map Author’s map Map of the web community How to read the map Five communities : CPAN’s authors Community and oﬃcials Perl Bloggers Opensource world Enterprise Franck Cuny franck.cuny@rtgi.fr RTGI Perl and its community

Introduction Distribution’s map Author’s map Map of the web community How to read the map Two gatekeepers : Franck Cuny franck.cuny@rtgi.fr RTGI Perl and its community

Introduction Distribution’s map Author’s map Map of the web community How to read the map Two gatekeepers : perl.org : open on the community and Perl bloggers Franck Cuny franck.cuny@rtgi.fr RTGI Perl and its community

Introduction Distribution’s map Author’s map Map of the web community How to read the map Two gatekeepers : perl.org : open on the community and Perl bloggers cpan.org : open on the opensource community Franck Cuny franck.cuny@rtgi.fr RTGI Perl and its community

Introduction Distribution’s map Author’s map Map of the web community How to read the map Two gatekeepers : perl.org : open on the community and Perl bloggers cpan.org : open on the opensource community Penetration of CPAN’s authors pages is low: GitHub has become a dominant tool Franck Cuny franck.cuny@rtgi.fr RTGI Perl and its community

Introduction Distribution’s map Author’s map Map of the web community How to read the map Two gatekeepers : perl.org : open on the community and Perl bloggers cpan.org : open on the opensource community Penetration of CPAN’s authors pages is low: GitHub has become a dominant tool Companies locations, diﬀerences between promotion and use Franck Cuny franck.cuny@rtgi.fr RTGI Perl and its community

Introduction Distribution’s map Author’s map Map of the web community How to read the map Two gatekeepers : perl.org : open on the community and Perl bloggers cpan.org : open on the opensource community Penetration of CPAN’s authors pages is low: GitHub has become a dominant tool Companies locations, diﬀerences between promotion and use Opensource company Franck Cuny franck.cuny@rtgi.fr RTGI Perl and its community

Introduction Distribution’s map Author’s map Map of the web community How to read the map Two gatekeepers : perl.org : open on the community and Perl bloggers cpan.org : open on the opensource community Penetration of CPAN’s authors pages is low: GitHub has become a dominant tool Companies locations, diﬀerences between promotion and use Opensource company Company that employs Perl developers (SixApart, NYT, BBC) Franck Cuny franck.cuny@rtgi.fr RTGI Perl and its community

Introduction Distribution’s map Author’s map Map of the web community How to read the map Two gatekeepers : perl.org : open on the community and Perl bloggers cpan.org : open on the opensource community Penetration of CPAN’s authors pages is low: GitHub has become a dominant tool Companies locations, diﬀerences between promotion and use Opensource company Company that employs Perl developers (SixApart, NYT, BBC) Comany that promote the use of Perl: (Booking and Perl conferences, Iinteractive, Shadowcat) Franck Cuny franck.cuny@rtgi.fr RTGI Perl and its community

Introduction Distribution’s map Author’s map Map of the web community How to read the map Zoom on modern Perl The modern Perl exists also in this map. Structured around inﬂuent bloggers and companies (Iinteractive and shadowcat) Franck Cuny franck.cuny@rtgi.fr RTGI Perl and its community

Introduction Distribution’s map Author’s map Map of the web community How to read the map Zoom on modern Perl The modern Perl exists also in this map. Structured around inﬂuent bloggers and companies (Iinteractive and shadowcat) Proximity betweens blogs Franck Cuny franck.cuny@rtgi.fr RTGI Perl and its community

Introduction Distribution’s map Author’s map Map of the web community Conclusion The CPAN community is already structured and alive Franck Cuny franck.cuny@rtgi.fr RTGI Perl and its community

Introduction Distribution’s map Author’s map Map of the web community Conclusion The CPAN community is already structured and alive The modern Perl is a growing movement Franck Cuny franck.cuny@rtgi.fr RTGI Perl and its community

Introduction Distribution’s map Author’s map Map of the web community Thanks! http://cpan-explorer.org/ http://labs.rtgi.eu/yapceu09/ http://gephi.org/ Franck Cuny franck.cuny@rtgi.fr RTGI Perl and its community

Map of the Perl and CPAN community

0 comments

Notes on slide 1

1 Favorite