Enhancing Worker Digital Experience: A Hands-on Workshop for Partners
Jailbreaking the Forges : project export/import efforts
1. Jailbreaking
the Forges :
project ex-
port/import
efforts
Olivier
Berger,
Telecom
SudParis
Jailbreaking the Forges : project export/import
Introduction
Foreword
About
efforts
COCLICO
Issues
Still too much
lock-in
Who cares ?
Olivier Berger, Telecom SudParis
Freedom vs
Hosted
Forge
proliferation
Efforts
COCLICO’s
Staurday 24/09/2011
ForgePlucker
Interoperability
Techniques
Forge
ontology
Implementations
Join in !
2. Jailbreaking
the Forges :
project ex-
port/import
Who’s tweeting now
efforts
Olivier
Berger,
Telecom
SudParis
• Institut TELECOM / TELECOM SudParis /
Computer Science dept.
Introduction
Foreword
• Research on collaborative development
About
COCLICO
platforms, tools, process, in FLOSS
Issues communities
Still too much
lock-in • Previously worked in service companies (Cap
Who cares ?
Freedom vs
Hosted
Gemini, IDEALX)
Forge
proliferation
• At TELECOM SudParis since 2002
Efforts
COCLICO’s • R&D on FLOSS, forges, bugtracking, Linked
ForgePlucker
Interoperability
Data, etc. (CALIBRE, HELIOS, COCLICO)
Techniques
Forge
ontology
• Contributor to Debian, FusionForge,
Implementations ForgePlucker, Eclipse Lyo, OSLC
Join in !
3. Jailbreaking
the Forges :
project ex-
port/import
About COCLICO
efforts
Olivier
Berger,
Telecom
SudParis
Introduction
Foreword
About
COCLICO
Issues
Still too much
lock-in
Who cares ? http://www.coclico-project.org/
Freedom vs
Hosted
Forge
proliferation
Efforts The Coclico project aims to reinforce software forges
COCLICO’s
ForgePlucker communities by structuring an open source ecosystem
Interoperability for which a critical mass exists in France.
Techniques
Forge
ontology
Implementations
Join in !
4. Jailbreaking
the Forges :
project ex-
port/import
Quick poll
efforts
Olivier
Berger,
Telecom
SudParis
Introduction
Foreword
About
COCLICO
Issues
Still too much
lock-in
Which forges are you using ?
Who cares ?
Freedom vs
Hosted
Forge
proliferation
Efforts
COCLICO’s
ForgePlucker
Interoperability
Techniques
Forge
ontology
Implementations
Join in !
5. Jailbreaking
the Forges :
project ex-
port/import
Sharing some ideas with you
efforts
Olivier
Berger,
Telecom
SudParis
Introduction Forges are great
Foreword
About
COCLICO
There are still some issues :
Issues • Features
Still too much
lock-in
Who cares ?
• Project lock-in
Freedom vs
Hosted
Forge
How to move a project from one forge to the other ?
proliferation
• Silos
Efforts
COCLICO’s • APIs : scraping, SOAP, XMLRPC :-/
ForgePlucker
Interoperability
Techniques
Forge
ontology
Implementations
Join in !
6. Jailbreaking
the Forges :
project ex-
port/import
Project lock-in
efforts
Olivier
Berger,
Telecom
SudParis
Introduction
Foreword
About
• There’s still too much lock-in
COCLICO
Issues
• Even if not lock-in, too much entropy generated
Still too much
lock-in • Who’s caring ?
Who cares ?
Freedom vs
Hosted
• Since 2003 (CoopX initiative)
Forge
proliferation
...
Efforts • to 2010 (COCLICO, ongoing work)
COCLICO’s
ForgePlucker
Interoperability
Techniques
Forge
ontology
Implementations
Join in !
7. Jailbreaking
the Forges :
project ex-
port/import
Who cares if migration is
efforts
Olivier
impossible ?
Berger,
Telecom
SudParis
Introduction
Foreword
About
COCLICO
Issues
Still too much
lock-in
Who cares ?
Freedom vs
Hosted
Forge
proliferation
Efforts
COCLICO’s
ForgePlucker
Interoperability
Techniques
Forge
ontology
Implementations
Join in !
8. Jailbreaking
the Forges :
project ex-
port/import
Excerpt from the
efforts
Olivier
DocumentFoundation / LibreOffice
Berger,
Telecom FAQ
SudParis
Introduction
Foreword
About
COCLICO http ://www.documentfoundation.org/faq/ (sept. 30 2010)
Issues
Still too much
lock-in
Who cares ?
Q : Why are you building a new web infrastructure ?
Freedom vs
Hosted
A : Since Oracle’s takeover of Sun Microsystems, the
Forge
proliferation Community has been under “notice to quit” from our
Efforts previous Collabnet infrastructure. With today’s
COCLICO’s
ForgePlucker announcement of a Foundation, we now have an
Interoperability entity which can own our emerging new infrastructure.
Techniques
Forge
ontology
Implementations
Join in !
9. Jailbreaking
the Forges :
project ex-
port/import
ESR dixit :
efforts
Olivier
Berger,
Telecom
SudParis
Introduction
Foreword
Eric (ESR) Raymond
About
COCLICO
“Three Systemic Problems with Open-Source Hosting Sites” 1
Issues
Still too much
lock-in
1 Hosting Sites Are Data Jails
Who cares ?
Freedom vs
2 Hosting Sites have Poor Scriptability
Hosted
Forge 3 Hosting Sites Have Inadequate Support for
proliferation
Efforts
Immigration
COCLICO’s
ForgePlucker
Interoperability
Techniques
Forge
ontology
Implementations
Join in !
1. http ://esr.ibiblio.org/ ?p=1282
10. Jailbreaking
the Forges :
project ex-
port/import
Git ?
efforts
Olivier
Berger,
Telecom
SudParis
Introduction
Foreword
OK, with git, less centralization == less lock-in
About
COCLICO But :
Issues
Still too much
• Anyone using GitHub ?
lock-in
Who cares ?
Freedom vs
• Developing free software ?
Hosted
Forge
proliferation
• With non-free tools ?
Efforts • How much do, you depend on it ?
COCLICO’s
ForgePlucker
Interoperability
Techniques
Forge
ontology
Implementations
Join in !
11. Jailbreaking
the Forges :
project ex-
port/import
Jesse Vincent dixit
efforts
Olivier
Berger,
Telecom
SudParis
Introduction
Foreword
About
COCLICO
Jesse (obra) Vincent, in :
Issues “Web 2.0 is Sharecropping” Conference (5’) 2
Still too much
lock-in
Who cares ? “If you don’t own your tools, you’re going to be in a
Freedom vs
Hosted
Forge
whole mess of trouble.”
proliferation
Efforts
COCLICO’s
ForgePlucker
Interoperability
Techniques
Forge
ontology
Implementations
Join in !
2. http ://syncwith.us/talks
12. Jailbreaking
the Forges :
project ex-
port/import
Moglen dixit
efforts
Olivier
Berger,
Telecom
SudParis
Introduction
Foreword
About
Eben Moglen, in
COCLICO
“Freedom in the Cloud” Conference (1h) 3
Issues
Still too much
lock-in
• What’s the difference between forge users and social
Who cares ?
Freedom vs
network sites users ?
Hosted
Forge
proliferation
• Cloud “jail” platforms vs. forge servers close to users
Efforts
COCLICO’s
ForgePlucker
Interoperability
Techniques
Forge
ontology
Implementations
Join in !
3. http ://www.isoc-ny.org/ ?p=1338
13. Jailbreaking
the Forges :
project ex-
port/import
Forge proliferation
efforts
Olivier
Berger,
Telecom
SudParis
• Services vs Software
Introduction • Services
Foreword
About • list your own
COCLICO
Issues • Software
Still too much
lock-in • list your own
Who cares ?
Freedom vs
Hosted • Choosing a tool or service at project start
Forge
proliferation
• Later changes ?
Efforts
COCLICO’s
ForgePlucker
• Proliferation is great, but repeating errors of the past is not
Interoperability
Techniques
• Preserve developers freedom to fork
Forge
ontology
Implementations
Join in !
14. Jailbreaking
the Forges :
project ex-
port/import
COCLICO context
efforts Our efforts
Olivier
Berger,
Telecom • Not reinventing yet another forge
SudParis
Venerable forges with circa 2000 PHP codebase
Introduction
Foreword • Interoperability - import/export toolbox
About
COCLICO
Issues • From legacy forges to modern
Still too much
lock-in Migration path : towards more REST APIs, more RDF
Who cares ?
Freedom vs
Hosted
extensible representation formats, more Linked Data,
Forge
proliferation
supporting new tools (CI, tests, Eclipse, etc.)
Efforts • Raising awareness
COCLICO’s
ForgePlucker
• Sharing experience in a community (PlanetForge, see
Interoperability
Techniques bellow)
Forge
ontology
Implementations
• More details : ongoing work, soon on PlanetForge wiki (or
Join in ! ask us on planetforge discussion list)
15. Jailbreaking
the Forges :
project ex-
port/import
Forgeplucker
efforts
Olivier • ForgePlucker (initiated by ESR) is the reference
Berger,
Telecom http ://home.gna.org/forgeplucker/
SudParis
• There was code, but still alot of work (and improvements
Introduction
Foreword to make)
About
COCLICO
Issues
• We improved forgeplucker to improve the forge ontology,
Still too much
lock-in
fusionforge coverage
Who cares ?
Freedom vs
Hosted
• Towards a standard forge project dump format (RDF,
Forge
proliferation ontologies, OpenDocument Package container. . . )
Efforts
COCLICO’s • Based on same core standards as for dynamic
ForgePlucker
Interoperability
interoperability (OSLC)
Techniques
Forge • We “forked” its code on gitorious (paradox)
ontology
Implementations • Scraping is not only option (direct admin export), but
Join in !
reference Python codebase
16. Jailbreaking
the Forges :
project ex-
port/import
Interoperability techniques
efforts Worked on in COCLICO
Olivier
Berger,
Telecom • RDF / Linked Data (JSON or XML)
SudParis
• OAuth
Introduction
Foreword
About
• OSLC proposed standard
COCLICO
• Web technology : REST, RDF, AJAX,
Issues
Still too much • Open community, Open standard
lock-in
Who cares ? • OSLC-CM (Change Management) FLOSS implementations
Freedom vs
Hosted developped in Helios and COCLICO
Forge
proliferation • Mantis bugtracker
Efforts • FusionForge trackers (soon Codendi too)
COCLICO’s
ForgePlucker
• Many more domains than trackers
Interoperability
Techniques
Forge
• WebID, aka FOAF+SSL
ontology
Implementations • Building grounds for forge interop standard to be
Join in ! elaborated at PlanetForge community
17. Jailbreaking
the Forges :
project ex-
port/import
Forge artifacts/tools ontology
efforts
Olivier
Berger,
Telecom
SudParis
Introduction
Foreword
About
COCLICO
Issues
Still too much
lock-in
Who cares ?
Freedom vs
Hosted
Forge
proliferation
Efforts
COCLICO’s
ForgePlucker
Interoperability
Techniques
Forge
ontology
Implementations
Join in !
https://forge.projet-coclico.org/plugins/mediawiki/
18. Jailbreaking
the Forges :
project ex-
port/import
Linked Open Data
efforts (Public) Development artifacts part of Web 3.0 ?
Olivier
Berger,
Telecom
SudParis
Introduction
Foreword
About
COCLICO
Issues
Still too much
lock-in
Who cares ?
Freedom vs
Hosted
Forge
proliferation
Efforts
COCLICO’s
ForgePlucker
Interoperability
Techniques
Forge
ontology
Implementations
Join in !
Source : http ://linkeddata.org/
19. Jailbreaking
the Forges :
project ex-
port/import
ForgePlucker
efforts
Olivier
Berger,
Telecom
SudParis
Evolving the format to more extensibility and semantics, with
Introduction
Foreword RDF
About
COCLICO • OpenDocument Package (zip) container
Issues
Still too much
lock-in
• Metadata RDF (JSON) description (Forge ontology) of
Who cares ?
Freedom vs links between people, projects, forge tools, and rest of the
Hosted
Forge
proliferation
export data
Efforts • Dumps of the tools inside the container if possible
COCLICO’s
ForgePlucker
• In principle run from the user’s client system (scraping)
Interoperability
Techniques
Forge
ontology
Implementations
Join in !
20. Jailbreaking
the Forges :
project ex-
port/import
FusionForge
efforts
Olivier
Berger,
Telecom
SudParis
Introduction
Foreword • Exporter
About
COCLICO • Based on ForgePlucker
Issues
Still too much
• Run from the forge’s hosting system
lock-in
Who cares ?
Freedom vs
• Importer
Hosted
Forge
proliferation
‘projectimport’ plugin in Fusionforge trunk
Efforts • Other goodies for dynamic interoperability
COCLICO’s
ForgePlucker
Interoperability
Techniques
Forge
ontology
Implementations
Join in !
21. Jailbreaking
the Forges :
project ex-
port/import
Trac
efforts
Olivier
Berger,
Telecom
SudParis
Introduction
Foreword
About
COCLICO
http ://trac-hacks.org/wiki/PlanetForgeImportExportPlugin
Issues • INRIA (S. Campion)
Still too much
lock-in
Who cares ? • Export
Freedom vs
Hosted
Forge
proliferation
• Import
Efforts
COCLICO’s
ForgePlucker
Interoperability
Techniques
Forge
ontology
Implementations
Join in !
22. Jailbreaking
the Forges :
project ex-
port/import
Redmine
efforts
Olivier
Berger,
Telecom
SudParis
Introduction
Foreword
About
COCLICO https ://gi-
Issues
Still too much
thub.com/scampion/forgeplucker/tree/import_redmine
lock-in
Who cares ?
Freedom vs
Hosted • Bearstech (V. Caron)
Forge
proliferation
Efforts
COCLICO’s
ForgePlucker
Interoperability
Techniques
Forge
ontology
Implementations
Join in !
23. Jailbreaking
the Forges :
project ex-
port/import
Codendi, Novaforge, . . .
efforts
Olivier
Berger,
Telecom
SudParis
Introduction
Foreword
About
COCLICO
Issues
Still too much
lock-in
Not so much used by FLOSS projects
Who cares ?
Freedom vs
Hosted
Forge
proliferation
Efforts
COCLICO’s
ForgePlucker
Interoperability
Techniques
Forge
ontology
Implementations
Join in !
24. Jailbreaking
the Forges :
project ex-
port/import
Forge export/import
efforts ForgePlucker
Olivier
Berger,
Telecom
SudParis
Introduction
Foreword
About
COCLICO
Issues
Still too much
• We need more export / import features compatible to
lock-in
Who cares ? each-other
Freedom vs
Hosted
Forge
• Let’s talk on the forgeplucker mailing-list
proliferation
Efforts
COCLICO’s
ForgePlucker
Interoperability
Techniques
Forge
ontology
Implementations
Join in !
25. Jailbreaking
the Forges :
project ex-
port/import
Interoperability of forges and other
efforts
Olivier
dev tools
Berger, PlanetForge
Telecom
SudParis PlanetForge community
Introduction
• News agregator (planet)
Foreword
About
http://planet.planetforge.org/
COCLICO
• Microblogging (!planetforge)
Issues
Still too much
lock-in
http://identi.ca/group/planetforge
Who cares ?
Freedom vs • Mailing-list
Hosted
Forge
proliferation
mailto:discussions@planetforge.org
Efforts • Wiki
COCLICO’s
ForgePlucker http://wiki.planetforge.org/
Interoperability
Techniques
• Forge meetups (OWF, RMLL/LSM, . . . )
Forge
ontology • Share ideas, experience, collaborate
Implementations
• Interoperability standardization
Join in !
Join us !
26. Jailbreaking
the Forges :
project ex-
port/import
Copyright & License
efforts
Olivier
Berger,
Telecom
SudParis
Introduction
Foreword
About
COCLICO
• This presentation is under CC-by-SA license
Issues
Still too much
lock-in • Copyright (c) 2010-11 Olivier Berger
Who cares ?
Freedom vs
Hosted • Made with org-mode under emacs (org + beamer)
Forge
proliferation
Efforts
COCLICO’s
ForgePlucker
Interoperability
Techniques
Forge
ontology
Implementations
Join in !
27. Jailbreaking
the Forges :
project ex-
port/import
Q&A
efforts
Olivier
Berger,
Telecom
SudParis
Introduction
Foreword
Thank you
About
COCLICO Questions ?
Issues
Still too much
lock-in
Who cares ? More
Freedom vs
Hosted @oberger : http://identi.ca/oberger/
Forge
proliferation email : mailto:olivier.berger@it-sudparis.eu
Efforts
COCLICO’s
blog :
ForgePlucker
http://www-public.it-sudparis.eu/~berger_o/weblog/
Interoperability
Techniques
Forge
ontology
Implementations
Join in !