SysFera - fOSSa 2011

History Industrialization Conclusion SysFera-DS: industrializing an open-source research middleware for distributed resources David Loureiro, Frédéric Desprez, Eddy Caron SysFera fOSSa 2011 SYSFERADavid Loureiro, Frédéric Desprez, Eddy Caron Industrializing OSS

History Industrialization ConclusionOutline 1 History 2 Industrialization Code is IP But code is also just code! 3 Conclusion SYSFERA David Loureiro, Frédéric Desprez, Eddy Caron Industrializing OSS

History Industrialization ConclusionMeh CEO @ S YS F ERA Previously research engineer @ I NRIA in the GRAAL research team SYSFERA David Loureiro, Frédéric Desprez, Eddy Caron Industrializing OSS

History Industrialization ConclusionS YS F ERA We provide FOSS for the management of HPC IT infrastructure in a hybrid Cloud mode Based on research software called DIET 12 people located close to the INSA campus (the weirdos doing pixel art on the windows? That’s us.) SYSFERA David Loureiro, Frédéric Desprez, Eddy Caron Industrializing OSS

History Industrialization ConclusionDIET @GRAAL: where it all began DIET (Distributed Interactive Engineering Toolbox) created by Eddy Caron et Frédéric Desprez in 2001 (Yup, 10 years!) SYSFERA David Loureiro, Frédéric Desprez, Eddy Caron Industrializing OSS

History Industrialization ConclusionDIET @GRAAL: where it all began DIET (Distributed Interactive Engineering Toolbox) created by Eddy Caron et Frédéric Desprez in 2001 (Yup, 10 years!) (they made up this acronym later, they were just starving) SYSFERA David Loureiro, Frédéric Desprez, Eddy Caron Industrializing OSS

History Industrialization ConclusionDIET @GRAAL: where it all began DIET (Distributed Interactive Engineering Toolbox) created by Eddy Caron et Frédéric Desprez in 2001 (Yup, 10 years!) (they made up this acronym later, they were just starving) (most researchers are, really) SYSFERA David Loureiro, Frédéric Desprez, Eddy Caron Industrializing OSS

History Industrialization ConclusionDIET @GRAAL: where it all began DIET (Distributed Interactive Engineering Toolbox) created by Eddy Caron et Frédéric Desprez in 2001 (Yup, 10 years!) (they made up this acronym later, they were just starving) (most researchers are, really) Middleware for HPC : How to access an application on a distant server in a SaaS fashion leading implementation of the OGF’s GridRPC standard Maintained by I NRIA, the GRAAL/AVALON team and S YS F ERA SYSFERA David Loureiro, Frédéric Desprez, Eddy Caron Industrializing OSS

History Industrialization ConclusionDIET architecture 101 End User FindServer() MA LA1 LA2 SeD1 SeD2 SeD3 SeD4 SYSFERA David Loureiro, Frédéric Desprez, Eddy Caron Industrializing OSS

History Industrialization ConclusionDIET architecture 101 End User MA FindServer() LA1 LA2 SeD1 SeD2 SeD3 SeD4 SYSFERA David Loureiro, Frédéric Desprez, Eddy Caron Industrializing OSS

History Industrialization ConclusionDIET architecture 101 End User MA LA1 LA2 FindServer() SeD1 SeD2 SeD3 SeD4 SYSFERA David Loureiro, Frédéric Desprez, Eddy Caron Industrializing OSS

History Industrialization ConclusionDIET architecture 101 End User MA LA1 LA2 Estimate() SeD1 SeD2 SeD3 SeD4 SYSFERA David Loureiro, Frédéric Desprez, Eddy Caron Industrializing OSS

History Industrialization ConclusionDIET architecture 101 End User MA Aggregate() LA1 LA2 SeD1 SeD2 SeD3 SeD4 SYSFERA David Loureiro, Frédéric Desprez, Eddy Caron Industrializing OSS

History Industrialization ConclusionDIET architecture 101 End User Aggregate() MA LA1 LA2 SeD1 SeD2 SeD3 SeD4 SYSFERA David Loureiro, Frédéric Desprez, Eddy Caron Industrializing OSS

History Industrialization ConclusionDIET architecture 101 End BestServer = SeD1 User MA LA1 LA2 SeD1 SeD2 SeD3 SeD4 SYSFERA David Loureiro, Frédéric Desprez, Eddy Caron Industrializing OSS

History Industrialization ConclusionDIET architecture 101 End User MA RunService() LA1 LA2 SeD1 SeD2 SeD3 SeD4 SYSFERA David Loureiro, Frédéric Desprez, Eddy Caron Industrializing OSS

History Industrialization ConclusionDIET architecture 101 End User MA SendBackResults() LA1 LA2 SeD1 SeD2 SeD3 SeD4 SYSFERA David Loureiro, Frédéric Desprez, Eddy Caron Industrializing OSS

History Industrialization ConclusionThe D ÉCRYPTHON project Early adopters, guiding us on the path of industrializing research software The computing platform of the Téléthon : provide a simple to use grid platform for biologists Sponsors: AFM, IBM, CNRS 2007: DIET replaces proprietary middleware (o/) Has been up and running 24/7/365 ever since Wait... what if we created a company to do that for others? SYSFERA David Loureiro, Frédéric Desprez, Eddy Caron Industrializing OSS

History Code is IP Industrialization But code is also just code! ConclusionThe path March 2010: birth of S YS F ERA building up a commercial offer around DIET ...while staying true to DIET’s OSS roots SYSFERA David Loureiro, Frédéric Desprez, Eddy Caron Industrializing OSS

History Code is IP Industrialization But code is also just code! ConclusionCode is IP To create a company, you need to secure the IP → from the inside → from the outside → with the authors SYSFERA David Loureiro, Frédéric Desprez, Eddy Caron Industrializing OSS

History Code is IP Industrialization But code is also just code! ConclusionManage your code’s IP architecture Are you using code snippets from the Internet? Are you using third-party libraries? What is your code’s license? Is there a global coherence in the IP’s perspective? SYSFERA David Loureiro, Frédéric Desprez, Eddy Caron Industrializing OSS

History Code is IP Industrialization But code is also just code! ConclusionManage your code’s IP architecture Are you using code snippets from the Internet? Are you using third-party libraries? What is your code’s license? Is there a global coherence in the IP’s perspective? Well, there should be! SYSFERA David Loureiro, Frédéric Desprez, Eddy Caron Industrializing OSS

History Code is IP Industrialization But code is also just code! ConclusionManage your code’s IP architecture Are you using code snippets from the Internet? Are you using third-party libraries? What is your code’s license? Is there a global coherence in the IP’s perspective? Well, there should be! Possible solutions: SYSFERA David Loureiro, Frédéric Desprez, Eddy Caron Industrializing OSS

History Code is IP Industrialization But code is also just code! ConclusionManage your code’s IP architecture Are you using code snippets from the Internet? Are you using third-party libraries? What is your code’s license? Is there a global coherence in the IP’s perspective? Well, there should be! Possible solutions: Antepedia Suite ← They’re coming from I NRIA and it’s OSS! SYSFERA David Loureiro, Frédéric Desprez, Eddy Caron Industrializing OSS

History Code is IP Industrialization But code is also just code! ConclusionManage your code’s IP architecture Are you using code snippets from the Internet? Are you using third-party libraries? What is your code’s license? Is there a global coherence in the IP’s perspective? Well, there should be! Possible solutions: Antepedia Suite ← They’re coming from I NRIA and it’s OSS! {eyes, hands, head, jurist} SYSFERA David Loureiro, Frédéric Desprez, Eddy Caron Industrializing OSS

History Code is IP Industrialization But code is also just code! ConclusionAny patent blocking you in the real - i.e. not research - world? It’s a shame, but software patents do exist (boo!) Publications? Clone of your technology in the real world? Deﬁne your innovation/process Study patent claims... SYSFERA David Loureiro, Frédéric Desprez, Eddy Caron Industrializing OSS

History Code is IP Industrialization But code is also just code! ConclusionAny patent blocking you in the real - i.e. not research - world? It’s a shame, but software patents do exist (boo!) Publications? Clone of your technology in the real world? Deﬁne your innovation/process Study patent claims...VERY accurately. SYSFERA David Loureiro, Frédéric Desprez, Eddy Caron Industrializing OSS

History Code is IP Industrialization But code is also just code! ConclusionAny patent blocking you in the real - i.e. not research - world? It’s a shame, but software patents do exist (boo!) Publications? Clone of your technology in the real world? Deﬁne your innovation/process Study patent claims...VERY accurately. Seriously, I mean it. SYSFERA David Loureiro, Frédéric Desprez, Eddy Caron Industrializing OSS

History Code is IP Industrialization But code is also just code! ConclusionAny patent blocking you in the real - i.e. not research - world? It’s a shame, but software patents do exist (boo!) Publications? Clone of your technology in the real world? Deﬁne your innovation/process Study patent claims...VERY accurately. Seriously, I mean it. Possible solutions: SYSFERA David Loureiro, Frédéric Desprez, Eddy Caron Industrializing OSS

History Code is IP Industrialization But code is also just code! ConclusionAny patent blocking you in the real - i.e. not research - world? It’s a shame, but software patents do exist (boo!) Publications? Clone of your technology in the real world? Deﬁne your innovation/process Study patent claims...VERY accurately. Seriously, I mean it. Possible solutions: {A consulting ﬁrm in IP} SYSFERA David Loureiro, Frédéric Desprez, Eddy Caron Industrializing OSS

History Code is IP Industrialization But code is also just code! ConclusionAny patent blocking you in the real - i.e. not research - world? It’s a shame, but software patents do exist (boo!) Publications? Clone of your technology in the real world? Deﬁne your innovation/process Study patent claims...VERY accurately. Seriously, I mean it. Possible solutions: {A consulting ﬁrm in IP} {eyes, hands, head, jurist} SYSFERA David Loureiro, Frédéric Desprez, Eddy Caron Industrializing OSS

History Code is IP Industrialization But code is also just code! ConclusionPast: dealing with developers and authors It WILL be the most time-consuming part. Check developers’: contract type, lab, institute, faculty, etc. What part of the IP do they produce - specs, code, documentation? Who owns the code? What business model for what business plan? Same license or dual licensing? → Transfer conditions! Most of the time authors don’t know anything about that ("I NRIA knows!") SYSFERA David Loureiro, Frédéric Desprez, Eddy Caron Industrializing OSS

History Code is IP Industrialization But code is also just code! ConclusionPast: dealing with developers and authors It WILL be the most time-consuming part. Check developers’: contract type, lab, institute, faculty, etc. What part of the IP do they produce - specs, code, documentation? Who owns the code? What business model for what business plan? Same license or dual licensing? → Transfer conditions! Most of the time authors don’t know anything about that ("I NRIA knows!") Above all: be patient! SYSFERA David Loureiro, Frédéric Desprez, Eddy Caron Industrializing OSS

History Code is IP Industrialization But code is also just code! ConclusionPast: dealing with developers and authors It WILL be the most time-consuming part. Check developers’: contract type, lab, institute, faculty, etc. What part of the IP do they produce - specs, code, documentation? Who owns the code? What business model for what business plan? Same license or dual licensing? → Transfer conditions! Most of the time authors don’t know anything about that ("I NRIA knows!") Above all: be patient! Only solution: SYSFERA David Loureiro, Frédéric Desprez, Eddy Caron Industrializing OSS

History Code is IP Industrialization But code is also just code! ConclusionPast: dealing with developers and authors It WILL be the most time-consuming part. Check developers’: contract type, lab, institute, faculty, etc. What part of the IP do they produce - specs, code, documentation? Who owns the code? What business model for what business plan? Same license or dual licensing? → Transfer conditions! Most of the time authors don’t know anything about that ("I NRIA knows!") Above all: be patient! Only solution: SYSFERA Patience, Time, Tenacity David Loureiro, Frédéric Desprez, Eddy Caron Industrializing OSS

History Code is IP Industrialization But code is also just code! ConclusionFuture: dealing with developers and authors Will the research lab/research team/faculty still contribute to the transferred technology? What about the community? Will you be able to use that code in any situation? Who will lead the project? What’s the road map? How will you manage the code? (Client/Research)-driven commits? SYSFERA David Loureiro, Frédéric Desprez, Eddy Caron Industrializing OSS

History Code is IP Industrialization But code is also just code! ConclusionFuture: dealing with developers and authors Will the research lab/research team/faculty still contribute to the transferred technology? What about the community? Will you be able to use that code in any situation? Who will lead the project? What’s the road map? How will you manage the code? (Client/Research)-driven commits? Only solution: SYSFERA David Loureiro, Frédéric Desprez, Eddy Caron Industrializing OSS

History Code is IP Industrialization But code is also just code! ConclusionFuture: dealing with developers and authors Will the research lab/research team/faculty still contribute to the transferred technology? What about the community? Will you be able to use that code in any situation? Who will lead the project? What’s the road map? How will you manage the code? (Client/Research)-driven commits? Only solution: Clarity, Perpetuity, Serenity SYSFERA David Loureiro, Frédéric Desprez, Eddy Caron Industrializing OSS

History Code is IP Industrialization But code is also just code! ConclusionBut code is also just code! DIET comes from a research lab SYSFERA David Loureiro, Frédéric Desprez, Eddy Caron Industrializing OSS

History Code is IP Industrialization But code is also just code! ConclusionBut code is also just code! DIET comes from a research lab S YS F ERA comes from a research lab SYSFERA David Loureiro, Frédéric Desprez, Eddy Caron Industrializing OSS

History Code is IP Industrialization But code is also just code! ConclusionBut code is also just code! DIET comes from a research lab S YS F ERA comes from a research lab all of use were coming from research labs SYSFERA David Loureiro, Frédéric Desprez, Eddy Caron Industrializing OSS

History Code is IP Industrialization But code is also just code! ConclusionBut code is also just code! DIET comes from a research lab S YS F ERA comes from a research lab all of use were coming from research labs we needed tools and methodology to get the job done, clean and fast so we didn’t follow the (easy) (evil) path of proprietary software! SYSFERA David Loureiro, Frédéric Desprez, Eddy Caron Industrializing OSS

History Code is IP Industrialization But code is also just code! ConclusionVersion your stuff You need to be able track every change and to revert them Forget CVS and fully embrace Git (or any distributed scm) Prefer atomic changes over monster patches! SYSFERA David Loureiro, Frédéric Desprez, Eddy Caron Industrializing OSS

History Code is IP Industrialization But code is also just code! ConclusionBuild and test your stuff Tracking bugs takes up half of your time (conservative estimate) The sooner, the better SYSFERA David Loureiro, Frédéric Desprez, Eddy Caron Industrializing OSS

History Code is IP Industrialization But code is also just code! ConclusionBuild and test your stuff Tracking bugs takes up half of your time (conservative estimate) The sooner, the better You know where this is going, right? SYSFERA David Loureiro, Frédéric Desprez, Eddy Caron Industrializing OSS

History Code is IP Industrialization But code is also just code! ConclusionContinuous Integration Level 0: compile manually every morning (no, really) Level 1: make a cron task to checkout the scm repository and then build the software Level 2: add up unit tests suite execution and send nagging email to maintainers when it fails Level 3: add quality checks (valgrind, cppcheck, coding style, etc.) into the mix Level 4: install a CI server so you get nice shiny graphics appealing to developers and managers alike SYSFERA David Loureiro, Frédéric Desprez, Eddy Caron Industrializing OSS

History Code is IP Industrialization But code is also just code! ConclusionContinuous Integration Level 0: compile manually every morning (no, really) Level 1: make a cron task to checkout the scm repository and then build the software Level 2: add up unit tests suite execution and send nagging email to maintainers when it fails Level 3: add quality checks (valgrind, cppcheck, coding style, etc.) into the mix Level 4: install a CI server so you get nice shiny graphics appealing to developers and managers alike Level 5: make developers who break builds bring pastries the next morning! (We call that Jenkin’s "fat" plugin.) SYSFERA David Loureiro, Frédéric Desprez, Eddy Caron Industrializing OSS

History Code is IP Industrialization But code is also just code! ConclusionYour build system is your friend automates tasks good support of parallel jobs (scons out) extendable easy to learn and use (autotools out) multiplatform SYSFERA David Loureiro, Frédéric Desprez, Eddy Caron Industrializing OSS

History Code is IP Industrialization But code is also just code! ConclusionYour build system is your friend automates tasks good support of parallel jobs (scons out) extendable easy to learn and use (autotools out) multiplatform Our answer: SYSFERA David Loureiro, Frédéric Desprez, Eddy Caron Industrializing OSS

History Code is IP Industrialization But code is also just code! ConclusionYour build system is your friend automates tasks good support of parallel jobs (scons out) extendable easy to learn and use (autotools out) multiplatform Our answer: CMake SYSFERA David Loureiro, Frédéric Desprez, Eddy Caron Industrializing OSS

History Code is IP Industrialization But code is also just code! ConclusionUnit testing Testing is boring Humans don’t like boring stuff SYSFERA David Loureiro, Frédéric Desprez, Eddy Caron Industrializing OSS

History Code is IP Industrialization But code is also just code! ConclusionUnit testing Testing is boring Humans don’t like boring stuff However, SYSFERA David Loureiro, Frédéric Desprez, Eddy Caron Industrializing OSS

History Code is IP Industrialization But code is also just code! ConclusionUnit testing Testing is boring Humans don’t like boring stuff However, it saves time by quickly detecting regression it helps detecting dead code SYSFERA David Loureiro, Frédéric Desprez, Eddy Caron Industrializing OSS

History Code is IP Industrialization But code is also just code! ConclusionUnit testing Testing is boring Humans don’t like boring stuff However, it saves time by quickly detecting regression it helps detecting dead code Our answer: SYSFERA David Loureiro, Frédéric Desprez, Eddy Caron Industrializing OSS

History Code is IP Industrialization But code is also just code! ConclusionUnit testing Testing is boring Humans don’t like boring stuff However, it saves time by quickly detecting regression it helps detecting dead code Our answer: Boost Unit Tests Framework SYSFERA David Loureiro, Frédéric Desprez, Eddy Caron Industrializing OSS

History Code is IP Industrialization But code is also just code! ConclusionDocument your code DIET has nice user and developer guides (very rare for FOSS projects!) SYSFERA David Loureiro, Frédéric Desprez, Eddy Caron Industrializing OSS

History Code is IP Industrialization But code is also just code! ConclusionDocument your code DIET has nice user and developer guides (very rare for FOSS projects!) the API documentation, however, not so much SYSFERA David Loureiro, Frédéric Desprez, Eddy Caron Industrializing OSS

History Code is IP Industrialization But code is also just code! ConclusionDocument your code DIET has nice user and developer guides (very rare for FOSS projects!) the API documentation, however, not so much Developers hate writing anything else than code SYSFERA David Loureiro, Frédéric Desprez, Eddy Caron Industrializing OSS

History Code is IP Industrialization But code is also just code! ConclusionDocument your code DIET has nice user and developer guides (very rare for FOSS projects!) the API documentation, however, not so much Developers hate writing anything else than code (to the coders here: you know it’s true) SYSFERA David Loureiro, Frédéric Desprez, Eddy Caron Industrializing OSS

History Code is IP Industrialization But code is also just code! ConclusionDocument your code DIET has nice user and developer guides (very rare for FOSS projects!) the API documentation, however, not so much Developers hate writing anything else than code (to the coders here: you know it’s true) Our answer: SYSFERA David Loureiro, Frédéric Desprez, Eddy Caron Industrializing OSS

History Code is IP Industrialization But code is also just code! ConclusionDocument your code DIET has nice user and developer guides (very rare for FOSS projects!) the API documentation, however, not so much Developers hate writing anything else than code (to the coders here: you know it’s true) Our answer: Doxygen SYSFERA David Loureiro, Frédéric Desprez, Eddy Caron Industrializing OSS

History Code is IP Industrialization But code is also just code! ConclusionEveryone loves having a nice and tidy butler to do the annoyingstuff SYSFERA David Loureiro, Frédéric Desprez, Eddy Caron Industrializing OSS

History Code is IP Industrialization But code is also just code! ConclusionEveryone loves having a nice and tidy butler to do the annoyingstuff Jenkins: the rising continuous-integration server easy to use, easy to manage lots and lots of plugins! SYSFERA David Loureiro, Frédéric Desprez, Eddy Caron Industrializing OSS

History Code is IP Industrialization But code is also just code! ConclusionPlan things Plan your development sticking to deﬁned release cycles Deﬁne priorities based on clients, community and (a little bit) your developers’ needs Structure your developments through projects Choose your preferred development method (XP, TDD, BDD, something agile!) Involve your community in the debugging! SYSFERA David Loureiro, Frédéric Desprez, Eddy Caron Industrializing OSS

History Code is IP Industrialization But code is also just code! ConclusionBe agile like a monkey SYSFERA David Loureiro, Frédéric Desprez, Eddy Caron Industrializing OSS

History Code is IP Industrialization But code is also just code! ConclusionBe agile like a monkey prefer small iterative cycles plan, test, document... ...the sooner, the better get your toolbox ready SYSFERA David Loureiro, Frédéric Desprez, Eddy Caron Industrializing OSS

History Code is IP Industrialization But code is also just code! ConclusionCommunicate with your management with your sales and marketing department with your clients SYSFERA David Loureiro, Frédéric Desprez, Eddy Caron Industrializing OSS

History Code is IP Industrialization But code is also just code! ConclusionCommunicate with your management with your sales and marketing department with your clients with your community (we’re doing open source, remember?)... SYSFERA David Loureiro, Frédéric Desprez, Eddy Caron Industrializing OSS

History Code is IP Industrialization But code is also just code! ConclusionCommunicate with your management with your sales and marketing department with your clients with your community (we’re doing open source, remember?)... ...and others, through projects (Debian, Fedora, etc.) or events (fOSSa, JDLL, OWF, FOSDEM, etc.) SYSFERA David Loureiro, Frédéric Desprez, Eddy Caron Industrializing OSS

History Code is IP Industrialization But code is also just code! ConclusionGet a real marketing guy or girl (or a hippie) Or you might end up with such logo SYSFERA David Loureiro, Frédéric Desprez, Eddy Caron Industrializing OSS

History Code is IP Industrialization But code is also just code! ConclusionGet a real marketing guy or girl (or a hippie) no comment SYSFERA David Loureiro, Frédéric Desprez, Eddy Caron Industrializing OSS

History Industrialization ConclusionConclusion really cool adventure! always looking for people wanting to get involved in the DIET community! download DIET and S YS F ERA -DS and give us some feedback! . . . and join us at S YS F ERA: we’re not the dark side of the force (with their delicious cookies), but we have good coffee! SYSFERA David Loureiro, Frédéric Desprez, Eddy Caron Industrializing OSS

History Industrialization ConclusionConclusion really cool adventure! always looking for people wanting to get involved in the DIET community! download DIET and S YS F ERA -DS and give us some feedback! . . . and join us at S YS F ERA: we’re not the dark side of the force (with their delicious cookies), but we have good coffee! Well, we have coffee. SYSFERA David Loureiro, Frédéric Desprez, Eddy Caron Industrializing OSS

History Industrialization Conclusion Any question? www.sysfera.comDavid Loureiro: <david.loureiro@sysfera.com> - @DavidLoureiroFr on TwitterSysFera: <contact@sysfera.com> - @SysFera on TwitterSpecial thanks to @augustin82 and @hguemar for the slides! SYSFERA David Loureiro, Frédéric Desprez, Eddy Caron Industrializing OSS

SysFera - fOSSa 2011

by SysFera on Oct 28, 2011

Accessibility

Categories

Tags

Upload Details

Usage Rights

2 Embeds 15

Statistics

SysFera - fOSSa 2011 — Presentation Transcript

http://www.sysfera.fr	10
http://www.sysfera.com	5