• Share
  • Email
  • Embed
  • Like
  • Save
  • Private Content
Open source from disruption to innovation - Can we measure and evaluate the outcomes?
 

Open source from disruption to innovation - Can we measure and evaluate the outcomes?

on

  • 486 views

This presentation supported the speech delivered by Gabriele Ruffatti, founder of the SpagoWorld initiative and founder and OW2 President (www.ow2.org), at OSS 2013 - the International Conference on ...

This presentation supported the speech delivered by Gabriele Ruffatti, founder of the SpagoWorld initiative and founder and OW2 President (www.ow2.org), at OSS 2013 - the International Conference on Open Source Systems (Koper, Slovenia, 25th-28th June 2013).
The first part of the presentation focuses on open source, innovation and next challenges in the context of the "nexus of events".
The second part provides various examples of how Spago4Q (www.spago4q.org) - SpagoBI analytic for quality - supports a quality assurance and trustworthiness program. It includes a preview of the speech to be delivered at IT Confidence 2013 in Rio de Janeiro (Brazil), presenting how Spago4Q is being used as the key tool inside a complete Application Lifecycle Management process. Spago4Q allows the evaluation of corporate performances through a 3D model integrating data coming from three dimensions of analysis: Technical, Economical and Social.

Statistics

Views

Total Views
486
Views on SlideShare
486
Embed Views
0

Actions

Likes
0
Downloads
5
Comments
0

0 Embeds 0

No embeds

Accessibility

Categories

Upload Details

Uploaded via as Adobe PDF

Usage Rights

CC Attribution-ShareAlike LicenseCC Attribution-ShareAlike License

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Processing…
Post Comment
Edit your comment

    Open source from disruption to innovation - Can we measure and evaluate the outcomes? Open source from disruption to innovation - Can we measure and evaluate the outcomes? Presentation Transcript

    • 1 Creative Commons Attribution-Share Alike 3.0 Italia License www.eng.it June 27th 2013 Gabriele Ruffatti Technical, Innovation & Research Division of Engineering Group President of OW2 Consortium OPEN SOURCE FROM DISRUPTION TO INNOVATION Can we measure and evaluate the outcomes? OSS 2013 The Ninth International Conference on Open Source Systems Koper-Capodistria, Slovenia, 25th-28th June, 2013
    • 2 Creative Commons Attribution-Share Alike 3.0 Italia License www.eng.it Background information: Engineering Group and OSS Brazil Benelux ItalyArgentina Lebanon The leading Italian independent, privately-owned software and IT services company One of the top 10 in Europe in software and services 43 branches in Italy, Belgium, Latin America and the MENA area > 770M€ Value of Production in 2012, 1,000 large accounts in all market sectors www.eng.itwww.eng.it OSS Competency CenterOSS Competency Center Innovation & Research DivisionInnovation & Research Division Engineering GroupEngineering Group www.spagoworld.orgwww.spagoworld.org
    • 3 Creative Commons Attribution-Share Alike 3.0 Italia License www.eng.it Background information: OW2 Consortium www.ow2.orgwww.ow2.org
    • 4 Creative Commons Attribution-Share Alike 3.0 Italia License www.eng.it Open Source
    • 5 Creative Commons Attribution-Share Alike 3.0 Italia License www.eng.it Open Source refers to software freedom Credits to: www.ow2.org and Cedric Thomas
    • 6 Creative Commons Attribution-Share Alike 3.0 Italia License www.eng.it Open Source: Linux story Don’t dream big Give it all away http://www.spagoworld.org/blog/ Don’t have a plan Don’t be nice
    • 7 Creative Commons Attribution-Share Alike 3.0 Italia License www.eng.it Distribution: who can play Community: who plays the game Architecture: the playing field Freedom to play the game Open Architecture Open Licensing Open Community Open Source is a game of freedom Commercial Model Commercial model: how to sustain the game
    • 8 Creative Commons Attribution-Share Alike 3.0 Italia License www.eng.it Open Source has disrupted the software industry Economically efficientTechnically efficient Strategically efficient Socially efficient
    • 9 Creative Commons Attribution-Share Alike 3.0 Italia License www.eng.it Open Source: quality gains momentum Source: The 2013 Future of Open Source Survey, Black Duck Software
    • 10 Creative Commons Attribution-Share Alike 3.0 Italia License www.eng.it OSS is an innovation factor Where it’s leading Stack up, from the bottom of technology Decision factors Source: The 2013 Future of Open Source Survey, Black Duck Software
    • 11 Creative Commons Attribution-Share Alike 3.0 Italia License www.eng.it Linus Torvalds was looking for building an open operating system: we have Linux Steve Jobs was looking for selling user experience: we have the iPad It’s dependent on the context It refers to research or production activities It relates to new things or changes in mature markets Sometimes it’s mistaken for re-organization or simplification Innovation is giving shape to ideas Does open source drive innovation? What is innovation?
    • 12 Creative Commons Attribution-Share Alike 3.0 Italia License www.eng.it Open Source and Innovation Open Source refers to collaboration, sharing and diversity Are they sufficient conditions to innovate? Collaboration, sharing and diversity are powerful tools to support innovation
    • 13 Creative Commons Attribution-Share Alike 3.0 Italia License www.eng.it Building Innovation Momentum GETTING THINGS STARTED FROM NEXUS OF EVENTS
    • 14 Creative Commons Attribution-Share Alike 3.0 Italia License www.eng.it Event #1: Era of digital economy
    • 15 Creative Commons Attribution-Share Alike 3.0 Italia License www.eng.it Event #2: Nexus of Forces Networks and behaviors dynamism Complete re-desing of IT processes New approaches for information management A new way to acquire technology
    • 16 Creative Commons Attribution-Share Alike 3.0 Italia License www.eng.it Identifying value that people need and delivering it Today we can provide it: at lower cost with faster development times with greater impact on user experience than any-thing that came before Today we can think about opportunity differently and make the difference Event #3: Era of Digital Disruption IT applications from a prescriptive to a consumer-driven approach Bottom-up innovation
    • 17 Creative Commons Attribution-Share Alike 3.0 Italia License www.eng.it Event #4: entering a new society Saatchi & Saatchi CEO Kevin Roberts … to SuperVUCAFrom VUCA …
    • 18 Creative Commons Attribution-Share Alike 3.0 Italia License www.eng.it Open Source and Innovation at work Big data is the killer app for the cloud
    • 19 Creative Commons Attribution-Share Alike 3.0 Italia License www.eng.it Open Source is here to stay in these innovation areas
    • 20 Creative Commons Attribution-Share Alike 3.0 Italia License www.eng.it Samples IoT (Choreos) M2M Cloud CompatibleOne FI-Ware
    • 21 Creative Commons Attribution-Share Alike 3.0 Italia License www.eng.it The next challenge
    • 22 Creative Commons Attribution-Share Alike 3.0 Italia License www.eng.it Platform Name of plane and resistant surfaces, fixed or mobile, generally having support or connection purposes. Translation from the Italian language: Dizionario delle Scienze Fisiche (2012) www.treccani.it A solid and plane surface, artificially created with various materials, at the level or above the level of the surrounding area, used as the base for many applications. Translation from the Italian language: Grande Dizionario Italiano di Gabrielli – HOEPLI www.grandidizionari.it
    • 23 Creative Commons Attribution-Share Alike 3.0 Italia License www.eng.it Platform for Sustainability Technical InfrastructureTechnical Infrastructure ServicesServices Governance and CommunityGovernance and Community ServicesServices Marketing and CommunicationMarketing and Communication ServicesServices The Community Ecosystem PlatformThe Community Ecosystem Platform for open source softwarefor open source software Credits to: www.ow2.org and Cedric Thomas
    • 24 Creative Commons Attribution-Share Alike 3.0 Italia License www.eng.it Rules
    • 25 Creative Commons Attribution-Share Alike 3.0 Italia License www.eng.it Rules Rules make us confident of our next behavior Rules drive decisions Emotions drive actions
    • 26 Creative Commons Attribution-Share Alike 3.0 Italia License www.eng.it Rules? We need We don’t need
    • 27 Creative Commons Attribution-Share Alike 3.0 Italia License www.eng.it Values Credits to: www.londonlovesbusiness.com http://fda.gov/ www.blinkerart.net/ http://foolsjournals.wordpress.com/
    • 28 Creative Commons Attribution-Share Alike 3.0 Italia License www.eng.it Valuable outcomes PlanPlan MeasureMeasure ImproveImprove AssessAssess set of metrics & dimensions of analysis collection of data, computation of metric values & global performance value presentation of results (dashboards & reports) detailed analysis to find problems or bottlenecks
    • 29 Creative Commons Attribution-Share Alike 3.0 Italia License www.eng.it Spago4Q, the OSS platform for Quality www.spago4q.orgwww.spago4q.org partially funded by:
    • 30 Creative Commons Attribution-Share Alike 3.0 Italia License www.eng.it Example #1: Quality assessment of a single project
    • 31 Creative Commons Attribution-Share Alike 3.0 Italia License www.eng.it Example #1: Quality assessment of SpagoBI project
    • 32 Creative Commons Attribution-Share Alike 3.0 Italia License www.eng.it Example #2: OW2 SQuaAT IP verification License verification • FOSSology Source code origin • Antelink Code quality OW2 rules • Sonar Business readiness • Qualipso MOSST, OMM Reputation • Trustie Trustworthiness Assessment (TSRR) Functionality • China Software Testing Center (CSTC)
    • 33 Creative Commons Attribution-Share Alike 3.0 Italia License www.eng.it Application Lifecycle Management and process monitoring through an integrated and low-cost solution, mainly based on Open Source Software products Example #3: ALM at Engineering Group
    • 34 Creative Commons Attribution-Share Alike 3.0 Italia License www.eng.it Technical, Innovation & Research Division Engineering’s Software Labs (ESL) PRODUCTION ESL3: Application Management ESL1-2: Project development RFPs technical support MANAGED OPERATIONS Infrastructures & System Services Architectural design Research & Development Competency Centers Resource management Business Units (BUs) for different market sector Account Managers Sales Managers Service Desk Business Analysis Project Managers Business Competency Center Worldwide Customers Example #3: background - software factory
    • 35 Creative Commons Attribution-Share Alike 3.0 Italia License www.eng.it Continuous Quality Improvement in Engineering's projects Unified Infrastructure supporting quality processes granting flexibility and adaptability CMMi-DEV and ISO certifications, as independent method to validate the compliance of processes and infrastructure with quality standards Set-up of Engineering’s Software Labs to enhance and measure productivity and improve quality practices Example #3: background - goals
    • 36 Creative Commons Attribution-Share Alike 3.0 Italia License www.eng.it Example #3: development scenario
    • 37 Creative Commons Attribution-Share Alike 3.0 Italia License www.eng.it Example #3: ALM at work
    • 38 Creative Commons Attribution-Share Alike 3.0 Italia License www.eng.it • Spago4Q, the open source platform to measure, analyze and monitor quality of products, processes and services www.spago4q.org “Productivity Intelligence” by • QEST nD model, a conceptual framework for measuring process performance based on multiple analysis dimensions (e.g. economic, social, and technological dimensions) www.semq.eu/leng/modtechqlm.htm Example #3: QEST nD with Spago4Q
    • 39 Creative Commons Attribution-Share Alike 3.0 Italia License www.eng.it Method: Performance is expressed as the combination of the specific ratios selected for each of the 3 dimensions of the quantitative assessment (Productivity - PR) and the perceived product quality level of the qualitative assessment (Quality - Q) Performance = PR + Q Model: QEST (Quality factor + Economic, Social & Technical dimensions) is a “structured shell” to be filled according to management objectives in relation to a specific project Such a model has the ability to handle independent sets of dimensions without predefined ratios and weights - referred to as an open model Source: Buglione L. & Abran A., QEST nD: n-dimensional extension and generalisation of a Software Performance Measurement Model, International Journal of Advances in Engineering Software, Elsevier Science Publisher, Vol. 33, No. 1, January 2002, pp.1-7 Example #3: QEST nD model
    • 40 Creative Commons Attribution-Share Alike 3.0 Italia License www.eng.it • Three dimensions of analysis: 1. Economical (EE) 2. Social (SS) 3. Technical (TT) • Performance values for each dimension allow to identify process areas that need improvements Example #3: nD analysis – 3 main dimensions
    • 41 Creative Commons Attribution-Share Alike 3.0 Italia License www.eng.it The model defined for the ESL takes into account three analysis dimensions and goals as follows: 1. Economical (EE) E.G1 Reduce the effort of corrective maintenance E.G2 Improve ESL Resource allocation E.G3 reduce the effort of hardware system unavailability E.G4 Reduce the rework (intended as impact of defects in UAT or production environment) 2. Social (SS) S.G1 Reduce the number of non-conformity issues (QA inspection) S.G2 Improve artifacts reuse S.G3 Improve the number of delayed deliverables S.G4 Improve quality of documents and source code 3.Technical (TT) T.G1 Improve the deploy process T.G2 Reduce the resolution time for defects and technical issues T.G3 Improve the skills of resources T.G4 Improve the development (FP per work/month) Example #3: nD analysis – goals of 3 main dimensions
    • 42 Creative Commons Attribution-Share Alike 3.0 Italia License www.eng.it Metric ID Metric Desc Formula Source E.M1.1 Incidence of corrective maintenance effort Corrective Maintenance Effort/FP ALM & prj registry E.M2.1 Allocation of ESL resources Nr. Of hours allocated on prj/Tot of hours ALM & Corp. Systems E.M3.1 Hardware System Availability Percentage System Availability System Monitoring E.M4.1 Incidence of errors Errors (defects after release)/(erros+defects) ALM E.M4.2 Incidence of analysis defects Analysis defects/(errors + defects) ALM S.M1.1 n. Of Non Conformity issue Nr. Of NC/nr of Projects ALM & QA Registry S.M2.1 Incidence of artifact reuse Nr downloads/total nr of artifacts stored Component repo S.M3.1 Incidence of delayed deliverable Nr-delayed deliv./Tot of delayed deliv. ALM S.M4.1 Software Complexity Results of automatic static code Code analysis tool S.M4.2 Software mantainability Results of automatic static code Code analysis tool T.M1.1 Incidence of deploy defects Deploy defects/(errors + defects) ALM T.M2.1 Defects Mean Resolution Time Tot. Resolution time/Tot. Defects ALM T.M2.2 Incidence of design defects Design defects/(errors + defects) ALM T.M3.1 Incidence of training courses Nr. Of hours allocated on training/Tot of hours Corp. Systems T.M4.1 Development Capability FP/effort Prj registry & Corp. Sys Example #3: metrics
    • 43 Creative Commons Attribution-Share Alike 3.0 Italia License www.eng.it Top Manager ESL Manager Level 1 Level 2 Level 3 Project Manager PRJ n ESL ESL 1 ESL 2 ESL 3 PRJ 1 PRJ n PRJ 1 PRJ n PRJ 1 Project developmentProject development Application maintenanceApplication maintenanceProject developmentProject development EngineeringEngineering’’s Software Labss Software Labs Example #3: drill-down through the organization tree levels
    • 44 Creative Commons Attribution-Share Alike 3.0 Italia License www.eng.it • Unified view on Engineering Software Labs • Unique performance indicator • Performance comparison Example #3: QEST nD dashboard
    • 45 Creative Commons Attribution-Share Alike 3.0 Italia License www.eng.it Example #3: QEST nD dashboard
    • 46 Creative Commons Attribution-Share Alike 3.0 Italia License www.eng.it Metrics Reqs & Bugs Risks Tasks & Issues Docs Detailed view Tracking and trends Example #3: a single dimension view – project dashboard
    • 47 Creative Commons Attribution-Share Alike 3.0 Italia License www.eng.it Example #3: a single dimension view – ALM tool
    • 48 Creative Commons Attribution-Share Alike 3.0 Italia License www.eng.it Example #3: a single dimension view – quality audits
    • 49 Creative Commons Attribution-Share Alike 3.0 Italia License www.eng.it Next: Innovation Factory • Goal 1: Innovation Level Improvement Q1.1: Which is the level of innovative knowledge exploited in the Organization? Q1.2: How much are the new products innovative? •Goal 2 : Quality of Innovation Sources Q2.1: Which is the quality of the sources of the innovation process? • Goal 3: Open Innovation Permeability Q3.1: To what extent is the customer’s contribution exploited? Q3.2: To what extent are the concepts coming from competitors' sites exploited? Q3.3: Evaluate the level of technologies that are transferred by the analysis of competitors Q3.4: How much do internal proposals influence innovative products? • Goal 4: Return of Innovation Investment Q4.1: How much do innovation process produces profits? Q4.2: How much do innovation process costs? Q4.3: Indirect Advantages
    • 50 Creative Commons Attribution-Share Alike 3.0 Italia License www.eng.it 50 Conclusions: how to make this happen Open source has not intrinsic value per se Prepare the environment and build the platform(s) Stimulate creativity Help bring innovation into market Measure, assess and value the results Finally, what’s your vision of the world where open source is a major part of computing? […] In the meshed world, what helps you be successful in a business is influence. And, you get influence not by power but by being valuable. My vision is that we’re switching over to this new world of influence instead of control, of value instead of power, of participation instead of distribution. […] Interview to Simon Phipps, OSI Director Linux Journal, June 2007 Let’s make it happen!