Open BQR a framework for the assessment of Open Source Software Davide Taibi  -  Luigi Lavazza  -  Sandro Morasca Universi...
Goals
O.S.S. Comparison Ideology Opinion “ religion” issue Assessment  Errors Big Projects +
<ul><li>Experience: inaccurate </li></ul><ul><li>Existing methods: very recent  </li></ul><ul><li>No methods yet consider ...
Goals <ul><li>COMPARISON MODEL </li></ul><ul><ul><li>simple  </li></ul></ul><ul><ul><li>“ formal” </li></ul></ul>Fast qual...
Preliminary analysis <ul><li>O.S. Communities Contacts </li></ul><ul><li>GUFPI-ISMA Software Metrics  </li></ul><ul><li>Ja...
Open BQR OSMM Open Source Maturity Model Open BRR Open Business Readiness Rating + QSOS Qualification and Selection of O.S...
<ul><ul><li>OPEN SOURCE SOFTWARE COMPARISON </li></ul></ul><ul><ul><ul><li>Selection </li></ul></ul></ul><ul><ul><ul><li>P...
Open BQR – method <ul><ul><li>1. Quick Assessment Filter </li></ul></ul><ul><ul><li>2. Data Collection & Processing </li><...
Open BQR – method <ul><li>License  </li></ul><ul><li>Compliance with standards </li></ul><ul><li>Implementation language  ...
Open BQR – method <ul><li>Specification analysis   </li></ul><ul><ul><li>Functional coverage assessment </li></ul></ul><ul...
Open BQR – method <ul><li>Specification analysis   </li></ul><ul><ul><li>Functional coverage assessment </li></ul></ul><ul...
Open BQR – method <ul><li>Specification analysis   </li></ul><ul><ul><li>Functional coverage assessment </li></ul></ul><ul...
Open BQR – method <ul><li>Quick Assessment Filter </li></ul><ul><li>Data Collection & Processing </li></ul><ul><li>Data Tr...
Test Drupal Mambo WebGUI CMS ERP Compiere
Open BQR – CMS Custom requirements <ul><li>Personal web site: </li></ul><ul><ul><li>User-defined layout </li></ul></ul><ul...
Open BQR – CMS <ul><li>INITIAL CHOICE  </li></ul><ul><li>MAMBO  </li></ul><ul><li>DRUPAL  </li></ul><ul><li>WEB GUI </li><...
Open BQR – CMS Parameter Assessment  -  Mambo Indicator Weight Normalized  weight Score Final Score Target usage assessmen...
Open BQR – CMS Parameter Assessment  -  Mambo Indicator Weight Normalized  weight Score Final Score Target usage assessmen...
Open BQR – CMS Parameter Assessment  -  Mambo Indicator Weight Normalized  weight Score Final Score Target usage assessmen...
Open BQR – CMS Parameter Assessment  -  Mambo Indicator Weight Normalized  weight Score Final Score Target usage assessmen...
Open BQR – CMS Functionality Support availability External qualities Evaluation Target usage indicators
Tool
Conclusions & future work <ul><li>Apply Open BQR to CMS projects  </li></ul><ul><li>Refine/extend the set of parameters th...
Q & A THANKS. QUESTIONS? Open BQR
Upcoming SlideShare
Loading in …5
×

Open Bqr an Open Framework for the assessment of Open Source Software

1,709 views

Published on

Published in: Technology
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
1,709
On SlideShare
0
From Embeds
0
Number of Embeds
47
Actions
Shares
0
Downloads
55
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide
  • Good morning everyone, I’m davide Taibi, from Insubria University. I’m glad to present you our new method the OpenBQR
  • Open Bqr an Open Framework for the assessment of Open Source Software

    1. 1. Open BQR a framework for the assessment of Open Source Software Davide Taibi - Luigi Lavazza - Sandro Morasca University of Insubria
    2. 2. Goals
    3. 3. O.S.S. Comparison Ideology Opinion “ religion” issue Assessment Errors Big Projects +
    4. 4. <ul><li>Experience: inaccurate </li></ul><ul><li>Existing methods: very recent </li></ul><ul><li>No methods yet consider the following: </li></ul><ul><ul><li>Internal qualities (eg. code size, complexity) </li></ul></ul><ul><ul><li>External qualities (eg. fault proneness) </li></ul></ul><ul><ul><li>Support availability in the future </li></ul></ul>Current situation
    5. 5. Goals <ul><li>COMPARISON MODEL </li></ul><ul><ul><li>simple </li></ul></ul><ul><ul><li>“ formal” </li></ul></ul>Fast qualification and selection <ul><ul><ul><ul><li>FUNDAMENTAL ASPECTS </li></ul></ul></ul></ul><ul><ul><ul><ul><li>- Functional coverage </li></ul></ul></ul></ul><ul><ul><ul><ul><ul><li>- Number of bugs & time needed to solve - Availability of future support </li></ul></ul></ul></ul></ul><ul><ul><ul><ul><ul><li>- Other aspects </li></ul></ul></ul></ul></ul>
    6. 6. Preliminary analysis <ul><li>O.S. Communities Contacts </li></ul><ul><li>GUFPI-ISMA Software Metrics </li></ul><ul><li>Java Open Business </li></ul><ul><li>International Function Point User Group (IFPUG) </li></ul><ul><li>CMMi Process Improvement Community </li></ul><ul><li>Software Metrics </li></ul><ul><li>Function Points </li></ul><ul><li>Cosmic FFP </li></ul><ul><li>COCOMO </li></ul><ul><li>Existing OSS comparison methods </li></ul><ul><li>Open Source Maturity Model </li></ul><ul><li>Open Business Readiness Ratings </li></ul><ul><li>Qualification and Selection of O.S. Software </li></ul><ul><ul><ul><ul><ul><li>Forum </li></ul></ul></ul></ul></ul><ul><ul><ul><ul><ul><li>Workshop </li></ul></ul></ul></ul></ul><ul><ul><ul><ul><ul><li>Surveys </li></ul></ul></ul></ul></ul>
    7. 7. Open BQR OSMM Open Source Maturity Model Open BRR Open Business Readiness Rating + QSOS Qualification and Selection of O.S. Software + Open BQR Open Business Quality Rating
    8. 8. <ul><ul><li>OPEN SOURCE SOFTWARE COMPARISON </li></ul></ul><ul><ul><ul><li>Selection </li></ul></ul></ul><ul><ul><ul><li>Parameter evaluation </li></ul></ul></ul><ul><ul><ul><li>Classification </li></ul></ul></ul>v v v x x x x Open BQR
    9. 9. Open BQR – method <ul><ul><li>1. Quick Assessment Filter </li></ul></ul><ul><ul><li>2. Data Collection & Processing </li></ul></ul><ul><ul><li>3. Data Translation </li></ul></ul>
    10. 10. Open BQR – method <ul><li>License </li></ul><ul><li>Compliance with standards </li></ul><ul><li>Implementation language </li></ul><ul><li>Internationalization support </li></ul><ul><li>User’s manual availability </li></ul><ul><li>Supervised by analysts </li></ul><ul><li>Specification analysis </li></ul><ul><ul><li>Functional coverage assessment </li></ul></ul><ul><li>Indicator Analysis </li></ul><ul><ul><li>Target Usage parameters </li></ul></ul>1.Quick Assessment Filter
    11. 11. Open BQR – method <ul><li>Specification analysis </li></ul><ul><ul><li>Functional coverage assessment </li></ul></ul><ul><li>Indicator Analysis </li></ul><ul><ul><li>Target Usage parameters </li></ul></ul><ul><ul><li>Bug database analysis </li></ul></ul><ul><ul><li>Closed bugs/ bug number </li></ul></ul><ul><ul><li>Bug time correction </li></ul></ul><ul><ul><li>Donations/bug number </li></ul></ul>1.Quick Assessment Filter
    12. 12. Open BQR – method <ul><li>Specification analysis </li></ul><ul><ul><li>Functional coverage assessment </li></ul></ul><ul><li>Indicator Analysis </li></ul><ul><ul><li>Target Usage parameters </li></ul></ul><ul><ul><li>Bug database analysis </li></ul></ul><ul><ul><li>Internal qualities analysis </li></ul></ul><ul><ul><li>Complexity (Mc Cabe) </li></ul></ul><ul><ul><li>Reuse </li></ul></ul><ul><ul><li>Dependencies </li></ul></ul>1.Quick Assessment Filter
    13. 13. Open BQR – method <ul><li>Specification analysis </li></ul><ul><ul><li>Functional coverage assessment </li></ul></ul><ul><li>Indicator Analysis </li></ul><ul><ul><li>Target Usage parameters </li></ul></ul><ul><ul><li>Bug database analysis </li></ul></ul><ul><ul><li>Internal qualities analysis </li></ul></ul><ul><ul><li>Community activity analysis </li></ul></ul><ul><ul><li>Number of release </li></ul></ul><ul><ul><li>Number of company supporting the product </li></ul></ul><ul><ul><li>Average number of developers per company </li></ul></ul><ul><ul><li>Independent developers </li></ul></ul>1.Quick Assessment Filter
    14. 14. Open BQR – method <ul><li>Quick Assessment Filter </li></ul><ul><li>Data Collection & Processing </li></ul><ul><li>Data Translation </li></ul>Target usage parameters External qualities Functionality Cost Support <ul><li>Specification analysis </li></ul><ul><li>Rank of indicators </li></ul><ul><li>Weight normalization </li></ul><ul><li>Indicator assessment </li></ul><ul><li>Final score calculation </li></ul><ul><li>Result plotting </li></ul>Internal qualities
    15. 15. Test Drupal Mambo WebGUI CMS ERP Compiere
    16. 16. Open BQR – CMS Custom requirements <ul><li>Personal web site: </li></ul><ul><ul><li>User-defined layout </li></ul></ul><ul><ul><li>Creation of new public or hidden page by the user </li></ul></ul><ul><ul><li>Image gallery </li></ul></ul><ul><ul><li>Donwloads </li></ul></ul><ul><ul><li>Upload of files and images via browser </li></ul></ul><ul><ul><li>Administration interface, better if in the user’s language </li></ul></ul>
    17. 17. Open BQR – CMS <ul><li>INITIAL CHOICE </li></ul><ul><li>MAMBO </li></ul><ul><li>DRUPAL </li></ul><ul><li>WEB GUI </li></ul><ul><li>FUNCTIONAL COVERAGE CHECK </li></ul><ul><li>Customer indicator weight </li></ul><ul><li>1. User-defined layout 10/10 </li></ul><ul><li>2. CRUD (Create, Read, Update, Delete) pages 10/10 </li></ul><ul><li>3. Image gallery 7/10 </li></ul><ul><li>4. CRUD (Create, Read, Update, Delete) files and download page 5/10 </li></ul><ul><li>5. Italian interface supported 5/10 </li></ul>
    18. 18. Open BQR – CMS Parameter Assessment - Mambo Indicator Weight Normalized weight Score Final Score Target usage assessment License 10 7,35 10 7,35% Respect of standards 5 3,68 8 2,94% Implementation language 8 5,88 20 11,76% Internationalization support 5 3,68 8 2,94% Technical documentation availability 10 7,35 7 5,15% Supervised by analysts 2 1,47 0 0,00%
    19. 19. Open BQR – CMS Parameter Assessment - Mambo Indicator Weight Normalized weight Score Final Score Target usage assessment License 10 7,35 10 7,35% Respect of standards 5 3,68 8 2,94% Implementation language 8 5,88 20 11,76% Internationalization support 5 3,68 8 2,94% Technical documentation availability 10 7,35 7 5,15% Supervised by analysts 2 1,47 0 0,00%
    20. 20. Open BQR – CMS Parameter Assessment - Mambo Indicator Weight Normalized weight Score Final Score Target usage assessment License 10 7,35 10 7,35% Respect of standards 5 3,68 8 2,94% Implementation language 8 5,88 20 11,76% Internationalization support 5 3,68 8 2,94% Technical documentation availability 10 7,35 7 5,15% Supervised by analysts 2 1,47 0 0,00%
    21. 21. Open BQR – CMS Parameter Assessment - Mambo Indicator Weight Normalized weight Score Final Score Target usage assessment License 10 7,35 10 7,35% Respect of standards 5 3,68 8 2,94% Implementation language 8 5,88 20 11,76% Internationalization support 5 3,68 8 2,94% Technical documentation availability 10 7,35 7 5,15% Supervised by analysts 2 1,47 0 0,00%
    22. 22. Open BQR – CMS Functionality Support availability External qualities Evaluation Target usage indicators
    23. 23. Tool
    24. 24. Conclusions & future work <ul><li>Apply Open BQR to CMS projects </li></ul><ul><li>Refine/extend the set of parameters that are relevant for the evaluation </li></ul><ul><li>Reduce subjectivity as much as possible </li></ul><ul><li>Disseminate the method among the O.S. users and developers </li></ul>
    25. 25. Q & A THANKS. QUESTIONS? Open BQR

    ×