Your SlideShare is downloading. ×
Eliciting Requirements for Search based Requirements Prioritisation Soo Ling Lim Department of Computer Science University...
 
Stakeholders Requirements Multi-Objective
Stakeholders Requirements Multi-Objective
Guildford, UK © River Wey
Software project failure rate FAILURE SUCCESS CHAOS Report, The Standish Group International, Inc.
Build a   Stake holder   Net work
Step 1: Find initial stakeholders Users Developers Legislators Decision-makers
Step 2: Get recommendations
Step 2: Get recommendations <Alice, Director of Estates, 4>
Step 3: Draw social network
Step 3: Draw social network Alice
Step 3: Draw social network Alice Carl Bob
Step 3: Draw social network Alice Carl Bob
Step 4: Apply social network measures <ul><li>Betweenness </li></ul><ul><li>Load </li></ul><ul><li>Closeness </li></ul><ul...
RALIC: UCL Access Control Project
Recommendations
Identifying Stakeholders Found them! Omitted external library users Existing Method StakeNet Precision 89% 90% Recall 40% ...
StakeNet vs. Individuals legislators users developers directors managers StakeNet 79% Role Accuracy ( ρ)
Stakeholders Requirements Multi-Objective
http://research.it.uts.edu.au
RALIC requirements Version 1.2
RALIC requirements Version 1.2 Who wants what?
StakeRare: Recommender Assisted Requirements Elicitation
1. Each stakeholder rates requirements
1. Each stakeholder rates requirements <Alice, R1, 3> <Alice, R2, 2> <Alice, R3, 5> <Alice, R8, -1>
2. Predict stakeholders’ needs (kNN)
You want R1, R2, and R3 2. Predict stakeholders’ needs (kNN)
2. Predict stakeholders’ needs (kNN) You want R1, R2, and R3 You may also want R4, R5, and R7
 
Identifying Requirements
Predicting Requirements S.L. Lim & A. Finkelstein (2011) StakeRare: Social Networks and Collaborative Filtering for Large-...
BUT…In StakeNet and StakeRare, Analyst interviews stakeholders
For large projects…
www.stakesource.co.uk S.L. Lim, D. Quercia & A. Finkelstein (2010) StakeSource. In  32 nd  Int. Conf. on Soft. Eng.
StakeSource 2.0 S.L. Lim, D. Damian & A. Finkelstein (2011) StakeSource2.0. In  33 rd  Int. Conf. on Soft. Eng.
> 50 Trial Requests Since Dec‘09
> 10 Projects Used StakeSource <ul><li>IS Division, UCL </li></ul><ul><li>Bartlett Faculty of Built Environment , UCL </li...
Project Networks Edubase (NII, Japan) IRIS (UCL ISD) RIM (British Lib) Healthy Cities (Bartlett) [1] S.L. Lim, F. Ishikawa...
Stakeholders Requirements Multi-Objective
Treat each set of stakeholder’s ratings as an objective to optimise
MOO Algorithms <ul><li>Sum of Weighted Objectives (Single Objective) </li></ul><ul><li>Non-Dominated Sorting (NDS) </li></...
Findings <ul><li>Pareto optimal front too large - contains many solutions that are not desirable </li></ul><ul><li>For ~80...
Soo Ling Lim [email_address] © Anne Geddes
Upcoming SlideShare
Loading in...5
×

Eliciting Requirements for Search based Requirements Prioritisation

807

Published on

The slides for my SEBASE talk.

Published in: Technology
0 Comments
1 Like
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total Views
807
On Slideshare
0
From Embeds
0
Number of Embeds
0
Actions
Shares
0
Downloads
1
Comments
0
Likes
1
Embeds 0
No embeds

No notes for slide
  • What is the relationship
  • salience
  • http://research.it.uts.edu.au/re/cgi-bin/resources_srs.cgi
  • What is the relationship
  • What is the relationship
  • Transcript of "Eliciting Requirements for Search based Requirements Prioritisation"

    1. 1. Eliciting Requirements for Search based Requirements Prioritisation Soo Ling Lim Department of Computer Science University College London
    2. 3. Stakeholders Requirements Multi-Objective
    3. 4. Stakeholders Requirements Multi-Objective
    4. 5. Guildford, UK © River Wey
    5. 6. Software project failure rate FAILURE SUCCESS CHAOS Report, The Standish Group International, Inc.
    6. 7. Build a Stake holder Net work
    7. 8. Step 1: Find initial stakeholders Users Developers Legislators Decision-makers
    8. 9. Step 2: Get recommendations
    9. 10. Step 2: Get recommendations <Alice, Director of Estates, 4>
    10. 11. Step 3: Draw social network
    11. 12. Step 3: Draw social network Alice
    12. 13. Step 3: Draw social network Alice Carl Bob
    13. 14. Step 3: Draw social network Alice Carl Bob
    14. 15. Step 4: Apply social network measures <ul><li>Betweenness </li></ul><ul><li>Load </li></ul><ul><li>Closeness </li></ul><ul><li>PageRank </li></ul><ul><li>Degree </li></ul><ul><li>In-degree </li></ul><ul><li>Out-degree </li></ul>S.L. Lim, D. Quercia & A. Finkelstein (2010) StakeNet: Using Social Networks to Analyse the stakeholders of Large-Scale Software Projects. In 32 nd Int. Conf. on Soft. Eng.
    15. 16. RALIC: UCL Access Control Project
    16. 17. Recommendations
    17. 18. Identifying Stakeholders Found them! Omitted external library users Existing Method StakeNet Precision 89% 90% Recall 40% 90%
    18. 19. StakeNet vs. Individuals legislators users developers directors managers StakeNet 79% Role Accuracy ( ρ)
    19. 20. Stakeholders Requirements Multi-Objective
    20. 21. http://research.it.uts.edu.au
    21. 22. RALIC requirements Version 1.2
    22. 23. RALIC requirements Version 1.2 Who wants what?
    23. 24. StakeRare: Recommender Assisted Requirements Elicitation
    24. 25. 1. Each stakeholder rates requirements
    25. 26. 1. Each stakeholder rates requirements <Alice, R1, 3> <Alice, R2, 2> <Alice, R3, 5> <Alice, R8, -1>
    26. 27. 2. Predict stakeholders’ needs (kNN)
    27. 28. You want R1, R2, and R3 2. Predict stakeholders’ needs (kNN)
    28. 29. 2. Predict stakeholders’ needs (kNN) You want R1, R2, and R3 You may also want R4, R5, and R7
    29. 31. Identifying Requirements
    30. 32. Predicting Requirements S.L. Lim & A. Finkelstein (2011) StakeRare: Social Networks and Collaborative Filtering for Large-Scale Requirements Elicitation. IEEE Trans. on Soft. Eng.
    31. 33. BUT…In StakeNet and StakeRare, Analyst interviews stakeholders
    32. 34. For large projects…
    33. 35. www.stakesource.co.uk S.L. Lim, D. Quercia & A. Finkelstein (2010) StakeSource. In 32 nd Int. Conf. on Soft. Eng.
    34. 36. StakeSource 2.0 S.L. Lim, D. Damian & A. Finkelstein (2011) StakeSource2.0. In 33 rd Int. Conf. on Soft. Eng.
    35. 37. > 50 Trial Requests Since Dec‘09
    36. 38. > 10 Projects Used StakeSource <ul><li>IS Division, UCL </li></ul><ul><li>Bartlett Faculty of Built Environment , UCL </li></ul><ul><li>British Library </li></ul><ul><li>National Institute of Informatics, Japan </li></ul><ul><li>WestGrid, Canada </li></ul><ul><li>Allestis, Australia </li></ul>
    37. 39. Project Networks Edubase (NII, Japan) IRIS (UCL ISD) RIM (British Lib) Healthy Cities (Bartlett) [1] S.L. Lim, F. Ishikawa, D. Damian & A. Finkelstein (2011) Using Web 2.0 to engage Stakeholders: the Good, Bad and the Ugly (submitted). [2] S.L. Lim & P. Bentley (2011) Evolving relationships between social networks and stakeholder involvement in software projects. GECCO’11 SBSE track .
    38. 40. Stakeholders Requirements Multi-Objective
    39. 41. Treat each set of stakeholder’s ratings as an objective to optimise
    40. 42. MOO Algorithms <ul><li>Sum of Weighted Objectives (Single Objective) </li></ul><ul><li>Non-Dominated Sorting (NDS) </li></ul><ul><li>NSGA-II </li></ul><ul><li>PAES </li></ul><ul><li>Alternative highly multi-objective methods: </li></ul><ul><ul><li>Weighted Maximum Ranking (WMR) </li></ul></ul><ul><ul><li>Weighted Average Ranking (WAR)* </li></ul></ul><ul><ul><li>Sum of Weighted Ratios (SWR) </li></ul></ul><ul><ul><li>Sum of Weighted Global Ratios (SWGR) </li></ul></ul>
    41. 43. Findings <ul><li>Pareto optimal front too large - contains many solutions that are not desirable </li></ul><ul><li>For ~80 objectives not feasible to visualise or select good solutions </li></ul><ul><li>Requirements engineers want an optimal solution, not a range of solutions to choose from </li></ul><ul><li>Clustering? PCA? Alternative methods? </li></ul><ul><li>What about 100,000 stakeholders? </li></ul>
    42. 44. Soo Ling Lim [email_address] © Anne Geddes

    ×