ICSE10 StakeNet Talk

875 views

Published on

Slides for my StakeNet paper in the International Conference on Software Engineering 2010

Published in: Technology, Business
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
875
On SlideShare
0
From Embeds
0
Number of Embeds
9
Actions
Shares
0
Downloads
0
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide
  • 22
  • What is the relationship
  • salience
  • 15 minutes
  • Explain why (existing methods usually don’t have specific representatives of some roles)
  • ICSE10 StakeNet Talk

    1. 1. Soo Ling Lim*, Daniele Quercia † , and Anthony Finkelstein* *University College London and † MIT SENSEable City Lab Using Social Networks to Analyse the Stakeholders of Large-Scale Software Projects
    2. 5. Stakeholder
    3. 6. Guildford, UK © River Wey
    4. 7. Software project failure rate FAILURE SUCCESS CHAOS Report, The Standish Group International, Inc.
    5. 8. Identify Prioritise
    6. 9. Build a Stake holder Net work
    7. 10. Step 1: Find initial stakeholders Users Developers Legislators Decision-makers
    8. 11. Step 2: Get recommendations
    9. 12. Step 2: Get recommendations <Alice, Director of Estates, 4>
    10. 13. Step 3: Draw social network
    11. 14. Step 3: Draw social network Alice
    12. 15. Step 3: Draw social network Alice Carl Bob
    13. 16. Step 3: Draw social network Alice Carl Bob
    14. 17. Step 4: Apply social network measures <ul><li>Betweenness </li></ul><ul><li>Closeness </li></ul><ul><li>Pagerank </li></ul><ul><li>Degree </li></ul><ul><li>In-degree </li></ul><ul><li>Out-degree </li></ul>
    15. 18. Research Questions <ul><li>Identify and prioritise stakeholder roles </li></ul><ul><li>Identify and prioritise stakeholders </li></ul><ul><li>OpenR vs. ClosedR </li></ul><ul><li>StakeNet vs. individuals </li></ul>RQ RQ RQ RQ
    16. 19. RALIC: UCL Access Control Project
    17. 20. Stakeholder Details
    18. 21. OpenR
    19. 22. ClosedR
    20. 23. Top 20 Stakeholders
    21. 24. Existing Method StakeNet lists
    22. 25. Existing Method Ground Truth list StakeNet lists
    23. 26. Existing Method Ground Truth list StakeNet lists Existing Method list
    24. 27. Example Stakeholder List 4 UCL visitor Dave 3 Student Carl 2 Head of Security Bob 1 Director of Estates Alice Priority Stakeholder Role Stakeholder
    25. 28. RQ1a. Identify stakeholder roles Found them! Omitted external library users 90% 89% Precision 90% 40% Recall StakeNet Existing Method
    26. 29. RQ1b. Prioritise stakeholder roles Accuracy ( ρ )
    27. 30. RQ2. Identify and prioritise stakeholders 57% 91% Out-degree 66% 91% In-degree 65% 91% Degree 78% 87% PageRank 56% 91% Closeness 52% 92% Betweenness No prioritisation 47% Existing method Prioritisation (Accuracy ) Identification (Recall)
    28. 31. RQ2. Identify and prioritise stakeholders Security and Access Systems
    29. 32. RQ2. Identify and prioritise stakeholders Security and Access Systems
    30. 33. RQ2. Identify and prioritise stakeholders Security and Access Systems
    31. 34. RQ2. Identify and prioritise stakeholders Security and Access Systems StakeNet List
    32. 35. RQ3. OpenR vs. ClosedR Identify stakeholder roles 95% 90% Precision 60% 90% Recall ClosedR OpenR
    33. 36. RQ4. StakeNet vs. Individuals legislators users developers directors managers StakeNet Accuracy ( ρ) 85%
    34. 37. StakeSource Tool
    35. 38. StakeSource Tool www.stakesource.co.uk
    36. 39. Current & Future Work + Different projects + Collaborative filtering + Network change over time + Prioritise across various issues
    37. 40. Soo Ling Lim [email_address] Daniele Quercia [email_address] Anthony Finkelstein [email_address] www.stakesource.co.uk
    38. 41. Extra Slides
    39. 42. StakeNet’s Output
    40. 43. Data Size
    41. 44. 68 surveys
    42. 45. Open-ended Recommendations 4463 recommendations 127 stakeholders
    43. 46. Closed-ended Recommendations 839 recommendations 76 stakeholders
    44. 47. Existing Method Ground Truth
    45. 48. Building Ground Truth <ul><li>Input: Project document, interviews, observation </li></ul><ul><li>Enumerate all stakeholder types </li></ul><ul><li>Find actual stakeholder and roles from Input </li></ul><ul><li>Rate each stakeholder along their involvement (finance, management, development, usage) in the subtype in terms of High, Medium, Low </li></ul><ul><li>Rank stakeholders by the sum of their ratings (H=3, M=2, L=1) </li></ul><ul><li>Output: ranked list of stakeholders and roles </li></ul>
    46. 49. 85 stakeholders 62 roles
    47. 50. Existing Method Ground Truth StakeNet
    48. 51. Open-ended: 127 stakeholders 70 roles Closed-ended: 67 stakeholders 39 roles
    49. 52. Existing Method Ground Truth StakeNet Existing Method
    50. 56. 18 stakeholders 28 roles
    51. 57. Precision & Recall
    52. 58. OpenR vs. ClosedR
    53. 59. Decision Tree
    54. 60. RQ5. Motivation to recommend 81% responded
    55. 61. Identify stakeholder roles It was established that there were 17,000 “external” library members who would require new cards if the Library turnstiles were to be de-commissioned. The Board decided that this objective should be removed as the associated costs and complications far outweighed the benefits. “ ” Post implementation report
    56. 62. Identify stakeholder roles

    ×