Structural Diversity in Social Recommender Systems

Structural Diversity in Social
Recommender Systems
Mitul Tiwari
Joint work with
Xinyi (Lisa) Huang and Sam Shah
LinkedIn
2
Who am I
3
Outline
• Introduction
• Motivation
• Goal
• Structural Diversity in Recommendation
• Structural Diversity and User Engagement
• Conclusion
4
Introduction
• Social Networks : important for
• Sharing and Discovery
• Communication
• Networking
• Online Social Networks are partially observed
• Link Prediction and Recommending entities are important
5
Introduction: Network is Important
6
Introduction: People You May Know
7
Introduction: Goal
• How does structural diversity of network plays a role in
• Recommendations of people?
• User Engagement on the site?
8
Outline
• Introduction
• Motivation
• Goal
• Structural Diversity in Recommendation
• Structural Diversity and User Engagement
• Conclusion
9
Structural Diversity in PYMK Recommendations
• Members in recommendation set mapped to a graph G
• Vertices represent members in the recommendation set
• Edges are the connections between those members on LinkedIn social
graph
• 3 measures of structural diversity
• Number of connected components
• Number of triangles
• Average local node degree
10
Structural Diversity in Recommendations
• A connected component
• any pair of vertices are connected by a path or an isolated vertex
• Number of connected components
• a measure of structural diversity [Ugander et al. 2012]
• Smaller number of components => less structural diversity
• Effect on Invitation rate or conversion rate
• ratio of the number of invitations sent and size of recommended set
11
Structural Diversity in Recommendations
• Invitation rate increases as the number of components decreases
12
Structural Diversity in Recommendations
• Members in recommendation set mapped to a graph G
• A triangle in graph G
• Set of three vertices in Graph G s.t. each vertex is connected to other two
• More number of triangles => dense graph
• More number of triangles => less structural diversity
• Effect on Invitation rate or conversion rate
13
Structural Diversity in Recommendations
• Invitation rate increases as the number of triangles increases
14
Structural Diversity in Recommendations
• Members in recommendation set mapped to a graph G
• Local node degree
• Number of edges incident on the node
• Avg local node degree
• Average of the local node degree over all nodes
• Higher avg local node degree => denser graph
• Higher avg local node degree => less structural diversity
• Effect on Invitation rate or conversion rate
15
Recommendations
• Invitation rate increases as the avg local node degree
increases
16
Structural Diversity in Recommendations
• Less diverse the result set, the higher the invitation rates
• Explanation: A member knows one person in a
recommendation set of connected members then knows other
members in the set
17
Outline
• Introduction
• Motivation
• Goal
• Structural Diversity in Recommendation
• Structural Diversity and User Engagement
• Conclusion
18
Structural Diversity and User Engagement
• A member is engaged if visits the site multiple times a week
• How does engagement depend on the structure of a
member’s immediate connection network?
• Connections of a member is mapped to a graph
• Vertices represent members in the connections set
• Edges are the connections between those members on LinkedIn social
graph
19
Structural Diversity and User Engagement
• K-core decomposition of a graph
• Repeatedly remove nodes with less than K neighbors
• Eliminate influence from unimportant nodes
• K-components
• Connected components in K-core decomposition of the graph
20
Structural Diversity and User Engagement
• Higher engagement with higher number K-core components
21
Structural Diversity and User Engagement
• Higher engagement with higher number K-core components
22
Concluding remarks
• Lower structural diversity among recommendation set results
in a higher invitation rate
• Different form Facebook data study [Ugander et al. 2012]
• Use case is slightly different
• Effect of structural diversity on recommender system highly depends on
the use
• Don’t generalize structural diversity effects on one recommender system
to all
• Higher structural diversity among member’s connection
network results in higher engagement
• Similar to Facebook data study
23
Related Work
24
Acknowledgement
• http://data.linkedin.com
• We are hiring!
• Contact: mtiwari[at]linkedin.com
25
Questions?
1 of 25

Recommended

Theories in social work by
Theories in social workTheories in social work
Theories in social workSrinivasan Rengasamy
60.5K views12 slides
Large scale social recommender systems at LinkedIn by
Large scale social recommender systems at LinkedInLarge scale social recommender systems at LinkedIn
Large scale social recommender systems at LinkedInMitul Tiwari
956 views60 slides
Global Grants 102 by
Global Grants 102Global Grants 102
Global Grants 102Rotary International
755 views45 slides
Global Grants 102 by
Global Grants 102Global Grants 102
Global Grants 102Elizabeth Toms
229 views45 slides
Understanding the context for urban form changes: a concept mapping exercise ... by
Understanding the context for urban form changes: a concept mapping exercise ...Understanding the context for urban form changes: a concept mapping exercise ...
Understanding the context for urban form changes: a concept mapping exercise ...INTERACT
416 views18 slides
Grant Proposal Writing Workshop by
Grant Proposal Writing WorkshopGrant Proposal Writing Workshop
Grant Proposal Writing WorkshopConnectdotDC
3.5K views14 slides

More Related Content

Similar to Structural Diversity in Social Recommender Systems

Planning Effective Linkages by
Planning Effective LinkagesPlanning Effective Linkages
Planning Effective LinkagesGhulam Qadir
2.4K views15 slides
2017 10 16 networks webinar masterclass webinar 2 v0.1 by
2017 10 16 networks webinar masterclass   webinar 2 v0.12017 10 16 networks webinar masterclass   webinar 2 v0.1
2017 10 16 networks webinar masterclass webinar 2 v0.1Becky Malby
424 views46 slides
Global Grants Projects - AG Tarek Omar by
Global Grants Projects - AG Tarek OmarGlobal Grants Projects - AG Tarek Omar
Global Grants Projects - AG Tarek OmarRotary District 2451
148 views21 slides
Helping Gnomes that Code by
Helping Gnomes that CodeHelping Gnomes that Code
Helping Gnomes that CodeMark Hart
992 views23 slides
Project Stakeholder Management - PMBOK6 by
Project Stakeholder Management - PMBOK6Project Stakeholder Management - PMBOK6
Project Stakeholder Management - PMBOK6Agus Suhanto
6.2K views36 slides

Similar to Structural Diversity in Social Recommender Systems(20)

Planning Effective Linkages by Ghulam Qadir
Planning Effective LinkagesPlanning Effective Linkages
Planning Effective Linkages
Ghulam Qadir2.4K views
2017 10 16 networks webinar masterclass webinar 2 v0.1 by Becky Malby
2017 10 16 networks webinar masterclass   webinar 2 v0.12017 10 16 networks webinar masterclass   webinar 2 v0.1
2017 10 16 networks webinar masterclass webinar 2 v0.1
Becky Malby424 views
Helping Gnomes that Code by Mark Hart
Helping Gnomes that CodeHelping Gnomes that Code
Helping Gnomes that Code
Mark Hart992 views
Project Stakeholder Management - PMBOK6 by Agus Suhanto
Project Stakeholder Management - PMBOK6Project Stakeholder Management - PMBOK6
Project Stakeholder Management - PMBOK6
Agus Suhanto6.2K views
LinC Project: Parlimentary Select Committee to Mental Health Social Services by Chris Jansen
LinC Project: Parlimentary Select Committee to Mental Health Social ServicesLinC Project: Parlimentary Select Committee to Mental Health Social Services
LinC Project: Parlimentary Select Committee to Mental Health Social Services
Chris Jansen610 views
Invovling Beneficiaries in Grant-Making (ACF 2013) by indigotrust
Invovling Beneficiaries in Grant-Making (ACF 2013)Invovling Beneficiaries in Grant-Making (ACF 2013)
Invovling Beneficiaries in Grant-Making (ACF 2013)
indigotrust396 views
A Community of Quality: Using Social Network Analysis to Study University-Wid... by Stephanie Richter
A Community of Quality: Using Social Network Analysis to Study University-Wid...A Community of Quality: Using Social Network Analysis to Study University-Wid...
A Community of Quality: Using Social Network Analysis to Study University-Wid...
Stephanie Richter1.8K views
CFMC NWLC 20101021 by Janet Shing
CFMC NWLC 20101021CFMC NWLC 20101021
CFMC NWLC 20101021
Janet Shing519 views
How to Conduct a Community Assessment by Kaitlin Kirk
How to Conduct a Community AssessmentHow to Conduct a Community Assessment
How to Conduct a Community Assessment
Kaitlin Kirk137 views
4C13 J.15 Larson "Twitter based discourse community" by rhetoricked
4C13 J.15 Larson "Twitter based discourse community"4C13 J.15 Larson "Twitter based discourse community"
4C13 J.15 Larson "Twitter based discourse community"
rhetoricked692 views
ADRP | Measurement of Success by Heurista, Co.
ADRP | Measurement of SuccessADRP | Measurement of Success
ADRP | Measurement of Success
Heurista, Co.362 views
Glass House Community Led Design (Maja Luna Jorgensen) UK Network of Age-Frie... by UK_UAC
Glass House Community Led Design (Maja Luna Jorgensen) UK Network of Age-Frie...Glass House Community Led Design (Maja Luna Jorgensen) UK Network of Age-Frie...
Glass House Community Led Design (Maja Luna Jorgensen) UK Network of Age-Frie...
UK_UAC748 views
Best Practices for Implementing a District Communication Strategy by ClubRunner
Best Practices for Implementing a District Communication StrategyBest Practices for Implementing a District Communication Strategy
Best Practices for Implementing a District Communication Strategy
ClubRunner620 views
Large scale social recommender systems and their evaluation by Mitul Tiwari
Large scale social recommender systems and their evaluationLarge scale social recommender systems and their evaluation
Large scale social recommender systems and their evaluation
Mitul Tiwari1.2K views
DeLiddo&BuckinghamShum-e-Part2014 by Anna De Liddo
DeLiddo&BuckinghamShum-e-Part2014DeLiddo&BuckinghamShum-e-Part2014
DeLiddo&BuckinghamShum-e-Part2014
Anna De Liddo748 views

More from Mitul Tiwari

Big Data Ecosystem at LinkedIn. Keynote talk at Big Data Innovators Gathering... by
Big Data Ecosystem at LinkedIn. Keynote talk at Big Data Innovators Gathering...Big Data Ecosystem at LinkedIn. Keynote talk at Big Data Innovators Gathering...
Big Data Ecosystem at LinkedIn. Keynote talk at Big Data Innovators Gathering...Mitul Tiwari
5.1K views46 slides
Modeling Impression discounting in large-scale recommender systems by
Modeling Impression discounting in large-scale recommender systemsModeling Impression discounting in large-scale recommender systems
Modeling Impression discounting in large-scale recommender systemsMitul Tiwari
2.4K views30 slides
Metaphor: A system for related searches recommendations by
Metaphor: A system for related searches recommendationsMetaphor: A system for related searches recommendations
Metaphor: A system for related searches recommendationsMitul Tiwari
1.2K views30 slides
Related searches at LinkedIn by
Related searches at LinkedInRelated searches at LinkedIn
Related searches at LinkedInMitul Tiwari
533 views30 slides
Organizational Overlap on Social Networks and its Applications by
Organizational Overlap on Social Networks and its ApplicationsOrganizational Overlap on Social Networks and its Applications
Organizational Overlap on Social Networks and its ApplicationsMitul Tiwari
537 views28 slides
Large-scale Social Recommendation Systems: Challenges and Opportunity by
Large-scale Social Recommendation Systems: Challenges and OpportunityLarge-scale Social Recommendation Systems: Challenges and Opportunity
Large-scale Social Recommendation Systems: Challenges and OpportunityMitul Tiwari
1.9K views53 slides

More from Mitul Tiwari(8)

Big Data Ecosystem at LinkedIn. Keynote talk at Big Data Innovators Gathering... by Mitul Tiwari
Big Data Ecosystem at LinkedIn. Keynote talk at Big Data Innovators Gathering...Big Data Ecosystem at LinkedIn. Keynote talk at Big Data Innovators Gathering...
Big Data Ecosystem at LinkedIn. Keynote talk at Big Data Innovators Gathering...
Mitul Tiwari5.1K views
Modeling Impression discounting in large-scale recommender systems by Mitul Tiwari
Modeling Impression discounting in large-scale recommender systemsModeling Impression discounting in large-scale recommender systems
Modeling Impression discounting in large-scale recommender systems
Mitul Tiwari2.4K views
Metaphor: A system for related searches recommendations by Mitul Tiwari
Metaphor: A system for related searches recommendationsMetaphor: A system for related searches recommendations
Metaphor: A system for related searches recommendations
Mitul Tiwari1.2K views
Related searches at LinkedIn by Mitul Tiwari
Related searches at LinkedInRelated searches at LinkedIn
Related searches at LinkedIn
Mitul Tiwari533 views
Organizational Overlap on Social Networks and its Applications by Mitul Tiwari
Organizational Overlap on Social Networks and its ApplicationsOrganizational Overlap on Social Networks and its Applications
Organizational Overlap on Social Networks and its Applications
Mitul Tiwari537 views
Large-scale Social Recommendation Systems: Challenges and Opportunity by Mitul Tiwari
Large-scale Social Recommendation Systems: Challenges and OpportunityLarge-scale Social Recommendation Systems: Challenges and Opportunity
Large-scale Social Recommendation Systems: Challenges and Opportunity
Mitul Tiwari1.9K views
Building Data Driven Products at Linkedin by Mitul Tiwari
Building Data Driven Products at LinkedinBuilding Data Driven Products at Linkedin
Building Data Driven Products at Linkedin
Mitul Tiwari737 views
Social Network Analysis at LinkedIn by Mitul Tiwari
Social Network Analysis at LinkedInSocial Network Analysis at LinkedIn
Social Network Analysis at LinkedIn
Mitul Tiwari6K views

Recently uploaded

The Dark Web : Hidden Services by
The Dark Web : Hidden ServicesThe Dark Web : Hidden Services
The Dark Web : Hidden ServicesAnshu Singh
19 views24 slides
ARNAB12.pdf by
ARNAB12.pdfARNAB12.pdf
ARNAB12.pdfArnabChakraborty499766
5 views83 slides
How to think like a threat actor for Kubernetes.pptx by
How to think like a threat actor for Kubernetes.pptxHow to think like a threat actor for Kubernetes.pptx
How to think like a threat actor for Kubernetes.pptxLibbySchulze1
7 views33 slides
hamro digital logics.pptx by
hamro digital logics.pptxhamro digital logics.pptx
hamro digital logics.pptxtupeshghimire
11 views36 slides
Affiliate Marketing by
Affiliate MarketingAffiliate Marketing
Affiliate MarketingNavin Dhanuka
20 views30 slides
Amine el bouzalimi by
Amine el bouzalimiAmine el bouzalimi
Amine el bouzalimiAmine EL BOUZALIMI
5 views38 slides

Recently uploaded(10)

Structural Diversity in Social Recommender Systems

  • 1. Structural Diversity in Social Recommender Systems Mitul Tiwari Joint work with Xinyi (Lisa) Huang and Sam Shah LinkedIn
  • 3. 3 Outline • Introduction • Motivation • Goal • Structural Diversity in Recommendation • Structural Diversity and User Engagement • Conclusion
  • 4. 4 Introduction • Social Networks : important for • Sharing and Discovery • Communication • Networking • Online Social Networks are partially observed • Link Prediction and Recommending entities are important
  • 7. 7 Introduction: Goal • How does structural diversity of network plays a role in • Recommendations of people? • User Engagement on the site?
  • 8. 8 Outline • Introduction • Motivation • Goal • Structural Diversity in Recommendation • Structural Diversity and User Engagement • Conclusion
  • 9. 9 Structural Diversity in PYMK Recommendations • Members in recommendation set mapped to a graph G • Vertices represent members in the recommendation set • Edges are the connections between those members on LinkedIn social graph • 3 measures of structural diversity • Number of connected components • Number of triangles • Average local node degree
  • 10. 10 Structural Diversity in Recommendations • A connected component • any pair of vertices are connected by a path or an isolated vertex • Number of connected components • a measure of structural diversity [Ugander et al. 2012] • Smaller number of components => less structural diversity • Effect on Invitation rate or conversion rate • ratio of the number of invitations sent and size of recommended set
  • 11. 11 Structural Diversity in Recommendations • Invitation rate increases as the number of components decreases
  • 12. 12 Structural Diversity in Recommendations • Members in recommendation set mapped to a graph G • A triangle in graph G • Set of three vertices in Graph G s.t. each vertex is connected to other two • More number of triangles => dense graph • More number of triangles => less structural diversity • Effect on Invitation rate or conversion rate
  • 13. 13 Structural Diversity in Recommendations • Invitation rate increases as the number of triangles increases
  • 14. 14 Structural Diversity in Recommendations • Members in recommendation set mapped to a graph G • Local node degree • Number of edges incident on the node • Avg local node degree • Average of the local node degree over all nodes • Higher avg local node degree => denser graph • Higher avg local node degree => less structural diversity • Effect on Invitation rate or conversion rate
  • 15. 15 Recommendations • Invitation rate increases as the avg local node degree increases
  • 16. 16 Structural Diversity in Recommendations • Less diverse the result set, the higher the invitation rates • Explanation: A member knows one person in a recommendation set of connected members then knows other members in the set
  • 17. 17 Outline • Introduction • Motivation • Goal • Structural Diversity in Recommendation • Structural Diversity and User Engagement • Conclusion
  • 18. 18 Structural Diversity and User Engagement • A member is engaged if visits the site multiple times a week • How does engagement depend on the structure of a member’s immediate connection network? • Connections of a member is mapped to a graph • Vertices represent members in the connections set • Edges are the connections between those members on LinkedIn social graph
  • 19. 19 Structural Diversity and User Engagement • K-core decomposition of a graph • Repeatedly remove nodes with less than K neighbors • Eliminate influence from unimportant nodes • K-components • Connected components in K-core decomposition of the graph
  • 20. 20 Structural Diversity and User Engagement • Higher engagement with higher number K-core components
  • 21. 21 Structural Diversity and User Engagement • Higher engagement with higher number K-core components
  • 22. 22 Concluding remarks • Lower structural diversity among recommendation set results in a higher invitation rate • Different form Facebook data study [Ugander et al. 2012] • Use case is slightly different • Effect of structural diversity on recommender system highly depends on the use • Don’t generalize structural diversity effects on one recommender system to all • Higher structural diversity among member’s connection network results in higher engagement • Similar to Facebook data study
  • 24. 24 Acknowledgement • http://data.linkedin.com • We are hiring! • Contact: mtiwari[at]linkedin.com

Editor's Notes

  1. Hi, I am Mitul Tiwari. Today I am going to present our paper on “Structural Diversity in Social Recommender Systems” This is joint work with Lisa Huang and Sam Shah
  2. I work in Search, Network, and Analytics group at LinkedIn, and focus on social recommender systems and graph mining problems such as link prediction, etc.
  3. Here is the outline of my talk. First, I will describe the motivation and the goal behind our work. Next I am going to talk about effects of structural diversity in people recommendation systems such as “People You May Know” at LinkedIn Then I will talk about how structural diversity affects user engagement And finally I will conclude with some remarks drawn from this work
  4. Social networks have become important for sharing and discovery of content, communication with others, and networking. Any online social network is partially observed as two people might know each other but may not be connected with each other Link prediction and recommending other members to connect with is important to grow your network and social reach
  5. LinkedIn is the largest professional network with more than 238 million members. Members can connect with each other and maintain their professional network on linkedin.
  6. LinkedIn exposes it’s link prediction and people recommendation system through a feature called People You May Know or PYMK in short In PYMK we analyze billions of edges to recommend possible connections to you. PYMK is a large scale recommendation system that helps you connect with others.
  7. In this work we aim to study how structural diversity of connections between recommended set of members in PYMK affects overall invitation or conversion rate Also, we aim to study the structural diversity of connections network affects user engagement on the site
  8. Next I am going to talk more about how structural diversity of connections between recommended members in PYMK affects the overall invitation or connection rate
  9. To study structural diversity of connections among the recommended set of members in PYMK, we first map the recommended set of members to a graph G where vertices represents members in the recommendation set, and edges are the connections between those members on LinkedIn social graph We define 3 measures of structural diversity in terms of the number of connected components, the number of triangles, and Average local node degree. I will go into each of these three notions of structural diversity next Todo: a simple graph
  10. A connected component is defined as a maximal subgraph of the original graph such that any pair of vertices are connected by a path or the subgraph is just an isolated vertex The number of connected components can be used a measure of structural diversity where smaller number of components mean less structural diversity This measure was also used by Ugander et al. in their study where they compared the effect of structural diversity in user recruitment We aim to measure effect on invitation rate or conversion rate, which is defined as the ratio of the number of invitations to connect sent and the size of recommended set in People You May Know (PYMK)
  11. This figure plots invitation rate vs the number of components for different sizes of recommendation set Data set: PYMK recommendation sets of different sizes: 2, 3, 4, 5 and 6 in this graph For each of this figure, we see that invitation rate increases with decrease in the number of components in the graph That is, invitation rate increases as the recommendation set becomes less structurally diverse
  12. Next we measure structural diversity in terms of the number of triangles in the graph G, which is obtained by mapping the recommended set of members to a graph G A set of three vertices in a graph form a triangle if any of the vertex is connected with the other two More number of triangles in a graph means denser graph and the graph is less structurally diverse We aim to measure the effect on invitation rate as the number of triangles changes in the graph G
  13. This figure plots invitation rate with respect to the number of triangles in the graph obtained from the recommendation set A we see the invitation rate increases as the number of triangles increase That is, invitation rate increases as the graph becomes less structurally diverse
  14. Next we measure structural diversity in terms of average local node degree in Graph G, which is obtained by mapping members in recommendation set to a Graph as before Local node degress is defined as the number of edges incident on the node Avg local node degree is the average of the local node degree over all nodes in Graph G Higher avg local node degree implies denser graph, that means, less structural diversity
  15. We use the same PYMK data set and measure invitation rate wrt to average local node degree and we observe that invitation rate increases as avg local node degree increases that is, invitation rate increase as the graph becomes less structurally diverse
  16. In summary, less structurally diverse the recommendation set is the higher the invitation rate Possible explanation: if a member knows one person in a recommendation set, and if the recommendation set of members are strongly connected with each other then, the member knows other members in the set
  17. Next I am going to talk about structural diversity and its effect on user engagement
  18. We say a member is engaged if the member visits the site multiple times a week We would like to measure how engagement varies with structural diversity of member’s immediate connection network First, we map connections of a member to a graph, where vertices represent members in the connections set Edges are the connection between those member on the social graph
  19. We define K-core decomposition of graph as repeatedly removing nodes with less than K neighbors This eliminates influence from unimportant nodes K-components: connected components in K-core decomposition of the graph
  20. questions, details, hiring