SlideShare a Scribd company logo
The Unfairness of Active Users and Popularity
Bias in Point-of-Interest Recommendation
Hossein A. Rahmani
University College London
United Kingdom
h.rahmani@ucl.ac.uk
Yashar Deldjoo
Polytechnic University of Bari
Italy
deldjooy@acm.org
Ali Tourani
University of Guilan
Iran
tourani@msc.guilan.ac.ir
Mohammadmehdi Naghiaei
University of Southern
California, USA
naghiaei@usc.edu
The 44th European Conference on Information Retrieval (ECIR)
Third International Workshop on Algorithmic Bias in Search and Recommendation (Bias 2022)
Bias 2022, Stavanger, Norway
Motivation
● Point-of-Interest (POI) recommender system provide personalized recommendation to users while helping
businesses attract customers
● Highly data-driven recommendations could be impacted by data biases
● Most research papers focus on biases only on one stakeholder ignoring the interplays
Contributions
Studying the interplay between <Personalization>, <unfairness of active users>, <unfairness of popular items>
● RQ1: To what extent are users or groups of users (active vs. inactive) are interested in popular POIs? That is
identifying natural data bias toward popularity.
● RQ2: Is there a trade-off among the factors of accuracy, user fairness, and item fairness?
● RQ3: Could we classify algorithms based on their performance on the accuracy, user fairness, and item fairness?
Datasets
Number of Users
7,135
Yelp
Gowalla 5,628
Number of POIs
15,575
39,943
Number of Check-ins
299,327
618,621
Sparsity
99.74%
99.65%
Liu, Yiding, Tuan-Anh Nguyen Pham, Gao Cong, and Quan Yuan. "An experimental evaluation of point-of-interest recommendation in location-based social networks." Proceedings of the VLDB
Endowment 10, no. 10 (2017): 1010-1021.
For each user, the earliest 70% check-ins used as training data, the most recent 20% check-ins as test
data, and the remaining 10% as validation data.
Time
Feb 2016
Feb. 2009 to Oct. 2010
To what extent are users or groups of users interested in popular POIs?
That is identifying natural data bias toward popularity.
Consumption Distribution of POIs Gowalla
Yelp
● A long-term distribution of the POI checks-ins, where few
items (POIs) are consumed (visited) by many users, while
few users only see most POIs.
● Three categories of items
○ short-head (50% of POIs)
○ mid-tail (30% of POIs)
○ long-tail (20% of POIs)
● User groups
○ Very inactive, slightly inactive, slightly active, and
very active based on their number of check-ins.
Liu, Y., Pham, T.A.N., Cong, G., Yuan, Q.: An experimental evaluation of point-of-interest recommendation in location-based social networks. Proceedings of the VLDB Endowment 10 (10), 1010–1021 (2017)
(a) (b)
(c) (d)
User Profiles, and Popularity Bias
Gowalla
Yelp
● Increasing the number of items in a user profile extends
the probability of finding popular POIs
● Users with fewer items included in their profiles prefer to
attend more popular POIs
Is there a trade-off among the factors of accuracy, user fairness, and item
fairness? Could we classify algorithms based on these metrics?
Evaluation Metrics
● NDCG
● Generalized Cross-Entropy (GCE)
● Mean Absolute Deviation of ranking performance (MADr)
Deldjoo, Y., Anelli, V.W., Zamani, H., Bellogin, A., Di Noia, T.: A flexible framework for evaluating user and item fairness in recommender systems. User Modeling and
User-Adapted Interaction pp. 1–55 (2021)
Recommendation Models
Conventional
Neural CF
Context-aware
01 | NeuMF
02 | VAECF
01 | GeoSoCa
02 | LORE
01 | MostPop
02 | BPR
03 | WMF
04 | PF
Trade-off on Accuracy, User and Item Fairness
Yelp
Gowalla
Popularity Bias in POI Recommendation
Conclusion
01 | We analyzed the trade-off between accuracy, relevance to user groups, and popular item exposures fairness.
02 | Numerous methods failed to balance the item and user fairness due to the natural biases in data.
03 | VAECF produces the best level of accuracy, user fairness, and item fairness.
04 | Usually, one aspect, item fairness or user fairness, is compromised to keep the accuracy high.
Open Questions
01 | Extending the experiments on more datasets from different domains and models.
02 | Investigating the different type of bias, such as gender bias, can be a potential direction for future research.
03 | Proposing a single metric that can serve for the evaluation of all these dimensions for a given RecSys model.
Thank you.
Hossein A. Rahmani, Yashar Deldjoo, Ali Tourani, Mohammadmehdi Naghiaei
https://recsys-lab.github.io/FairPOI/

More Related Content

Similar to The Unfairness of Active Users and Popularity Bias in Point-of-Interest Recommendation (BIAS@ECIR22)

Interactive Recommender Systems
Interactive Recommender SystemsInteractive Recommender Systems
Interactive Recommender Systems
Katrien Verbert
 
Agents vs Users: Visual Recommendation of Research Talks with Multiple Dimens...
Agents vs Users: Visual Recommendation of Research Talks with Multiple Dimens...Agents vs Users: Visual Recommendation of Research Talks with Multiple Dimens...
Agents vs Users: Visual Recommendation of Research Talks with Multiple Dimens...
Katrien Verbert
 
Using Behavioral Data - Netquest - NewMR May 22.pptx.pdf
Using Behavioral Data - Netquest - NewMR May 22.pptx.pdfUsing Behavioral Data - Netquest - NewMR May 22.pptx.pdf
Using Behavioral Data - Netquest - NewMR May 22.pptx.pdf
Ray Poynter
 
Mixed-initiative recommender systems
Mixed-initiative recommender systemsMixed-initiative recommender systems
Mixed-initiative recommender systems
Katrien Verbert
 
Contribution to proactivity in mobile context-aware recommender systems
Contribution to proactivity in mobile context-aware recommender systemsContribution to proactivity in mobile context-aware recommender systems
Contribution to proactivity in mobile context-aware recommender systems
Daniel Gallego Vico
 
Social Media
Social MediaSocial Media
Social Media
Munirah Memo
 
Interactive recommender systems: opening up the “black box”
Interactive recommender systems: opening up the “black box”Interactive recommender systems: opening up the “black box”
Interactive recommender systems: opening up the “black box”
Katrien Verbert
 
Recommendations for Open Online Education: An Algorithmic Study
Recommendations for Open Online Education:  An Algorithmic StudyRecommendations for Open Online Education:  An Algorithmic Study
Recommendations for Open Online Education: An Algorithmic Study
Hendrik Drachsler
 
Stakeholders of Organic Products in Mexico and Korea
Stakeholders of Organic Products in Mexico and KoreaStakeholders of Organic Products in Mexico and Korea
Stakeholders of Organic Products in Mexico and Korea
Xanat V. Meza
 
Eb m congress 2020 embedding consumer involvement in cochrane richard morley
Eb m congress 2020 embedding consumer involvement in cochrane richard morleyEb m congress 2020 embedding consumer involvement in cochrane richard morley
Eb m congress 2020 embedding consumer involvement in cochrane richard morley
Richard Morley
 
HealthRecSys: Phd Dissertation.
HealthRecSys: Phd Dissertation.HealthRecSys: Phd Dissertation.
HealthRecSys: Phd Dissertation.
Carlos Luis Sánchez Bocanegra
 
Tutorial on metrics of user engagement -- Applications to Search & E- commerce
Tutorial on metrics of user engagement -- Applications to Search & E- commerceTutorial on metrics of user engagement -- Applications to Search & E- commerce
Tutorial on metrics of user engagement -- Applications to Search & E- commerce
Mounia Lalmas-Roelleke
 
User Control in Adaptive Information Access
User Control in Adaptive Information AccessUser Control in Adaptive Information Access
User Control in Adaptive Information Access
Peter Brusilovsky
 
Metrics, Engagement & Personalization
Metrics, Engagement & Personalization Metrics, Engagement & Personalization
Metrics, Engagement & Personalization
Mounia Lalmas-Roelleke
 
Strategie di comunicazione online per prodotti innovativi. Uno studio empiri...
 Strategie di comunicazione online per prodotti innovativi. Uno studio empiri... Strategie di comunicazione online per prodotti innovativi. Uno studio empiri...
Strategie di comunicazione online per prodotti innovativi. Uno studio empiri...
Target Research
 
Effect of online reviews on consumer purchase behaviour
Effect of online reviews on consumer purchase behaviourEffect of online reviews on consumer purchase behaviour
Effect of online reviews on consumer purchase behaviour
SadiahAhmad
 
Mixed-initiative recommender systems: towards a next generation of recommende...
Mixed-initiative recommender systems: towards a next generation of recommende...Mixed-initiative recommender systems: towards a next generation of recommende...
Mixed-initiative recommender systems: towards a next generation of recommende...
Katrien Verbert
 
Online Travel Reviews on Mobile Applications when making travel plans: Uses a...
Online Travel Reviews on Mobile Applications when making travel plans: Uses a...Online Travel Reviews on Mobile Applications when making travel plans: Uses a...
Online Travel Reviews on Mobile Applications when making travel plans: Uses a...
International Federation for Information Technologies in Travel and Tourism (IFITT)
 
ICAR-IFPRI : Problems of Impact Evaluation Confounding Factors and Selection ...
ICAR-IFPRI : Problems of Impact Evaluation Confounding Factors and Selection ...ICAR-IFPRI : Problems of Impact Evaluation Confounding Factors and Selection ...
ICAR-IFPRI : Problems of Impact Evaluation Confounding Factors and Selection ...
International Food Policy Research Institute- South Asia Office
 
(AEIOU) Project.wsa
(AEIOU) Project.wsa (AEIOU) Project.wsa
(AEIOU) Project.wsa
Salma A
 

Similar to The Unfairness of Active Users and Popularity Bias in Point-of-Interest Recommendation (BIAS@ECIR22) (20)

Interactive Recommender Systems
Interactive Recommender SystemsInteractive Recommender Systems
Interactive Recommender Systems
 
Agents vs Users: Visual Recommendation of Research Talks with Multiple Dimens...
Agents vs Users: Visual Recommendation of Research Talks with Multiple Dimens...Agents vs Users: Visual Recommendation of Research Talks with Multiple Dimens...
Agents vs Users: Visual Recommendation of Research Talks with Multiple Dimens...
 
Using Behavioral Data - Netquest - NewMR May 22.pptx.pdf
Using Behavioral Data - Netquest - NewMR May 22.pptx.pdfUsing Behavioral Data - Netquest - NewMR May 22.pptx.pdf
Using Behavioral Data - Netquest - NewMR May 22.pptx.pdf
 
Mixed-initiative recommender systems
Mixed-initiative recommender systemsMixed-initiative recommender systems
Mixed-initiative recommender systems
 
Contribution to proactivity in mobile context-aware recommender systems
Contribution to proactivity in mobile context-aware recommender systemsContribution to proactivity in mobile context-aware recommender systems
Contribution to proactivity in mobile context-aware recommender systems
 
Social Media
Social MediaSocial Media
Social Media
 
Interactive recommender systems: opening up the “black box”
Interactive recommender systems: opening up the “black box”Interactive recommender systems: opening up the “black box”
Interactive recommender systems: opening up the “black box”
 
Recommendations for Open Online Education: An Algorithmic Study
Recommendations for Open Online Education:  An Algorithmic StudyRecommendations for Open Online Education:  An Algorithmic Study
Recommendations for Open Online Education: An Algorithmic Study
 
Stakeholders of Organic Products in Mexico and Korea
Stakeholders of Organic Products in Mexico and KoreaStakeholders of Organic Products in Mexico and Korea
Stakeholders of Organic Products in Mexico and Korea
 
Eb m congress 2020 embedding consumer involvement in cochrane richard morley
Eb m congress 2020 embedding consumer involvement in cochrane richard morleyEb m congress 2020 embedding consumer involvement in cochrane richard morley
Eb m congress 2020 embedding consumer involvement in cochrane richard morley
 
HealthRecSys: Phd Dissertation.
HealthRecSys: Phd Dissertation.HealthRecSys: Phd Dissertation.
HealthRecSys: Phd Dissertation.
 
Tutorial on metrics of user engagement -- Applications to Search & E- commerce
Tutorial on metrics of user engagement -- Applications to Search & E- commerceTutorial on metrics of user engagement -- Applications to Search & E- commerce
Tutorial on metrics of user engagement -- Applications to Search & E- commerce
 
User Control in Adaptive Information Access
User Control in Adaptive Information AccessUser Control in Adaptive Information Access
User Control in Adaptive Information Access
 
Metrics, Engagement & Personalization
Metrics, Engagement & Personalization Metrics, Engagement & Personalization
Metrics, Engagement & Personalization
 
Strategie di comunicazione online per prodotti innovativi. Uno studio empiri...
 Strategie di comunicazione online per prodotti innovativi. Uno studio empiri... Strategie di comunicazione online per prodotti innovativi. Uno studio empiri...
Strategie di comunicazione online per prodotti innovativi. Uno studio empiri...
 
Effect of online reviews on consumer purchase behaviour
Effect of online reviews on consumer purchase behaviourEffect of online reviews on consumer purchase behaviour
Effect of online reviews on consumer purchase behaviour
 
Mixed-initiative recommender systems: towards a next generation of recommende...
Mixed-initiative recommender systems: towards a next generation of recommende...Mixed-initiative recommender systems: towards a next generation of recommende...
Mixed-initiative recommender systems: towards a next generation of recommende...
 
Online Travel Reviews on Mobile Applications when making travel plans: Uses a...
Online Travel Reviews on Mobile Applications when making travel plans: Uses a...Online Travel Reviews on Mobile Applications when making travel plans: Uses a...
Online Travel Reviews on Mobile Applications when making travel plans: Uses a...
 
ICAR-IFPRI : Problems of Impact Evaluation Confounding Factors and Selection ...
ICAR-IFPRI : Problems of Impact Evaluation Confounding Factors and Selection ...ICAR-IFPRI : Problems of Impact Evaluation Confounding Factors and Selection ...
ICAR-IFPRI : Problems of Impact Evaluation Confounding Factors and Selection ...
 
(AEIOU) Project.wsa
(AEIOU) Project.wsa (AEIOU) Project.wsa
(AEIOU) Project.wsa
 

More from Hossein A. (Saeed) Rahmani

Beyond-Accuracy Provider Fairness (Slides)
Beyond-Accuracy Provider Fairness (Slides)Beyond-Accuracy Provider Fairness (Slides)
Beyond-Accuracy Provider Fairness (Slides)
Hossein A. (Saeed) Rahmani
 
ContextsPOI (Slides)
ContextsPOI (Slides)ContextsPOI (Slides)
ContextsPOI (Slides)
Hossein A. (Saeed) Rahmani
 
ACQSurvey (Slides)
ACQSurvey (Slides)ACQSurvey (Slides)
ACQSurvey (Slides)
Hossein A. (Saeed) Rahmani
 
ACQSurvey (Poster)
ACQSurvey (Poster)ACQSurvey (Poster)
ACQSurvey (Poster)
Hossein A. (Saeed) Rahmani
 
Towards Confidence-aware Calibrated Recommendation (Poster)
Towards Confidence-aware Calibrated Recommendation (Poster)Towards Confidence-aware Calibrated Recommendation (Poster)
Towards Confidence-aware Calibrated Recommendation (Poster)
Hossein A. (Saeed) Rahmani
 
Towards Confidence-aware Calibrated Recommendation (Slides)
Towards Confidence-aware Calibrated Recommendation (Slides)Towards Confidence-aware Calibrated Recommendation (Slides)
Towards Confidence-aware Calibrated Recommendation (Slides)
Hossein A. (Saeed) Rahmani
 
CPFair: Personalized Consumer and Producer Fairness Re-ranking for Recommende...
CPFair: Personalized Consumer and Producer Fairness Re-ranking for Recommende...CPFair: Personalized Consumer and Producer Fairness Re-ranking for Recommende...
CPFair: Personalized Consumer and Producer Fairness Re-ranking for Recommende...
Hossein A. (Saeed) Rahmani
 
The Unfairness of Popularity Bias in Book Recommendation (Bias@ECIR22)
The Unfairness of Popularity Bias in Book Recommendation (Bias@ECIR22)The Unfairness of Popularity Bias in Book Recommendation (Bias@ECIR22)
The Unfairness of Popularity Bias in Book Recommendation (Bias@ECIR22)
Hossein A. (Saeed) Rahmani
 
Introduction to Complex Networks
Introduction to Complex NetworksIntroduction to Complex Networks
Introduction to Complex Networks
Hossein A. (Saeed) Rahmani
 

More from Hossein A. (Saeed) Rahmani (9)

Beyond-Accuracy Provider Fairness (Slides)
Beyond-Accuracy Provider Fairness (Slides)Beyond-Accuracy Provider Fairness (Slides)
Beyond-Accuracy Provider Fairness (Slides)
 
ContextsPOI (Slides)
ContextsPOI (Slides)ContextsPOI (Slides)
ContextsPOI (Slides)
 
ACQSurvey (Slides)
ACQSurvey (Slides)ACQSurvey (Slides)
ACQSurvey (Slides)
 
ACQSurvey (Poster)
ACQSurvey (Poster)ACQSurvey (Poster)
ACQSurvey (Poster)
 
Towards Confidence-aware Calibrated Recommendation (Poster)
Towards Confidence-aware Calibrated Recommendation (Poster)Towards Confidence-aware Calibrated Recommendation (Poster)
Towards Confidence-aware Calibrated Recommendation (Poster)
 
Towards Confidence-aware Calibrated Recommendation (Slides)
Towards Confidence-aware Calibrated Recommendation (Slides)Towards Confidence-aware Calibrated Recommendation (Slides)
Towards Confidence-aware Calibrated Recommendation (Slides)
 
CPFair: Personalized Consumer and Producer Fairness Re-ranking for Recommende...
CPFair: Personalized Consumer and Producer Fairness Re-ranking for Recommende...CPFair: Personalized Consumer and Producer Fairness Re-ranking for Recommende...
CPFair: Personalized Consumer and Producer Fairness Re-ranking for Recommende...
 
The Unfairness of Popularity Bias in Book Recommendation (Bias@ECIR22)
The Unfairness of Popularity Bias in Book Recommendation (Bias@ECIR22)The Unfairness of Popularity Bias in Book Recommendation (Bias@ECIR22)
The Unfairness of Popularity Bias in Book Recommendation (Bias@ECIR22)
 
Introduction to Complex Networks
Introduction to Complex NetworksIntroduction to Complex Networks
Introduction to Complex Networks
 

Recently uploaded

Embedded machine learning-based road conditions and driving behavior monitoring
Embedded machine learning-based road conditions and driving behavior monitoringEmbedded machine learning-based road conditions and driving behavior monitoring
Embedded machine learning-based road conditions and driving behavior monitoring
IJECEIAES
 
Introduction to AI Safety (public presentation).pptx
Introduction to AI Safety (public presentation).pptxIntroduction to AI Safety (public presentation).pptx
Introduction to AI Safety (public presentation).pptx
MiscAnnoy1
 
Mechanical Engineering on AAI Summer Training Report-003.pdf
Mechanical Engineering on AAI Summer Training Report-003.pdfMechanical Engineering on AAI Summer Training Report-003.pdf
Mechanical Engineering on AAI Summer Training Report-003.pdf
21UME003TUSHARDEB
 
Software Quality Assurance-se412-v11.ppt
Software Quality Assurance-se412-v11.pptSoftware Quality Assurance-se412-v11.ppt
Software Quality Assurance-se412-v11.ppt
TaghreedAltamimi
 
AI assisted telemedicine KIOSK for Rural India.pptx
AI assisted telemedicine KIOSK for Rural India.pptxAI assisted telemedicine KIOSK for Rural India.pptx
AI assisted telemedicine KIOSK for Rural India.pptx
architagupta876
 
Curve Fitting in Numerical Methods Regression
Curve Fitting in Numerical Methods RegressionCurve Fitting in Numerical Methods Regression
Curve Fitting in Numerical Methods Regression
Nada Hikmah
 
官方认证美国密歇根州立大学毕业证学位证书原版一模一样
官方认证美国密歇根州立大学毕业证学位证书原版一模一样官方认证美国密歇根州立大学毕业证学位证书原版一模一样
官方认证美国密歇根州立大学毕业证学位证书原版一模一样
171ticu
 
CEC 352 - SATELLITE COMMUNICATION UNIT 1
CEC 352 - SATELLITE COMMUNICATION UNIT 1CEC 352 - SATELLITE COMMUNICATION UNIT 1
CEC 352 - SATELLITE COMMUNICATION UNIT 1
PKavitha10
 
Seminar on Distillation study-mafia.pptx
Seminar on Distillation study-mafia.pptxSeminar on Distillation study-mafia.pptx
Seminar on Distillation study-mafia.pptx
Madan Karki
 
Use PyCharm for remote debugging of WSL on a Windo cf5c162d672e4e58b4dde5d797...
Use PyCharm for remote debugging of WSL on a Windo cf5c162d672e4e58b4dde5d797...Use PyCharm for remote debugging of WSL on a Windo cf5c162d672e4e58b4dde5d797...
Use PyCharm for remote debugging of WSL on a Windo cf5c162d672e4e58b4dde5d797...
shadow0702a
 
Engineering Drawings Lecture Detail Drawings 2014.pdf
Engineering Drawings Lecture Detail Drawings 2014.pdfEngineering Drawings Lecture Detail Drawings 2014.pdf
Engineering Drawings Lecture Detail Drawings 2014.pdf
abbyasa1014
 
BRAIN TUMOR DETECTION for seminar ppt.pdf
BRAIN TUMOR DETECTION for seminar ppt.pdfBRAIN TUMOR DETECTION for seminar ppt.pdf
BRAIN TUMOR DETECTION for seminar ppt.pdf
LAXMAREDDY22
 
Properties Railway Sleepers and Test.pptx
Properties Railway Sleepers and Test.pptxProperties Railway Sleepers and Test.pptx
Properties Railway Sleepers and Test.pptx
MDSABBIROJJAMANPAYEL
 
学校原版美国波士顿大学毕业证学历学位证书原版一模一样
学校原版美国波士顿大学毕业证学历学位证书原版一模一样学校原版美国波士顿大学毕业证学历学位证书原版一模一样
学校原版美国波士顿大学毕业证学历学位证书原版一模一样
171ticu
 
ISPM 15 Heat Treated Wood Stamps and why your shipping must have one
ISPM 15 Heat Treated Wood Stamps and why your shipping must have oneISPM 15 Heat Treated Wood Stamps and why your shipping must have one
ISPM 15 Heat Treated Wood Stamps and why your shipping must have one
Las Vegas Warehouse
 
Unit-III-ELECTROCHEMICAL STORAGE DEVICES.ppt
Unit-III-ELECTROCHEMICAL STORAGE DEVICES.pptUnit-III-ELECTROCHEMICAL STORAGE DEVICES.ppt
Unit-III-ELECTROCHEMICAL STORAGE DEVICES.ppt
KrishnaveniKrishnara1
 
IEEE Aerospace and Electronic Systems Society as a Graduate Student Member
IEEE Aerospace and Electronic Systems Society as a Graduate Student MemberIEEE Aerospace and Electronic Systems Society as a Graduate Student Member
IEEE Aerospace and Electronic Systems Society as a Graduate Student Member
VICTOR MAESTRE RAMIREZ
 
LLM Fine Tuning with QLoRA Cassandra Lunch 4, presented by Anant
LLM Fine Tuning with QLoRA Cassandra Lunch 4, presented by AnantLLM Fine Tuning with QLoRA Cassandra Lunch 4, presented by Anant
LLM Fine Tuning with QLoRA Cassandra Lunch 4, presented by Anant
Anant Corporation
 
Optimizing Gradle Builds - Gradle DPE Tour Berlin 2024
Optimizing Gradle Builds - Gradle DPE Tour Berlin 2024Optimizing Gradle Builds - Gradle DPE Tour Berlin 2024
Optimizing Gradle Builds - Gradle DPE Tour Berlin 2024
Sinan KOZAK
 
cnn.pptx Convolutional neural network used for image classication
cnn.pptx Convolutional neural network used for image classicationcnn.pptx Convolutional neural network used for image classication
cnn.pptx Convolutional neural network used for image classication
SakkaravarthiShanmug
 

Recently uploaded (20)

Embedded machine learning-based road conditions and driving behavior monitoring
Embedded machine learning-based road conditions and driving behavior monitoringEmbedded machine learning-based road conditions and driving behavior monitoring
Embedded machine learning-based road conditions and driving behavior monitoring
 
Introduction to AI Safety (public presentation).pptx
Introduction to AI Safety (public presentation).pptxIntroduction to AI Safety (public presentation).pptx
Introduction to AI Safety (public presentation).pptx
 
Mechanical Engineering on AAI Summer Training Report-003.pdf
Mechanical Engineering on AAI Summer Training Report-003.pdfMechanical Engineering on AAI Summer Training Report-003.pdf
Mechanical Engineering on AAI Summer Training Report-003.pdf
 
Software Quality Assurance-se412-v11.ppt
Software Quality Assurance-se412-v11.pptSoftware Quality Assurance-se412-v11.ppt
Software Quality Assurance-se412-v11.ppt
 
AI assisted telemedicine KIOSK for Rural India.pptx
AI assisted telemedicine KIOSK for Rural India.pptxAI assisted telemedicine KIOSK for Rural India.pptx
AI assisted telemedicine KIOSK for Rural India.pptx
 
Curve Fitting in Numerical Methods Regression
Curve Fitting in Numerical Methods RegressionCurve Fitting in Numerical Methods Regression
Curve Fitting in Numerical Methods Regression
 
官方认证美国密歇根州立大学毕业证学位证书原版一模一样
官方认证美国密歇根州立大学毕业证学位证书原版一模一样官方认证美国密歇根州立大学毕业证学位证书原版一模一样
官方认证美国密歇根州立大学毕业证学位证书原版一模一样
 
CEC 352 - SATELLITE COMMUNICATION UNIT 1
CEC 352 - SATELLITE COMMUNICATION UNIT 1CEC 352 - SATELLITE COMMUNICATION UNIT 1
CEC 352 - SATELLITE COMMUNICATION UNIT 1
 
Seminar on Distillation study-mafia.pptx
Seminar on Distillation study-mafia.pptxSeminar on Distillation study-mafia.pptx
Seminar on Distillation study-mafia.pptx
 
Use PyCharm for remote debugging of WSL on a Windo cf5c162d672e4e58b4dde5d797...
Use PyCharm for remote debugging of WSL on a Windo cf5c162d672e4e58b4dde5d797...Use PyCharm for remote debugging of WSL on a Windo cf5c162d672e4e58b4dde5d797...
Use PyCharm for remote debugging of WSL on a Windo cf5c162d672e4e58b4dde5d797...
 
Engineering Drawings Lecture Detail Drawings 2014.pdf
Engineering Drawings Lecture Detail Drawings 2014.pdfEngineering Drawings Lecture Detail Drawings 2014.pdf
Engineering Drawings Lecture Detail Drawings 2014.pdf
 
BRAIN TUMOR DETECTION for seminar ppt.pdf
BRAIN TUMOR DETECTION for seminar ppt.pdfBRAIN TUMOR DETECTION for seminar ppt.pdf
BRAIN TUMOR DETECTION for seminar ppt.pdf
 
Properties Railway Sleepers and Test.pptx
Properties Railway Sleepers and Test.pptxProperties Railway Sleepers and Test.pptx
Properties Railway Sleepers and Test.pptx
 
学校原版美国波士顿大学毕业证学历学位证书原版一模一样
学校原版美国波士顿大学毕业证学历学位证书原版一模一样学校原版美国波士顿大学毕业证学历学位证书原版一模一样
学校原版美国波士顿大学毕业证学历学位证书原版一模一样
 
ISPM 15 Heat Treated Wood Stamps and why your shipping must have one
ISPM 15 Heat Treated Wood Stamps and why your shipping must have oneISPM 15 Heat Treated Wood Stamps and why your shipping must have one
ISPM 15 Heat Treated Wood Stamps and why your shipping must have one
 
Unit-III-ELECTROCHEMICAL STORAGE DEVICES.ppt
Unit-III-ELECTROCHEMICAL STORAGE DEVICES.pptUnit-III-ELECTROCHEMICAL STORAGE DEVICES.ppt
Unit-III-ELECTROCHEMICAL STORAGE DEVICES.ppt
 
IEEE Aerospace and Electronic Systems Society as a Graduate Student Member
IEEE Aerospace and Electronic Systems Society as a Graduate Student MemberIEEE Aerospace and Electronic Systems Society as a Graduate Student Member
IEEE Aerospace and Electronic Systems Society as a Graduate Student Member
 
LLM Fine Tuning with QLoRA Cassandra Lunch 4, presented by Anant
LLM Fine Tuning with QLoRA Cassandra Lunch 4, presented by AnantLLM Fine Tuning with QLoRA Cassandra Lunch 4, presented by Anant
LLM Fine Tuning with QLoRA Cassandra Lunch 4, presented by Anant
 
Optimizing Gradle Builds - Gradle DPE Tour Berlin 2024
Optimizing Gradle Builds - Gradle DPE Tour Berlin 2024Optimizing Gradle Builds - Gradle DPE Tour Berlin 2024
Optimizing Gradle Builds - Gradle DPE Tour Berlin 2024
 
cnn.pptx Convolutional neural network used for image classication
cnn.pptx Convolutional neural network used for image classicationcnn.pptx Convolutional neural network used for image classication
cnn.pptx Convolutional neural network used for image classication
 

The Unfairness of Active Users and Popularity Bias in Point-of-Interest Recommendation (BIAS@ECIR22)

  • 1. The Unfairness of Active Users and Popularity Bias in Point-of-Interest Recommendation Hossein A. Rahmani University College London United Kingdom h.rahmani@ucl.ac.uk Yashar Deldjoo Polytechnic University of Bari Italy deldjooy@acm.org Ali Tourani University of Guilan Iran tourani@msc.guilan.ac.ir Mohammadmehdi Naghiaei University of Southern California, USA naghiaei@usc.edu The 44th European Conference on Information Retrieval (ECIR) Third International Workshop on Algorithmic Bias in Search and Recommendation (Bias 2022) Bias 2022, Stavanger, Norway
  • 2. Motivation ● Point-of-Interest (POI) recommender system provide personalized recommendation to users while helping businesses attract customers ● Highly data-driven recommendations could be impacted by data biases ● Most research papers focus on biases only on one stakeholder ignoring the interplays
  • 3. Contributions Studying the interplay between <Personalization>, <unfairness of active users>, <unfairness of popular items> ● RQ1: To what extent are users or groups of users (active vs. inactive) are interested in popular POIs? That is identifying natural data bias toward popularity. ● RQ2: Is there a trade-off among the factors of accuracy, user fairness, and item fairness? ● RQ3: Could we classify algorithms based on their performance on the accuracy, user fairness, and item fairness?
  • 4. Datasets Number of Users 7,135 Yelp Gowalla 5,628 Number of POIs 15,575 39,943 Number of Check-ins 299,327 618,621 Sparsity 99.74% 99.65% Liu, Yiding, Tuan-Anh Nguyen Pham, Gao Cong, and Quan Yuan. "An experimental evaluation of point-of-interest recommendation in location-based social networks." Proceedings of the VLDB Endowment 10, no. 10 (2017): 1010-1021. For each user, the earliest 70% check-ins used as training data, the most recent 20% check-ins as test data, and the remaining 10% as validation data. Time Feb 2016 Feb. 2009 to Oct. 2010
  • 5. To what extent are users or groups of users interested in popular POIs? That is identifying natural data bias toward popularity.
  • 6. Consumption Distribution of POIs Gowalla Yelp ● A long-term distribution of the POI checks-ins, where few items (POIs) are consumed (visited) by many users, while few users only see most POIs. ● Three categories of items ○ short-head (50% of POIs) ○ mid-tail (30% of POIs) ○ long-tail (20% of POIs) ● User groups ○ Very inactive, slightly inactive, slightly active, and very active based on their number of check-ins. Liu, Y., Pham, T.A.N., Cong, G., Yuan, Q.: An experimental evaluation of point-of-interest recommendation in location-based social networks. Proceedings of the VLDB Endowment 10 (10), 1010–1021 (2017) (a) (b) (c) (d)
  • 7. User Profiles, and Popularity Bias Gowalla Yelp ● Increasing the number of items in a user profile extends the probability of finding popular POIs ● Users with fewer items included in their profiles prefer to attend more popular POIs
  • 8. Is there a trade-off among the factors of accuracy, user fairness, and item fairness? Could we classify algorithms based on these metrics?
  • 9. Evaluation Metrics ● NDCG ● Generalized Cross-Entropy (GCE) ● Mean Absolute Deviation of ranking performance (MADr) Deldjoo, Y., Anelli, V.W., Zamani, H., Bellogin, A., Di Noia, T.: A flexible framework for evaluating user and item fairness in recommender systems. User Modeling and User-Adapted Interaction pp. 1–55 (2021)
  • 10. Recommendation Models Conventional Neural CF Context-aware 01 | NeuMF 02 | VAECF 01 | GeoSoCa 02 | LORE 01 | MostPop 02 | BPR 03 | WMF 04 | PF
  • 11. Trade-off on Accuracy, User and Item Fairness Yelp Gowalla
  • 12. Popularity Bias in POI Recommendation
  • 13. Conclusion 01 | We analyzed the trade-off between accuracy, relevance to user groups, and popular item exposures fairness. 02 | Numerous methods failed to balance the item and user fairness due to the natural biases in data. 03 | VAECF produces the best level of accuracy, user fairness, and item fairness. 04 | Usually, one aspect, item fairness or user fairness, is compromised to keep the accuracy high.
  • 14. Open Questions 01 | Extending the experiments on more datasets from different domains and models. 02 | Investigating the different type of bias, such as gender bias, can be a potential direction for future research. 03 | Proposing a single metric that can serve for the evaluation of all these dimensions for a given RecSys model.
  • 15. Thank you. Hossein A. Rahmani, Yashar Deldjoo, Ali Tourani, Mohammadmehdi Naghiaei https://recsys-lab.github.io/FairPOI/