The document describes a holistic user modeling approach for building personalized user profiles. Data is collected from various sources like social media, smartphones, and fitness trackers. This data is processed and used to populate facets of a user profile like demographics, interests, behaviors, and physical states. The profiles are made available via an API to power personalized services while giving users control over their data and privacy settings. A platform called Myrror was developed to create and manage these holistic user profiles.
A Framework for Holistic User Modeling Merging Heterogeneous Digital FootprintsCataldo Musto
A Framework for Holistic User Modeling Merging Heterogeneous Digital Footprints - HUM 2018 – Holistic User Modeling Workshop jointly held with
UMAP 2018 – 26th International
Conference on User Modeling,
Adaptation and Personalization
Singapore - July 8, 2018
Combining Social Data and Semantic Content Analysis for L’Aquila Social Urban...Cataldo Musto
Combining Social Data and
Semantic Content Analysis for
L’Aquila Social Urban Network - Cataldo Musto, Giovanni Semeraro, Marco de Gemmis, Pasquale Lops (Università degli Studi di Bari ‘Aldo Moro’, Italy - SWAP Research Group) - I-CiTies 2015
2015 CINI Annual Workshop on ICT for Smart Cities and Communities Palermo (Italy) - October 29-30, 2015
A Framework for Holistic User Modeling Merging Heterogeneous Digital FootprintsCataldo Musto
A Framework for Holistic User Modeling Merging Heterogeneous Digital Footprints - HUM 2018 – Holistic User Modeling Workshop jointly held with
UMAP 2018 – 26th International
Conference on User Modeling,
Adaptation and Personalization
Singapore - July 8, 2018
Combining Social Data and Semantic Content Analysis for L’Aquila Social Urban...Cataldo Musto
Combining Social Data and
Semantic Content Analysis for
L’Aquila Social Urban Network - Cataldo Musto, Giovanni Semeraro, Marco de Gemmis, Pasquale Lops (Università degli Studi di Bari ‘Aldo Moro’, Italy - SWAP Research Group) - I-CiTies 2015
2015 CINI Annual Workshop on ICT for Smart Cities and Communities Palermo (Italy) - October 29-30, 2015
In this project, the analysis will break down Snapchat Inc's 9 elements of the business model. An assignment from curiosity, adventure, and my career interest advertisement.
Artificial Intelligence influencing the Social Media Industry.pdfMarkThomas316888
Coddle Technologies provide a complete spectrum of software development services delivering innovative solutions for Startups, SMBs and Enterprises
Website : https://www.coddletech.com/
TrendsSpotting's 2010 Social Media Influencers - Trend Predictions in 140 Cha...Taly Weiss
"2010 Social Media Influencers" is the first report from the series "2010 Influencers Series: Trend Predictions in 140 Characters".
TrendsSpotting Market Research is now running its third annual prediction reports following major trends in six categories. We will be featuring the predictions of digital and marketing experts on the big changes awaiting us in the coming year.
This year we are adopting a new “tweet style” format, easier for you to focus on, comprehend and forward.
A report by thenetworkone and Kurio.
The contributing experts and agencies are (in an alphabetical order): Megan Encarnacion, Associate Director Social Media & Christopher Dimmock, SVP Integrated Strategy, Abelson Taylor (USA); Ramaa Mosley, CEO Adolescent Content/Youthtellers & Serenity Griffin, Community Manager & Michelle Castillo, Youthteller Consultant &Jola Adeoye, Youthteller Consultant & Sophie Wieters, Youthteller Consultant & Rea Sweets, Youthteller Consultant & Nathalie Alvarez, Youthteller Consultant & Jacob Thompson, Youthteller Consultant § Jadon Velasquez, Youthteller Consultant § Maya Minhas, Youthteller Consultant & Khrystina Warnstadt, Youthteller Consultant, Adolescent Content (USA); Alex Casanovas, Digital Director. Atrevia (ES); Natalie Chaney, Social Strategist, Barrett (USA); Seyi Alawode, Founder & Head of Strategy, CHL (NGA / UK); Eli Williams, Sr. Creative Strategist, Day One Agency (USA); Francesca Trevisan, Strategist, Different (IT); Jide Agbana, Global Product Marketing Manager, Enterfive (US / UK / NGA); Olivia Hussey, Junior Planner, The Hallway (AUS); James Hebbert, Managing Director, Hylink UK (CH / UK); Laura Marzec, Content Strategy at Imagination, part of The Mx Group (USA); Valentina Lagos, Social Media Manager & Felipe "Peluche" León, Digital Director & Mundy Álvarez, Planning Director & Pancho González, CCO, Inbrax (CH); Oana Oprea, Head of Digital Planning, Jam Session Agency (RO); Alix Le Bourgeois, Lead Strategist, JIN (UK/FR); Leigh Tayler, Integrated Strategy Director, Joe Public (SA); Amy Bottrill, Social Account Director, Launch (UK); Gaby Arriaga, Founder of Leonardo1452, Leonardo1452 (MX), Rajesh Mehta, Chief Strategy Officer & Dhruv Gaur, Digital Planning Lead, Medulla (IN); Maira Genovese, Founder and President, MG Empower (UK); Aryana Noorbakhsh, Senior Digital Marketing Executive, Osaka Labs (UK); Timotée Louise Gbaguidi, Digital Communications Director, PIABO (DE); Alexandre Ouairy, Founder and Director, PLTFRM (CN); Daffi Ranandi, Junior Insights Manager, Radarr (SGP); Hannah Nickels, Head Paid & Owned Media Thinker, Thinkerbell (AUS); Allison Lee, Social Team Co-Lead, UltraSuperNew (JP)
This presentation was delivered at STLX 2019; the conference for user experience professionals in the St. Louis region. The content discussed two frameworks from city planning and discussed their current relevance and future application for those designing experiences with technology.
Intelligenza Artificiale e Social Media - Monitoraggio della Farnesina e La M...Cataldo Musto
Convegno a Porte Chiuse dell'Associazione Italiana per l'Intelligenza Artificiale insieme al Ministero per gli Affari Esteri e la Cooperazione Internazionale - 30 Giugno 2021
More Related Content
Similar to Holistic User Modeling for Personalized Services in Smart Cities
In this project, the analysis will break down Snapchat Inc's 9 elements of the business model. An assignment from curiosity, adventure, and my career interest advertisement.
Artificial Intelligence influencing the Social Media Industry.pdfMarkThomas316888
Coddle Technologies provide a complete spectrum of software development services delivering innovative solutions for Startups, SMBs and Enterprises
Website : https://www.coddletech.com/
TrendsSpotting's 2010 Social Media Influencers - Trend Predictions in 140 Cha...Taly Weiss
"2010 Social Media Influencers" is the first report from the series "2010 Influencers Series: Trend Predictions in 140 Characters".
TrendsSpotting Market Research is now running its third annual prediction reports following major trends in six categories. We will be featuring the predictions of digital and marketing experts on the big changes awaiting us in the coming year.
This year we are adopting a new “tweet style” format, easier for you to focus on, comprehend and forward.
A report by thenetworkone and Kurio.
The contributing experts and agencies are (in an alphabetical order): Megan Encarnacion, Associate Director Social Media & Christopher Dimmock, SVP Integrated Strategy, Abelson Taylor (USA); Ramaa Mosley, CEO Adolescent Content/Youthtellers & Serenity Griffin, Community Manager & Michelle Castillo, Youthteller Consultant &Jola Adeoye, Youthteller Consultant & Sophie Wieters, Youthteller Consultant & Rea Sweets, Youthteller Consultant & Nathalie Alvarez, Youthteller Consultant & Jacob Thompson, Youthteller Consultant § Jadon Velasquez, Youthteller Consultant § Maya Minhas, Youthteller Consultant & Khrystina Warnstadt, Youthteller Consultant, Adolescent Content (USA); Alex Casanovas, Digital Director. Atrevia (ES); Natalie Chaney, Social Strategist, Barrett (USA); Seyi Alawode, Founder & Head of Strategy, CHL (NGA / UK); Eli Williams, Sr. Creative Strategist, Day One Agency (USA); Francesca Trevisan, Strategist, Different (IT); Jide Agbana, Global Product Marketing Manager, Enterfive (US / UK / NGA); Olivia Hussey, Junior Planner, The Hallway (AUS); James Hebbert, Managing Director, Hylink UK (CH / UK); Laura Marzec, Content Strategy at Imagination, part of The Mx Group (USA); Valentina Lagos, Social Media Manager & Felipe "Peluche" León, Digital Director & Mundy Álvarez, Planning Director & Pancho González, CCO, Inbrax (CH); Oana Oprea, Head of Digital Planning, Jam Session Agency (RO); Alix Le Bourgeois, Lead Strategist, JIN (UK/FR); Leigh Tayler, Integrated Strategy Director, Joe Public (SA); Amy Bottrill, Social Account Director, Launch (UK); Gaby Arriaga, Founder of Leonardo1452, Leonardo1452 (MX), Rajesh Mehta, Chief Strategy Officer & Dhruv Gaur, Digital Planning Lead, Medulla (IN); Maira Genovese, Founder and President, MG Empower (UK); Aryana Noorbakhsh, Senior Digital Marketing Executive, Osaka Labs (UK); Timotée Louise Gbaguidi, Digital Communications Director, PIABO (DE); Alexandre Ouairy, Founder and Director, PLTFRM (CN); Daffi Ranandi, Junior Insights Manager, Radarr (SGP); Hannah Nickels, Head Paid & Owned Media Thinker, Thinkerbell (AUS); Allison Lee, Social Team Co-Lead, UltraSuperNew (JP)
This presentation was delivered at STLX 2019; the conference for user experience professionals in the St. Louis region. The content discussed two frameworks from city planning and discussed their current relevance and future application for those designing experiences with technology.
Intelligenza Artificiale e Social Media - Monitoraggio della Farnesina e La M...Cataldo Musto
Convegno a Porte Chiuse dell'Associazione Italiana per l'Intelligenza Artificiale insieme al Ministero per gli Affari Esteri e la Cooperazione Internazionale - 30 Giugno 2021
Exploring the Effects of Natural Language Justifications in Food Recommender ...Cataldo Musto
Cataldo Musto, Alain D. Starke, Christoph Trattner, Amon Rapp, and Giovanni Semeraro. 2021. Exploring the Effects of Natural Language Justifications in Food Recommender Systems. In Proceedings of the 29th ACM
Conference on User Modeling, Adaptation and Personalization (UMAP ’21), June 21–25, 2021, Utrecht, Netherlands. ACM, New York, NY, USA, 11 pages. https://doi.org/10.1145/3450613.3456827
Natural Language Justifications for Recommender Systems Exploiting Text Summa...Cataldo Musto
Natural Language Justifications for Recommender Systems Exploiting Text Summarization and Sentiment Analysis - AI*IA 2019 - Italian Conference on Artificial Intelligence
Temporal and Holistic User Modeling Workshop - THUM@UMAP 2017Cataldo Musto
Opening presentation of the Workshop on Temporal and Holistic User Modeling - Merging Quantified Self with Semantic Content Analytics. Jointly held with UMAP 2017. Bratislava, Slovakia, July 2017.
LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...DanBrown980551
Do you want to learn how to model and simulate an electrical network from scratch in under an hour?
Then welcome to this PowSyBl workshop, hosted by Rte, the French Transmission System Operator (TSO)!
During the webinar, you will discover the PowSyBl ecosystem as well as handle and study an electrical network through an interactive Python notebook.
PowSyBl is an open source project hosted by LF Energy, which offers a comprehensive set of features for electrical grid modelling and simulation. Among other advanced features, PowSyBl provides:
- A fully editable and extendable library for grid component modelling;
- Visualization tools to display your network;
- Grid simulation tools, such as power flows, security analyses (with or without remedial actions) and sensitivity analyses;
The framework is mostly written in Java, with a Python binding so that Python developers can access PowSyBl functionalities as well.
What you will learn during the webinar:
- For beginners: discover PowSyBl's functionalities through a quick general presentation and the notebook, without needing any expert coding skills;
- For advanced developers: master the skills to efficiently apply PowSyBl functionalities to your real-world scenarios.
State of ICS and IoT Cyber Threat Landscape Report 2024 previewPrayukth K V
The IoT and OT threat landscape report has been prepared by the Threat Research Team at Sectrio using data from Sectrio, cyber threat intelligence farming facilities spread across over 85 cities around the world. In addition, Sectrio also runs AI-based advanced threat and payload engagement facilities that serve as sinks to attract and engage sophisticated threat actors, and newer malware including new variants and latent threats that are at an earlier stage of development.
The latest edition of the OT/ICS and IoT security Threat Landscape Report 2024 also covers:
State of global ICS asset and network exposure
Sectoral targets and attacks as well as the cost of ransom
Global APT activity, AI usage, actor and tactic profiles, and implications
Rise in volumes of AI-powered cyberattacks
Major cyber events in 2024
Malware and malicious payload trends
Cyberattack types and targets
Vulnerability exploit attempts on CVEs
Attacks on counties – USA
Expansion of bot farms – how, where, and why
In-depth analysis of the cyber threat landscape across North America, South America, Europe, APAC, and the Middle East
Why are attacks on smart factories rising?
Cyber risk predictions
Axis of attacks – Europe
Systemic attacks in the Middle East
Download the full report from here:
https://sectrio.com/resources/ot-threat-landscape-reports/sectrio-releases-ot-ics-and-iot-security-threat-landscape-report-2024/
Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024Tobias Schneck
As AI technology is pushing into IT I was wondering myself, as an “infrastructure container kubernetes guy”, how get this fancy AI technology get managed from an infrastructure operational view? Is it possible to apply our lovely cloud native principals as well? What benefit’s both technologies could bring to each other?
Let me take this questions and provide you a short journey through existing deployment models and use cases for AI software. On practical examples, we discuss what cloud/on-premise strategy we may need for applying it to our own infrastructure to get it to work from an enterprise perspective. I want to give an overview about infrastructure requirements and technologies, what could be beneficial or limiting your AI use cases in an enterprise environment. An interactive Demo will give you some insides, what approaches I got already working for real.
GraphRAG is All You need? LLM & Knowledge GraphGuy Korland
Guy Korland, CEO and Co-founder of FalkorDB, will review two articles on the integration of language models with knowledge graphs.
1. Unifying Large Language Models and Knowledge Graphs: A Roadmap.
https://arxiv.org/abs/2306.08302
2. Microsoft Research's GraphRAG paper and a review paper on various uses of knowledge graphs:
https://www.microsoft.com/en-us/research/blog/graphrag-unlocking-llm-discovery-on-narrative-private-data/
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024Albert Hoitingh
In this session I delve into the encryption technology used in Microsoft 365 and Microsoft Purview. Including the concepts of Customer Key and Double Key Encryption.
Accelerate your Kubernetes clusters with Varnish CachingThijs Feryn
A presentation about the usage and availability of Varnish on Kubernetes. This talk explores the capabilities of Varnish caching and shows how to use the Varnish Helm chart to deploy it to Kubernetes.
This presentation was delivered at K8SUG Singapore. See https://feryn.eu/presentations/accelerate-your-kubernetes-clusters-with-varnish-caching-k8sug-singapore-28-2024 for more details.
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...James Anderson
Effective Application Security in Software Delivery lifecycle using Deployment Firewall and DBOM
The modern software delivery process (or the CI/CD process) includes many tools, distributed teams, open-source code, and cloud platforms. Constant focus on speed to release software to market, along with the traditional slow and manual security checks has caused gaps in continuous security as an important piece in the software supply chain. Today organizations feel more susceptible to external and internal cyber threats due to the vast attack surface in their applications supply chain and the lack of end-to-end governance and risk management.
The software team must secure its software delivery process to avoid vulnerability and security breaches. This needs to be achieved with existing tool chains and without extensive rework of the delivery processes. This talk will present strategies and techniques for providing visibility into the true risk of the existing vulnerabilities, preventing the introduction of security issues in the software, resolving vulnerabilities in production environments quickly, and capturing the deployment bill of materials (DBOM).
Speakers:
Bob Boule
Robert Boule is a technology enthusiast with PASSION for technology and making things work along with a knack for helping others understand how things work. He comes with around 20 years of solution engineering experience in application security, software continuous delivery, and SaaS platforms. He is known for his dynamic presentations in CI/CD and application security integrated in software delivery lifecycle.
Gopinath Rebala
Gopinath Rebala is the CTO of OpsMx, where he has overall responsibility for the machine learning and data processing architectures for Secure Software Delivery. Gopi also has a strong connection with our customers, leading design and architecture for strategic implementations. Gopi is a frequent speaker and well-known leader in continuous delivery and integrating security into software delivery.
Transcript: Selling digital books in 2024: Insights from industry leaders - T...BookNet Canada
The publishing industry has been selling digital audiobooks and ebooks for over a decade and has found its groove. What’s changed? What has stayed the same? Where do we go from here? Join a group of leading sales peers from across the industry for a conversation about the lessons learned since the popularization of digital books, best practices, digital book supply chain management, and more.
Link to video recording: https://bnctechforum.ca/sessions/selling-digital-books-in-2024-insights-from-industry-leaders/
Presented by BookNet Canada on May 28, 2024, with support from the Department of Canadian Heritage.
Mission to Decommission: Importance of Decommissioning Products to Increase E...
Holistic User Modeling for Personalized Services in Smart Cities
1. @cataldomusto
Holistic User Modeling for
Personalized Services in Smart Cities
CATALDO MUSTO, GIOVANNI SEMERARO
MARCO DE GEMMIS, PASQUALE LOPS, MARCO POLIGNANO
UNIVERSITÀ DEGLI STUDI DI BARI ‘ALDO MORO’ - ITALY
cataldo.musto@uniba.it
2. The ‘Egosystem’
Cataldo Musto, Giovanni Semeraro, Marco de Gemmis, Pasquale Lops, Marco Polignano
Holistic User Modeling for Personalized Services in Smart Cities . i-CITIES 2018. L’Aquila, 19-21 September 2018
3. Data Silos Problem
Cataldo Musto, Giovanni Semeraro, Marco de Gemmis, Pasquale Lops, Marco Polignano
Holistic User Modeling for Personalized Services in Smart Cities . i-CITIES 2018. L’Aquila, 19-21 September 2018
4. What about personalization?
X
Cataldo Musto, Giovanni Semeraro, Marco de Gemmis, Pasquale Lops, Marco Polignano
Holistic User Modeling for Personalized Services in Smart Cities . i-CITIES 2018. L’Aquila, 19-21 September 2018
5. Research Questions
‘’ Is it possible to build a
unique representation of
the user merging data
extracted from personal
devices with data
extracted from social
networks? ‘’
Cataldo Musto, Giovanni Semeraro, Marco de Gemmis, Pasquale Lops, Marco Polignano
Holistic User Modeling for Personalized Services in Smart Cities . i-CITIES 2018. L’Aquila, 19-21 September 2018
6. Holistic User Model
Cataldo Musto, Giovanni Semeraro, Marco de Gemmis, Pasquale Lops, Marco Polignano
Holistic User Modeling for Personalized Services in Smart Cities . i-CITIES 2018. L’Aquila, 19-21 September 2018
7. Holistic User Model
Affects
Demographics
Interests
Behaviors
Social Relations
Knowledge and
Skills
Physical States
Cognitive Aspects
Inspiredy by
Cena, F., Likavec, S., and Rapp, A. Real world user model: Evolution of user modeling triggered
by advances in wearable and ubiquitous computing. Information Systems Frontiers, 2018
Cataldo Musto, Giovanni Semeraro, Marco de Gemmis, Pasquale Lops, Marco Polignano
Holistic User Modeling for Personalized Services in Smart Cities . i-CITIES 2018. L’Aquila, 19-21 September 2018
8. Holistic User Model
Name Description
Demographics Models demographic data (age, weight, name, etc.)
Interests Models interests and preferences
Affects Models mood and emotions of the user
Cognitive Aspects Models cognitive traits (personality, emphaty, etc.)
Behaviors Models the activities of the user
Social Relations Models the connections and the relations
Physical States Models physical data (sleep, food, heart rate, etc.)
Knowledge and Skills Models knowledge and skills of the user
Cataldo Musto, Giovanni Semeraro, Marco de Gemmis, Pasquale Lops, Marco Polignano
Holistic User Modeling for Personalized Services in Smart Cities . i-CITIES 2018. L’Aquila, 19-21 September 2018
9. How can we build a Holistic User Model?
Cataldo Musto, Giovanni Semeraro, Marco de Gemmis, Pasquale Lops, Marco Polignano
Holistic User Modeling for Personalized Services in Smart Cities . i-CITIES 2018. L’Aquila, 19-21 September 2018
10. Holistic User Modeling Workflow
Cataldo Musto, Giovanni Semeraro, Marco de Gemmis, Pasquale Lops, Marco Polignano
Holistic User Modeling for Personalized Services in Smart Cities . i-CITIES 2018. L’Aquila, 19-21 September 2018
11. Holistic User Modeling Workflow
Cataldo Musto, Giovanni Semeraro, Marco de Gemmis, Pasquale Lops, Marco Polignano
Holistic User Modeling for Personalized Services in Smart Cities . i-CITIES 2018. L’Aquila, 19-21 September 2018
12. Data Acquisition - Sources
Twitter
Facebook LinkedIn
Android
FitBit
Instagram
Cataldo Musto, Giovanni Semeraro, Marco de Gemmis, Pasquale Lops, Marco Polignano
Holistic User Modeling for Personalized Services in Smart Cities . i-CITIES 2018. L’Aquila, 19-21 September 2018
13. Data Acquisition
Twitter
Dato Descrizione
Profile Demographic information extracted from the profile (name,
location, website, #followers, #following, etc.)
Post Textual content of each post, date, language, #likes e retweet,
latitude and longitude (if any)
Connections Username, kind of relations (following/follower)
Cataldo Musto, Giovanni Semeraro, Marco de Gemmis, Pasquale Lops, Marco Polignano
Holistic User Modeling for Personalized Services in Smart Cities . i-CITIES 2018. L’Aquila, 19-21 September 2018
14. Data Acquisition
Facebook
Dato Descrizione
Profile Demographic information extracted from the profile (name,
surname, profile pic, sex, age, location)
Post Textual content of the post, date, language, story (if any)
Friends Username
Likes Name of the page, Category of the page, Description of the page
Cataldo Musto, Giovanni Semeraro, Marco de Gemmis, Pasquale Lops, Marco Polignano
Holistic User Modeling for Personalized Services in Smart Cities . i-CITIES 2018. L’Aquila, 19-21 September 2018
15. Data Acquisition
Instagram
Dato Descrizione
Profile Demographic information extracted from the profile (name,
surname, profile pic)
Post Textual content of the post, hashtag , location (if any)
Friends Following/followers
Cataldo Musto, Giovanni Semeraro, Marco de Gemmis, Pasquale Lops, Marco Polignano
Holistic User Modeling for Personalized Services in Smart Cities . i-CITIES 2018. L’Aquila, 19-21 September 2018
16. Data Acquisition
LinkedIn
Dato Descrizione
Profile Demographic information extracted from the profile (name,
surname, profile pic, language, work category)
Position Description and category of the current work
Cataldo Musto, Giovanni Semeraro, Marco de Gemmis, Pasquale Lops, Marco Polignano
Holistic User Modeling for Personalized Services in Smart Cities . i-CITIES 2018. L’Aquila, 19-21 September 2018
17. Data Acquisition
Android Devices
Dato Descrizione
GPS Data Latitude, Longitude, Accuracy, Timestamp
Contacts Name, Phone Number, Interactions
App Name of the app, category, daily usage
Display Display mode (on/off)
Usage Network used (Wi-Fi, 4G, etc.) and traffic
Device Brand and Model of the phone
Cataldo Musto, Giovanni Semeraro, Marco de Gemmis, Pasquale Lops, Marco Polignano
Holistic User Modeling for Personalized Services in Smart Cities . i-CITIES 2018. L’Aquila, 19-21 September 2018
18. Data Acquisition
FitBit
Dato Descrizione
Profile Demographic information extracted from the profile (name,
surname, profile pic, birth date, height, weight, sex)
Activities Kind of activities (running, walking) duration, calories, distance
Heart Rate Heart rate and timestamp
Sleep Date, sleep duration, sleep Quality
Food Food, calories, date, time
Cataldo Musto, Giovanni Semeraro, Marco de Gemmis, Pasquale Lops, Marco Polignano
Holistic User Modeling for Personalized Services in Smart Cities . i-CITIES 2018. L’Aquila, 19-21 September 2018
19. Holistic User Modeling Workflow
Cataldo Musto, Giovanni Semeraro, Marco de Gemmis, Pasquale Lops, Marco Polignano
Holistic User Modeling for Personalized Services in Smart Cities . i-CITIES 2018. L’Aquila, 19-21 September 2018
20. Data Processing and Enrichment
Data are processed through a Natural Language Processing and Machine Learning pipelines
Natural Language Processing
◦ Language Detection
◦ Stop-words Removal
◦ Lemmatization
◦ Entity Linking
◦ Wikipedia Categories Identification
Machine Learning (work-in-progress)
◦ Sentiment Analysis for Italian Tweets
◦ Emphathy and Personality Detection from Text
◦ Models for Activity Detection
◦ etc.
Cataldo Musto, Giovanni Semeraro, Marco de Gemmis, Pasquale Lops, Marco Polignano
Holistic User Modeling for Personalized Services in Smart Cities . i-CITIES 2018. L’Aquila, 19-21 September 2018
21. Holistic User Modeling Workflow
Cataldo Musto, Giovanni Semeraro, Marco de Gemmis, Pasquale Lops, Marco Polignano
Holistic User Modeling for Personalized Services in Smart Cities . i-CITIES 2018. L’Aquila, 19-21 September 2018
22. Holistic User Model
(recap)
Affects
Demographics
Interests
Behaviors
Social Relations
Knowledge and
Skills
Physical States
Cognitive Aspects
Cataldo Musto, Giovanni Semeraro, Marco de Gemmis, Pasquale Lops, Marco Polignano
Holistic User Modeling for Personalized Services in Smart Cities . i-CITIES 2018. L’Aquila, 19-21 September 2018
23. Holistic Profile Builder
12 demographics attributes are modeled
◦ Name, surname, profile pic, email, gender, location, height,
weight, working position, industry, language
Many attributes are general and available in many sources
◦ Name, surname, profilePic, etc.
Other attributes are source-specific
◦ e.g., height, weight from FitBit, working position from LinkedIn
Demographics
Cataldo Musto, Giovanni Semeraro, Marco de Gemmis, Pasquale Lops, Marco Polignano
Holistic User Modeling for Personalized Services in Smart Cities . i-CITIES 2018. L’Aquila, 19-21 September 2018
24. Holistic Profile Builder
Interests can be both explicitly and implicitly modeled
◦ Explicitly: interests are obtained from the categories of the Pages
liked by the user on Facebook (e.g., sports, politics, etc.) and from the
apps she used;
◦ Implicitly: interests are inferred by mining relevant entities
mentioned in posts (with a positive or neutral sentiment) written by
the user on Twitter and Facebook, from the hashtags used on
Instagram, etc.
In both cases, the Interest facet is populated with some keywords
and entities extracted from the posts and copied from the Pages
Interests
Cataldo Musto, Giovanni Semeraro, Marco de Gemmis, Pasquale Lops, Marco Polignano
Holistic User Modeling for Personalized Services in Smart Cities . i-CITIES 2018. L’Aquila, 19-21 September 2018
25. Holistic Profile Builder
User Mood and Emotions are encoded in the ‘Affects’ facet and
are Implicitly obtained by mining textual content
Affects
Cataldo Musto, Giovanni Semeraro, Marco de Gemmis, Pasquale Lops, Marco Polignano
Holistic User Modeling for Personalized Services in Smart Cities . i-CITIES 2018. L’Aquila, 19-21 September 2018
Cognitive Aspects
Personality traits are obtained by automatically inferring Big-5 traits
(extraversion, openness to experience, Conscientiousness, neuroticism,
agreeableness) from content written by the user
26. Holistic Profile Builder
User Activities and Visited Places are encoded in the
‘Cognitive Aspects’ facet
User Activities are obtained from FitBit and Android Phones
◦ Both of them exploit device sensors to implicitly infer users’ activities
(running, walking, etc.).
Visited Places are implicitly inferred from the geotag
available in Instagram pictures
Behaviors
Cataldo Musto, Giovanni Semeraro, Marco de Gemmis, Pasquale Lops, Marco Polignano
Holistic User Modeling for Personalized Services in Smart Cities . i-CITIES 2018. L’Aquila, 19-21 September 2018
27. Holistic Profile Builder
Social Relations are currently inferred by merging all the
contacts available in the sources connected to the
platforms
Social Relations
Cataldo Musto, Giovanni Semeraro, Marco de Gemmis, Pasquale Lops, Marco Polignano
Holistic User Modeling for Personalized Services in Smart Cities . i-CITIES 2018. L’Aquila, 19-21 September 2018
Physical States of the user are explicitly extracted from
FitBit data (food, hearth rate, sleep quality, etc.)
Physical States
28. Holistic User Modeling Workflow
Cataldo Musto, Giovanni Semeraro, Marco de Gemmis, Pasquale Lops, Marco Polignano
Holistic User Modeling for Personalized Services in Smart Cities . i-CITIES 2018. L’Aquila, 19-21 September 2018
29. Data Exposure
Holistic User Profiles are made available to developers
and third-party services via a high-level REST api
◦e.g., http://90.147.102.243/api/profile/cataldo
◦Only the facets the user explicitly labeled as ‘public’ are
exposed via the endpoint
◦Developers have to request an API key to access to the
user profiles
Cataldo Musto, Giovanni Semeraro, Marco de Gemmis, Pasquale Lops, Marco Polignano
Holistic User Modeling for Personalized Services in Smart Cities . i-CITIES 2018. L’Aquila, 19-21 September 2018
30. Holistic User Modeling Workflow
Cataldo Musto, Giovanni Semeraro, Marco de Gemmis, Pasquale Lops, Marco Polignano
Holistic User Modeling for Personalized Services in Smart Cities . i-CITIES 2018. L’Aquila, 19-21 September 2018
31. Data Visualization - Login
Cataldo Musto, Giovanni Semeraro, Marco de Gemmis, Pasquale Lops, Marco Polignano
Holistic User Modeling for Personalized Services in Smart Cities . i-CITIES 2018. L’Aquila, 19-21 September 2018
32. Data Visualization – Linking Identities
Cataldo Musto, Giovanni Semeraro, Marco de Gemmis, Pasquale Lops, Marco Polignano
Holistic User Modeling for Personalized Services in Smart Cities . i-CITIES 2018. L’Aquila, 19-21 September 2018
33. Data Visualization – Privacy Settings
Cataldo Musto, Giovanni Semeraro, Marco de Gemmis, Pasquale Lops, Marco Polignano
Holistic User Modeling for Personalized Services in Smart Cities . i-CITIES 2018. L’Aquila, 19-21 September 2018
34. Data Visualization – Controlling Data Exposure
Cataldo Musto, Giovanni Semeraro, Marco de Gemmis, Pasquale Lops, Marco Polignano
Holistic User Modeling for Personalized Services in Smart Cities . i-CITIES 2018. L’Aquila, 19-21 September 2018
35. Data Visualization – User Interests
Cataldo Musto, Giovanni Semeraro, Marco de Gemmis, Pasquale Lops, Marco Polignano
Holistic User Modeling for Personalized Services in Smart Cities . i-CITIES 2018. L’Aquila, 19-21 September 2018
36. Data Visualization – Emotion Monitoring
Cataldo Musto, Giovanni Semeraro, Marco de Gemmis, Pasquale Lops, Marco Polignano
Holistic User Modeling for Personalized Services in Smart Cities . i-CITIES 2018. L’Aquila, 19-21 September 2018
37. Data Visualization – Sleep Monitoring
Cataldo Musto, Giovanni Semeraro, Marco de Gemmis, Pasquale Lops, Marco Polignano
Holistic User Modeling for Personalized Services in Smart Cities . i-CITIES 2018. L’Aquila, 19-21 September 2018
38. Conclusions
Holistic User Profiling
◦ Conceptual model based on eight different facets
◦ Built by merging the digital footprints gathered from several
heterogeneous sources
◦ Overcomes data silos problem!
Myrror
◦ Platform supporting the creation of holistic user profiles
◦ Users have full control over the data extracted and exposed
◦ Profiles are made available through a REST Api to third-party
services and developers
Cataldo Musto, Giovanni Semeraro, Marco de Gemmis, Pasquale Lops, Marco Polignano
Holistic User Modeling for Personalized Services in Smart Cities . i-CITIES 2018. L’Aquila, 19-21 September 2018
39. Future Work
Data Sources
◦Introduction of more sources for modeling user profiles
Data Processing and Enrichment
◦Room for improvement: many algorithms can be
integrated to implicitly infer users’ data from rough data
Experimental Evaluation
◦ Definition of an experimental scenario to assess about the
effectiveness of holistic user profiles.
Cataldo Musto, Giovanni Semeraro, Marco de Gemmis, Pasquale Lops, Marco Polignano
Holistic User Modeling for Personalized Services in Smart Cities . i-CITIES 2018. L’Aquila, 19-21 September 2018
40. Thank you!
cataldo.musto@uniba.it
@cataldomusto
Want to try Myrror?
Contacts
Contact us! Working Online Demo
Cataldo Musto, Giovanni Semeraro, Marco de Gemmis, Pasquale Lops, Marco Polignano
Holistic User Modeling for Personalized Services in Smart Cities . i-CITIES 2018. L’Aquila, 19-21 September 2018