SlideShare a Scribd company logo
1 of 62
Enabling Opinion-Driven
Decision Making
Kavita Ganesan
Senior Data Scientist, GitHub Inc.
@kav_gan
#Activate18 #ActivateSearch
Agenda
• Problem Intro
• Demo of FindiLike – System leveraging user reviews
• FindiLike - Search component
• FindiLike - Summarization component
What people think?
INFLUENCES DECISION MAKING
What companies to work for?
Which cool places to visit?
What data science tools to use?
Before Web became popular
– life was simple
Friends and relatives Consumer Reports
Crazy WWW
What people think?
- e-commerce sites
- online directories
- blog articles
- review sites
- social networking sites
…more
TOO MUCH INFORMATION
TOO FEW TOOLS FOR DECISION MAKING
Looking for a hotel in an
unknown city
Looking for a hotel in an unknown city
1 Safe ! - No bullets
Looking for a hotel in an unknown city
1 Safe ! - No bullets
2 Spacious room - Claustrophobic
Looking for a hotel in an unknown city
1 Safe ! - No bullets
2 Spacious room - Claustrophobic
3 Tempurpedic beds
Can we currently find hotels matching
these criteria?
1 Safe ! - No bullets
2 Spacious room - Claustrophobic
3 Tempurpedic beds
Maybe by reading 2000 reviews?
Information is there – somewhere
Read reviews & perform own data mining
FindiLike – Preference Based Hotel Search
• Research prototype
• Showcase algorithms
leveraging user reviews
Different tools to help
with decision making
based on opinions
Can we use this in other
domains?
Product search
T-shirt:
"baggy"
"v-neck"
"doesn't shrink"
Healthcare provider search
Family Doctor:
"speaks fluent spanish"
"good with kids"
"calming clinic"
How to implement such
a system?
1. Preference Based Search
How to recommend relevant
entities using user reviews
and a users’ unstructured
preference?
2. Query Understanding
"good for kids" == "child friendly" ?
"baggy" == "oversized" ?
3. Summarization
How do you provide concise
views of user reviews?
4. Combine structured + unstructured info
How do you combine
structured + unstructured
info to provide a powerful
search experience?
Let's zoom into two components
Preference Based
Search
Summarization
Query
Understanding
Structured +
Unstrcutred Search
Traditional Search
Query (short)
Document
<content>
Document
<content>
Document
<content>
Click to add text
Query (short)
Document
<content>
Document
<content>
Document
<content>
Traditional Search
Click to add text
Query (Preferences)
Entity
<content>
Entity
<content>
Entity
<content>
Preference Based Search
Each entity represented by entity
document
Hotel Los Angeles
(Entity)
Vagabond Inn
(Entity)
Holiday Inn Los
Angeles
(Entity)
Entity Document (content)
review1: this hotel was absolutely...
review2: nice pet friendly hotel...
Entity Document (content)
review1: extremely old and dirty...
review2: nice little place although...
Entity Document (content)
review1: the continental breakfast was...
review2: I will never stay at this place..
Use regular search technologies to index
Entity Document
review1: this hotel was absolutely...
review2: nice pet friendly hotel...
Entity Document
review1: extremely old and dirty...
review2: nice little place although...
Entity Document
review1: the continental breakfast was...
review2: I will never stay at this place..
Hotel Los Angeles
(Entity)
Vagabond Inn
(Entity)
Holiday Inn Los
Angeles
(Entity)
more keyword
matches = better
entity ranks
Entity Document
Review 1: I loved that this hotel was pet friendly...
Review 2: nice pet friendly hotel...
Review 3: pets are welcome at this hotel...
Review 4: I brought my puppy along since this was...
Pet friendlyPreference / query:
Hotel Los Angeles
#1: Uneven Entity Document Length
extremel
Entity Document
(Hotel A)
Review 1: This hotel was absolutely...
Review 2: Nice pet friendly hotel...
Review 3: Beautiful hotel with friendly...
Review 4: My pets were really happy...
Review 5: Our stay was fantastic. We...
......................................
......................................
......................................
......................................
......................................
......................................
Review 1000: Unfortunately, we had a bad...
Entity Document
(Hotel B)
Review 1: We had muffis for bfast...
Review 2: Dull hotel with very little...
......................................
......................................
......................................
Review 10: Unfortunately, we had a bad...
more matches ==> relevance goes up ↑
#1: Uneven Entity Document Length
Solution: similarity models
that have saturation points
#2: Matching similar concepts
#2: Matching similar concepts
extremel
pet friendly
Entity Document
Review 1: I loved that this hotel was pet friendly...
Review 2: nice dog friendly hotel...
Review 3: pets are welcome at this hotel...
Review 4: Brought my kitty along since this is an animal friendly facility...
Preference / query:
#2: Matching similar concepts
extremel
pet friendly
Entity Document
Review 1: I loved that this hotel was pet friendly...
Review 2: nice dog friendly hotel...
Review 3: pets are welcome at this hotel...
Review 4: Brought my kitty along since this is an animal friendly facility...
Preference / query:
Expand query with related concepts
#3: Dealing with negations
#3: Dealing with negations
extremel
pet friendly
This hotel was NOT pet friendly so I could not bring my dog
Preference / query:
#3: Dealing with negations
extremel
pet friendly
This hotel was NOT pet friendly so I could not bring my dog
Preference / query:
Nearby negations should be considered
Opinion-Based Entity Ranking – Ganesan & Zhai 2012
http://kavita-ganesan.com/opinion-based-entity-ranking/
Let's zoom into summarization of
opinions
Preference Based
Search
Summarization
Query
Understanding
Structured +
Unstrcutred Search
What can review summaries
provide that search cannot?
Unexpected Information
That can make or break the deal
Deal
breaker!
Lots of summarization options
Concise or aggregated view of what people are saying
Cleanliness
Comfort
Staff
Views
4.0/5
2.0/5
3.0/5
4.5/5
Natural Language Opinion Summary
• Aggregation of
what people think
• Concise, conveys
essential info
• Analytics
Opinosis: Graph Based Sentence
Compression Approach
(Ganesan & Zhai Coling 2010)
Sentence Compression Approach
“The bed was comfortable, I loved it!”
“The bed was really comfortable..”
“The tempurpedic bed was super comfy”
Sentence Compression Approach
“The bed was comfortable, I loved it!”
“The bed was really comfortable..”
“The tempurpedic bed was super comfy”
bed was comfortable (3)
Opinosis: Uses a Word Graph
“The bed was comfortable, I loved it!”
“The bed was really comfortable..”
“The tempurpedic bed was super comfy”
bed I
really
comfortable
.
tempurpedic
the ,
loved itwas
super
.
WORD GRAPH
What's nice about this technique?
1. Really speedy for ad hoc summarization
• No need to pre-compute
• Generate summaries for specific topics
What's nice about this technique?
1. Really speedy for ad hoc summarization
2. Captures redundancies naturally
• Automatically provides the analytics component
What's nice about this technique?
1. Really speedy for ad hoc summarization
2. Captures redundancies naturally
3. Extract phrases from existing sentence structure
• Limiting external dependencies
Try out Web API or JAR File
www. kavita-ganesan.com/opinosis/
In summary…
Leverage text data to empower
consumers…
Help users make faster decisions...
Increase conversion rates & loyalty
Thank you!
Kavita Ganesan
@kav_gan
kavita-ganesan.com
#Activate18 #ActivateSearch

More Related Content

Similar to Enabling Opinion Driven Decision Making - Kavita Ganesan, GitHub

The Architecture of Social Websites: Reputation
The Architecture of Social Websites: ReputationThe Architecture of Social Websites: Reputation
The Architecture of Social Websites: ReputationBryce Glass
 
Critical Thinking for Software Testers
Critical Thinking for Software TestersCritical Thinking for Software Testers
Critical Thinking for Software TestersTechWell
 
How to get personal with your customers and have them love it
How to get personal with your customers and have them love itHow to get personal with your customers and have them love it
How to get personal with your customers and have them love itEvan LaPointe
 
Balancing the Dimensions of User Intent
Balancing the Dimensions of User IntentBalancing the Dimensions of User Intent
Balancing the Dimensions of User IntentTrey Grainger
 
Magic If Play Analysis
Magic If Play AnalysisMagic If Play Analysis
Magic If Play AnalysisKendra Cote
 
The filter bubble
The filter bubbleThe filter bubble
The filter bubblefleong
 
A Multifaceted Look At Faceting - Ted Sullivan, Lucidworks
A Multifaceted Look At Faceting - Ted Sullivan, LucidworksA Multifaceted Look At Faceting - Ted Sullivan, Lucidworks
A Multifaceted Look At Faceting - Ted Sullivan, LucidworksLucidworks
 
SearchLove San Diego 2017 | Joel Klettke | Don't Buy Your Customer a Beer: Ho...
SearchLove San Diego 2017 | Joel Klettke | Don't Buy Your Customer a Beer: Ho...SearchLove San Diego 2017 | Joel Klettke | Don't Buy Your Customer a Beer: Ho...
SearchLove San Diego 2017 | Joel Klettke | Don't Buy Your Customer a Beer: Ho...Distilled
 
Frakture 4 fold webinar presentation 2015-04_23
Frakture 4 fold webinar presentation 2015-04_23Frakture 4 fold webinar presentation 2015-04_23
Frakture 4 fold webinar presentation 2015-04_23Chris Lundberg
 
Intro to Vita Beans
Intro to Vita BeansIntro to Vita Beans
Intro to Vita Beansamruth
 
Andy Crestodina — How to Find Blog Topics Your Audience REALLY Cares About
Andy Crestodina — How to Find Blog Topics Your Audience REALLY Cares AboutAndy Crestodina — How to Find Blog Topics Your Audience REALLY Cares About
Andy Crestodina — How to Find Blog Topics Your Audience REALLY Cares AboutSemrush
 
Acceptance, accessible, actionable and auditable
Acceptance, accessible, actionable and auditableAcceptance, accessible, actionable and auditable
Acceptance, accessible, actionable and auditableAlban Gérôme
 
Human-centered data: using data science and human-centered design to grow you...
Human-centered data: using data science and human-centered design to grow you...Human-centered data: using data science and human-centered design to grow you...
Human-centered data: using data science and human-centered design to grow you...Cprime
 
Bearish SEO: Defining the User Experience for Google’s Panda Search Landscape
Bearish SEO: Defining the User Experience for Google’s Panda Search LandscapeBearish SEO: Defining the User Experience for Google’s Panda Search Landscape
Bearish SEO: Defining the User Experience for Google’s Panda Search LandscapeMarianne Sweeny
 
How to Build a Recommendation Engine on Spark
How to Build a Recommendation Engine on SparkHow to Build a Recommendation Engine on Spark
How to Build a Recommendation Engine on SparkCaserta
 
The Art of Smart Data
The Art of Smart DataThe Art of Smart Data
The Art of Smart DataInsideView
 
Is Your Website Trauma-Informed?
Is Your Website Trauma-Informed?Is Your Website Trauma-Informed?
Is Your Website Trauma-Informed?Melissa Eggleston
 
SEO in 2017, Lee Kennedy 2017 CO2 Presentation
SEO in 2017, Lee Kennedy 2017 CO2 PresentationSEO in 2017, Lee Kennedy 2017 CO2 Presentation
SEO in 2017, Lee Kennedy 2017 CO2 PresentationCoalmarch
 

Similar to Enabling Opinion Driven Decision Making - Kavita Ganesan, GitHub (20)

The Architecture of Social Websites: Reputation
The Architecture of Social Websites: ReputationThe Architecture of Social Websites: Reputation
The Architecture of Social Websites: Reputation
 
Critical Thinking for Software Testers
Critical Thinking for Software TestersCritical Thinking for Software Testers
Critical Thinking for Software Testers
 
How to get personal with your customers and have them love it
How to get personal with your customers and have them love itHow to get personal with your customers and have them love it
How to get personal with your customers and have them love it
 
Balancing the Dimensions of User Intent
Balancing the Dimensions of User IntentBalancing the Dimensions of User Intent
Balancing the Dimensions of User Intent
 
Magic If Play Analysis
Magic If Play AnalysisMagic If Play Analysis
Magic If Play Analysis
 
The filter bubble
The filter bubbleThe filter bubble
The filter bubble
 
Context, Narratives & Big Data Analytics
Context, Narratives & Big Data AnalyticsContext, Narratives & Big Data Analytics
Context, Narratives & Big Data Analytics
 
A Multifaceted Look At Faceting - Ted Sullivan, Lucidworks
A Multifaceted Look At Faceting - Ted Sullivan, LucidworksA Multifaceted Look At Faceting - Ted Sullivan, Lucidworks
A Multifaceted Look At Faceting - Ted Sullivan, Lucidworks
 
SearchLove San Diego 2017 | Joel Klettke | Don't Buy Your Customer a Beer: Ho...
SearchLove San Diego 2017 | Joel Klettke | Don't Buy Your Customer a Beer: Ho...SearchLove San Diego 2017 | Joel Klettke | Don't Buy Your Customer a Beer: Ho...
SearchLove San Diego 2017 | Joel Klettke | Don't Buy Your Customer a Beer: Ho...
 
Frakture 4 fold webinar presentation 2015-04_23
Frakture 4 fold webinar presentation 2015-04_23Frakture 4 fold webinar presentation 2015-04_23
Frakture 4 fold webinar presentation 2015-04_23
 
Intro to Vita Beans
Intro to Vita BeansIntro to Vita Beans
Intro to Vita Beans
 
Andy Crestodina — How to Find Blog Topics Your Audience REALLY Cares About
Andy Crestodina — How to Find Blog Topics Your Audience REALLY Cares AboutAndy Crestodina — How to Find Blog Topics Your Audience REALLY Cares About
Andy Crestodina — How to Find Blog Topics Your Audience REALLY Cares About
 
Acceptance, accessible, actionable and auditable
Acceptance, accessible, actionable and auditableAcceptance, accessible, actionable and auditable
Acceptance, accessible, actionable and auditable
 
Everything You Wish You Knew About Search
Everything You Wish You Knew About SearchEverything You Wish You Knew About Search
Everything You Wish You Knew About Search
 
Human-centered data: using data science and human-centered design to grow you...
Human-centered data: using data science and human-centered design to grow you...Human-centered data: using data science and human-centered design to grow you...
Human-centered data: using data science and human-centered design to grow you...
 
Bearish SEO: Defining the User Experience for Google’s Panda Search Landscape
Bearish SEO: Defining the User Experience for Google’s Panda Search LandscapeBearish SEO: Defining the User Experience for Google’s Panda Search Landscape
Bearish SEO: Defining the User Experience for Google’s Panda Search Landscape
 
How to Build a Recommendation Engine on Spark
How to Build a Recommendation Engine on SparkHow to Build a Recommendation Engine on Spark
How to Build a Recommendation Engine on Spark
 
The Art of Smart Data
The Art of Smart DataThe Art of Smart Data
The Art of Smart Data
 
Is Your Website Trauma-Informed?
Is Your Website Trauma-Informed?Is Your Website Trauma-Informed?
Is Your Website Trauma-Informed?
 
SEO in 2017, Lee Kennedy 2017 CO2 Presentation
SEO in 2017, Lee Kennedy 2017 CO2 PresentationSEO in 2017, Lee Kennedy 2017 CO2 Presentation
SEO in 2017, Lee Kennedy 2017 CO2 Presentation
 

More from Lucidworks

Search is the Tip of the Spear for Your B2B eCommerce Strategy
Search is the Tip of the Spear for Your B2B eCommerce StrategySearch is the Tip of the Spear for Your B2B eCommerce Strategy
Search is the Tip of the Spear for Your B2B eCommerce StrategyLucidworks
 
Drive Agent Effectiveness in Salesforce
Drive Agent Effectiveness in SalesforceDrive Agent Effectiveness in Salesforce
Drive Agent Effectiveness in SalesforceLucidworks
 
How Crate & Barrel Connects Shoppers with Relevant Products
How Crate & Barrel Connects Shoppers with Relevant ProductsHow Crate & Barrel Connects Shoppers with Relevant Products
How Crate & Barrel Connects Shoppers with Relevant ProductsLucidworks
 
Lucidworks & IMRG Webinar – Best-In-Class Retail Product Discovery
Lucidworks & IMRG Webinar – Best-In-Class Retail Product DiscoveryLucidworks & IMRG Webinar – Best-In-Class Retail Product Discovery
Lucidworks & IMRG Webinar – Best-In-Class Retail Product DiscoveryLucidworks
 
Connected Experiences Are Personalized Experiences
Connected Experiences Are Personalized ExperiencesConnected Experiences Are Personalized Experiences
Connected Experiences Are Personalized ExperiencesLucidworks
 
Intelligent Insight Driven Policing with MC+A, Toronto Police Service and Luc...
Intelligent Insight Driven Policing with MC+A, Toronto Police Service and Luc...Intelligent Insight Driven Policing with MC+A, Toronto Police Service and Luc...
Intelligent Insight Driven Policing with MC+A, Toronto Police Service and Luc...Lucidworks
 
[Webinar] Intelligent Policing. Leveraging Data to more effectively Serve Com...
[Webinar] Intelligent Policing. Leveraging Data to more effectively Serve Com...[Webinar] Intelligent Policing. Leveraging Data to more effectively Serve Com...
[Webinar] Intelligent Policing. Leveraging Data to more effectively Serve Com...Lucidworks
 
Preparing for Peak in Ecommerce | eTail Asia 2020
Preparing for Peak in Ecommerce | eTail Asia 2020Preparing for Peak in Ecommerce | eTail Asia 2020
Preparing for Peak in Ecommerce | eTail Asia 2020Lucidworks
 
Accelerate The Path To Purchase With Product Discovery at Retail Innovation C...
Accelerate The Path To Purchase With Product Discovery at Retail Innovation C...Accelerate The Path To Purchase With Product Discovery at Retail Innovation C...
Accelerate The Path To Purchase With Product Discovery at Retail Innovation C...Lucidworks
 
AI-Powered Linguistics and Search with Fusion and Rosette
AI-Powered Linguistics and Search with Fusion and RosetteAI-Powered Linguistics and Search with Fusion and Rosette
AI-Powered Linguistics and Search with Fusion and RosetteLucidworks
 
The Service Industry After COVID-19: The Soul of Service in a Virtual Moment
The Service Industry After COVID-19: The Soul of Service in a Virtual MomentThe Service Industry After COVID-19: The Soul of Service in a Virtual Moment
The Service Industry After COVID-19: The Soul of Service in a Virtual MomentLucidworks
 
Webinar: Smart answers for employee and customer support after covid 19 - Europe
Webinar: Smart answers for employee and customer support after covid 19 - EuropeWebinar: Smart answers for employee and customer support after covid 19 - Europe
Webinar: Smart answers for employee and customer support after covid 19 - EuropeLucidworks
 
Smart Answers for Employee and Customer Support After COVID-19
Smart Answers for Employee and Customer Support After COVID-19Smart Answers for Employee and Customer Support After COVID-19
Smart Answers for Employee and Customer Support After COVID-19Lucidworks
 
Applying AI & Search in Europe - featuring 451 Research
Applying AI & Search in Europe - featuring 451 ResearchApplying AI & Search in Europe - featuring 451 Research
Applying AI & Search in Europe - featuring 451 ResearchLucidworks
 
Webinar: Accelerate Data Science with Fusion 5.1
Webinar: Accelerate Data Science with Fusion 5.1Webinar: Accelerate Data Science with Fusion 5.1
Webinar: Accelerate Data Science with Fusion 5.1Lucidworks
 
Webinar: 5 Must-Have Items You Need for Your 2020 Ecommerce Strategy
Webinar: 5 Must-Have Items You Need for Your 2020 Ecommerce StrategyWebinar: 5 Must-Have Items You Need for Your 2020 Ecommerce Strategy
Webinar: 5 Must-Have Items You Need for Your 2020 Ecommerce StrategyLucidworks
 
Where Search Meets Science and Style Meets Savings: Nordstrom Rack's Journey ...
Where Search Meets Science and Style Meets Savings: Nordstrom Rack's Journey ...Where Search Meets Science and Style Meets Savings: Nordstrom Rack's Journey ...
Where Search Meets Science and Style Meets Savings: Nordstrom Rack's Journey ...Lucidworks
 
Apply Knowledge Graphs and Search for Real-World Decision Intelligence
Apply Knowledge Graphs and Search for Real-World Decision IntelligenceApply Knowledge Graphs and Search for Real-World Decision Intelligence
Apply Knowledge Graphs and Search for Real-World Decision IntelligenceLucidworks
 
Webinar: Building a Business Case for Enterprise Search
Webinar: Building a Business Case for Enterprise SearchWebinar: Building a Business Case for Enterprise Search
Webinar: Building a Business Case for Enterprise SearchLucidworks
 
Why Insight Engines Matter in 2020 and Beyond
Why Insight Engines Matter in 2020 and BeyondWhy Insight Engines Matter in 2020 and Beyond
Why Insight Engines Matter in 2020 and BeyondLucidworks
 

More from Lucidworks (20)

Search is the Tip of the Spear for Your B2B eCommerce Strategy
Search is the Tip of the Spear for Your B2B eCommerce StrategySearch is the Tip of the Spear for Your B2B eCommerce Strategy
Search is the Tip of the Spear for Your B2B eCommerce Strategy
 
Drive Agent Effectiveness in Salesforce
Drive Agent Effectiveness in SalesforceDrive Agent Effectiveness in Salesforce
Drive Agent Effectiveness in Salesforce
 
How Crate & Barrel Connects Shoppers with Relevant Products
How Crate & Barrel Connects Shoppers with Relevant ProductsHow Crate & Barrel Connects Shoppers with Relevant Products
How Crate & Barrel Connects Shoppers with Relevant Products
 
Lucidworks & IMRG Webinar – Best-In-Class Retail Product Discovery
Lucidworks & IMRG Webinar – Best-In-Class Retail Product DiscoveryLucidworks & IMRG Webinar – Best-In-Class Retail Product Discovery
Lucidworks & IMRG Webinar – Best-In-Class Retail Product Discovery
 
Connected Experiences Are Personalized Experiences
Connected Experiences Are Personalized ExperiencesConnected Experiences Are Personalized Experiences
Connected Experiences Are Personalized Experiences
 
Intelligent Insight Driven Policing with MC+A, Toronto Police Service and Luc...
Intelligent Insight Driven Policing with MC+A, Toronto Police Service and Luc...Intelligent Insight Driven Policing with MC+A, Toronto Police Service and Luc...
Intelligent Insight Driven Policing with MC+A, Toronto Police Service and Luc...
 
[Webinar] Intelligent Policing. Leveraging Data to more effectively Serve Com...
[Webinar] Intelligent Policing. Leveraging Data to more effectively Serve Com...[Webinar] Intelligent Policing. Leveraging Data to more effectively Serve Com...
[Webinar] Intelligent Policing. Leveraging Data to more effectively Serve Com...
 
Preparing for Peak in Ecommerce | eTail Asia 2020
Preparing for Peak in Ecommerce | eTail Asia 2020Preparing for Peak in Ecommerce | eTail Asia 2020
Preparing for Peak in Ecommerce | eTail Asia 2020
 
Accelerate The Path To Purchase With Product Discovery at Retail Innovation C...
Accelerate The Path To Purchase With Product Discovery at Retail Innovation C...Accelerate The Path To Purchase With Product Discovery at Retail Innovation C...
Accelerate The Path To Purchase With Product Discovery at Retail Innovation C...
 
AI-Powered Linguistics and Search with Fusion and Rosette
AI-Powered Linguistics and Search with Fusion and RosetteAI-Powered Linguistics and Search with Fusion and Rosette
AI-Powered Linguistics and Search with Fusion and Rosette
 
The Service Industry After COVID-19: The Soul of Service in a Virtual Moment
The Service Industry After COVID-19: The Soul of Service in a Virtual MomentThe Service Industry After COVID-19: The Soul of Service in a Virtual Moment
The Service Industry After COVID-19: The Soul of Service in a Virtual Moment
 
Webinar: Smart answers for employee and customer support after covid 19 - Europe
Webinar: Smart answers for employee and customer support after covid 19 - EuropeWebinar: Smart answers for employee and customer support after covid 19 - Europe
Webinar: Smart answers for employee and customer support after covid 19 - Europe
 
Smart Answers for Employee and Customer Support After COVID-19
Smart Answers for Employee and Customer Support After COVID-19Smart Answers for Employee and Customer Support After COVID-19
Smart Answers for Employee and Customer Support After COVID-19
 
Applying AI & Search in Europe - featuring 451 Research
Applying AI & Search in Europe - featuring 451 ResearchApplying AI & Search in Europe - featuring 451 Research
Applying AI & Search in Europe - featuring 451 Research
 
Webinar: Accelerate Data Science with Fusion 5.1
Webinar: Accelerate Data Science with Fusion 5.1Webinar: Accelerate Data Science with Fusion 5.1
Webinar: Accelerate Data Science with Fusion 5.1
 
Webinar: 5 Must-Have Items You Need for Your 2020 Ecommerce Strategy
Webinar: 5 Must-Have Items You Need for Your 2020 Ecommerce StrategyWebinar: 5 Must-Have Items You Need for Your 2020 Ecommerce Strategy
Webinar: 5 Must-Have Items You Need for Your 2020 Ecommerce Strategy
 
Where Search Meets Science and Style Meets Savings: Nordstrom Rack's Journey ...
Where Search Meets Science and Style Meets Savings: Nordstrom Rack's Journey ...Where Search Meets Science and Style Meets Savings: Nordstrom Rack's Journey ...
Where Search Meets Science and Style Meets Savings: Nordstrom Rack's Journey ...
 
Apply Knowledge Graphs and Search for Real-World Decision Intelligence
Apply Knowledge Graphs and Search for Real-World Decision IntelligenceApply Knowledge Graphs and Search for Real-World Decision Intelligence
Apply Knowledge Graphs and Search for Real-World Decision Intelligence
 
Webinar: Building a Business Case for Enterprise Search
Webinar: Building a Business Case for Enterprise SearchWebinar: Building a Business Case for Enterprise Search
Webinar: Building a Business Case for Enterprise Search
 
Why Insight Engines Matter in 2020 and Beyond
Why Insight Engines Matter in 2020 and BeyondWhy Insight Engines Matter in 2020 and Beyond
Why Insight Engines Matter in 2020 and Beyond
 

Recently uploaded

EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptxEIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptxEarley Information Science
 
08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking Men08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking MenDelhi Call girls
 
Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024The Digital Insurer
 
Boost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdfBoost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdfsudhanshuwaghmare1
 
Handwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed textsHandwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed textsMaria Levchenko
 
Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...
Workshop - Best of Both Worlds_ Combine  KG and Vector search for  enhanced R...Workshop - Best of Both Worlds_ Combine  KG and Vector search for  enhanced R...
Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...Neo4j
 
Scaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationScaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationRadu Cotescu
 
08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking Men08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking MenDelhi Call girls
 
How to convert PDF to text with Nanonets
How to convert PDF to text with NanonetsHow to convert PDF to text with Nanonets
How to convert PDF to text with Nanonetsnaman860154
 
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...apidays
 
Artificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and MythsArtificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and MythsJoaquim Jorge
 
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...Igalia
 
Understanding Discord NSFW Servers A Guide for Responsible Users.pdf
Understanding Discord NSFW Servers A Guide for Responsible Users.pdfUnderstanding Discord NSFW Servers A Guide for Responsible Users.pdf
Understanding Discord NSFW Servers A Guide for Responsible Users.pdfUK Journal
 
[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdf[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdfhans926745
 
Data Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt RobisonData Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt RobisonAnna Loughnan Colquhoun
 
CNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of ServiceCNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of Servicegiselly40
 
Tata AIG General Insurance Company - Insurer Innovation Award 2024
Tata AIG General Insurance Company - Insurer Innovation Award 2024Tata AIG General Insurance Company - Insurer Innovation Award 2024
Tata AIG General Insurance Company - Insurer Innovation Award 2024The Digital Insurer
 
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptxHampshireHUG
 
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationFrom Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationSafe Software
 
GenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day PresentationGenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day PresentationMichael W. Hawkins
 

Recently uploaded (20)

EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptxEIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
 
08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking Men08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking Men
 
Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024
 
Boost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdfBoost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdf
 
Handwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed textsHandwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed texts
 
Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...
Workshop - Best of Both Worlds_ Combine  KG and Vector search for  enhanced R...Workshop - Best of Both Worlds_ Combine  KG and Vector search for  enhanced R...
Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...
 
Scaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationScaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organization
 
08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking Men08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking Men
 
How to convert PDF to text with Nanonets
How to convert PDF to text with NanonetsHow to convert PDF to text with Nanonets
How to convert PDF to text with Nanonets
 
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
 
Artificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and MythsArtificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and Myths
 
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
 
Understanding Discord NSFW Servers A Guide for Responsible Users.pdf
Understanding Discord NSFW Servers A Guide for Responsible Users.pdfUnderstanding Discord NSFW Servers A Guide for Responsible Users.pdf
Understanding Discord NSFW Servers A Guide for Responsible Users.pdf
 
[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdf[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdf
 
Data Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt RobisonData Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt Robison
 
CNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of ServiceCNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of Service
 
Tata AIG General Insurance Company - Insurer Innovation Award 2024
Tata AIG General Insurance Company - Insurer Innovation Award 2024Tata AIG General Insurance Company - Insurer Innovation Award 2024
Tata AIG General Insurance Company - Insurer Innovation Award 2024
 
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
 
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationFrom Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
 
GenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day PresentationGenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day Presentation
 

Enabling Opinion Driven Decision Making - Kavita Ganesan, GitHub

  • 1. Enabling Opinion-Driven Decision Making Kavita Ganesan Senior Data Scientist, GitHub Inc. @kav_gan #Activate18 #ActivateSearch
  • 2. Agenda • Problem Intro • Demo of FindiLike – System leveraging user reviews • FindiLike - Search component • FindiLike - Summarization component
  • 4. What companies to work for?
  • 5. Which cool places to visit?
  • 6. What data science tools to use?
  • 7. Before Web became popular – life was simple Friends and relatives Consumer Reports
  • 8. Crazy WWW What people think? - e-commerce sites - online directories - blog articles - review sites - social networking sites …more
  • 9. TOO MUCH INFORMATION TOO FEW TOOLS FOR DECISION MAKING
  • 10. Looking for a hotel in an unknown city
  • 11. Looking for a hotel in an unknown city 1 Safe ! - No bullets
  • 12. Looking for a hotel in an unknown city 1 Safe ! - No bullets 2 Spacious room - Claustrophobic
  • 13. Looking for a hotel in an unknown city 1 Safe ! - No bullets 2 Spacious room - Claustrophobic 3 Tempurpedic beds
  • 14. Can we currently find hotels matching these criteria? 1 Safe ! - No bullets 2 Spacious room - Claustrophobic 3 Tempurpedic beds
  • 15. Maybe by reading 2000 reviews?
  • 16. Information is there – somewhere Read reviews & perform own data mining
  • 17. FindiLike – Preference Based Hotel Search • Research prototype • Showcase algorithms leveraging user reviews
  • 18. Different tools to help with decision making based on opinions
  • 19. Can we use this in other domains?
  • 21. Healthcare provider search Family Doctor: "speaks fluent spanish" "good with kids" "calming clinic"
  • 22. How to implement such a system?
  • 23. 1. Preference Based Search How to recommend relevant entities using user reviews and a users’ unstructured preference?
  • 24. 2. Query Understanding "good for kids" == "child friendly" ? "baggy" == "oversized" ?
  • 25. 3. Summarization How do you provide concise views of user reviews?
  • 26. 4. Combine structured + unstructured info How do you combine structured + unstructured info to provide a powerful search experience?
  • 27. Let's zoom into two components Preference Based Search Summarization Query Understanding Structured + Unstrcutred Search
  • 29. Click to add text Query (short) Document <content> Document <content> Document <content> Traditional Search Click to add text Query (Preferences) Entity <content> Entity <content> Entity <content> Preference Based Search
  • 30. Each entity represented by entity document Hotel Los Angeles (Entity) Vagabond Inn (Entity) Holiday Inn Los Angeles (Entity) Entity Document (content) review1: this hotel was absolutely... review2: nice pet friendly hotel... Entity Document (content) review1: extremely old and dirty... review2: nice little place although... Entity Document (content) review1: the continental breakfast was... review2: I will never stay at this place..
  • 31. Use regular search technologies to index Entity Document review1: this hotel was absolutely... review2: nice pet friendly hotel... Entity Document review1: extremely old and dirty... review2: nice little place although... Entity Document review1: the continental breakfast was... review2: I will never stay at this place.. Hotel Los Angeles (Entity) Vagabond Inn (Entity) Holiday Inn Los Angeles (Entity)
  • 32. more keyword matches = better entity ranks Entity Document Review 1: I loved that this hotel was pet friendly... Review 2: nice pet friendly hotel... Review 3: pets are welcome at this hotel... Review 4: I brought my puppy along since this was... Pet friendlyPreference / query: Hotel Los Angeles
  • 33. #1: Uneven Entity Document Length extremel Entity Document (Hotel A) Review 1: This hotel was absolutely... Review 2: Nice pet friendly hotel... Review 3: Beautiful hotel with friendly... Review 4: My pets were really happy... Review 5: Our stay was fantastic. We... ...................................... ...................................... ...................................... ...................................... ...................................... ...................................... Review 1000: Unfortunately, we had a bad... Entity Document (Hotel B) Review 1: We had muffis for bfast... Review 2: Dull hotel with very little... ...................................... ...................................... ...................................... Review 10: Unfortunately, we had a bad... more matches ==> relevance goes up ↑
  • 34. #1: Uneven Entity Document Length Solution: similarity models that have saturation points
  • 36. #2: Matching similar concepts extremel pet friendly Entity Document Review 1: I loved that this hotel was pet friendly... Review 2: nice dog friendly hotel... Review 3: pets are welcome at this hotel... Review 4: Brought my kitty along since this is an animal friendly facility... Preference / query:
  • 37. #2: Matching similar concepts extremel pet friendly Entity Document Review 1: I loved that this hotel was pet friendly... Review 2: nice dog friendly hotel... Review 3: pets are welcome at this hotel... Review 4: Brought my kitty along since this is an animal friendly facility... Preference / query: Expand query with related concepts
  • 38. #3: Dealing with negations
  • 39. #3: Dealing with negations extremel pet friendly This hotel was NOT pet friendly so I could not bring my dog Preference / query:
  • 40. #3: Dealing with negations extremel pet friendly This hotel was NOT pet friendly so I could not bring my dog Preference / query: Nearby negations should be considered
  • 41. Opinion-Based Entity Ranking – Ganesan & Zhai 2012 http://kavita-ganesan.com/opinion-based-entity-ranking/
  • 42. Let's zoom into summarization of opinions Preference Based Search Summarization Query Understanding Structured + Unstrcutred Search
  • 43. What can review summaries provide that search cannot?
  • 44. Unexpected Information That can make or break the deal
  • 45.
  • 47. Lots of summarization options Concise or aggregated view of what people are saying Cleanliness Comfort Staff Views 4.0/5 2.0/5 3.0/5 4.5/5
  • 48. Natural Language Opinion Summary • Aggregation of what people think • Concise, conveys essential info • Analytics
  • 49. Opinosis: Graph Based Sentence Compression Approach (Ganesan & Zhai Coling 2010)
  • 50. Sentence Compression Approach “The bed was comfortable, I loved it!” “The bed was really comfortable..” “The tempurpedic bed was super comfy”
  • 51. Sentence Compression Approach “The bed was comfortable, I loved it!” “The bed was really comfortable..” “The tempurpedic bed was super comfy” bed was comfortable (3)
  • 52. Opinosis: Uses a Word Graph “The bed was comfortable, I loved it!” “The bed was really comfortable..” “The tempurpedic bed was super comfy” bed I really comfortable . tempurpedic the , loved itwas super . WORD GRAPH
  • 53. What's nice about this technique? 1. Really speedy for ad hoc summarization • No need to pre-compute • Generate summaries for specific topics
  • 54. What's nice about this technique? 1. Really speedy for ad hoc summarization 2. Captures redundancies naturally • Automatically provides the analytics component
  • 55. What's nice about this technique? 1. Really speedy for ad hoc summarization 2. Captures redundancies naturally 3. Extract phrases from existing sentence structure • Limiting external dependencies
  • 56. Try out Web API or JAR File www. kavita-ganesan.com/opinosis/
  • 58.
  • 59. Leverage text data to empower consumers…
  • 60. Help users make faster decisions...