SlideShare a Scribd company logo
UNDERSTANDING DEJA REVIEWERS
Eric Gilbert & Karrie Karahalios   University of Illinois
WHAT’S IN IT FOR DEJA REVIEWERS?
THE REVIEWS
overview


98,191 Amazon.com reviews
from 200 bestselling products
belonging to 15 product categories
COMPUTATIONAL METHOD
n-gram & sentiment centrality


 “Our family loves the Wii Fit, but my son loves it most.”


       deja score = similarity to centroid &
                     similarity to running sentiment
        centroid = statistically representative n-grams
                     normalized to Google 1T corpus
THE INTERVIEWS
overview


20 interviews
from 200 invitations extended
conducted via email, phone & IM
THE PROBLEM OF SCALE
a common refrain


If there's 5, 10, I'll read those. If there's
50 or 60, I'll skim some titles. If a title
looks like it has some wit or humor, I
might read that one. That’s about it.
— P13
AMATEUR DEJA REVIEWERS
catharsis


I was so moved by this documentary,
and as a wolf advocate, I wanted a few
others to know about it … I don't care if
I write the rst review or the 5,000th.
It's cathartic for me.
— P3
AMATEUR DEJA REVIEWERS
why be unique?


I'm sure that other reviewers noted the
same features that appealed to me and my
kids. A completely unique review wouldn't
serve any real purpose, would it?
— P5
PRO DEJA REVIEWERS
hate mail




One said we were trying to “sti e dissent.”

Another warned us that she does not write
“just to see my own words on the internet.”
PRO DEJA REVIEWERS
above the din


[Do you read other reviews?] Absolutely
not … I do not condone plagiarism and
would never base my opinion on another
reviewer’s thoughts. I believe this alone
has led me to be rated highly.
— P7
PRO DEJA REVIEWERS
building a brand


I am trying to build a name for myself …
If every other person on earth has said
something similar that is ne, it in no
way diminishes the value of my personal
opinion.
— P19
RESULTS
summary


universal problem of scale
amateurs: ok as a brick in the wall; visceral reactions
pros: special bricks in the wall; cerebral reviews
NUDGEMENTAL COMMUNITIES
early sketch
UNDERSTANDING DEJA REVIEWERS
Eric Gilbert & Karrie Karahalios   University of Illinois

More Related Content

Viewers also liked

The Network in the Garden: CHI 08
The Network in the Garden: CHI 08The Network in the Garden: CHI 08
The Network in the Garden: CHI 08
eegilbert
 
Staff Tech Training 20 minute version
Staff Tech Training 20 minute versionStaff Tech Training 20 minute version
Staff Tech Training 20 minute version
Bald Geek In Md
 
Demystifying & Integrating Web 2.0 at the Metropolitan Museum of Art
Demystifying & Integrating Web 2.0 at the Metropolitan Museum of ArtDemystifying & Integrating Web 2.0 at the Metropolitan Museum of Art
Demystifying & Integrating Web 2.0 at the Metropolitan Museum of Art
Jennie Pu
 
When Web Calling, Video, and Libraries Collide
When Web Calling, Video, and Libraries CollideWhen Web Calling, Video, and Libraries Collide
When Web Calling, Video, and Libraries Collide
char booth
 
Integrating RSS Into Your Web Site - CIL2008
Integrating RSS Into Your Web Site - CIL2008Integrating RSS Into Your Web Site - CIL2008
Integrating RSS Into Your Web Site - CIL2008
Michael Sauers
 
Leading Technology in Libraries
Leading Technology in LibrariesLeading Technology in Libraries
Leading Technology in Libraries
Gina Millsap
 
Predicting Tie Strength With Social Media
Predicting Tie Strength With Social MediaPredicting Tie Strength With Social Media
Predicting Tie Strength With Social Media
eegilbert
 

Viewers also liked (7)

The Network in the Garden: CHI 08
The Network in the Garden: CHI 08The Network in the Garden: CHI 08
The Network in the Garden: CHI 08
 
Staff Tech Training 20 minute version
Staff Tech Training 20 minute versionStaff Tech Training 20 minute version
Staff Tech Training 20 minute version
 
Demystifying & Integrating Web 2.0 at the Metropolitan Museum of Art
Demystifying & Integrating Web 2.0 at the Metropolitan Museum of ArtDemystifying & Integrating Web 2.0 at the Metropolitan Museum of Art
Demystifying & Integrating Web 2.0 at the Metropolitan Museum of Art
 
When Web Calling, Video, and Libraries Collide
When Web Calling, Video, and Libraries CollideWhen Web Calling, Video, and Libraries Collide
When Web Calling, Video, and Libraries Collide
 
Integrating RSS Into Your Web Site - CIL2008
Integrating RSS Into Your Web Site - CIL2008Integrating RSS Into Your Web Site - CIL2008
Integrating RSS Into Your Web Site - CIL2008
 
Leading Technology in Libraries
Leading Technology in LibrariesLeading Technology in Libraries
Leading Technology in Libraries
 
Predicting Tie Strength With Social Media
Predicting Tie Strength With Social MediaPredicting Tie Strength With Social Media
Predicting Tie Strength With Social Media
 

Similar to Understanding Deja Reviewers

Media question 4
Media question 4Media question 4
Media question 4
madiarnold98
 
Research unit 3
 Research unit 3 Research unit 3
Research unit 3
Sam Fulton
 
"Yes, and...": What Agencies Can Learn from Improv
"Yes, and...": What Agencies Can Learn from Improv"Yes, and...": What Agencies Can Learn from Improv
"Yes, and...": What Agencies Can Learn from Improv
Young & Rubicam
 
How to Write Elevator Pitches - Personal Branding for Entrepreneurs Kaitlin Z...
How to Write Elevator Pitches - Personal Branding for Entrepreneurs Kaitlin Z...How to Write Elevator Pitches - Personal Branding for Entrepreneurs Kaitlin Z...
How to Write Elevator Pitches - Personal Branding for Entrepreneurs Kaitlin Z...
Kaitlin Zhang
 
How To Find A Business Name In 12 Happy Steps
How To Find A Business Name In 12 Happy StepsHow To Find A Business Name In 12 Happy Steps
How To Find A Business Name In 12 Happy Steps
TwentyTwo Agency
 
Validity
ValidityValidity
Validity
Elisew123
 

Similar to Understanding Deja Reviewers (6)

Media question 4
Media question 4Media question 4
Media question 4
 
Research unit 3
 Research unit 3 Research unit 3
Research unit 3
 
"Yes, and...": What Agencies Can Learn from Improv
"Yes, and...": What Agencies Can Learn from Improv"Yes, and...": What Agencies Can Learn from Improv
"Yes, and...": What Agencies Can Learn from Improv
 
How to Write Elevator Pitches - Personal Branding for Entrepreneurs Kaitlin Z...
How to Write Elevator Pitches - Personal Branding for Entrepreneurs Kaitlin Z...How to Write Elevator Pitches - Personal Branding for Entrepreneurs Kaitlin Z...
How to Write Elevator Pitches - Personal Branding for Entrepreneurs Kaitlin Z...
 
How To Find A Business Name In 12 Happy Steps
How To Find A Business Name In 12 Happy StepsHow To Find A Business Name In 12 Happy Steps
How To Find A Business Name In 12 Happy Steps
 
Validity
ValidityValidity
Validity
 

Recently uploaded

The Art of the Pitch: WordPress Relationships and Sales
The Art of the Pitch: WordPress Relationships and SalesThe Art of the Pitch: WordPress Relationships and Sales
The Art of the Pitch: WordPress Relationships and Sales
Laura Byrne
 
Leading Change strategies and insights for effective change management pdf 1.pdf
Leading Change strategies and insights for effective change management pdf 1.pdfLeading Change strategies and insights for effective change management pdf 1.pdf
Leading Change strategies and insights for effective change management pdf 1.pdf
OnBoard
 
Introduction to CHERI technology - Cybersecurity
Introduction to CHERI technology - CybersecurityIntroduction to CHERI technology - Cybersecurity
Introduction to CHERI technology - Cybersecurity
mikeeftimakis1
 
Key Trends Shaping the Future of Infrastructure.pdf
Key Trends Shaping the Future of Infrastructure.pdfKey Trends Shaping the Future of Infrastructure.pdf
Key Trends Shaping the Future of Infrastructure.pdf
Cheryl Hung
 
Free Complete Python - A step towards Data Science
Free Complete Python - A step towards Data ScienceFree Complete Python - A step towards Data Science
Free Complete Python - A step towards Data Science
RinaMondal9
 
When stars align: studies in data quality, knowledge graphs, and machine lear...
When stars align: studies in data quality, knowledge graphs, and machine lear...When stars align: studies in data quality, knowledge graphs, and machine lear...
When stars align: studies in data quality, knowledge graphs, and machine lear...
Elena Simperl
 
Quantum Computing: Current Landscape and the Future Role of APIs
Quantum Computing: Current Landscape and the Future Role of APIsQuantum Computing: Current Landscape and the Future Role of APIs
Quantum Computing: Current Landscape and the Future Role of APIs
Vlad Stirbu
 
Monitoring Java Application Security with JDK Tools and JFR Events
Monitoring Java Application Security with JDK Tools and JFR EventsMonitoring Java Application Security with JDK Tools and JFR Events
Monitoring Java Application Security with JDK Tools and JFR Events
Ana-Maria Mihalceanu
 
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...
James Anderson
 
UiPath Test Automation using UiPath Test Suite series, part 4
UiPath Test Automation using UiPath Test Suite series, part 4UiPath Test Automation using UiPath Test Suite series, part 4
UiPath Test Automation using UiPath Test Suite series, part 4
DianaGray10
 
A tale of scale & speed: How the US Navy is enabling software delivery from l...
A tale of scale & speed: How the US Navy is enabling software delivery from l...A tale of scale & speed: How the US Navy is enabling software delivery from l...
A tale of scale & speed: How the US Navy is enabling software delivery from l...
sonjaschweigert1
 
Le nuove frontiere dell'AI nell'RPA con UiPath Autopilot™
Le nuove frontiere dell'AI nell'RPA con UiPath Autopilot™Le nuove frontiere dell'AI nell'RPA con UiPath Autopilot™
Le nuove frontiere dell'AI nell'RPA con UiPath Autopilot™
UiPathCommunity
 
Observability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdf
Observability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdfObservability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdf
Observability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdf
Paige Cruz
 
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024Encryption in Microsoft 365 - ExpertsLive Netherlands 2024
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024
Albert Hoitingh
 
FIDO Alliance Osaka Seminar: Overview.pdf
FIDO Alliance Osaka Seminar: Overview.pdfFIDO Alliance Osaka Seminar: Overview.pdf
FIDO Alliance Osaka Seminar: Overview.pdf
FIDO Alliance
 
Elevating Tactical DDD Patterns Through Object Calisthenics
Elevating Tactical DDD Patterns Through Object CalisthenicsElevating Tactical DDD Patterns Through Object Calisthenics
Elevating Tactical DDD Patterns Through Object Calisthenics
Dorra BARTAGUIZ
 
State of ICS and IoT Cyber Threat Landscape Report 2024 preview
State of ICS and IoT Cyber Threat Landscape Report 2024 previewState of ICS and IoT Cyber Threat Landscape Report 2024 preview
State of ICS and IoT Cyber Threat Landscape Report 2024 preview
Prayukth K V
 
Builder.ai Founder Sachin Dev Duggal's Strategic Approach to Create an Innova...
Builder.ai Founder Sachin Dev Duggal's Strategic Approach to Create an Innova...Builder.ai Founder Sachin Dev Duggal's Strategic Approach to Create an Innova...
Builder.ai Founder Sachin Dev Duggal's Strategic Approach to Create an Innova...
Ramesh Iyer
 
SAP Sapphire 2024 - ASUG301 building better apps with SAP Fiori.pdf
SAP Sapphire 2024 - ASUG301 building better apps with SAP Fiori.pdfSAP Sapphire 2024 - ASUG301 building better apps with SAP Fiori.pdf
SAP Sapphire 2024 - ASUG301 building better apps with SAP Fiori.pdf
Peter Spielvogel
 
Elizabeth Buie - Older adults: Are we really designing for our future selves?
Elizabeth Buie - Older adults: Are we really designing for our future selves?Elizabeth Buie - Older adults: Are we really designing for our future selves?
Elizabeth Buie - Older adults: Are we really designing for our future selves?
Nexer Digital
 

Recently uploaded (20)

The Art of the Pitch: WordPress Relationships and Sales
The Art of the Pitch: WordPress Relationships and SalesThe Art of the Pitch: WordPress Relationships and Sales
The Art of the Pitch: WordPress Relationships and Sales
 
Leading Change strategies and insights for effective change management pdf 1.pdf
Leading Change strategies and insights for effective change management pdf 1.pdfLeading Change strategies and insights for effective change management pdf 1.pdf
Leading Change strategies and insights for effective change management pdf 1.pdf
 
Introduction to CHERI technology - Cybersecurity
Introduction to CHERI technology - CybersecurityIntroduction to CHERI technology - Cybersecurity
Introduction to CHERI technology - Cybersecurity
 
Key Trends Shaping the Future of Infrastructure.pdf
Key Trends Shaping the Future of Infrastructure.pdfKey Trends Shaping the Future of Infrastructure.pdf
Key Trends Shaping the Future of Infrastructure.pdf
 
Free Complete Python - A step towards Data Science
Free Complete Python - A step towards Data ScienceFree Complete Python - A step towards Data Science
Free Complete Python - A step towards Data Science
 
When stars align: studies in data quality, knowledge graphs, and machine lear...
When stars align: studies in data quality, knowledge graphs, and machine lear...When stars align: studies in data quality, knowledge graphs, and machine lear...
When stars align: studies in data quality, knowledge graphs, and machine lear...
 
Quantum Computing: Current Landscape and the Future Role of APIs
Quantum Computing: Current Landscape and the Future Role of APIsQuantum Computing: Current Landscape and the Future Role of APIs
Quantum Computing: Current Landscape and the Future Role of APIs
 
Monitoring Java Application Security with JDK Tools and JFR Events
Monitoring Java Application Security with JDK Tools and JFR EventsMonitoring Java Application Security with JDK Tools and JFR Events
Monitoring Java Application Security with JDK Tools and JFR Events
 
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...
 
UiPath Test Automation using UiPath Test Suite series, part 4
UiPath Test Automation using UiPath Test Suite series, part 4UiPath Test Automation using UiPath Test Suite series, part 4
UiPath Test Automation using UiPath Test Suite series, part 4
 
A tale of scale & speed: How the US Navy is enabling software delivery from l...
A tale of scale & speed: How the US Navy is enabling software delivery from l...A tale of scale & speed: How the US Navy is enabling software delivery from l...
A tale of scale & speed: How the US Navy is enabling software delivery from l...
 
Le nuove frontiere dell'AI nell'RPA con UiPath Autopilot™
Le nuove frontiere dell'AI nell'RPA con UiPath Autopilot™Le nuove frontiere dell'AI nell'RPA con UiPath Autopilot™
Le nuove frontiere dell'AI nell'RPA con UiPath Autopilot™
 
Observability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdf
Observability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdfObservability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdf
Observability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdf
 
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024Encryption in Microsoft 365 - ExpertsLive Netherlands 2024
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024
 
FIDO Alliance Osaka Seminar: Overview.pdf
FIDO Alliance Osaka Seminar: Overview.pdfFIDO Alliance Osaka Seminar: Overview.pdf
FIDO Alliance Osaka Seminar: Overview.pdf
 
Elevating Tactical DDD Patterns Through Object Calisthenics
Elevating Tactical DDD Patterns Through Object CalisthenicsElevating Tactical DDD Patterns Through Object Calisthenics
Elevating Tactical DDD Patterns Through Object Calisthenics
 
State of ICS and IoT Cyber Threat Landscape Report 2024 preview
State of ICS and IoT Cyber Threat Landscape Report 2024 previewState of ICS and IoT Cyber Threat Landscape Report 2024 preview
State of ICS and IoT Cyber Threat Landscape Report 2024 preview
 
Builder.ai Founder Sachin Dev Duggal's Strategic Approach to Create an Innova...
Builder.ai Founder Sachin Dev Duggal's Strategic Approach to Create an Innova...Builder.ai Founder Sachin Dev Duggal's Strategic Approach to Create an Innova...
Builder.ai Founder Sachin Dev Duggal's Strategic Approach to Create an Innova...
 
SAP Sapphire 2024 - ASUG301 building better apps with SAP Fiori.pdf
SAP Sapphire 2024 - ASUG301 building better apps with SAP Fiori.pdfSAP Sapphire 2024 - ASUG301 building better apps with SAP Fiori.pdf
SAP Sapphire 2024 - ASUG301 building better apps with SAP Fiori.pdf
 
Elizabeth Buie - Older adults: Are we really designing for our future selves?
Elizabeth Buie - Older adults: Are we really designing for our future selves?Elizabeth Buie - Older adults: Are we really designing for our future selves?
Elizabeth Buie - Older adults: Are we really designing for our future selves?
 

Understanding Deja Reviewers

  • 1. UNDERSTANDING DEJA REVIEWERS Eric Gilbert & Karrie Karahalios University of Illinois
  • 2. WHAT’S IN IT FOR DEJA REVIEWERS?
  • 3. THE REVIEWS overview 98,191 Amazon.com reviews from 200 bestselling products belonging to 15 product categories
  • 4. COMPUTATIONAL METHOD n-gram & sentiment centrality “Our family loves the Wii Fit, but my son loves it most.” deja score = similarity to centroid & similarity to running sentiment centroid = statistically representative n-grams normalized to Google 1T corpus
  • 5.
  • 6. THE INTERVIEWS overview 20 interviews from 200 invitations extended conducted via email, phone & IM
  • 7. THE PROBLEM OF SCALE a common refrain If there's 5, 10, I'll read those. If there's 50 or 60, I'll skim some titles. If a title looks like it has some wit or humor, I might read that one. That’s about it. — P13
  • 8. AMATEUR DEJA REVIEWERS catharsis I was so moved by this documentary, and as a wolf advocate, I wanted a few others to know about it … I don't care if I write the rst review or the 5,000th. It's cathartic for me. — P3
  • 9. AMATEUR DEJA REVIEWERS why be unique? I'm sure that other reviewers noted the same features that appealed to me and my kids. A completely unique review wouldn't serve any real purpose, would it? — P5
  • 10. PRO DEJA REVIEWERS hate mail One said we were trying to “sti e dissent.” Another warned us that she does not write “just to see my own words on the internet.”
  • 11. PRO DEJA REVIEWERS above the din [Do you read other reviews?] Absolutely not … I do not condone plagiarism and would never base my opinion on another reviewer’s thoughts. I believe this alone has led me to be rated highly. — P7
  • 12. PRO DEJA REVIEWERS building a brand I am trying to build a name for myself … If every other person on earth has said something similar that is ne, it in no way diminishes the value of my personal opinion. — P19
  • 13. RESULTS summary universal problem of scale amateurs: ok as a brick in the wall; visceral reactions pros: special bricks in the wall; cerebral reviews
  • 15. UNDERSTANDING DEJA REVIEWERS Eric Gilbert & Karrie Karahalios University of Illinois