Red Opal: Product-Feature Scoring from Reviews Christopher Scaffidi Kevin Bierhoff Eric Chang Mikhael Felker Herman Ng Chun Jin School of Computer Science Carnegie Mellon University ACM EC 2007, San Diego, CA

Motivation Searching for quality digital camera Picture quality Auto mode Battery Shutter Memory Searching by product feature: Red Opal

Searching for quality digital camera

Picture quality

Auto mode

Battery

Shutter

Memory

Searching by product feature: Red Opal

Red Opal Overview Feature Extraction Product scoring User Interface Evaluation

Feature Extraction

Product scoring

User Interface

Evaluation

Feature extraction Prior work identified technical terms as mostly nouns. For a given product category, if a certain noun occurs in reviews far more frequently than in generic English text, then that word is likely to be a product feature. A Poisson distribution was previously used to extract technical terms from texts on physics & politics.

Prior work identified technical terms as mostly nouns.

For a given product category, if a certain noun occurs in reviews far more frequently than in generic English text, then that word is likely to be a product feature.

A Poisson distribution was previously used to extract technical terms from texts on physics & politics.

Feature extraction For each product category, 1. Retrieve Amazon reviews for products in this category 2. Tag part-of-speech to text (e.g. “games”  NN/“game”) 3. Compute the count of each noun and compound noun 4. Compute their probability 5. Sort the most common nouns and compound nouns together according to probability, yielding the feature list

For each product category,

1. Retrieve Amazon reviews for products in this category

2. Tag part-of-speech to text (e.g. “games”  NN/“game”)

3. Compute the count of each noun and compound noun

4. Compute their probability

5. Sort the most common nouns and compound nouns together according to probability, yielding the feature list

Product scoring for features Input: Product category, feature of interest Output: Score (1-5) Scores are specific to feature … 3.9 4.3 CameraD 4.8 2.1 CameraC … 4.1 3.7 CameraB 3.0 4.5 CameraA … Picture quality Memory Product

Input: Product category, feature of interest

Output: Score (1-5)

Scores are specific to feature

Compute scores and confidences based on review ratings Red Opal scoring algorithm Based on reviewer-assigned ratings Weighted average rating of reviews that mention feature Weigh reviews higher if feature mentioned more often Assumption: Review ratings consistent with features discussed Future work to identify the consistent rating with a feature Compute confidence in scores Measures uniformity of relevant reviewer ratings

Red Opal scoring algorithm

Based on reviewer-assigned ratings

Weighted average rating of reviews that mention feature

Weigh reviews higher if feature mentioned more often

Assumption: Review ratings consistent with features discussed

Future work to identify the consistent rating with a feature

Compute confidence in scores

Measures uniformity of relevant reviewer ratings

User Interface: Search Screen http://redopal.ntelligentsolutions.net

User Interface: Search Results 3 min(RedOpal) vs 10-15min(general)

Evaluation: Feature Extraction Time complexity: O(n), 0.9s per review.

Evaluation: Scoring Precision

Summary Red Opal: searching on-line catalog by feature Future Work: Integrating manufacturer product description Finding opinion words User-specified features Multi-feature search

Red Opal: searching on-line catalog by feature

Future Work:

Integrating manufacturer product description

Finding opinion words

User-specified features

Multi-feature search

Acknowledgements Norman M. Sadeh, Mary Shaw, Jonathan Aldrich, and Jaime Carbonell Fall 2005 “ Web Commerce, Security and Privacy” class (questionnaire subjects)

Norman M. Sadeh, Mary Shaw, Jonathan Aldrich, and Jaime Carbonell

Fall 2005 “ Web Commerce, Security and Privacy” class (questionnaire subjects)

Thank you! Questions and Comments?

Thank you!

Questions and Comments?