Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

Yelp Refiner Lightning Talk

160 views

Published on

Using Latent Dirichlet Allocation, I created a model to predict the sub-topics and sub-topical sentiments of Yelp reviews (e.g. "good food, bad service", "good food, good price, good service").

Published in: Data & Analytics
  • Be the first to comment

  • Be the first to like this

Yelp Refiner Lightning Talk

  1. 1. YELP REVIEWS MAKING HEADS OR TAILS OF
  2. 2. THE [FOOD] GET[S] A 5 STAR FROM ME, BUT, SADLY, THE SERVICE BRINGS IT DOWN TO A 3. Yelp Review THE PROBLEM
  3. 3. GOAL MAKE YELP MORE USEFUL
  4. 4. GOAL MAKE YELP MORE USEFUL ▸ More clarity
  5. 5. GOAL MAKE YELP MORE USEFUL ▸ More clarity ▸ Easier to make decisions
  6. 6. GOAL MAKE YELP MORE USEFUL ▸ More clarity ▸ Easier to make decisions ▸ Less scrolling
  7. 7. GOAL MAKE YELP MORE USEFUL ▸ More clarity ▸ Easier to make decisions ▸ Less scrolling
  8. 8. DATASET YELP DATASET CHALLENGE ▸2.7M Reviews ▸649K Tips ▸687K Users ▸86K Businesses
  9. 9. PREDICT CATEGORIES + SENTIMENTS MODEL GOAL:
  10. 10. LATENT DIRICHLET ALLOCATION
  11. 11. OUTPUTS
  12. 12. OUTPUTS ▸ “Topics”
  13. 13. OUTPUTS ▸ “Topics” ▸ Top words in each topic Car, vehicle, tires, drive, …
  14. 14. OUTPUTS ▸ “Topics” ▸ Top words in each topic Car, vehicle, tires, drive, … ▸ Topic proportions for each “document” 40% Topic 1, 30% Topic 2, 15% Topic 3, …
  15. 15. MODIFICATIONS
  16. 16. MODIFICATIONS ▸ “Codewords” Positive and negative adjectives (nltk) (Jack Linshi, 2014 Yelp Dataset Challenge winner)
  17. 17. MODIFICATIONS ▸ “Codewords” Positive and negative adjectives (nltk) (Jack Linshi, 2014 Yelp Dataset Challenge winner) ▸ “Foodwords” Food-related nouns
  18. 18. TEST RESTAURANTS FOUR RESTAURANTS Restaurant 1 Restaurant 2 Restaurant 3 Restaurant 4 Mexican Italian Mexican Pizza 4.2 Stars 3.0 Stars 3.0 Stars 3.0 Stars 49 reviews 19 reviews 20 reviews 20 reviews
  19. 19. MANUAL CODING “GOOD FOOD” REVIEWS LDA CODING Rest 1 Rest 2 Rest 3 Rest 4 78% 58% 65% 50% 57% 47% 55% 40%
  20. 20. MANUAL CODING “GOOD FOOD” REVIEWS LDA CODING Rest 1 Rest 2 Rest 3 Rest 4
  21. 21. MANUAL CODING “GOOD FOOD” REVIEWS LDA CODING Rest 1 Rest 2 Rest 3 Rest 4
  22. 22. MANUAL CODING “GOOD FOOD” REVIEWS LDA CODING Rest 1 Rest 2 Rest 3 Rest 4
  23. 23. MANUAL CODING “GOOD FOOD” REVIEWS LDA CODING Rest 1 Rest 2 Rest 3 Rest 4
  24. 24. MANUAL CODING “GOOD FOOD” REVIEWS LDA CODING Rest 1 Rest 2 Rest 3 Rest 4
  25. 25. MANUAL CODING “BAD FOOD” REVIEWS LDA CODING Rest 1 Rest 2 Rest 3 Rest 4 20% 26% 35% 35% 20% 32% 25% 35%
  26. 26. MANUAL CODING “BAD FOOD” REVIEWS LDA CODING Rest 1 Rest 2 Rest 3 Rest 4
  27. 27. MANUAL CODING “BAD FOOD” REVIEWS LDA CODING Rest 1 Rest 2 Rest 3 Rest 4
  28. 28. MANUAL CODING “BAD FOOD” REVIEWS LDA CODING Rest 1 Rest 2 Rest 3 Rest 4
  29. 29. MANUAL CODING “BAD FOOD” REVIEWS LDA CODING Rest 1 Rest 2 Rest 3 Rest 4
  30. 30. MANUAL CODING “BAD FOOD” REVIEWS LDA CODING Rest 1 Rest 2 Rest 3 Rest 4
  31. 31. MANUAL CODING “GOOD SERVICE” REVIEWS LDA CODING Rest 1 Rest 2 Rest 3 Rest 4 39% 43% 26%16% 40% 20% 10% 15%
  32. 32. MANUAL CODING “GOOD SERVICE” REVIEWS LDA CODING Rest 1 Rest 2 Rest 3 Rest 4
  33. 33. MANUAL CODING “GOOD SERVICE” REVIEWS LDA CODING Rest 1 Rest 2 Rest 3 Rest 4
  34. 34. MANUAL CODING “GOOD SERVICE” REVIEWS LDA CODING Rest 1 Rest 2 Rest 3 Rest 4
  35. 35. MANUAL CODING “GOOD SERVICE” REVIEWS LDA CODING Rest 1 Rest 2 Rest 3 Rest 4
  36. 36. MANUAL CODING “GOOD SERVICE” REVIEWS LDA CODING Rest 1 Rest 2 Rest 3 Rest 4
  37. 37. MANUAL CODING “BAD SERVICE” REVIEWS LDA CODING Rest 1 Rest 2 Rest 3 Rest 4 4% 4% 21%16% 10% 15% 15% 25%
  38. 38. MANUAL CODING “BAD SERVICE” REVIEWS LDA CODING Rest 1 Rest 2 Rest 3 Rest 4
  39. 39. MANUAL CODING “BAD SERVICE” REVIEWS LDA CODING Rest 1 Rest 2 Rest 3 Rest 4
  40. 40. MANUAL CODING “BAD SERVICE” REVIEWS LDA CODING Rest 1 Rest 2 Rest 3 Rest 4
  41. 41. MANUAL CODING “BAD SERVICE” REVIEWS LDA CODING Rest 1 Rest 2 Rest 3 Rest 4
  42. 42. MANUAL CODING “BAD SERVICE” REVIEWS LDA CODING Rest 1 Rest 2 Rest 3 Rest 4
  43. 43. MANUAL CODING “BAD PRICE” REVIEWS LDA CODING Rest 1 Rest 2 Rest 3 Rest 4 0% 18% 11%11% 5% 15% 5% 15%
  44. 44. MANUAL CODING “BAD PRICE” REVIEWS LDA CODING Rest 1 Rest 2 Rest 3 Rest 4
  45. 45. MANUAL CODING “BAD PRICE” REVIEWS LDA CODING Rest 1 Rest 2 Rest 3 Rest 4
  46. 46. MANUAL CODING “BAD PRICE” REVIEWS LDA CODING Rest 1 Rest 2 Rest 3 Rest 4
  47. 47. MANUAL CODING “BAD PRICE” REVIEWS LDA CODING Rest 1 Rest 2 Rest 3 Rest 4
  48. 48. MANUAL CODING “BAD PRICE” REVIEWS LDA CODING Rest 1 Rest 2 Rest 3 Rest 4

×