Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.
Big Data    Stupid DecisionsThe Importance Of MeasuringWhat We Should Be Measuring              Panos @IpeirotisStern Scho...
Shopping for a camera
Multiple merchants sell the same camera
Consumers do not always buy the cheapest
Willoughby’s enjoys a 7.5% price premium (= $140)
Price Premium Percentages, Amazon.com                                     Transaction price compared to competition       ...
Customers care about reputation!
The price of Willoughby’s reputation : $140                                    (*)                                        ...
What is reputation? Factors affecting pricing power  Number of stars  Number of past transactions  …  Text!My reputati...
How text affects reputation?
The value of text
The value of text   Misspellings…
good packaging       -0.56%Positive? Negative?
Recommendation Letters: “He is a good student”    “He works hard”   Decision: Reject
AAA++++ seller       -2.93%Positive? Negative?
People interpret things differently,    according to the context
Lesson #1Adapt to the environmentOne size does not fit all!
Same idea, different focus:How reviews (text) affect product sales?
Best camera!        -0.20%Positive?  Negative?
Tell me something specific, you shill!
Positive ?   Negative?
“If this is the worst that can happen…”
What product features do customers want?
Point-and-Shoot: Lenses, zoom, …                                              % DiscussionZoom      Lenses   Megapixel   B...
Point-and-Shoot: Lenses, zoom, …                                             % Discussion                                 ...
Lesson #2Not sufficient to know what people say     Measure what people DO
Reviews, Grammar, and Hotel Bookings
Bad Grammar → Bad Sales
Zappos takes action! Examined and fixed grammar for  millions of reviews on Zappos.com! Used Amazon Mechanical Turk,  pa...
But… is it ethical?“Would you correct a friend’s tweet orFacebook post?…Nitpick a colleague for using shorthand inemails s...
Experiment: Fixed 1000 reviews Emailed authors: “Do you approve of the changes?” Gift card for replying Result: 978 rep...
Experiment: Fixed 1000 reviews Emailed readers: “Do you approve of the changes?”   Version 1: Only new version posted  ...
“Can you do the same for YouTube comments?   My eyes hurt every time that I read them”
Lesson #3Check your gut instinct at the entrance    Measure and then talk!
Lessons1. Measure in context: one size does not fit all2. Measure what people do, not what they say                 3. Mea...
Big Data, Stupid Decisions / Strata Jumpstart 2011 / Panos Ipeirotis / http://www.youtube.com/watch?v=LXDFwphuwCs
Upcoming SlideShare
Loading in …5
×

Big Data, Stupid Decisions / Strata Jumpstart 2011 / Panos Ipeirotis / http://www.youtube.com/watch?v=LXDFwphuwCs

41,530 views

Published on

Strata Jumpstart, New York, September 19 2011

Big Data , Stupid Decisions: The Importance Of Measuring What We Should Be Measuring

Video at http://www.youtube.com/watch?v=LXDFwphuwCs

Published in: Technology, Education, Business

Big Data, Stupid Decisions / Strata Jumpstart 2011 / Panos Ipeirotis / http://www.youtube.com/watch?v=LXDFwphuwCs

  1. Big Data Stupid DecisionsThe Importance Of MeasuringWhat We Should Be Measuring Panos @IpeirotisStern School of Business, New York University “A Computer Scientist in a Business School” http://behind-the-enemy-lines.com
  2. Shopping for a camera
  3. Multiple merchants sell the same camera
  4. Consumers do not always buy the cheapest
  5. Willoughby’s enjoys a 7.5% price premium (= $140)
  6. Price Premium Percentages, Amazon.com Transaction price compared to competition 20000 18000Number of Transactions 16000 14000 12000 10000 8000 6000 4000 2000 0 -100% 0% +30% +100%
  7. Customers care about reputation!
  8. The price of Willoughby’s reputation : $140 (*) (*) vs 17th street photo
  9. What is reputation? Factors affecting pricing power  Number of stars  Number of past transactions  …  Text!My reputation, Iago, my reputation! -Shakespeare, Othello
  10. How text affects reputation?
  11. The value of text
  12. The value of text Misspellings…
  13. good packaging -0.56%Positive? Negative?
  14. Recommendation Letters: “He is a good student” “He works hard” Decision: Reject
  15. AAA++++ seller -2.93%Positive? Negative?
  16. People interpret things differently, according to the context
  17. Lesson #1Adapt to the environmentOne size does not fit all!
  18. Same idea, different focus:How reviews (text) affect product sales?
  19. Best camera! -0.20%Positive? Negative?
  20. Tell me something specific, you shill!
  21. Positive ? Negative?
  22. “If this is the worst that can happen…”
  23. What product features do customers want?
  24. Point-and-Shoot: Lenses, zoom, … % DiscussionZoom Lenses Megapixel Battery Life
  25. Point-and-Shoot: Lenses, zoom, … % Discussion Effect on SalesZoom Lenses Megapixel Battery Life
  26. Lesson #2Not sufficient to know what people say Measure what people DO
  27. Reviews, Grammar, and Hotel Bookings
  28. Bad Grammar → Bad Sales
  29. Zappos takes action! Examined and fixed grammar for millions of reviews on Zappos.com! Used Amazon Mechanical Turk, paying ~$0.10 per review Improved product sales!
  30. But… is it ethical?“Would you correct a friend’s tweet orFacebook post?…Nitpick a colleague for using shorthand inemails sent from his iPhone?…This level of social intrusion is almostunthinkable.”
  31. Experiment: Fixed 1000 reviews Emailed authors: “Do you approve of the changes?” Gift card for replying Result: 978 replies, not a single negative evaluation! “Thank you! I almost feel that I am ‘stoopid’ when I leave such reviews!” “Hey, the review is not updated online! When will it be fixed?”
  32. Experiment: Fixed 1000 reviews Emailed readers: “Do you approve of the changes?”  Version 1: Only new version posted  Version 2: Disclaimer (“Review has been edited…”)  Version 3: Disclaimer + mouseover to see old review Result: For version 3, unanimously positive replies!
  33. “Can you do the same for YouTube comments? My eyes hurt every time that I read them”
  34. Lesson #3Check your gut instinct at the entrance Measure and then talk!
  35. Lessons1. Measure in context: one size does not fit all2. Measure what people do, not what they say 3. Measure! Thank you!

×