Everyone’s Customers Are Wrong andTheir Data Is LyingEvan HamiltonHead of Community, UserVoice
DATA!Big Data! Social Data! Mobile Data!It’s the future!
Actually...Data doesn’t tell the whole story.
Data doesn’t tell the whole story.A/B test: will this carousel increase clicks?^ incredibly ugly
Data doesn’t tell the whole story.“Hey, look! The version of the page with the carousel ismaking more people click through!”
Data doesn’t tell the whole story.“Oh wait...it’s making more people click, not actuallyconvert.”Tricky data at work!
Data doesn’t tell the whole story.We created confusion, not conversions.
Data doesn’t tell the whole story.
Data doesn’t tell the whole story.Hey, that looks good!
Data doesn’t tell the whole story.Oops. They “forgot” to report refunds (amongst other things.)
PEOPLE!Feelings! Empathy! Gut!It’s the only way!
Actually...People don’t tell the whole story.
People don’t tell the whole story.“Wow, maybe we should build this. Let’s ask for morefeedback first...”
People don’t tell the whole story.Oh. So they want this feature because they’re notresponding to customers. Next.
There’s always more context.• What is the pain point?• Are these paying users? Freeloaders?• Are these people using your p...
People don’t tell the whole story.“Makes sense, let’s build it!”
People don’t tell the whole story.But customers found this confusing. (And it made us throwup in our mouths a little bit.)
People don’t tell the whole story.“Yet another online identity” is what we should havefocused on.
People don’t tell the whole story.v2No password. No signup. No registration.Solved the problem without a complicated sign-...
Customers often give you bad solutions toreal problems.(Don’t misinterpret this as good solutionsor not real problems.)
Everything is wrong.Now what?
Data still has to be interpreted.
Data still has to be interpreted.Requests can lead you astray.
Data still has to be interpreted.Requests can lead you astray.Combine data + customer stories.
Combine data + customer stories.Back when we just had UserVoice Feedback, we’d loselots of customers after 1 year. So we a...
Turns out they were growing up. New staff, newdepartment heads...& feedback forums didn’t have adefinitive place in the or...
So we built a customer service tool into our product. Notwhat we necessarily planned to build...but what customerswanted.
It increased retention immensely. We now have a place inthe organization.We got here because data alerted us to something,...
Don’t get lost in the data rat-hole.
Don’t get lost in the data rat-hole.Don’t chase 1% when you can get 15%.
Don’t get lost in the data rat-hole.Don’t chase 1% when you can get 15%.Don’t get lost in minor homepageoptimization.
You’ll never know what you could get unlessyou try something crazy.
Tried this yet? If not, go do thatbefore trying another shade of blue.
Tips, tricks, and tools• (At least) Google Analytics• Hell, even Bit.ly links give you a basis to work from• Mixpanel• The...
Thank you!Evan HamiltonHead of Community, UserVoice@evanhamilton
Upcoming SlideShare
Loading in …5
×

Everyone's Customers Are Wrong and Their Data Is Lying

1,291 views

Published on

You can't trust your customers or your data. But a combination will yield amazing results. Originally presented at the Startup Product Summit.

Learn more about how UserVoice can help you understand your customers at http://www.uservoice.com

Photo credits:
WTH dude - http://www.flickr.com/photos/porphyria/3206687773/
Groupon data - http://techcrunch.com/2011/06/02/groupon-growth-2-6-billion-revenue-run-rate-charts/ & http://techcrunch.com/2012/11/08/groupons-q3-2012-earnings/
Crowd - http://www.flickr.com/photos/anirudhkoul/3786725982/in/photostream/
Boys - http://www.flickr.com/photos/mutrock/8259688450/in/photostream/
Prince - http://ryanhoover.me/post/43545454717/test-something-crazy

Published in: Business, Technology
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
1,291
On SlideShare
0
From Embeds
0
Number of Embeds
699
Actions
Shares
0
Downloads
6
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

Everyone's Customers Are Wrong and Their Data Is Lying

  1. 1. Everyone’s Customers Are Wrong andTheir Data Is LyingEvan HamiltonHead of Community, UserVoice
  2. 2. DATA!Big Data! Social Data! Mobile Data!It’s the future!
  3. 3. Actually...Data doesn’t tell the whole story.
  4. 4. Data doesn’t tell the whole story.A/B test: will this carousel increase clicks?^ incredibly ugly
  5. 5. Data doesn’t tell the whole story.“Hey, look! The version of the page with the carousel ismaking more people click through!”
  6. 6. Data doesn’t tell the whole story.“Oh wait...it’s making more people click, not actuallyconvert.”Tricky data at work!
  7. 7. Data doesn’t tell the whole story.We created confusion, not conversions.
  8. 8. Data doesn’t tell the whole story.
  9. 9. Data doesn’t tell the whole story.Hey, that looks good!
  10. 10. Data doesn’t tell the whole story.Oops. They “forgot” to report refunds (amongst other things.)
  11. 11. PEOPLE!Feelings! Empathy! Gut!It’s the only way!
  12. 12. Actually...People don’t tell the whole story.
  13. 13. People don’t tell the whole story.“Wow, maybe we should build this. Let’s ask for morefeedback first...”
  14. 14. People don’t tell the whole story.Oh. So they want this feature because they’re notresponding to customers. Next.
  15. 15. There’s always more context.• What is the pain point?• Are these paying users? Freeloaders?• Are these people using your product in theintended way?• (We had someone using our forum to name their baby.Cute, but not our target market.)• Are they using your main features?• Early “adopters”?• (Robert Scoble is not your target market. He is fickle.)
  16. 16. People don’t tell the whole story.“Makes sense, let’s build it!”
  17. 17. People don’t tell the whole story.But customers found this confusing. (And it made us throwup in our mouths a little bit.)
  18. 18. People don’t tell the whole story.“Yet another online identity” is what we should havefocused on.
  19. 19. People don’t tell the whole story.v2No password. No signup. No registration.Solved the problem without a complicated sign-in process.
  20. 20. Customers often give you bad solutions toreal problems.(Don’t misinterpret this as good solutionsor not real problems.)
  21. 21. Everything is wrong.Now what?
  22. 22. Data still has to be interpreted.
  23. 23. Data still has to be interpreted.Requests can lead you astray.
  24. 24. Data still has to be interpreted.Requests can lead you astray.Combine data + customer stories.
  25. 25. Combine data + customer stories.Back when we just had UserVoice Feedback, we’d loselots of customers after 1 year. So we asked them whythey were leaving.
  26. 26. Turns out they were growing up. New staff, newdepartment heads...& feedback forums didn’t have adefinitive place in the organization.
  27. 27. So we built a customer service tool into our product. Notwhat we necessarily planned to build...but what customerswanted.
  28. 28. It increased retention immensely. We now have a place inthe organization.We got here because data alerted us to something, & userstories filled out the details.
  29. 29. Don’t get lost in the data rat-hole.
  30. 30. Don’t get lost in the data rat-hole.Don’t chase 1% when you can get 15%.
  31. 31. Don’t get lost in the data rat-hole.Don’t chase 1% when you can get 15%.Don’t get lost in minor homepageoptimization.
  32. 32. You’ll never know what you could get unlessyou try something crazy.
  33. 33. Tried this yet? If not, go do thatbefore trying another shade of blue.
  34. 34. Tips, tricks, and tools• (At least) Google Analytics• Hell, even Bit.ly links give you a basis to work from• Mixpanel• The ol’ fake button• How many people click a (fake) “calendar” button in your app? If 40% ofusers do, you should build it!• Test with segments• Try tests on nonpaying users if you don’t want to scare off paying users• Talk to customers (constantly)• UserVoice
  35. 35. Thank you!Evan HamiltonHead of Community, UserVoice@evanhamilton

×