Everyone’s Customers Are Wrong and Their Data Is Lying

3,617 views
3,519 views

Published on

You can't trust your customers or your data. But a combination will yield amazing results. Originally presented at the Startup Product Summit.

Learn more about how UserVoice can help you understand your customers at http://www.uservoice.com

Photo credits:
WTH dude - http://www.flickr.com/photos/porphyria/3206687773/
Groupon data - http://techcrunch.com/2011/06/02/groupon-growth-2-6-billion-revenue-run-rate-charts/ & http://techcrunch.com/2012/11/08/groupons-q3-2012-earnings/
Crowd - http://www.flickr.com/photos/anirudhkoul/3786725982/in/photostream/
Boys - http://www.flickr.com/photos/mutrock/8259688450/in/photostream/
Prince - http://ryanhoover.me/post/43545454717/test-something-crazy

Published in: Technology
0 Comments
2 Likes
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total views
3,617
On SlideShare
0
From Embeds
0
Number of Embeds
2,510
Actions
Shares
0
Downloads
5
Comments
0
Likes
2
Embeds 0
No embeds

No notes for slide

Everyone’s Customers Are Wrong and Their Data Is Lying

  1. 1. Everyone’s Customers Are Wrong and Their Data Is Lying Evan Hamilton Head of Community, UserVoice
  2. 2. DATA!Big Data! Social Data! Mobile Data! It’s the future!
  3. 3. Actually...Data doesn’t tell the whole story.
  4. 4. Data doesn’t tell the whole story.A/B test: will this carousel increase clicks? ^ incredibly ugly
  5. 5. Data doesn’t tell the whole story.“Hey, look! The version of the page with the carousel is making more people click through!”
  6. 6. Data doesn’t tell the whole story.“Oh wait...it’s making more people click, not actually convert.” Tricky data at work!
  7. 7. Data doesn’t tell the whole story. We created confusion, not conversions.
  8. 8. Data doesn’t tell the whole story.
  9. 9. Data doesn’t tell the whole story. Hey, that looks good!
  10. 10. Data doesn’t tell the whole story.Oops. They “forgot” to report refunds (amongst other things.)
  11. 11. PEOPLE! Feelings! Empathy! Gut! It’s the only way!
  12. 12. Actually...People don’t tell the whole story.
  13. 13. People don’t tell the whole story.“Wow, maybe we should build this. Let’s ask for more feedback first...”
  14. 14. People don’t tell the whole story.Oh. So they want this feature because they’re not responding to customers. Next.
  15. 15. There’s always more context.• What is the pain point?• Are these paying users? Freeloaders?• Are these people using your product in the intended way? • (We had someone using our forum to name their baby. Cute, but not our target market.)• Are they using your main features?• Early “adopters”? • (Robert Scoble is not your target market. He is fickle.)
  16. 16. People don’t tell the whole story. “Makes sense, let’s build it!”
  17. 17. People don’t tell the whole story.But customers found this confusing. (And it made us throw up in our mouths a little bit.)
  18. 18. People don’t tell the whole story.“Yet another online identity” is what we should have focused on.
  19. 19. People don’t tell the whole story. v2 No password. No signup. No registration.Solved the problem without a complicated sign-in process.
  20. 20. Customers often give you bad solutions to real problems.(Don’t misinterpret this as good solutions or not real problems.)
  21. 21. Everything is wrong. Now what?
  22. 22. Data still has to be interpreted.
  23. 23. Data still has to be interpreted.Requests can lead you astray.
  24. 24. Data still has to be interpreted. Requests can lead you astray.Combine data + customer stories.
  25. 25. Combine data + customer stories.Back when we just had UserVoice Feedback, we’d loselots of customers after 1 year. So we asked them why they were leaving.
  26. 26. Turns out they were growing up. New staff, newdepartment heads...& feedback forums didn’t have a definitive place in the organization.
  27. 27. So we built a customer service tool into our product. Notwhat we necessarily planned to build...but what customers wanted.
  28. 28. It increased retention immensely. We now have a place in the organization.We got here because data alerted us to something, & user stories filled out the details.
  29. 29. Don’t get lost in the data rat-hole.
  30. 30. Don’t get lost in the data rat-hole.Don’t chase 1% when you can get 15%.
  31. 31. Don’t get lost in the data rat-hole.Don’t chase 1% when you can get 15%. Don’t get lost in minor homepage optimization.
  32. 32. You’ll never know what you could get unless you try something crazy.
  33. 33. Tried this yet? If not, go do thatbefore trying another shade of blue.
  34. 34. Tips, tricks, and tools• (At least) Google Analytics • Hell, even Bit.ly links give you a basis to work from• Mixpanel• The ol’ fake button • How many people click a (fake) “calendar” button in your app? If 40% of users do, you should build it!• Test with segments • Try tests on nonpaying users if you don’t want to scare off paying users• Talk to customers (constantly)• UserVoice
  35. 35. Thank you! Evan HamiltonHead of Community, UserVoice @evanhamilton

×