What do you want to learn? …
What do you want to learn?
Lean Analytics Cycle AVINASH KAUSHIK HTTP://KISS.LY/LEANAC
Lean is all about identifying and quantifying risk.
Don’t just ask questions.
Know what decisions you can make from these surveys.
Lean Analytics Cycle AVINASH KAUSHIK HTTP://KISS.LY/LEANAC This is where we survey
1. Keep surveys short ! Under 5 minutes is ideal
Survey Monkey: Does Adding One More Question Impact Survey Completion Rate?
40% is awesome ! 30% is great ! 20% is good ! ~15% is expected !
What We See In Practice
Longer Surveys Decrease Completion Rates
A 5 Question Screener That I Did Recently
14% CTR from Nudge to Screener ! 202 Responses in 7 days ! 202 Opt-Ins for further studies !
By the way… ! Satisfaction surveys see 10% or lower response rates
2. Start broad then get detailed ! Satisfaction -> speciﬁcs
How satisﬁed are you?
What is your primary motivation?
What best describes why you came here today?
What is your experience with using X?
How satisﬁed are you with X/Y/Z?
3. Ask what you need to know ! Avoid what’s nice to know
What do you want to learn?
What are you going to DO with this survey data?
It’s easy to let additional questions creep up. Resist the urge!
4. Avoid hypothetical questions
Would you buy X if we oﬀered it?
Instead, ask people about their CURRENT experience, frustrations, or workarounds to their problem.
5. Test survey internally
Startups have smaller customer counts. Surveying multiple times gets interpreted as spam.
Dry runs with your team are a great way to check if anything is confusing.
3 Ways to Get Surveys In Front of People 2
1. Email !
Apple ’s satisfaction survey uses plain text for simplicity
General Assembly’s HTML emails look too automated
Plain text works best. ! Looks like a real person wrote it.
2. In-App Opt-In !
Google Has Dedicated Usability Opt Ins
Twitter Integrates In-App Opt-In Into Their Apps
Target Opt-Ins Based On People’s Behavior To Increase Chances of Response
2. In-App Pop-up !
GQ Asks about Subscription Friction
Logitech Asks for Use Cases
3 Strategies for Segmenting Survey Results 3
Demographic segmentation is the norm, but only if it actually helps.
1. Platform !
Segmenting by Device Type
Another Example of Segmenting by Device Type
2. Time of Survey Response !
Segmenting by Time Survey Was Completed
Zendesk Uses Time of Survey To Send Surveys At Times That Have Higher Response Rates
Zendesk Figured Out “Not Work Hours” Worked Best
3. Cross-Reference with Analytics !
Cross Reference Analytics Data with Survey Data to Get the Whole Picture
Features used / products bought ! Frequency of visits !
Our Favorite Tools and Workﬂows 4
Research Tools of the Trade Our toolkit for getting survey’s done.
Book Resource: Improving Survey Questions: Design and Evaluation