SlideShare a Scribd company logo
1 of 17
Jason Evanish
Product, KISSmetrics
Kickass Products Meetup
April 24, 2013
Source: “The Inconvenient Truth About Product”, March 17, 2013
404 Tests
Source: scapromotions.com
Source: MakeCheckThink Blog, August 25, 2012
Source: “Value Creation vs. Value Capture”, April 21, 2013
Product Experiments

More Related Content

More from Jason Evanish

Everything you need to know about 1 on 1s to prevent turnover and motivate yo...
Everything you need to know about 1 on 1s to prevent turnover and motivate yo...Everything you need to know about 1 on 1s to prevent turnover and motivate yo...
Everything you need to know about 1 on 1s to prevent turnover and motivate yo...Jason Evanish
 
The First 2 Steps to the Epiphany: Customer Discovery, Customer Validation an...
The First 2 Steps to the Epiphany: Customer Discovery, Customer Validation an...The First 2 Steps to the Epiphany: Customer Discovery, Customer Validation an...
The First 2 Steps to the Epiphany: Customer Discovery, Customer Validation an...Jason Evanish
 
10 Things They Don't Teach You in College About Entrepreneurship
10 Things They Don't Teach You in College About Entrepreneurship10 Things They Don't Teach You in College About Entrepreneurship
10 Things They Don't Teach You in College About EntrepreneurshipJason Evanish
 
Getting to Product Market Fit - An Overview of Customer Discovery & Validation
Getting to Product Market Fit - An Overview of Customer Discovery & ValidationGetting to Product Market Fit - An Overview of Customer Discovery & Validation
Getting to Product Market Fit - An Overview of Customer Discovery & ValidationJason Evanish
 
A Greenhorn's Journey - Social Entrepreneur Edition
A Greenhorn's Journey - Social Entrepreneur EditionA Greenhorn's Journey - Social Entrepreneur Edition
A Greenhorn's Journey - Social Entrepreneur EditionJason Evanish
 
Greenhorn Connect: Advice on Partnerships for Startups
Greenhorn Connect: Advice on Partnerships for StartupsGreenhorn Connect: Advice on Partnerships for Startups
Greenhorn Connect: Advice on Partnerships for StartupsJason Evanish
 
The Boston Entrepreneur Ecosystem: Presentation at Northeastern University
The Boston Entrepreneur Ecosystem: Presentation at Northeastern UniversityThe Boston Entrepreneur Ecosystem: Presentation at Northeastern University
The Boston Entrepreneur Ecosystem: Presentation at Northeastern UniversityJason Evanish
 
The Entrepreneur Road
The Entrepreneur RoadThe Entrepreneur Road
The Entrepreneur RoadJason Evanish
 
GreenhornTV Ep. 45 for Oct 10th to Oct 16th
GreenhornTV Ep. 45 for Oct 10th to Oct 16thGreenhornTV Ep. 45 for Oct 10th to Oct 16th
GreenhornTV Ep. 45 for Oct 10th to Oct 16thJason Evanish
 
How to make the most of startup weekend
How to make the most of startup weekendHow to make the most of startup weekend
How to make the most of startup weekendJason Evanish
 
A Greenhorn's Journey
A Greenhorn's JourneyA Greenhorn's Journey
A Greenhorn's JourneyJason Evanish
 

More from Jason Evanish (12)

Everything you need to know about 1 on 1s to prevent turnover and motivate yo...
Everything you need to know about 1 on 1s to prevent turnover and motivate yo...Everything you need to know about 1 on 1s to prevent turnover and motivate yo...
Everything you need to know about 1 on 1s to prevent turnover and motivate yo...
 
The First 2 Steps to the Epiphany: Customer Discovery, Customer Validation an...
The First 2 Steps to the Epiphany: Customer Discovery, Customer Validation an...The First 2 Steps to the Epiphany: Customer Discovery, Customer Validation an...
The First 2 Steps to the Epiphany: Customer Discovery, Customer Validation an...
 
10 Things They Don't Teach You in College About Entrepreneurship
10 Things They Don't Teach You in College About Entrepreneurship10 Things They Don't Teach You in College About Entrepreneurship
10 Things They Don't Teach You in College About Entrepreneurship
 
Getting to Product Market Fit - An Overview of Customer Discovery & Validation
Getting to Product Market Fit - An Overview of Customer Discovery & ValidationGetting to Product Market Fit - An Overview of Customer Discovery & Validation
Getting to Product Market Fit - An Overview of Customer Discovery & Validation
 
Lean startup 101
Lean startup 101Lean startup 101
Lean startup 101
 
A Greenhorn's Journey - Social Entrepreneur Edition
A Greenhorn's Journey - Social Entrepreneur EditionA Greenhorn's Journey - Social Entrepreneur Edition
A Greenhorn's Journey - Social Entrepreneur Edition
 
Greenhorn Connect: Advice on Partnerships for Startups
Greenhorn Connect: Advice on Partnerships for StartupsGreenhorn Connect: Advice on Partnerships for Startups
Greenhorn Connect: Advice on Partnerships for Startups
 
The Boston Entrepreneur Ecosystem: Presentation at Northeastern University
The Boston Entrepreneur Ecosystem: Presentation at Northeastern UniversityThe Boston Entrepreneur Ecosystem: Presentation at Northeastern University
The Boston Entrepreneur Ecosystem: Presentation at Northeastern University
 
The Entrepreneur Road
The Entrepreneur RoadThe Entrepreneur Road
The Entrepreneur Road
 
GreenhornTV Ep. 45 for Oct 10th to Oct 16th
GreenhornTV Ep. 45 for Oct 10th to Oct 16thGreenhornTV Ep. 45 for Oct 10th to Oct 16th
GreenhornTV Ep. 45 for Oct 10th to Oct 16th
 
How to make the most of startup weekend
How to make the most of startup weekendHow to make the most of startup weekend
How to make the most of startup weekend
 
A Greenhorn's Journey
A Greenhorn's JourneyA Greenhorn's Journey
A Greenhorn's Journey
 

Recently uploaded

SQL Database Design For Developers at php[tek] 2024
SQL Database Design For Developers at php[tek] 2024SQL Database Design For Developers at php[tek] 2024
SQL Database Design For Developers at php[tek] 2024Scott Keck-Warren
 
#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024BookNet Canada
 
AI as an Interface for Commercial Buildings
AI as an Interface for Commercial BuildingsAI as an Interface for Commercial Buildings
AI as an Interface for Commercial BuildingsMemoori
 
Unblocking The Main Thread Solving ANRs and Frozen Frames
Unblocking The Main Thread Solving ANRs and Frozen FramesUnblocking The Main Thread Solving ANRs and Frozen Frames
Unblocking The Main Thread Solving ANRs and Frozen FramesSinan KOZAK
 
FULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | Delhi
FULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | DelhiFULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | Delhi
FULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | Delhisoniya singh
 
Hyderabad Call Girls Khairatabad ✨ 7001305949 ✨ Cheap Price Your Budget
Hyderabad Call Girls Khairatabad ✨ 7001305949 ✨ Cheap Price Your BudgetHyderabad Call Girls Khairatabad ✨ 7001305949 ✨ Cheap Price Your Budget
Hyderabad Call Girls Khairatabad ✨ 7001305949 ✨ Cheap Price Your BudgetEnjoy Anytime
 
Understanding the Laravel MVC Architecture
Understanding the Laravel MVC ArchitectureUnderstanding the Laravel MVC Architecture
Understanding the Laravel MVC ArchitecturePixlogix Infotech
 
The Codex of Business Writing Software for Real-World Solutions 2.pptx
The Codex of Business Writing Software for Real-World Solutions 2.pptxThe Codex of Business Writing Software for Real-World Solutions 2.pptx
The Codex of Business Writing Software for Real-World Solutions 2.pptxMalak Abu Hammad
 
Pigging Solutions Piggable Sweeping Elbows
Pigging Solutions Piggable Sweeping ElbowsPigging Solutions Piggable Sweeping Elbows
Pigging Solutions Piggable Sweeping ElbowsPigging Solutions
 
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 3652toLead Limited
 
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmatics
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmaticsKotlin Multiplatform & Compose Multiplatform - Starter kit for pragmatics
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmaticscarlostorres15106
 
Breaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path MountBreaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path MountPuma Security, LLC
 
How to Remove Document Management Hurdles with X-Docs?
How to Remove Document Management Hurdles with X-Docs?How to Remove Document Management Hurdles with X-Docs?
How to Remove Document Management Hurdles with X-Docs?XfilesPro
 
Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...
Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...
Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...Neo4j
 
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure service
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure serviceWhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure service
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure servicePooja Nehwal
 
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...shyamraj55
 
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking MenDelhi Call girls
 
Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024BookNet Canada
 
How to convert PDF to text with Nanonets
How to convert PDF to text with NanonetsHow to convert PDF to text with Nanonets
How to convert PDF to text with Nanonetsnaman860154
 
Snow Chain-Integrated Tire for a Safe Drive on Winter Roads
Snow Chain-Integrated Tire for a Safe Drive on Winter RoadsSnow Chain-Integrated Tire for a Safe Drive on Winter Roads
Snow Chain-Integrated Tire for a Safe Drive on Winter RoadsHyundai Motor Group
 

Recently uploaded (20)

SQL Database Design For Developers at php[tek] 2024
SQL Database Design For Developers at php[tek] 2024SQL Database Design For Developers at php[tek] 2024
SQL Database Design For Developers at php[tek] 2024
 
#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
 
AI as an Interface for Commercial Buildings
AI as an Interface for Commercial BuildingsAI as an Interface for Commercial Buildings
AI as an Interface for Commercial Buildings
 
Unblocking The Main Thread Solving ANRs and Frozen Frames
Unblocking The Main Thread Solving ANRs and Frozen FramesUnblocking The Main Thread Solving ANRs and Frozen Frames
Unblocking The Main Thread Solving ANRs and Frozen Frames
 
FULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | Delhi
FULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | DelhiFULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | Delhi
FULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | Delhi
 
Hyderabad Call Girls Khairatabad ✨ 7001305949 ✨ Cheap Price Your Budget
Hyderabad Call Girls Khairatabad ✨ 7001305949 ✨ Cheap Price Your BudgetHyderabad Call Girls Khairatabad ✨ 7001305949 ✨ Cheap Price Your Budget
Hyderabad Call Girls Khairatabad ✨ 7001305949 ✨ Cheap Price Your Budget
 
Understanding the Laravel MVC Architecture
Understanding the Laravel MVC ArchitectureUnderstanding the Laravel MVC Architecture
Understanding the Laravel MVC Architecture
 
The Codex of Business Writing Software for Real-World Solutions 2.pptx
The Codex of Business Writing Software for Real-World Solutions 2.pptxThe Codex of Business Writing Software for Real-World Solutions 2.pptx
The Codex of Business Writing Software for Real-World Solutions 2.pptx
 
Pigging Solutions Piggable Sweeping Elbows
Pigging Solutions Piggable Sweeping ElbowsPigging Solutions Piggable Sweeping Elbows
Pigging Solutions Piggable Sweeping Elbows
 
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
 
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmatics
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmaticsKotlin Multiplatform & Compose Multiplatform - Starter kit for pragmatics
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmatics
 
Breaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path MountBreaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path Mount
 
How to Remove Document Management Hurdles with X-Docs?
How to Remove Document Management Hurdles with X-Docs?How to Remove Document Management Hurdles with X-Docs?
How to Remove Document Management Hurdles with X-Docs?
 
Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...
Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...
Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...
 
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure service
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure serviceWhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure service
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure service
 
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...
 
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
 
Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
 
How to convert PDF to text with Nanonets
How to convert PDF to text with NanonetsHow to convert PDF to text with Nanonets
How to convert PDF to text with Nanonets
 
Snow Chain-Integrated Tire for a Safe Drive on Winter Roads
Snow Chain-Integrated Tire for a Safe Drive on Winter RoadsSnow Chain-Integrated Tire for a Safe Drive on Winter Roads
Snow Chain-Integrated Tire for a Safe Drive on Winter Roads
 

Product Experiments

Editor's Notes

  1. So the more I thought about, the more I thought about Marty Cagan's post "The inconvenient truth about product" which basically says that every feature you build, even the stuff you launch is still an experiment and might fail.  Thinking that all product is an experiment got me thinking about framing my talk around that concept and the tools we use at KISSmetrics to try to succeed more than we fail on our "experiments". Let me know if that's off track from what you're getting from other panelists.
  2. This is great when you’re just starting out. Sell the value proposition. It’s less valuable once you have a product, but can often turn into your marketing site. This is great when you don't have a site yet. Once you have a product, less valuable. We're launching a mobile app (see myanalyticsapp.com) and used this and have thousands of sign ups
  3. Copy, color, flow, information on the page Good for: Marketing Site, on boarding.
  4. We don't do much of this because we love doing the next one...
  5. Validate what they need We ask our customers questions all the time
  6. We'll search parts of our user base to ask questions of them (use our own product's People Search for this) We always like to have already done some CustDev interviews to better inform the questions 10 open ended questions is a total fail. Have direct discussions if you don't know what to ask
  7. We don't like using these to share with customers bc most don't know how to imagine something will work in our experience
  8. Share with customers or potential ones a prototype so they can see how it actually works. This helps ourselves too. We test it on ourselves
  9. We have a feedback box on every page on the site. We get 50+ emails every week filled with passionate, frustrated, excited, confused users. The perfect group to experiment with. I'll go back to old ones to reach out about experiments or if they're asking about stuff we're currently thinking about I'll send it right away...they may be just the early adopter we want for such a feature.
  10. Turn on a feature for a customer with the check of a box, that way you only do it for a few people to get key feedback. Allows you to start getting feedback sooner as you manage the expectations of those seeing it
  11. We've been trying not to overbuild things lately and so that means often taking away as much as we can and focusing on releasing only the absolutely core problem. We've already found how that changes our priorities, while getting something out the door faster.
  12. I saw this post over the weekend an thought it hammered home what I hope you take away from today. There’s a lot of great tactics you can apply, but they’re all there just to deliver on on goal.