Lean Experiments with Lean Expectations—Product Camp Cascadia 2021

Lean
Experiments
with Lean
Expectations
Lena Sesardic
Product Camp Cascadia 2021
March 6, 2021 10AM PST

What you'll get out of this talk:
How to build less of the wrong products by running lean
experiments.
FOUR types of lean experiments through FIVE real-life
examples.
The importance of lean expectations in staying objective.
When to walk away from an idea.

Lena Sesardic
7 yrs startups/startup-like teams (3.5 yrs PM).
Entrepreneur, Creator & Writer.
Mentor & advise venture teams.
Author of The Making of Product Managers.
I write on lenasesardic.com & for Product
Coalition & The Startup on Medium.

Think in experiments, not products.
What is the quickest way to test an idea?
Riskiest assumptions.
Hypothesis (specific, measurable, disprovable, time-bound).
Expected outcome—stay objective & accountable.

Divorce yourself from your idea
9/10 startups fail.
Even more product features fail.
Most experiments fail.
Failed experiments = learning.

Lean experiments
Few days/weeks to run.
Test a specific hypothesis.
Quantitative/qualitative data as feedback.
Prioritize learning.

Wizard of Oz method
Lean Experiment #1

Humans simulate a functioning product without the
use of technology & without the user's knowledge.
Wizard of Oz method

Real-life Example: Veni
Resource: Veni.ca

1. Simple landing page for customers submit orders through.
Resource: Veni.ca

2. Place orders with restaurants on the day manually.
Resource: Veni.ca

3. Deliver all meals manually.
Resource: Veni.ca

Spent $25.
Batching meal orders is valuable to restaurants.
Collected feedback on the customer experience.
Going forward: Wizard of Oz + landing page analytics
Results:
Resource: Veni.ca

Pros & Cons: Wizard of Oz method
No need to build
technology.
Quick to ship.
High-touch service =
learning opportunity.
Easy to pivot.
Requires manual work.
Have to build product
eventually.
May not be polished.
May not be possible for
all product concepts.

Fake Door Demand Test
Lean Experiment #2

Fake Door Demand Test
Fake the existence of a product & measure the
actions users take.

Real-life Example: Kettle & Fire
Resource: How I validated my idea for Kettle & Fire by Justin Mares.

1. Keyword search & trend analysis.

2. Simple landing page with "Order Bone Broth Now!" button &
$50 worth of Bing ads.

3. Redirected to "PayPall $29.99 to xxxxxx@gmail.com."

7814 2384 30.51%
Visitors Conversions Conversion rate
Results:

4. Out of stock follow-up email.

Real-life Example: Customer Camp
Resource: Customer Camp.

1. "GET CERTIFIED" fake door.

2. Popup to join waitlist.

3. Customer discovery interview.

Quantitative data: waitlist sign-ups.
Customer discovery interviews w/ interested parties.
Qualitative data >> deep insights.
Connections with potential future customers.
Results:

Pros & Cons: Fake Door Demand Test
Quick to ship landing
page/button.
No need to create or
source product.
Quantitative/qualitative
data for analysis.
Scalable (landing
pages/button).
Paid ads expensive &
require expertise.
False negatives due to
poor UX/ad copy or choice
of ad platform.
Potentially frustrated
customers (use sparingly).

Cold Outreach
Lean Experiment #3

Cold Outreach
Contact people who haven't previously
expressed an interest in the products or
services you're offering.

Real-life Example: Scheduling App X

1. Clickable prototype of what app would look like.

100+ leads for each of 5 niche industries.
2.

5 cold email campaign to the 5 niche industries with clickable
prototype included.
3.

Identified 2 niche industries with highest demand (carpet
cleaning & painting).
50 early customers with signed Letters of Intent (LOIs).
Results:

Pros & Cons: Cold Outreach
Quick to ship.
data for analysis.
Scalable (cold emails).
Some lead generation can be
time-consuming & expensive.
False negatives due to poor
email copy or cold calling.
Easy to pivot.
False negatives due to poorly
formed value prop.

Inchworm Medley
Lean Experiment #4

Inchworm Medley
Gauge interest on for a product or service on
social media
+
set up pre-orders to validate willingness to pay.

Real-life Example: Lean SEO Course
Resource: Starter Story

1. Gauged interest with a tweet & blog post.

2. Positive qualitative feedback & insight into customer pains.

3. Gauge product format with a tweet.

4. Pre-orders to validate willingness to pay.

$2,054 in presales in 2 weeks.
$30k in sales within 2 months.
Results:

Pros & Cons: Inchworm Medley
Multiple checkpoints for
validation.
Builds community.
No need to create or
source product right
away.
data for analysis.
More effective with an existing
audience & credibility.
May be difficult to back out of
(social reputation).
Risk of someone stealing
your idea.

Recap of Lean Experiments
#1 Wizard of Oz method #2 Fake door demand test
#3 Cold outreach #4 Inchworm medley

Walking Away From an Idea
Pre-desired outcomes are not met.
We tend to see what we want to see.
Exceptions are rare.

The Value of Lean Experiments
Speed.
Learning.
Hidden ROI.

Thank you!
in/lenasesardic
@LenaSesardic
lenasesardic.com
hello@lenasesardic.com

Lean Experiments with Lean Expectations—Product Camp Cascadia 2021

Lean Experiments with Lean Expectations—Product Camp Cascadia 2021

Recommended

More Related Content

What's hot

What's hot(20)

Similar to Lean Experiments with Lean Expectations—Product Camp Cascadia 2021

Similar to Lean Experiments with Lean Expectations—Product Camp Cascadia 2021(20)

Recently uploaded

Recently uploaded(20)

Lean Experiments with Lean Expectations—Product Camp Cascadia 2021