SlideShare a Scribd company logo
1 of 13
Download to read offline
What is Design for Delight?
Intuit’s #1 Core Capability
“Design for Delight” is about evoking
positive emotion throughout the customer
journey, by going beyond customer
expectations in delivering awesome product
experiences that people want to tell the
world about. Design for Delight principles
are practiced throughout the company, and
have become Intuit’s #1 core capability.
Customer-Driven Innovation
Intuit’s Innovation Framework
We afford our employees the autonomy to
tap into their own passions to delight
customers and grow the company. We
encourage our employees to know our
customers - watch them, listen to them, visit
their homes and workplaces - so they can
discover and solve important problems for
our customers.
with durable
advantage
find an
important
problem
that we and
those we enable
can solve well
Your
Challenge
“Make New York Happy”
Learn the principles of rapid
experimentation by running
experiments on the streets of
New York City.
Why Experiments?
We use rapid experiments to quickly test the
merit of our ideas, and generate new insights
about our customers. By testing ideas using
real customer behavior, we quickly separate
what customers say, from what they actually
do in the real world.
Experiment to learn, not validate
• Change opinions into facts
• Prove or disprove our assumptions
• Discover surprises about our customer
• Make more informed decisions
• Use data to help tell our story
How to Experiment?
First, document a bold vision for which you
will attempt to create an idea customers
love. Next, make your idea tangible by listing
your 1) customer 2) problem 3) solution.
Next, run experiments with real customers
using the “experiment loop”. Run multiple
“experiment loops” until you have
determined if your idea is viable (or not).
Rigor Inspiration
Rapid Experiments idea
13
2
vision
Rapid Experiment Loop
1. Leap of Faith Assumption (LOF)
Your LOF is the most important behavior
that must be true for your idea to work. You
assume it to be true, but have not yet
proven this assumption with evidence.
“Participants will run experiments”
2. Build Experiments
Build the absolute minimum required to test
your assumption. Document a hypothesis
and minimum success criteria, and be sure
to measure real customer behavior.
“If we do X, Y% of customers
will behave in way Z”
3. Learn & Decide
Review metrics from your experiment, and
the surprises you observed. Discuss why
your hypothesis passed or failed, and new
customer insights you discovered. Decide if
you will change your idea (pivot), continue
(persevere), or run additional experiments.
“Pivot - the experiment failed”
Ready, Set, Go!
Go run your experiment with real customers
on the streets of NYC. Yes, outside!
00:10 Find a suitable location
00:05 Set up your experiment
00:20 Run your experiment!
00:10 Return to Master Class location
NOTE: You must be back in :45
Tips...
• Assign 1 person at a time to be the “re-
corder”, switch every 8 minutes.
• Record exactly what happens, in detail.
• Learn “why or why not” - savor surprises.
• Be neutral, avoid confirmation bias.
• Don’t do anything disrespectful or illegal.
• Take pictures, ask for feedback.
1 Hopscotch to Go
Insights: People are more willing to try
something fun if they see others doing it.
Vision: Moments of fun on the go
Idea: For busy New Yorkers on the go, create a
quick game they can play on the street.
LOF: People will take time to play quick games
Hypothesis: If we create a hopscotch game on
the street, 25% of passers by will play the game.
Experiment: Using the chalk provided, create a
hopscotch game on the sidewalk. Start playing
the game, and see how many others join you.
The game should be simple and quick to play.
Behavior:
Minimum Success Criteria:
Experiment Notes
Metrics:
Observations:
2 Airplane Competition
Insights: People are more willing to try
something fun if it’s a competition.
Vision: Moments of fun on the go
Idea: For busy New Yorkers on the go, create a
quick competition between players.
LOF: People will take time to join a competition.
Hypothesis: If we create a quick competition,
25% of passers by will join the competition.
Experiment: Set up a paper airplane contest on
the streets of NYC, where participants are asked
to create and fly an airplane of their own design.
Consider using time aloft or distance as the
measure, or come up with your own ideas if you
prefer. Use the paper and materials provided.
Behavior:
Minimum Success Criteria:
Experiment Notes
Metrics:
Observations:
3 Funny Walkers
Insights: People are willing to do something fun
if the effort is minimal.
Vision: Moments of fun on the go
Idea: For busy New Yorkers on the go, create a
fun experience which can be played as they walk.
LOF: People are willing to look silly in public
Hypothesis: If we start “walking funny”, 25% of
passers by join us in walking funny.
Experiment: Begin a “funny walkers” line at one
end of any city block, then walk to the other end
of the block. Attempt to get others to join you,
repeating the funny walk.
Behavior:
Minimum Success Criteria:
Experiment Notes
Metrics:
Observations:
Pay it Forward
Insights: People are inherently generous,
especially when they see others being generous.
Vision: Moments of generosity on the go
Idea: For busy New Yorkers, help them take part
in random acts of generosity.
LOF: People are generous if given the chance
Hypothesis: If we create an opportunity to be
generous, 50% of people will take advantage of
this opportunity.
Experiment: Visit a local coffee shop and wait in
line to purchase coffee. When paying, offer to
pay for the coffee of the person behind you. Ask
this person to “pay it forward” by buying coffee
for next person in line. See how many people in
line continue the “pay it forward” process.
Behavior:
Minimum Success Criteria:
Experiment Notes
Metrics:
Observations:
4
5 Wallet Drop
Insights: People are inherently good, and will do
the right thing if given the chance publicly.
Vision: Moments of kindness on the go
Idea: For busy New Yorkers provide an
opportunity to help another person.
LOF: People will do the right thing and help.
Hypothesis: If we create an opportunity to help
someone, 75% of people will help.
Experiment: As you walk, drop a fake wallet on
the street in a manner that others will notice. See
how many people alert you to the fact you
dropped the wallet. Be sure to make it obvious to
passers by that your wallet has been dropped.
Behavior:
Minimum Success Criteria:
Experiment Notes
Metrics:
Observations:
Learn & Decide
Results: Why did your experiment pass or fail?
New Insights: What is your biggest surprise?
Make a decision: What will you do next?
Pivot
(change direction significantly)
Persevere
(continue, we’re onto something big)
Iterate
(try again with a few minor tweaks)
Update Idea: How will your idea evolve?
NotesNow What?
“The secret to getting ahead, is getting
started.” - Mark Twain
There’s no better time than the present to
lead the charge in your organization. Don’t
ask permission, just get started!
How to Lead with Experimentation:
1. Champion a grand vision.
Grand visions are ambitious, tangible and
memorable, and focused on your customer
(not on you or your business).
2. Install systems & culture to enable
rapid experimentation.
Make experimentation easy for everyone in
your organization.
3. Pull insights from success and failure.
Savor the surprises from your experiments,
both positive and negative.
4. Live by the same rules yourself.
Recognize your idea is just one idea. Can
your team find even better ideas?
Thank You!
Thanks for joining us today, and
your willingness to get outside
your comfort zone.
For more information regarding Intuit, or to
search for design related career
opportunities, please visit us at:
http://careers.intuit.com

More Related Content

What's hot

Lean startup - what is pivot
Lean startup - what is pivotLean startup - what is pivot
Lean startup - what is pivot
Yuki Sekiguchi
 
Design Thinking: The one thing that will transform the way you think
Design Thinking: The one thing that will transform the way you thinkDesign Thinking: The one thing that will transform the way you think
Design Thinking: The one thing that will transform the way you think
Digital Surgeons
 

What's hot (20)

MIT HMS Healthcare Innovation Bootcamp: Ideation Workshop
MIT HMS Healthcare Innovation Bootcamp: Ideation WorkshopMIT HMS Healthcare Innovation Bootcamp: Ideation Workshop
MIT HMS Healthcare Innovation Bootcamp: Ideation Workshop
 
Story writing and mapping.pdf
Story writing and mapping.pdfStory writing and mapping.pdf
Story writing and mapping.pdf
 
Ic ws-2-design-thinking-ppt
Ic ws-2-design-thinking-pptIc ws-2-design-thinking-ppt
Ic ws-2-design-thinking-ppt
 
Introduction to Design Thinking Workshop
Introduction to Design Thinking WorkshopIntroduction to Design Thinking Workshop
Introduction to Design Thinking Workshop
 
Getting to Product Market Fit - An Overview of Customer Discovery & Validation
Getting to Product Market Fit - An Overview of Customer Discovery & ValidationGetting to Product Market Fit - An Overview of Customer Discovery & Validation
Getting to Product Market Fit - An Overview of Customer Discovery & Validation
 
Design thinking
Design thinkingDesign thinking
Design thinking
 
What mindset is needed for Design Thinking?
What mindset is needed for Design Thinking?What mindset is needed for Design Thinking?
What mindset is needed for Design Thinking?
 
Teresa Torres - An introduction to modern product discovery - Productized16
Teresa Torres - An introduction to modern product discovery - Productized16Teresa Torres - An introduction to modern product discovery - Productized16
Teresa Torres - An introduction to modern product discovery - Productized16
 
Design Thinking
Design ThinkingDesign Thinking
Design Thinking
 
UX Design - Client presentation
UX Design - Client presentationUX Design - Client presentation
UX Design - Client presentation
 
Ideation Workshop
Ideation WorkshopIdeation Workshop
Ideation Workshop
 
Users' Story: UX Storyboarding
Users' Story: UX StoryboardingUsers' Story: UX Storyboarding
Users' Story: UX Storyboarding
 
Design Thinking in Solving Problem - HCMC Scrum Breakfast - July 27, 2019
Design Thinking in Solving Problem - HCMC Scrum Breakfast - July 27, 2019Design Thinking in Solving Problem - HCMC Scrum Breakfast - July 27, 2019
Design Thinking in Solving Problem - HCMC Scrum Breakfast - July 27, 2019
 
The role of Design Thinking
The role of Design ThinkingThe role of Design Thinking
The role of Design Thinking
 
10 steps to product/market fit
10 steps to product/market fit10 steps to product/market fit
10 steps to product/market fit
 
Lean startup - what is pivot
Lean startup - what is pivotLean startup - what is pivot
Lean startup - what is pivot
 
How to think like a startup
How to think like a startupHow to think like a startup
How to think like a startup
 
The Art & Science of Growth Hacking
The Art & Science of Growth HackingThe Art & Science of Growth Hacking
The Art & Science of Growth Hacking
 
Design thinking
Design thinkingDesign thinking
Design thinking
 
Design Thinking: The one thing that will transform the way you think
Design Thinking: The one thing that will transform the way you thinkDesign Thinking: The one thing that will transform the way you think
Design Thinking: The one thing that will transform the way you think
 

Viewers also liked

ROI Marketing and Advertising Your Web Presence (Inbound)
ROI Marketing and Advertising Your Web Presence (Inbound)ROI Marketing and Advertising Your Web Presence (Inbound)
ROI Marketing and Advertising Your Web Presence (Inbound)
Modgility
 
Going global - Clarks European ecommerce
Going global - Clarks European ecommerceGoing global - Clarks European ecommerce
Going global - Clarks European ecommerce
Practicology
 

Viewers also liked (20)

Design for Delight - The Innovation Catalysts
Design for Delight - The Innovation CatalystsDesign for Delight - The Innovation Catalysts
Design for Delight - The Innovation Catalysts
 
Intuit Immersion Workbook: Design with Emotion
Intuit Immersion Workbook: Design with Emotion Intuit Immersion Workbook: Design with Emotion
Intuit Immersion Workbook: Design with Emotion
 
Catalyst - An Intuit Innovation Experience
Catalyst - An Intuit Innovation ExperienceCatalyst - An Intuit Innovation Experience
Catalyst - An Intuit Innovation Experience
 
Delight 2015 | Getting Design for Delight Into Your Organizational DNA
Delight 2015 | Getting Design for Delight Into Your Organizational DNADelight 2015 | Getting Design for Delight Into Your Organizational DNA
Delight 2015 | Getting Design for Delight Into Your Organizational DNA
 
D4D Tools - The NEXT Tool
D4D Tools - The NEXT ToolD4D Tools - The NEXT Tool
D4D Tools - The NEXT Tool
 
From Design Thinking to Design Doing
From Design Thinking to Design Doing From Design Thinking to Design Doing
From Design Thinking to Design Doing
 
Intuit Overview January 2017
Intuit Overview January 2017Intuit Overview January 2017
Intuit Overview January 2017
 
D4D Tools: Empathy Map
D4D Tools: Empathy MapD4D Tools: Empathy Map
D4D Tools: Empathy Map
 
Snap Messaging Tools
Snap Messaging ToolsSnap Messaging Tools
Snap Messaging Tools
 
Intuit Investor Presentation November 2016
Intuit Investor Presentation November 2016Intuit Investor Presentation November 2016
Intuit Investor Presentation November 2016
 
ROI Marketing and Advertising Your Web Presence (Inbound)
ROI Marketing and Advertising Your Web Presence (Inbound)ROI Marketing and Advertising Your Web Presence (Inbound)
ROI Marketing and Advertising Your Web Presence (Inbound)
 
7 Learnings About Call Conversions (From 7 Marketing Leaders)
7 Learnings About Call Conversions (From 7 Marketing Leaders)7 Learnings About Call Conversions (From 7 Marketing Leaders)
7 Learnings About Call Conversions (From 7 Marketing Leaders)
 
TKG.com's Content Ideation Breakfast Bootcamp
TKG.com's Content Ideation Breakfast BootcampTKG.com's Content Ideation Breakfast Bootcamp
TKG.com's Content Ideation Breakfast Bootcamp
 
Improve Advertising ROI Using Call Tracking
Improve Advertising ROI Using Call TrackingImprove Advertising ROI Using Call Tracking
Improve Advertising ROI Using Call Tracking
 
DialogTech Digital Summit: Embracing Conversations in a Digital Landscape
DialogTech Digital Summit: Embracing Conversations in a Digital LandscapeDialogTech Digital Summit: Embracing Conversations in a Digital Landscape
DialogTech Digital Summit: Embracing Conversations in a Digital Landscape
 
Beyond Ideas: Prototyping and Rapid Experimentation
Beyond Ideas: Prototyping and Rapid ExperimentationBeyond Ideas: Prototyping and Rapid Experimentation
Beyond Ideas: Prototyping and Rapid Experimentation
 
Going global - Clarks European ecommerce
Going global - Clarks European ecommerceGoing global - Clarks European ecommerce
Going global - Clarks European ecommerce
 
How to Use Content for eCommerce Marketing
How to Use Content for eCommerce MarketingHow to Use Content for eCommerce Marketing
How to Use Content for eCommerce Marketing
 
Social Drink-Up ! #8 - BlaBlaCar, from desktop to mobile first - Laure Wagner
Social Drink-Up ! #8 - BlaBlaCar, from desktop to mobile first - Laure WagnerSocial Drink-Up ! #8 - BlaBlaCar, from desktop to mobile first - Laure Wagner
Social Drink-Up ! #8 - BlaBlaCar, from desktop to mobile first - Laure Wagner
 
How Retail Marketers can Boost Their Facebook Advertising ROI in 2016
How Retail Marketers can Boost Their Facebook Advertising ROI in 2016How Retail Marketers can Boost Their Facebook Advertising ROI in 2016
How Retail Marketers can Boost Their Facebook Advertising ROI in 2016
 

Similar to Field Guide to Rapid Experimentation

Similar to Field Guide to Rapid Experimentation (20)

Making Ideas Happen workshop for Vicsport
Making Ideas Happen workshop for VicsportMaking Ideas Happen workshop for Vicsport
Making Ideas Happen workshop for Vicsport
 
Lean Customer Discovery Needs Deep Empathy
Lean Customer Discovery Needs Deep Empathy Lean Customer Discovery Needs Deep Empathy
Lean Customer Discovery Needs Deep Empathy
 
Immerse, Imagine, Invent, Articulate: A framework for disruptive innovation
Immerse, Imagine, Invent, Articulate: A framework for disruptive innovationImmerse, Imagine, Invent, Articulate: A framework for disruptive innovation
Immerse, Imagine, Invent, Articulate: A framework for disruptive innovation
 
Imperial experiments session
Imperial experiments sessionImperial experiments session
Imperial experiments session
 
How to Choose Your Next Experiments
How to Choose Your Next ExperimentsHow to Choose Your Next Experiments
How to Choose Your Next Experiments
 
SheSummits 2016 program
SheSummits 2016 programSheSummits 2016 program
SheSummits 2016 program
 
SheSummits 2016 Program
SheSummits 2016 ProgramSheSummits 2016 Program
SheSummits 2016 Program
 
SheSummits 2016 Program
SheSummits 2016 ProgramSheSummits 2016 Program
SheSummits 2016 Program
 
Lean NYU ITP Class 2 2.9.2015
Lean NYU ITP Class 2 2.9.2015Lean NYU ITP Class 2 2.9.2015
Lean NYU ITP Class 2 2.9.2015
 
Lean NYU ITP Class 2 2.9.2015
Lean NYU ITP Class 2 2.9.2015Lean NYU ITP Class 2 2.9.2015
Lean NYU ITP Class 2 2.9.2015
 
Validating Ideas with Users
Validating Ideas with UsersValidating Ideas with Users
Validating Ideas with Users
 
UXSG2014 Workshop (Day 1) - Lean Startup (Bryan Long)
UXSG2014 Workshop (Day 1) - Lean Startup (Bryan Long)UXSG2014 Workshop (Day 1) - Lean Startup (Bryan Long)
UXSG2014 Workshop (Day 1) - Lean Startup (Bryan Long)
 
The Journey of Creativity
The Journey of CreativityThe Journey of Creativity
The Journey of Creativity
 
Chinaccelerator 10x10 Spring 2014 Shanghai
Chinaccelerator 10x10 Spring 2014 ShanghaiChinaccelerator 10x10 Spring 2014 Shanghai
Chinaccelerator 10x10 Spring 2014 Shanghai
 
Don't let assumptions kill good ideas
Don't let assumptions kill good ideasDon't let assumptions kill good ideas
Don't let assumptions kill good ideas
 
Don't let assumptions kill good ideas
Don't let assumptions kill good ideasDon't let assumptions kill good ideas
Don't let assumptions kill good ideas
 
Innovation in Action workshop with Vicsport March 2015
Innovation in Action workshop with Vicsport March 2015Innovation in Action workshop with Vicsport March 2015
Innovation in Action workshop with Vicsport March 2015
 
Building a Minimum Viable Product
Building a Minimum Viable ProductBuilding a Minimum Viable Product
Building a Minimum Viable Product
 
Improve your product design with Game Thinking (UIE Webinar)
Improve your product design with Game Thinking (UIE Webinar)Improve your product design with Game Thinking (UIE Webinar)
Improve your product design with Game Thinking (UIE Webinar)
 
Focus fast bigd15_roger_belveal_2015-09-19
Focus fast bigd15_roger_belveal_2015-09-19Focus fast bigd15_roger_belveal_2015-09-19
Focus fast bigd15_roger_belveal_2015-09-19
 

More from Intuit Inc.

More from Intuit Inc. (20)

State of Small Business – Growth and Success Report
State of Small Business – Growth and Success ReportState of Small Business – Growth and Success Report
State of Small Business – Growth and Success Report
 
The State of Small Business Cash Flow
The State of Small Business Cash FlowThe State of Small Business Cash Flow
The State of Small Business Cash Flow
 
Small Business in the Age of AI
Small Business in the Age of AI Small Business in the Age of AI
Small Business in the Age of AI
 
Get financially Fit: Tips for Using QuickBooks
Get financially Fit: Tips for Using QuickBooksGet financially Fit: Tips for Using QuickBooks
Get financially Fit: Tips for Using QuickBooks
 
SEO, Social, and More: Digital Marketing for your Business
SEO, Social, and More: Digital Marketing for your BusinessSEO, Social, and More: Digital Marketing for your Business
SEO, Social, and More: Digital Marketing for your Business
 
Why Building Your Brand is Key to Getting Customers
Why Building Your Brand is Key to Getting CustomersWhy Building Your Brand is Key to Getting Customers
Why Building Your Brand is Key to Getting Customers
 
Get Found Fast: Google AdWords Strategies for Growth
Get Found Fast: Google AdWords Strategies for GrowthGet Found Fast: Google AdWords Strategies for Growth
Get Found Fast: Google AdWords Strategies for Growth
 
Giving Clients What They Want
Giving Clients What They WantGiving Clients What They Want
Giving Clients What They Want
 
What Accounting Will Look Like in 2030
What Accounting Will Look Like in 2030What Accounting Will Look Like in 2030
What Accounting Will Look Like in 2030
 
Pricing in the Digital Age
Pricing in the Digital Age Pricing in the Digital Age
Pricing in the Digital Age
 
Handbook: Power Panel on Apps you need to give you more time to serve your cl...
Handbook: Power Panel on Apps you need to give you more time to serve your cl...Handbook: Power Panel on Apps you need to give you more time to serve your cl...
Handbook: Power Panel on Apps you need to give you more time to serve your cl...
 
Handbook: Advanced QuickBooks Online - Handling Tricky Transactions
Handbook: Advanced QuickBooks Online - Handling Tricky TransactionsHandbook: Advanced QuickBooks Online - Handling Tricky Transactions
Handbook: Advanced QuickBooks Online - Handling Tricky Transactions
 
Advanced QuickBooks Online - Handling Tricky Transactions
Advanced QuickBooks Online - Handling Tricky TransactionsAdvanced QuickBooks Online - Handling Tricky Transactions
Advanced QuickBooks Online - Handling Tricky Transactions
 
Handling tricky transactions in QuickBooks Online
Handling tricky transactions in QuickBooks OnlineHandling tricky transactions in QuickBooks Online
Handling tricky transactions in QuickBooks Online
 
Social media is social business
Social media is social business  Social media is social business
Social media is social business
 
Conversation guide: Forming deep relationships with your clients
Conversation guide: Forming deep relationships with your clientsConversation guide: Forming deep relationships with your clients
Conversation guide: Forming deep relationships with your clients
 
Making tax digital
Making tax digital  Making tax digital
Making tax digital
 
Giving clients what they want
Giving clients what they want Giving clients what they want
Giving clients what they want
 
100 percent cloud your action plan for success
100 percent cloud your action plan for success 100 percent cloud your action plan for success
100 percent cloud your action plan for success
 
Attracting and retaining top talent
Attracting and retaining top talent Attracting and retaining top talent
Attracting and retaining top talent
 

Recently uploaded

Finding Java's Hidden Performance Traps @ DevoxxUK 2024
Finding Java's Hidden Performance Traps @ DevoxxUK 2024Finding Java's Hidden Performance Traps @ DevoxxUK 2024
Finding Java's Hidden Performance Traps @ DevoxxUK 2024
Victor Rentea
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Safe Software
 
Architecting Cloud Native Applications
Architecting Cloud Native ApplicationsArchitecting Cloud Native Applications
Architecting Cloud Native Applications
WSO2
 

Recently uploaded (20)

ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemkeProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
 
AWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of TerraformAWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of Terraform
 
FWD Group - Insurer Innovation Award 2024
FWD Group - Insurer Innovation Award 2024FWD Group - Insurer Innovation Award 2024
FWD Group - Insurer Innovation Award 2024
 
Finding Java's Hidden Performance Traps @ DevoxxUK 2024
Finding Java's Hidden Performance Traps @ DevoxxUK 2024Finding Java's Hidden Performance Traps @ DevoxxUK 2024
Finding Java's Hidden Performance Traps @ DevoxxUK 2024
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected Worker
 
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot TakeoffStrategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
 
Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...
Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...
Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...
 
Artificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : UncertaintyArtificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : Uncertainty
 
Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...
Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...
Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...
 
TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data DiscoveryTrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
 
Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...
 
"I see eyes in my soup": How Delivery Hero implemented the safety system for ...
"I see eyes in my soup": How Delivery Hero implemented the safety system for ..."I see eyes in my soup": How Delivery Hero implemented the safety system for ...
"I see eyes in my soup": How Delivery Hero implemented the safety system for ...
 
Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...
Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...
Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...
 
Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood
Polkadot JAM Slides - Token2049 - By Dr. Gavin WoodPolkadot JAM Slides - Token2049 - By Dr. Gavin Wood
Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood
 
Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdf
Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdfRising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdf
Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdf
 
Architecting Cloud Native Applications
Architecting Cloud Native ApplicationsArchitecting Cloud Native Applications
Architecting Cloud Native Applications
 
Exploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone ProcessorsExploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone Processors
 
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
 
CNIC Information System with Pakdata Cf In Pakistan
CNIC Information System with Pakdata Cf In PakistanCNIC Information System with Pakdata Cf In Pakistan
CNIC Information System with Pakdata Cf In Pakistan
 

Field Guide to Rapid Experimentation

  • 1.
  • 2. What is Design for Delight? Intuit’s #1 Core Capability “Design for Delight” is about evoking positive emotion throughout the customer journey, by going beyond customer expectations in delivering awesome product experiences that people want to tell the world about. Design for Delight principles are practiced throughout the company, and have become Intuit’s #1 core capability. Customer-Driven Innovation Intuit’s Innovation Framework We afford our employees the autonomy to tap into their own passions to delight customers and grow the company. We encourage our employees to know our customers - watch them, listen to them, visit their homes and workplaces - so they can discover and solve important problems for our customers. with durable advantage find an important problem that we and those we enable can solve well
  • 3. Your Challenge “Make New York Happy” Learn the principles of rapid experimentation by running experiments on the streets of New York City.
  • 4. Why Experiments? We use rapid experiments to quickly test the merit of our ideas, and generate new insights about our customers. By testing ideas using real customer behavior, we quickly separate what customers say, from what they actually do in the real world. Experiment to learn, not validate • Change opinions into facts • Prove or disprove our assumptions • Discover surprises about our customer • Make more informed decisions • Use data to help tell our story How to Experiment? First, document a bold vision for which you will attempt to create an idea customers love. Next, make your idea tangible by listing your 1) customer 2) problem 3) solution. Next, run experiments with real customers using the “experiment loop”. Run multiple “experiment loops” until you have determined if your idea is viable (or not). Rigor Inspiration Rapid Experiments idea 13 2 vision
  • 5. Rapid Experiment Loop 1. Leap of Faith Assumption (LOF) Your LOF is the most important behavior that must be true for your idea to work. You assume it to be true, but have not yet proven this assumption with evidence. “Participants will run experiments” 2. Build Experiments Build the absolute minimum required to test your assumption. Document a hypothesis and minimum success criteria, and be sure to measure real customer behavior. “If we do X, Y% of customers will behave in way Z” 3. Learn & Decide Review metrics from your experiment, and the surprises you observed. Discuss why your hypothesis passed or failed, and new customer insights you discovered. Decide if you will change your idea (pivot), continue (persevere), or run additional experiments. “Pivot - the experiment failed” Ready, Set, Go! Go run your experiment with real customers on the streets of NYC. Yes, outside! 00:10 Find a suitable location 00:05 Set up your experiment 00:20 Run your experiment! 00:10 Return to Master Class location NOTE: You must be back in :45 Tips... • Assign 1 person at a time to be the “re- corder”, switch every 8 minutes. • Record exactly what happens, in detail. • Learn “why or why not” - savor surprises. • Be neutral, avoid confirmation bias. • Don’t do anything disrespectful or illegal. • Take pictures, ask for feedback.
  • 6. 1 Hopscotch to Go Insights: People are more willing to try something fun if they see others doing it. Vision: Moments of fun on the go Idea: For busy New Yorkers on the go, create a quick game they can play on the street. LOF: People will take time to play quick games Hypothesis: If we create a hopscotch game on the street, 25% of passers by will play the game. Experiment: Using the chalk provided, create a hopscotch game on the sidewalk. Start playing the game, and see how many others join you. The game should be simple and quick to play. Behavior: Minimum Success Criteria: Experiment Notes Metrics: Observations:
  • 7. 2 Airplane Competition Insights: People are more willing to try something fun if it’s a competition. Vision: Moments of fun on the go Idea: For busy New Yorkers on the go, create a quick competition between players. LOF: People will take time to join a competition. Hypothesis: If we create a quick competition, 25% of passers by will join the competition. Experiment: Set up a paper airplane contest on the streets of NYC, where participants are asked to create and fly an airplane of their own design. Consider using time aloft or distance as the measure, or come up with your own ideas if you prefer. Use the paper and materials provided. Behavior: Minimum Success Criteria: Experiment Notes Metrics: Observations:
  • 8. 3 Funny Walkers Insights: People are willing to do something fun if the effort is minimal. Vision: Moments of fun on the go Idea: For busy New Yorkers on the go, create a fun experience which can be played as they walk. LOF: People are willing to look silly in public Hypothesis: If we start “walking funny”, 25% of passers by join us in walking funny. Experiment: Begin a “funny walkers” line at one end of any city block, then walk to the other end of the block. Attempt to get others to join you, repeating the funny walk. Behavior: Minimum Success Criteria: Experiment Notes Metrics: Observations:
  • 9. Pay it Forward Insights: People are inherently generous, especially when they see others being generous. Vision: Moments of generosity on the go Idea: For busy New Yorkers, help them take part in random acts of generosity. LOF: People are generous if given the chance Hypothesis: If we create an opportunity to be generous, 50% of people will take advantage of this opportunity. Experiment: Visit a local coffee shop and wait in line to purchase coffee. When paying, offer to pay for the coffee of the person behind you. Ask this person to “pay it forward” by buying coffee for next person in line. See how many people in line continue the “pay it forward” process. Behavior: Minimum Success Criteria: Experiment Notes Metrics: Observations: 4
  • 10. 5 Wallet Drop Insights: People are inherently good, and will do the right thing if given the chance publicly. Vision: Moments of kindness on the go Idea: For busy New Yorkers provide an opportunity to help another person. LOF: People will do the right thing and help. Hypothesis: If we create an opportunity to help someone, 75% of people will help. Experiment: As you walk, drop a fake wallet on the street in a manner that others will notice. See how many people alert you to the fact you dropped the wallet. Be sure to make it obvious to passers by that your wallet has been dropped. Behavior: Minimum Success Criteria: Experiment Notes Metrics: Observations:
  • 11. Learn & Decide Results: Why did your experiment pass or fail? New Insights: What is your biggest surprise? Make a decision: What will you do next? Pivot (change direction significantly) Persevere (continue, we’re onto something big) Iterate (try again with a few minor tweaks) Update Idea: How will your idea evolve?
  • 12. NotesNow What? “The secret to getting ahead, is getting started.” - Mark Twain There’s no better time than the present to lead the charge in your organization. Don’t ask permission, just get started! How to Lead with Experimentation: 1. Champion a grand vision. Grand visions are ambitious, tangible and memorable, and focused on your customer (not on you or your business). 2. Install systems & culture to enable rapid experimentation. Make experimentation easy for everyone in your organization. 3. Pull insights from success and failure. Savor the surprises from your experiments, both positive and negative. 4. Live by the same rules yourself. Recognize your idea is just one idea. Can your team find even better ideas?
  • 13. Thank You! Thanks for joining us today, and your willingness to get outside your comfort zone. For more information regarding Intuit, or to search for design related career opportunities, please visit us at: http://careers.intuit.com