SlideShare a Scribd company logo
THE VALUE OF EXPERIMENTATION
A GUEST PANEL DISCUSSION
Host: Tremis Skeete, Principal Product Manager, nexTier Innovations
Sponsor: Alpha
PRODUCT THINKING NYC
3.29.2017
Ellen Chisa
VP of Product
Lola
Daniella Patrick
Innovation Lab Product Manager
Accenture
Jordan Bergtraum
Management Consultant
(formerly VP of Product Management at ServiceChannel)
Nis Frome
Co-Founder, Product Manager & Content Lead
Alpha
It’s a future the CEO of Netflix says he couldn’t even have
predicted five years ago, when the company was still
primarily shipping DVDs to customers in the U.S. while
grappling with its emerging video streaming service. Even
now, the Internet continues to scramble the game so fast
that Hastings said his company is racing to keep up with all
the changes.
When asked, he didn’t even want to hazard a guess as to
where Netflix might be five years from now.
“We don’t really know,” Hastings said. “It’s not Netflix that’s
making the changes. It’s the Internet. We’re figuring out
every year how to use the Internet to make a great
consumer experience. Every year is an experiment.”
Reference:
https://venturebeat.com/2016/05/07/netflixs-reed-hastings-and-ted-s
arandos-every-year-is-an-experiment
1. What does it mean when you perform an experiment?
2. How can we communicate the value of experiments?
3. What performing experiments can do for you as designer?
4. What will users get out of being a part of an experiment?
What does it mean
when you perform an experiment?
“The objective of a Product Manager is to take an
idea and break it down into its core assumptions, and
find ways to test as cheap as possible.”
Experiments enable product managers to have autonomy. They
can more effectively push back against feature-creep and design by
committee by simply arguing that they are running an experiment
rather than launching a product.
Experiments drastically limit brand exposure to prospective
customers. A startup can launch a failed product and go back to the
drawing board without missing a beat. A major credit card company
cannot do the same without risking its reputation and damaging its
ability to launch trusted products in the future.
Experiments can transport user feedback from the end of the
product lifecycle to the beginning.
Reference: What Product Managers Need to Know About Minimum
Viable Experiments
By Mike Fishbein, Alpha
(http://insights.alphahq.com/minimum-viable-experiments)
“In the past few months, I've been trying to embrace
experiments. Instead of waiting until I had a bank of 30
[youtube] videos in place, I just wanted to do a test, see
how people responded, and then go from there.
Now, you're probably thinking ... don't you tell your clients to
start small, to launch fast, and to experiment? Yes, I do.
But, as many of you can probably relate, sometimes we
are our own worst client. Because as designers, we
want to make sure it's really well done.
So if you are struggling to act on your ideas then figure out
how you can start small, learn, and then go from there.”
Sarah Doody
User experience designer, consultant, and writer.
http://www.sarahdoody.com
“User Experience Design is a way to reduce risk,
improve productivity, and reduce cost.”
Reference: UX Briefing For Executives & Managers
(https://blog.prototypr.io/ux-briefing-for-executives-managers-8331160747f1)
[Product] Pricing is both the crudest, and most subtle, signal
that you can send to your customers, and they don’t really
think about their reaction to that signal – they feel it. The only
way to really understand your customers and design an
effective pricing strategy is to run experiments to work
out exactly how they’ll behave.
Reference: Designing Pricing Strategies: Don’t Ask – Experiment!
http://www.mindtheproduct.com/2016/11/designing-pricing-strategies-dont-ask-experiment/
A/B Testing
Comparing two versions of a web page to see which one performs
better. You compare two web pages by showing the two variants (let's
call them A and B) to similar visitors at the same time. The one that
gives a better conversion rate, wins!
Reference: The Complete Guide to A/B Testing (https://vwo.com/ab-testing/)
Reference: RankScience.com
Reference: RankScience.com
Reference: Casey Winters on Pinterest's Retention Wins, and Why 90% of SEO Advice is Wrong
(http://reforge.com/blog/casey-winters-pinterest-retention-seo)
A special thanks to our guest panelists:
A special thanks to Thor Ernstsson, Nis Frome,
and the team at…
Alpha
http://alphahq.com
NexTierInnovations.com
AlphaHQ.com
productthinkingnyc@gmail.com

More Related Content

What's hot

UX at Canadian Tire: Baking empathy into projects
UX at Canadian Tire: Baking empathy into projectsUX at Canadian Tire: Baking empathy into projects
UX at Canadian Tire: Baking empathy into projects
UserTesting
 
How To Turn Ideas Into Product
How To Turn Ideas Into Product How To Turn Ideas Into Product
How To Turn Ideas Into Product
Product School
 
Yes, You Can! No, You Can't! Yes, You Can!
Yes, You Can! No, You Can't! Yes, You Can!Yes, You Can! No, You Can't! Yes, You Can!
Yes, You Can! No, You Can't! Yes, You Can!
Cprime
 
How to Solve any Problems?
How to Solve any Problems?How to Solve any Problems?
How to Solve any Problems?
Rangga Wiseno
 
UserTesting Webinar - UX in Action: Fareportal
UserTesting Webinar - UX in Action: FareportalUserTesting Webinar - UX in Action: Fareportal
UserTesting Webinar - UX in Action: Fareportal
UserTesting
 
Product Culture with Property Finder VP Product
Product Culture with Property Finder VP ProductProduct Culture with Property Finder VP Product
Product Culture with Property Finder VP Product
Product School
 
BriannaGrahamHinchly365Days
BriannaGrahamHinchly365DaysBriannaGrahamHinchly365Days
BriannaGrahamHinchly365DaysBrianna Bourne
 
Uncovering Need and Validating Ideas with UserTesting by Marieke McCloskey
Uncovering Need and Validating Ideas with UserTesting by Marieke McCloskeyUncovering Need and Validating Ideas with UserTesting by Marieke McCloskey
Uncovering Need and Validating Ideas with UserTesting by Marieke McCloskey
UserTesting
 
10 tips for starting up ux research
10 tips for starting up ux research10 tips for starting up ux research
10 tips for starting up ux research
The Research Thing
 
Anda Gansca (Knotch) – Pivoting to Product Market Fit
Anda Gansca (Knotch) – Pivoting to Product Market FitAnda Gansca (Knotch) – Pivoting to Product Market Fit
Anda Gansca (Knotch) – Pivoting to Product Market Fit
Techsylvania
 
Designing To Learn: Creating Effective MVP Experiments - Lean UX NYC 2014
Designing To Learn: Creating Effective MVP Experiments - Lean UX NYC 2014Designing To Learn: Creating Effective MVP Experiments - Lean UX NYC 2014
Designing To Learn: Creating Effective MVP Experiments - Lean UX NYC 2014
Melissa Perri
 
Building Buy-In: 
Internally Positioning UX 
for Executive Impact. BigDesign...
Building Buy-In: 
Internally Positioning UX 
for Executive Impact.  BigDesign...Building Buy-In: 
Internally Positioning UX 
for Executive Impact.  BigDesign...
Building Buy-In: 
Internally Positioning UX 
for Executive Impact. BigDesign...
John Whalen
 
The agency's guide to effective user research
The agency's guide to effective user researchThe agency's guide to effective user research
The agency's guide to effective user research
UserTesting
 
Beyond Just Usability: Desirability and Usefulness Testing
Beyond Just Usability: Desirability and Usefulness TestingBeyond Just Usability: Desirability and Usefulness Testing
Beyond Just Usability: Desirability and Usefulness Testing
Susan Mercer
 
Startup Ingredients (Team, Solving a Problem, Customers)
Startup Ingredients (Team, Solving a Problem, Customers)Startup Ingredients (Team, Solving a Problem, Customers)
Startup Ingredients (Team, Solving a Problem, Customers)
John Peebles
 
UX Metrics for Enterprise
UX Metrics for EnterpriseUX Metrics for Enterprise
UX Metrics for Enterprise
Noemie PRIN
 
Creating Inspiring Products: Columbus IXDA
Creating Inspiring Products: Columbus IXDACreating Inspiring Products: Columbus IXDA
Creating Inspiring Products: Columbus IXDA
Justin Meats
 
3 Insights for Consumerization of the Enterprise
3 Insights for Consumerization of the Enterprise3 Insights for Consumerization of the Enterprise
3 Insights for Consumerization of the Enterprise
saastr
 
How Case Study Buddy helped Looop close 30% more sales
How Case Study Buddy helped Looop close 30% more salesHow Case Study Buddy helped Looop close 30% more sales
How Case Study Buddy helped Looop close 30% more sales
Joel Klettke
 
Minimum Viable Product (MVP) Testing
Minimum Viable Product (MVP) TestingMinimum Viable Product (MVP) Testing
Minimum Viable Product (MVP) Testing
Elaine Chen
 

What's hot (20)

UX at Canadian Tire: Baking empathy into projects
UX at Canadian Tire: Baking empathy into projectsUX at Canadian Tire: Baking empathy into projects
UX at Canadian Tire: Baking empathy into projects
 
How To Turn Ideas Into Product
How To Turn Ideas Into Product How To Turn Ideas Into Product
How To Turn Ideas Into Product
 
Yes, You Can! No, You Can't! Yes, You Can!
Yes, You Can! No, You Can't! Yes, You Can!Yes, You Can! No, You Can't! Yes, You Can!
Yes, You Can! No, You Can't! Yes, You Can!
 
How to Solve any Problems?
How to Solve any Problems?How to Solve any Problems?
How to Solve any Problems?
 
UserTesting Webinar - UX in Action: Fareportal
UserTesting Webinar - UX in Action: FareportalUserTesting Webinar - UX in Action: Fareportal
UserTesting Webinar - UX in Action: Fareportal
 
Product Culture with Property Finder VP Product
Product Culture with Property Finder VP ProductProduct Culture with Property Finder VP Product
Product Culture with Property Finder VP Product
 
BriannaGrahamHinchly365Days
BriannaGrahamHinchly365DaysBriannaGrahamHinchly365Days
BriannaGrahamHinchly365Days
 
Uncovering Need and Validating Ideas with UserTesting by Marieke McCloskey
Uncovering Need and Validating Ideas with UserTesting by Marieke McCloskeyUncovering Need and Validating Ideas with UserTesting by Marieke McCloskey
Uncovering Need and Validating Ideas with UserTesting by Marieke McCloskey
 
10 tips for starting up ux research
10 tips for starting up ux research10 tips for starting up ux research
10 tips for starting up ux research
 
Anda Gansca (Knotch) – Pivoting to Product Market Fit
Anda Gansca (Knotch) – Pivoting to Product Market FitAnda Gansca (Knotch) – Pivoting to Product Market Fit
Anda Gansca (Knotch) – Pivoting to Product Market Fit
 
Designing To Learn: Creating Effective MVP Experiments - Lean UX NYC 2014
Designing To Learn: Creating Effective MVP Experiments - Lean UX NYC 2014Designing To Learn: Creating Effective MVP Experiments - Lean UX NYC 2014
Designing To Learn: Creating Effective MVP Experiments - Lean UX NYC 2014
 
Building Buy-In: 
Internally Positioning UX 
for Executive Impact. BigDesign...
Building Buy-In: 
Internally Positioning UX 
for Executive Impact.  BigDesign...Building Buy-In: 
Internally Positioning UX 
for Executive Impact.  BigDesign...
Building Buy-In: 
Internally Positioning UX 
for Executive Impact. BigDesign...
 
The agency's guide to effective user research
The agency's guide to effective user researchThe agency's guide to effective user research
The agency's guide to effective user research
 
Beyond Just Usability: Desirability and Usefulness Testing
Beyond Just Usability: Desirability and Usefulness TestingBeyond Just Usability: Desirability and Usefulness Testing
Beyond Just Usability: Desirability and Usefulness Testing
 
Startup Ingredients (Team, Solving a Problem, Customers)
Startup Ingredients (Team, Solving a Problem, Customers)Startup Ingredients (Team, Solving a Problem, Customers)
Startup Ingredients (Team, Solving a Problem, Customers)
 
UX Metrics for Enterprise
UX Metrics for EnterpriseUX Metrics for Enterprise
UX Metrics for Enterprise
 
Creating Inspiring Products: Columbus IXDA
Creating Inspiring Products: Columbus IXDACreating Inspiring Products: Columbus IXDA
Creating Inspiring Products: Columbus IXDA
 
3 Insights for Consumerization of the Enterprise
3 Insights for Consumerization of the Enterprise3 Insights for Consumerization of the Enterprise
3 Insights for Consumerization of the Enterprise
 
How Case Study Buddy helped Looop close 30% more sales
How Case Study Buddy helped Looop close 30% more salesHow Case Study Buddy helped Looop close 30% more sales
How Case Study Buddy helped Looop close 30% more sales
 
Minimum Viable Product (MVP) Testing
Minimum Viable Product (MVP) TestingMinimum Viable Product (MVP) Testing
Minimum Viable Product (MVP) Testing
 

Viewers also liked

Experimentation Mindset
Experimentation MindsetExperimentation Mindset
Experimentation Mindset
Doc Norton
 
Intro to A.I. with Amazon's Senior Product Manager
Intro to A.I. with Amazon's Senior Product ManagerIntro to A.I. with Amazon's Senior Product Manager
Intro to A.I. with Amazon's Senior Product Manager
Product School
 
Growing Your Business Through Experimentation
Growing Your Business Through ExperimentationGrowing Your Business Through Experimentation
Growing Your Business Through Experimentation
Hiten Shah
 
The actual problems to be solved
The actual problems to be solvedThe actual problems to be solved
The actual problems to be solved
Kate Tarling
 
制作会社の視点で見る デザイナーのキャリアパスとスキル
制作会社の視点で見る デザイナーのキャリアパスとスキル制作会社の視点で見る デザイナーのキャリアパスとスキル
制作会社の視点で見る デザイナーのキャリアパスとスキル
Tomoyuki Arasuna
 
フォントの選び方・使い方
フォントの選び方・使い方フォントの選び方・使い方
フォントの選び方・使い方
k maztani
 
Design in Tech Report 2017
Design in Tech Report 2017Design in Tech Report 2017
Design in Tech Report 2017
John Maeda
 
Designing Teams for Emerging Challenges
Designing Teams for Emerging ChallengesDesigning Teams for Emerging Challenges
Designing Teams for Emerging Challenges
Aaron Irizarry
 
Visual Design with Data
Visual Design with DataVisual Design with Data
Visual Design with Data
Seth Familian
 
How to Become a Thought Leader in Your Niche
How to Become a Thought Leader in Your NicheHow to Become a Thought Leader in Your Niche
How to Become a Thought Leader in Your Niche
Leslie Samuel
 

Viewers also liked (10)

Experimentation Mindset
Experimentation MindsetExperimentation Mindset
Experimentation Mindset
 
Intro to A.I. with Amazon's Senior Product Manager
Intro to A.I. with Amazon's Senior Product ManagerIntro to A.I. with Amazon's Senior Product Manager
Intro to A.I. with Amazon's Senior Product Manager
 
Growing Your Business Through Experimentation
Growing Your Business Through ExperimentationGrowing Your Business Through Experimentation
Growing Your Business Through Experimentation
 
The actual problems to be solved
The actual problems to be solvedThe actual problems to be solved
The actual problems to be solved
 
制作会社の視点で見る デザイナーのキャリアパスとスキル
制作会社の視点で見る デザイナーのキャリアパスとスキル制作会社の視点で見る デザイナーのキャリアパスとスキル
制作会社の視点で見る デザイナーのキャリアパスとスキル
 
フォントの選び方・使い方
フォントの選び方・使い方フォントの選び方・使い方
フォントの選び方・使い方
 
Design in Tech Report 2017
Design in Tech Report 2017Design in Tech Report 2017
Design in Tech Report 2017
 
Designing Teams for Emerging Challenges
Designing Teams for Emerging ChallengesDesigning Teams for Emerging Challenges
Designing Teams for Emerging Challenges
 
Visual Design with Data
Visual Design with DataVisual Design with Data
Visual Design with Data
 
How to Become a Thought Leader in Your Niche
How to Become a Thought Leader in Your NicheHow to Become a Thought Leader in Your Niche
How to Become a Thought Leader in Your Niche
 

Similar to The Value of Experimentation: A Guest Panel Discussion

How to Master Product Management Case Studies by fmr Groupon PM
How to Master Product Management Case Studies by fmr Groupon PMHow to Master Product Management Case Studies by fmr Groupon PM
How to Master Product Management Case Studies by fmr Groupon PM
Product School
 
How to win over your colleagues and make life easier iwmw 2017
How to win over your colleagues and make life easier   iwmw 2017How to win over your colleagues and make life easier   iwmw 2017
How to win over your colleagues and make life easier iwmw 2017
IWMW
 
How to Avoid Common Mistakes in Product by Cake Product Manager
How to Avoid Common Mistakes in Product by Cake Product ManagerHow to Avoid Common Mistakes in Product by Cake Product Manager
How to Avoid Common Mistakes in Product by Cake Product Manager
Product School
 
UXUI Shanghai Meetup March 21st
UXUI Shanghai Meetup March 21st UXUI Shanghai Meetup March 21st
UXUI Shanghai Meetup March 21st
Clément LEDORMEUR
 
Grace Ng | SearchLove San Diego, 'Designing Effective Experiments for Product...
Grace Ng | SearchLove San Diego, 'Designing Effective Experiments for Product...Grace Ng | SearchLove San Diego, 'Designing Effective Experiments for Product...
Grace Ng | SearchLove San Diego, 'Designing Effective Experiments for Product...
Distilled
 
[UserTesting Webinar] Design Thinking & Design Research at Credit Karma
[UserTesting Webinar] Design Thinking & Design Research at Credit Karma[UserTesting Webinar] Design Thinking & Design Research at Credit Karma
[UserTesting Webinar] Design Thinking & Design Research at Credit Karma
UserTesting
 
Build the Right Product with Lean UX
Build the Right Product with Lean UXBuild the Right Product with Lean UX
Build the Right Product with Lean UX
Mike Long
 
[DevDay2019] Lean UX - By Bryant Castro, Bryant Castro at Wizeline
[DevDay2019] Lean UX - By  Bryant Castro,  Bryant Castro at Wizeline[DevDay2019] Lean UX - By  Bryant Castro,  Bryant Castro at Wizeline
[DevDay2019] Lean UX - By Bryant Castro, Bryant Castro at Wizeline
DevDay.org
 
Lets talk about user centered design
Lets talk about user centered designLets talk about user centered design
Lets talk about user centered designAgustín Schelstraete
 
Do Some UX On It
Do Some UX On ItDo Some UX On It
Do Some UX On It
Garry Finch
 
Why And How to Transition into Product Management by Google PM
Why And How to Transition into Product Management by Google PMWhy And How to Transition into Product Management by Google PM
Why And How to Transition into Product Management by Google PM
Product School
 
NeDeNa Lean Startup lean talk Barcelona 24.1.2019 -Björn Ühss
NeDeNa Lean Startup lean talk Barcelona 24.1.2019 -Björn ÜhssNeDeNa Lean Startup lean talk Barcelona 24.1.2019 -Björn Ühss
NeDeNa Lean Startup lean talk Barcelona 24.1.2019 -Björn Ühss
Björn Ühss (500+) ★ Bjoern Uehss
 
Including the User: How insights drive business #pswud2017
Including the User: How insights drive business #pswud2017Including the User: How insights drive business #pswud2017
Including the User: How insights drive business #pswud2017
Jeremy Johnson
 
Top 3 ways to use your UX team - producttank DFW Meetup
Top 3 ways to use your UX team - producttank DFW MeetupTop 3 ways to use your UX team - producttank DFW Meetup
Top 3 ways to use your UX team - producttank DFW Meetup
Jeremy Johnson
 
Prototyping Services
Prototyping Services Prototyping Services
Prototyping Services
Rakuten Group, Inc.
 
Paper Prototyping Rakuten Osaka
Paper Prototyping Rakuten OsakaPaper Prototyping Rakuten Osaka
Paper Prototyping Rakuten Osaka
Mandy Meissner
 
Design research for a quality product
Design research for a quality productDesign research for a quality product
Design research for a quality product
Carmen Brion
 
UX Design Process & Methods
UX Design Process & MethodsUX Design Process & Methods
UX Design Process & Methods
Baris Erkol
 
UX South Africa 2014 - Keynote
UX South Africa 2014 - KeynoteUX South Africa 2014 - Keynote
UX South Africa 2014 - Keynote
Phil Barrett
 
MVP Workshop @ Aeternity Starfleet 3 | Malta
MVP Workshop @ Aeternity Starfleet 3 | Malta MVP Workshop @ Aeternity Starfleet 3 | Malta
MVP Workshop @ Aeternity Starfleet 3 | Malta
MVP Workshop
 

Similar to The Value of Experimentation: A Guest Panel Discussion (20)

How to Master Product Management Case Studies by fmr Groupon PM
How to Master Product Management Case Studies by fmr Groupon PMHow to Master Product Management Case Studies by fmr Groupon PM
How to Master Product Management Case Studies by fmr Groupon PM
 
How to win over your colleagues and make life easier iwmw 2017
How to win over your colleagues and make life easier   iwmw 2017How to win over your colleagues and make life easier   iwmw 2017
How to win over your colleagues and make life easier iwmw 2017
 
How to Avoid Common Mistakes in Product by Cake Product Manager
How to Avoid Common Mistakes in Product by Cake Product ManagerHow to Avoid Common Mistakes in Product by Cake Product Manager
How to Avoid Common Mistakes in Product by Cake Product Manager
 
UXUI Shanghai Meetup March 21st
UXUI Shanghai Meetup March 21st UXUI Shanghai Meetup March 21st
UXUI Shanghai Meetup March 21st
 
Grace Ng | SearchLove San Diego, 'Designing Effective Experiments for Product...
Grace Ng | SearchLove San Diego, 'Designing Effective Experiments for Product...Grace Ng | SearchLove San Diego, 'Designing Effective Experiments for Product...
Grace Ng | SearchLove San Diego, 'Designing Effective Experiments for Product...
 
[UserTesting Webinar] Design Thinking & Design Research at Credit Karma
[UserTesting Webinar] Design Thinking & Design Research at Credit Karma[UserTesting Webinar] Design Thinking & Design Research at Credit Karma
[UserTesting Webinar] Design Thinking & Design Research at Credit Karma
 
Build the Right Product with Lean UX
Build the Right Product with Lean UXBuild the Right Product with Lean UX
Build the Right Product with Lean UX
 
[DevDay2019] Lean UX - By Bryant Castro, Bryant Castro at Wizeline
[DevDay2019] Lean UX - By  Bryant Castro,  Bryant Castro at Wizeline[DevDay2019] Lean UX - By  Bryant Castro,  Bryant Castro at Wizeline
[DevDay2019] Lean UX - By Bryant Castro, Bryant Castro at Wizeline
 
Lets talk about user centered design
Lets talk about user centered designLets talk about user centered design
Lets talk about user centered design
 
Do Some UX On It
Do Some UX On ItDo Some UX On It
Do Some UX On It
 
Why And How to Transition into Product Management by Google PM
Why And How to Transition into Product Management by Google PMWhy And How to Transition into Product Management by Google PM
Why And How to Transition into Product Management by Google PM
 
NeDeNa Lean Startup lean talk Barcelona 24.1.2019 -Björn Ühss
NeDeNa Lean Startup lean talk Barcelona 24.1.2019 -Björn ÜhssNeDeNa Lean Startup lean talk Barcelona 24.1.2019 -Björn Ühss
NeDeNa Lean Startup lean talk Barcelona 24.1.2019 -Björn Ühss
 
Including the User: How insights drive business #pswud2017
Including the User: How insights drive business #pswud2017Including the User: How insights drive business #pswud2017
Including the User: How insights drive business #pswud2017
 
Top 3 ways to use your UX team - producttank DFW Meetup
Top 3 ways to use your UX team - producttank DFW MeetupTop 3 ways to use your UX team - producttank DFW Meetup
Top 3 ways to use your UX team - producttank DFW Meetup
 
Prototyping Services
Prototyping Services Prototyping Services
Prototyping Services
 
Paper Prototyping Rakuten Osaka
Paper Prototyping Rakuten OsakaPaper Prototyping Rakuten Osaka
Paper Prototyping Rakuten Osaka
 
Design research for a quality product
Design research for a quality productDesign research for a quality product
Design research for a quality product
 
UX Design Process & Methods
UX Design Process & MethodsUX Design Process & Methods
UX Design Process & Methods
 
UX South Africa 2014 - Keynote
UX South Africa 2014 - KeynoteUX South Africa 2014 - Keynote
UX South Africa 2014 - Keynote
 
MVP Workshop @ Aeternity Starfleet 3 | Malta
MVP Workshop @ Aeternity Starfleet 3 | Malta MVP Workshop @ Aeternity Starfleet 3 | Malta
MVP Workshop @ Aeternity Starfleet 3 | Malta
 

More from Tremis Skeete

Talking about Padlet: Presented at Imagine Learning (pka Twig Education)
Talking about Padlet: Presented at Imagine Learning (pka Twig Education)Talking about Padlet: Presented at Imagine Learning (pka Twig Education)
Talking about Padlet: Presented at Imagine Learning (pka Twig Education)
Tremis Skeete
 
Build Services that Fit: Product Discovery Lessons Learned
Build Services that Fit: Product Discovery Lessons LearnedBuild Services that Fit: Product Discovery Lessons Learned
Build Services that Fit: Product Discovery Lessons Learned
Tremis Skeete
 
Science and USA Middle Schools
Science and USA Middle SchoolsScience and USA Middle Schools
Science and USA Middle Schools
Tremis Skeete
 
Why Accessibility Matters
Why Accessibility MattersWhy Accessibility Matters
Why Accessibility Matters
Tremis Skeete
 
Digital to Physical: The Experiment Economy
Digital to Physical: The Experiment EconomyDigital to Physical: The Experiment Economy
Digital to Physical: The Experiment Economy
Tremis Skeete
 
How to Effectively Lead Focus Groups: Presented at Product School NYC
How to Effectively Lead Focus Groups: Presented at Product School NYC How to Effectively Lead Focus Groups: Presented at Product School NYC
How to Effectively Lead Focus Groups: Presented at Product School NYC
Tremis Skeete
 
How to Effectively Lead Focus Groups: Presented at ProductTank Toronto
How to Effectively Lead Focus Groups: Presented at ProductTank TorontoHow to Effectively Lead Focus Groups: Presented at ProductTank Toronto
How to Effectively Lead Focus Groups: Presented at ProductTank Toronto
Tremis Skeete
 
How to Supercharge Your Team by Divorcing Product from Project Management
How to Supercharge Your Team by Divorcing Product from Project ManagementHow to Supercharge Your Team by Divorcing Product from Project Management
How to Supercharge Your Team by Divorcing Product from Project Management
Tremis Skeete
 
Sense & Respond: Book Review & Panel Discussion
Sense & Respond: Book Review & Panel DiscussionSense & Respond: Book Review & Panel Discussion
Sense & Respond: Book Review & Panel Discussion
Tremis Skeete
 

More from Tremis Skeete (9)

Talking about Padlet: Presented at Imagine Learning (pka Twig Education)
Talking about Padlet: Presented at Imagine Learning (pka Twig Education)Talking about Padlet: Presented at Imagine Learning (pka Twig Education)
Talking about Padlet: Presented at Imagine Learning (pka Twig Education)
 
Build Services that Fit: Product Discovery Lessons Learned
Build Services that Fit: Product Discovery Lessons LearnedBuild Services that Fit: Product Discovery Lessons Learned
Build Services that Fit: Product Discovery Lessons Learned
 
Science and USA Middle Schools
Science and USA Middle SchoolsScience and USA Middle Schools
Science and USA Middle Schools
 
Why Accessibility Matters
Why Accessibility MattersWhy Accessibility Matters
Why Accessibility Matters
 
Digital to Physical: The Experiment Economy
Digital to Physical: The Experiment EconomyDigital to Physical: The Experiment Economy
Digital to Physical: The Experiment Economy
 
How to Effectively Lead Focus Groups: Presented at Product School NYC
How to Effectively Lead Focus Groups: Presented at Product School NYC How to Effectively Lead Focus Groups: Presented at Product School NYC
How to Effectively Lead Focus Groups: Presented at Product School NYC
 
How to Effectively Lead Focus Groups: Presented at ProductTank Toronto
How to Effectively Lead Focus Groups: Presented at ProductTank TorontoHow to Effectively Lead Focus Groups: Presented at ProductTank Toronto
How to Effectively Lead Focus Groups: Presented at ProductTank Toronto
 
How to Supercharge Your Team by Divorcing Product from Project Management
How to Supercharge Your Team by Divorcing Product from Project ManagementHow to Supercharge Your Team by Divorcing Product from Project Management
How to Supercharge Your Team by Divorcing Product from Project Management
 
Sense & Respond: Book Review & Panel Discussion
Sense & Respond: Book Review & Panel DiscussionSense & Respond: Book Review & Panel Discussion
Sense & Respond: Book Review & Panel Discussion
 

Recently uploaded

Maximize Your Content with Beautiful Assets : Content & Asset for Landing Page
Maximize Your Content with Beautiful Assets : Content & Asset for Landing Page Maximize Your Content with Beautiful Assets : Content & Asset for Landing Page
Maximize Your Content with Beautiful Assets : Content & Asset for Landing Page
pmgdscunsri
 
一比一原版(Bristol毕业证书)布里斯托大学毕业证成绩单如何办理
一比一原版(Bristol毕业证书)布里斯托大学毕业证成绩单如何办理一比一原版(Bristol毕业证书)布里斯托大学毕业证成绩单如何办理
一比一原版(Bristol毕业证书)布里斯托大学毕业证成绩单如何办理
smpc3nvg
 
Impact of Fonts: in Web and Apps Design
Impact of Fonts:  in Web and Apps DesignImpact of Fonts:  in Web and Apps Design
Impact of Fonts: in Web and Apps Design
contactproperweb2014
 
Moldes de letra 3D Alfabeto completo esp
Moldes de letra 3D Alfabeto completo espMoldes de letra 3D Alfabeto completo esp
Moldes de letra 3D Alfabeto completo esp
Hess9
 
Storytelling For The Web: Integrate Storytelling in your Design Process
Storytelling For The Web: Integrate Storytelling in your Design ProcessStorytelling For The Web: Integrate Storytelling in your Design Process
Storytelling For The Web: Integrate Storytelling in your Design Process
Chiara Aliotta
 
一比一原版(UW毕业证)西雅图华盛顿大学毕业证如何办理
一比一原版(UW毕业证)西雅图华盛顿大学毕业证如何办理一比一原版(UW毕业证)西雅图华盛顿大学毕业证如何办理
一比一原版(UW毕业证)西雅图华盛顿大学毕业证如何办理
kecekev
 
一比一原版(BU毕业证书)伯恩茅斯大学毕业证成绩单如何办理
一比一原版(BU毕业证书)伯恩茅斯大学毕业证成绩单如何办理一比一原版(BU毕业证书)伯恩茅斯大学毕业证成绩单如何办理
一比一原版(BU毕业证书)伯恩茅斯大学毕业证成绩单如何办理
h7j5io0
 
一比一原版(Columbia毕业证)哥伦比亚大学毕业证如何办理
一比一原版(Columbia毕业证)哥伦比亚大学毕业证如何办理一比一原版(Columbia毕业证)哥伦比亚大学毕业证如何办理
一比一原版(Columbia毕业证)哥伦比亚大学毕业证如何办理
asuzyq
 
一比一原版(Glasgow毕业证书)格拉斯哥大学毕业证成绩单如何办理
一比一原版(Glasgow毕业证书)格拉斯哥大学毕业证成绩单如何办理一比一原版(Glasgow毕业证书)格拉斯哥大学毕业证成绩单如何办理
一比一原版(Glasgow毕业证书)格拉斯哥大学毕业证成绩单如何办理
n0tivyq
 
EASY TUTORIAL OF HOW TO USE CAPCUT BY: FEBLESS HERNANE
EASY TUTORIAL OF HOW TO USE CAPCUT BY: FEBLESS HERNANEEASY TUTORIAL OF HOW TO USE CAPCUT BY: FEBLESS HERNANE
EASY TUTORIAL OF HOW TO USE CAPCUT BY: FEBLESS HERNANE
Febless Hernane
 
White wonder, Work developed by Eva Tschopp
White wonder, Work developed by Eva TschoppWhite wonder, Work developed by Eva Tschopp
White wonder, Work developed by Eva Tschopp
Mansi Shah
 
一比一原版(RHUL毕业证书)伦敦大学皇家霍洛威学院毕业证如何办理
一比一原版(RHUL毕业证书)伦敦大学皇家霍洛威学院毕业证如何办理一比一原版(RHUL毕业证书)伦敦大学皇家霍洛威学院毕业证如何办理
一比一原版(RHUL毕业证书)伦敦大学皇家霍洛威学院毕业证如何办理
9a93xvy
 
Portfolio.pdf
Portfolio.pdfPortfolio.pdf
Portfolio.pdf
garcese
 
Technoblade The Legacy of a Minecraft Legend.
Technoblade The Legacy of a Minecraft Legend.Technoblade The Legacy of a Minecraft Legend.
Technoblade The Legacy of a Minecraft Legend.
Techno Merch
 
20 slides of research movie and artists .pdf
20 slides of research movie and artists .pdf20 slides of research movie and artists .pdf
20 slides of research movie and artists .pdf
ameli25062005
 
Can AI do good? at 'offtheCanvas' India HCI prelude
Can AI do good? at 'offtheCanvas' India HCI preludeCan AI do good? at 'offtheCanvas' India HCI prelude
Can AI do good? at 'offtheCanvas' India HCI prelude
Alan Dix
 
Mohannad Abdullah portfolio _ V2 _22-24
Mohannad Abdullah  portfolio _ V2 _22-24Mohannad Abdullah  portfolio _ V2 _22-24
Mohannad Abdullah portfolio _ V2 _22-24
M. A. Architect
 
Transforming Brand Perception and Boosting Profitability
Transforming Brand Perception and Boosting ProfitabilityTransforming Brand Perception and Boosting Profitability
Transforming Brand Perception and Boosting Profitability
aaryangarg12
 
Research 20 slides Amelia gavryliuks.pdf
Research 20 slides Amelia gavryliuks.pdfResearch 20 slides Amelia gavryliuks.pdf
Research 20 slides Amelia gavryliuks.pdf
ameli25062005
 
一比一原版(UNUK毕业证书)诺丁汉大学毕业证如何办理
一比一原版(UNUK毕业证书)诺丁汉大学毕业证如何办理一比一原版(UNUK毕业证书)诺丁汉大学毕业证如何办理
一比一原版(UNUK毕业证书)诺丁汉大学毕业证如何办理
7sd8fier
 

Recently uploaded (20)

Maximize Your Content with Beautiful Assets : Content & Asset for Landing Page
Maximize Your Content with Beautiful Assets : Content & Asset for Landing Page Maximize Your Content with Beautiful Assets : Content & Asset for Landing Page
Maximize Your Content with Beautiful Assets : Content & Asset for Landing Page
 
一比一原版(Bristol毕业证书)布里斯托大学毕业证成绩单如何办理
一比一原版(Bristol毕业证书)布里斯托大学毕业证成绩单如何办理一比一原版(Bristol毕业证书)布里斯托大学毕业证成绩单如何办理
一比一原版(Bristol毕业证书)布里斯托大学毕业证成绩单如何办理
 
Impact of Fonts: in Web and Apps Design
Impact of Fonts:  in Web and Apps DesignImpact of Fonts:  in Web and Apps Design
Impact of Fonts: in Web and Apps Design
 
Moldes de letra 3D Alfabeto completo esp
Moldes de letra 3D Alfabeto completo espMoldes de letra 3D Alfabeto completo esp
Moldes de letra 3D Alfabeto completo esp
 
Storytelling For The Web: Integrate Storytelling in your Design Process
Storytelling For The Web: Integrate Storytelling in your Design ProcessStorytelling For The Web: Integrate Storytelling in your Design Process
Storytelling For The Web: Integrate Storytelling in your Design Process
 
一比一原版(UW毕业证)西雅图华盛顿大学毕业证如何办理
一比一原版(UW毕业证)西雅图华盛顿大学毕业证如何办理一比一原版(UW毕业证)西雅图华盛顿大学毕业证如何办理
一比一原版(UW毕业证)西雅图华盛顿大学毕业证如何办理
 
一比一原版(BU毕业证书)伯恩茅斯大学毕业证成绩单如何办理
一比一原版(BU毕业证书)伯恩茅斯大学毕业证成绩单如何办理一比一原版(BU毕业证书)伯恩茅斯大学毕业证成绩单如何办理
一比一原版(BU毕业证书)伯恩茅斯大学毕业证成绩单如何办理
 
一比一原版(Columbia毕业证)哥伦比亚大学毕业证如何办理
一比一原版(Columbia毕业证)哥伦比亚大学毕业证如何办理一比一原版(Columbia毕业证)哥伦比亚大学毕业证如何办理
一比一原版(Columbia毕业证)哥伦比亚大学毕业证如何办理
 
一比一原版(Glasgow毕业证书)格拉斯哥大学毕业证成绩单如何办理
一比一原版(Glasgow毕业证书)格拉斯哥大学毕业证成绩单如何办理一比一原版(Glasgow毕业证书)格拉斯哥大学毕业证成绩单如何办理
一比一原版(Glasgow毕业证书)格拉斯哥大学毕业证成绩单如何办理
 
EASY TUTORIAL OF HOW TO USE CAPCUT BY: FEBLESS HERNANE
EASY TUTORIAL OF HOW TO USE CAPCUT BY: FEBLESS HERNANEEASY TUTORIAL OF HOW TO USE CAPCUT BY: FEBLESS HERNANE
EASY TUTORIAL OF HOW TO USE CAPCUT BY: FEBLESS HERNANE
 
White wonder, Work developed by Eva Tschopp
White wonder, Work developed by Eva TschoppWhite wonder, Work developed by Eva Tschopp
White wonder, Work developed by Eva Tschopp
 
一比一原版(RHUL毕业证书)伦敦大学皇家霍洛威学院毕业证如何办理
一比一原版(RHUL毕业证书)伦敦大学皇家霍洛威学院毕业证如何办理一比一原版(RHUL毕业证书)伦敦大学皇家霍洛威学院毕业证如何办理
一比一原版(RHUL毕业证书)伦敦大学皇家霍洛威学院毕业证如何办理
 
Portfolio.pdf
Portfolio.pdfPortfolio.pdf
Portfolio.pdf
 
Technoblade The Legacy of a Minecraft Legend.
Technoblade The Legacy of a Minecraft Legend.Technoblade The Legacy of a Minecraft Legend.
Technoblade The Legacy of a Minecraft Legend.
 
20 slides of research movie and artists .pdf
20 slides of research movie and artists .pdf20 slides of research movie and artists .pdf
20 slides of research movie and artists .pdf
 
Can AI do good? at 'offtheCanvas' India HCI prelude
Can AI do good? at 'offtheCanvas' India HCI preludeCan AI do good? at 'offtheCanvas' India HCI prelude
Can AI do good? at 'offtheCanvas' India HCI prelude
 
Mohannad Abdullah portfolio _ V2 _22-24
Mohannad Abdullah  portfolio _ V2 _22-24Mohannad Abdullah  portfolio _ V2 _22-24
Mohannad Abdullah portfolio _ V2 _22-24
 
Transforming Brand Perception and Boosting Profitability
Transforming Brand Perception and Boosting ProfitabilityTransforming Brand Perception and Boosting Profitability
Transforming Brand Perception and Boosting Profitability
 
Research 20 slides Amelia gavryliuks.pdf
Research 20 slides Amelia gavryliuks.pdfResearch 20 slides Amelia gavryliuks.pdf
Research 20 slides Amelia gavryliuks.pdf
 
一比一原版(UNUK毕业证书)诺丁汉大学毕业证如何办理
一比一原版(UNUK毕业证书)诺丁汉大学毕业证如何办理一比一原版(UNUK毕业证书)诺丁汉大学毕业证如何办理
一比一原版(UNUK毕业证书)诺丁汉大学毕业证如何办理
 

The Value of Experimentation: A Guest Panel Discussion

  • 1. THE VALUE OF EXPERIMENTATION A GUEST PANEL DISCUSSION Host: Tremis Skeete, Principal Product Manager, nexTier Innovations Sponsor: Alpha PRODUCT THINKING NYC 3.29.2017
  • 2. Ellen Chisa VP of Product Lola Daniella Patrick Innovation Lab Product Manager Accenture Jordan Bergtraum Management Consultant (formerly VP of Product Management at ServiceChannel) Nis Frome Co-Founder, Product Manager & Content Lead Alpha
  • 3. It’s a future the CEO of Netflix says he couldn’t even have predicted five years ago, when the company was still primarily shipping DVDs to customers in the U.S. while grappling with its emerging video streaming service. Even now, the Internet continues to scramble the game so fast that Hastings said his company is racing to keep up with all the changes. When asked, he didn’t even want to hazard a guess as to where Netflix might be five years from now. “We don’t really know,” Hastings said. “It’s not Netflix that’s making the changes. It’s the Internet. We’re figuring out every year how to use the Internet to make a great consumer experience. Every year is an experiment.” Reference: https://venturebeat.com/2016/05/07/netflixs-reed-hastings-and-ted-s arandos-every-year-is-an-experiment
  • 4. 1. What does it mean when you perform an experiment? 2. How can we communicate the value of experiments? 3. What performing experiments can do for you as designer? 4. What will users get out of being a part of an experiment?
  • 5. What does it mean when you perform an experiment?
  • 6.
  • 7. “The objective of a Product Manager is to take an idea and break it down into its core assumptions, and find ways to test as cheap as possible.”
  • 8. Experiments enable product managers to have autonomy. They can more effectively push back against feature-creep and design by committee by simply arguing that they are running an experiment rather than launching a product. Experiments drastically limit brand exposure to prospective customers. A startup can launch a failed product and go back to the drawing board without missing a beat. A major credit card company cannot do the same without risking its reputation and damaging its ability to launch trusted products in the future. Experiments can transport user feedback from the end of the product lifecycle to the beginning. Reference: What Product Managers Need to Know About Minimum Viable Experiments By Mike Fishbein, Alpha (http://insights.alphahq.com/minimum-viable-experiments)
  • 9. “In the past few months, I've been trying to embrace experiments. Instead of waiting until I had a bank of 30 [youtube] videos in place, I just wanted to do a test, see how people responded, and then go from there. Now, you're probably thinking ... don't you tell your clients to start small, to launch fast, and to experiment? Yes, I do. But, as many of you can probably relate, sometimes we are our own worst client. Because as designers, we want to make sure it's really well done. So if you are struggling to act on your ideas then figure out how you can start small, learn, and then go from there.” Sarah Doody User experience designer, consultant, and writer. http://www.sarahdoody.com
  • 10.
  • 11.
  • 12. “User Experience Design is a way to reduce risk, improve productivity, and reduce cost.” Reference: UX Briefing For Executives & Managers (https://blog.prototypr.io/ux-briefing-for-executives-managers-8331160747f1)
  • 13.
  • 14. [Product] Pricing is both the crudest, and most subtle, signal that you can send to your customers, and they don’t really think about their reaction to that signal – they feel it. The only way to really understand your customers and design an effective pricing strategy is to run experiments to work out exactly how they’ll behave. Reference: Designing Pricing Strategies: Don’t Ask – Experiment! http://www.mindtheproduct.com/2016/11/designing-pricing-strategies-dont-ask-experiment/
  • 15. A/B Testing Comparing two versions of a web page to see which one performs better. You compare two web pages by showing the two variants (let's call them A and B) to similar visitors at the same time. The one that gives a better conversion rate, wins! Reference: The Complete Guide to A/B Testing (https://vwo.com/ab-testing/)
  • 18. Reference: Casey Winters on Pinterest's Retention Wins, and Why 90% of SEO Advice is Wrong (http://reforge.com/blog/casey-winters-pinterest-retention-seo)
  • 19. A special thanks to our guest panelists:
  • 20. A special thanks to Thor Ernstsson, Nis Frome, and the team at… Alpha http://alphahq.com