SlideShare a Scribd company logo
1 of 35
Creating Value Testing
Geoff Wolf, EVP, J.Schmid & Associates
Jude Hoffner, Principle, Hoffner Marketing
Agenda
• Why Test
• Extracting Value from Testing
• Communication
• Q/A
Agenda
• Why Test
• Extracting Value from Testing
• Communication
• Q/A
Why Test
“It’s there!”
Why Test
1) Distinguishing advantage of direct marketing
Why Test
“If you’re not improving…”
Why Test
2) Essential for survival
Why Test
27%
25%
17%
15%
11%
71%
77%
83%
87%
91%
2000 2003 2006 2009 2012
Items Sales
E-Comm Mobile
Why Test
Why Test
3) Isolate Valuable Practices
Why Test
3) Isolate ValuablePractices
Why Test
Testing + Testing = Value
Testing + Answers = Value
Agenda
• Why Test
• Extracting Value from Testing
• Communication
• Q/A
Extracting Value
Starts with
What to test
Extracting Value
Nice to Know…
Vs.
…Need to Know
Extracting Value
Nice to Know…
May not be actionable in future
Example
Nice to Know…
Beware Creative tests!
The 2013 Blue
Cover!
The 2013 Red
Cover!
The 2014 Cover Must be
Green or White!
Extracting Value
Demand Cultivate accountability
for test ideas
Extracting Value
Need to Know
Actionable
Relevant
Repeatable
And delivers ROI
Extracting Value
Need to Know…
…delivers ROI
Offers
=
Conversion
Example
Customer Acquisition
Extracting Value
Need to Know…
…delivers ROI
Contact Strategies
=
Margin
Example
Extracting Value
Need to Know…
…delivers ROI
Channel mix/preference
=
Engagement
Example
Extracting Value
Need to Know…
…delivers ROI
Doesn’t always have to be an
A/B test.
Extracting Value
Let’s talk about your data…
Extracting Value
The Obvious
• Ensure randomized selection
• Create two controls when
possible
• Manage long tests carefully to
preserve valid results
Extracting Value
The Less Obvious
Think ahead!
…about what you’re reporting
and to whom
Extracting Value
Must be organized
AND
Communicate Clearly!
Example
Example
Example
Ok if testing for $/Bk
Example
Not Ok if testing for Contribution
Q & A

More Related Content

What's hot

A/B Testing for Everyone
A/B Testing for EveryoneA/B Testing for Everyone
A/B Testing for EveryonePavel Dmitriev
 
Optimizely Workshop: Take Action on Results with Statistics
Optimizely Workshop: Take Action on Results with StatisticsOptimizely Workshop: Take Action on Results with Statistics
Optimizely Workshop: Take Action on Results with StatisticsOptimizely
 
MECLABS in Five Minutes
MECLABS in Five MinutesMECLABS in Five Minutes
MECLABS in Five MinutesKevin Soisson
 
Run High Impact Experimentation with High-quality Customer Discovery
Run High Impact Experimentation with High-quality Customer DiscoveryRun High Impact Experimentation with High-quality Customer Discovery
Run High Impact Experimentation with High-quality Customer DiscoveryOptimizely
 
Losing is the New Winning
Losing is the New WinningLosing is the New Winning
Losing is the New WinningOptimizely
 
Opticon 2017 - Building a Culture of Experimentation at IBM
Opticon 2017 - Building a Culture of Experimentation at IBMOpticon 2017 - Building a Culture of Experimentation at IBM
Opticon 2017 - Building a Culture of Experimentation at IBMOptimizely
 
The real c in cro is communication
The real c in cro is communicationThe real c in cro is communication
The real c in cro is communicationVWO
 
Steve Wilt, Director, Innovation & Transformation Center, Salesforce
Steve Wilt, Director, Innovation & Transformation Center, SalesforceSteve Wilt, Director, Innovation & Transformation Center, Salesforce
Steve Wilt, Director, Innovation & Transformation Center, SalesforceWorld_Forum_Disrupt
 
Accelue Lean Yellow Belt - Day 1
Accelue  Lean  Yellow Belt - Day 1Accelue  Lean  Yellow Belt - Day 1
Accelue Lean Yellow Belt - Day 1Dinesh Thomas
 
Modernize 2018: Product Experimentation Pitfalls and How to Avoid Them, Optim...
Modernize 2018: Product Experimentation Pitfalls and How to Avoid Them, Optim...Modernize 2018: Product Experimentation Pitfalls and How to Avoid Them, Optim...
Modernize 2018: Product Experimentation Pitfalls and How to Avoid Them, Optim...Optimizely
 
Transforming to a product led company by Josh Centner
Transforming to a product led company by Josh CentnerTransforming to a product led company by Josh Centner
Transforming to a product led company by Josh CentnerProduct Anonymous
 
Keeping your eyes on the business goal
Keeping your eyes on the business goalKeeping your eyes on the business goal
Keeping your eyes on the business goalUXDXConf
 
Vinod Suresh, Director, Product Management, Walmart Labs
Vinod Suresh, Director, Product Management, Walmart LabsVinod Suresh, Director, Product Management, Walmart Labs
Vinod Suresh, Director, Product Management, Walmart LabsWorld_Forum_Disrupt
 
Let's build great products for mid-size companies
Let's build great products for mid-size companiesLet's build great products for mid-size companies
Let's build great products for mid-size companiesTu Pham
 
Megan Foy - Director, Innovation, 20th Century Fox
Megan Foy - Director, Innovation, 20th Century FoxMegan Foy - Director, Innovation, 20th Century Fox
Megan Foy - Director, Innovation, 20th Century FoxWorld_Forum_Disrupt
 
Follow the Money - How to Speak to Executives about Agile
Follow the Money - How to Speak to Executives about AgileFollow the Money - How to Speak to Executives about Agile
Follow the Money - How to Speak to Executives about AgileAgileThought
 
Supporting Institutions in Changing Times: Manifesto
Supporting Institutions in Changing Times: ManifestoSupporting Institutions in Changing Times: Manifesto
Supporting Institutions in Changing Times: ManifestoIWMW
 
Indonesian Opinion about SMS as Customer Service Survey Report
Indonesian Opinion about SMS as Customer Service Survey ReportIndonesian Opinion about SMS as Customer Service Survey Report
Indonesian Opinion about SMS as Customer Service Survey ReportBunga Addinta
 
Tech and Government - Procurement stats
Tech and Government - Procurement statsTech and Government - Procurement stats
Tech and Government - Procurement statsPaul Matthews
 
Building a Culture of Product Experimentation by Optimizely PM
Building a Culture of Product Experimentation by Optimizely PMBuilding a Culture of Product Experimentation by Optimizely PM
Building a Culture of Product Experimentation by Optimizely PMProduct School
 

What's hot (20)

A/B Testing for Everyone
A/B Testing for EveryoneA/B Testing for Everyone
A/B Testing for Everyone
 
Optimizely Workshop: Take Action on Results with Statistics
Optimizely Workshop: Take Action on Results with StatisticsOptimizely Workshop: Take Action on Results with Statistics
Optimizely Workshop: Take Action on Results with Statistics
 
MECLABS in Five Minutes
MECLABS in Five MinutesMECLABS in Five Minutes
MECLABS in Five Minutes
 
Run High Impact Experimentation with High-quality Customer Discovery
Run High Impact Experimentation with High-quality Customer DiscoveryRun High Impact Experimentation with High-quality Customer Discovery
Run High Impact Experimentation with High-quality Customer Discovery
 
Losing is the New Winning
Losing is the New WinningLosing is the New Winning
Losing is the New Winning
 
Opticon 2017 - Building a Culture of Experimentation at IBM
Opticon 2017 - Building a Culture of Experimentation at IBMOpticon 2017 - Building a Culture of Experimentation at IBM
Opticon 2017 - Building a Culture of Experimentation at IBM
 
The real c in cro is communication
The real c in cro is communicationThe real c in cro is communication
The real c in cro is communication
 
Steve Wilt, Director, Innovation & Transformation Center, Salesforce
Steve Wilt, Director, Innovation & Transformation Center, SalesforceSteve Wilt, Director, Innovation & Transformation Center, Salesforce
Steve Wilt, Director, Innovation & Transformation Center, Salesforce
 
Accelue Lean Yellow Belt - Day 1
Accelue  Lean  Yellow Belt - Day 1Accelue  Lean  Yellow Belt - Day 1
Accelue Lean Yellow Belt - Day 1
 
Modernize 2018: Product Experimentation Pitfalls and How to Avoid Them, Optim...
Modernize 2018: Product Experimentation Pitfalls and How to Avoid Them, Optim...Modernize 2018: Product Experimentation Pitfalls and How to Avoid Them, Optim...
Modernize 2018: Product Experimentation Pitfalls and How to Avoid Them, Optim...
 
Transforming to a product led company by Josh Centner
Transforming to a product led company by Josh CentnerTransforming to a product led company by Josh Centner
Transforming to a product led company by Josh Centner
 
Keeping your eyes on the business goal
Keeping your eyes on the business goalKeeping your eyes on the business goal
Keeping your eyes on the business goal
 
Vinod Suresh, Director, Product Management, Walmart Labs
Vinod Suresh, Director, Product Management, Walmart LabsVinod Suresh, Director, Product Management, Walmart Labs
Vinod Suresh, Director, Product Management, Walmart Labs
 
Let's build great products for mid-size companies
Let's build great products for mid-size companiesLet's build great products for mid-size companies
Let's build great products for mid-size companies
 
Megan Foy - Director, Innovation, 20th Century Fox
Megan Foy - Director, Innovation, 20th Century FoxMegan Foy - Director, Innovation, 20th Century Fox
Megan Foy - Director, Innovation, 20th Century Fox
 
Follow the Money - How to Speak to Executives about Agile
Follow the Money - How to Speak to Executives about AgileFollow the Money - How to Speak to Executives about Agile
Follow the Money - How to Speak to Executives about Agile
 
Supporting Institutions in Changing Times: Manifesto
Supporting Institutions in Changing Times: ManifestoSupporting Institutions in Changing Times: Manifesto
Supporting Institutions in Changing Times: Manifesto
 
Indonesian Opinion about SMS as Customer Service Survey Report
Indonesian Opinion about SMS as Customer Service Survey ReportIndonesian Opinion about SMS as Customer Service Survey Report
Indonesian Opinion about SMS as Customer Service Survey Report
 
Tech and Government - Procurement stats
Tech and Government - Procurement statsTech and Government - Procurement stats
Tech and Government - Procurement stats
 
Building a Culture of Product Experimentation by Optimizely PM
Building a Culture of Product Experimentation by Optimizely PMBuilding a Culture of Product Experimentation by Optimizely PM
Building a Culture of Product Experimentation by Optimizely PM
 

Viewers also liked

Delivering Increased Relevance and Revenue with Automated Emails
Delivering Increased Relevance and Revenue with Automated EmailsDelivering Increased Relevance and Revenue with Automated Emails
Delivering Increased Relevance and Revenue with Automated EmailsVivastream
 
Developing Complete Customer Centricity
Developing Complete Customer CentricityDeveloping Complete Customer Centricity
Developing Complete Customer CentricityVivastream
 
Real Time Marketing: Tools and Techniques to Own the Moment
Real Time Marketing: Tools and Techniques to Own the MomentReal Time Marketing: Tools and Techniques to Own the Moment
Real Time Marketing: Tools and Techniques to Own the MomentVivastream
 
How Top Brands Are Going Social for Lead Generation
How Top Brands Are Going Social for Lead GenerationHow Top Brands Are Going Social for Lead Generation
How Top Brands Are Going Social for Lead GenerationVivastream
 
Integrated Marketing Analytics & Data-Driven Intelligence: Module 4
Integrated Marketing Analytics & Data-Driven Intelligence: Module 4Integrated Marketing Analytics & Data-Driven Intelligence: Module 4
Integrated Marketing Analytics & Data-Driven Intelligence: Module 4Vivastream
 

Viewers also liked (6)

SMB Niche
SMB NicheSMB Niche
SMB Niche
 
Delivering Increased Relevance and Revenue with Automated Emails
Delivering Increased Relevance and Revenue with Automated EmailsDelivering Increased Relevance and Revenue with Automated Emails
Delivering Increased Relevance and Revenue with Automated Emails
 
Developing Complete Customer Centricity
Developing Complete Customer CentricityDeveloping Complete Customer Centricity
Developing Complete Customer Centricity
 
Real Time Marketing: Tools and Techniques to Own the Moment
Real Time Marketing: Tools and Techniques to Own the MomentReal Time Marketing: Tools and Techniques to Own the Moment
Real Time Marketing: Tools and Techniques to Own the Moment
 
How Top Brands Are Going Social for Lead Generation
How Top Brands Are Going Social for Lead GenerationHow Top Brands Are Going Social for Lead Generation
How Top Brands Are Going Social for Lead Generation
 
Integrated Marketing Analytics & Data-Driven Intelligence: Module 4
Integrated Marketing Analytics & Data-Driven Intelligence: Module 4Integrated Marketing Analytics & Data-Driven Intelligence: Module 4
Integrated Marketing Analytics & Data-Driven Intelligence: Module 4
 

Similar to Creating Value Testing

Meta-Analyses in Experimentation: The Whats and Hows
Meta-Analyses in Experimentation: The Whats and HowsMeta-Analyses in Experimentation: The Whats and Hows
Meta-Analyses in Experimentation: The Whats and HowsVWO
 
Experimentation for PMs: A Primer by Amazon Director of Product
Experimentation for PMs: A Primer by Amazon Director of ProductExperimentation for PMs: A Primer by Amazon Director of Product
Experimentation for PMs: A Primer by Amazon Director of ProductProduct School
 
WEBINAR: How to Set Up and Run Hypothesis Tests (ENCORE!)
WEBINAR: How to Set Up and Run Hypothesis Tests (ENCORE!)WEBINAR: How to Set Up and Run Hypothesis Tests (ENCORE!)
WEBINAR: How to Set Up and Run Hypothesis Tests (ENCORE!)GoLeanSixSigma.com
 
Continuous discovery - Caitlin Blackwell
Continuous discovery - Caitlin BlackwellContinuous discovery - Caitlin Blackwell
Continuous discovery - Caitlin BlackwellProduct Anonymous
 
Data driven design
Data driven designData driven design
Data driven designSean Byrnes
 
How to Effectively Experiment in PM by LendingTree Sr PM
How to Effectively Experiment in PM by LendingTree Sr PMHow to Effectively Experiment in PM by LendingTree Sr PM
How to Effectively Experiment in PM by LendingTree Sr PMProduct School
 
Agile Metrics...That Matter
Agile Metrics...That MatterAgile Metrics...That Matter
Agile Metrics...That MatterErik Weber
 
Stop Maintaining Multiple Test Environments
Stop Maintaining Multiple Test EnvironmentsStop Maintaining Multiple Test Environments
Stop Maintaining Multiple Test EnvironmentsTechWell
 
Research and Discovery Tools for Experimentation - 17 Apr 2024 - v 2.3 (1).pdf
Research and Discovery Tools for Experimentation - 17 Apr 2024 - v 2.3 (1).pdfResearch and Discovery Tools for Experimentation - 17 Apr 2024 - v 2.3 (1).pdf
Research and Discovery Tools for Experimentation - 17 Apr 2024 - v 2.3 (1).pdfVWO
 
UXSG2014 Workshop (Day 1) - Lean Startup (Bryan Long)
UXSG2014 Workshop (Day 1) - Lean Startup (Bryan Long)UXSG2014 Workshop (Day 1) - Lean Startup (Bryan Long)
UXSG2014 Workshop (Day 1) - Lean Startup (Bryan Long)ux singapore
 
A/B Testing Best Practices - Do's and Don'ts
A/B Testing Best Practices - Do's and Don'tsA/B Testing Best Practices - Do's and Don'ts
A/B Testing Best Practices - Do's and Don'tsRamkumar Ravichandran
 
Mal12 qa tand-automatedtesting
Mal12 qa tand-automatedtestingMal12 qa tand-automatedtesting
Mal12 qa tand-automatedtestingandytinkham
 
Continuous Testing: Preparing for DevOps
Continuous Testing: Preparing for DevOpsContinuous Testing: Preparing for DevOps
Continuous Testing: Preparing for DevOpsSTePINForum
 
Eworks WSI Cyprus online testing oct 2010
Eworks WSI Cyprus online testing oct 2010Eworks WSI Cyprus online testing oct 2010
Eworks WSI Cyprus online testing oct 2010EworksWSI Cyprus
 
Fail your Way to Success - For Learning Organisations
Fail your Way to Success - For Learning OrganisationsFail your Way to Success - For Learning Organisations
Fail your Way to Success - For Learning OrganisationsAndrea Darabos
 
Your A/B Tests are Lying to You
Your A/B Tests are Lying to YouYour A/B Tests are Lying to You
Your A/B Tests are Lying to YouJohn Clevenger
 

Similar to Creating Value Testing (20)

Meta-Analyses in Experimentation: The Whats and Hows
Meta-Analyses in Experimentation: The Whats and HowsMeta-Analyses in Experimentation: The Whats and Hows
Meta-Analyses in Experimentation: The Whats and Hows
 
Lean Startup 301
Lean Startup 301Lean Startup 301
Lean Startup 301
 
Experimentation for PMs: A Primer by Amazon Director of Product
Experimentation for PMs: A Primer by Amazon Director of ProductExperimentation for PMs: A Primer by Amazon Director of Product
Experimentation for PMs: A Primer by Amazon Director of Product
 
WEBINAR: How to Set Up and Run Hypothesis Tests (ENCORE!)
WEBINAR: How to Set Up and Run Hypothesis Tests (ENCORE!)WEBINAR: How to Set Up and Run Hypothesis Tests (ENCORE!)
WEBINAR: How to Set Up and Run Hypothesis Tests (ENCORE!)
 
Continuous discovery - Caitlin Blackwell
Continuous discovery - Caitlin BlackwellContinuous discovery - Caitlin Blackwell
Continuous discovery - Caitlin Blackwell
 
Data driven design
Data driven designData driven design
Data driven design
 
How to Effectively Experiment in PM by LendingTree Sr PM
How to Effectively Experiment in PM by LendingTree Sr PMHow to Effectively Experiment in PM by LendingTree Sr PM
How to Effectively Experiment in PM by LendingTree Sr PM
 
Agile Metrics...That Matter
Agile Metrics...That MatterAgile Metrics...That Matter
Agile Metrics...That Matter
 
Stop Maintaining Multiple Test Environments
Stop Maintaining Multiple Test EnvironmentsStop Maintaining Multiple Test Environments
Stop Maintaining Multiple Test Environments
 
Research and Discovery Tools for Experimentation - 17 Apr 2024 - v 2.3 (1).pdf
Research and Discovery Tools for Experimentation - 17 Apr 2024 - v 2.3 (1).pdfResearch and Discovery Tools for Experimentation - 17 Apr 2024 - v 2.3 (1).pdf
Research and Discovery Tools for Experimentation - 17 Apr 2024 - v 2.3 (1).pdf
 
Martijn Beijk & Charles Goodall
Martijn Beijk & Charles GoodallMartijn Beijk & Charles Goodall
Martijn Beijk & Charles Goodall
 
Brooks Bell Interactive Tama Presentation
Brooks Bell Interactive Tama PresentationBrooks Bell Interactive Tama Presentation
Brooks Bell Interactive Tama Presentation
 
UXSG2014 Workshop (Day 1) - Lean Startup (Bryan Long)
UXSG2014 Workshop (Day 1) - Lean Startup (Bryan Long)UXSG2014 Workshop (Day 1) - Lean Startup (Bryan Long)
UXSG2014 Workshop (Day 1) - Lean Startup (Bryan Long)
 
A/B Testing Best Practices - Do's and Don'ts
A/B Testing Best Practices - Do's and Don'tsA/B Testing Best Practices - Do's and Don'ts
A/B Testing Best Practices - Do's and Don'ts
 
Mal12 qa tand-automatedtesting
Mal12 qa tand-automatedtestingMal12 qa tand-automatedtesting
Mal12 qa tand-automatedtesting
 
Continuous Testing: Preparing for DevOps
Continuous Testing: Preparing for DevOpsContinuous Testing: Preparing for DevOps
Continuous Testing: Preparing for DevOps
 
Eworks WSI Cyprus online testing oct 2010
Eworks WSI Cyprus online testing oct 2010Eworks WSI Cyprus online testing oct 2010
Eworks WSI Cyprus online testing oct 2010
 
Fail your Way to Success - For Learning Organisations
Fail your Way to Success - For Learning OrganisationsFail your Way to Success - For Learning Organisations
Fail your Way to Success - For Learning Organisations
 
Updated PPT
Updated PPTUpdated PPT
Updated PPT
 
Your A/B Tests are Lying to You
Your A/B Tests are Lying to YouYour A/B Tests are Lying to You
Your A/B Tests are Lying to You
 

More from Vivastream

Exchange Solutions Datasheet_Ecommerce
Exchange Solutions Datasheet_EcommerceExchange Solutions Datasheet_Ecommerce
Exchange Solutions Datasheet_EcommerceVivastream
 
Exchange Solutions Datasheet_Customer Engagement Roadmap
Exchange Solutions Datasheet_Customer Engagement RoadmapExchange Solutions Datasheet_Customer Engagement Roadmap
Exchange Solutions Datasheet_Customer Engagement RoadmapVivastream
 
Vivastream Poster
Vivastream PosterVivastream Poster
Vivastream PosterVivastream
 
Vivastream Poster
Vivastream PosterVivastream Poster
Vivastream PosterVivastream
 
Breaking Up is Hard to Do: Small Businesses’ Love Affair with Checks
Breaking Up is Hard to Do: Small Businesses’ Love Affair with ChecksBreaking Up is Hard to Do: Small Businesses’ Love Affair with Checks
Breaking Up is Hard to Do: Small Businesses’ Love Affair with ChecksVivastream
 
EY Smart Commerce Report
EY Smart Commerce ReportEY Smart Commerce Report
EY Smart Commerce ReportVivastream
 
EY Global Consumer Banking Survey 2014
EY Global Consumer Banking Survey 2014EY Global Consumer Banking Survey 2014
EY Global Consumer Banking Survey 2014Vivastream
 
EY Global Consumer Banking Survey
EY Global Consumer Banking SurveyEY Global Consumer Banking Survey
EY Global Consumer Banking SurveyVivastream
 
Automation for RDC and Mobile
Automation for RDC and MobileAutomation for RDC and Mobile
Automation for RDC and MobileVivastream
 
Healthcare Payments Automation Center
Healthcare Payments Automation CenterHealthcare Payments Automation Center
Healthcare Payments Automation CenterVivastream
 
Next Generation Recognition Solutions
Next Generation Recognition SolutionsNext Generation Recognition Solutions
Next Generation Recognition SolutionsVivastream
 
Automation Services
Automation ServicesAutomation Services
Automation ServicesVivastream
 
Company Overview
Company OverviewCompany Overview
Company OverviewVivastream
 

More from Vivastream (20)

Exchange Solutions Datasheet_Ecommerce
Exchange Solutions Datasheet_EcommerceExchange Solutions Datasheet_Ecommerce
Exchange Solutions Datasheet_Ecommerce
 
Exchange Solutions Datasheet_Customer Engagement Roadmap
Exchange Solutions Datasheet_Customer Engagement RoadmapExchange Solutions Datasheet_Customer Engagement Roadmap
Exchange Solutions Datasheet_Customer Engagement Roadmap
 
Test
TestTest
Test
 
Tcap
TcapTcap
Tcap
 
SQA
SQASQA
SQA
 
Jeeva jessf
Jeeva jessfJeeva jessf
Jeeva jessf
 
Vivastream Poster
Vivastream PosterVivastream Poster
Vivastream Poster
 
Vivastream Poster
Vivastream PosterVivastream Poster
Vivastream Poster
 
APEX
APEXAPEX
APEX
 
Breaking Up is Hard to Do: Small Businesses’ Love Affair with Checks
Breaking Up is Hard to Do: Small Businesses’ Love Affair with ChecksBreaking Up is Hard to Do: Small Businesses’ Love Affair with Checks
Breaking Up is Hard to Do: Small Businesses’ Love Affair with Checks
 
EY Smart Commerce Report
EY Smart Commerce ReportEY Smart Commerce Report
EY Smart Commerce Report
 
EY Global Consumer Banking Survey 2014
EY Global Consumer Banking Survey 2014EY Global Consumer Banking Survey 2014
EY Global Consumer Banking Survey 2014
 
EY Global Consumer Banking Survey
EY Global Consumer Banking SurveyEY Global Consumer Banking Survey
EY Global Consumer Banking Survey
 
Serano
SeranoSerano
Serano
 
Accura XV
Accura XVAccura XV
Accura XV
 
Automation for RDC and Mobile
Automation for RDC and MobileAutomation for RDC and Mobile
Automation for RDC and Mobile
 
Healthcare Payments Automation Center
Healthcare Payments Automation CenterHealthcare Payments Automation Center
Healthcare Payments Automation Center
 
Next Generation Recognition Solutions
Next Generation Recognition SolutionsNext Generation Recognition Solutions
Next Generation Recognition Solutions
 
Automation Services
Automation ServicesAutomation Services
Automation Services
 
Company Overview
Company OverviewCompany Overview
Company Overview
 

Recently uploaded

Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)wesley chun
 
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemkeProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemkeProduct Anonymous
 
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationFrom Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationSafe Software
 
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law DevelopmentsTrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law DevelopmentsTrustArc
 
Partners Life - Insurer Innovation Award 2024
Partners Life - Insurer Innovation Award 2024Partners Life - Insurer Innovation Award 2024
Partners Life - Insurer Innovation Award 2024The Digital Insurer
 
The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024Rafal Los
 
A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)Gabriella Davis
 
Scaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationScaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationRadu Cotescu
 
MINDCTI Revenue Release Quarter One 2024
MINDCTI Revenue Release Quarter One 2024MINDCTI Revenue Release Quarter One 2024
MINDCTI Revenue Release Quarter One 2024MIND CTI
 
Artificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : UncertaintyArtificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : UncertaintyKhushali Kathiriya
 
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, AdobeApidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobeapidays
 
HTML Injection Attacks: Impact and Mitigation Strategies
HTML Injection Attacks: Impact and Mitigation StrategiesHTML Injection Attacks: Impact and Mitigation Strategies
HTML Injection Attacks: Impact and Mitigation StrategiesBoston Institute of Analytics
 
Manulife - Insurer Innovation Award 2024
Manulife - Insurer Innovation Award 2024Manulife - Insurer Innovation Award 2024
Manulife - Insurer Innovation Award 2024The Digital Insurer
 
Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...
Workshop - Best of Both Worlds_ Combine  KG and Vector search for  enhanced R...Workshop - Best of Both Worlds_ Combine  KG and Vector search for  enhanced R...
Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...Neo4j
 
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...apidays
 
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost SavingRepurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost SavingEdi Saputra
 
2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...Martijn de Jong
 
Real Time Object Detection Using Open CV
Real Time Object Detection Using Open CVReal Time Object Detection Using Open CV
Real Time Object Detection Using Open CVKhem
 
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024The Digital Insurer
 
presentation ICT roal in 21st century education
presentation ICT roal in 21st century educationpresentation ICT roal in 21st century education
presentation ICT roal in 21st century educationjfdjdjcjdnsjd
 

Recently uploaded (20)

Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)
 
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemkeProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
 
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationFrom Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
 
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law DevelopmentsTrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
 
Partners Life - Insurer Innovation Award 2024
Partners Life - Insurer Innovation Award 2024Partners Life - Insurer Innovation Award 2024
Partners Life - Insurer Innovation Award 2024
 
The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024
 
A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)
 
Scaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationScaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organization
 
MINDCTI Revenue Release Quarter One 2024
MINDCTI Revenue Release Quarter One 2024MINDCTI Revenue Release Quarter One 2024
MINDCTI Revenue Release Quarter One 2024
 
Artificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : UncertaintyArtificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : Uncertainty
 
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, AdobeApidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
 
HTML Injection Attacks: Impact and Mitigation Strategies
HTML Injection Attacks: Impact and Mitigation StrategiesHTML Injection Attacks: Impact and Mitigation Strategies
HTML Injection Attacks: Impact and Mitigation Strategies
 
Manulife - Insurer Innovation Award 2024
Manulife - Insurer Innovation Award 2024Manulife - Insurer Innovation Award 2024
Manulife - Insurer Innovation Award 2024
 
Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...
Workshop - Best of Both Worlds_ Combine  KG and Vector search for  enhanced R...Workshop - Best of Both Worlds_ Combine  KG and Vector search for  enhanced R...
Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...
 
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
 
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost SavingRepurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
 
2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...
 
Real Time Object Detection Using Open CV
Real Time Object Detection Using Open CVReal Time Object Detection Using Open CV
Real Time Object Detection Using Open CV
 
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
 
presentation ICT roal in 21st century education
presentation ICT roal in 21st century educationpresentation ICT roal in 21st century education
presentation ICT roal in 21st century education
 

Creating Value Testing

Editor's Notes

  1. Increasing pressure to get merchandise selection right
  2. Important to challenge how the results will be applied in the future
  3. Results when mailed a catalog. What’s going on here? When they click thru an email recently, they’re less likely to make a purchase in the following 8 weeks??
  4. For example, add an item to back ordered item and get free shipping is just a cool test, but there’s no control. It either works or doesn’t, and there’s nothing special to measure.
  5. Control/Test not descriptive
  6. 10 minutes