SlideShare a Scribd company logo
1 of 27
The Insider’s Guide To
Running Amazon Split Tests
1
Tuesday, August 9th
A Fun Game:
Which Test Won?
**These are not the exact products used, but representative products to preserve
the sellers’ privacy.
2
Enter Your Guesses In The Survey...
3
4
Main Feature Image Test: Larger Product vs. Smaller Product + Include Packaging
Variation A Variation B
5
Sale Price vs. No Sale Price
Variation A
Variation B
6
Detailed Graphics vs. Lifestyle Product Image
Variation A Variation B
And The Winners Are...
7
Improved Daily Profit By 45%
Improved Conversion Rate 17%
Larger Product, No Packaging
Improved Conversion Rate
21%
No Sale Price
Improved Sales by 22%
Improved Conversion Rate
19%
Infographic
The Takeaway:
You never know what will perform
best…..until you run tests with actual
data!
8
9
Amazon is getting more competitive and
crowded.
Optimizing your listing is ever more important.
9,000 people selling “bbq gloves”.
How can you compete?
Answer:
Run Split Tests
What is split
testing?
Controlled | Randomized | Experiment
Between two or more variations...
10
Will lead to Improved Metrics
(ie click through rate,
conversions, profits, etc)
How Split Testing Works
Control (original)
Variation
Distribute traffic between original and variation
(visitor doesn’t know they are part of a test)
Accumulate enough data to identify a *statistically
significant* change in visitor behavior
“Statistically Significant” is the likelihood that a
change (ie conversion rate) is not due to random
chance.
This gives you confidence that the changes you
make actually have an impact!
11
Challenges to split testing on Amazon:
↪ You must work within Amazon’s guidelines (character limits, formatting, etc)
↪ All traffic must go to only one page
↪ Amazon only gives traffic data on a daily basis (therefore must make changes
daily at 12 midnight)
12
High Impact Test #1: Price
In a low-priced niche (ie price sensitive
consumer), would a change in price
change the profits?
13
↪ Large changes +/- $2.00
↪ Small changes $x.97 vs $x.88 vs. $x.99
Recommended Price Tests
14
↪ Highly Competitive Niche - Try
small incremental changes
↪ Low Competition - Try Increasing
your price by $1 or $2
↪ Differentiated/Improved Product -
Increase price by more than you think
Pricing Example: A cheaper price will generate more
clicks and sales
$18.60
Sponsored Ads
Hypothesis:
Adjusting pricing (to $9.99) will generate more clicks,
and sales.
I may make less profit per unit sold, but overall will get
more sales.
Ultimately, I should increase my profits.
15
$19.99
$14.99
$18.99
$9.99
High Impact Test #2: Main Feature
Image
Top search results for “bocce set”
Could the top organic result get a higher click
through rate with a different image?
With an undifferentiated product (ie colored balls),
would a change in main image increase the click
through rate?
16
Sponsored Ads
Image Test: Make it appear a lot is included with your item
You can combine images of
your product to feature
different aspects.
Variation A shows a large
version of the balls, as well as
the carrying case.
17
Control Variation A
Image Test: Example 2
VS
18
Image Test:
Bring the Product
To Life
19
Instead of (photoshopped) two-
dimensional images, try showing
it in action.
Minimal Propping is OK in main
image as long as it does not
confuse the customer.
Image Test: “Explain” Your Product Visually
20
Use diagrams and notations to show the differentiating features of your product.
This helps quickly convey information that they may not read in your listing’s text.
vs.
vs.
Image Test: Show Interesting Product
Photos
21
Roasting sticks would be just a line if you
included the whole image.
Competitors Included the whole packaging.
Our solution:
Stand out with a unique angle, product
composition, close-up image.
Split Testing Best Practices
Run your test until 90% or 95% statistical significance - minimum 2 weeks (ie
know that your changes will have a positive impact!)
❗Only test one thing at a time.
❗Start with easier tests (price and image) vs. more nuanced tests (product
description)
❗Switch variations every day (at midnight) to account for day-to-day or seasonal
changes
22
Automate Your Split Testing with Splitly
Results from a recent pricing test.
Hypothesis: decreasing the price by a dollar would increase sessions,
conversion rate, and sales.
29% more page views
66% more sales
33% higher conversion rate 32% HIGHER PROFITS!
23
Splitly Data: Rotation Log
24
Review the key metrics for every variant on a given day...
Splitly Data: Test Summary
Or view the test
summary in a
simple dashboard.
The Variation
showed
improvements
across the board.
This is a good
thing!
25
Impact on Profits
from Test Results
For example, Jungle Stix sells
$16,000/month in sales, $4,800/profit
33% increase in profits =
$1584 per
month, $19,000
per year, straight to
the bottom line!
Continue to optimize for different
metrics (CTR, Conv. Rate,
Impressions)
Run automated tests on each
product you sell
26
Try Splitly Today:
Get 50% Off Your First
Month
(exclusive offer through 8/12 at 11:59p PST)
www.splitly.com/js
27

More Related Content

What's hot

Million Dollar Case Study Europe – Session #19 – MDCS Updates
Million Dollar Case Study Europe – Session #19 – MDCS UpdatesMillion Dollar Case Study Europe – Session #19 – MDCS Updates
Million Dollar Case Study Europe – Session #19 – MDCS UpdatesKym Ellis
 
Million Dollar Case Study: Europe – Session #16 – Launching With Amazon PPC
Million Dollar Case Study: Europe – Session #16 – Launching With Amazon PPCMillion Dollar Case Study: Europe – Session #16 – Launching With Amazon PPC
Million Dollar Case Study: Europe – Session #16 – Launching With Amazon PPCKym Ellis
 
AMAZON PPC: HOW HIGH-VOLUME SELLERS ARE MANAGING THEIR CAMPAIGNS
AMAZON PPC: HOW HIGH-VOLUME SELLERS ARE MANAGING THEIR CAMPAIGNSAMAZON PPC: HOW HIGH-VOLUME SELLERS ARE MANAGING THEIR CAMPAIGNS
AMAZON PPC: HOW HIGH-VOLUME SELLERS ARE MANAGING THEIR CAMPAIGNSAndrew Maff
 
Amazon PPC automation with Sellics
Amazon PPC automation with SellicsAmazon PPC automation with Sellics
Amazon PPC automation with SellicsFranz Jordan
 
Brightpearl - Fulfillment & Inventory Control Management for Amazon Sellers
Brightpearl - Fulfillment & Inventory Control Management for Amazon SellersBrightpearl - Fulfillment & Inventory Control Management for Amazon Sellers
Brightpearl - Fulfillment & Inventory Control Management for Amazon SellersTinuiti
 
Accelerating Amazon Sales Strategy for Q4 2015: Day 2
Accelerating Amazon Sales Strategy for Q4 2015: Day 2Accelerating Amazon Sales Strategy for Q4 2015: Day 2
Accelerating Amazon Sales Strategy for Q4 2015: Day 2Jon Gregoire
 
How to Generate Product Reviews on Amazon
How to Generate Product Reviews on AmazonHow to Generate Product Reviews on Amazon
How to Generate Product Reviews on AmazonTinuiti
 
How To Drive Incremental Sales on Amazon – We Found The Missing Link
How To Drive Incremental Sales on Amazon – We Found The Missing LinkHow To Drive Incremental Sales on Amazon – We Found The Missing Link
How To Drive Incremental Sales on Amazon – We Found The Missing LinkDaytodayebay
 
Cpc Strategy & Amazon on the New Sponsored Products Updates
Cpc Strategy & Amazon on the New Sponsored Products UpdatesCpc Strategy & Amazon on the New Sponsored Products Updates
Cpc Strategy & Amazon on the New Sponsored Products UpdatesJon Gregoire
 
A SMART PRODUCT REVIEW STRATEGY FOR LAUNCHING NEW PRODUCTS AS A 3p SELLER
A SMART PRODUCT REVIEW STRATEGY FOR LAUNCHING NEW PRODUCTS AS A 3p SELLERA SMART PRODUCT REVIEW STRATEGY FOR LAUNCHING NEW PRODUCTS AS A 3p SELLER
A SMART PRODUCT REVIEW STRATEGY FOR LAUNCHING NEW PRODUCTS AS A 3p SELLERTinuiti
 
AmafestUK 2020 -Florian nottorf - 5 Amazon PPC Hacks:Maximize sales on amazon...
AmafestUK 2020 -Florian nottorf - 5 Amazon PPC Hacks:Maximize sales on amazon...AmafestUK 2020 -Florian nottorf - 5 Amazon PPC Hacks:Maximize sales on amazon...
AmafestUK 2020 -Florian nottorf - 5 Amazon PPC Hacks:Maximize sales on amazon...Daytodayebay
 
The 2017 Amazon Virtual Summit: Day 3
The 2017 Amazon Virtual Summit: Day 3The 2017 Amazon Virtual Summit: Day 3
The 2017 Amazon Virtual Summit: Day 3Tinuiti
 
Beginners Guide to Amazon Ads
Beginners Guide to Amazon AdsBeginners Guide to Amazon Ads
Beginners Guide to Amazon AdsStoreAutomator
 
How Top Brands Drive Results With Email Personalization
How Top Brands Drive Results With Email PersonalizationHow Top Brands Drive Results With Email Personalization
How Top Brands Drive Results With Email PersonalizationTinuiti
 
Increasing Visibility on the Amazon Marketplace
Increasing Visibility on the Amazon MarketplaceIncreasing Visibility on the Amazon Marketplace
Increasing Visibility on the Amazon MarketplaceTinuiti
 
Teikametrics & CPC Strategy - Assessing Your Fulfillment by Amazon Strategy
Teikametrics & CPC Strategy - Assessing Your Fulfillment by Amazon StrategyTeikametrics & CPC Strategy - Assessing Your Fulfillment by Amazon Strategy
Teikametrics & CPC Strategy - Assessing Your Fulfillment by Amazon StrategyTinuiti
 
The 2017 Amazon Virtual Summit: Day 2
The 2017 Amazon Virtual Summit: Day 2The 2017 Amazon Virtual Summit: Day 2
The 2017 Amazon Virtual Summit: Day 2Tinuiti
 
Amazon product sponsored ads: Case study by BM Consulting
Amazon product sponsored ads: Case study by BM ConsultingAmazon product sponsored ads: Case study by BM Consulting
Amazon product sponsored ads: Case study by BM ConsultingOjaswita Chaturvedi
 
Amazon Marketing Services: The Tool You Need This Holiday Season
Amazon Marketing Services: The Tool You Need This Holiday SeasonAmazon Marketing Services: The Tool You Need This Holiday Season
Amazon Marketing Services: The Tool You Need This Holiday SeasonTinuiti
 

What's hot (20)

Million Dollar Case Study Europe – Session #19 – MDCS Updates
Million Dollar Case Study Europe – Session #19 – MDCS UpdatesMillion Dollar Case Study Europe – Session #19 – MDCS Updates
Million Dollar Case Study Europe – Session #19 – MDCS Updates
 
Million Dollar Case Study: Europe – Session #16 – Launching With Amazon PPC
Million Dollar Case Study: Europe – Session #16 – Launching With Amazon PPCMillion Dollar Case Study: Europe – Session #16 – Launching With Amazon PPC
Million Dollar Case Study: Europe – Session #16 – Launching With Amazon PPC
 
AMAZON PPC: HOW HIGH-VOLUME SELLERS ARE MANAGING THEIR CAMPAIGNS
AMAZON PPC: HOW HIGH-VOLUME SELLERS ARE MANAGING THEIR CAMPAIGNSAMAZON PPC: HOW HIGH-VOLUME SELLERS ARE MANAGING THEIR CAMPAIGNS
AMAZON PPC: HOW HIGH-VOLUME SELLERS ARE MANAGING THEIR CAMPAIGNS
 
Amazon PPC automation with Sellics
Amazon PPC automation with SellicsAmazon PPC automation with Sellics
Amazon PPC automation with Sellics
 
Brightpearl - Fulfillment & Inventory Control Management for Amazon Sellers
Brightpearl - Fulfillment & Inventory Control Management for Amazon SellersBrightpearl - Fulfillment & Inventory Control Management for Amazon Sellers
Brightpearl - Fulfillment & Inventory Control Management for Amazon Sellers
 
Amazon ppc management
Amazon ppc managementAmazon ppc management
Amazon ppc management
 
Accelerating Amazon Sales Strategy for Q4 2015: Day 2
Accelerating Amazon Sales Strategy for Q4 2015: Day 2Accelerating Amazon Sales Strategy for Q4 2015: Day 2
Accelerating Amazon Sales Strategy for Q4 2015: Day 2
 
How to Generate Product Reviews on Amazon
How to Generate Product Reviews on AmazonHow to Generate Product Reviews on Amazon
How to Generate Product Reviews on Amazon
 
How To Drive Incremental Sales on Amazon – We Found The Missing Link
How To Drive Incremental Sales on Amazon – We Found The Missing LinkHow To Drive Incremental Sales on Amazon – We Found The Missing Link
How To Drive Incremental Sales on Amazon – We Found The Missing Link
 
Cpc Strategy & Amazon on the New Sponsored Products Updates
Cpc Strategy & Amazon on the New Sponsored Products UpdatesCpc Strategy & Amazon on the New Sponsored Products Updates
Cpc Strategy & Amazon on the New Sponsored Products Updates
 
A SMART PRODUCT REVIEW STRATEGY FOR LAUNCHING NEW PRODUCTS AS A 3p SELLER
A SMART PRODUCT REVIEW STRATEGY FOR LAUNCHING NEW PRODUCTS AS A 3p SELLERA SMART PRODUCT REVIEW STRATEGY FOR LAUNCHING NEW PRODUCTS AS A 3p SELLER
A SMART PRODUCT REVIEW STRATEGY FOR LAUNCHING NEW PRODUCTS AS A 3p SELLER
 
AmafestUK 2020 -Florian nottorf - 5 Amazon PPC Hacks:Maximize sales on amazon...
AmafestUK 2020 -Florian nottorf - 5 Amazon PPC Hacks:Maximize sales on amazon...AmafestUK 2020 -Florian nottorf - 5 Amazon PPC Hacks:Maximize sales on amazon...
AmafestUK 2020 -Florian nottorf - 5 Amazon PPC Hacks:Maximize sales on amazon...
 
The 2017 Amazon Virtual Summit: Day 3
The 2017 Amazon Virtual Summit: Day 3The 2017 Amazon Virtual Summit: Day 3
The 2017 Amazon Virtual Summit: Day 3
 
Beginners Guide to Amazon Ads
Beginners Guide to Amazon AdsBeginners Guide to Amazon Ads
Beginners Guide to Amazon Ads
 
How Top Brands Drive Results With Email Personalization
How Top Brands Drive Results With Email PersonalizationHow Top Brands Drive Results With Email Personalization
How Top Brands Drive Results With Email Personalization
 
Increasing Visibility on the Amazon Marketplace
Increasing Visibility on the Amazon MarketplaceIncreasing Visibility on the Amazon Marketplace
Increasing Visibility on the Amazon Marketplace
 
Teikametrics & CPC Strategy - Assessing Your Fulfillment by Amazon Strategy
Teikametrics & CPC Strategy - Assessing Your Fulfillment by Amazon StrategyTeikametrics & CPC Strategy - Assessing Your Fulfillment by Amazon Strategy
Teikametrics & CPC Strategy - Assessing Your Fulfillment by Amazon Strategy
 
The 2017 Amazon Virtual Summit: Day 2
The 2017 Amazon Virtual Summit: Day 2The 2017 Amazon Virtual Summit: Day 2
The 2017 Amazon Virtual Summit: Day 2
 
Amazon product sponsored ads: Case study by BM Consulting
Amazon product sponsored ads: Case study by BM ConsultingAmazon product sponsored ads: Case study by BM Consulting
Amazon product sponsored ads: Case study by BM Consulting
 
Amazon Marketing Services: The Tool You Need This Holiday Season
Amazon Marketing Services: The Tool You Need This Holiday SeasonAmazon Marketing Services: The Tool You Need This Holiday Season
Amazon Marketing Services: The Tool You Need This Holiday Season
 

Viewers also liked

Jungle Scout's Million Dollar Case Study - amazon marketing services how to ...
Jungle Scout's Million Dollar Case Study -  amazon marketing services how to ...Jungle Scout's Million Dollar Case Study -  amazon marketing services how to ...
Jungle Scout's Million Dollar Case Study - amazon marketing services how to ...Gen Furukawa
 
Jungle Scout's Million Dollar Case Study Session #20: Amazon Marketing Servic...
Jungle Scout's Million Dollar Case Study Session #20: Amazon Marketing Servic...Jungle Scout's Million Dollar Case Study Session #20: Amazon Marketing Servic...
Jungle Scout's Million Dollar Case Study Session #20: Amazon Marketing Servic...Gen Furukawa
 
Jungle Scout's Million Dollar Case Study Session #10: Tax and Legal Structure
Jungle Scout's Million Dollar Case Study Session #10: Tax and Legal StructureJungle Scout's Million Dollar Case Study Session #10: Tax and Legal Structure
Jungle Scout's Million Dollar Case Study Session #10: Tax and Legal StructureGen Furukawa
 
Jungle Scout's Million Dollar Case Study: Reviewing Samples
Jungle Scout's Million Dollar Case Study: Reviewing SamplesJungle Scout's Million Dollar Case Study: Reviewing Samples
Jungle Scout's Million Dollar Case Study: Reviewing SamplesGen Furukawa
 
The Million Dollar Case Study - Outreach to Suppliers
The Million Dollar Case Study - Outreach to SuppliersThe Million Dollar Case Study - Outreach to Suppliers
The Million Dollar Case Study - Outreach to SuppliersGen Furukawa
 
Jungle Scout's Million Dollar Case Study: Intellectual Property and Protectin...
Jungle Scout's Million Dollar Case Study: Intellectual Property and Protectin...Jungle Scout's Million Dollar Case Study: Intellectual Property and Protectin...
Jungle Scout's Million Dollar Case Study: Intellectual Property and Protectin...Gen Furukawa
 
12 Tips for Creating Amazon Product Listings That Outsell The Competition
12 Tips for Creating Amazon Product Listings That Outsell The Competition12 Tips for Creating Amazon Product Listings That Outsell The Competition
12 Tips for Creating Amazon Product Listings That Outsell The CompetitionGen Furukawa
 
The Secrets of Importing Your Amazon Product
The Secrets of Importing Your Amazon ProductThe Secrets of Importing Your Amazon Product
The Secrets of Importing Your Amazon ProductGen Furukawa
 
Jungle Scout's Million Dollar Case Study Session #8: Shipping & Importing
Jungle Scout's Million Dollar Case Study Session #8: Shipping & ImportingJungle Scout's Million Dollar Case Study Session #8: Shipping & Importing
Jungle Scout's Million Dollar Case Study Session #8: Shipping & ImportingGen Furukawa
 
Million Dollar Case Study: Europe - Session #10 - Amazon Supplier Agreements
Million Dollar Case Study: Europe - Session #10 - Amazon Supplier AgreementsMillion Dollar Case Study: Europe - Session #10 - Amazon Supplier Agreements
Million Dollar Case Study: Europe - Session #10 - Amazon Supplier AgreementsGen Furukawa
 
Jungle Scout's Million Dollar Case Study: Session #2: Advanced Product Research
Jungle Scout's Million Dollar Case Study: Session #2: Advanced Product Research Jungle Scout's Million Dollar Case Study: Session #2: Advanced Product Research
Jungle Scout's Million Dollar Case Study: Session #2: Advanced Product Research Gen Furukawa
 
How To Find A Good Supplier For Your Amazon Product
How To Find A Good Supplier For Your Amazon ProductHow To Find A Good Supplier For Your Amazon Product
How To Find A Good Supplier For Your Amazon ProductGen Furukawa
 
Jungle Scout's Million Dollar Case Study Session #7: Branding & Package Design
Jungle Scout's Million Dollar Case Study Session #7: Branding & Package DesignJungle Scout's Million Dollar Case Study Session #7: Branding & Package Design
Jungle Scout's Million Dollar Case Study Session #7: Branding & Package DesignGen Furukawa
 
Jungle Scout's Million Dollar Case Study: Crafting an optimized amazon listing
Jungle Scout's Million Dollar Case Study: Crafting an optimized amazon listingJungle Scout's Million Dollar Case Study: Crafting an optimized amazon listing
Jungle Scout's Million Dollar Case Study: Crafting an optimized amazon listingGen Furukawa
 
Jungle Scout's Million Dollar Case Study - Inventory Management
Jungle Scout's Million Dollar Case Study -  Inventory Management Jungle Scout's Million Dollar Case Study -  Inventory Management
Jungle Scout's Million Dollar Case Study - Inventory Management Gen Furukawa
 
Jungle Scout's Million Dollar Case Study: How To Find Product Ideas
Jungle Scout's Million Dollar Case Study: How To Find Product IdeasJungle Scout's Million Dollar Case Study: How To Find Product Ideas
Jungle Scout's Million Dollar Case Study: How To Find Product IdeasGen Furukawa
 
Master Inventory Replenishment: The FBA Sellers Guide To Inventory Management
Master Inventory Replenishment: The FBA Sellers Guide To Inventory ManagementMaster Inventory Replenishment: The FBA Sellers Guide To Inventory Management
Master Inventory Replenishment: The FBA Sellers Guide To Inventory ManagementGen Furukawa
 
Jungle Scout's million dollar case study session #16: Updates and Q&A
Jungle Scout's million dollar case study   session #16: Updates and Q&AJungle Scout's million dollar case study   session #16: Updates and Q&A
Jungle Scout's million dollar case study session #16: Updates and Q&AGen Furukawa
 

Viewers also liked (18)

Jungle Scout's Million Dollar Case Study - amazon marketing services how to ...
Jungle Scout's Million Dollar Case Study -  amazon marketing services how to ...Jungle Scout's Million Dollar Case Study -  amazon marketing services how to ...
Jungle Scout's Million Dollar Case Study - amazon marketing services how to ...
 
Jungle Scout's Million Dollar Case Study Session #20: Amazon Marketing Servic...
Jungle Scout's Million Dollar Case Study Session #20: Amazon Marketing Servic...Jungle Scout's Million Dollar Case Study Session #20: Amazon Marketing Servic...
Jungle Scout's Million Dollar Case Study Session #20: Amazon Marketing Servic...
 
Jungle Scout's Million Dollar Case Study Session #10: Tax and Legal Structure
Jungle Scout's Million Dollar Case Study Session #10: Tax and Legal StructureJungle Scout's Million Dollar Case Study Session #10: Tax and Legal Structure
Jungle Scout's Million Dollar Case Study Session #10: Tax and Legal Structure
 
Jungle Scout's Million Dollar Case Study: Reviewing Samples
Jungle Scout's Million Dollar Case Study: Reviewing SamplesJungle Scout's Million Dollar Case Study: Reviewing Samples
Jungle Scout's Million Dollar Case Study: Reviewing Samples
 
The Million Dollar Case Study - Outreach to Suppliers
The Million Dollar Case Study - Outreach to SuppliersThe Million Dollar Case Study - Outreach to Suppliers
The Million Dollar Case Study - Outreach to Suppliers
 
Jungle Scout's Million Dollar Case Study: Intellectual Property and Protectin...
Jungle Scout's Million Dollar Case Study: Intellectual Property and Protectin...Jungle Scout's Million Dollar Case Study: Intellectual Property and Protectin...
Jungle Scout's Million Dollar Case Study: Intellectual Property and Protectin...
 
12 Tips for Creating Amazon Product Listings That Outsell The Competition
12 Tips for Creating Amazon Product Listings That Outsell The Competition12 Tips for Creating Amazon Product Listings That Outsell The Competition
12 Tips for Creating Amazon Product Listings That Outsell The Competition
 
The Secrets of Importing Your Amazon Product
The Secrets of Importing Your Amazon ProductThe Secrets of Importing Your Amazon Product
The Secrets of Importing Your Amazon Product
 
Jungle Scout's Million Dollar Case Study Session #8: Shipping & Importing
Jungle Scout's Million Dollar Case Study Session #8: Shipping & ImportingJungle Scout's Million Dollar Case Study Session #8: Shipping & Importing
Jungle Scout's Million Dollar Case Study Session #8: Shipping & Importing
 
Million Dollar Case Study: Europe - Session #10 - Amazon Supplier Agreements
Million Dollar Case Study: Europe - Session #10 - Amazon Supplier AgreementsMillion Dollar Case Study: Europe - Session #10 - Amazon Supplier Agreements
Million Dollar Case Study: Europe - Session #10 - Amazon Supplier Agreements
 
Jungle Scout's Million Dollar Case Study: Session #2: Advanced Product Research
Jungle Scout's Million Dollar Case Study: Session #2: Advanced Product Research Jungle Scout's Million Dollar Case Study: Session #2: Advanced Product Research
Jungle Scout's Million Dollar Case Study: Session #2: Advanced Product Research
 
How To Find A Good Supplier For Your Amazon Product
How To Find A Good Supplier For Your Amazon ProductHow To Find A Good Supplier For Your Amazon Product
How To Find A Good Supplier For Your Amazon Product
 
Jungle Scout's Million Dollar Case Study Session #7: Branding & Package Design
Jungle Scout's Million Dollar Case Study Session #7: Branding & Package DesignJungle Scout's Million Dollar Case Study Session #7: Branding & Package Design
Jungle Scout's Million Dollar Case Study Session #7: Branding & Package Design
 
Jungle Scout's Million Dollar Case Study: Crafting an optimized amazon listing
Jungle Scout's Million Dollar Case Study: Crafting an optimized amazon listingJungle Scout's Million Dollar Case Study: Crafting an optimized amazon listing
Jungle Scout's Million Dollar Case Study: Crafting an optimized amazon listing
 
Jungle Scout's Million Dollar Case Study - Inventory Management
Jungle Scout's Million Dollar Case Study -  Inventory Management Jungle Scout's Million Dollar Case Study -  Inventory Management
Jungle Scout's Million Dollar Case Study - Inventory Management
 
Jungle Scout's Million Dollar Case Study: How To Find Product Ideas
Jungle Scout's Million Dollar Case Study: How To Find Product IdeasJungle Scout's Million Dollar Case Study: How To Find Product Ideas
Jungle Scout's Million Dollar Case Study: How To Find Product Ideas
 
Master Inventory Replenishment: The FBA Sellers Guide To Inventory Management
Master Inventory Replenishment: The FBA Sellers Guide To Inventory ManagementMaster Inventory Replenishment: The FBA Sellers Guide To Inventory Management
Master Inventory Replenishment: The FBA Sellers Guide To Inventory Management
 
Jungle Scout's million dollar case study session #16: Updates and Q&A
Jungle Scout's million dollar case study   session #16: Updates and Q&AJungle Scout's million dollar case study   session #16: Updates and Q&A
Jungle Scout's million dollar case study session #16: Updates and Q&A
 

Similar to Tthe Insider's Guide to Running Amazon Split Tests

ESOMAR Workshop "The art of pricing"
ESOMAR Workshop "The art of pricing"ESOMAR Workshop "The art of pricing"
ESOMAR Workshop "The art of pricing"SKIM
 
KSS Retail: Challenging Historical Pricing Practices
KSS Retail: Challenging Historical Pricing PracticesKSS Retail: Challenging Historical Pricing Practices
KSS Retail: Challenging Historical Pricing PracticesKSSretail
 
Webinar "The art of pricing"
Webinar "The art of pricing"Webinar "The art of pricing"
Webinar "The art of pricing"SKIM
 
Conflict resolution diagram tutorial
Conflict resolution diagram tutorialConflict resolution diagram tutorial
Conflict resolution diagram tutorialAgileCoach.net
 
Chapter 11 - Pricing
Chapter 11 - PricingChapter 11 - Pricing
Chapter 11 - PricingNicholsb1
 
Amazon Listing Optimizations that Drive Visibility & Sales
Amazon Listing Optimizations that Drive Visibility & SalesAmazon Listing Optimizations that Drive Visibility & Sales
Amazon Listing Optimizations that Drive Visibility & SalesTinuiti
 
Emerce eTravel - 5 startups lessons to build better products faster
Emerce eTravel - 5 startups lessons to build better products fasterEmerce eTravel - 5 startups lessons to build better products faster
Emerce eTravel - 5 startups lessons to build better products fasterMeasureWorks
 
Zuora_Subscription_Pricing_Game_Plan (1)
Zuora_Subscription_Pricing_Game_Plan (1)Zuora_Subscription_Pricing_Game_Plan (1)
Zuora_Subscription_Pricing_Game_Plan (1)Chris Budelli
 
Analysis of Pricing Methods
 Analysis of Pricing Methods Analysis of Pricing Methods
Analysis of Pricing MethodsUdayraj Deshmukh
 
How to Succeed with the New Bing Product Ads
How to Succeed with the New Bing Product AdsHow to Succeed with the New Bing Product Ads
How to Succeed with the New Bing Product AdsTinuiti
 
Custom Advanced Analytics Brochure
Custom Advanced Analytics BrochureCustom Advanced Analytics Brochure
Custom Advanced Analytics Brochurechokanson
 
NPD Custom Research/Advanced Analytics
NPD Custom Research/Advanced AnalyticsNPD Custom Research/Advanced Analytics
NPD Custom Research/Advanced Analyticsbuddhand
 
SMX London 2018 - Improving shopping ads - using price reductions and remarke...
SMX London 2018 - Improving shopping ads - using price reductions and remarke...SMX London 2018 - Improving shopping ads - using price reductions and remarke...
SMX London 2018 - Improving shopping ads - using price reductions and remarke...Ann Stanley
 

Similar to Tthe Insider's Guide to Running Amazon Split Tests (20)

ESOMAR Workshop "The art of pricing"
ESOMAR Workshop "The art of pricing"ESOMAR Workshop "The art of pricing"
ESOMAR Workshop "The art of pricing"
 
Datawiz.io case study
Datawiz.io case studyDatawiz.io case study
Datawiz.io case study
 
KSS Retail: Challenging Historical Pricing Practices
KSS Retail: Challenging Historical Pricing PracticesKSS Retail: Challenging Historical Pricing Practices
KSS Retail: Challenging Historical Pricing Practices
 
PRICING.pptx
PRICING.pptxPRICING.pptx
PRICING.pptx
 
Webinar "The art of pricing"
Webinar "The art of pricing"Webinar "The art of pricing"
Webinar "The art of pricing"
 
Conflict resolution diagram tutorial
Conflict resolution diagram tutorialConflict resolution diagram tutorial
Conflict resolution diagram tutorial
 
Mabaya gh
Mabaya ghMabaya gh
Mabaya gh
 
Chapter 11 - Pricing
Chapter 11 - PricingChapter 11 - Pricing
Chapter 11 - Pricing
 
Amazon Listing Optimizations that Drive Visibility & Sales
Amazon Listing Optimizations that Drive Visibility & SalesAmazon Listing Optimizations that Drive Visibility & Sales
Amazon Listing Optimizations that Drive Visibility & Sales
 
Emerce eTravel - 5 startups lessons to build better products faster
Emerce eTravel - 5 startups lessons to build better products fasterEmerce eTravel - 5 startups lessons to build better products faster
Emerce eTravel - 5 startups lessons to build better products faster
 
Zuora_Subscription_Pricing_Game_Plan (1)
Zuora_Subscription_Pricing_Game_Plan (1)Zuora_Subscription_Pricing_Game_Plan (1)
Zuora_Subscription_Pricing_Game_Plan (1)
 
Analysis of Pricing Methods
 Analysis of Pricing Methods Analysis of Pricing Methods
Analysis of Pricing Methods
 
MarketSim Modeling
MarketSim ModelingMarketSim Modeling
MarketSim Modeling
 
Advanced Google Shopping By Andreas Reiffen
Advanced Google Shopping By Andreas ReiffenAdvanced Google Shopping By Andreas Reiffen
Advanced Google Shopping By Andreas Reiffen
 
How to Succeed with the New Bing Product Ads
How to Succeed with the New Bing Product AdsHow to Succeed with the New Bing Product Ads
How to Succeed with the New Bing Product Ads
 
Amafest 3
Amafest 3Amafest 3
Amafest 3
 
Custom Advanced Analytics Brochure
Custom Advanced Analytics BrochureCustom Advanced Analytics Brochure
Custom Advanced Analytics Brochure
 
NPD Custom Research/Advanced Analytics
NPD Custom Research/Advanced AnalyticsNPD Custom Research/Advanced Analytics
NPD Custom Research/Advanced Analytics
 
The retail and online pricing game
The retail and online pricing gameThe retail and online pricing game
The retail and online pricing game
 
SMX London 2018 - Improving shopping ads - using price reductions and remarke...
SMX London 2018 - Improving shopping ads - using price reductions and remarke...SMX London 2018 - Improving shopping ads - using price reductions and remarke...
SMX London 2018 - Improving shopping ads - using price reductions and remarke...
 

Recently uploaded

The+State+of+Careers+In+Retention+Marketing-2.pdf
The+State+of+Careers+In+Retention+Marketing-2.pdfThe+State+of+Careers+In+Retention+Marketing-2.pdf
The+State+of+Careers+In+Retention+Marketing-2.pdfSocial Samosa
 
Local SEO Domination: Put your business at the forefront of local searches!
Local SEO Domination:  Put your business at the forefront of local searches!Local SEO Domination:  Put your business at the forefront of local searches!
Local SEO Domination: Put your business at the forefront of local searches!dstvtechnician
 
Unraveling the Mystery of the Hinterkaifeck Murders.pptx
Unraveling the Mystery of the Hinterkaifeck Murders.pptxUnraveling the Mystery of the Hinterkaifeck Murders.pptx
Unraveling the Mystery of the Hinterkaifeck Murders.pptxelizabethella096
 
Branding strategies of new company .pptx
Branding strategies of new company .pptxBranding strategies of new company .pptx
Branding strategies of new company .pptxVikasTiwari846641
 
Brand experience Dream Center Peoria Presentation.pdf
Brand experience Dream Center Peoria Presentation.pdfBrand experience Dream Center Peoria Presentation.pdf
Brand experience Dream Center Peoria Presentation.pdftbatkhuu1
 
Uncover Insightful User Journey Secrets Using GA4 Reports
Uncover Insightful User Journey Secrets Using GA4 ReportsUncover Insightful User Journey Secrets Using GA4 Reports
Uncover Insightful User Journey Secrets Using GA4 ReportsVWO
 
Factors-Influencing-Branding-Strategies.pptx
Factors-Influencing-Branding-Strategies.pptxFactors-Influencing-Branding-Strategies.pptx
Factors-Influencing-Branding-Strategies.pptxVikasTiwari846641
 
BLOOM_April2024. Balmer Lawrie Online Monthly Bulletin
BLOOM_April2024. Balmer Lawrie Online Monthly BulletinBLOOM_April2024. Balmer Lawrie Online Monthly Bulletin
BLOOM_April2024. Balmer Lawrie Online Monthly BulletinBalmerLawrie
 
Brand experience Peoria City Soccer Presentation.pdf
Brand experience Peoria City Soccer Presentation.pdfBrand experience Peoria City Soccer Presentation.pdf
Brand experience Peoria City Soccer Presentation.pdftbatkhuu1
 
Unraveling the Mystery of The Circleville Letters.pptx
Unraveling the Mystery of The Circleville Letters.pptxUnraveling the Mystery of The Circleville Letters.pptx
Unraveling the Mystery of The Circleville Letters.pptxelizabethella096
 
Enjoy Night⚡Call Girls Dlf City Phase 4 Gurgaon >༒8448380779 Escort Service
Enjoy Night⚡Call Girls Dlf City Phase 4 Gurgaon >༒8448380779 Escort ServiceEnjoy Night⚡Call Girls Dlf City Phase 4 Gurgaon >༒8448380779 Escort Service
Enjoy Night⚡Call Girls Dlf City Phase 4 Gurgaon >༒8448380779 Escort ServiceDelhi Call girls
 
Brighton SEO April 2024 - The Good, the Bad & the Ugly of SEO Success
Brighton SEO April 2024 - The Good, the Bad & the Ugly of SEO SuccessBrighton SEO April 2024 - The Good, the Bad & the Ugly of SEO Success
Brighton SEO April 2024 - The Good, the Bad & the Ugly of SEO SuccessVarn
 
Moving beyond multi-touch attribution - DigiMarCon CanWest 2024
Moving beyond multi-touch attribution - DigiMarCon CanWest 2024Moving beyond multi-touch attribution - DigiMarCon CanWest 2024
Moving beyond multi-touch attribution - DigiMarCon CanWest 2024Richard Ingilby
 
VIP 7001035870 Find & Meet Hyderabad Call Girls Film Nagar high-profile Call ...
VIP 7001035870 Find & Meet Hyderabad Call Girls Film Nagar high-profile Call ...VIP 7001035870 Find & Meet Hyderabad Call Girls Film Nagar high-profile Call ...
VIP 7001035870 Find & Meet Hyderabad Call Girls Film Nagar high-profile Call ...aditipandeya
 
What is Google Search Console and What is it provide?
What is Google Search Console and What is it provide?What is Google Search Console and What is it provide?
What is Google Search Console and What is it provide?riteshhsociall
 

Recently uploaded (20)

Brand Strategy Master Class - Juntae DeLane
Brand Strategy Master Class - Juntae DeLaneBrand Strategy Master Class - Juntae DeLane
Brand Strategy Master Class - Juntae DeLane
 
The+State+of+Careers+In+Retention+Marketing-2.pdf
The+State+of+Careers+In+Retention+Marketing-2.pdfThe+State+of+Careers+In+Retention+Marketing-2.pdf
The+State+of+Careers+In+Retention+Marketing-2.pdf
 
Local SEO Domination: Put your business at the forefront of local searches!
Local SEO Domination:  Put your business at the forefront of local searches!Local SEO Domination:  Put your business at the forefront of local searches!
Local SEO Domination: Put your business at the forefront of local searches!
 
Unraveling the Mystery of the Hinterkaifeck Murders.pptx
Unraveling the Mystery of the Hinterkaifeck Murders.pptxUnraveling the Mystery of the Hinterkaifeck Murders.pptx
Unraveling the Mystery of the Hinterkaifeck Murders.pptx
 
Branding strategies of new company .pptx
Branding strategies of new company .pptxBranding strategies of new company .pptx
Branding strategies of new company .pptx
 
Brand experience Dream Center Peoria Presentation.pdf
Brand experience Dream Center Peoria Presentation.pdfBrand experience Dream Center Peoria Presentation.pdf
Brand experience Dream Center Peoria Presentation.pdf
 
Top 5 Breakthrough AI Innovations Elevating Content Creation and Personalizat...
Top 5 Breakthrough AI Innovations Elevating Content Creation and Personalizat...Top 5 Breakthrough AI Innovations Elevating Content Creation and Personalizat...
Top 5 Breakthrough AI Innovations Elevating Content Creation and Personalizat...
 
Uncover Insightful User Journey Secrets Using GA4 Reports
Uncover Insightful User Journey Secrets Using GA4 ReportsUncover Insightful User Journey Secrets Using GA4 Reports
Uncover Insightful User Journey Secrets Using GA4 Reports
 
Factors-Influencing-Branding-Strategies.pptx
Factors-Influencing-Branding-Strategies.pptxFactors-Influencing-Branding-Strategies.pptx
Factors-Influencing-Branding-Strategies.pptx
 
BLOOM_April2024. Balmer Lawrie Online Monthly Bulletin
BLOOM_April2024. Balmer Lawrie Online Monthly BulletinBLOOM_April2024. Balmer Lawrie Online Monthly Bulletin
BLOOM_April2024. Balmer Lawrie Online Monthly Bulletin
 
Brand experience Peoria City Soccer Presentation.pdf
Brand experience Peoria City Soccer Presentation.pdfBrand experience Peoria City Soccer Presentation.pdf
Brand experience Peoria City Soccer Presentation.pdf
 
Unraveling the Mystery of The Circleville Letters.pptx
Unraveling the Mystery of The Circleville Letters.pptxUnraveling the Mystery of The Circleville Letters.pptx
Unraveling the Mystery of The Circleville Letters.pptx
 
Enjoy Night⚡Call Girls Dlf City Phase 4 Gurgaon >༒8448380779 Escort Service
Enjoy Night⚡Call Girls Dlf City Phase 4 Gurgaon >༒8448380779 Escort ServiceEnjoy Night⚡Call Girls Dlf City Phase 4 Gurgaon >༒8448380779 Escort Service
Enjoy Night⚡Call Girls Dlf City Phase 4 Gurgaon >༒8448380779 Escort Service
 
Brighton SEO April 2024 - The Good, the Bad & the Ugly of SEO Success
Brighton SEO April 2024 - The Good, the Bad & the Ugly of SEO SuccessBrighton SEO April 2024 - The Good, the Bad & the Ugly of SEO Success
Brighton SEO April 2024 - The Good, the Bad & the Ugly of SEO Success
 
Creator Influencer Strategy Master Class - Corinne Rose Guirgis
Creator Influencer Strategy Master Class - Corinne Rose GuirgisCreator Influencer Strategy Master Class - Corinne Rose Guirgis
Creator Influencer Strategy Master Class - Corinne Rose Guirgis
 
SEO Master Class - Steve Wiideman, Wiideman Consulting Group
SEO Master Class - Steve Wiideman, Wiideman Consulting GroupSEO Master Class - Steve Wiideman, Wiideman Consulting Group
SEO Master Class - Steve Wiideman, Wiideman Consulting Group
 
Generative AI Master Class - Generative AI, Unleash Creative Opportunity - Pe...
Generative AI Master Class - Generative AI, Unleash Creative Opportunity - Pe...Generative AI Master Class - Generative AI, Unleash Creative Opportunity - Pe...
Generative AI Master Class - Generative AI, Unleash Creative Opportunity - Pe...
 
Moving beyond multi-touch attribution - DigiMarCon CanWest 2024
Moving beyond multi-touch attribution - DigiMarCon CanWest 2024Moving beyond multi-touch attribution - DigiMarCon CanWest 2024
Moving beyond multi-touch attribution - DigiMarCon CanWest 2024
 
VIP 7001035870 Find & Meet Hyderabad Call Girls Film Nagar high-profile Call ...
VIP 7001035870 Find & Meet Hyderabad Call Girls Film Nagar high-profile Call ...VIP 7001035870 Find & Meet Hyderabad Call Girls Film Nagar high-profile Call ...
VIP 7001035870 Find & Meet Hyderabad Call Girls Film Nagar high-profile Call ...
 
What is Google Search Console and What is it provide?
What is Google Search Console and What is it provide?What is Google Search Console and What is it provide?
What is Google Search Console and What is it provide?
 

Tthe Insider's Guide to Running Amazon Split Tests

  • 1. The Insider’s Guide To Running Amazon Split Tests 1 Tuesday, August 9th
  • 2. A Fun Game: Which Test Won? **These are not the exact products used, but representative products to preserve the sellers’ privacy. 2
  • 3. Enter Your Guesses In The Survey... 3
  • 4. 4 Main Feature Image Test: Larger Product vs. Smaller Product + Include Packaging Variation A Variation B
  • 5. 5 Sale Price vs. No Sale Price Variation A Variation B
  • 6. 6 Detailed Graphics vs. Lifestyle Product Image Variation A Variation B
  • 7. And The Winners Are... 7 Improved Daily Profit By 45% Improved Conversion Rate 17% Larger Product, No Packaging Improved Conversion Rate 21% No Sale Price Improved Sales by 22% Improved Conversion Rate 19% Infographic
  • 8. The Takeaway: You never know what will perform best…..until you run tests with actual data! 8
  • 9. 9 Amazon is getting more competitive and crowded. Optimizing your listing is ever more important. 9,000 people selling “bbq gloves”. How can you compete? Answer: Run Split Tests
  • 10. What is split testing? Controlled | Randomized | Experiment Between two or more variations... 10 Will lead to Improved Metrics (ie click through rate, conversions, profits, etc)
  • 11. How Split Testing Works Control (original) Variation Distribute traffic between original and variation (visitor doesn’t know they are part of a test) Accumulate enough data to identify a *statistically significant* change in visitor behavior “Statistically Significant” is the likelihood that a change (ie conversion rate) is not due to random chance. This gives you confidence that the changes you make actually have an impact! 11
  • 12. Challenges to split testing on Amazon: ↪ You must work within Amazon’s guidelines (character limits, formatting, etc) ↪ All traffic must go to only one page ↪ Amazon only gives traffic data on a daily basis (therefore must make changes daily at 12 midnight) 12
  • 13. High Impact Test #1: Price In a low-priced niche (ie price sensitive consumer), would a change in price change the profits? 13 ↪ Large changes +/- $2.00 ↪ Small changes $x.97 vs $x.88 vs. $x.99
  • 14. Recommended Price Tests 14 ↪ Highly Competitive Niche - Try small incremental changes ↪ Low Competition - Try Increasing your price by $1 or $2 ↪ Differentiated/Improved Product - Increase price by more than you think
  • 15. Pricing Example: A cheaper price will generate more clicks and sales $18.60 Sponsored Ads Hypothesis: Adjusting pricing (to $9.99) will generate more clicks, and sales. I may make less profit per unit sold, but overall will get more sales. Ultimately, I should increase my profits. 15 $19.99 $14.99 $18.99 $9.99
  • 16. High Impact Test #2: Main Feature Image Top search results for “bocce set” Could the top organic result get a higher click through rate with a different image? With an undifferentiated product (ie colored balls), would a change in main image increase the click through rate? 16 Sponsored Ads
  • 17. Image Test: Make it appear a lot is included with your item You can combine images of your product to feature different aspects. Variation A shows a large version of the balls, as well as the carrying case. 17 Control Variation A
  • 19. Image Test: Bring the Product To Life 19 Instead of (photoshopped) two- dimensional images, try showing it in action. Minimal Propping is OK in main image as long as it does not confuse the customer.
  • 20. Image Test: “Explain” Your Product Visually 20 Use diagrams and notations to show the differentiating features of your product. This helps quickly convey information that they may not read in your listing’s text. vs. vs.
  • 21. Image Test: Show Interesting Product Photos 21 Roasting sticks would be just a line if you included the whole image. Competitors Included the whole packaging. Our solution: Stand out with a unique angle, product composition, close-up image.
  • 22. Split Testing Best Practices Run your test until 90% or 95% statistical significance - minimum 2 weeks (ie know that your changes will have a positive impact!) ❗Only test one thing at a time. ❗Start with easier tests (price and image) vs. more nuanced tests (product description) ❗Switch variations every day (at midnight) to account for day-to-day or seasonal changes 22
  • 23. Automate Your Split Testing with Splitly Results from a recent pricing test. Hypothesis: decreasing the price by a dollar would increase sessions, conversion rate, and sales. 29% more page views 66% more sales 33% higher conversion rate 32% HIGHER PROFITS! 23
  • 24. Splitly Data: Rotation Log 24 Review the key metrics for every variant on a given day...
  • 25. Splitly Data: Test Summary Or view the test summary in a simple dashboard. The Variation showed improvements across the board. This is a good thing! 25
  • 26. Impact on Profits from Test Results For example, Jungle Stix sells $16,000/month in sales, $4,800/profit 33% increase in profits = $1584 per month, $19,000 per year, straight to the bottom line! Continue to optimize for different metrics (CTR, Conv. Rate, Impressions) Run automated tests on each product you sell 26
  • 27. Try Splitly Today: Get 50% Off Your First Month (exclusive offer through 8/12 at 11:59p PST) www.splitly.com/js 27

Editor's Notes

  1. Note to maryna - can you please obscure the name of the test, “9.97”