Ryan Jones | SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop
Zagreb SEO Summit 2025
SEO Testing
And Experimentation
How to be more data-driven with your SEO.
Ryan Jones | SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop
Zagreb SEO Summit 2025
Hi, I’m Ryan! 󰗝
Marketing Manager @ SEOTesting
Entering a Decade in SEO / Digital Marketing
International Speaker (Thanks to Zagreb) 😉
Lover of All Things Sports 🏈
Obsessed with The Big Bang Theory (Sorry Not Sorry)
Ryan Jones | SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop
seotesting.com
What We’ll Cover
01
What is SEO
Testing?
02
Why Does
Testing Matter?
03
Types of SEO
Tests Available
04
How to Run an
SEO Test
Ryan Jones | SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop
seotesting.com
That’s Not All
05
What Things to
Run Tests On
06
Real SEO Test
Examples
07
SEO Testing
Tools
08
Additional Time
for a Q&A
Ryan Jones | SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop
seotesting.com
Ryan Jones | SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop
seotesting.com
I work for an SEO testing tool.
I’ve run hundreds of SEO tests on different sites.
I work closely with SEOs to understand what works.
I regularly speak and write on SEO testing topics.
Ryan Jones | SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop
seotesting.com
Who Can Benefit from
SEO Testing?
Ryan Jones | SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop
seotesting.com
Anyone working on
in-house SEO for
companies.
Anyone doing
agency-side SEO for
clients.
Anyone doing SEO for
their own business’
website.
Anyone who wants to
see the impact of
their SEO changes.
Ryan Jones | SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop
seotesting.com
Ryan Jones | SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop
seotesting.com
What is SEO
Testing?
Ryan Jones | SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop
seotesting.com
Find something on a
website that we’re not
happy with.
Change something on
the page like text,
links, images, etc.
Measure the results
based on the metrics
we wanted improving.
Ryan Jones | SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop
seotesting.com
Ryan Jones | SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop
seotesting.com
Ryan Jones | SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop
seotesting.com
Ryan Jones | SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop
seotesting.com
Ryan Jones | SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop
seotesting.com
Ryan Jones | SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop
seotesting.com
Ryan Jones | SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop
seotesting.com
Ryan Jones | SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop
seotesting.com
Analyze The
Results
Use all the data collected to
analyze your results and work
out whether your test was
successful, a failure, or
statistically insignificant.
Step 5
Run The
Test
Run the test for a set period
of time. Enough time to
create a statistically
significant result is
preferable.
Step 4
Choose Suitable
Pages
This will depend on the test
type that you have chosen. In
some cases you will work with
one page, and other times you
will work with multiple.
Step 3
Select Your
Test Type
Based on your hypothesis,
choose the type of SEO test
you are going to run.
Step 2
Form Your
Hypothesis
Come up with a “plan of
action” for your upcoming
SEO test based on what you
want to improve and how you
are going to do it.
Step 1
Ryan Jones | SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop
seotesting.com
Track the performance of
those changes via SEO tests.
Track Performance
Make changes to your site
based on hypotheses.
Make Changes
Based on the results, roll out
to the wider site, iterate, or
roll back.
Roll Out, Iterate, or Roll
Back
Analyze whether those tests
worked or if they didn’t work.
Analyze Results
Ryan Jones | SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop
seotesting.com
SEO Testing vs.
CRO Testing
Ryan Jones | SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop
seotesting.com
SEO Testing is Not CRO
Testing
Ryan Jones | SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop
seotesting.com
SEO Testing CRO Testing
Goal Improve SEO Performance Increase On-Site Conversions
Metrics Impressions | Clicks | Rankings | CTR Click-Throughs | Sign-Ups | Sales
Tools GSC | SEOTesting | SearchPilot | seoClarity WVO | Hotjar | Optimizely | Etc
Who “Sees” the Change? Search Engine Bots Real-World Users
Testing Method Split Tests | Time-Based Tests Live A/B Tests
Ryan Jones | SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop
seotesting.com
Is There Any
Overlap?
Ryan Jones | SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop
seotesting.com
Shared Testing Approach
SEO Testing CRO Testing
Can Impact SEO Metrics
Changing for Users
Can Impact CRO Metrics
Changing for Google
Ryan Jones | SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop
seotesting.com
Where SEO Testing Fits
Into SEO Strategy
Ryan Jones | SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop
seotesting.com
SEO Testing Is Part of a
Complete SEO Strategy
Ryan Jones | SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop
seotesting.com
Content Creation
Write and publish
content like blog
posts, feature pages,
PDPs, PLPs, etc.
SEO Testing
Testing various things
across your site based
on SEO metrics to
improve your results.
Iteration & Scaling
Using SEO test data to
inform strategy going
forward, or roll out
changes to more
areas.
Tech Foundation
Making sure Google
and other search
engines can crawl,
index and understand.
Keyword Research
Find what your
audience searches for.
Build topic lists to
target.
Ryan Jones | SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop
seotesting.com
Actually, I might have
lied a little bit there…
Ryan Jones | SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop
seotesting.com
Content Creation
Write and publish
content like blog
posts, feature pages,
PDPs, PLPs, etc.
Iteration & Scaling
Using SEO test data to
inform strategy going
forward, or roll out
changes to more
areas.
Tech Foundation
Making sure Google
and other search
engines can crawl,
index and understand.
Keyword Research
Find what your
audience searches for.
Build topic lists to
target.
Ryan Jones | SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop
seotesting.com
Content Creation
Write and publish
content like blog
posts, feature pages,
PDPs, PLPs, etc.
Iteration & Scaling
Using SEO test data to
inform strategy going
forward, or roll out
changes to more
areas.
Tech Foundation
Making sure Google
and other search
engines can crawl,
index and understand.
Keyword Research
Find what your
audience searches for.
Build topic lists to
target.
Test results can be
used to inform
strategy and
scaling-up work going
forward.
SEO tests can help you
decide what content
types work best for
different target
keywords.
Some keywords/topics
are easier to rank for.
SEO tests can help you
choose targets.
Use SEO test results
to inform your tech
stack going forward.
Some CMS will work
better than others.
Ryan Jones | SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop
seotesting.com
Stop Guessing.
Start Learning.
Ryan Jones | SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop
seotesting.com
You don’t know what works until you test.
Google updates change what works.
Testing helps you stay ahead of competitors.
It removes guesswork from your workflow.
The SEO Testing
Cycle
Measure the results of that test.
02
D
e
c
i
d
e
o
n
n
e
x
t
a
c
t
i
o
n
s
.
03
01
C
o
n
d
u
c
t
a
n
S
E
O
t
e
s
t
.
Ryan Jones | SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop
seotesting.com
Testing Helps You
Focus
Ryan Jones | SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop
seotesting.com
- Testing allows you to find the changes that move the needle.
- You can avoid wasting time on low-impact SEO tasks for your site.
- Build “proof” before scaling changes and rolling them out.
- Great for justifying changes to teams/stakeholders/clients.
Ryan Jones | SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop
seotesting.com
Why does SEO testing
matter?
Ryan Jones | SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop
seotesting.com
01
Figure Out What
Works
02
Show the
Impact of SEO
03
Remove Wasted
Time
04
Stop SEO
Disasters
Ryan Jones | SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop
seotesting.com
Ryan Jones | SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop
seotesting.com
01
Prove Concepts
with SEO Tests
02
Remove “It
Depends”
03
Drip Feed Good
News
04
Show ROI of
SEO
Ryan Jones | SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop
seotesting.com
Using SEO Tests to
Figure Out What Works
Ryan Jones | SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop
seotesting.com
What Does “What Works” Mean in SEO?
- More Clicks
- Better Rankings
- On-Page Metric Improvements
- More Conversions
Ryan Jones | SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop
seotesting.com
Use SEO Tests to Prove Value
Lorem ipsum dolor sit amet
at nec at adipiscing
03
● Donec risus dolor porta venenatis
● Pharetra luctus felis
● Proin in tellus felis volutpat
Lorem ipsum dolor sit amet
at nec at adipiscing
02
● Donec risus dolor porta venenatis
● Pharetra luctus felis
● Proin in tellus felis volutpat
Lorem ipsum dolor sit amet
at nec at adipiscing
01
● Donec risus dolor porta venenatis
● Pharetra luctus felis
● Proin in tellus felis volutpat
Use data to back up
changes.
03
Test ideas and measure real
results.
02
Don’t rely on best practices.
01
Instead, use tests to
validate your own ideas.
Test results can be used to
inform your own strategy
going forward.
Use successful tests to get
buy-in for other work.
Ryan Jones | SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop
seotesting.com
Common SEO Questions to Test
- Will adding internal links improve traffic to target pages?
- Will adding FAQ schema help us rank for more keywords?
- Does updating old content help us improve traffic?
- Does our new meta template increase CTR?
Ryan Jones | SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop
seotesting.com
Let’s Look at an Example Test:
Ryan Jones | SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop
seotesting.com
Will Adding Video
Schema Have an
Impact?
Ryan Jones | SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop
seotesting.com
👤👤👤👤
👤👤👤👤
👤👤👤👤
👤👤👤
👤👤👤👤
👤👤👤👤
👤👤👤👤
👤👤👤
Pages Without
Video Schema
Added
Pages With
Video Schema
Added
Ryan Jones | SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop
seotesting.com
Ryan Jones | SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop
seotesting.com
What Success Looks Like
- More Impressions or Clicks
- Higher Position for Key Terms
- Better Click-Through Rates
- Longer Time Spent on Key Pages
Ryan Jones | SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop
seotesting.com
What If There’s No Improvement?
- Failed Tests Are Still Wins
- Informs Strategy Going Forward
- Use Failed Tests to Plan for Better Changes
Ryan Jones | SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop
seotesting.com
Ryan Jones | SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop
seotesting.com
Build a Library of Learnings
Test Type Test Description Test Status Test Result
Split Test New PLP Design Complete +20% Organic Traffic
Time-Based Test Adding Internal Links Complete +50% Organic Traffic
Split Test New PDP Design Complete 20% Improvement to
Engagement Rate
Time-Based Test Improving Page Speed Complete 45% Increase in Conversion
Rate
Ryan Jones | SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop
seotesting.com
Showing the Impact SEO
Has on a Website
Ryan Jones | SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop
seotesting.com
Why Showing Impact Matters
SEO takes time to
implement and start
bringing in
meaningful results.
SEO “wins” are often
hidden from key
stakeholders within
the business.
SEOs need to
constantly prove their
value to clients/key
stakeholders.
Ryan Jones | SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop
seotesting.com
Ryan Jones | SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop
seotesting.com
Who You’re Showing Impact To
Clients Managers Founders Other Teams
Ryan Jones | SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop
seotesting.com
What They Care About
What Key Stakeholders Care About What They Don’t Care About
Business Results Organic Traffic
Leads or Sales Impacts Impressions
Return on Investment Click-Through Rate
Overall Traffic Growth On-Page Metrics (with Exceptions)
Ryan Jones | SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop
seotesting.com
Tie SEO Metrics to Business Goals
Clicks
Rankings
Indexed Pages
Page Speed
Leads
Traffic
Visibility
Conversion Rates
Ryan Jones | SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop
seotesting.com
Use SEO Tests to Tell Stories
1
We Found a Problem
“We realised that 20% of
our blog content was out of
date. This is content that
cost us $26,000 to create.
Now it is sat there not
generating any return on
investment.”
We Ideated a Solution
“We thought about
refreshing half of that
content, spending $3,000,
to see if this generates a
meaningful ROI from the
older content.”
2
We Ran a Test
“We refreshed 50% of the
outdated content, leaving
the other 50% unchanged
as a control group.”
3
We Saw Massive Gains!
“The refreshed content
generated an additional
55,000 clicks, generating
an additional $14,000 in
revenue.”
4
Ryan Jones | SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop
seotesting.com
Save Time: Something
SEOs Need
Ryan Jones | SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop
seotesting.com
How SEO Testing Saves Time
- You stop guessing.
- You focus only on what works.
- You avoid wasting time on weak ideas.
Ryan Jones | SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop
seotesting.com
Cut Time Spent on Low-Impact Work
Low-Impact High-Impact
Creating New Content Backlink Acquisition
Improving Page Speed Content Refreshes
Optimizing Meta Descriptions Adding Structured Data Where Applicable
Image Optimization Improving Internal Linking & Site Structure
Ryan Jones | SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop
seotesting.com
Prioritize the Right Changes
Adding Internal Links
Updating Title Tags
Adding Structured Data
Improving Headers
Refreshing Content
New Landing Pages
Improve Site Structure
Programmatic SEO
Fixing Broken Links
Adding Alt Tags
Site Redesigns
Meta Description Rewrites
Translating Content
High Effort
High
Impact
Low
Impact
Low Effort
Ryan Jones | SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop
seotesting.com
Build a Bank of Proven Wins
- Reuse winning tests across the site.
- No need to start from scratch each time.
- Scale what works faster.
Ryan Jones | SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop
seotesting.com
Stop Chasing Trends
Ryan Jones | SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop
seotesting.com
While a tactic works,
repeat it across your site.
Reuse Working Tactics
Use SEO test results to find
the tactics that work for
your site.
Find What Works
Repeat until those tactics
stop working or reduce in
effectiveness.
Repeat
Ryan Jones | SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop
seotesting.com
Stop SEO
Disasters
Ryan Jones | SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop
seotesting.com
Why SEO Disasters Happen
Big changes go live on
a website without
prior testing.
Development teams
sometimes move fast
and push changes
without informing
other teams.
Nobody checks on the
impact of a page/site
change until traffic
tanks.
Ryan Jones | SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop
seotesting.com
What an SEO Disaster Looks Like
- Important pages drop off the SERPs.
- Rankings collapse.
- Traffic tanks overnight.
- Leads and sales dry up.
Ryan Jones | SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop
seotesting.com
SEO Testing as a Safety Net
SEO Test
Complete
SEO Test
Complete
Roll Out to
Wider Site
Revert
Back
Ryan Jones | SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop
seotesting.com
Build Trust Through Safe Testing
Who What They Worry About How Testing Builds Trust
SEO Managers Traffic drops from untested changes. Testing shows what’s safe to roll out.
Developers Code changes breaking SEO. Tests confirm changes won’t hurt
rankings.
Content Teams New copy hurting performance. Testing proves if updates help or hurt.
Marketing Leaders Wasting time or budget on SEO. Data shows which work drives the best
results.
Executives / Founders Risk to leads and revenue. Testing reduces risk and shows business
impact.
Ryan Jones | SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop
seotesting.com
Prove Concepts with
SEO Tests (Or Disprove)
Ryan Jones | SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop
seotesting.com
Why Prove Concepts?
- SEO advice is, literally, everywhere.
- Not all of it will work for your site.
- Testing separates theory from truth.
Ryan Jones | SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop
seotesting.com
How Testing Proves or Disproves a Concept
Take a
group of
pages.
Make One
Clear Change
Measure
Change Over
Time
Ryan Jones | SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop
seotesting.com
Testing a Concept
Concept: Adding FAQ Schema Boosts Clicks
Test: Add FAQ Schema to 10% of Blog Posts
Result: Clicks to Test Pages Rose 12%
Lesson: Concept Confirmed. Scale the Change
Ryan Jones | SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop
seotesting.com
Remove “It Depends”
from Our Vocabulary
Ryan Jones | SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop
seotesting.com
Ryan Jones | SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop
seotesting.com
SEO Question Usual Answer Test-Based Answer
Should we add more internal links? “It depends.” “Yes. Test pages saw 15% more clicks.”
Does FAQ schema improve
performance?
“It depends.” “Yes. CTR increased by 3% on 10
pages.”
Should we merge similar blog posts into
one comprehensive piece of content?
“It depends.” “No. Merged content lost rankings on all
tests.”
Will changing title tags help? “It depends.” “Yes. Rank went from 9 to 4 after
change.”
Should we prune low-traffic pages? “It depends.” “Yes. Sitewide traffic rose 10% after
test.”
Ryan Jones | SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop
seotesting.com
Drip Feed Good News to
Stakeholders
Ryan Jones | SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop
seotesting.com
Why Drip Feed SEO Wins?
- SEO results often take time.
- Big wins can be pretty rare.
- Sharing small wins helps build trust and momentum.
Ryan Jones | SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop
seotesting.com
What to Share (And When)
Type of Update When to Share Example
Small Test Wins Weekly or Bi-Weekly Title Update = +18% Clicks
Completed Test Summary End of Each Test Content Update Boosted Rankings by 3
Positions
Failed Test with a Lesson Monthly or Quarterly Removing FAQ Schema Dropped CTR.
Reverted.
Grouped Insights from Tests Quarterly Internal Links and Schema Gave Best
Results
Ryan Jones | SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop
seotesting.com
How It Helps
- Keeps stakeholders informed.
- Builds confidence in your SEO work.
- Makes it easier to ask for more resources.
- Turns testing into a habit the whole team supports.
Ryan Jones | SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop
seotesting.com
Better Show the ROI of
SEO
Ryan Jones | SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop
seotesting.com
Why ROI Matters in SEO
- SEO takes time. But more importantly. SEO takes money.
- Stakeholders want results they can measure.
- ROI proves SEO is worth the investment.
Ryan Jones | SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop
seotesting.com
How SEO Testing Helps Show ROI
Track wins from
specific site changes.
Tie traffic gains to
value: Leads, Sales,
Sign-Ups
Use Real Data Instead
of Projections
Ryan Jones | SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop
seotesting.com
Example to Show ROI Impact of SEO Test
H1
Product
Image and
Description
H1
Product Image
and Info
New FAQ
Section
Test: Added FAQ Schema to Product Content
Result: +25% CTR
Traffic Value: +5,000 Clicks Per Month
If 2% Convert → 100 Extra Leads
Value Per Lead: $50 → $5,000pm ROI
Ryan Jones | SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop
seotesting.com
The Different Types of
SEO Tests
Ryan Jones | SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop
seotesting.com
🅰🅱 Split Tests (A/B Tests)
Ryan Jones | SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop
seotesting.com
🅰🅱 Split Tests (A/B Tests)
🕙⏰ Time-Based Tests
Ryan Jones | SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop
seotesting.com
🅰🅱 Split Tests (A/B Tests)
🕙⏰ Time-Based Tests
🛞🔉 Multivariate Tests
Ryan Jones | SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop
seotesting.com
Variables What are you changing & measuring?
Tools What tools are you using?
Traffic What traffic does your page/s have?
Ryan Jones | SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop
seotesting.com
Split Tests (Not A/B
Tests)
Ryan Jones | SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop
seotesting.com
‘Test’ Page
H1
Product Hero
Image
Product
Info
FAQ Content
Reviews
‘Control’ Page
H1
Product Hero Image
Product Information
Ryan Jones | SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop
seotesting.com
👤👤👤👤
👤👤👤👤
👤👤👤👤
👤👤👤
👤👤👤👤
👤👤👤👤
👤👤👤👤
👤👤👤
Control Pages Test Pages
Ryan Jones | SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop
seotesting.com
Ryan Jones | SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop
seotesting.com
Page Version
‘A’
Page Version
‘B’
👤👤👤👤
👤👤👤👤
👤👤👤👤
👤👤👤
👤👤👤👤
👤👤👤👤
👤👤👤👤
👤👤👤
👤👤👤👤
👤👤👤👤
👤👤👤👤
👤👤👤👤
👤👤👤👤
👤👤👤👤
👤👤👤👤
👤👤👤👤
👤👤👤👤
👤👤👤👤
👤👤👤👤
👤👤👤👤
👤👤
Ryan Jones | SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop
seotesting.com
Time-Based
Tests
Ryan Jones | SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop
seotesting.com
Page After
Change
Page Before
Change
H1
Main Blog Post Content
H1
Main Blog Post Content
New FAQ Section
Ryan Jones | SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop
seotesting.com
Clicks Before Change Clicks After Change
Change Made
Ryan Jones | SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop
seotesting.com
Multivariate
Tests
Ryan Jones | SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop
seotesting.com
Page Before
Change
H1
Main Blog Post Content
Page After
Change
Changed H1 Tag
Main Blog
Post
Content
(With
Internal
Links
Added) Added FAQ
Section
Added Hero
Image
Ryan Jones | SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop
seotesting.com
Clicks Before Change Clicks After Change
Change Made
Ryan Jones | SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop
seotesting.com
How to Decide on a Test
Type?
Ryan Jones | SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop
seotesting.com
Test Type Best For Needs High Traffic? Page Type Pros Watch Out For
Split Test Templated Content
PDPs, PLPs, Etc
Yes Many Similar Pages Accurate Control Group
Comparison
Requires Accurate Page
Grouping
Time-Based Test One-Off Content
Unique Content
Ideally Single-Page or Group of
Pages
Easy to Set Up - Great
for Quick Tests
Can be Impacted by
Outside Variables
Multivariate Test Testing Multiple
Changes at Once
Ideally Any Page (Unique or
Templated)
Tests the Impact of
Multiple Changes
Hard to Isolate the
Impact per Change
Ryan Jones | SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop
seotesting.com
How to Run SEO
Tests
Ryan Jones | SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop
seotesting.com
Step 1: Start with a
Hypothesis
Ryan Jones | SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop
seotesting.com
What is a
Hypothesis?
Ryan Jones | SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop
seotesting.com
A statement that is
formed from an
independent variable,
and a dependent
variable.
Ryan Jones | SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop
seotesting.com
Test Example Independent Variable Dependent Variable
Title Tag Rewrite Title Tag Wording Click-Through Rate
Adding Internal Links Number & Placement of Internal Links Organic Traffic to Target Page
Meta Description Change Description and Content Structure Clicks from the SERPs
Adding FAQ Schema Presence of FAQ Structured Data Impressions & CTR
Content Expansion Word Count and Added Sections Average Position & Impressions
Page Speed Improvement Time to First Byte & Page Load Speed Bounce Rate or Dwell Time
H1 Change H1 Text Phrasing Rankings for Target Keyword
Removing Thin Content Number of Low-Value Pages Overall Site Visibility & Crawl Efficiency
Ryan Jones | SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop
seotesting.com
How is a Hypothesis
Formed for SEO Tests?
Ryan Jones | SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop
seotesting.com
✋ Use data to spot an issue.
Ryan Jones | SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop
seotesting.com
✋ Use data to spot an issue.
🧪 Outline the work to be done.
Ryan Jones | SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop
seotesting.com
✋ Use data to spot an issue.
🧪 Outline the work to be done.
😎 Make an educated guess.
Ryan Jones | SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop
seotesting.com
Use Data to Spot Issues:
Our page’s current click-through rate is below the
expected average for SERP Position 4.
Ryan Jones | SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop
seotesting.com
Outline the Work:
We will rewrite our page’s title tag to better
match search intent, and shorten it to below 60
characters.
Ryan Jones | SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop
seotesting.com
Make Educated Guesses:
The work we do to our page will increase its
click-through rate.
Ryan Jones | SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop
seotesting.com
Our page’s current CTR (1.2%) is less than the
expected for SERP Position 4. We will rewrite
our page’s title tag to better match search
intent and bring it below 60 characters. This will
increase this page’s CTR for our target keyword.
Ryan Jones | SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop
seotesting.com
How to Ideate
Hypotheses
Ryan Jones | SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop
seotesting.com
How can we keep users on the page longer once
they land?
05
● Add a table of contents for long-form blog posts.
● Improve above-the-fold content clarity.
● Add internal links to encourage further browsing.
How can we move our pages higher up in the
rankings?
04
● Donec risus dolor porta venenatis
● Pharetra luctus felis
● Proin in tellus felis volutpat
Why are people seeing our page but not clicking
on it?
03
● Test shorter vs. longer title tags.
● Add emotion or urgency to meta titles.
● Experiment with symbols or brackets in title tags.
How can we show up for more search queries?
02
● Add related keywords into existing content.
● Expand on thin pages with more detailed sections.
● Optimize headings to reflect keyword variations.
How can we get more people to click on our page
from search results?
01
● Rewrite title tags to match search intent.
● Add a CTA or value proposition to meta descriptions.
● Use FAQ schema to earn rich snippets.
Ryan Jones | SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop
seotesting.com
Step 2: Choose the Type
of SEO Test
Ryan Jones | SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop
seotesting.com
Some Questions to Ask
Am I changing one thing, or changing multiple?
Do I have similar content templates to use as a control?
Is the page I am testing on a high-traffic page?
Ryan Jones | SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop
seotesting.com
Test Type Comparison Table
Test Type Best For Needs High
Traffic?
Page Type Pros Watch Out For
Split Test Templated Pages Yes Groups of Similar
Pages
Clear Control Group.
Reliable Comparison
Needs proper
grouping. Easy to get
wrong.
Time-Based
Test
One-Off or Unique
Pages
No (But Helps) Single or Small Group
of Pages
Easy to Run. Works
Well for Small Sites
Can be skewed by
algorithm updates or
seasonality.
Multivariate
Test
Pages with High
Traffic
Yes Any Page Test Combinations of
Changes Together
Hard to isolate which
change caused what
result.
Ryan Jones | SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop
seotesting.com
Ryan Jones | SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop
seotesting.com
Split Test Time-Based Test Multivariate Test
I am testing a single change, on templated content, with lots of traffic:
Ryan Jones | SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop
seotesting.com
Split Test Time-Based Test Multivariate Test
I am testing a single change, on templated content, with lots of traffic:
✅ ❌ ❌
Ryan Jones | SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop
seotesting.com
Split Test Time-Based Test Multivariate Test
I am testing changing the H1 to a single page, non-templated content:
Ryan Jones | SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop
seotesting.com
Split Test Time-Based Test Multivariate Test
I am testing changing the H1 to a single page, non-templated content:
❌ ✅ ❌
Ryan Jones | SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop
seotesting.com
Split Test Time-Based Test Multivariate Test
I am testing a full content refresh on a single page:
Ryan Jones | SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop
seotesting.com
Split Test Time-Based Test Multivariate Test
I am testing a full content refresh on a single page:
❌ ❌ ✅
Ryan Jones | SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop
seotesting.com
Step 3: Choose the Page
or Pages to Test On
Ryan Jones | SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop
seotesting.com
Performance-Based
Questions
Ryan Jones | SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop
seotesting.com
1⃣ Which pages get the most impressions but low clicks?
2⃣ Which pages have high bounce rates?
3⃣ Which pages have dropped in traffic recently?
4⃣ Which pages have stagnated within the rankings?
5⃣ Which pages rank on Page 2 or 3 for target keywords?
Ryan Jones | SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop
seotesting.com
Optimization
Opportunity Questions
Ryan Jones | SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop
seotesting.com
1⃣ Do any pages lack internal links pointing to them?
2⃣ Do some pages have outdated or thin content?
3⃣ Are some pages missing structured data?
4⃣ Are any title tags too long, or missing important keywords?
5⃣ Do similar pages perform very differently?
Ryan Jones | SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop
seotesting.com
Testing Value
Questions
Ryan Jones | SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop
seotesting.com
1⃣ Can I isolate this page from others for a test?
2⃣ Will changes on this page affect site performance?
3⃣ Is this page part of a large group I can test across?
4⃣ Can I measure the test result easily?
5⃣ Is this page important for conversions/leads?
Ryan Jones | SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop
seotesting.com
Step 4: Run the Test
(And Wait)
Ryan Jones | SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop
seotesting.com
Launching the Test
1⃣ Make the Change
2⃣ Note the Start Date
3⃣ Use Annotations to Show Tests
Ryan Jones | SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop
seotesting.com
Set a Testing Window
Ryan Jones | SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop
seotesting.com
Testing Tips
- Don’t change multiple things mid-test.
- Avoid running test during Google Core Updates.
- If possible, freeze other SEO activity. Especially on test pages!
Ryan Jones | SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop
seotesting.com
Step 5: Analyze the Test
Results
Ryan Jones | SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop
seotesting.com
- Clicks
- Click-Through Rate
- Impressions
- Average Position
- On-Page Metrics (For Some Tests)
What Metrics to Track
Ryan Jones | SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop
seotesting.com
Example SEO Test Result
Ryan Jones | SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop
seotesting.com
Don’t “Just” Use Graphs
Ryan Jones | SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop
seotesting.com
Did this result happen by chance… or is it real?
- Small changes can happen by chance.
- We use stat sig to check if the result is meaningful.
- Most tools aim for 95% confidence.
- If the sample size is too small, wait longer or rerun the test.
Ryan Jones | SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop
seotesting.com
Again: Use Data to Tell a Story
1
We Found a Problem
“We realised that 20% of
our blog content was out of
date. This is content that
cost us $26,000 to create.
Now it is sat there not
generating any return on
investment.”
We Ideated a Solution
“We thought about
refreshing half of that
content, spending $3,000,
to see if this generates a
meaningful ROI from the
older content.”
2
We Ran a Test
“We refreshed 50% of the
outdated content, leaving
the other 50% unchanged
as a control group.”
3
We Saw Massive Gains!
“The refreshed content
generated an additional
55,000 clicks, generating
an additional $14,000 in
revenue.”
4
Ryan Jones | SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop
seotesting.com
Step 6: Decide on the
Next Steps
Ryan Jones | SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop
seotesting.com
✅ Test Worked → Roll Out Sitewide
❌ Test Failed → Revert and Learn
🤔 Unclear → Try a New Variation
Ryan Jones | SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop
seotesting.com
Record the hypothesis
you used for your test.
Note the change you
made to your site and
the test result.
Add to your internal
SEO testing log.
Document What You Learned
Ryan Jones | SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop
seotesting.com
The SEO Testing Cycle
The SEO
Testing Cycle
Conduct
your
Test
01
Analyze the Results
02
Decide
on
Next
Actions
03
Form your Test
04
Ryan Jones | SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop
seotesting.com
What Things to Test
On (With Real-World
Examples)
Ryan Jones | SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop
seotesting.com
Page
Titles
Ryan Jones | SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop
seotesting.com
‘Test’ Page
New H1 with Dates
Unchanged Blog
Content
‘Control’ Page
Original H1
Unchanged Blog
Content
Adding Year and Month to Page Title
Ryan Jones | SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop
seotesting.com
Ryan Jones | SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop
seotesting.com
‘Test’ Page
Keyword + Brand
Unchanged Blog
Content
‘Control’ Page
Keyword + Date + Brand
Unchanged Blog
Content
Simplifying Page Titles
Ryan Jones | SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop
seotesting.com
Ryan Jones | SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop
seotesting.com
‘Test’ Page
SEO Guide
Unchanged Blog
Content
‘Control’ Page
SEO Guide 2023
Unchanged Blog
Content
Removing Published Date from Old Content
Ryan Jones | SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop
seotesting.com
Ryan Jones | SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop
seotesting.com
Specific Page
Elements
Ryan Jones | SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop
seotesting.com
‘Test’ Page
‘Control’ Page
Product Name
Hero Image
Hero Section - 1 Hero Pic vs Clickable Carousel
Product
Info
FAQs
Detailed Product
Description
Product Name
Clickable Carousel
Product
Info
FAQs
Detailed Product
Description
Ryan Jones | SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop
seotesting.com
Ryan Jones | SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop
seotesting.com
‘Test’ Page
‘Control’ Page
H1
Added Navigation to Blog Posts (More User Interaction)
Main Blog Post Content
Product Name
Table of Contents
(Navigation)
Main Blog Post Content
Ryan Jones | SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop
seotesting.com
Ryan Jones | SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop
seotesting.com
Links
Ryan Jones | SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop
seotesting.com
‘Test’ Page
‘Control’ Page
H1
Internal Links to Pages
Main Blog Post Content
(Unchanged)
H1
Main Blog Post
Content
(Internal Links Added)
Ryan Jones | SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop
seotesting.com
Ryan Jones | SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop
seotesting.com
‘Test’ Page
‘Control’ Page
H1
Reduced Number of Outbound Links (Retain Link Equity)
Blog Post with 5
Outbound Links
H1
Blog Post with 0
Outbound Links
Ryan Jones | SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop
seotesting.com
Ryan Jones | SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop
seotesting.com
Page
Design
Ryan Jones | SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop
seotesting.com
‘Test’ Page
‘Control’ Page
Product Name
Hero Image
New Product Page Design
Product Info
Detailed Product
Description
Product Name
Hero
Image
FAQs
Price
Options
Detailed Product
Description
Key Info
Ryan Jones | SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop
seotesting.com
Ryan Jones | SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop
seotesting.com
Content
Ryan Jones | SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop
seotesting.com
‘Test’ Page
‘Control’ Page
Product Name
Hero Image
Adding More Data to Product Pages
Product Info
Product Name
Hero
Image
Detailed Product
Description
FAQ
Section
Price
Options
Similar
Items
Ryan Jones | SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop
seotesting.com
Ryan Jones | SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop
seotesting.com
‘Test’ Page
‘Control’ Page
H1
Accordion
Remove Accordions - Make All Content Visible
Main Blog Content
Product Name
Main Blog Content
Ryan Jones | SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop
seotesting.com
Ryan Jones | SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop
seotesting.com
Ryan Jones | SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop
seotesting.com
‘Test’ Page
‘Control’ Page
H1
Adding E-E-A-T
Main Blog Content
H1
Main Blog Content
Reviewed by Nick
Swan
Ryan Jones | SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop
seotesting.com
Ryan Jones | SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop
seotesting.com
‘Test’ Page
‘Control’ Page
H1
Testing Adding Display Advertising to Blog Posts
Main Blog Content
H1
Blog Content
Blog Content
Blog
Content
Display
Ads
Ryan Jones | SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop
seotesting.com
Ryan Jones | SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop
seotesting.com
SEO Testing Tools You
Can Use
Ryan Jones | SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop
seotesting.com
Do you have a budget for SEO testing tools?
And many more…
Ryan Jones | SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop
seotesting.com
Don’t have a budget?
Use Free Tools:
GSC, GA4, Sheets, Excel
Ryan Jones | SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop
seotesting.com
Ryan Jones | SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop
seotesting.com
Small
Scale
Tests
Show ROI of
SEO Testing
Run Tests to Prove Value
💰
Ryan Jones | SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop
seotesting.com
Any
Questions?
Thank You! 󰚥
Connect With Me! 󰛈
LinkedIn - linkedin.com/in/ryan-g-jones/
X - x.com/ryanjonesseo
Bluesky - bsky.app/profile/ryanjonesseo.bsky.social
https://seotesting.com/

SEO Testing and Experimentation: How to be More Data-Driven with your SEO

  • 1.
    Ryan Jones |SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop Zagreb SEO Summit 2025 SEO Testing And Experimentation How to be more data-driven with your SEO.
  • 2.
    Ryan Jones |SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop Zagreb SEO Summit 2025 Hi, I’m Ryan! 󰗝 Marketing Manager @ SEOTesting Entering a Decade in SEO / Digital Marketing International Speaker (Thanks to Zagreb) 😉 Lover of All Things Sports 🏈 Obsessed with The Big Bang Theory (Sorry Not Sorry)
  • 3.
    Ryan Jones |SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop seotesting.com What We’ll Cover 01 What is SEO Testing? 02 Why Does Testing Matter? 03 Types of SEO Tests Available 04 How to Run an SEO Test
  • 4.
    Ryan Jones |SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop seotesting.com That’s Not All 05 What Things to Run Tests On 06 Real SEO Test Examples 07 SEO Testing Tools 08 Additional Time for a Q&A
  • 5.
    Ryan Jones |SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop seotesting.com
  • 6.
    Ryan Jones |SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop seotesting.com I work for an SEO testing tool. I’ve run hundreds of SEO tests on different sites. I work closely with SEOs to understand what works. I regularly speak and write on SEO testing topics.
  • 7.
    Ryan Jones |SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop seotesting.com Who Can Benefit from SEO Testing?
  • 8.
    Ryan Jones |SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop seotesting.com Anyone working on in-house SEO for companies. Anyone doing agency-side SEO for clients. Anyone doing SEO for their own business’ website. Anyone who wants to see the impact of their SEO changes.
  • 9.
    Ryan Jones |SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop seotesting.com
  • 10.
    Ryan Jones |SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop seotesting.com What is SEO Testing?
  • 11.
    Ryan Jones |SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop seotesting.com Find something on a website that we’re not happy with. Change something on the page like text, links, images, etc. Measure the results based on the metrics we wanted improving.
  • 12.
    Ryan Jones |SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop seotesting.com
  • 13.
    Ryan Jones |SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop seotesting.com
  • 14.
    Ryan Jones |SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop seotesting.com
  • 15.
    Ryan Jones |SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop seotesting.com
  • 16.
    Ryan Jones |SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop seotesting.com
  • 17.
    Ryan Jones |SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop seotesting.com
  • 18.
    Ryan Jones |SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop seotesting.com
  • 19.
    Ryan Jones |SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop seotesting.com Analyze The Results Use all the data collected to analyze your results and work out whether your test was successful, a failure, or statistically insignificant. Step 5 Run The Test Run the test for a set period of time. Enough time to create a statistically significant result is preferable. Step 4 Choose Suitable Pages This will depend on the test type that you have chosen. In some cases you will work with one page, and other times you will work with multiple. Step 3 Select Your Test Type Based on your hypothesis, choose the type of SEO test you are going to run. Step 2 Form Your Hypothesis Come up with a “plan of action” for your upcoming SEO test based on what you want to improve and how you are going to do it. Step 1
  • 20.
    Ryan Jones |SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop seotesting.com Track the performance of those changes via SEO tests. Track Performance Make changes to your site based on hypotheses. Make Changes Based on the results, roll out to the wider site, iterate, or roll back. Roll Out, Iterate, or Roll Back Analyze whether those tests worked or if they didn’t work. Analyze Results
  • 21.
    Ryan Jones |SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop seotesting.com SEO Testing vs. CRO Testing
  • 22.
    Ryan Jones |SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop seotesting.com SEO Testing is Not CRO Testing
  • 23.
    Ryan Jones |SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop seotesting.com SEO Testing CRO Testing Goal Improve SEO Performance Increase On-Site Conversions Metrics Impressions | Clicks | Rankings | CTR Click-Throughs | Sign-Ups | Sales Tools GSC | SEOTesting | SearchPilot | seoClarity WVO | Hotjar | Optimizely | Etc Who “Sees” the Change? Search Engine Bots Real-World Users Testing Method Split Tests | Time-Based Tests Live A/B Tests
  • 24.
    Ryan Jones |SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop seotesting.com Is There Any Overlap?
  • 25.
    Ryan Jones |SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop seotesting.com Shared Testing Approach SEO Testing CRO Testing Can Impact SEO Metrics Changing for Users Can Impact CRO Metrics Changing for Google
  • 26.
    Ryan Jones |SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop seotesting.com Where SEO Testing Fits Into SEO Strategy
  • 27.
    Ryan Jones |SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop seotesting.com SEO Testing Is Part of a Complete SEO Strategy
  • 28.
    Ryan Jones |SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop seotesting.com Content Creation Write and publish content like blog posts, feature pages, PDPs, PLPs, etc. SEO Testing Testing various things across your site based on SEO metrics to improve your results. Iteration & Scaling Using SEO test data to inform strategy going forward, or roll out changes to more areas. Tech Foundation Making sure Google and other search engines can crawl, index and understand. Keyword Research Find what your audience searches for. Build topic lists to target.
  • 29.
    Ryan Jones |SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop seotesting.com Actually, I might have lied a little bit there…
  • 30.
    Ryan Jones |SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop seotesting.com Content Creation Write and publish content like blog posts, feature pages, PDPs, PLPs, etc. Iteration & Scaling Using SEO test data to inform strategy going forward, or roll out changes to more areas. Tech Foundation Making sure Google and other search engines can crawl, index and understand. Keyword Research Find what your audience searches for. Build topic lists to target.
  • 31.
    Ryan Jones |SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop seotesting.com Content Creation Write and publish content like blog posts, feature pages, PDPs, PLPs, etc. Iteration & Scaling Using SEO test data to inform strategy going forward, or roll out changes to more areas. Tech Foundation Making sure Google and other search engines can crawl, index and understand. Keyword Research Find what your audience searches for. Build topic lists to target. Test results can be used to inform strategy and scaling-up work going forward. SEO tests can help you decide what content types work best for different target keywords. Some keywords/topics are easier to rank for. SEO tests can help you choose targets. Use SEO test results to inform your tech stack going forward. Some CMS will work better than others.
  • 32.
    Ryan Jones |SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop seotesting.com Stop Guessing. Start Learning.
  • 33.
    Ryan Jones |SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop seotesting.com You don’t know what works until you test. Google updates change what works. Testing helps you stay ahead of competitors. It removes guesswork from your workflow. The SEO Testing Cycle Measure the results of that test. 02 D e c i d e o n n e x t a c t i o n s . 03 01 C o n d u c t a n S E O t e s t .
  • 34.
    Ryan Jones |SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop seotesting.com Testing Helps You Focus
  • 35.
    Ryan Jones |SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop seotesting.com - Testing allows you to find the changes that move the needle. - You can avoid wasting time on low-impact SEO tasks for your site. - Build “proof” before scaling changes and rolling them out. - Great for justifying changes to teams/stakeholders/clients.
  • 36.
    Ryan Jones |SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop seotesting.com Why does SEO testing matter?
  • 37.
    Ryan Jones |SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop seotesting.com 01 Figure Out What Works 02 Show the Impact of SEO 03 Remove Wasted Time 04 Stop SEO Disasters
  • 38.
    Ryan Jones |SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop seotesting.com
  • 39.
    Ryan Jones |SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop seotesting.com 01 Prove Concepts with SEO Tests 02 Remove “It Depends” 03 Drip Feed Good News 04 Show ROI of SEO
  • 40.
    Ryan Jones |SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop seotesting.com Using SEO Tests to Figure Out What Works
  • 41.
    Ryan Jones |SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop seotesting.com What Does “What Works” Mean in SEO? - More Clicks - Better Rankings - On-Page Metric Improvements - More Conversions
  • 42.
    Ryan Jones |SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop seotesting.com Use SEO Tests to Prove Value Lorem ipsum dolor sit amet at nec at adipiscing 03 ● Donec risus dolor porta venenatis ● Pharetra luctus felis ● Proin in tellus felis volutpat Lorem ipsum dolor sit amet at nec at adipiscing 02 ● Donec risus dolor porta venenatis ● Pharetra luctus felis ● Proin in tellus felis volutpat Lorem ipsum dolor sit amet at nec at adipiscing 01 ● Donec risus dolor porta venenatis ● Pharetra luctus felis ● Proin in tellus felis volutpat Use data to back up changes. 03 Test ideas and measure real results. 02 Don’t rely on best practices. 01 Instead, use tests to validate your own ideas. Test results can be used to inform your own strategy going forward. Use successful tests to get buy-in for other work.
  • 43.
    Ryan Jones |SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop seotesting.com Common SEO Questions to Test - Will adding internal links improve traffic to target pages? - Will adding FAQ schema help us rank for more keywords? - Does updating old content help us improve traffic? - Does our new meta template increase CTR?
  • 44.
    Ryan Jones |SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop seotesting.com Let’s Look at an Example Test:
  • 45.
    Ryan Jones |SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop seotesting.com Will Adding Video Schema Have an Impact?
  • 46.
    Ryan Jones |SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop seotesting.com 👤👤👤👤 👤👤👤👤 👤👤👤👤 👤👤👤 👤👤👤👤 👤👤👤👤 👤👤👤👤 👤👤👤 Pages Without Video Schema Added Pages With Video Schema Added
  • 47.
    Ryan Jones |SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop seotesting.com
  • 48.
    Ryan Jones |SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop seotesting.com What Success Looks Like - More Impressions or Clicks - Higher Position for Key Terms - Better Click-Through Rates - Longer Time Spent on Key Pages
  • 49.
    Ryan Jones |SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop seotesting.com What If There’s No Improvement? - Failed Tests Are Still Wins - Informs Strategy Going Forward - Use Failed Tests to Plan for Better Changes
  • 50.
    Ryan Jones |SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop seotesting.com
  • 51.
    Ryan Jones |SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop seotesting.com Build a Library of Learnings Test Type Test Description Test Status Test Result Split Test New PLP Design Complete +20% Organic Traffic Time-Based Test Adding Internal Links Complete +50% Organic Traffic Split Test New PDP Design Complete 20% Improvement to Engagement Rate Time-Based Test Improving Page Speed Complete 45% Increase in Conversion Rate
  • 52.
    Ryan Jones |SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop seotesting.com Showing the Impact SEO Has on a Website
  • 53.
    Ryan Jones |SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop seotesting.com Why Showing Impact Matters SEO takes time to implement and start bringing in meaningful results. SEO “wins” are often hidden from key stakeholders within the business. SEOs need to constantly prove their value to clients/key stakeholders.
  • 54.
    Ryan Jones |SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop seotesting.com
  • 55.
    Ryan Jones |SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop seotesting.com Who You’re Showing Impact To Clients Managers Founders Other Teams
  • 56.
    Ryan Jones |SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop seotesting.com What They Care About What Key Stakeholders Care About What They Don’t Care About Business Results Organic Traffic Leads or Sales Impacts Impressions Return on Investment Click-Through Rate Overall Traffic Growth On-Page Metrics (with Exceptions)
  • 57.
    Ryan Jones |SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop seotesting.com Tie SEO Metrics to Business Goals Clicks Rankings Indexed Pages Page Speed Leads Traffic Visibility Conversion Rates
  • 58.
    Ryan Jones |SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop seotesting.com Use SEO Tests to Tell Stories 1 We Found a Problem “We realised that 20% of our blog content was out of date. This is content that cost us $26,000 to create. Now it is sat there not generating any return on investment.” We Ideated a Solution “We thought about refreshing half of that content, spending $3,000, to see if this generates a meaningful ROI from the older content.” 2 We Ran a Test “We refreshed 50% of the outdated content, leaving the other 50% unchanged as a control group.” 3 We Saw Massive Gains! “The refreshed content generated an additional 55,000 clicks, generating an additional $14,000 in revenue.” 4
  • 59.
    Ryan Jones |SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop seotesting.com Save Time: Something SEOs Need
  • 60.
    Ryan Jones |SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop seotesting.com How SEO Testing Saves Time - You stop guessing. - You focus only on what works. - You avoid wasting time on weak ideas.
  • 61.
    Ryan Jones |SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop seotesting.com Cut Time Spent on Low-Impact Work Low-Impact High-Impact Creating New Content Backlink Acquisition Improving Page Speed Content Refreshes Optimizing Meta Descriptions Adding Structured Data Where Applicable Image Optimization Improving Internal Linking & Site Structure
  • 62.
    Ryan Jones |SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop seotesting.com Prioritize the Right Changes Adding Internal Links Updating Title Tags Adding Structured Data Improving Headers Refreshing Content New Landing Pages Improve Site Structure Programmatic SEO Fixing Broken Links Adding Alt Tags Site Redesigns Meta Description Rewrites Translating Content High Effort High Impact Low Impact Low Effort
  • 63.
    Ryan Jones |SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop seotesting.com Build a Bank of Proven Wins - Reuse winning tests across the site. - No need to start from scratch each time. - Scale what works faster.
  • 64.
    Ryan Jones |SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop seotesting.com Stop Chasing Trends
  • 65.
    Ryan Jones |SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop seotesting.com While a tactic works, repeat it across your site. Reuse Working Tactics Use SEO test results to find the tactics that work for your site. Find What Works Repeat until those tactics stop working or reduce in effectiveness. Repeat
  • 66.
    Ryan Jones |SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop seotesting.com Stop SEO Disasters
  • 67.
    Ryan Jones |SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop seotesting.com Why SEO Disasters Happen Big changes go live on a website without prior testing. Development teams sometimes move fast and push changes without informing other teams. Nobody checks on the impact of a page/site change until traffic tanks.
  • 68.
    Ryan Jones |SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop seotesting.com What an SEO Disaster Looks Like - Important pages drop off the SERPs. - Rankings collapse. - Traffic tanks overnight. - Leads and sales dry up.
  • 69.
    Ryan Jones |SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop seotesting.com SEO Testing as a Safety Net SEO Test Complete SEO Test Complete Roll Out to Wider Site Revert Back
  • 70.
    Ryan Jones |SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop seotesting.com Build Trust Through Safe Testing Who What They Worry About How Testing Builds Trust SEO Managers Traffic drops from untested changes. Testing shows what’s safe to roll out. Developers Code changes breaking SEO. Tests confirm changes won’t hurt rankings. Content Teams New copy hurting performance. Testing proves if updates help or hurt. Marketing Leaders Wasting time or budget on SEO. Data shows which work drives the best results. Executives / Founders Risk to leads and revenue. Testing reduces risk and shows business impact.
  • 71.
    Ryan Jones |SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop seotesting.com Prove Concepts with SEO Tests (Or Disprove)
  • 72.
    Ryan Jones |SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop seotesting.com Why Prove Concepts? - SEO advice is, literally, everywhere. - Not all of it will work for your site. - Testing separates theory from truth.
  • 73.
    Ryan Jones |SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop seotesting.com How Testing Proves or Disproves a Concept Take a group of pages. Make One Clear Change Measure Change Over Time
  • 74.
    Ryan Jones |SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop seotesting.com Testing a Concept Concept: Adding FAQ Schema Boosts Clicks Test: Add FAQ Schema to 10% of Blog Posts Result: Clicks to Test Pages Rose 12% Lesson: Concept Confirmed. Scale the Change
  • 75.
    Ryan Jones |SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop seotesting.com Remove “It Depends” from Our Vocabulary
  • 76.
    Ryan Jones |SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop seotesting.com
  • 77.
    Ryan Jones |SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop seotesting.com SEO Question Usual Answer Test-Based Answer Should we add more internal links? “It depends.” “Yes. Test pages saw 15% more clicks.” Does FAQ schema improve performance? “It depends.” “Yes. CTR increased by 3% on 10 pages.” Should we merge similar blog posts into one comprehensive piece of content? “It depends.” “No. Merged content lost rankings on all tests.” Will changing title tags help? “It depends.” “Yes. Rank went from 9 to 4 after change.” Should we prune low-traffic pages? “It depends.” “Yes. Sitewide traffic rose 10% after test.”
  • 78.
    Ryan Jones |SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop seotesting.com Drip Feed Good News to Stakeholders
  • 79.
    Ryan Jones |SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop seotesting.com Why Drip Feed SEO Wins? - SEO results often take time. - Big wins can be pretty rare. - Sharing small wins helps build trust and momentum.
  • 80.
    Ryan Jones |SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop seotesting.com What to Share (And When) Type of Update When to Share Example Small Test Wins Weekly or Bi-Weekly Title Update = +18% Clicks Completed Test Summary End of Each Test Content Update Boosted Rankings by 3 Positions Failed Test with a Lesson Monthly or Quarterly Removing FAQ Schema Dropped CTR. Reverted. Grouped Insights from Tests Quarterly Internal Links and Schema Gave Best Results
  • 81.
    Ryan Jones |SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop seotesting.com How It Helps - Keeps stakeholders informed. - Builds confidence in your SEO work. - Makes it easier to ask for more resources. - Turns testing into a habit the whole team supports.
  • 82.
    Ryan Jones |SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop seotesting.com Better Show the ROI of SEO
  • 83.
    Ryan Jones |SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop seotesting.com Why ROI Matters in SEO - SEO takes time. But more importantly. SEO takes money. - Stakeholders want results they can measure. - ROI proves SEO is worth the investment.
  • 84.
    Ryan Jones |SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop seotesting.com How SEO Testing Helps Show ROI Track wins from specific site changes. Tie traffic gains to value: Leads, Sales, Sign-Ups Use Real Data Instead of Projections
  • 85.
    Ryan Jones |SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop seotesting.com Example to Show ROI Impact of SEO Test H1 Product Image and Description H1 Product Image and Info New FAQ Section Test: Added FAQ Schema to Product Content Result: +25% CTR Traffic Value: +5,000 Clicks Per Month If 2% Convert → 100 Extra Leads Value Per Lead: $50 → $5,000pm ROI
  • 86.
    Ryan Jones |SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop seotesting.com The Different Types of SEO Tests
  • 87.
    Ryan Jones |SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop seotesting.com 🅰🅱 Split Tests (A/B Tests)
  • 88.
    Ryan Jones |SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop seotesting.com 🅰🅱 Split Tests (A/B Tests) 🕙⏰ Time-Based Tests
  • 89.
    Ryan Jones |SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop seotesting.com 🅰🅱 Split Tests (A/B Tests) 🕙⏰ Time-Based Tests 🛞🔉 Multivariate Tests
  • 90.
    Ryan Jones |SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop seotesting.com Variables What are you changing & measuring? Tools What tools are you using? Traffic What traffic does your page/s have?
  • 91.
    Ryan Jones |SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop seotesting.com Split Tests (Not A/B Tests)
  • 92.
    Ryan Jones |SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop seotesting.com ‘Test’ Page H1 Product Hero Image Product Info FAQ Content Reviews ‘Control’ Page H1 Product Hero Image Product Information
  • 93.
    Ryan Jones |SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop seotesting.com 👤👤👤👤 👤👤👤👤 👤👤👤👤 👤👤👤 👤👤👤👤 👤👤👤👤 👤👤👤👤 👤👤👤 Control Pages Test Pages
  • 94.
    Ryan Jones |SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop seotesting.com
  • 95.
    Ryan Jones |SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop seotesting.com Page Version ‘A’ Page Version ‘B’ 👤👤👤👤 👤👤👤👤 👤👤👤👤 👤👤👤 👤👤👤👤 👤👤👤👤 👤👤👤👤 👤👤👤 👤👤👤👤 👤👤👤👤 👤👤👤👤 👤👤👤👤 👤👤👤👤 👤👤👤👤 👤👤👤👤 👤👤👤👤 👤👤👤👤 👤👤👤👤 👤👤👤👤 👤👤👤👤 👤👤
  • 96.
    Ryan Jones |SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop seotesting.com Time-Based Tests
  • 97.
    Ryan Jones |SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop seotesting.com Page After Change Page Before Change H1 Main Blog Post Content H1 Main Blog Post Content New FAQ Section
  • 98.
    Ryan Jones |SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop seotesting.com Clicks Before Change Clicks After Change Change Made
  • 99.
    Ryan Jones |SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop seotesting.com Multivariate Tests
  • 100.
    Ryan Jones |SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop seotesting.com Page Before Change H1 Main Blog Post Content Page After Change Changed H1 Tag Main Blog Post Content (With Internal Links Added) Added FAQ Section Added Hero Image
  • 101.
    Ryan Jones |SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop seotesting.com Clicks Before Change Clicks After Change Change Made
  • 102.
    Ryan Jones |SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop seotesting.com How to Decide on a Test Type?
  • 103.
    Ryan Jones |SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop seotesting.com Test Type Best For Needs High Traffic? Page Type Pros Watch Out For Split Test Templated Content PDPs, PLPs, Etc Yes Many Similar Pages Accurate Control Group Comparison Requires Accurate Page Grouping Time-Based Test One-Off Content Unique Content Ideally Single-Page or Group of Pages Easy to Set Up - Great for Quick Tests Can be Impacted by Outside Variables Multivariate Test Testing Multiple Changes at Once Ideally Any Page (Unique or Templated) Tests the Impact of Multiple Changes Hard to Isolate the Impact per Change
  • 104.
    Ryan Jones |SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop seotesting.com How to Run SEO Tests
  • 105.
    Ryan Jones |SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop seotesting.com Step 1: Start with a Hypothesis
  • 106.
    Ryan Jones |SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop seotesting.com What is a Hypothesis?
  • 107.
    Ryan Jones |SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop seotesting.com A statement that is formed from an independent variable, and a dependent variable.
  • 108.
    Ryan Jones |SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop seotesting.com Test Example Independent Variable Dependent Variable Title Tag Rewrite Title Tag Wording Click-Through Rate Adding Internal Links Number & Placement of Internal Links Organic Traffic to Target Page Meta Description Change Description and Content Structure Clicks from the SERPs Adding FAQ Schema Presence of FAQ Structured Data Impressions & CTR Content Expansion Word Count and Added Sections Average Position & Impressions Page Speed Improvement Time to First Byte & Page Load Speed Bounce Rate or Dwell Time H1 Change H1 Text Phrasing Rankings for Target Keyword Removing Thin Content Number of Low-Value Pages Overall Site Visibility & Crawl Efficiency
  • 109.
    Ryan Jones |SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop seotesting.com How is a Hypothesis Formed for SEO Tests?
  • 110.
    Ryan Jones |SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop seotesting.com ✋ Use data to spot an issue.
  • 111.
    Ryan Jones |SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop seotesting.com ✋ Use data to spot an issue. 🧪 Outline the work to be done.
  • 112.
    Ryan Jones |SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop seotesting.com ✋ Use data to spot an issue. 🧪 Outline the work to be done. 😎 Make an educated guess.
  • 113.
    Ryan Jones |SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop seotesting.com Use Data to Spot Issues: Our page’s current click-through rate is below the expected average for SERP Position 4.
  • 114.
    Ryan Jones |SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop seotesting.com Outline the Work: We will rewrite our page’s title tag to better match search intent, and shorten it to below 60 characters.
  • 115.
    Ryan Jones |SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop seotesting.com Make Educated Guesses: The work we do to our page will increase its click-through rate.
  • 116.
    Ryan Jones |SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop seotesting.com Our page’s current CTR (1.2%) is less than the expected for SERP Position 4. We will rewrite our page’s title tag to better match search intent and bring it below 60 characters. This will increase this page’s CTR for our target keyword.
  • 117.
    Ryan Jones |SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop seotesting.com How to Ideate Hypotheses
  • 118.
    Ryan Jones |SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop seotesting.com How can we keep users on the page longer once they land? 05 ● Add a table of contents for long-form blog posts. ● Improve above-the-fold content clarity. ● Add internal links to encourage further browsing. How can we move our pages higher up in the rankings? 04 ● Donec risus dolor porta venenatis ● Pharetra luctus felis ● Proin in tellus felis volutpat Why are people seeing our page but not clicking on it? 03 ● Test shorter vs. longer title tags. ● Add emotion or urgency to meta titles. ● Experiment with symbols or brackets in title tags. How can we show up for more search queries? 02 ● Add related keywords into existing content. ● Expand on thin pages with more detailed sections. ● Optimize headings to reflect keyword variations. How can we get more people to click on our page from search results? 01 ● Rewrite title tags to match search intent. ● Add a CTA or value proposition to meta descriptions. ● Use FAQ schema to earn rich snippets.
  • 119.
    Ryan Jones |SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop seotesting.com Step 2: Choose the Type of SEO Test
  • 120.
    Ryan Jones |SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop seotesting.com Some Questions to Ask Am I changing one thing, or changing multiple? Do I have similar content templates to use as a control? Is the page I am testing on a high-traffic page?
  • 121.
    Ryan Jones |SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop seotesting.com Test Type Comparison Table Test Type Best For Needs High Traffic? Page Type Pros Watch Out For Split Test Templated Pages Yes Groups of Similar Pages Clear Control Group. Reliable Comparison Needs proper grouping. Easy to get wrong. Time-Based Test One-Off or Unique Pages No (But Helps) Single or Small Group of Pages Easy to Run. Works Well for Small Sites Can be skewed by algorithm updates or seasonality. Multivariate Test Pages with High Traffic Yes Any Page Test Combinations of Changes Together Hard to isolate which change caused what result.
  • 122.
    Ryan Jones |SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop seotesting.com
  • 123.
    Ryan Jones |SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop seotesting.com Split Test Time-Based Test Multivariate Test I am testing a single change, on templated content, with lots of traffic:
  • 124.
    Ryan Jones |SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop seotesting.com Split Test Time-Based Test Multivariate Test I am testing a single change, on templated content, with lots of traffic: ✅ ❌ ❌
  • 125.
    Ryan Jones |SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop seotesting.com Split Test Time-Based Test Multivariate Test I am testing changing the H1 to a single page, non-templated content:
  • 126.
    Ryan Jones |SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop seotesting.com Split Test Time-Based Test Multivariate Test I am testing changing the H1 to a single page, non-templated content: ❌ ✅ ❌
  • 127.
    Ryan Jones |SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop seotesting.com Split Test Time-Based Test Multivariate Test I am testing a full content refresh on a single page:
  • 128.
    Ryan Jones |SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop seotesting.com Split Test Time-Based Test Multivariate Test I am testing a full content refresh on a single page: ❌ ❌ ✅
  • 129.
    Ryan Jones |SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop seotesting.com Step 3: Choose the Page or Pages to Test On
  • 130.
    Ryan Jones |SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop seotesting.com Performance-Based Questions
  • 131.
    Ryan Jones |SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop seotesting.com 1⃣ Which pages get the most impressions but low clicks? 2⃣ Which pages have high bounce rates? 3⃣ Which pages have dropped in traffic recently? 4⃣ Which pages have stagnated within the rankings? 5⃣ Which pages rank on Page 2 or 3 for target keywords?
  • 132.
    Ryan Jones |SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop seotesting.com Optimization Opportunity Questions
  • 133.
    Ryan Jones |SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop seotesting.com 1⃣ Do any pages lack internal links pointing to them? 2⃣ Do some pages have outdated or thin content? 3⃣ Are some pages missing structured data? 4⃣ Are any title tags too long, or missing important keywords? 5⃣ Do similar pages perform very differently?
  • 134.
    Ryan Jones |SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop seotesting.com Testing Value Questions
  • 135.
    Ryan Jones |SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop seotesting.com 1⃣ Can I isolate this page from others for a test? 2⃣ Will changes on this page affect site performance? 3⃣ Is this page part of a large group I can test across? 4⃣ Can I measure the test result easily? 5⃣ Is this page important for conversions/leads?
  • 136.
    Ryan Jones |SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop seotesting.com Step 4: Run the Test (And Wait)
  • 137.
    Ryan Jones |SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop seotesting.com Launching the Test 1⃣ Make the Change 2⃣ Note the Start Date 3⃣ Use Annotations to Show Tests
  • 138.
    Ryan Jones |SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop seotesting.com Set a Testing Window
  • 139.
    Ryan Jones |SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop seotesting.com Testing Tips - Don’t change multiple things mid-test. - Avoid running test during Google Core Updates. - If possible, freeze other SEO activity. Especially on test pages!
  • 140.
    Ryan Jones |SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop seotesting.com Step 5: Analyze the Test Results
  • 141.
    Ryan Jones |SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop seotesting.com - Clicks - Click-Through Rate - Impressions - Average Position - On-Page Metrics (For Some Tests) What Metrics to Track
  • 142.
    Ryan Jones |SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop seotesting.com Example SEO Test Result
  • 143.
    Ryan Jones |SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop seotesting.com Don’t “Just” Use Graphs
  • 144.
    Ryan Jones |SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop seotesting.com Did this result happen by chance… or is it real? - Small changes can happen by chance. - We use stat sig to check if the result is meaningful. - Most tools aim for 95% confidence. - If the sample size is too small, wait longer or rerun the test.
  • 145.
    Ryan Jones |SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop seotesting.com Again: Use Data to Tell a Story 1 We Found a Problem “We realised that 20% of our blog content was out of date. This is content that cost us $26,000 to create. Now it is sat there not generating any return on investment.” We Ideated a Solution “We thought about refreshing half of that content, spending $3,000, to see if this generates a meaningful ROI from the older content.” 2 We Ran a Test “We refreshed 50% of the outdated content, leaving the other 50% unchanged as a control group.” 3 We Saw Massive Gains! “The refreshed content generated an additional 55,000 clicks, generating an additional $14,000 in revenue.” 4
  • 146.
    Ryan Jones |SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop seotesting.com Step 6: Decide on the Next Steps
  • 147.
    Ryan Jones |SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop seotesting.com ✅ Test Worked → Roll Out Sitewide ❌ Test Failed → Revert and Learn 🤔 Unclear → Try a New Variation
  • 148.
    Ryan Jones |SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop seotesting.com Record the hypothesis you used for your test. Note the change you made to your site and the test result. Add to your internal SEO testing log. Document What You Learned
  • 149.
    Ryan Jones |SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop seotesting.com The SEO Testing Cycle The SEO Testing Cycle Conduct your Test 01 Analyze the Results 02 Decide on Next Actions 03 Form your Test 04
  • 150.
    Ryan Jones |SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop seotesting.com What Things to Test On (With Real-World Examples)
  • 151.
    Ryan Jones |SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop seotesting.com Page Titles
  • 152.
    Ryan Jones |SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop seotesting.com ‘Test’ Page New H1 with Dates Unchanged Blog Content ‘Control’ Page Original H1 Unchanged Blog Content Adding Year and Month to Page Title
  • 153.
    Ryan Jones |SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop seotesting.com
  • 154.
    Ryan Jones |SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop seotesting.com ‘Test’ Page Keyword + Brand Unchanged Blog Content ‘Control’ Page Keyword + Date + Brand Unchanged Blog Content Simplifying Page Titles
  • 155.
    Ryan Jones |SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop seotesting.com
  • 156.
    Ryan Jones |SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop seotesting.com ‘Test’ Page SEO Guide Unchanged Blog Content ‘Control’ Page SEO Guide 2023 Unchanged Blog Content Removing Published Date from Old Content
  • 157.
    Ryan Jones |SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop seotesting.com
  • 158.
    Ryan Jones |SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop seotesting.com Specific Page Elements
  • 159.
    Ryan Jones |SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop seotesting.com ‘Test’ Page ‘Control’ Page Product Name Hero Image Hero Section - 1 Hero Pic vs Clickable Carousel Product Info FAQs Detailed Product Description Product Name Clickable Carousel Product Info FAQs Detailed Product Description
  • 160.
    Ryan Jones |SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop seotesting.com
  • 161.
    Ryan Jones |SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop seotesting.com ‘Test’ Page ‘Control’ Page H1 Added Navigation to Blog Posts (More User Interaction) Main Blog Post Content Product Name Table of Contents (Navigation) Main Blog Post Content
  • 162.
    Ryan Jones |SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop seotesting.com
  • 163.
    Ryan Jones |SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop seotesting.com Links
  • 164.
    Ryan Jones |SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop seotesting.com ‘Test’ Page ‘Control’ Page H1 Internal Links to Pages Main Blog Post Content (Unchanged) H1 Main Blog Post Content (Internal Links Added)
  • 165.
    Ryan Jones |SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop seotesting.com
  • 166.
    Ryan Jones |SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop seotesting.com ‘Test’ Page ‘Control’ Page H1 Reduced Number of Outbound Links (Retain Link Equity) Blog Post with 5 Outbound Links H1 Blog Post with 0 Outbound Links
  • 167.
    Ryan Jones |SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop seotesting.com
  • 168.
    Ryan Jones |SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop seotesting.com Page Design
  • 169.
    Ryan Jones |SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop seotesting.com ‘Test’ Page ‘Control’ Page Product Name Hero Image New Product Page Design Product Info Detailed Product Description Product Name Hero Image FAQs Price Options Detailed Product Description Key Info
  • 170.
    Ryan Jones |SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop seotesting.com
  • 171.
    Ryan Jones |SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop seotesting.com Content
  • 172.
    Ryan Jones |SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop seotesting.com ‘Test’ Page ‘Control’ Page Product Name Hero Image Adding More Data to Product Pages Product Info Product Name Hero Image Detailed Product Description FAQ Section Price Options Similar Items
  • 173.
    Ryan Jones |SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop seotesting.com
  • 174.
    Ryan Jones |SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop seotesting.com ‘Test’ Page ‘Control’ Page H1 Accordion Remove Accordions - Make All Content Visible Main Blog Content Product Name Main Blog Content
  • 175.
    Ryan Jones |SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop seotesting.com
  • 176.
    Ryan Jones |SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop seotesting.com
  • 177.
    Ryan Jones |SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop seotesting.com ‘Test’ Page ‘Control’ Page H1 Adding E-E-A-T Main Blog Content H1 Main Blog Content Reviewed by Nick Swan
  • 178.
    Ryan Jones |SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop seotesting.com
  • 179.
    Ryan Jones |SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop seotesting.com ‘Test’ Page ‘Control’ Page H1 Testing Adding Display Advertising to Blog Posts Main Blog Content H1 Blog Content Blog Content Blog Content Display Ads
  • 180.
    Ryan Jones |SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop seotesting.com
  • 181.
    Ryan Jones |SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop seotesting.com SEO Testing Tools You Can Use
  • 182.
    Ryan Jones |SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop seotesting.com Do you have a budget for SEO testing tools? And many more…
  • 183.
    Ryan Jones |SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop seotesting.com Don’t have a budget? Use Free Tools: GSC, GA4, Sheets, Excel
  • 184.
    Ryan Jones |SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop seotesting.com
  • 185.
    Ryan Jones |SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop seotesting.com Small Scale Tests Show ROI of SEO Testing Run Tests to Prove Value 💰
  • 186.
    Ryan Jones |SEOTesting | @RyanJonesSEO SEO Testing & Experimentation Workshop seotesting.com Any Questions?
  • 187.
  • 188.
    Connect With Me!󰛈 LinkedIn - linkedin.com/in/ryan-g-jones/ X - x.com/ryanjonesseo Bluesky - bsky.app/profile/ryanjonesseo.bsky.social https://seotesting.com/