Explainable Machine Learning for Ranking Factors

Vincent Terrasi
Vincent TerrasiProduct Director & Data Science Coach
Explainable Machine Learning for
Ranking Factors
@OnCrawl
#brightonseo
Vincent Terrasi
Product Director
@OnCrawl
+20 years experience in SEO
Data Science coach
Speaking
today
@OnCrawl
#brightonseo
OnCrawl SEO Crawler
OnCrawl Log Analyzer
OnCrawl Data³
OnCrawl Labs
@OnCrawl
#brightonseo
For more information, visit
www.oncrawl.com
Flight
plan
- Which ranking factors are important?
- How to interpret "black box" machine
learning models?
- How does a ranking factor contribute
to ranking for individual URLs?
- What's next for interpreting machine
learning?
@OnCrawl
#brightonseo
@OnCrawl
#brightonseo
https://www.uptimiser.com.hk/
Machine Learning Model
Ready-To-Use
ModelURL
TOP 10
NOT
TOP 10
Accuracy: 92%
Error rate: 8%
@OnCrawl
#brightonseo
Ranking Factors
Accuracy: 92%
Error rate: 8%
@OnCrawl
#brightonseo
with Response Time
Error rate: 8% Error rate: 20%
without Response Time
Variable Importance: 20 - 8 = 12%
@OnCrawl
#brightonseo
Explain one variable: Basic Method
(e.g.: Citation Flow)
Ready-To-Use
Model
URL with
different
CF values
HIGH INFLUENCE:
URL with CF=90
URL with CF=80
….
URL with CF=50
LOW INFLUENCE
URL with CF<20
Accuracy: 92%
Error rate: 8%
@OnCrawl
#brightonseo
Explain one variable: Basic Method
(e.g.: Citation Flow)
@OnCrawl
#brightonseo
Black box model: Can you explain per URL?
@OnCrawl
#brightonseo
Interpretable Accurate
Complex model
Simple model
Interpretable or accurate: choose one
@OnCrawl
#brightonseo
Can you interpret complex models?
@OnCrawl
#brightonseo
Explicability with Shapley: Nobel Prize in 2012
Excellent Load Time : +10%
WordCount > 600 : +5%
TrustFlow > 70 : +5%
Threshold
40%
Prediction for URL 1
60%0%
@OnCrawl
#brightonseo
It is mind-blowing to explain a
prediction as a cooperative
game played by the feature
values.
@OnCrawl
#brightonseo
Shapley:
Prediction as a game played by feature value
Word
Count
Response
Time
Inlinks
Citation
Flow Trust
Flow
https://clearcode.cc/blog/game-theory-attribution/
@OnCrawl
#brightonseo
Shapley:
Simulation with 3 features = 2^3 cases
https://clearcode.cc/blog/game-theory-attribution/
@OnCrawl
#brightonseo
Python Library: SHAP
https://github.com/slundberg/shap
@OnCrawl
#brightonseo
Python Library: SHAP
https://github.com/slundberg/shap
@OnCrawl
#brightonseo
Python Library: SHAP
https://github.com/slundberg/shap
@OnCrawl
#brightonseo
● A lot of computing time. (2k)
● Explanations created with the Shapley value
method always use all the features.
Disadvantages
@OnCrawl
#brightonseo
New way to boost your SEO with Data Science
@OnCrawl
#brightonseo
xAI Concept
Source : Darpa
@OnCrawl
#brightonseo
@OnCrawl
#brightonseo
Using Google Colab,
we’ll open ‘à la carte’
algorithms to address
strategic SEO issues based on
Python and R.
First R&D projects available!
Key Takeaways:
● You can use ML to find your own ranking
factors
● Shapley Values is a good method to better
understand a model
● Shapley Library is available with Python, R
or directly with Dataiku
● Currently, xAI is the best framework to
level up your SEO
@OnCrawl
#brightonseo
www.oncrawl.com
Enjoy a 1-month free trial
http://cgntv.co/f
@OnCrawl
#brightonseo
Thank you!
Any questions?
@vincentterrasi
1 of 27

Recommended

How Data Science can boost your SEO ? by
How Data Science can boost your SEO ?How Data Science can boost your SEO ?
How Data Science can boost your SEO ?Vincent Terrasi
3.6K views59 slides
Google Hacking Basics by
Google Hacking BasicsGoogle Hacking Basics
Google Hacking Basicsamiable_indian
12.6K views32 slides
SearchLove London 2016 | Dom Woodman | How to Get Insight From Your Logs by
SearchLove London 2016 | Dom Woodman | How to Get Insight From Your LogsSearchLove London 2016 | Dom Woodman | How to Get Insight From Your Logs
SearchLove London 2016 | Dom Woodman | How to Get Insight From Your LogsDistilled
4.9K views168 slides
Extreme Google by
Extreme GoogleExtreme Google
Extreme Googlemlx
9K views22 slides
Migration Best Practices - SMX London 2018 by
Migration Best Practices - SMX London 2018Migration Best Practices - SMX London 2018
Migration Best Practices - SMX London 2018Bastian Grimm
7.7K views59 slides
Rich Snippets چیست ؟نسخه PDF by
Rich Snippets چیست ؟نسخه PDFRich Snippets چیست ؟نسخه PDF
Rich Snippets چیست ؟نسخه PDFseotrade.ir
35 views22 slides

More Related Content

What's hot

Three site speed optimisation tips to make your website REALLY fast - Brighto... by
Three site speed optimisation tips to make your website REALLY fast - Brighto...Three site speed optimisation tips to make your website REALLY fast - Brighto...
Three site speed optimisation tips to make your website REALLY fast - Brighto...Bastian Grimm
7.9K views56 slides
A Technical Look at Content - PUBCON SFIMA 2017 - Patrick Stox by
A Technical Look at Content - PUBCON SFIMA 2017 - Patrick StoxA Technical Look at Content - PUBCON SFIMA 2017 - Patrick Stox
A Technical Look at Content - PUBCON SFIMA 2017 - Patrick Stoxpatrickstox
20.3K views41 slides
Whats Next in SEO & CRO - 3XE Conference 2018 Dublin by
Whats Next in SEO & CRO - 3XE Conference 2018 DublinWhats Next in SEO & CRO - 3XE Conference 2018 Dublin
Whats Next in SEO & CRO - 3XE Conference 2018 DublinBastian Grimm
1K views65 slides
SMX Advanced 2018 SEO for Javascript Frameworks by Patrick Stox by
SMX Advanced 2018 SEO for Javascript Frameworks by Patrick StoxSMX Advanced 2018 SEO for Javascript Frameworks by Patrick Stox
SMX Advanced 2018 SEO for Javascript Frameworks by Patrick Stoxpatrickstox
12.3K views69 slides
International Site Speed Tweaks - ISS 2017 Barcelona by
International Site Speed Tweaks - ISS 2017 BarcelonaInternational Site Speed Tweaks - ISS 2017 Barcelona
International Site Speed Tweaks - ISS 2017 BarcelonaBastian Grimm
5.6K views88 slides
How fast is fast enough - SMX West 2018 by
How fast is fast enough - SMX West 2018How fast is fast enough - SMX West 2018
How fast is fast enough - SMX West 2018Bastian Grimm
7.6K views53 slides

What's hot(11)

Three site speed optimisation tips to make your website REALLY fast - Brighto... by Bastian Grimm
Three site speed optimisation tips to make your website REALLY fast - Brighto...Three site speed optimisation tips to make your website REALLY fast - Brighto...
Three site speed optimisation tips to make your website REALLY fast - Brighto...
Bastian Grimm7.9K views
A Technical Look at Content - PUBCON SFIMA 2017 - Patrick Stox by patrickstox
A Technical Look at Content - PUBCON SFIMA 2017 - Patrick StoxA Technical Look at Content - PUBCON SFIMA 2017 - Patrick Stox
A Technical Look at Content - PUBCON SFIMA 2017 - Patrick Stox
patrickstox20.3K views
Whats Next in SEO & CRO - 3XE Conference 2018 Dublin by Bastian Grimm
Whats Next in SEO & CRO - 3XE Conference 2018 DublinWhats Next in SEO & CRO - 3XE Conference 2018 Dublin
Whats Next in SEO & CRO - 3XE Conference 2018 Dublin
Bastian Grimm1K views
SMX Advanced 2018 SEO for Javascript Frameworks by Patrick Stox by patrickstox
SMX Advanced 2018 SEO for Javascript Frameworks by Patrick StoxSMX Advanced 2018 SEO for Javascript Frameworks by Patrick Stox
SMX Advanced 2018 SEO for Javascript Frameworks by Patrick Stox
patrickstox12.3K views
International Site Speed Tweaks - ISS 2017 Barcelona by Bastian Grimm
International Site Speed Tweaks - ISS 2017 BarcelonaInternational Site Speed Tweaks - ISS 2017 Barcelona
International Site Speed Tweaks - ISS 2017 Barcelona
Bastian Grimm5.6K views
How fast is fast enough - SMX West 2018 by Bastian Grimm
How fast is fast enough - SMX West 2018How fast is fast enough - SMX West 2018
How fast is fast enough - SMX West 2018
Bastian Grimm7.6K views
Identifying Patterns for Fun, Profit, and Rankings - Search Exchange 2013 by Joe Hall
Identifying Patterns for Fun, Profit, and Rankings - Search Exchange 2013Identifying Patterns for Fun, Profit, and Rankings - Search Exchange 2013
Identifying Patterns for Fun, Profit, and Rankings - Search Exchange 2013
Joe Hall3.1K views
Rendering SEO (explained by Google's Martin Splitt) by Anton Shulke
Rendering SEO (explained by Google's Martin Splitt)Rendering SEO (explained by Google's Martin Splitt)
Rendering SEO (explained by Google's Martin Splitt)
Anton Shulke649 views
Measuring Content Marketing by David Iwanow
Measuring Content MarketingMeasuring Content Marketing
Measuring Content Marketing
David Iwanow11.3K views
Migration Best Practices - SMX West 2019 by Bastian Grimm
Migration Best Practices - SMX West 2019Migration Best Practices - SMX West 2019
Migration Best Practices - SMX West 2019
Bastian Grimm3.3K views

Similar to Explainable Machine Learning for Ranking Factors

Leveling up your JavaScipt - DrupalJam 2017 by
Leveling up your JavaScipt - DrupalJam 2017Leveling up your JavaScipt - DrupalJam 2017
Leveling up your JavaScipt - DrupalJam 2017Christian Heilmann
581 views94 slides
Progressive web and the problem of JavaScript by
Progressive web and the problem of JavaScriptProgressive web and the problem of JavaScript
Progressive web and the problem of JavaScriptChristian Heilmann
6.1K views96 slides
Tom Capper Mozcon 2021 - Core Web Vitals - The Fast & The Spurious by
Tom Capper Mozcon 2021 - Core Web Vitals - The Fast & The SpuriousTom Capper Mozcon 2021 - Core Web Vitals - The Fast & The Spurious
Tom Capper Mozcon 2021 - Core Web Vitals - The Fast & The SpuriousTom Capper
423 views124 slides
Slay the Dragons of Agile Measurement by
Slay the Dragons of Agile MeasurementSlay the Dragons of Agile Measurement
Slay the Dragons of Agile MeasurementJosiah Renaudin
226 views57 slides
From Web Site to Web App: Fantastic Optimisations and Where To Find Them by
From Web Site to Web App: Fantastic Optimisations and Where To Find ThemFrom Web Site to Web App: Fantastic Optimisations and Where To Find Them
From Web Site to Web App: Fantastic Optimisations and Where To Find ThemMobileMoxie
593 views115 slides
Brighton SEO April 2022 - Automate the technical SEO stuff by
Brighton SEO April 2022 - Automate the technical SEO stuffBrighton SEO April 2022 - Automate the technical SEO stuff
Brighton SEO April 2022 - Automate the technical SEO stuffMichael Van Den Reym
6.3K views81 slides

Similar to Explainable Machine Learning for Ranking Factors(20)

Progressive web and the problem of JavaScript by Christian Heilmann
Progressive web and the problem of JavaScriptProgressive web and the problem of JavaScript
Progressive web and the problem of JavaScript
Christian Heilmann6.1K views
Tom Capper Mozcon 2021 - Core Web Vitals - The Fast & The Spurious by Tom Capper
Tom Capper Mozcon 2021 - Core Web Vitals - The Fast & The SpuriousTom Capper Mozcon 2021 - Core Web Vitals - The Fast & The Spurious
Tom Capper Mozcon 2021 - Core Web Vitals - The Fast & The Spurious
Tom Capper423 views
Slay the Dragons of Agile Measurement by Josiah Renaudin
Slay the Dragons of Agile MeasurementSlay the Dragons of Agile Measurement
Slay the Dragons of Agile Measurement
Josiah Renaudin226 views
From Web Site to Web App: Fantastic Optimisations and Where To Find Them by MobileMoxie
From Web Site to Web App: Fantastic Optimisations and Where To Find ThemFrom Web Site to Web App: Fantastic Optimisations and Where To Find Them
From Web Site to Web App: Fantastic Optimisations and Where To Find Them
MobileMoxie593 views
Brighton SEO April 2022 - Automate the technical SEO stuff by Michael Van Den Reym
Brighton SEO April 2022 - Automate the technical SEO stuffBrighton SEO April 2022 - Automate the technical SEO stuff
Brighton SEO April 2022 - Automate the technical SEO stuff
How to build simple web apps to automate your SEO tasks - BrightonSEO Spring ... by Charly Wargnier
How to build simple web apps to automate your SEO tasks - BrightonSEO Spring ...How to build simple web apps to automate your SEO tasks - BrightonSEO Spring ...
How to build simple web apps to automate your SEO tasks - BrightonSEO Spring ...
Charly Wargnier2.2K views
Dynamic Rendering - is this really an SEO silver bullet? SMX WEST by Onely
Dynamic Rendering - is this really an SEO silver bullet? SMX WESTDynamic Rendering - is this really an SEO silver bullet? SMX WEST
Dynamic Rendering - is this really an SEO silver bullet? SMX WEST
Onely10.8K views
SearchLove London | Dave Sottimano, 'Using Data to Win Arguments' by Distilled
SearchLove London | Dave Sottimano, 'Using Data to Win Arguments' SearchLove London | Dave Sottimano, 'Using Data to Win Arguments'
SearchLove London | Dave Sottimano, 'Using Data to Win Arguments'
Distilled6.3K views
How Search Works by Ahrefs
How Search WorksHow Search Works
How Search Works
Ahrefs4.3K views
Best practice is not enough #brightonSEO @Linkdex #SEOnow stage by Branded3
Best practice is not enough #brightonSEO @Linkdex #SEOnow stageBest practice is not enough #brightonSEO @Linkdex #SEOnow stage
Best practice is not enough #brightonSEO @Linkdex #SEOnow stage
Branded39K views
Achieving Technical Excellence in Your Software Teams - from Devternity by Peter Gfader
Achieving Technical Excellence in Your Software Teams - from Devternity Achieving Technical Excellence in Your Software Teams - from Devternity
Achieving Technical Excellence in Your Software Teams - from Devternity
Peter Gfader660 views
Debugging rendering problems at scale by Giacomo Zecchini
Debugging rendering problems at scaleDebugging rendering problems at scale
Debugging rendering problems at scale
Giacomo Zecchini645 views
BrightonSEO 2017 - SEO quick wins from a technical check by Chloe Bodard
BrightonSEO 2017  - SEO quick wins from a technical checkBrightonSEO 2017  - SEO quick wins from a technical check
BrightonSEO 2017 - SEO quick wins from a technical check
Chloe Bodard8.9K views
From Mess To Masterpiece - JFokus 2017 by Sven Ruppert
From Mess To Masterpiece - JFokus 2017From Mess To Masterpiece - JFokus 2017
From Mess To Masterpiece - JFokus 2017
Sven Ruppert179 views
2018-05-09_CRAFTConf_FirstStepsMovingToTheCloud by Abigail Bangser
2018-05-09_CRAFTConf_FirstStepsMovingToTheCloud2018-05-09_CRAFTConf_FirstStepsMovingToTheCloud
2018-05-09_CRAFTConf_FirstStepsMovingToTheCloud
Abigail Bangser179 views
Deeplearning for industries | Data to Production by Rahul Kumar
Deeplearning for industries | Data to ProductionDeeplearning for industries | Data to Production
Deeplearning for industries | Data to Production
Rahul Kumar31 views
The Future of Technical SEO | Women in Tech SEO 2019 | Rachel Costello by Rachel Costello
The Future of Technical SEO | Women in Tech SEO 2019 | Rachel CostelloThe Future of Technical SEO | Women in Tech SEO 2019 | Rachel Costello
The Future of Technical SEO | Women in Tech SEO 2019 | Rachel Costello
Rachel Costello783 views
TechSEO Boost 2017: Fun with Machine Learning: How Machine Learning is Shapin... by Catalyst
TechSEO Boost 2017: Fun with Machine Learning: How Machine Learning is Shapin...TechSEO Boost 2017: Fun with Machine Learning: How Machine Learning is Shapin...
TechSEO Boost 2017: Fun with Machine Learning: How Machine Learning is Shapin...
Catalyst58.6K views

More from Vincent Terrasi

IA générative : Menace ou Opportunité pour le SEO by
IA générative : Menace ou Opportunité pour le SEOIA générative : Menace ou Opportunité pour le SEO
IA générative : Menace ou Opportunité pour le SEOVincent Terrasi
91 views45 slides
Une IA pour votre SEO, une méthode inédite pour accélérer vos projets Data SEO by
Une IA pour votre SEO, une méthode inédite pour accélérer vos projets Data SEOUne IA pour votre SEO, une méthode inédite pour accélérer vos projets Data SEO
Une IA pour votre SEO, une méthode inédite pour accélérer vos projets Data SEOVincent Terrasi
14 views37 slides
SEO AnswerBox, une méthode inédite pour interroger vos données et créer vos d... by
SEO AnswerBox, une méthode inédite pour interroger vos données et créer vos d...SEO AnswerBox, une méthode inédite pour interroger vos données et créer vos d...
SEO AnswerBox, une méthode inédite pour interroger vos données et créer vos d...Vincent Terrasi
126 views41 slides
Génération de contenu pour le SEO by
Génération de contenu pour le SEOGénération de contenu pour le SEO
Génération de contenu pour le SEOVincent Terrasi
4.1K views51 slides
Comment faire du Data SEO sans savoir programmer ? by
Comment faire du Data SEO sans savoir programmer ?Comment faire du Data SEO sans savoir programmer ?
Comment faire du Data SEO sans savoir programmer ?Vincent Terrasi
206 views39 slides
Fausses données et Bad Data : restez vigilant ! by
Fausses données et Bad Data : restez vigilant !Fausses données et Bad Data : restez vigilant !
Fausses données et Bad Data : restez vigilant !Vincent Terrasi
345 views23 slides

More from Vincent Terrasi(12)

IA générative : Menace ou Opportunité pour le SEO by Vincent Terrasi
IA générative : Menace ou Opportunité pour le SEOIA générative : Menace ou Opportunité pour le SEO
IA générative : Menace ou Opportunité pour le SEO
Vincent Terrasi91 views
Une IA pour votre SEO, une méthode inédite pour accélérer vos projets Data SEO by Vincent Terrasi
Une IA pour votre SEO, une méthode inédite pour accélérer vos projets Data SEOUne IA pour votre SEO, une méthode inédite pour accélérer vos projets Data SEO
Une IA pour votre SEO, une méthode inédite pour accélérer vos projets Data SEO
Vincent Terrasi14 views
SEO AnswerBox, une méthode inédite pour interroger vos données et créer vos d... by Vincent Terrasi
SEO AnswerBox, une méthode inédite pour interroger vos données et créer vos d...SEO AnswerBox, une méthode inédite pour interroger vos données et créer vos d...
SEO AnswerBox, une méthode inédite pour interroger vos données et créer vos d...
Vincent Terrasi126 views
Génération de contenu pour le SEO by Vincent Terrasi
Génération de contenu pour le SEOGénération de contenu pour le SEO
Génération de contenu pour le SEO
Vincent Terrasi4.1K views
Comment faire du Data SEO sans savoir programmer ? by Vincent Terrasi
Comment faire du Data SEO sans savoir programmer ?Comment faire du Data SEO sans savoir programmer ?
Comment faire du Data SEO sans savoir programmer ?
Vincent Terrasi206 views
Fausses données et Bad Data : restez vigilant ! by Vincent Terrasi
Fausses données et Bad Data : restez vigilant !Fausses données et Bad Data : restez vigilant !
Fausses données et Bad Data : restez vigilant !
Vincent Terrasi345 views
Comment les plateformes de Data Science métamorphosent le SEO ? by Vincent Terrasi
Comment les plateformes de Data Science métamorphosent le SEO ?Comment les plateformes de Data Science métamorphosent le SEO ?
Comment les plateformes de Data Science métamorphosent le SEO ?
Vincent Terrasi727 views
Find out how DataScience has revolutionized SEO for OVH by Vincent Terrasi
Find out how DataScience has revolutionized SEO for OVHFind out how DataScience has revolutionized SEO for OVH
Find out how DataScience has revolutionized SEO for OVH
Vincent Terrasi692 views
How to boost your datamanagement with Dremio ? by Vincent Terrasi
How to boost your datamanagement with Dremio ?How to boost your datamanagement with Dremio ?
How to boost your datamanagement with Dremio ?
Vincent Terrasi1.4K views
How to automate all your SEO projects by Vincent Terrasi
How to automate all your SEO projectsHow to automate all your SEO projects
How to automate all your SEO projects
Vincent Terrasi3.2K views
Analyse your SEO Data with R and Kibana by Vincent Terrasi
Analyse your SEO Data with R and KibanaAnalyse your SEO Data with R and Kibana
Analyse your SEO Data with R and Kibana
Vincent Terrasi6.9K views

Recently uploaded

Deltaplan - SEO Search by
Deltaplan - SEO SearchDeltaplan - SEO Search
Deltaplan - SEO SearchRoy Huiskes
49 views57 slides
First 30 days of Your CRO Program by
First 30 days of Your CRO ProgramFirst 30 days of Your CRO Program
First 30 days of Your CRO ProgramVWO
47 views57 slides

Recently uploaded(20)

Deltaplan - SEO Search by Roy Huiskes
Deltaplan - SEO SearchDeltaplan - SEO Search
Deltaplan - SEO Search
Roy Huiskes49 views
First 30 days of Your CRO Program by VWO
First 30 days of Your CRO ProgramFirst 30 days of Your CRO Program
First 30 days of Your CRO Program
VWO47 views
AZoNetwork Newsletter Audiences 2024.pdf by Rebecca731061
AZoNetwork Newsletter Audiences 2024.pdfAZoNetwork Newsletter Audiences 2024.pdf
AZoNetwork Newsletter Audiences 2024.pdf
Rebecca73106170 views
Turning Business Challenges into Testable Ideas - 29 Nov '23.pdf by VWO
Turning Business Challenges into Testable Ideas - 29 Nov '23.pdfTurning Business Challenges into Testable Ideas - 29 Nov '23.pdf
Turning Business Challenges into Testable Ideas - 29 Nov '23.pdf
VWO34 views

Explainable Machine Learning for Ranking Factors