SlideShare a Scribd company logo
Developing SEO Tools:
Custom solutions with free and paid APIs
Max Prin
CONDÉ NAST | TECHNICALSEO.COM
slideshare.net/MaxPrin
@maxxeight
(Traditional) SEO Pillars
Relevance
Content Strategy
Authority & Trust
Link Building
Site Infrastructure
Technical SEO
Improving the site infrastructure in order to optimize
crawling and indexing to eventually increase ranking.
True, but incomplete.
Technical SEO?
Technical SEO?
“Any sufficiently technical action undertaken
with the intent to improve search results.”
– Russ Jones
Technical SEO
Site Health
Fixes + Improvements
01
Tooling
Automation + Reporting
02
Tooling
Getting Started
Getting Started
● Google Cloud Platform Free Tier
○ Virtual machine
○ Storage
○ APIs
https://cloud.google.com/free
Getting Started
● Front-end (UI)
○ HTML / CSS
○ JavaScript
■ React / Angular / Vue
● Back-end
○ Server
○ Database
○ Language: python, php,
nodejs (at least for
puppeteer)
Efficiency
Automation
Reporting
Monitoring, data export,
time-consuming tasks, etc.
Custom dashboards,
augmented data, etc.
Site Health Monitoring
● Out-of-the-box solutions, scheduled crawls, custom extractions, etc.
● Custom solution - tips and ideas
○ Monitor only a few URLs per page template
○ No database needed, only keep 3 days of
data in .txt of .json files
○ Free API for Domain-level info:
whoisxmlapi.com (screenshot, DNS,
categorization, SSL cert, etc.)
○ Gmail API + Puppeteer:
parse GSC notifications and login GSC to get
“# of URLs impacted”
URL Inspector on Steroid
“I want to know everything about that URL…”
● Fetch and render (custom extractions for
rendering issues)
○ cURL + puppeteer
● On-page elements (meta data, headings, etc.)
● hreflang tags validation
● Schema markup extraction
○ Free Yandex API
● GSC’s URL inspection API
● PageSpeed Insights API (Lighthouse reports)
● Content: entities, classification, sentiment
○ Google Natural Language API
● Traffic: GSC + GA APIs
● CMS API for internal data
● Geotargeting: anonymous-proxies.net
https://technicalseo.com/tools/fetch-render/
Google-InspectionTool
https://technicalseo.com/tools/robots-txt/
Keyword Tool
Combine:
● Search Console data (ranking
URLs, clicks / impressions)
With (paid APIs from semrush,
keywords everywhere, etc.):
● Search volumes
● Related keywords
● Top ranking URLs
Similar to Bing Webmaster Tools
Clients’ Tech Stacks
BuiltWith API: https://api.builtwith.com
Automating
Tasks
Example: SERP screenshots
Reporting
Custom dashboards,
augmented data, etc.
Search Console
Analytics API
Combining properties
Pro tip: use “service accounts” to
avoid disconnection and
authentication with your app
GCP’s Service Accounts
Google Algorithm Updates
https://technicalseo.com/tools/google-algorithm-updates/
Google Search Status Dashboard
https://status.search.google.com/incidents.json
maxpr.in/algo-updates-json
More Insights (Just) with Search Console Data
Combine “dimensions” with the API and/or data from multiple requests to analyze:
● Top Keywords of Top URLs
○ e.g. top 5 keywords for each of the top 100 URLs
○ What % of traffic each keyword represent? e.g. top keyword = 65% of
clicks to page
● Cannibalization
○ How many and which pages rank for each keywords?
○ Within same site or across markets (e.g. UK site outranking US site in US)
Core Web Vitals
● Leverage the historical data
endpoint in
CrUX API
● Overlay competitors
(programmatically pull from
semrush)
● Warning: Search Console report
vs. CrUX origin data
Search Console
Sitemaps API
+ robots.txt info
+ HTTP status code checker
Jira API
Custom table listing all “SEO”
issues (based on name, description,
label, comments, etc.)
Own Data + Natural Language Processing (NLP)
Augmented data for deeper performance analysis
Clicks, impressions, CTR, position from GSC
+ Author
+ Content type (page template)
+ Site section
+ Published/modified date
+ Word count
+ Core Web Vitals
+ Content category (classification,
entities, tags)
+ Sentiment analysis (title and/or
body)
Clicks Impressions CTR # of Pages
Beauty &
Fitness
1,234,567 34,567,891 3.57% 25
Shopping 456,789 22,333,444 2.05% 65
News 123,456 11,789,101 1.05% 58
Own Data + Natural Language Processing (NLP)
Augmented data for deeper performance analysis
+
Clicks Impressions CTR # of Pages
Positive 1,234,567 34,567,891 3.57% 25
Neutral 456,789 22,333,444 2.05% 65
Negative 123,456 11,789,101 1.05% 58
Generative AI
Content briefs, ideation, etc.
Explaining data
Generative AI
OpenAI’s GPT API - Function calling
- Integrate any data into your
chat/assistant
- Eliminate “hallucinations”
- New: cheaper pricing for GPT-4
API and improved function
calling feature
Thank you!
Questions?

More Related Content

What's hot

Brighton SEO 2023 - ML Lessons For Total Search.pdf
Brighton SEO 2023 - ML Lessons For Total Search.pdfBrighton SEO 2023 - ML Lessons For Total Search.pdf
Brighton SEO 2023 - ML Lessons For Total Search.pdf
MaxFlajsner1
 
Agile SEO: Prioritise SEO Activities with Cadence and Risk Radius
Agile SEO: Prioritise SEO Activities with Cadence and Risk RadiusAgile SEO: Prioritise SEO Activities with Cadence and Risk Radius
Agile SEO: Prioritise SEO Activities with Cadence and Risk Radius
Parth Suba
 
brightonSEO - Stress Is Contagious Don't Catch It From Your Clients
brightonSEO - Stress Is Contagious Don't Catch It From Your ClientsbrightonSEO - Stress Is Contagious Don't Catch It From Your Clients
brightonSEO - Stress Is Contagious Don't Catch It From Your Clients
Kathryn Monkcom
 
Probabilistic Thinking in SEO - BrightonSEO October 2022
Probabilistic Thinking in SEO - BrightonSEO October 2022Probabilistic Thinking in SEO - BrightonSEO October 2022
Probabilistic Thinking in SEO - BrightonSEO October 2022
Andrew Charlton
 
HELP! I've Been Hit By An Algorithm Update - Jess Maloney - BrightonSEO Apri...
HELP! I've Been Hit By An Algorithm Update - Jess Maloney - BrightonSEO  Apri...HELP! I've Been Hit By An Algorithm Update - Jess Maloney - BrightonSEO  Apri...
HELP! I've Been Hit By An Algorithm Update - Jess Maloney - BrightonSEO Apri...
Jessica Maloney
 
Web Server SEO: Make your TTFB faster!
Web Server SEO: Make your TTFB faster!Web Server SEO: Make your TTFB faster!
Web Server SEO: Make your TTFB faster!
Ash New
 
BrightonSEO 2023 - Introduction to Search Engines Beyond Google - N Witczyk.pdf
BrightonSEO 2023 - Introduction to Search Engines Beyond Google - N Witczyk.pdfBrightonSEO 2023 - Introduction to Search Engines Beyond Google - N Witczyk.pdf
BrightonSEO 2023 - Introduction to Search Engines Beyond Google - N Witczyk.pdf
Natalia Witczyk
 
How to control googlebot
How to control googlebotHow to control googlebot
How to control googlebot
Serge Bezborodov
 
I Am A Donut: How to Avoid International SEO Mistakes
I Am A Donut: How to Avoid International SEO MistakesI Am A Donut: How to Avoid International SEO Mistakes
I Am A Donut: How to Avoid International SEO Mistakes
Tom Brennan
 
Beth Barnham Schema Auditing BrightonSEO Slides.pptx
Beth Barnham Schema Auditing BrightonSEO Slides.pptxBeth Barnham Schema Auditing BrightonSEO Slides.pptx
Beth Barnham Schema Auditing BrightonSEO Slides.pptx
BethBarnham1
 
Data-driven SEO & content strategy to reduce your customer acquisition costs
Data-driven SEO & content strategy to reduce your customer acquisition costsData-driven SEO & content strategy to reduce your customer acquisition costs
Data-driven SEO & content strategy to reduce your customer acquisition costs
adlift
 
How to produce great multilingual content, even when you can't read it | Laur...
How to produce great multilingual content, even when you can't read it | Laur...How to produce great multilingual content, even when you can't read it | Laur...
How to produce great multilingual content, even when you can't read it | Laur...
Oban International
 
Improving Crawling and Indexing using Real-Time Log File Insights
Improving Crawling and Indexing using Real-Time Log File InsightsImproving Crawling and Indexing using Real-Time Log File Insights
Improving Crawling and Indexing using Real-Time Log File Insights
Steven van Vessum
 
How to convince even the pickiest editors to take SEO more seriously :: brigh...
How to convince even the pickiest editors to take SEO more seriously :: brigh...How to convince even the pickiest editors to take SEO more seriously :: brigh...
How to convince even the pickiest editors to take SEO more seriously :: brigh...
Ian Helms
 
BrightonSEO October 2022 - Log File Analysis - Steven van Vessum.pdf
BrightonSEO October 2022 - Log File Analysis - Steven van Vessum.pdfBrightonSEO October 2022 - Log File Analysis - Steven van Vessum.pdf
BrightonSEO October 2022 - Log File Analysis - Steven van Vessum.pdf
Steven van Vessum
 
BrightonSEO April 2023 Similar AI: Automation recipes for SEO success
BrightonSEO April 2023 Similar AI: Automation recipes for SEO successBrightonSEO April 2023 Similar AI: Automation recipes for SEO success
BrightonSEO April 2023 Similar AI: Automation recipes for SEO success
Dylan Fuler
 
Extreme Makeover: Site Architecture Edition
Extreme Makeover: Site Architecture EditionExtreme Makeover: Site Architecture Edition
Extreme Makeover: Site Architecture Edition
Kavi Kardos
 
Internal Linking - The Topic Clustering Way edited.pptx
Internal Linking - The Topic Clustering Way edited.pptxInternal Linking - The Topic Clustering Way edited.pptx
Internal Linking - The Topic Clustering Way edited.pptx
Dixon Jones
 
BrightonSEO - Master Crawl Budget Optimization for Enterprise Websites
BrightonSEO - Master Crawl Budget Optimization for Enterprise WebsitesBrightonSEO - Master Crawl Budget Optimization for Enterprise Websites
BrightonSEO - Master Crawl Budget Optimization for Enterprise Websites
Manick Bhan
 
How to come up with content ideas without relying on search volume.pptx
How to come up with content ideas without relying on search volume.pptxHow to come up with content ideas without relying on search volume.pptx
How to come up with content ideas without relying on search volume.pptx
StephNaylor2
 

What's hot (20)

Brighton SEO 2023 - ML Lessons For Total Search.pdf
Brighton SEO 2023 - ML Lessons For Total Search.pdfBrighton SEO 2023 - ML Lessons For Total Search.pdf
Brighton SEO 2023 - ML Lessons For Total Search.pdf
 
Agile SEO: Prioritise SEO Activities with Cadence and Risk Radius
Agile SEO: Prioritise SEO Activities with Cadence and Risk RadiusAgile SEO: Prioritise SEO Activities with Cadence and Risk Radius
Agile SEO: Prioritise SEO Activities with Cadence and Risk Radius
 
brightonSEO - Stress Is Contagious Don't Catch It From Your Clients
brightonSEO - Stress Is Contagious Don't Catch It From Your ClientsbrightonSEO - Stress Is Contagious Don't Catch It From Your Clients
brightonSEO - Stress Is Contagious Don't Catch It From Your Clients
 
Probabilistic Thinking in SEO - BrightonSEO October 2022
Probabilistic Thinking in SEO - BrightonSEO October 2022Probabilistic Thinking in SEO - BrightonSEO October 2022
Probabilistic Thinking in SEO - BrightonSEO October 2022
 
HELP! I've Been Hit By An Algorithm Update - Jess Maloney - BrightonSEO Apri...
HELP! I've Been Hit By An Algorithm Update - Jess Maloney - BrightonSEO  Apri...HELP! I've Been Hit By An Algorithm Update - Jess Maloney - BrightonSEO  Apri...
HELP! I've Been Hit By An Algorithm Update - Jess Maloney - BrightonSEO Apri...
 
Web Server SEO: Make your TTFB faster!
Web Server SEO: Make your TTFB faster!Web Server SEO: Make your TTFB faster!
Web Server SEO: Make your TTFB faster!
 
BrightonSEO 2023 - Introduction to Search Engines Beyond Google - N Witczyk.pdf
BrightonSEO 2023 - Introduction to Search Engines Beyond Google - N Witczyk.pdfBrightonSEO 2023 - Introduction to Search Engines Beyond Google - N Witczyk.pdf
BrightonSEO 2023 - Introduction to Search Engines Beyond Google - N Witczyk.pdf
 
How to control googlebot
How to control googlebotHow to control googlebot
How to control googlebot
 
I Am A Donut: How to Avoid International SEO Mistakes
I Am A Donut: How to Avoid International SEO MistakesI Am A Donut: How to Avoid International SEO Mistakes
I Am A Donut: How to Avoid International SEO Mistakes
 
Beth Barnham Schema Auditing BrightonSEO Slides.pptx
Beth Barnham Schema Auditing BrightonSEO Slides.pptxBeth Barnham Schema Auditing BrightonSEO Slides.pptx
Beth Barnham Schema Auditing BrightonSEO Slides.pptx
 
Data-driven SEO & content strategy to reduce your customer acquisition costs
Data-driven SEO & content strategy to reduce your customer acquisition costsData-driven SEO & content strategy to reduce your customer acquisition costs
Data-driven SEO & content strategy to reduce your customer acquisition costs
 
How to produce great multilingual content, even when you can't read it | Laur...
How to produce great multilingual content, even when you can't read it | Laur...How to produce great multilingual content, even when you can't read it | Laur...
How to produce great multilingual content, even when you can't read it | Laur...
 
Improving Crawling and Indexing using Real-Time Log File Insights
Improving Crawling and Indexing using Real-Time Log File InsightsImproving Crawling and Indexing using Real-Time Log File Insights
Improving Crawling and Indexing using Real-Time Log File Insights
 
How to convince even the pickiest editors to take SEO more seriously :: brigh...
How to convince even the pickiest editors to take SEO more seriously :: brigh...How to convince even the pickiest editors to take SEO more seriously :: brigh...
How to convince even the pickiest editors to take SEO more seriously :: brigh...
 
BrightonSEO October 2022 - Log File Analysis - Steven van Vessum.pdf
BrightonSEO October 2022 - Log File Analysis - Steven van Vessum.pdfBrightonSEO October 2022 - Log File Analysis - Steven van Vessum.pdf
BrightonSEO October 2022 - Log File Analysis - Steven van Vessum.pdf
 
BrightonSEO April 2023 Similar AI: Automation recipes for SEO success
BrightonSEO April 2023 Similar AI: Automation recipes for SEO successBrightonSEO April 2023 Similar AI: Automation recipes for SEO success
BrightonSEO April 2023 Similar AI: Automation recipes for SEO success
 
Extreme Makeover: Site Architecture Edition
Extreme Makeover: Site Architecture EditionExtreme Makeover: Site Architecture Edition
Extreme Makeover: Site Architecture Edition
 
Internal Linking - The Topic Clustering Way edited.pptx
Internal Linking - The Topic Clustering Way edited.pptxInternal Linking - The Topic Clustering Way edited.pptx
Internal Linking - The Topic Clustering Way edited.pptx
 
BrightonSEO - Master Crawl Budget Optimization for Enterprise Websites
BrightonSEO - Master Crawl Budget Optimization for Enterprise WebsitesBrightonSEO - Master Crawl Budget Optimization for Enterprise Websites
BrightonSEO - Master Crawl Budget Optimization for Enterprise Websites
 
How to come up with content ideas without relying on search volume.pptx
How to come up with content ideas without relying on search volume.pptxHow to come up with content ideas without relying on search volume.pptx
How to come up with content ideas without relying on search volume.pptx
 

Similar to Max Prin - brightonSEO San Diego 2023 - Developing SEO Tools

ApacheCon NA 2018 : Apache Unomi, an Open Source Customer Data Platformapache...
ApacheCon NA 2018 : Apache Unomi, an Open Source Customer Data Platformapache...ApacheCon NA 2018 : Apache Unomi, an Open Source Customer Data Platformapache...
ApacheCon NA 2018 : Apache Unomi, an Open Source Customer Data Platformapache...
Serge Huber
 
Apache Unomi presentation and update. By Serge Huber, CTO Jahia
Apache Unomi presentation and update. By Serge Huber, CTO JahiaApache Unomi presentation and update. By Serge Huber, CTO Jahia
Apache Unomi presentation and update. By Serge Huber, CTO Jahia
Jahia Solutions Group
 
Google Analytics 101 Webinar
Google Analytics 101 WebinarGoogle Analytics 101 Webinar
Google Analytics 101 Webinar
webucatordemo
 
Enhancing WordPress With AI Plugins Boost Efficiency & Speed .pptx
Enhancing WordPress With AI Plugins  Boost Efficiency & Speed .pptxEnhancing WordPress With AI Plugins  Boost Efficiency & Speed .pptx
Enhancing WordPress With AI Plugins Boost Efficiency & Speed .pptx
MegataskWeb
 
Build Your Own Search Engine
Build Your Own Search EngineBuild Your Own Search Engine
Build Your Own Search Engine
goodfriday
 
Entrepreneurship Tips With HTML5 & App Engine Startup Weekend (June 2012)
Entrepreneurship Tips With HTML5 & App Engine Startup Weekend (June 2012)Entrepreneurship Tips With HTML5 & App Engine Startup Weekend (June 2012)
Entrepreneurship Tips With HTML5 & App Engine Startup Weekend (June 2012)
Ido Green
 
Exploring Google APIs with Python
Exploring Google APIs with PythonExploring Google APIs with Python
Exploring Google APIs with Python
wesley chun
 
Database automation guide - Oracle Community Tour LATAM 2023
Database automation guide - Oracle Community Tour LATAM 2023Database automation guide - Oracle Community Tour LATAM 2023
Database automation guide - Oracle Community Tour LATAM 2023
Nelson Calero
 
Google Cloud Platform Update
Google Cloud Platform UpdateGoogle Cloud Platform Update
Google Cloud Platform Update
Ido Green
 
Log analysis and pro use cases for search marketers online version (1)
Log analysis and pro use cases for search marketers online version (1)Log analysis and pro use cases for search marketers online version (1)
Log analysis and pro use cases for search marketers online version (1)
David Sottimano
 
Capturing speed of user experience using user timing api
Capturing speed of user experience using user timing apiCapturing speed of user experience using user timing api
Capturing speed of user experience using user timing api
SergeyChernyshev
 
Building Integrated Applications on Google's Cloud Technologies
Building Integrated Applications on Google's Cloud TechnologiesBuilding Integrated Applications on Google's Cloud Technologies
Building Integrated Applications on Google's Cloud Technologies
Chris Schalk
 
Pawel Sokolowski at UX Antwerp Meetup - 26 September 2017
Pawel Sokolowski at UX Antwerp Meetup - 26 September 2017Pawel Sokolowski at UX Antwerp Meetup - 26 September 2017
Pawel Sokolowski at UX Antwerp Meetup - 26 September 2017
UX Antwerp Meetup
 
Optimizing a React application for Core Web Vitals
Optimizing a React application for Core Web VitalsOptimizing a React application for Core Web Vitals
Optimizing a React application for Core Web Vitals
Juan Picado
 
Generative AI: The New Wild West of SEO - Ryan Huser, Ayima
Generative AI: The New Wild West of SEO - Ryan Huser, AyimaGenerative AI: The New Wild West of SEO - Ryan Huser, Ayima
Generative AI: The New Wild West of SEO - Ryan Huser, Ayima
DigiMarCon - Digital Marketing, Media and Advertising Conferences & Exhibitions
 
Jeremy cabral search marketing summit - scraping data-driven content (1)
Jeremy cabral   search marketing summit - scraping data-driven content (1)Jeremy cabral   search marketing summit - scraping data-driven content (1)
Jeremy cabral search marketing summit - scraping data-driven content (1)
Jeremy Cabral
 
Automation in seo. Tools and tricks
Automation in seo. Tools and tricksAutomation in seo. Tools and tricks
Automation in seo. Tools and tricks
NetpeakBG
 
Automation in seo. Tools and tricks
Automation in seo. Tools and tricksAutomation in seo. Tools and tricks
Automation in seo. Tools and tricks
Netpeak
 
Google Technical Webinar - Building Mashups with Google Apps and SAP, using S...
Google Technical Webinar - Building Mashups with Google Apps and SAP, using S...Google Technical Webinar - Building Mashups with Google Apps and SAP, using S...
Google Technical Webinar - Building Mashups with Google Apps and SAP, using S...
SAP PartnerEdge program for Application Development
 
Cherokee nation 2 day AIAD & DIAD - App in a day and Dashboard in day
Cherokee nation 2 day AIAD & DIAD - App in a day and Dashboard in dayCherokee nation 2 day AIAD & DIAD - App in a day and Dashboard in day
Cherokee nation 2 day AIAD & DIAD - App in a day and Dashboard in day
Vishal Pawar
 

Similar to Max Prin - brightonSEO San Diego 2023 - Developing SEO Tools (20)

ApacheCon NA 2018 : Apache Unomi, an Open Source Customer Data Platformapache...
ApacheCon NA 2018 : Apache Unomi, an Open Source Customer Data Platformapache...ApacheCon NA 2018 : Apache Unomi, an Open Source Customer Data Platformapache...
ApacheCon NA 2018 : Apache Unomi, an Open Source Customer Data Platformapache...
 
Apache Unomi presentation and update. By Serge Huber, CTO Jahia
Apache Unomi presentation and update. By Serge Huber, CTO JahiaApache Unomi presentation and update. By Serge Huber, CTO Jahia
Apache Unomi presentation and update. By Serge Huber, CTO Jahia
 
Google Analytics 101 Webinar
Google Analytics 101 WebinarGoogle Analytics 101 Webinar
Google Analytics 101 Webinar
 
Enhancing WordPress With AI Plugins Boost Efficiency & Speed .pptx
Enhancing WordPress With AI Plugins  Boost Efficiency & Speed .pptxEnhancing WordPress With AI Plugins  Boost Efficiency & Speed .pptx
Enhancing WordPress With AI Plugins Boost Efficiency & Speed .pptx
 
Build Your Own Search Engine
Build Your Own Search EngineBuild Your Own Search Engine
Build Your Own Search Engine
 
Entrepreneurship Tips With HTML5 & App Engine Startup Weekend (June 2012)
Entrepreneurship Tips With HTML5 & App Engine Startup Weekend (June 2012)Entrepreneurship Tips With HTML5 & App Engine Startup Weekend (June 2012)
Entrepreneurship Tips With HTML5 & App Engine Startup Weekend (June 2012)
 
Exploring Google APIs with Python
Exploring Google APIs with PythonExploring Google APIs with Python
Exploring Google APIs with Python
 
Database automation guide - Oracle Community Tour LATAM 2023
Database automation guide - Oracle Community Tour LATAM 2023Database automation guide - Oracle Community Tour LATAM 2023
Database automation guide - Oracle Community Tour LATAM 2023
 
Google Cloud Platform Update
Google Cloud Platform UpdateGoogle Cloud Platform Update
Google Cloud Platform Update
 
Log analysis and pro use cases for search marketers online version (1)
Log analysis and pro use cases for search marketers online version (1)Log analysis and pro use cases for search marketers online version (1)
Log analysis and pro use cases for search marketers online version (1)
 
Capturing speed of user experience using user timing api
Capturing speed of user experience using user timing apiCapturing speed of user experience using user timing api
Capturing speed of user experience using user timing api
 
Building Integrated Applications on Google's Cloud Technologies
Building Integrated Applications on Google's Cloud TechnologiesBuilding Integrated Applications on Google's Cloud Technologies
Building Integrated Applications on Google's Cloud Technologies
 
Pawel Sokolowski at UX Antwerp Meetup - 26 September 2017
Pawel Sokolowski at UX Antwerp Meetup - 26 September 2017Pawel Sokolowski at UX Antwerp Meetup - 26 September 2017
Pawel Sokolowski at UX Antwerp Meetup - 26 September 2017
 
Optimizing a React application for Core Web Vitals
Optimizing a React application for Core Web VitalsOptimizing a React application for Core Web Vitals
Optimizing a React application for Core Web Vitals
 
Generative AI: The New Wild West of SEO - Ryan Huser, Ayima
Generative AI: The New Wild West of SEO - Ryan Huser, AyimaGenerative AI: The New Wild West of SEO - Ryan Huser, Ayima
Generative AI: The New Wild West of SEO - Ryan Huser, Ayima
 
Jeremy cabral search marketing summit - scraping data-driven content (1)
Jeremy cabral   search marketing summit - scraping data-driven content (1)Jeremy cabral   search marketing summit - scraping data-driven content (1)
Jeremy cabral search marketing summit - scraping data-driven content (1)
 
Automation in seo. Tools and tricks
Automation in seo. Tools and tricksAutomation in seo. Tools and tricks
Automation in seo. Tools and tricks
 
Automation in seo. Tools and tricks
Automation in seo. Tools and tricksAutomation in seo. Tools and tricks
Automation in seo. Tools and tricks
 
Google Technical Webinar - Building Mashups with Google Apps and SAP, using S...
Google Technical Webinar - Building Mashups with Google Apps and SAP, using S...Google Technical Webinar - Building Mashups with Google Apps and SAP, using S...
Google Technical Webinar - Building Mashups with Google Apps and SAP, using S...
 
Cherokee nation 2 day AIAD & DIAD - App in a day and Dashboard in day
Cherokee nation 2 day AIAD & DIAD - App in a day and Dashboard in dayCherokee nation 2 day AIAD & DIAD - App in a day and Dashboard in day
Cherokee nation 2 day AIAD & DIAD - App in a day and Dashboard in day
 

More from Max Prin

Search Y 2020 - PWA + AMP
Search Y 2020 - PWA + AMPSearch Y 2020 - PWA + AMP
Search Y 2020 - PWA + AMP
Max Prin
 
PWA & AMP (PWAMP) - Making the Bot Experience as Good as the User Experience
PWA & AMP (PWAMP) - Making the Bot Experience as Good as the User ExperiencePWA & AMP (PWAMP) - Making the Bot Experience as Good as the User Experience
PWA & AMP (PWAMP) - Making the Bot Experience as Good as the User Experience
Max Prin
 
What's New with Schema and Structured Data - Max Prin - SMX Advanced 2019
What's New with Schema and Structured Data - Max Prin - SMX Advanced 2019What's New with Schema and Structured Data - Max Prin - SMX Advanced 2019
What's New with Schema and Structured Data - Max Prin - SMX Advanced 2019
Max Prin
 
PWA + AMP: The Future of E-Commerce? Max Prin - BrightonSEO - Sept. 2018
PWA + AMP: The Future of E-Commerce? Max Prin - BrightonSEO - Sept. 2018PWA + AMP: The Future of E-Commerce? Max Prin - BrightonSEO - Sept. 2018
PWA + AMP: The Future of E-Commerce? Max Prin - BrightonSEO - Sept. 2018
Max Prin
 
Max Prin - MnSearch Summit 2018 - SEO for the Current Mobile Landscape
Max Prin - MnSearch Summit 2018 - SEO for the Current Mobile LandscapeMax Prin - MnSearch Summit 2018 - SEO for the Current Mobile Landscape
Max Prin - MnSearch Summit 2018 - SEO for the Current Mobile Landscape
Max Prin
 
Max Prin - Engage 2018 - AMP for E-Commerce
Max Prin - Engage 2018 - AMP for E-CommerceMax Prin - Engage 2018 - AMP for E-Commerce
Max Prin - Engage 2018 - AMP for E-Commerce
Max Prin
 
Max Prin - TechSEO Boost 2017 - SEO Best Practices For JavaScript-Based Websites
Max Prin - TechSEO Boost 2017 - SEO Best Practices For JavaScript-Based WebsitesMax Prin - TechSEO Boost 2017 - SEO Best Practices For JavaScript-Based Websites
Max Prin - TechSEO Boost 2017 - SEO Best Practices For JavaScript-Based Websites
Max Prin
 
Max Prin - MnSearch Summit 2017 - What does technical SEO look like in 2017?
Max Prin - MnSearch Summit 2017 - What does technical SEO look like in 2017?Max Prin - MnSearch Summit 2017 - What does technical SEO look like in 2017?
Max Prin - MnSearch Summit 2017 - What does technical SEO look like in 2017?
Max Prin
 
Max Prin - SMX Paris 2017 - Voice Search: Comment Ranker?
Max Prin - SMX Paris 2017 - Voice Search: Comment Ranker?Max Prin - SMX Paris 2017 - Voice Search: Comment Ranker?
Max Prin - SMX Paris 2017 - Voice Search: Comment Ranker?
Max Prin
 
Max Prin - SMX 2016 - Structured Data Markup and Quick Answers: Chasing Ranki...
Max Prin - SMX 2016 - Structured Data Markup and Quick Answers: Chasing Ranki...Max Prin - SMX 2016 - Structured Data Markup and Quick Answers: Chasing Ranki...
Max Prin - SMX 2016 - Structured Data Markup and Quick Answers: Chasing Ranki...
Max Prin
 
Max Prin - SMX Paris 2016 - Données Structurées et Quick Answers : à la conqu...
Max Prin - SMX Paris 2016 - Données Structurées et Quick Answers : à la conqu...Max Prin - SMX Paris 2016 - Données Structurées et Quick Answers : à la conqu...
Max Prin - SMX Paris 2016 - Données Structurées et Quick Answers : à la conqu...
Max Prin
 
Max Prin - SMX West 2017 - What to do when Google can't understand your JavaS...
Max Prin - SMX West 2017 - What to do when Google can't understand your JavaS...Max Prin - SMX West 2017 - What to do when Google can't understand your JavaS...
Max Prin - SMX West 2017 - What to do when Google can't understand your JavaS...
Max Prin
 

More from Max Prin (12)

Search Y 2020 - PWA + AMP
Search Y 2020 - PWA + AMPSearch Y 2020 - PWA + AMP
Search Y 2020 - PWA + AMP
 
PWA & AMP (PWAMP) - Making the Bot Experience as Good as the User Experience
PWA & AMP (PWAMP) - Making the Bot Experience as Good as the User ExperiencePWA & AMP (PWAMP) - Making the Bot Experience as Good as the User Experience
PWA & AMP (PWAMP) - Making the Bot Experience as Good as the User Experience
 
What's New with Schema and Structured Data - Max Prin - SMX Advanced 2019
What's New with Schema and Structured Data - Max Prin - SMX Advanced 2019What's New with Schema and Structured Data - Max Prin - SMX Advanced 2019
What's New with Schema and Structured Data - Max Prin - SMX Advanced 2019
 
PWA + AMP: The Future of E-Commerce? Max Prin - BrightonSEO - Sept. 2018
PWA + AMP: The Future of E-Commerce? Max Prin - BrightonSEO - Sept. 2018PWA + AMP: The Future of E-Commerce? Max Prin - BrightonSEO - Sept. 2018
PWA + AMP: The Future of E-Commerce? Max Prin - BrightonSEO - Sept. 2018
 
Max Prin - MnSearch Summit 2018 - SEO for the Current Mobile Landscape
Max Prin - MnSearch Summit 2018 - SEO for the Current Mobile LandscapeMax Prin - MnSearch Summit 2018 - SEO for the Current Mobile Landscape
Max Prin - MnSearch Summit 2018 - SEO for the Current Mobile Landscape
 
Max Prin - Engage 2018 - AMP for E-Commerce
Max Prin - Engage 2018 - AMP for E-CommerceMax Prin - Engage 2018 - AMP for E-Commerce
Max Prin - Engage 2018 - AMP for E-Commerce
 
Max Prin - TechSEO Boost 2017 - SEO Best Practices For JavaScript-Based Websites
Max Prin - TechSEO Boost 2017 - SEO Best Practices For JavaScript-Based WebsitesMax Prin - TechSEO Boost 2017 - SEO Best Practices For JavaScript-Based Websites
Max Prin - TechSEO Boost 2017 - SEO Best Practices For JavaScript-Based Websites
 
Max Prin - MnSearch Summit 2017 - What does technical SEO look like in 2017?
Max Prin - MnSearch Summit 2017 - What does technical SEO look like in 2017?Max Prin - MnSearch Summit 2017 - What does technical SEO look like in 2017?
Max Prin - MnSearch Summit 2017 - What does technical SEO look like in 2017?
 
Max Prin - SMX Paris 2017 - Voice Search: Comment Ranker?
Max Prin - SMX Paris 2017 - Voice Search: Comment Ranker?Max Prin - SMX Paris 2017 - Voice Search: Comment Ranker?
Max Prin - SMX Paris 2017 - Voice Search: Comment Ranker?
 
Max Prin - SMX 2016 - Structured Data Markup and Quick Answers: Chasing Ranki...
Max Prin - SMX 2016 - Structured Data Markup and Quick Answers: Chasing Ranki...Max Prin - SMX 2016 - Structured Data Markup and Quick Answers: Chasing Ranki...
Max Prin - SMX 2016 - Structured Data Markup and Quick Answers: Chasing Ranki...
 
Max Prin - SMX Paris 2016 - Données Structurées et Quick Answers : à la conqu...
Max Prin - SMX Paris 2016 - Données Structurées et Quick Answers : à la conqu...Max Prin - SMX Paris 2016 - Données Structurées et Quick Answers : à la conqu...
Max Prin - SMX Paris 2016 - Données Structurées et Quick Answers : à la conqu...
 
Max Prin - SMX West 2017 - What to do when Google can't understand your JavaS...
Max Prin - SMX West 2017 - What to do when Google can't understand your JavaS...Max Prin - SMX West 2017 - What to do when Google can't understand your JavaS...
Max Prin - SMX West 2017 - What to do when Google can't understand your JavaS...
 

Recently uploaded

AI Best Practices for Marketing HUG June 2024
AI Best Practices for Marketing HUG June 2024AI Best Practices for Marketing HUG June 2024
AI Best Practices for Marketing HUG June 2024
Amanda Farrell
 
E-Learning Vs Traditional Learning_ Benefits and Differences.pdf
E-Learning Vs Traditional Learning_ Benefits and Differences.pdfE-Learning Vs Traditional Learning_ Benefits and Differences.pdf
E-Learning Vs Traditional Learning_ Benefits and Differences.pdf
Mega P
 
Snapshot of Consumer Behaviors of May 2024-EOLiSurvey (EN).pdf
Snapshot of Consumer Behaviors of May 2024-EOLiSurvey (EN).pdfSnapshot of Consumer Behaviors of May 2024-EOLiSurvey (EN).pdf
Snapshot of Consumer Behaviors of May 2024-EOLiSurvey (EN).pdf
Eastern Online-iSURVEY
 
Practical Progress from a Theory by Steven Kingpdf
Practical Progress from a Theory by Steven KingpdfPractical Progress from a Theory by Steven Kingpdf
Practical Progress from a Theory by Steven Kingpdf
william charnock
 
DCC Technology Intro Slides June 2024.pptx
DCC Technology Intro Slides June 2024.pptxDCC Technology Intro Slides June 2024.pptx
DCC Technology Intro Slides June 2024.pptx
vishc81
 
一比一原版哥伦比亚大学毕业证(Columbia毕业证书)学历如何办理
一比一原版哥伦比亚大学毕业证(Columbia毕业证书)学历如何办理一比一原版哥伦比亚大学毕业证(Columbia毕业证书)学历如何办理
一比一原版哥伦比亚大学毕业证(Columbia毕业证书)学历如何办理
omywaf
 
2024 case study-SHEIN Analysis-Final.pdf
2024 case study-SHEIN Analysis-Final.pdf2024 case study-SHEIN Analysis-Final.pdf
2024 case study-SHEIN Analysis-Final.pdf
Sun.Lee
 
Learn more about affiliate marketing as a beginner
Learn more about affiliate marketing as a beginnerLearn more about affiliate marketing as a beginner
Learn more about affiliate marketing as a beginner
MichaelGiles34
 
SEO and Google Ads Fundamentals Gokce Yesilbas
SEO and Google Ads Fundamentals Gokce YesilbasSEO and Google Ads Fundamentals Gokce Yesilbas
SEO and Google Ads Fundamentals Gokce Yesilbas
gokceyesilbas
 
Social Samosa's #30Under30 Guidebook.pdf
Social Samosa's #30Under30 Guidebook.pdfSocial Samosa's #30Under30 Guidebook.pdf
Social Samosa's #30Under30 Guidebook.pdf
Social Samosa
 
Meta Revolutionizes Product Promotion with Automated Video Catalog Ads.pptx
Meta Revolutionizes Product Promotion with Automated Video Catalog Ads.pptxMeta Revolutionizes Product Promotion with Automated Video Catalog Ads.pptx
Meta Revolutionizes Product Promotion with Automated Video Catalog Ads.pptx
providenceadworks416
 
Bad Bunny Merch.pptxKJDSVKBDSVKBDSVKDDSKDKJDBK
Bad Bunny Merch.pptxKJDSVKBDSVKBDSVKDDSKDKJDBKBad Bunny Merch.pptxKJDSVKBDSVKBDSVKDDSKDKJDBK
Bad Bunny Merch.pptxKJDSVKBDSVKBDSVKDDSKDKJDBK
rawlensproductionsco
 
Digital Marketing Services in India 2024
Digital Marketing Services in India 2024Digital Marketing Services in India 2024
Digital Marketing Services in India 2024
PRITESHSAKPAL1
 
Top 10 Digital Marketing Institute in lucknow.pptx
Top 10 Digital Marketing Institute in lucknow.pptxTop 10 Digital Marketing Institute in lucknow.pptx
Top 10 Digital Marketing Institute in lucknow.pptx
zaireendigitech
 
Customer relationship management notes for Bcom students
Customer relationship management notes for Bcom studentsCustomer relationship management notes for Bcom students
Customer relationship management notes for Bcom students
PratibhaShelake1
 
2024 Trend Updates: What Really Works In SEO & Content Marketing
2024 Trend Updates: What Really Works In SEO & Content Marketing2024 Trend Updates: What Really Works In SEO & Content Marketing
2024 Trend Updates: What Really Works In SEO & Content Marketing
Search Engine Journal
 
Importance of Customer Service in Fashion Industry
Importance of Customer Service in Fashion IndustryImportance of Customer Service in Fashion Industry
Importance of Customer Service in Fashion Industry
Shantilal Hajeri
 
INTRODUCTION TO SEARCH ENGINE OPTIMIZATION (SEO).pptx
INTRODUCTION TO SEARCH ENGINE OPTIMIZATION (SEO).pptxINTRODUCTION TO SEARCH ENGINE OPTIMIZATION (SEO).pptx
INTRODUCTION TO SEARCH ENGINE OPTIMIZATION (SEO).pptx
Giorgio Chiesa
 
Digital Marketing Company in India - DIGI Brooks
Digital Marketing Company in India -  DIGI BrooksDigital Marketing Company in India -  DIGI Brooks
Digital Marketing Company in India - DIGI Brooks
DIGI Brooks
 
Evaluating the Effectiveness of Women-Focused Marketing
Evaluating the Effectiveness of Women-Focused MarketingEvaluating the Effectiveness of Women-Focused Marketing
Evaluating the Effectiveness of Women-Focused Marketing
HighViz PR
 

Recently uploaded (20)

AI Best Practices for Marketing HUG June 2024
AI Best Practices for Marketing HUG June 2024AI Best Practices for Marketing HUG June 2024
AI Best Practices for Marketing HUG June 2024
 
E-Learning Vs Traditional Learning_ Benefits and Differences.pdf
E-Learning Vs Traditional Learning_ Benefits and Differences.pdfE-Learning Vs Traditional Learning_ Benefits and Differences.pdf
E-Learning Vs Traditional Learning_ Benefits and Differences.pdf
 
Snapshot of Consumer Behaviors of May 2024-EOLiSurvey (EN).pdf
Snapshot of Consumer Behaviors of May 2024-EOLiSurvey (EN).pdfSnapshot of Consumer Behaviors of May 2024-EOLiSurvey (EN).pdf
Snapshot of Consumer Behaviors of May 2024-EOLiSurvey (EN).pdf
 
Practical Progress from a Theory by Steven Kingpdf
Practical Progress from a Theory by Steven KingpdfPractical Progress from a Theory by Steven Kingpdf
Practical Progress from a Theory by Steven Kingpdf
 
DCC Technology Intro Slides June 2024.pptx
DCC Technology Intro Slides June 2024.pptxDCC Technology Intro Slides June 2024.pptx
DCC Technology Intro Slides June 2024.pptx
 
一比一原版哥伦比亚大学毕业证(Columbia毕业证书)学历如何办理
一比一原版哥伦比亚大学毕业证(Columbia毕业证书)学历如何办理一比一原版哥伦比亚大学毕业证(Columbia毕业证书)学历如何办理
一比一原版哥伦比亚大学毕业证(Columbia毕业证书)学历如何办理
 
2024 case study-SHEIN Analysis-Final.pdf
2024 case study-SHEIN Analysis-Final.pdf2024 case study-SHEIN Analysis-Final.pdf
2024 case study-SHEIN Analysis-Final.pdf
 
Learn more about affiliate marketing as a beginner
Learn more about affiliate marketing as a beginnerLearn more about affiliate marketing as a beginner
Learn more about affiliate marketing as a beginner
 
SEO and Google Ads Fundamentals Gokce Yesilbas
SEO and Google Ads Fundamentals Gokce YesilbasSEO and Google Ads Fundamentals Gokce Yesilbas
SEO and Google Ads Fundamentals Gokce Yesilbas
 
Social Samosa's #30Under30 Guidebook.pdf
Social Samosa's #30Under30 Guidebook.pdfSocial Samosa's #30Under30 Guidebook.pdf
Social Samosa's #30Under30 Guidebook.pdf
 
Meta Revolutionizes Product Promotion with Automated Video Catalog Ads.pptx
Meta Revolutionizes Product Promotion with Automated Video Catalog Ads.pptxMeta Revolutionizes Product Promotion with Automated Video Catalog Ads.pptx
Meta Revolutionizes Product Promotion with Automated Video Catalog Ads.pptx
 
Bad Bunny Merch.pptxKJDSVKBDSVKBDSVKDDSKDKJDBK
Bad Bunny Merch.pptxKJDSVKBDSVKBDSVKDDSKDKJDBKBad Bunny Merch.pptxKJDSVKBDSVKBDSVKDDSKDKJDBK
Bad Bunny Merch.pptxKJDSVKBDSVKBDSVKDDSKDKJDBK
 
Digital Marketing Services in India 2024
Digital Marketing Services in India 2024Digital Marketing Services in India 2024
Digital Marketing Services in India 2024
 
Top 10 Digital Marketing Institute in lucknow.pptx
Top 10 Digital Marketing Institute in lucknow.pptxTop 10 Digital Marketing Institute in lucknow.pptx
Top 10 Digital Marketing Institute in lucknow.pptx
 
Customer relationship management notes for Bcom students
Customer relationship management notes for Bcom studentsCustomer relationship management notes for Bcom students
Customer relationship management notes for Bcom students
 
2024 Trend Updates: What Really Works In SEO & Content Marketing
2024 Trend Updates: What Really Works In SEO & Content Marketing2024 Trend Updates: What Really Works In SEO & Content Marketing
2024 Trend Updates: What Really Works In SEO & Content Marketing
 
Importance of Customer Service in Fashion Industry
Importance of Customer Service in Fashion IndustryImportance of Customer Service in Fashion Industry
Importance of Customer Service in Fashion Industry
 
INTRODUCTION TO SEARCH ENGINE OPTIMIZATION (SEO).pptx
INTRODUCTION TO SEARCH ENGINE OPTIMIZATION (SEO).pptxINTRODUCTION TO SEARCH ENGINE OPTIMIZATION (SEO).pptx
INTRODUCTION TO SEARCH ENGINE OPTIMIZATION (SEO).pptx
 
Digital Marketing Company in India - DIGI Brooks
Digital Marketing Company in India -  DIGI BrooksDigital Marketing Company in India -  DIGI Brooks
Digital Marketing Company in India - DIGI Brooks
 
Evaluating the Effectiveness of Women-Focused Marketing
Evaluating the Effectiveness of Women-Focused MarketingEvaluating the Effectiveness of Women-Focused Marketing
Evaluating the Effectiveness of Women-Focused Marketing
 

Max Prin - brightonSEO San Diego 2023 - Developing SEO Tools

  • 1. Developing SEO Tools: Custom solutions with free and paid APIs Max Prin CONDÉ NAST | TECHNICALSEO.COM slideshare.net/MaxPrin @maxxeight
  • 2. (Traditional) SEO Pillars Relevance Content Strategy Authority & Trust Link Building Site Infrastructure Technical SEO
  • 3. Improving the site infrastructure in order to optimize crawling and indexing to eventually increase ranking. True, but incomplete. Technical SEO?
  • 4. Technical SEO? “Any sufficiently technical action undertaken with the intent to improve search results.” – Russ Jones
  • 5. Technical SEO Site Health Fixes + Improvements 01 Tooling Automation + Reporting 02
  • 8. Getting Started ● Google Cloud Platform Free Tier ○ Virtual machine ○ Storage ○ APIs https://cloud.google.com/free
  • 9. Getting Started ● Front-end (UI) ○ HTML / CSS ○ JavaScript ■ React / Angular / Vue ● Back-end ○ Server ○ Database ○ Language: python, php, nodejs (at least for puppeteer)
  • 11. Automation Reporting Monitoring, data export, time-consuming tasks, etc. Custom dashboards, augmented data, etc.
  • 12. Site Health Monitoring ● Out-of-the-box solutions, scheduled crawls, custom extractions, etc. ● Custom solution - tips and ideas ○ Monitor only a few URLs per page template ○ No database needed, only keep 3 days of data in .txt of .json files ○ Free API for Domain-level info: whoisxmlapi.com (screenshot, DNS, categorization, SSL cert, etc.) ○ Gmail API + Puppeteer: parse GSC notifications and login GSC to get “# of URLs impacted”
  • 13. URL Inspector on Steroid “I want to know everything about that URL…” ● Fetch and render (custom extractions for rendering issues) ○ cURL + puppeteer ● On-page elements (meta data, headings, etc.) ● hreflang tags validation ● Schema markup extraction ○ Free Yandex API ● GSC’s URL inspection API ● PageSpeed Insights API (Lighthouse reports) ● Content: entities, classification, sentiment ○ Google Natural Language API ● Traffic: GSC + GA APIs ● CMS API for internal data ● Geotargeting: anonymous-proxies.net https://technicalseo.com/tools/fetch-render/
  • 15. Keyword Tool Combine: ● Search Console data (ranking URLs, clicks / impressions) With (paid APIs from semrush, keywords everywhere, etc.): ● Search volumes ● Related keywords ● Top ranking URLs Similar to Bing Webmaster Tools
  • 16. Clients’ Tech Stacks BuiltWith API: https://api.builtwith.com
  • 19. Search Console Analytics API Combining properties Pro tip: use “service accounts” to avoid disconnection and authentication with your app
  • 21. Google Algorithm Updates https://technicalseo.com/tools/google-algorithm-updates/ Google Search Status Dashboard https://status.search.google.com/incidents.json maxpr.in/algo-updates-json
  • 22. More Insights (Just) with Search Console Data Combine “dimensions” with the API and/or data from multiple requests to analyze: ● Top Keywords of Top URLs ○ e.g. top 5 keywords for each of the top 100 URLs ○ What % of traffic each keyword represent? e.g. top keyword = 65% of clicks to page ● Cannibalization ○ How many and which pages rank for each keywords? ○ Within same site or across markets (e.g. UK site outranking US site in US)
  • 23. Core Web Vitals ● Leverage the historical data endpoint in CrUX API ● Overlay competitors (programmatically pull from semrush) ● Warning: Search Console report vs. CrUX origin data
  • 24. Search Console Sitemaps API + robots.txt info + HTTP status code checker
  • 25. Jira API Custom table listing all “SEO” issues (based on name, description, label, comments, etc.)
  • 26. Own Data + Natural Language Processing (NLP) Augmented data for deeper performance analysis Clicks, impressions, CTR, position from GSC + Author + Content type (page template) + Site section + Published/modified date + Word count + Core Web Vitals + Content category (classification, entities, tags) + Sentiment analysis (title and/or body) Clicks Impressions CTR # of Pages Beauty & Fitness 1,234,567 34,567,891 3.57% 25 Shopping 456,789 22,333,444 2.05% 65 News 123,456 11,789,101 1.05% 58
  • 27. Own Data + Natural Language Processing (NLP) Augmented data for deeper performance analysis + Clicks Impressions CTR # of Pages Positive 1,234,567 34,567,891 3.57% 25 Neutral 456,789 22,333,444 2.05% 65 Negative 123,456 11,789,101 1.05% 58
  • 28. Generative AI Content briefs, ideation, etc. Explaining data
  • 29. Generative AI OpenAI’s GPT API - Function calling - Integrate any data into your chat/assistant - Eliminate “hallucinations” - New: cheaper pricing for GPT-4 API and improved function calling feature