Downloaded 79 times
Uploaded bySimon Lesser
How to leverage indexation tracking to monitor issues and improve performance
The document discusses leveraging indexation tracking to monitor and improve the performance of URLs on Google. It emphasizes the use of APIs and programmatic access to retrieve indexation status, diagnose issues, and provide solutions for indexation challenges at scale. Additionally, it offers resources and tools to assist with automated tracking and diagnostics of website indexation.
More Related Content
![[BrightonSEO 2022] Unlocking the Hidden Potential of Product Listing Pages](https://cdn.slidesharecdn.com/ss_thumbnails/abuali-brightonseo2022slides-221003112121-157abb52-thumbnail.jpg?width=640&height=640&fit=bounds)
Similar to How to leverage indexation tracking to monitor issues and improve performance
How to leverage indexation tracking to monitor issues and improve performance
- 1. How to leverageindexation tracking to monitor issues and improve performance slideshare.net/simonlesser @simonlesser Simon Lesser Dragon Metrics
- 2. #brightonSEO @simonlesser Simon Lesser Cofounderand CEO Dragon Metrics
- 4.
- 5. #brightonSEO @simonlesser The problem:Is this list of URLs indexed on Google?
- 6.
- 7. #brightonSEO @simonlesser Years spentwandering in the desert…
- 8.
- 9.
- 10.
- 11. #brightonSEO @simonlesser Years spentwandering in the desert…
- 12.
- 13.
- 14.
- 15.
- 16.
- 17.
- 18.
- 19. #brightonSEO @simonlesser Programmatically retrievethe indexation status on Google for multiple URLs that we can choose with details on how they interpreted it Why is this API so special?
- 20. #brightonSEO @simonlesser Searching forthe URL on Google Index status Index details Multiple URLs Choose URLs Programmatic access
- 21. #brightonSEO @simonlesser Log Files Indexstatus Index details Multiple URLs Choose URLs Programmatic access
- 22. #brightonSEO @simonlesser Google SearchConsole Index Coverage Index status Index details Multiple URLs Choose URLs Programmatic access
- 23. #brightonSEO @simonlesser GSC PageInspection Tool Index status Index details Multiple URLs Choose URLs Programmatic access
- 24. #brightonSEO @simonlesser GSC PageInspection API Index status Index details Multiple URLs Choose URLs Programmatic access (Data pulled via GSC API)
- 25. #brightonSEO @simonlesser Site operator Log files GSC Index coverage GSCURL Inspection Tool GSC URL Inspection API Index status Index details Multiple URLs Choose URLs Programmatic access
- 26. #brightonSEO @simonlesser Did Googlecrawl this URL? When? Why didn’t Google crawl it? Did Google index it? Why not? Finally answers…at scale!
- 27. #brightonSEO @simonlesser Did Googlecrawl as desktop or mobile? Did Google encounter crawling issues? What links did Google follow to find this URL? Finally answers…at scale!
- 28. #brightonSEO @simonlesser Are thereany issues with my structured data? Did Google follow my canonical directives? Are there any mobile usability issues? Finally answers…at scale!
- 29. #brightonSEO @simonlesser A newworld of possibilities for indexation tracking
- 30.
- 31. #brightonSEO @simonlesser De-Indexation Alerts We’veall done something stupid before
- 32. #brightonSEO @simonlesser This hasnever happened before, right? Oops
- 33.
- 34.
- 35. #brightonSEO @simonlesser Monitor indexationof new pages
- 36. #brightonSEO @simonlesser Diagnose reasonswhy URLs were not indexed
- 37. #brightonSEO @simonlesser Diagnose reasonswhy URLs were not indexed
- 38. #brightonSEO @simonlesser Find pageswhere Google chose a different canonical URL User-Declared Canonical Google-Selected Canonical https://example.com/ https://example.com/ https://example.com/products https://example.com/products https://example.com/services https://example.com/services https://example.com/green-widgets https://example.com/purple-widgets https://example.com/blue-widgets https://example.com/blue-widgets https://example.com/red-widgets https://example.com/red-widgets
- 39. #brightonSEO @simonlesser It’s justnot the same…
- 40. #brightonSEO @simonlesser Must clickthe link individually (and wait) for every page to see the canonical URL Google chose
- 41.
- 42. #brightonSEO @simonlesser Check pagesupdated but not recrawled URL CMS Last Updated Google Last Crawled Google has most recent version? https://example.com/ 6/16/22 7/13/22 TRUE https://example.com/products 5/8/22 5/26/22 TRUE https://example.com/services 8/8/22 8/17/22 TRUE https://example.com/about-us 8/15/22 6/8/22 FALSE https://example.com/contact 6/19/22 8/15/22 TRUE https://example.com/support 7/25/22 5/13/22 FALSE
- 43. #brightonSEO @simonlesser Monitoring progressof site migration
- 44. #brightonSEO @simonlesser Same reportsas GSC, but for specific groups of pages, >1,000 URLs, and programmatically
- 45. #brightonSEO @simonlesser Verify richresults & look for issues
- 46. #brightonSEO @simonlesser Uncover mobileusability issues
- 47. #brightonSEO @simonlesser …and somuch more
- 48.
- 49.
- 50. #brightonSEO @simonlesser We canget around these limits
- 51.
- 52.
- 53. #brightonSEO @simonlesser Google SearchConsole site ≠ Domain
- 54. #brightonSEO @simonlesser Using asingle domain property Site: example.com Total daily URLs: 2,000
- 55. #brightonSEO @simonlesser Using multipleURL-prefix properties Site 1: example.com/products/ Site 2: example.com/services/ Site 3: example.com/support/ … Site 10: example.com/about/ Total daily URLs: 20,000
- 56. #brightonSEO @simonlesser Update dataweekly for 7x URLs Site 1: example.com/products/ Site 2: example.com/services/ Site 3: example.com/support/ … Site 10: example.com/about/ Total weekly URLs: 140,000
- 57. #brightonSEO @simonlesser Still notscalable for very large sites
- 58. #brightonSEO @simonlesser Choose themost important key pages to track
- 59. #brightonSEO @simonlesser Consider logfile analysis instead
- 60. #brightonSEO @simonlesser Search PerformanceAPI for indexation
- 61.
- 62. #brightonSEO @simonlesser Custom appfrom scratch
- 63. #brightonSEO @simonlesser People were…excitedabout this API
- 64. #brightonSEO @simonlesser Leverage 3rdparty scripts Python (by Jean-Christophe-Chouinard) https://www.jcchouinard.com/google-url-inspection-api-with-python/ Node.js (by Jose Luis Hernando) https://jlhernando.com/blog/google-url-inspection-api-nodejs/
- 65.
- 66. #brightonSEO @simonlesser Websites forone-off checks valentin.app/inspect.html mydomain.dev
- 67. #brightonSEO @simonlesser Check rightinside Google Sheets keywordsinsheets.com/google-search-console-url-inspection-api-in-sheets
- 68.
- 69. #brightonSEO @simonlesser Screaming FrogOfficial Google Data Studio Template
- 70.
- 71. #brightonSEO @simonlesser Use automationfor ongoing tracking
- 72. #brightonSEO @simonlesser Custom appfrom scratch
- 73.
- 74. #brightonSEO @simonlesser Cloud apps Leveragecloud apps for hands-off tracking
- 75.
- 76.
- 79.
- 80.
- 81.
- 82.
- 83.
- 84.
- 85. #brightonSEO @simonlesser Monitor indexationof new pages
- 86.
- 87.
- 88. #brightonSEO @simonlesser Diagnose reasonswhy URLs were not indexed
- 89. #brightonSEO @simonlesser Filter forURLs Filter Coverage for non-indexed pages with unknown reason
- 90. #brightonSEO @simonlesser Pair withsite audit data
- 91. #brightonSEO @simonlesser Sort byproblematic fields and look for common issues
- 92. #brightonSEO @simonlesser Find pageswhere Google chose a different canonical URL User-Declared Canonical Google-Selected Canonical https://example.com/ https://example.com/ https://example.com/products https://example.com/products https://example.com/services https://example.com/services https://example.com/green-widgets https://example.com/purple-widgets https://example.com/blue-widgets https://example.com/blue-widgets https://example.com/red-widgets https://example.com/red-widgets
- 93.
- 94.
- 95.
- 96.
- 97.
- 98.
- 99.
- 100.
- 101.
- 102. #brightonSEO @simonlesser Check pagesupdated but not recrawled URL CMS Last Updated Google Last Crawled Google has most recent version? https://example.com/ 6/16/22 7/13/22 TRUE https://example.com/products 5/8/22 5/26/22 TRUE https://example.com/services 8/8/22 8/17/22 TRUE https://example.com/about-us 8/15/22 6/8/22 FALSE https://example.com/contact 6/19/22 8/15/22 TRUE https://example.com/support 7/25/22 5/13/22 FALSE
- 103. #brightonSEO @simonlesser Pull LastCrawl Date from GSC
- 104. #brightonSEO @simonlesser Pull LastUpdate Date from CMS
- 105.
- 106. #brightonSEO @simonlesser Monitoring progressof site migration
- 107.
- 108.
- 109. #brightonSEO @simonlesser Links toresources in this deck bit.ly/index-tracking
- 110. #brightonSEO @simonlesser Resources Aleyda Solis'post on Search Engine Land https://searchengineland.com/seo-tools-google-search- console-url-inspection-api-379955 Python script by Jean-Christophe-Chouinard https://www.jcchouinard.com/google-url-inspection- api-with-python/ Node.js script by Jose Luis Hernando https://jlhernando.com/blog/google-url-inspection-api-nodejs/ Bulk Inspect URLs https://valentin.app/inspect.html MyDomain.Dev by Lino Uruñuela https://tools.mydomain.dev/
- 111. #brightonSEO @simonlesser Resources Mike Richardson'sGoogle Sheets implementation https://keywordsinsheets.com/google-search-console-url- inspection-api-in-sheets Lazarina Stoy's URL Inspection Google Data Studio template for Screaming Frog https://lazarinastoy.com/google-search-console-url-inspection-api-in-data-studio-free-dashboard-template/ Screaming Frog CLI documentation https://www.screamingfrog.co.uk/seo-spider/user- guide/general/#command-line-interface-set-up URLinspector https://www.urlinspector.com/ Dragon Metrics https://www.dragonmetrics.com/