How to leverage indexation tracking to monitor issues and improve performance

1. How to leverage indexation tracking to monitor issues and improve performance slideshare.net/simonlesser @simonlesser Simon Lesser Dragon Metrics

2. #brightonSEO @simonlesser Simon Lesser Cofounder and CEO Dragon Metrics

4. #brightonSEO @simonlesser The problem:

5. #brightonSEO @simonlesser The problem: Is this list of URLs indexed on Google?

6. #brightonSEO @simonlesser The solution: ¯_(ツ)_/¯

7. #brightonSEO @simonlesser Years spent wandering in the desert…

8. #brightonSEO @simonlesser

9. #brightonSEO @simonlesser Back in my day…

11. #brightonSEO @simonlesser Years spent wandering in the desert…

12. #brightonSEO @simonlesser Test headline!

13. #brightonSEO @simonlesser SEOs

15. #brightonSEO @simonlesser Stupid-easy API Request

16. #brightonSEO @simonlesser (via GSC API)

17. #brightonSEO @simonlesser Simple API Response

19. #brightonSEO @simonlesser Programmatically retrieve the indexation status on Google for multiple URLs that we can choose with details on how they interpreted it Why is this API so special?

20. #brightonSEO @simonlesser Searching for the URL on Google Index status Index details Multiple URLs Choose URLs Programmatic access

21. #brightonSEO @simonlesser Log Files Index status Index details Multiple URLs Choose URLs Programmatic access

22. #brightonSEO @simonlesser Google Search Console Index Coverage Index status Index details Multiple URLs Choose URLs Programmatic access

23. #brightonSEO @simonlesser GSC Page Inspection Tool Index status Index details Multiple URLs Choose URLs Programmatic access

24. #brightonSEO @simonlesser GSC Page Inspection API Index status Index details Multiple URLs Choose URLs Programmatic access (Data pulled via GSC API)

25. #brightonSEO @simonlesser Site operator Log files GSC Index coverage GSC URL Inspection Tool GSC URL Inspection API Index status Index details Multiple URLs Choose URLs Programmatic access

26. #brightonSEO @simonlesser Did Google crawl this URL? When? Why didn’t Google crawl it? Did Google index it? Why not? Finally answers…at scale!

27. #brightonSEO @simonlesser Did Google crawl as desktop or mobile? Did Google encounter crawling issues? What links did Google follow to find this URL? Finally answers…at scale!

28. #brightonSEO @simonlesser Are there any issues with my structured data? Did Google follow my canonical directives? Are there any mobile usability issues? Finally answers…at scale!

29. #brightonSEO @simonlesser A new world of possibilities for indexation tracking

30. #brightonSEO @simonlesser De-Indexation Alerts

31. #brightonSEO @simonlesser De-Indexation Alerts We’ve all done something stupid before

32. #brightonSEO @simonlesser This has never happened before, right? Oops

35. #brightonSEO @simonlesser Monitor indexation of new pages

36. #brightonSEO @simonlesser Diagnose reasons why URLs were not indexed

38. #brightonSEO @simonlesser Find pages where Google chose a different canonical URL User-Declared Canonical Google-Selected Canonical https://example.com/ https://example.com/ https://example.com/products https://example.com/products https://example.com/services https://example.com/services https://example.com/green-widgets https://example.com/purple-widgets https://example.com/blue-widgets https://example.com/blue-widgets https://example.com/red-widgets https://example.com/red-widgets

39. #brightonSEO @simonlesser It’s just not the same…

40. #brightonSEO @simonlesser Must click the link individually (and wait) for every page to see the canonical URL Google chose

41. #brightonSEO @simonlesser Monitor Crawl Frequency

42. #brightonSEO @simonlesser Check pages updated but not recrawled URL CMS Last Updated Google Last Crawled Google has most recent version? https://example.com/ 6/16/22 7/13/22 TRUE https://example.com/products 5/8/22 5/26/22 TRUE https://example.com/services 8/8/22 8/17/22 TRUE https://example.com/about-us 8/15/22 6/8/22 FALSE https://example.com/contact 6/19/22 8/15/22 TRUE https://example.com/support 7/25/22 5/13/22 FALSE

43. #brightonSEO @simonlesser Monitoring progress of site migration

44. #brightonSEO @simonlesser Same reports as GSC, but for specific groups of pages, >1,000 URLs, and programmatically

45. #brightonSEO @simonlesser Verify rich results & look for issues

46. #brightonSEO @simonlesser Uncover mobile usability issues

47. #brightonSEO @simonlesser …and so much more

48. #brightonSEO @simonlesser …there’s a catch

49. #brightonSEO @simonlesser The Achilles Heel

50. #brightonSEO @simonlesser We can get around these limits

51. #brightonSEO @simonlesser The Achilles Heel

52. #brightonSEO @simonlesser What is a site?

53. #brightonSEO @simonlesser Google Search Console site ≠ Domain

54. #brightonSEO @simonlesser Using a single domain property Site: example.com Total daily URLs: 2,000

55. #brightonSEO @simonlesser Using multiple URL-prefix properties Site 1: example.com/products/ Site 2: example.com/services/ Site 3: example.com/support/ … Site 10: example.com/about/ Total daily URLs: 20,000

56. #brightonSEO @simonlesser Update data weekly for 7x URLs Site 1: example.com/products/ Site 2: example.com/services/ Site 3: example.com/support/ … Site 10: example.com/about/ Total weekly URLs: 140,000

57. #brightonSEO @simonlesser Still not scalable for very large sites

58. #brightonSEO @simonlesser Choose the most important key pages to track

59. #brightonSEO @simonlesser Consider log file analysis instead

60. #brightonSEO @simonlesser Search Performance API for indexation

61. #brightonSEO @simonlesser How to do it

62. #brightonSEO @simonlesser Custom app from scratch

63. #brightonSEO @simonlesser People were…excited about this API

64. #brightonSEO @simonlesser Leverage 3rd party scripts Python (by Jean-Christophe-Chouinard) https://www.jcchouinard.com/google-url-inspection-api-with-python/ Node.js (by Jose Luis Hernando) https://jlhernando.com/blog/google-url-inspection-api-nodejs/

65. #brightonSEO @simonlesser Fully integrated into Wix!

66. #brightonSEO @simonlesser Websites for one-off checks valentin.app/inspect.html mydomain.dev

67. #brightonSEO @simonlesser Check right inside Google Sheets keywordsinsheets.com/google-search-console-url-inspection-api-in-sheets

68. #brightonSEO @simonlesser Screaming Frog

69. #brightonSEO @simonlesser Screaming Frog Official Google Data Studio Template

70. #brightonSEO @simonlesser https://lazarinastoy.com/google-search-console-url-inspection-api-in-data-studio- free-dashboard-template/

71. #brightonSEO @simonlesser Use automation for ongoing tracking

72. #brightonSEO @simonlesser Custom app from scratch

73. #brightonSEO @simonlesser Screaming Frog CLI

74. #brightonSEO @simonlesser Cloud apps Leverage cloud apps for hands-off tracking

81. #brightonSEO @simonlesser De-Indexation Alerts

85. #brightonSEO @simonlesser Monitor indexation of new pages

89. #brightonSEO @simonlesser Filter for URLs Filter Coverage for non-indexed pages with unknown reason

90. #brightonSEO @simonlesser Pair with site audit data

91. #brightonSEO @simonlesser Sort by problematic fields and look for common issues

92. #brightonSEO @simonlesser Find pages where Google chose a different canonical URL User-Declared Canonical Google-Selected Canonical https://example.com/ https://example.com/ https://example.com/products https://example.com/products https://example.com/services https://example.com/services https://example.com/green-widgets https://example.com/purple-widgets https://example.com/blue-widgets https://example.com/blue-widgets https://example.com/red-widgets https://example.com/red-widgets

95. #brightonSEO @simonlesser Monitor Crawl Frequency

102. #brightonSEO @simonlesser Check pages updated but not recrawled URL CMS Last Updated Google Last Crawled Google has most recent version? https://example.com/ 6/16/22 7/13/22 TRUE https://example.com/products 5/8/22 5/26/22 TRUE https://example.com/services 8/8/22 8/17/22 TRUE https://example.com/about-us 8/15/22 6/8/22 FALSE https://example.com/contact 6/19/22 8/15/22 TRUE https://example.com/support 7/25/22 5/13/22 FALSE

103. #brightonSEO @simonlesser Pull Last Crawl Date from GSC

104. #brightonSEO @simonlesser Pull Last Update Date from CMS

105. #brightonSEO @simonlesser Compare dates

106. #brightonSEO @simonlesser Monitoring progress of site migration

109. #brightonSEO @simonlesser Links to resources in this deck bit.ly/index-tracking

110. #brightonSEO @simonlesser Resources Aleyda Solis' post on Search Engine Land https://searchengineland.com/seo-tools-google-search- console-url-inspection-api-379955 Python script by Jean-Christophe-Chouinard https://www.jcchouinard.com/google-url-inspection- api-with-python/ Node.js script by Jose Luis Hernando https://jlhernando.com/blog/google-url-inspection-api-nodejs/ Bulk Inspect URLs https://valentin.app/inspect.html MyDomain.Dev by Lino Uruñuela https://tools.mydomain.dev/

111. #brightonSEO @simonlesser Resources Mike Richardson's Google Sheets implementation https://keywordsinsheets.com/google-search-console-url- inspection-api-in-sheets Lazarina Stoy's URL Inspection Google Data Studio template for Screaming Frog https://lazarinastoy.com/google-search-console-url-inspection-api-in-data-studio-free-dashboard-template/ Screaming Frog CLI documentation https://www.screamingfrog.co.uk/seo-spider/user- guide/general/#command-line-interface-set-up URLinspector https://www.urlinspector.com/ Dragon Metrics https://www.dragonmetrics.com/

How to leverage indexation tracking to monitor issues and improve performance

How to leverage indexation tracking to monitor issues and improve performance

Recommended

More Related Content

What's hot

What's hot(20)

Similar to How to leverage indexation tracking to monitor issues and improve performance

Similar to How to leverage indexation tracking to monitor issues and improve performance(20)

Recently uploaded

Recently uploaded(20)

How to leverage indexation tracking to monitor issues and improve performance