Recommended
More Related Content
Similar to Technical SEO 101: Crawling, Indexing, URLs & More
Similar to Technical SEO 101: Crawling, Indexing, URLs & More (20)
Recently uploaded
Recently uploaded (20)
Technical SEO 101: Crawling, Indexing, URLs & More
- 2. Technical SEO is the process of ensuring that a website meets the technical requirements of modern search engines with the goal of improved organic rankings. Important elements of technical SEO include crawling, indexing, rendering, and website architecture. What is Technical SEO?
- 3. Crawling bots Fatch Data Content can vary it could be a webpage, an image, a video or a PDF The Basic structure of Crawling Crawling Webpages Store in the Index User queries Results Sending Data Ranking Algorithm Crawling is the discovery process in which search engines send out a team of robots to find new and updated content. But regardless of the format, content is discovered by links
- 4. Indexing & Rendering Indexing is how search engines organize the information and the websites that they know about Google bots catagories your content in its data base depanding on its nature and competition Rendering is the process where Googlebot retrieves your pages, runs your code, and assesses your content to understand the layout or structure of your site.
- 5. Caching When ever google bots comes to our website it take a snapshot and that snapshot is called cached version of our website When you are not connected to the live website you are connected to the cached version
- 6. Site-structure Site-structure should be organized Follow a consistent & logical site-structure For example: therahulsharma.com/services/seo
- 7. How to check Indexing & Caching site:therahulsharma.com Cache:therahulsharma.com
- 8. SEO friendly URLs An SEO friendly URL accurately describes the page using keywords that are easy to read for both search engines and users
- 9. Make less depth URLs Use keywords in the URL not but do not stuff Use hyphens(-) to distinguish words not Under score(_) Use lowercase in the urls Ignore numeric labels idea Use trailing slash to define catagory Avoid using dates Do not use special character Tips for SEO friendly URLS
- 10. Sitemap A sitemap is a file where you provide information about the pages, videos, and other files on your site, and the relationships between them. Sitemap helps google bots to crawl our website efficiently within crawl budget
- 11. Why Sitemaps Sitemaps are Good for large websites Your site has a lot of rich media content (video, Images) We need sitemaps if the pages are isolated & not well linked to each other Even without a sitemap, your website can be crawled. However, sitemaps make crawlers' lives easier
- 12. Types of Sitemaps Makes information machine readable Makes information human readable HTML Sitemap XML Sitemap
- 13. How to create XML Sitemaps Automatically get created via Yoast plugin Free sitemap generator tools Custom websites WP websites
- 14. Using plugin- Simple sitemap Manually created by the developer Custom websites WP websites How to create HTML Sitemaps
- 15. robots.txt Robots.txt is a text file with instructions for search engine robots that tells them which pages they should and shouldn't crawl
- 16. Why robots.txt To optimize the crawl budget We do not want the crawler to crawl unwanted pages for security reasons we don't want to take the crawler to unwanted resources on the website robots.txt files are instructions not order to google
- 17. Creating robots.txt files Automatically created by the Yoast plugin Manually on a notepad FILE MANAGER-ROOT DOMAIN (Robots.txt) Custom websites WP websites
- 18. Uploading robots.txt files File manager in Yoast C PANAL - FILE MANAGER-ROOT DOMAIN (Robots.txt) Custom websites WP websites Check whether the robots.txt file properly submitted or not with Webmaster tool robots.txt
- 19. Error 404 Page Users may experience frustration when encountering 404 errors, hence the main goal of this page is to make this experience positive. Stops audience diverting with error 404 page
- 20. Redirections A redirection is to send both users and search engines to a different URL from the one they originally requested Redirection is a solution to the broken link
- 21. Permanent Redierction Temprarory Redierction Types of Redirections 301 Redierect 302 Redierect
- 22. When to apply 301 Redirection When the webpage/website is moved The Domain is changed Ownership is changed Duplicate page/ post Http to https Page Rank & link juice will be transferred to the new page/website
- 23. When to apply 302 Redirection When page/website is updating or under maintenance Should be relevant page to be transferred on Link juice and authority will not be transferred
- 24. Schema markup structured data Schema markup (schema.org) is a structured data vocabulary that helps search engines to understand your website's content in a better way. It is inter search engines platform
- 25. Why schema markup is important It tells search engines about your website in a better way Check the schema in the source code It improves the appearance of your website on SERP We can put more than one schema on one website
- 26. Types of Schema Markup Make a Separate faq page and then put the schema
- 27. How to apply Schema Markup Use All In one snippets plungs If you have one schema then put it on the website header Copy from your competitor We can put more than one schema on one website
- 28. Opengraph Open graph is a protocol created by Facebook to standardize the use of metadata on webpages
- 29. How to apply Opengraph Social in Yoast https://smallseotools.com/open-graph- generator/ Custom websites WP websites Check whether the robots.txt file properly submitted or not with Webmaster tool robots.txt
- 30. Twitter Card The Twitter cards feature lets you attach rich photos, videos, and media experiences to Tweets, driving traffic to your website
- 31. How to apply Twitter Cards Social in Yoast https://wtools.io/twitter-card-generator Custom websites WP websites