SlideShare a Scribd company logo
CRAWLING
AND
INDEXING
In the simplest terms, you could think of searching the
web as looking in a very large book with an impressive
index telling you exactly where everything is located.
When we perform a Google search, Google programs
check their index to determine the most relevant
search results.
There are three process in delivering search results.
1. Crawling – Does Google know about your site and
find it.
2. Indexing – Can Google index your site.
3. Serving – Does the site have good and useful content
that is relevant to search users.
CRAWLING
 Crawling is the process of fetching all the web pages
linked with a website.
 This task is performed by a software called crawler.
The crawlers are also known as spiders or bots , they
visit website and send information to their respective
parent websites.
INDEXING
 Indexing is the process of creating index for all the
fetched web pages and keeping them into a huge
database from where it can later be retrieved.
 An index is another name for the database used by
a search engines. It contains information on all
the websites the search engine was able to find. If a
website is not in a search engine’s index, users will not
be able to find it using that search engine. Search
engines regularly update their indexes.
Difference between Indexing and
Crawling
 Crawling is the process through which indexing is
done. Google crawlers crawls through the WebPages
and index the pages.
 When search engine crawlers visit any link is called
crawling and when crawlers save or index that links in
search engine database is called indexing.
 Crawling means to visit the link by Search engines and
indexing means to put the page contents in Database
(after analysis) and make them available in search
results when a request is made.
 Crawling means the search engine robot crawl or fetch
the web pages while Indexing means search engine
robot crawl the web pages, saved the information and
it appear in the search engine.
THANK YOU

More Related Content

What's hot

Top 10 Free SEO Tools
Top 10 Free SEO ToolsTop 10 Free SEO Tools
Top 10 Free SEO Tools
Simplilearn
 
An introduction to Search Engine Optimization (SEO) and web analytics on fao.org
An introduction to Search Engine Optimization (SEO) and web analytics on fao.orgAn introduction to Search Engine Optimization (SEO) and web analytics on fao.org
An introduction to Search Engine Optimization (SEO) and web analytics on fao.org
FAO
 
On page seo ppt
On page seo ppt On page seo ppt
On page seo ppt
PRAJNAPARAMITAJENA6
 
Google Search Console: An Ultimate Guide
Google Search Console: An Ultimate GuideGoogle Search Console: An Ultimate Guide
Google Search Console: An Ultimate Guide
Tyler Horvath
 
Goolge Panda PPT | Goolge Panda Presentation
Goolge Panda PPT | Goolge Panda PresentationGoolge Panda PPT | Goolge Panda Presentation
Goolge Panda PPT | Goolge Panda Presentation
Keshav Kole
 
Keyword Research
Keyword ResearchKeyword Research
Keyword Research
Biswakesan Mohanty
 
What is SEO | Type of seo | Technique of seo | SEO PPT
What is SEO | Type of seo | Technique of seo | SEO PPTWhat is SEO | Type of seo | Technique of seo | SEO PPT
What is SEO | Type of seo | Technique of seo | SEO PPT
Khalid Shaikh
 
White hat seo vs black hat seo
White hat seo vs black hat seoWhite hat seo vs black hat seo
White hat seo vs black hat seo
INDIAN SEO COMPANY
 
Search Engine Powerpoint
Search Engine  Powerpoint Search Engine  Powerpoint
Search Engine Powerpoint
Partha Himu
 
page ranking algorithm
page ranking algorithmpage ranking algorithm
page ranking algorithm
Javed Khan
 
On page seo PDF
On page seo PDFOn page seo PDF
On page seo PDF
Rinkle Jain
 
Google webmaster tools
Google webmaster toolsGoogle webmaster tools
Google webmaster tools
ianolsonsb
 
Website Analysis Seo Report
Website Analysis Seo ReportWebsite Analysis Seo Report
Website Analysis Seo Report
SEO Google Guru
 
SEO On Page Activities 2014
SEO On Page Activities 2014SEO On Page Activities 2014
SEO On Page Activities 2014
Samskriti Business Solutions
 
Seo ppt - BEGINNERS COURSE - COMPLETE GUIDE - ARISE ROBY
Seo ppt - BEGINNERS COURSE - COMPLETE GUIDE - ARISE ROBYSeo ppt - BEGINNERS COURSE - COMPLETE GUIDE - ARISE ROBY
Seo ppt - BEGINNERS COURSE - COMPLETE GUIDE - ARISE ROBY
Arise Roby
 
Seo
SeoSeo
SEO proposal- www.thecorporateservices.com
SEO proposal- www.thecorporateservices.com SEO proposal- www.thecorporateservices.com
SEO proposal- www.thecorporateservices.com
Corporate Services
 
Introduction to Google Search Console
Introduction to Google Search ConsoleIntroduction to Google Search Console
Introduction to Google Search Console
Riley Haas
 
What is the best steps for seo ? ppt
What is the best steps for seo ? pptWhat is the best steps for seo ? ppt
What is the best steps for seo ? ppt
e-Definers Technology
 

What's hot (20)

Top 10 Free SEO Tools
Top 10 Free SEO ToolsTop 10 Free SEO Tools
Top 10 Free SEO Tools
 
Web crawler
Web crawlerWeb crawler
Web crawler
 
An introduction to Search Engine Optimization (SEO) and web analytics on fao.org
An introduction to Search Engine Optimization (SEO) and web analytics on fao.orgAn introduction to Search Engine Optimization (SEO) and web analytics on fao.org
An introduction to Search Engine Optimization (SEO) and web analytics on fao.org
 
On page seo ppt
On page seo ppt On page seo ppt
On page seo ppt
 
Google Search Console: An Ultimate Guide
Google Search Console: An Ultimate GuideGoogle Search Console: An Ultimate Guide
Google Search Console: An Ultimate Guide
 
Goolge Panda PPT | Goolge Panda Presentation
Goolge Panda PPT | Goolge Panda PresentationGoolge Panda PPT | Goolge Panda Presentation
Goolge Panda PPT | Goolge Panda Presentation
 
Keyword Research
Keyword ResearchKeyword Research
Keyword Research
 
What is SEO | Type of seo | Technique of seo | SEO PPT
What is SEO | Type of seo | Technique of seo | SEO PPTWhat is SEO | Type of seo | Technique of seo | SEO PPT
What is SEO | Type of seo | Technique of seo | SEO PPT
 
White hat seo vs black hat seo
White hat seo vs black hat seoWhite hat seo vs black hat seo
White hat seo vs black hat seo
 
Search Engine Powerpoint
Search Engine  Powerpoint Search Engine  Powerpoint
Search Engine Powerpoint
 
page ranking algorithm
page ranking algorithmpage ranking algorithm
page ranking algorithm
 
On page seo PDF
On page seo PDFOn page seo PDF
On page seo PDF
 
Google webmaster tools
Google webmaster toolsGoogle webmaster tools
Google webmaster tools
 
Website Analysis Seo Report
Website Analysis Seo ReportWebsite Analysis Seo Report
Website Analysis Seo Report
 
SEO On Page Activities 2014
SEO On Page Activities 2014SEO On Page Activities 2014
SEO On Page Activities 2014
 
Seo ppt - BEGINNERS COURSE - COMPLETE GUIDE - ARISE ROBY
Seo ppt - BEGINNERS COURSE - COMPLETE GUIDE - ARISE ROBYSeo ppt - BEGINNERS COURSE - COMPLETE GUIDE - ARISE ROBY
Seo ppt - BEGINNERS COURSE - COMPLETE GUIDE - ARISE ROBY
 
Seo
SeoSeo
Seo
 
SEO proposal- www.thecorporateservices.com
SEO proposal- www.thecorporateservices.com SEO proposal- www.thecorporateservices.com
SEO proposal- www.thecorporateservices.com
 
Introduction to Google Search Console
Introduction to Google Search ConsoleIntroduction to Google Search Console
Introduction to Google Search Console
 
What is the best steps for seo ? ppt
What is the best steps for seo ? pptWhat is the best steps for seo ? ppt
What is the best steps for seo ? ppt
 

Viewers also liked

Difference Between Crawling, Indexing and Caching
Difference Between Crawling, Indexing and Caching Difference Between Crawling, Indexing and Caching
Difference Between Crawling, Indexing and Caching
Laxman Kotte
 
Seo how search engine works
Seo how search engine worksSeo how search engine works
Seo how search engine works
Cybage Software Pvt ltd
 
Brilliant Steps to do Search Engine Optimization
Brilliant Steps to do Search Engine OptimizationBrilliant Steps to do Search Engine Optimization
Brilliant Steps to do Search Engine Optimization
Cjes John
 
Blogging With Word Press -Social Media Bootcamp
Blogging With Word Press -Social Media BootcampBlogging With Word Press -Social Media Bootcamp
Blogging With Word Press -Social Media Bootcamp
wesleyzhao
 
Ted Dunning - Whither Hadoop
Ted Dunning - Whither HadoopTed Dunning - Whither Hadoop
Ted Dunning - Whither HadoopEd Kohlwey
 
Search Engine Optimization - Social Media Bootcamp
Search Engine Optimization - Social Media BootcampSearch Engine Optimization - Social Media Bootcamp
Search Engine Optimization - Social Media Bootcamp
wesleyzhao
 
Search Engine Optimization - Fundamentals - SEO
Search Engine Optimization - Fundamentals - SEOSearch Engine Optimization - Fundamentals - SEO
Search Engine Optimization - Fundamentals - SEO
Neeraj Reddy
 
Challenges Distributed Information Retrieval [RBY] (ICDE 2007 Turkey)
Challenges Distributed Information Retrieval [RBY] (ICDE 2007 Turkey)Challenges Distributed Information Retrieval [RBY] (ICDE 2007 Turkey)
Challenges Distributed Information Retrieval [RBY] (ICDE 2007 Turkey)
Carlos Castillo (ChaTo)
 
Collaborative filtering
Collaborative filteringCollaborative filtering
Collaborative filtering
Neha Kulkarni
 
Indexing popsi....
Indexing popsi....Indexing popsi....
Indexing popsi....
PAQUIAAIZEL
 
Spatial databases
Spatial databasesSpatial databases
Spatial databases
Neha Kulkarni
 
Introduction to indexing (presentation1)
Introduction to indexing (presentation1)Introduction to indexing (presentation1)
Introduction to indexing (presentation1)Mary May Porto
 
Database index(sql server)
Database index(sql server)Database index(sql server)
Database index(sql server)
Aaron King
 
Intelligent crawling and indexing using lucene
Intelligent crawling and indexing using luceneIntelligent crawling and indexing using lucene
Intelligent crawling and indexing using luceneSwapnil & Patil
 
1. indexing and abstracting
1. indexing and abstracting1. indexing and abstracting
1. indexing and abstractingMoses Mbanje
 
Crawling, indexing, ranking: Make the search engine crawlers and algorithms y...
Crawling, indexing, ranking: Make the search engine crawlers and algorithms y...Crawling, indexing, ranking: Make the search engine crawlers and algorithms y...
Crawling, indexing, ranking: Make the search engine crawlers and algorithms y...
SEO monitor
 

Viewers also liked (20)

Difference Between Crawling, Indexing and Caching
Difference Between Crawling, Indexing and Caching Difference Between Crawling, Indexing and Caching
Difference Between Crawling, Indexing and Caching
 
Seo how search engine works
Seo how search engine worksSeo how search engine works
Seo how search engine works
 
Brilliant Steps to do Search Engine Optimization
Brilliant Steps to do Search Engine OptimizationBrilliant Steps to do Search Engine Optimization
Brilliant Steps to do Search Engine Optimization
 
Blogging With Word Press -Social Media Bootcamp
Blogging With Word Press -Social Media BootcampBlogging With Word Press -Social Media Bootcamp
Blogging With Word Press -Social Media Bootcamp
 
Ted Dunning - Whither Hadoop
Ted Dunning - Whither HadoopTed Dunning - Whither Hadoop
Ted Dunning - Whither Hadoop
 
Search Engine Optimization - Social Media Bootcamp
Search Engine Optimization - Social Media BootcampSearch Engine Optimization - Social Media Bootcamp
Search Engine Optimization - Social Media Bootcamp
 
Bcs
BcsBcs
Bcs
 
Web Scraping : Crawling
Web Scraping : CrawlingWeb Scraping : Crawling
Web Scraping : Crawling
 
Search Engine Optimization - Fundamentals - SEO
Search Engine Optimization - Fundamentals - SEOSearch Engine Optimization - Fundamentals - SEO
Search Engine Optimization - Fundamentals - SEO
 
Challenges Distributed Information Retrieval [RBY] (ICDE 2007 Turkey)
Challenges Distributed Information Retrieval [RBY] (ICDE 2007 Turkey)Challenges Distributed Information Retrieval [RBY] (ICDE 2007 Turkey)
Challenges Distributed Information Retrieval [RBY] (ICDE 2007 Turkey)
 
Collaborative filtering
Collaborative filteringCollaborative filtering
Collaborative filtering
 
Indexes
IndexesIndexes
Indexes
 
Indexing popsi....
Indexing popsi....Indexing popsi....
Indexing popsi....
 
Spatial databases
Spatial databasesSpatial databases
Spatial databases
 
Introduction to indexing (presentation1)
Introduction to indexing (presentation1)Introduction to indexing (presentation1)
Introduction to indexing (presentation1)
 
Database index(sql server)
Database index(sql server)Database index(sql server)
Database index(sql server)
 
Intelligent crawling and indexing using lucene
Intelligent crawling and indexing using luceneIntelligent crawling and indexing using lucene
Intelligent crawling and indexing using lucene
 
1. indexing and abstracting
1. indexing and abstracting1. indexing and abstracting
1. indexing and abstracting
 
POPSI
POPSIPOPSI
POPSI
 
Crawling, indexing, ranking: Make the search engine crawlers and algorithms y...
Crawling, indexing, ranking: Make the search engine crawlers and algorithms y...Crawling, indexing, ranking: Make the search engine crawlers and algorithms y...
Crawling, indexing, ranking: Make the search engine crawlers and algorithms y...
 

Similar to Crawling and Indexing

Search Engine Marketing | Top Search Engines | Search Engines List
Search Engine Marketing | Top Search Engines | Search Engines ListSearch Engine Marketing | Top Search Engines | Search Engines List
Search Engine Marketing | Top Search Engines | Search Engines List
paulfrench999
 
Notes for
Notes forNotes for
Notes for9pallen
 
Effective Searching Policies for Web Crawler
Effective Searching Policies for Web CrawlerEffective Searching Policies for Web Crawler
Effective Searching Policies for Web Crawler
IJMER
 
How Google Works
How Google WorksHow Google Works
How Google Works
Ganesh Solanke
 
Web Crawling and Indexing in Information Retrieval.pptx
Web Crawling and Indexing in Information Retrieval.pptxWeb Crawling and Indexing in Information Retrieval.pptx
Web Crawling and Indexing in Information Retrieval.pptx
libafid620
 
A Two Stage Crawler on Web Search using Site Ranker for Adaptive Learning
A Two Stage Crawler on Web Search using Site Ranker for Adaptive LearningA Two Stage Crawler on Web Search using Site Ranker for Adaptive Learning
A Two Stage Crawler on Web Search using Site Ranker for Adaptive Learning
IJMTST Journal
 
How search engine work ppt
How search engine work pptHow search engine work ppt
How search engine work ppt
Shubham Chinchkar
 
Search Engine Optimization (Seo)
Search Engine Optimization (Seo)Search Engine Optimization (Seo)
Search Engine Optimization (Seo)
ssunnysengar
 
Search engine optimization (seo)
Search engine optimization (seo)Search engine optimization (seo)
Search engine optimization (seo)
jhon smith
 
How Search Engines Work
How Search Engines WorkHow Search Engines Work
How Search Engines Work
Your SEO Consultant
 
IJCER (www.ijceronline.com) International Journal of computational Engineerin...
IJCER (www.ijceronline.com) International Journal of computational Engineerin...IJCER (www.ijceronline.com) International Journal of computational Engineerin...
IJCER (www.ijceronline.com) International Journal of computational Engineerin...
ijceronline
 
IJCER (www.ijceronline.com) International Journal of computational Engineerin...
IJCER (www.ijceronline.com) International Journal of computational Engineerin...IJCER (www.ijceronline.com) International Journal of computational Engineerin...
IJCER (www.ijceronline.com) International Journal of computational Engineerin...ijceronline
 
How search engine works
How search engine worksHow search engine works
How search engine works
Ashraf Ali
 
G017254554
G017254554G017254554
G017254554
IOSR Journals
 
An Intelligent Meta Search Engine for Efficient Web Document Retrieval
An Intelligent Meta Search Engine for Efficient Web Document RetrievalAn Intelligent Meta Search Engine for Efficient Web Document Retrieval
An Intelligent Meta Search Engine for Efficient Web Document Retrieval
iosrjce
 
Search engines by Gulshan K Maheshwari(QAU)
Search engines by Gulshan  K Maheshwari(QAU)Search engines by Gulshan  K Maheshwari(QAU)
Search engines by Gulshan K Maheshwari(QAU)
GulshanKumar368
 
How search engine works
How search engine worksHow search engine works
How search engine works
Ashraf Ali
 

Similar to Crawling and Indexing (20)

Search Engine Marketing | Top Search Engines | Search Engines List
Search Engine Marketing | Top Search Engines | Search Engines ListSearch Engine Marketing | Top Search Engines | Search Engines List
Search Engine Marketing | Top Search Engines | Search Engines List
 
Notes for
Notes forNotes for
Notes for
 
Effective Searching Policies for Web Crawler
Effective Searching Policies for Web CrawlerEffective Searching Policies for Web Crawler
Effective Searching Policies for Web Crawler
 
How Google Works
How Google WorksHow Google Works
How Google Works
 
Web Crawling and Indexing in Information Retrieval.pptx
Web Crawling and Indexing in Information Retrieval.pptxWeb Crawling and Indexing in Information Retrieval.pptx
Web Crawling and Indexing in Information Retrieval.pptx
 
A Two Stage Crawler on Web Search using Site Ranker for Adaptive Learning
A Two Stage Crawler on Web Search using Site Ranker for Adaptive LearningA Two Stage Crawler on Web Search using Site Ranker for Adaptive Learning
A Two Stage Crawler on Web Search using Site Ranker for Adaptive Learning
 
Seo Manual
Seo ManualSeo Manual
Seo Manual
 
How search engine work ppt
How search engine work pptHow search engine work ppt
How search engine work ppt
 
Search Engine Optimization (Seo)
Search Engine Optimization (Seo)Search Engine Optimization (Seo)
Search Engine Optimization (Seo)
 
Search engine optimization (seo)
Search engine optimization (seo)Search engine optimization (seo)
Search engine optimization (seo)
 
How Search Engines Work
How Search Engines WorkHow Search Engines Work
How Search Engines Work
 
IJCER (www.ijceronline.com) International Journal of computational Engineerin...
IJCER (www.ijceronline.com) International Journal of computational Engineerin...IJCER (www.ijceronline.com) International Journal of computational Engineerin...
IJCER (www.ijceronline.com) International Journal of computational Engineerin...
 
IJCER (www.ijceronline.com) International Journal of computational Engineerin...
IJCER (www.ijceronline.com) International Journal of computational Engineerin...IJCER (www.ijceronline.com) International Journal of computational Engineerin...
IJCER (www.ijceronline.com) International Journal of computational Engineerin...
 
How search engine works
How search engine worksHow search engine works
How search engine works
 
G017254554
G017254554G017254554
G017254554
 
An Intelligent Meta Search Engine for Efficient Web Document Retrieval
An Intelligent Meta Search Engine for Efficient Web Document RetrievalAn Intelligent Meta Search Engine for Efficient Web Document Retrieval
An Intelligent Meta Search Engine for Efficient Web Document Retrieval
 
Search engines by Gulshan K Maheshwari(QAU)
Search engines by Gulshan  K Maheshwari(QAU)Search engines by Gulshan  K Maheshwari(QAU)
Search engines by Gulshan K Maheshwari(QAU)
 
How search engine works
How search engine worksHow search engine works
How search engine works
 
Search Engine
Search EngineSearch Engine
Search Engine
 
unit 2.pptx
unit 2.pptxunit 2.pptx
unit 2.pptx
 

Recently uploaded

Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...
Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...
Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...
Product School
 
FIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdf
FIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdfFIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdf
FIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdf
FIDO Alliance
 
GraphRAG is All You need? LLM & Knowledge Graph
GraphRAG is All You need? LLM & Knowledge GraphGraphRAG is All You need? LLM & Knowledge Graph
GraphRAG is All You need? LLM & Knowledge Graph
Guy Korland
 
Designing Great Products: The Power of Design and Leadership by Chief Designe...
Designing Great Products: The Power of Design and Leadership by Chief Designe...Designing Great Products: The Power of Design and Leadership by Chief Designe...
Designing Great Products: The Power of Design and Leadership by Chief Designe...
Product School
 
To Graph or Not to Graph Knowledge Graph Architectures and LLMs
To Graph or Not to Graph Knowledge Graph Architectures and LLMsTo Graph or Not to Graph Knowledge Graph Architectures and LLMs
To Graph or Not to Graph Knowledge Graph Architectures and LLMs
Paul Groth
 
UiPath Test Automation using UiPath Test Suite series, part 4
UiPath Test Automation using UiPath Test Suite series, part 4UiPath Test Automation using UiPath Test Suite series, part 4
UiPath Test Automation using UiPath Test Suite series, part 4
DianaGray10
 
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdfFIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
FIDO Alliance
 
Connector Corner: Automate dynamic content and events by pushing a button
Connector Corner: Automate dynamic content and events by pushing a buttonConnector Corner: Automate dynamic content and events by pushing a button
Connector Corner: Automate dynamic content and events by pushing a button
DianaGray10
 
Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024
Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024
Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024
Tobias Schneck
 
Software Delivery At the Speed of AI: Inflectra Invests In AI-Powered Quality
Software Delivery At the Speed of AI: Inflectra Invests In AI-Powered QualitySoftware Delivery At the Speed of AI: Inflectra Invests In AI-Powered Quality
Software Delivery At the Speed of AI: Inflectra Invests In AI-Powered Quality
Inflectra
 
Mission to Decommission: Importance of Decommissioning Products to Increase E...
Mission to Decommission: Importance of Decommissioning Products to Increase E...Mission to Decommission: Importance of Decommissioning Products to Increase E...
Mission to Decommission: Importance of Decommissioning Products to Increase E...
Product School
 
Neuro-symbolic is not enough, we need neuro-*semantic*
Neuro-symbolic is not enough, we need neuro-*semantic*Neuro-symbolic is not enough, we need neuro-*semantic*
Neuro-symbolic is not enough, we need neuro-*semantic*
Frank van Harmelen
 
DevOps and Testing slides at DASA Connect
DevOps and Testing slides at DASA ConnectDevOps and Testing slides at DASA Connect
DevOps and Testing slides at DASA Connect
Kari Kakkonen
 
GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...
GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...
GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...
Sri Ambati
 
Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...
Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...
Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...
Thierry Lestable
 
FIDO Alliance Osaka Seminar: FIDO Security Aspects.pdf
FIDO Alliance Osaka Seminar: FIDO Security Aspects.pdfFIDO Alliance Osaka Seminar: FIDO Security Aspects.pdf
FIDO Alliance Osaka Seminar: FIDO Security Aspects.pdf
FIDO Alliance
 
Assuring Contact Center Experiences for Your Customers With ThousandEyes
Assuring Contact Center Experiences for Your Customers With ThousandEyesAssuring Contact Center Experiences for Your Customers With ThousandEyes
Assuring Contact Center Experiences for Your Customers With ThousandEyes
ThousandEyes
 
Leading Change strategies and insights for effective change management pdf 1.pdf
Leading Change strategies and insights for effective change management pdf 1.pdfLeading Change strategies and insights for effective change management pdf 1.pdf
Leading Change strategies and insights for effective change management pdf 1.pdf
OnBoard
 
State of ICS and IoT Cyber Threat Landscape Report 2024 preview
State of ICS and IoT Cyber Threat Landscape Report 2024 previewState of ICS and IoT Cyber Threat Landscape Report 2024 preview
State of ICS and IoT Cyber Threat Landscape Report 2024 preview
Prayukth K V
 
FIDO Alliance Osaka Seminar: Overview.pdf
FIDO Alliance Osaka Seminar: Overview.pdfFIDO Alliance Osaka Seminar: Overview.pdf
FIDO Alliance Osaka Seminar: Overview.pdf
FIDO Alliance
 

Recently uploaded (20)

Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...
Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...
Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...
 
FIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdf
FIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdfFIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdf
FIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdf
 
GraphRAG is All You need? LLM & Knowledge Graph
GraphRAG is All You need? LLM & Knowledge GraphGraphRAG is All You need? LLM & Knowledge Graph
GraphRAG is All You need? LLM & Knowledge Graph
 
Designing Great Products: The Power of Design and Leadership by Chief Designe...
Designing Great Products: The Power of Design and Leadership by Chief Designe...Designing Great Products: The Power of Design and Leadership by Chief Designe...
Designing Great Products: The Power of Design and Leadership by Chief Designe...
 
To Graph or Not to Graph Knowledge Graph Architectures and LLMs
To Graph or Not to Graph Knowledge Graph Architectures and LLMsTo Graph or Not to Graph Knowledge Graph Architectures and LLMs
To Graph or Not to Graph Knowledge Graph Architectures and LLMs
 
UiPath Test Automation using UiPath Test Suite series, part 4
UiPath Test Automation using UiPath Test Suite series, part 4UiPath Test Automation using UiPath Test Suite series, part 4
UiPath Test Automation using UiPath Test Suite series, part 4
 
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdfFIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
 
Connector Corner: Automate dynamic content and events by pushing a button
Connector Corner: Automate dynamic content and events by pushing a buttonConnector Corner: Automate dynamic content and events by pushing a button
Connector Corner: Automate dynamic content and events by pushing a button
 
Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024
Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024
Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024
 
Software Delivery At the Speed of AI: Inflectra Invests In AI-Powered Quality
Software Delivery At the Speed of AI: Inflectra Invests In AI-Powered QualitySoftware Delivery At the Speed of AI: Inflectra Invests In AI-Powered Quality
Software Delivery At the Speed of AI: Inflectra Invests In AI-Powered Quality
 
Mission to Decommission: Importance of Decommissioning Products to Increase E...
Mission to Decommission: Importance of Decommissioning Products to Increase E...Mission to Decommission: Importance of Decommissioning Products to Increase E...
Mission to Decommission: Importance of Decommissioning Products to Increase E...
 
Neuro-symbolic is not enough, we need neuro-*semantic*
Neuro-symbolic is not enough, we need neuro-*semantic*Neuro-symbolic is not enough, we need neuro-*semantic*
Neuro-symbolic is not enough, we need neuro-*semantic*
 
DevOps and Testing slides at DASA Connect
DevOps and Testing slides at DASA ConnectDevOps and Testing slides at DASA Connect
DevOps and Testing slides at DASA Connect
 
GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...
GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...
GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...
 
Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...
Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...
Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...
 
FIDO Alliance Osaka Seminar: FIDO Security Aspects.pdf
FIDO Alliance Osaka Seminar: FIDO Security Aspects.pdfFIDO Alliance Osaka Seminar: FIDO Security Aspects.pdf
FIDO Alliance Osaka Seminar: FIDO Security Aspects.pdf
 
Assuring Contact Center Experiences for Your Customers With ThousandEyes
Assuring Contact Center Experiences for Your Customers With ThousandEyesAssuring Contact Center Experiences for Your Customers With ThousandEyes
Assuring Contact Center Experiences for Your Customers With ThousandEyes
 
Leading Change strategies and insights for effective change management pdf 1.pdf
Leading Change strategies and insights for effective change management pdf 1.pdfLeading Change strategies and insights for effective change management pdf 1.pdf
Leading Change strategies and insights for effective change management pdf 1.pdf
 
State of ICS and IoT Cyber Threat Landscape Report 2024 preview
State of ICS and IoT Cyber Threat Landscape Report 2024 previewState of ICS and IoT Cyber Threat Landscape Report 2024 preview
State of ICS and IoT Cyber Threat Landscape Report 2024 preview
 
FIDO Alliance Osaka Seminar: Overview.pdf
FIDO Alliance Osaka Seminar: Overview.pdfFIDO Alliance Osaka Seminar: Overview.pdf
FIDO Alliance Osaka Seminar: Overview.pdf
 

Crawling and Indexing

  • 2.
  • 3. In the simplest terms, you could think of searching the web as looking in a very large book with an impressive index telling you exactly where everything is located. When we perform a Google search, Google programs check their index to determine the most relevant search results. There are three process in delivering search results. 1. Crawling – Does Google know about your site and find it. 2. Indexing – Can Google index your site. 3. Serving – Does the site have good and useful content that is relevant to search users.
  • 4. CRAWLING  Crawling is the process of fetching all the web pages linked with a website.  This task is performed by a software called crawler. The crawlers are also known as spiders or bots , they visit website and send information to their respective parent websites.
  • 5. INDEXING  Indexing is the process of creating index for all the fetched web pages and keeping them into a huge database from where it can later be retrieved.  An index is another name for the database used by a search engines. It contains information on all the websites the search engine was able to find. If a website is not in a search engine’s index, users will not be able to find it using that search engine. Search engines regularly update their indexes.
  • 6. Difference between Indexing and Crawling  Crawling is the process through which indexing is done. Google crawlers crawls through the WebPages and index the pages.  When search engine crawlers visit any link is called crawling and when crawlers save or index that links in search engine database is called indexing.
  • 7.  Crawling means to visit the link by Search engines and indexing means to put the page contents in Database (after analysis) and make them available in search results when a request is made.  Crawling means the search engine robot crawl or fetch the web pages while Indexing means search engine robot crawl the web pages, saved the information and it appear in the search engine.