Internet search engines use crawlers or spiders to discover documents and URLs on the web. The spiders send information about the documents and URLs to indexing software. When a user searches for something, the search engine checks its indexed database to return relevant results.